Analytics / Pilot Explorer

Explore the BSOS catalog, pilot tables, and wrangling workflow in one place.

This workspace brings together the public catalog, PostgreSQL pilot inventory, download links, previewable CSV and DataStore resources, a public read-only query workspace, and the optional local pgAdmin workflow for deeper row-level work on the same machine.

Loading pilot analytics payload...

Loading analytics payload and rendering charts...

Largest Pilot Tables

Top imported datasets by local row count in the PostgreSQL pilot.

Pilot Status Mix

How many datasets are imported, blocked, or otherwise limited in the current view.

Group Coverage

Dataset count by fellowship or thematic group in the filtered scope.

Access Modes

Whether users reach the data through DataStore, direct files, or external sources.

Select a dataset from the explorer to open its pilot workspace.

Starter Queries

Use one-click questions to browse allowlisted pilot export views without writing SQL or learning the schema first.

Loading starter queries from the read-only pilot API...

Read-Only Pilot View API

This server-side workspace queries allowlisted exported pilot views, applies rate limits, and returns JSON or CSV for the current result set.

Page through larger export views without exposing unrestricted SQL.

Loading pilot view metadata...

This workspace remains read-only and only exposes selected export views.

Public API request

Copy or open the rate-limited JSON request behind the current pilot query controls.

Open API JSON
Pilot query results
No pilot query has run yet.

Groups & Organizations

Browse all thematic groups and the contributing organization together. Click any card to filter the Pilot Explorer to that scope.

Rows vs Columns

Quick comparison of table volume and variable breadth in the current scope.

Pilot Readiness

A simple heuristic combining import status, previewability, support docs, and issue flags.

Wrangling Matrix

Use this to spot which datasets are ready for immediate teaching use, which ones have live preview routes, and which still need caution.

Dataset Status Rows Cols Preview Support Docs Live Table Issues Readiness

How Public Querying Works Here

The public analytics view centralizes catalog context, row and column counts, resource links, previewable files, and a safe read-only query builder backed by CKAN DataStore. The local pgAdmin pilot remains a same-machine research tool for browsing the PostgreSQL pilot schemas directly.

  1. Use the Pilot Explorer here to find a dataset and inspect its table name, links, and wrangling status.
  2. Open the Pilot Query API tab to run starter queries across allowlisted export views without writing SQL.
  3. Run the public query builder for datasets with CKAN DataStore coverage, then download the filtered rows as CSV.
  4. Use the preview and resource links for direct public downloads when a live query table is not available.
  5. Use the local pgAdmin workflow only when you are running the pilot stack on the same computer.
bsos_browser

Start here for inventory, column summaries, missing values, and chart-ready aggregates.

bsos_dataset_views

Use the per-dataset summary views when you want a metadata profile first.

bsos_data

Browse actual imported rows in pgAdmin under the pilot table name shown in the explorer.

bsos_summary

Inspect import history, resource materialization, and deeper profiling records.

Refresh, Public Query, and Local Research

These links and commands keep the analytics page aligned with the latest exports while separating public access from local-only admin tooling.

Public Query Workspace

Open /analytics/
Choose a dataset in Pilot Explorer
Run the Public query workspace controls
Download the filtered result as CSV

Pilot Query API

Open /analytics/
Switch to the Pilot Query API tab
Run a starter query or choose an allowlisted view
Open /analytics/api/pilot-query/meta for metadata

Refresh The Pilot

docker compose --env-file .env -f config/postgres-pilot/docker-compose.yml up -d
python scripts/postgres_pilot_refresh.py --ensure-schema

Open Local pgAdmin

http://127.0.0.1:8082/browser/
Open local pgAdminSame computer only

Export One Dataset View

python scripts/export_postgres_pilot.py --dataset american-non-voters