Analytics / Dataset Explorer

Find BSOS datasets, preview what is available, and explore the data without getting lost.

This dashboard keeps the public tools up front: search for a dataset, compare regions and categories, preview files, and run safe read-only queries where live public tables are available. Local maintenance tools still exist, but they stay clearly marked as optional.

Browse Dataset Catalog Back to Repository Home Find a Dataset Browse Public Data

Start Here

Most visitors only need three steps:

Use the filters to narrow the collection by category, region, status, or access type.
Open Find a Dataset for one dataset at a time, with previews and plain-language details.
Use Browse Public Data when you want a safe, guided query tool instead of raw SQL.

0 Datasets in the current view

0 Ready-to-preview datasets

0 Live public query tables

0 Total rows represented in the pilot

Analytics workspaces

Switch between focused public workspaces instead of scrolling through every dashboard layer at once.

Keep the filters above in place, then open one panel at a time. Each workspace shows only the tools and charts for the current task: orientation, dataset inspection, guided public queries, collections, quality checks, or support paths.

Loading analytics payload and rendering charts...

Approved dataset catalog

Browse active datasets first, then submit anything new through the review queue.

Browse active datasets Open upload form

This landing view only reflects approved datasets already present in the active analytics payload. Large incoming files should be shared through Google Drive or Dropbox links, then approved by an admin before publication.

Loading approved dataset summary...

Active datasets

Click any card to jump into the explorer with its detail workspace already selected.

Admin review queue

Select a dataset from the explorer to open its pilot workspace.

Try a ready-made question

These starter queries are the fastest way to explore the exported pilot views without learning the schema first.

Loading starter queries from the read-only pilot API...

Browse exported pilot data

Use this guided workspace to search one allowlisted view at a time and download the current results as CSV.

Pilot view

Filter field

Match this value

Rows to show

Sort field

Sort direction

OffsetUse this to move through longer result sets page by page.

Loading pilot view metadata...

This workspace remains read-only and only exposes selected export views.

Advanced: view the raw API request

Public API request

Copy or open the rate-limited JSON request behind the current controls.

Open API JSON

Pilot query results

No pilot query has run yet.

Collections

Browse the current region and category groupings. Select any card to narrow the dataset explorer to that collection without duplicating organization navigation.

Rows vs Columns

Quick comparison of table volume and variable breadth in the current scope.

Pilot Readiness

A weighted score combining materialization, documentation, source trace, download route, preview or live query access, and issue flags.

Wrangling Matrix

Use this to spot which datasets are ready for immediate teaching use, which ones have live preview routes, and which still need caution.

Dataset	Status	Rows	Cols	Preview	Support Docs	Live Table	Issues	Readiness

Public tools for most visitors

Most people can stay entirely within the public site. Use the explorer for one dataset at a time, browse exported pilot views in the guided query tab, and open files or live tables directly from here.

Start with Find a Dataset when you want a plain-language summary for one dataset.
Use Browse Data for starter queries and guided, read-only searches across exported pilot views.
Use the dataset preview or live query tools to inspect results before downloading.
Open the dataset page or resource links when you want the original catalog record or direct file access.

Find a Dataset

Best when you want to inspect one dataset, its preview, links, and support materials.

Browse Data

Best when you want a guided search across allowlisted exported views or live public tables.

Collections

Best when you want to compare dataset coverage by region and teaching category.

Help & Downloads

Best when you want the direct public links, download paths, or optional local admin workflow.

Optional local admin workflow

Most visitors can ignore this section. Use it only when you are maintaining the same-computer PostgreSQL pilot and pgAdmin workspace.

Show local-only maintenance commands

Start Local Pilot pgAdmin

bash scripts/start_pilot_pgadmin.sh

Same computer only

Refresh The Pilot

docker compose --env-file .env -f config/postgres-pilot/docker-compose.yml up -d
python scripts/postgres_pilot_refresh.py --ensure-schema

Open Local pgAdmin Pilot

http://127.0.0.1:8082/browser/
Login: BSOS_PILOT_PGADMIN_EMAIL / BSOS_PILOT_PGADMIN_PASSWORD from .env
Server: BSOS Metadata Pilot

Open local pgAdmin pilotSame computer only

Backend Maintenance Flow

Open sql/pgadmin_dataset_walkthrough.sql in pgAdmin Query Tool
Start with BSOS Metadata Pilot > bsos_catalog
Use bsos_browser for inventory and summaries
Use bsos_dataset_views for per-dataset profiles
Use bsos_data for imported local rows
Use bsos_summary for import and profiling history

Export One Dataset View

python scripts/export_postgres_pilot.py --dataset american-non-voters

Stop Local Pilot pgAdmin

bash scripts/stop_pilot_pgadmin.sh

Contribute a dataset to a group collection

Submit a primary data file or a Google Drive / Dropbox link into one of the existing group collections. Every submission now enters a pending review queue first, so nothing appears in the approved dataset catalog until an admin explicitly approves it.

Pick the group that matches your dataset topic — the form only lists groups that already exist on the site.
Direct uploads are limited to 50 MB per file. Use a Google Drive or Dropbox link for anything larger.
Primary files must be CSV, TSV, XLSX, JSON, or Parquet. A codebook or usage guide is still strongly recommended.
Every submission is queued for admin review before it appears in the active dataset catalog.
Provide at least three tags so reviewers can route the dataset into the right filters and collections.

Group collection

Dataset title

Description (what it contains, why it matters)

Tags (comma separated, minimum three)

Region label (optional)

Year(s) covered (optional)

Your name (optional, shown to reviewers)

Large file link (optional Google Drive or Dropbox) Use this instead of the primary upload when the dataset exceeds the direct upload limit.

Primary data file (optional when a link is provided) Choose either a direct file upload or an external link for the primary dataset source.

Support document (optional — codebook, questionnaire, guide)

Admin authorization

Review access uses the upload server's admin credentials. Approved submissions are written into the public analytics payload; rejected submissions stay in the queue history with their review notes.

Checking admin session...

Pending submission queue

Approve anything ready for publication, or reject it with a note so the submitter can correct the package before it reaches the active catalog.