nvrbot-scraper

Incorporate design notes into reporting spec

Update and test daily cron job

Build/update orchestration script (daily_run.sh)

[T31] **Export unified dataset** (May 2024 - present)

[T30] **Deduplicate and validate merged dataset**

[T29] **Load and merge old + new processed data**

[T28] **Process all new backfill data**

[T27] **Build output module** (`cleanup/output.py`)

[T26] **Build validation module** (`cleanup/validators.py`)

[T25] **Build lookup tables module** (`cleanup/lookups.py`)

[T24] **Build transformation script** (`cleanup/transform.py`)

Add 'Only show complete months' filter toggle to dashboard

2026-02-16

Fix dashboard graph data disappearing on page navigation

2026-02-16

Automated Master.json Pipeline - Implementation Complete

2026-02-14

Move NVRBOT Online

2026-02-14

Update scraping pipeline to push to Supabase

2026-02-14

Test and verify production deployment

2026-02-14

Deploy to Streamlit Community Cloud

2026-02-14

Set up GitHub repo for reports app

2026-02-14

Create requirements.txt and Streamlit config

2026-02-14

Refactor reports/db.py for PostgreSQL

2026-02-14

Migrate existing data to Supabase

2026-02-14

Write SQLite to PostgreSQL migration script

2026-02-14

Create Supabase project and database schema

2026-02-14

Polish NVRBOT dashboard with modern UI design

2026-02-13

Reports: Time Analysis - stacked bar by class type

2026-02-13

Reports: Add class type filter to Seats Filled + Fill Rates

2026-02-13

Reports: Refactor all pages to use studio selector

2026-02-13

Reports: Add studio selector component with toggle switches

2026-02-13

Reports: Update SQLite schema with studio_id + lookup table

2026-02-13

Reporting Portal: Data Explorer + CSV export

2026-02-13

Reporting Portal: Time of Day + Instructor analysis

2026-02-13

Reporting Portal: Ramp Data pivot table

2026-02-13

Reporting Portal: Seats Filled + Fill Rates charts

2026-02-13

Reporting Portal: Dashboard page with KPIs

2026-02-13

Reporting Portal: Streamlit app structure + theme

2026-02-13

Add sequential studio_id for database normalization

2026-02-13

Fix location field mapping and normalization

2026-02-13

Fix class type classification priority order

2026-02-13

Reporting Portal: SQLite database setup

2026-02-13

Merge legacy data into master file

2026-02-13

Reporting analysis: Zoho Analytics vs custom solution

2026-02-13

Document and consolidate FULL scraped dataset (Nov 2024+)

2026-02-13

Fix scraper to capture today's data (not yesterday)

2026-02-13

Full pipeline audit: daily scrape → transform → merge to master

2026-02-13

Daily processing workflow: transform + move to processed folder

2026-02-13

Transform: OtherShip weekday evening cancellation detection

2026-02-13

Transform: Handle Waitlist Only - lookup historical capacity

2026-02-13

Transform: Add yoga boolean flag

2026-02-13

Transform: Split multiple instructors on pipe

2026-02-13

Transform: Rename fields to historical schema

2026-02-13

[T2] **Design final schema**

2026-02-13

[T7] Implement Momence scraper for Soul Plunge

[T8] Implement Momence scraper for Conscious Body Recovery

[T11] Investigate S&T availability data issue

[T12] Add S&T Biohacking locations (if needed)

[T42] **Add data retention policy**

[T15] ~~Backfill investigation & resolution~~ (02-03)

2026-02-13

[T17] ~~Reset behind studios to current date~~ (02-03)

2026-02-13

[T0] ~~Validate scraper connections~~ (02-01)

2026-02-13

[T1] ~~Fix BD_CARLSBAD & MZ_MYRTLE scrapers~~ (02-01)

2026-02-13

[T5] ~~Research Soul Plunge (La Jolla)~~ (02-01)

2026-02-13

[T6] ~~Research Conscious Body Recovery~~ (02-01)

2026-02-13

[T9] ~~Data Check & Scrape Run~~ (02-01)

2026-02-13

[T10] ~~Add Sweat and Tonic to scraper~~ (02-01)

2026-02-13

[T181] ~~Document cleanup spec~~ (02-01)

2026-02-13

[T16] ~~Fix BD_CARLSBAD URL to include location ID~~ (02-02)

2026-02-13

[T182] ~~Add incremental saves to backfill~~ (02-03)

2026-02-13