Skip to content

Added competitions ETL pipeline and monitoring UI#54

Closed
mosda95200 wants to merge 1 commit intostatsbomb:masterfrom
mosda95200:feature/etl-competitions-ui
Closed

Added competitions ETL pipeline and monitoring UI#54
mosda95200 wants to merge 1 commit intostatsbomb:masterfrom
mosda95200:feature/etl-competitions-ui

Conversation

@mosda95200
Copy link

@mosda95200 mosda95200 commented Mar 8, 2026

Summary

  • add Python ETL for data/competitions.json (extract/transform/load)
  • load into PostgreSQL with upsert support and ETL run logging
  • add local monitoring web UI (app.py) with detailed run insights
  • add setup and run documentation in ETL_COMPETITIONS.md

Validation

  • python3 -m py_compile app.py etl/config.py etl/db.py etl/competitions_etl.py run_competitions_etl.py
  • successful ETL run in PostgreSQL: 75 competition rows loaded
  • UI checks: /health returns ok and dashboard sections render

@mosda95200 mosda95200 closed this by deleting the head repository Mar 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant