Ingestion and pipelines: vendor feeds, APIs and scraping jobs - scheduled, idempotent, monitored, with backfills and alerts when a feed stops or drifts. Schema and data model: the Postgres schema and data dictionary as the source of truth, including...
- PostgreSQL
- Hasura
- PostHog
- Python
- Airflow
- Prefect
- Pandas
- Dagster
- Polars
- Docker
- +9
- +10