Real-Time Crypto
Streaming Pipeline
Problem: analytics teams need near-real-time crypto price data without manual polling. This 7-stage pipeline ingests 10 assets from CoinGecko every 30 seconds, streams through Redpanda (Kafka-compatible), persists to PostgreSQL, transforms via dbt (14 tests), and surfaces in a live Metabase dashboard, orchestrated by Airflow and deployed to Oracle Cloud ARM via 90-second GitHub Actions CI/CD.