Indian Stock Market Pipeline 📈
A lightweight, serverless GCP pipeline that automatically fetches, analyzes, and visualizes Indian stock market data with technical indicators and anomaly detection.
Features
- Daily automated data ingestion from Indian Stock Exchange API
- Technical indicators calculation (7-day moving averages)
- Interactive Looker Studio dashboard
- Serverless architecture for cost efficiency
- Automated scheduling with Cloud Scheduler
Technology Stack
- Cloud Platform: Google Cloud Platform
- Data Storage: BigQuery for analytics and warehousing
- Compute: Cloud Functions for serverless data processing
- Scheduling: Cloud Scheduler for automated triggers
- Visualization: Looker Studio for interactive dashboards
- API: Indian Stock Exchange API (free tier)
Architecture
The pipeline follows a serverless ETL pattern:
- Extract: Cloud Functions fetch daily stock data
- Transform: Calculate technical indicators and detect anomalies
- Load: Store processed data in BigQuery
- Visualize: Real-time dashboard updates in Looker Studio
