Deep-dive into building a Scala SDK for CDC at petabyte scale on GCP. Learn partition pruning, getAffectedPartitions, cloud-native backups, and CDC without ACID. Includes metrics, scan reduction stats, and code from Delta/Hive lakes.
Breakdown of my GDE acceptance journey. Learn contribution tracking, referral tactics, interview focus areas, OSS PR examples, blogging setup, CFP submissions, and mentorship. Includes the spreadsheet system and interview questions.
Build reusable Scala utilities for data engineering on GCP, covering CDC, Delta maintenance, schema evolution, GCS helpers, affected-partition strategies, and error handling. Includes patterns for safe ops and repeatable pipelines.
Guide to building AI pipelines with BigQuery ML and Vertex AI. Learn SQL-first modeling, real-time endpoints, automated retraining, and drift monitoring. Includes diagrams and code that cut time-to-model from 6 weeks to 2 hours fast.
Building a demand forecasting system with Random Forest, ANN, and hybrid time-series models on Hadoop and Spark. Covers data ingestion, feature engineering, model training, validation, and rollout for large SKU catalogs and seasonality.