Loading profile…
Loading profile…
Staff Data Engineer
Senior Data Engineer specializing in cloud-native data platforms, MLops, and real-time analytics.
United StatesStaff Data Engineer at Segment
Architected and deployed cloud-native data pipelines using Spark, Delta Lake, and Databricks, improving processing throughput by 30% and reducing data delivery latency by 40% with real-time streaming solutions.
Apache SparkDatabricksDelta LakeKafkaAirflowDBTMLFlowPrometheusTerraform
Designed scalable pipelines and feature stores for AI/ML workloads, implemented vector DBs and RAG pipelines, and productionized ML services with CI/CD and monitoring to ensure model reliability.
DatabricksDelta LakeFaissChromaDBMLFlow
Built batch and streaming ETL pipelines with PySpark, Airflow, and Kafka processing 5TB/month, implemented data validation to reduce bad data incidents by 50%, and optimized cloud data warehouse performance.
PySparkKafkaGreat ExpectationsS3AirflowPower BISQLGrafana
Profile sourced from Himalayas.