Loading profile…
Loading profile…
Data Engineer
I build scalable enterprise data pipelines for batch and near-real-time pricing platforms.
IndiaData Engineer at McKinsey & Company
Architected and led backend data engineering solutions for a configurable Universal Data Editor, enabling batch and near real-time data synchronization. Designed metadata-driven ETL frameworks processing 15M+ records, reducing onboarding effort by 70% and improving pipeline performance by 40%.
PythonSQLPySparkApache SparkDelta LakeKafkaAirflowAzure DatabricksUnity CatalogCI CDGitlabPower BIData QualityETL
Pursued a Bachelor of Engineering in Computer Science, achieving a CGPA of 8.74.
Developed and deployed a configurable Go/No-Go Data Validation Framework using SQL, Spark SQL, and PySpark, automating pre-deployment data quality validation. Engineered scalable ETL ingestion pipelines and Power BI dashboards for automated validation reporting.
SQLPySparkETLPower BIData Quality
Profile sourced from Himalayas.