Deepyansh Shah

Looking for a job

Data Engineer

Data Engineer at Go Digital Technology Consulting LLP who cut pipeline load time by 67% and AWS costs by $29K/year.

IndiaData Engineer at Go Digital Technology Consulting LLP

Experience

Data Engineer
Reduced AWS infrastructure costs by $29,000/year and cut pipeline load time by 67% (4.5hrs to 1.5hrs). Migrated terabytes of on-premises Hadoop data to AWS without data loss.
AWSPySparkKafkaAirflowDatabricksTerraformDockerKubernetesCI CDDelta LakeApache IcebergHadoopHiveLang ChainLangGraphAgentic AIRAGMCPQdrantOpenAI SDKTool callingNeo4jPythonSQLBASHShell ScriptingfastAPIPydanticRedisMongoDBDynamoDBAurora RDSPandasNumPyAWS SDK (Boto3)AWS Wrangler

Vasantdada Patil Pratishthan College of Engineering
Pursued a Bachelor of Engineering in Information Technology, graduating in 2022.
Pursued a Bachelor of Engineering in Information Technology, graduating in 2022.

Loading profile…

Looking for a job

Data Engineer

Data Engineer at Go Digital Technology Consulting LLP who cut pipeline load time by 67% and AWS costs by $29K/year.

IndiaData Engineer at Go Digital Technology Consulting LLP

Data Engineer
Reduced AWS infrastructure costs by $29,000/year and cut pipeline load time by 67% (4.5hrs to 1.5hrs). Migrated terabytes of on-premises Hadoop data to AWS without data loss.
AWSPySparkKafkaAirflowDatabricksTerraformDockerKubernetesCI CDDelta LakeApache IcebergHadoopHiveLang ChainLangGraphAgentic AIRAGMCPQdrantOpenAI SDKTool callingNeo4jPythonSQLBASHShell ScriptingfastAPIPydanticRedisMongoDBDynamoDBAurora RDSPandasNumPyAWS SDK (Boto3)AWS Wrangler

Vasantdada Patil Pratishthan College of Engineering
Pursued a Bachelor of Engineering in Information Technology, graduating in 2022.
Pursued a Bachelor of Engineering in Information Technology, graduating in 2022.