Loading profile…
Loading profile…
Senior Data Engineer
Senior Data Engineer at TechOptima, applying Amazon Bedrock to data quality and metadata workflows on AWS.
IndiaSenior Data Engineer at TechOptima
Worked on an AI-assisted data quality and metadata project on AWS, using Amazon Bedrock to generate column descriptions and plain-language summaries of data issues. Built and maintained AWS Glue and PySpark jobs to ingest, clean, and standardize data into Amazon S3 and Amazon Redshift.
AWSAmazon BedrockAWS GluePySparkPythonSQLS3Amazon RedshiftAWS LambdaEventBridgeStep FunctionsCloudwatchData QualityMetadata Management
Developed cloud-native ETL/ELT pipelines using AWS Glue, Python, PySpark, SQL, Amazon S3, and Amazon Redshift. Built real-time streaming pipelines using Apache Kafka and Amazon MSK, and optimized Snowflake objects for reporting and analytics.
AWSAWS GluePythonPySparkSQLS3Amazon RedshiftKafkaAmazon MSK (Kafka)SnowflakeData QualityETLELTData Lake
Designed and developed scalable ETL pipelines using Python, SQL, AWS Glue, PySpark, and Amazon EMR. Migrated enterprise workloads to AWS and Snowflake, and created workflow orchestration using Apache Airflow.
PythonSQLAWS GluePySparkAmazon EMRApache SparkAirflowSnowflakeS3Amazon RedshiftData MigrationETLData Quality
Developed ETL workflows using Python, SQL, and AWS services to integrate data from multiple enterprise source systems. Implemented data quality checks and supported cloud migration activities.
PythonSQLAWSS3Amazon RedshiftPostgreSQLETLData QualityCloud Migration
Supported data extraction, cleansing, and transformation tasks using SQL and Python for internal reporting needs. Created ad hoc SQL reports and dashboards to support business stakeholders.
SQLPythonData AnalysisData CleaningReportingDashboarding
Bachelor of Commerce degree from GITAM University, Hyderabad, completed in 2017.
Bachelor of Commerce degree from GITAM University, Hyderabad, completed in 2017.
Profile sourced from Himalayas.