Daniel Andrade

Sr Data Engineer

Capital One

Engineered ETL pipelines using Apache Spark and Python for real-time analytics. Designed data warehouse solutions on AWS Redshift and optimized SQL queries to improve performance by 30%.

Apache SparkPythonAWS RedShiftSQLAirflowData GovernanceData QualityData SecurityETLELTData WarehouseCloud ArchitectureDistributed SystemsMachine LearningData Lineage

Sr Data Engineer

Dealpath

Architected scalable data pipelines using PySpark and Databricks for real estate analytics. Developed lakehouse architecture with Delta Lake and improved data availability by 25%.

PySparkDatabricksDelta LakeAWSDBTAirflowData QualityData GovernanceData SecurityETLELTLakehouseCloud ArchitectureCost Optimization

Sr Data Engineer

Designed and developed ETL pipelines using Scala and Apache Spark. Implemented data lake solutions on AWS S3 and optimized SQL performance improving query speed by 20%.

ScalaApache SparkS3SQLAirflowData QualityData GovernanceData SecurityETLData LakeCloud ArchitectureStreamingBatch Processing

Data Engineer Intern

Developed data ingestion pipelines using Python and SQL for research analytics. Assisted in building data models and implementing data validation processes.

PythonSQLData ModelingData ValidationData QualityETL

Data Engineering Intern

Supported development of ETL workflows using Python and SQL for academic projects. Contributed to database schema design and data cleansing activities.

PythonSQLETLDatabase DesignData Quality