Loading profile…
Ismael Estalayo
Looking for a jobSenior Data Engineer
Senior Software/Data Engineer with over 7 years of experience in big-data projects as well as developing native Android and Windows apps.
JapanSenior Data Engineer at Clarity AI
About
I like tackling challenging tasks at work, and digging deep into the issues to understand and solve them efficiently.
At Clarity AI, I designed and maintained orchestrated ETL pipelines for SFDR, SI, and MiFID reporting. I also drove a data lineage and explainability initiative to improve the reliability and auditability of data flows.
At Idealista, I migrated a 100TB data lake to AWS and built an automated data quality pipeline for live user events. Earlier, I developed a network traffic analysis pipeline that evolved into a SIEM solution at Keynetic Technologies, and built Crypto Tracker, a Windows app that reached over 100k lifetime acquisitions.
Experience
Senior Data Engineer
Designed and maintained end-to-end orchestrated ETL pipelines and batch chains for regulatory reporting modules. Spearheaded a data explainability and lineage initiative to improve reliability and auditability.
PythonPandasSQLAirflowSnowflakePostgreSQLDBTAWS
Data Engineer
Worked within a small team with a strict zero-event-loss approach, streaming live user events through Kafka. Single-handedly migrated a 100TB data lake from on-premise to AWS, achieving significant cost reduction.
ScalaJavaKafkaAWSClickhouseSQL
Education
University of the Basque Country
MSc in Telecommunication Engineering, specializing in Telematics, with a final grade of 8.46. Included an Erasmus semester in Vilnius, Lithuania, and a thesis on a SIEM solution for industrial environments.
University of the Basque Country
BSc in Telecommunication Engineering, specializing in Telematics, with a final grade of 6.97. Taught programming and 3D printing courses to kids, and wrote a thesis on cryptocurrency investment optimization using ML.