Azure Data Integration Engineer

i4DMUnited States only

Apply now

Opens the original posting on Himalayas.

Apply now Source: Himalayas

Apply on the original site

Companies in this catalog do not charge applicants. Never send money to apply.

Description

About the Role:

We are seeking an experienced Azure Data Integration Engineer to support ATLAS, the VA’s open-architected, multi-cloud enterprise data management and analytics platform. In this role, you will design, develop, and maintain scalable Azure-based pipelines and ETL/ELT solutions that ingest, condition, curate, and transform multi-source data into standardized, consumable enterprise data products. You will use Azure Data Factory, Synapse, Databricks, Azure Data Lake, and related services to improve interoperability among key data platforms and provide consistent, secure access to trusted data regardless of its source or stage of curation. Working with analysts, data scientists, product teams, and enterprise users, you will help deliver actionable insights that enable evidence-based decisions and improve outcomes for Veterans and their families.

Loading job…

Azure Data Integration Engineer at i4DM · ApplyPick

Design and implement scalable, secure, and efficient data pipelines using Azure Data Factory (ADF).
Develop and optimize ETL processes to ingest, transform, and store data in Azure Data Lake, SQL, and Synapse Analytics.
Automate data ingestion from structured and unstructured sources like APIs, databases, and IoT streams.
Build and maintain data lakes, warehouses, and lakehouses using Azure Data Lake, Synapse, and Databricks.
Optimize storage and retrieval of data using Parquet, Delta Lake, and columnar storage formats.
Ensure high availability, scalability, and performance tuning for large-scale datasets.
Implement batch and real-time data streaming solutions using Azure Stream Analytics, Event Hub, and Kafka.
Work with big data processing frameworks such as Apache Spark (Databricks) and HDInsight.
Integrate data from various sources like SQL Server, CosmosDB, SAP, and third-party APIs.
Implement data security best practices, including RBAC, Azure AD, Managed Identities, and Key Vault.
Work with Purview, Data Catalog, and metadata management tools to enforce data governance.
Monitor and troubleshoot data pipeline performance using Azure Monitor, Log Analytics, and Application Insights.
Optimize query performance in Synapse Analytics, SQL, and CosmosDB.
Automate data quality checks, anomaly detection, and alerting mechanisms.
Work closely with BI Developers and Cloud Engineers to support analytics and AI/ML use cases.
Participate in Agile/Scrum ceremonies, design reviews, and technical discussions.
Document data flows, best practices, and architecture decisions.
Design, develop, and optimize Power BI dashboards and reports for business intelligence and analytics.
Create interactive visualizations using advanced DAX, Power Query (M), and custom visuals.
Develop paginated reports using Power BI Report Builder
Ensure compliance with cloud security best practices and industry standards (ISO 27001, GDPR, HIPAA).
Automate deployments with Azure DevOps, GitHub Actions, and CI/CD pipelines.
Work closely with Cloud Engineers and DevOps teams to optimize deployment strategies.
Collaborate with software engineers, architects, and DevOps teams to build robust applications.
Participate in code reviews, sprint planning, and Agile/Scrum ceremonies.
Document technical solutions and best practices.

Azure Data Integration Engineer

Apply now

About the Role:

Azure Data Integration Engineer

Apply now

About the Role:

Key Responsibilities:

As part of an Agile team, our Azure Data Engineer will:

TAG:

Requirements

Minimum Qualifications:

Preferred Qualifications:

Benefits

Apply now