Job Title: Data Engineer
Experience: 5–7 years
Location: Remote, India
We are seeking a data engineer to design, implement, and optimize cloud-based data pipelines using Microsoft Azure services, including ADF, Synapse, and ADLS.
Responsibilities
Develop and maintain ETL/ELT pipelines using Azure Data Factory to ingest, transform, and load data from diverse sources (databases, APIs, flat files).
Design and manage data storage solutions using Azure Blob Storage and ADLS Gen2, ensuring proper partitioning, compression, and lifecycle policies for performance and cost efficiency.
Build and optimize data models and analytical queries in Azure Synapse Analytics, collaborating with data architects to support reporting and BI needs.
Ensure data quality, consistency, and reliability through validation, reconciliation, auditing, and monitoring frameworks.
Collaborate with data architects, BI developers, and business teams to define architecture, integration patterns, and performance tuning strategies.
Implement data security best practices, including encryption, access control, and role-based access management (RBAC).
Create and maintain documentation of data workflows, pipelines, and architecture to support knowledge