Data Engineer

Role: Azure Data Engineer

Experience: 5+ Years

Location: Bengaluru (Work from Office)

About the Role

We are looking for a highly skilled Azure Data Engineer to design, build, and optimize scalable enterprise data platforms and modern data pipelines. You'll work with big data technologies, cloud platforms, distributed computing, and DataOps practices to build reliable, high-performance data solutions that power analytics, AI, and business decision-making across the organization.

Key Responsibilities

• Design, build, and maintain scalable data pipelines and modern data platforms using Hadoop or cloud technologies.
• Develop and optimize end-to-end ETL/ELT workflows for structured and unstructured datasets.
• Build reliable, scalable, and high-performance data architectures.
• Drive DataOps best practices through automation, testing, monitoring, and deployment.
• Implement CI/CD pipelines, data governance standards, and production-grade monitoring.
• Collaborate with Enterprise Architecture, analytics, and cross-functional engineering teams.
• Design and maintain dimensional data models for reporting and business intelligence.
• Develop highly optimized SQL queries for large-scale data processing.
• Build scalable data processing solutions using Python, PySpark, and distributed computing frameworks.
• Continuously improve platform performance, reliability, scalability, and deployment efficiency.

Required Skills

• 4+ years of Data Engineering experience.
• Strong expertise in Hadoop or cloud-based data platforms.
• Hands-on experience with Python and/or PySpark.
• Advanced SQL skills for large-scale data processing.
• Experience building ETL/ELT pipelines.
• Knowledge of distributed computing frameworks.
• Strong understanding of Data Modeling, Data Warehousing, and Data Governance.
• Experience with DataOps practices, CI/CD, and automated deployments.
• Experience with workflow orchestration tools such as Airflow, Oozie, or Jenkins.
• Strong analytical, debugging, and problem-solving skills.