Senior Data Engineer

Sr Azure Data Engineer

Job Description

About Cloudaeon:

Cloudaeon is a global technology consulting and services company helping enterprises modernize and manage their cloud infrastructure, big data ecosystems, DevOps pipelines, and advanced analytics platforms. We deliver high-quality, scalable solutions built on deep domain expertise and leading enterprise data technologies. Our teams work actively on AI and GenAI initiatives, incorporating machine learning, intelligent automation, and modern data engineering practices to create future-ready digital solutions. With a highly skilled global team committed to excellence, we consistently exceed customer expectations and help organizations achieve their strategic goals.

Job Role Sr Azure Data Engineer

Experience - 5+ years

Location: Pune (Hybrid)

Job description:

We are looking for a Senior Azure Data Engineer with strong expertise in designing and delivering modern data solutions on the Azure platform. The ideal candidate will lead data engineering initiatives, mentor junior engineers, and contribute to building scalable, secure, and high-quality data products. A strong foundational understanding of AI/ML concepts is essential, enabling a smooth transition into AI Engineering over time.

Responsibilities:

• Design, build, and optimize modern data pipelines and real-time/near real-time data streams.

• Transform and move data across bronze, silver, and gold layers using ADF, Python, and PySpark.

• Evaluate current data practices and identify opportunities for improvement and modernization.

• Leverage Azure Data Platform capabilities including ADF, ADLS, Databricks, Synapse, Azure Functions, Event Hub, and Azure Data Explorer.

• Support planning, architecture, and deployment of scalable data platform services (sizing, configuration, and cost optimization).

• Implement automated monitoring, alerts, and operational dashboards. • Ensure CI/CD and DevOps integration of data pipelines.

• Collaborate closely with stakeholders and work as a trusted technology advisor.

• Provide technical leadership, code reviews, and mentorship to junior data engineers.

• Prepare AI-ready datasets, support feature engineering, vectorization, embeddings, and ML workflows using Azure Machine Learning and Databricks AI.

• Contribute to RAG pipelines, semantic search, and model deployment integrations.

Requirements:

• 5+ years of experience with Azure Data Engineering (ADF, Databricks, Python, PySpark, SQL).

• Strong understanding of data warehousing and data modelling.

• Proven experience building production-grade ETL/ELT pipelines.

• Hands-on experience with ADLS, Delta Lake, Synapse, Azure DevOps CI/CD.

• Ability to convert business requirements into scalable technical solutions.

• Excellent communication and problem-solving skills.

• Customer-centric mindset with passion for engineering quality.

• Working knowledge of Databricks AI, MLflow, model serving, feature store, vector search, and AI/ML workflows.