Sr Data Engineer

Responsibilities

• Design and develop scalable data ingestion and transformation pipelines integrating data from multiple source systems.
• Implement data cleansing, validation, and quality processes to ensure accurate, consistent, and reliable data.
• Build complex datasets and data models to support reporting, analytics, dashboards, and business decision-making.
• Analyze data and reporting requirements to identify trends, data gaps, and quality issues.
• Work closely with cross-functional teams using Agile methodology to deliver reliable and high-quality data solutions.

Requirements

• At least 5 years of experience as an expert in Data Engineering and Analysis.
• Expertise in data ingestion, data processing and analytical pipelines for big data, relational databases, and data warehouse solutions
• Hands-on experience with Agile software development
• Experience in designing and hands-on development in cloud-based analytics solutions.
• Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required.
• Designing and building of data pipelines using API ingestion and Streaming ingestion methods.
• Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential.
• Thorough understanding of Azure and AWS Cloud Infrastructure offerings.
• Expertise in Azure Databricks, Azure Stream Analytics, Power BI is desirable
• Knowledge of SAP and BW/ BPC is desirable.
• Expert in Python, Scala, SQL is desirable
• Experience developing security models.

Job Type

Full time

Location

Telangana, India

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.