Data Engineer

Hiring: Data Engineer | AI & Data Engineering

Location: Hyderabad

Experience: 8+ years

Work Mode: WFO

Notice Period: Immediate or up to 15 days

We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and data platforms supporting analytics, AI/ML, and enterprise data solutions.

Key Responsibilities:

• Design and develop ETL/ELT pipelines for structured and unstructured data
• Build and maintain Data Lakes, Data Warehouses, and data architectures
• Integrate data from multiple internal and external sources
• Perform data transformation, cleansing, enrichment, and quality checks
• Develop batch and real-time data processing pipelines
• Work with distributed processing frameworks such as Spark/Hadoop
• Support AI/ML pipelines, feature engineering, and analytics workloads
• Implement data governance, security, privacy, and data quality controls
• Monitor pipelines, troubleshoot failures, and optimize performance
• Maintain data lineage, metadata, documentation, and monitoring
• Collaborate with DevOps teams on CI/CD and deployment automation

Required Skills:

• Data Engineering & ETL/ELT
• Strong SQL and Python/Scala
• Apache Spark / Hadoop
• Data Modeling & Data Warehousing
• Data Lakes
• Cloud Data Platforms Azure / AWS / GCP
• Kafka / Azure Event Hubs
• Relational & NoSQL databases
• Data Governance & Data Quality
• Performance Optimization & Troubleshooting

Preferred Tools:

Azure Data Factory | AWS Glue | Google Dataflow | Databricks | Snowflake | BigQuery | PostgreSQL | MySQL | SQL Server | Airflow | Git | Azure DevOps | Jenkins | Prometheus | Grafana

Experience in banking/financial services or other regulated industries is an advantage.

Preferred Certifications:

Azure Data Engineer Associate | AWS Data Analytics | Google Professional Data Engineer | Databricks Certification