Senior Data Engineer- Databricks

Key Skills: AWS, Data Bricks, Data Engineer, Python, Pyspark, ETL, MySQL

Roles and Responsibilities:

• Design, develop, and maintain scalable data pipelines and analytical workflows using Databricks, Python, PySpark, and AWS services.
• Build reusable ETL/ELT frameworks, data models, transformation components, and data-quality controls for structured and unstructured datasets.
• Develop and optimize distributed-processing workloads, improving scalability, performance, reliability, and cloud resource utilization.
• Build Python-based APIs and data services to expose analytics and business data to downstream applications.
• Support data-platform migration, cloud-modernization, governance, reconciliation, monitoring, testing, CI/CD, and production-support initiatives.

Skills Required:

• 8 - 14 years of experience in Data Engineering, Data Science, or Analytics Engineering roles.
• Strong hands-on experience with AWS and Databricks-based data engineering solutions.
• Advanced Python programming skills and experience designing scalable data-processing applications.
• Proven experience delivering data engineering solutions across cloud data platforms, distributed architectures, and data lakes.
• Strong understanding of APIs, data quality, data governance, scalable processing, and production deployment practices.

Good to Have:

• Experience with ETL, PySpark, and MySQL.

Education: Bachelor's or Master's degree in Computer Science, Computer Applications, Communication Engineering, or a related discipline.