AWS DataBricks Engineer

Job Title

AWS DataBricks Engineer

Location

Karnataka, India

Job Type

Permanent

Responsibilities

• Help design, build and continuously improve the clients online platform.
• Research, suggest and implement new technology solutions following best practices/standards.
• Take responsibility for the resiliency and availability of different products.
• Be a productive member of the team.

Requirements

• 8+ years of experience in Data Engineering.
• Experienced Databricks Engineer to design, develop, and maintain scalable data solutions using Databricks and cloud technologies.
• Develop and maintain data pipelines using Databricks, PySpark, and SQL.
• Work with Delta Lake, Databricks Workflows, and Jobs.
• Build and optimize ETL/ELT pipelines for large-scale data processing.
• Collaborate with Data Engineers, Architects, and business stakeholders.
• Troubleshoot and optimize pipeline and data-processing performance.
• Implement data quality, monitoring, and engineering best practices.
• Strong hands-on experience with Databricks and PySpark.
• Good knowledge of SQL, ETL/ELT, and Data Warehousing.
• Experience with Azure, AWS, or GCP.
• Familiarity with Git, CI/CD, and DevOps practices.
• Strong communication and problem-solving skills.
• Experience with Azure Data Factory, Databricks Unity Catalog, Terraform, and streaming technologies.