Data Engineer II

Job Description

Location: Chennai, TN

Qualifications

• Bachelor's degree or higher in Computer Science, a related discipline, or equivalent professional experience.
• Experience designing scalable, automated, and reliable data pipelines and data processing systems.
• Strong theoretical knowledge of data engineering concepts, data structures, and algorithms.
• Proficiency in Python and PySpark.
• Strong proficiency in SQL.
• Hands-on experience with Databricks for data engineering, including notebook development, job orchestration, Delta Lake, and performance optimization.
• Experience with data processing frameworks such as Apache Spark, Flink, or Beam.
• Experience with cloud-based infrastructure such as AWS or GCP.
• Exposure to orchestration platforms such as Airflow or Kubeflow.
• Strong attention to detail, critical thinking, and the ability to work independently within a cross-functional team.
• Basic understanding of version control tools such as GitHub, SVN, or CVS.
• Understanding of Agile framework and delivery practices.
• Conceptual knowledge of cloud-based distributed or hybrid data warehousing solutions and Data Lake architecture would be a plus.
• Knowledge of AI-assisted development and implementation using tools such as Claude Code, Databricks Genie, or similar AI-based development platforms would be a plus.

Responsibilities

• Work with team members to understand technical requirements and take ownership of development, unit testing, analytics, data products, and data engineering deliverables.
• Build efficient and scalable code to transform raw data into reliable datasets for analysis, reporting, and data modeling.
• Collaborate with other data engineers to implement a shared technical vision and best practices.
• Participate in the complete software development lifecycle, from concept and design to release and support.
• Discuss requirements with the Product Owner team, create JIRA tickets wherever necessary, and update work logs regularly.
• Ensure data quality, performance, reliability, and maintainability of data pipelines and solutions.

Disclaimer: This job description has been sourced from a public domain and may have been modified by Naukri.com to improve clarity for our users. We encourage job seekers to verify all details directly with the employer via their official channels before applying.