Data Engineer_AI

Job Description

1. Job Description

• Develop and maintain ETL/ELT pipelines using Databricks.

• Write efficientPyspark& Python Scripts for large-scale data processing.

• Implement data models,transformationsand CI/CD pipelines for automation.

• Develop reusable data engineering frameworks,libraries and templates for ingestion,transformation,validationand publishing.

• Ensure Data Quality,Reliability, and Performance across pipelines and shared frameworks.

• Design, develop,testand deploy Power BI scripts and generate visually appearing and insightful reports.

• Integrate Power BI reports into Applications toprovideenhanced business capabilities.

• Build data models and develop dashboards using Power BI desktop.

• Work with Reliability Engineers to design and develop Power BI data Visualizations.

• Proficient in using DAX expressions and Power Queriesfor developing andoptimizingPower BI dashboards and reports.

• Knowledge of Azure Cloud Data Engineering Tools.

• Analysis of Validation Test Results.

• Development of Interfaces forMeasurement and Simulation.

• Development and MaintenanceofTest Automationsystemrelated Tools.

• Support Downstream consumers such as analytics,reporting,testingand Reliability teams.

1. Desired Skills

• Good knowledge of data engineering concepts, ETL/ELT pipelines, and data lifecycle management.

• Excellent understanding of datamodeling, data transformation, and dashboarding concepts for analytics and reporting.

• Proficiencyin programming languages includingPython andPySpark, with experience in large-scale data processing.

• Strong knowledge of data visualization and reporting using Microsoft Power BI including DAX expressions and Power Query.

• Familiarity with cloud-based data engineering tools, preferably Microsoft Azure services.

• Basic knowledge of electronics and industrial/validation systems is an added advantage.

1. Education& Experience

• Bachelor's orMaster'sdegree in Electronics or Electrical Engineeringor Computer Science Engineeringwith 2 to 5 years of experience.

• Hands-on experience in building andmaintainingdata pipeline solutions using Databricks.

• Exposure to data engineering concepts including ETL/ELT workflows, data processing, and automation.

1. Soft Skills

• Team player with a proactive mindset

• Good communicationskills

• Willing to work in an international team with diverse cultures

• Openness for technical discussions,assessmentsand reviews

Qualifications

Btech/Mtech

Additional Information

3-6 Years