Data Engineer / Sr Data Engineer

Job Summary

Job Title: Data Engineer - Automotive Analytics (PySpark, Databricks, Azure, Power BI)

Role Overview

The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and analytics solutions within the automotive domain. The role involves working with large datasets, cloud platforms, and visualization tools to support data-driven decision-making across engineering and business teams.

Key Responsibilities

• Data Processing Engineering - Design, build, and optimize ETL/ELT pipelines using PySpark and Databricks for large-scale automotive datasets. Implement and maintain CI/CD pipelines for automated data workflows.
• Cloud Big Data - Work with Azure Data Lake, Azure Synapse, Azure Data Factory, and Databricks for data ingestion, transformation, and processing.
• Analytics Insights - Perform statistical analysis, build predictive models, and identify trends in vehicle test drive behavior, environmental conditions, and key performance indicators.
• Dashboard Reporting - Develop interactive Power BI dashboards using DAX, KPIs, and real-time analytics for engineering and business stakeholders.
• Collaboration Documentation - Collaborate with data scientists, software engineers, and product stakeholders while maintaining clear, structured documentation of data flows and processes.

Required Skills

• Strong experience with PySpark, Databricks, and distributed data processing.
• Hands-on expertise in Azure data services (ADLS, ADF, Synapse).
• Proficiency in SQL, Python, and data modeling.
• Experience building dashboards in Power BI using DAX.
• Understanding of CI/CD processes and DevOps practices for data engineering.

Preferred Qualifications

• Automotive domain experience.
• Knowledge of machine learning workflows.
• Familiarity with Delta Lake, Unity Catalog, and data governance best practices.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.