Sr Data Engineer

Job Summary

Job Description - Senior Data Engineer Role Overview We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data pipelines and data platforms. The ideal candidate will have strong expertise in big data technologies, cloud-based data engineering, and modern data lakehouse architectures.

Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark and Databricks
• Build and manage data ingestion and orchestration workflows using Azure Data Factory (ADF)
• Perform complex data transformations and optimization using SQL and PySpark
• Implement and manage Delta Lake for reliable, high-performance data storage
• Develop and maintain data models (fact and dimension tables) for analytics and reporting
• Handle large-scale data processing, ensuring performance, scalability, and reliability
• Collaborate with cross-functional teams including data analysts, data scientists, and business stakeholders
• Ensure data quality, consistency, and governance across pipelines

Required Skills

• Strong experience in PySpark and Databricks
• Hands-on experience with Azure Data Factory (ADF)
• Proficiency in SQL and data transformation techniques
• Experience with Delta Lake and Lakehouse architecture
• Good understanding of data modeling (fact/dimension design)
• Experience handling large-scale data processing

Requirements

• Knowledge of Azure ecosystem (ADLS, Key Vault, Synapse)
• Familiarity with data governance and security practices
• Experience in performance tuning and optimization in Spark

Qualifications

Preferred Qualifications (Nice to Have)

• Experience with streaming frameworks (Kafka / Structured Streaming)

Disclaimer: This job posting and Location has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.