Industry Data Research & Validation P16 Professional

Job Summary

We are seeking a skilled Data Engineer with strong expertise in the Microsoft Azure ecosystem. The ideal candidate will design, build, and maintain scalable data pipelines and data solutions that support business analytics, reporting, and advanced data use cases. This role requires hands-on experience with Azure data services, data modeling, and ETL/ELT processes.

Key Responsibilities

• Design, develop, and maintain data pipelines for ingesting, transforming, and loading data from various sources.
• Build and optimize ETL/ELT workflows using Azure-native tools.
• Work with structured and unstructured data across multiple platforms.
• Ensure data quality, integrity, and accuracy through validation and monitoring.
• Implement data modeling solutions for analytics and reporting.
• Collaborate with business analysts, data scientists, and stakeholders to understand data requirements.
• Optimize performance and scalability of data pipelines and storage.
• Ensure data governance, security, and compliance standards are met.
• Troubleshoot data issues and provide solutions proactively.

Required Skills & Experience

Core Azure Services

• Azure Data Factory (ADF) - data integration and orchestration
• Azure SQL / Azure SQL Database
• Azure Data Lake Storage Gen2
• Azure Databricks (PySpark / Spark SQL)

Programming & Querying

• Strong SQL skills
• Python (for data processing and automation)
• PySpark / Spark (for big data processing)

Data Engineering Concepts

• ETL/ELT design patterns
• Data warehousing concepts (Star/Snowflake schema)
• Incremental loads and CDC (Change Data Capture)
• Data modeling (dimensional & normalized models)

DevOps & Automation

• Azure DevOps / CI-CD pipelines
• Git version control

Additional / Preferred Skills

• Experience with Power BI for data visualization integration
• Knowledge of data governance tools (e.g., Purview)
• Experience working in Agile/Scrum environments

Education & Experience

• Bachelor s degree in Computer Science, Engineering, or related field
• 2-4 years of experience in data engineering or related role
• Hands-on experience with Azure data platform is required

Key Competencies

• Strong analytical and problem-solving skills
• Ability to work with large datasets efficiently
• Excellent communication and collaboration skills
• Attention to detail and data quality focus

Nice-to-Have Certifications

• Microsoft Certified: Azure Data Engineer Associate (DP-203)
• Azure Fundamentals (AZ-900)

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.