Azure Data Engineer

Role Overview

We are seeking an experienced Data Engineer to design, develop, and maintain enterprise-scale Data Warehouse solutions. The ideal candidate will be responsible for building robust data pipelines, optimizing data models, managing large-scale data platforms, and ensuring high-quality, trusted data assets that support analytics, AI, and business decision-making.

The candidate will be responsible for designing, developing, and maintaining scalable data pipelines, data warehouses, and data lakes. The role will involve working with cloud-based data platforms and collaborating with technical and business teams to deliver reliable, high-quality data solutions. Experience in AI-enabled data solutions is highly desirable.

Key Responsibilities

Data Warehouse Development

•Design, develop, and maintain enterprise Data Warehouse solutions.

•Build and manage dimensional data models including Fact and Dimension tables.

•Implement Star Schema designs.

•Define and maintain enterprise data architecture standards.

Data Engineering & ETL

•Design and build ETL/ELT pipelines for structured and unstructured data sources.

•Develop scalable data ingestion, transformation, and integration frameworks.

•Ensure data quality, integrity, reconciliation, and validation.

•Implement automated data processing and orchestration workflows.

Azure Data Engineer | Artech LLC

•Support batch and near real-time data processing requirements.

SQL & Data Optimization

•Develop and optimize complex SQL queries, stored procedures, functions, and views.

•Perform database tuning, query optimization, and performance monitoring.

•Ensure efficient storage utilization and processing performance across data platforms.

Cloud Data Platform Engineering

•Develop and support cloud-based data ecosystems.

•Build and maintain solutions using:

o Azure Data Factory (ADF)

o Azure Synapse Analytics

o Azure Data Lake Storage Gen2

o Databricks

•Support migration and modernization of legacy data platforms.

Data Governance & Security

•Implement data governance, metadata management, lineage, and data quality standards.

•Ensure compliance with organizational security policies and regulatory requirements.

•Support audit readiness and data protection initiatives.

Collaboration & Solution Delivery

•Work closely with business stakeholders, architects, application teams, and data consumers.

•Participate in solution design, code reviews, testing, deployment, and production support.

•Create and maintain technical documentation and architectural artifacts. Required Technical Skills

Mandatory Skills

•Strong expertise in SQL and relational database technologies.

•Hands-on experience in enterprise Data Warehouse architecture and implementation.

•Experience designing and implementing ETL/ELT solutions.

•Strong understanding of:

o Star Schema

o Fact and Dimension Modeling

Azure Data Engineer | Artech LLC

o Data Lakes and Modern Data Platforms

Programming Languages : Python, SQL, PySpark

Data Platforms: Azure Synapse Analytics, Azure Data Factory, Databricks, Azure Data Lake Storage (ADLS Gen2)

Data Orchestration: Apache Airflow, Azure Data Factory Pipelines

Good to have skills: Version Control & DevOps- Git, Azure DevOps, CI/CD Practices

Desirable AI & Advanced Data Capabilities

Experience in any of the following areas will be considered an added advantage:

•Building data platforms that support Generative AI and Machine Learning workloads.

•Experience with AI-enabled data processing, intelligent document extraction, and semantic search solutions.

•Exposure to Large Language Models (LLMs) such as Azure OpenAI, OpenAI, Claude, Gemini, or similar platforms.

•Data preparation and optimization techniques for AI and Machine Learning applications.

•Knowledge of Vector Databases, Embeddings, Retrieval-Augmented Generation (RAG), and AI

knowledge repositories.

•Experience integrating AI services into enterprise applications and data platforms.

•Familiarity with copilots, AI agents, and workflow automation solutions. Education