Azure Devops Engineer

Job description

Senior DevOps Engineer with strong expertise in Python, Databricks, Azure Cloud, and data workflow orchestration. This role will focus on building scalable infrastructure, automating deployments, and supporting data engineering pipelines using Bicep, Azure Data Factory (ADF), and Apache Airflow. Also working on the data using databricks.

Skills

Programming:

Advanced Python with Pytest

Cloud:

Azure: ADF, Azure Functions, Azure DevOps, Azure Monitor, Key Vault, Databricks,Blob storage and ADLS.

Bicep: Azure-native IaC for declarative infrastructure.

CI/CD & Deployment

Architect CI/CD pipelines integrating Python apps, ADF pipelines, and Airflow DAGs.

Implement automated testing, security scanning, and deployment workflows.

Use tools like GitHub Actions, Azure DevOps, GitLab CI, or Jenkins.

Docker & Kubernetes:

Containerization and orchestration.

Workflow Orchestration

Apache Airflow: DAG creation, scheduling, monitoring.

Azure Data Factory:

pipeline design, data movement, transformation.

Monitoring & Logging:

ELK Stack, Azure Monitor, Datadog.

Security & Compliance:

IAM, RBAC, secrets management.

CMDB:

Able to create Application CIs and Sub applications

Able to register pipelines via CI/CD