Senior Devops Engineer

Job Summary

We are looking for an experienced Senior DevOps Engineer to manage and enhance our enterprise Azure Data Lake platform. The ideal candidate should have strong expertise in Azure Infrastructure, Networking, Platform Engineering, and Cloud Architecture. The

role requires ownership of the complete cloud infrastructure supporting our Data Lake ecosystem, ensuring secure, scalable, highly available, and cost-optimized operations.

The candidate will work closely with Data Engineering, Security, Infrastructure, and Application teams to onboard new applications and establish secure connectivity across multiple cloud environments.

Key Responsibilities

Azure Platform Management

• Manage and administer the complete Azure Data Lake platform.
• Design, implement, and maintain secure and highly available Azure infrastructure.
• Ensure platform stability, scalability, disaster recovery, and operational excellence.
• Implement infrastructure automation using Infrastructure as Code
• (Terraform/Bicep/ARM templates).

Azure Networking

• Design and manage enterprise Azure networking.
• Configure and troubleshoot:
• Virtual Networks (VNets)
• Subnets
• Network Security Groups (NSGs)
• Azure Firewall
• Route Tables
• Private Endpoints
• Private Link
• ExpressRoute
• VPN Gateway
• Azure DNS
• Load Balancers
• Manage enterprise connectivity between Azure resources and external environments.

Hybrid & Multi-Cloud Connectivity

• Establish secure connectivity between the Azure Data Lake platform and applications hosted on:
• AWS
• Google Cloud Platform (GCP)
• Azure
• On-Premises Data Centers
• Design and troubleshoot site-to-site VPNs, ExpressRoute, VNet Peering, and hybrid networking solutions.
• Ensure secure data movement across cloud providers while following enterprise security standards.

Enterprise Architecture

• Understand and manage enterprise cloud infrastructure architecture.
• Work with enterprise architecture teams to design scalable and secure solutions.
• Participate in infrastructure planning, cloud governance, and technology roadmap discussions.

Hub-and-Spoke Network Architecture

• Strong experience implementing and managing Azure Hub-and-Spoke network architecture.
• Configure spoke onboarding, routing, firewall policies, peering, and network segmentation.
• Ensure secure communication between spokes while maintaining centralized governance.

Security & Compliance

• Implement enterprise security best practices.

Manage:

• Azure RBAC
• Managed Identity
• Key Vault
• Azure Policy
• Microsoft Defender for Cloud
• Network security controls
• Ensure compliance with organizational security and regulatory standards.

DevOps & Automation

• Build and maintain CI/CD pipelines.

• Automate infrastructure provisioning and deployments.

• Implement monitoring, alerting, backup, and disaster recovery automation.

• Improve platform reliability through automation and operational excellence.

Cost Optimization

• Continuously optimize Azure infrastructure costs.

• Monitor Azure consumption and recommend architecture improvements for better

utilization.

• Implement Reserved Instances, Savings Plans, auto-scaling, storage lifecycle

management, and other cost optimization strategies.

• Produce periodic cost optimization reports and recommendations.

Operational Excellence

• Manage production incidents and perform root cause analysis.

• Ensure platform availability and performance.

• Maintain infrastructure documentation, architecture diagrams, and operational

runbooks.

• Collaborate with Data Engineering teams during onboarding of new applications and

integrations.

Required Technical Skills

Azure

• Azure Virtual Network

• Hub-and-Spoke Architecture

• Azure Firewall

• Azure Bastion

• Azure VPN Gateway

• ExpressRoute

• Private Link

• Private Endpoint

• Azure DNS

• NSG

• Route Tables

• Azure Monitor

• Log Analytics

• Azure Policy

• Azure RBAC

• Microsoft Defender for Cloud

• Azure Key Vault

• Azure Storage

• Azure Data Lake Storage Gen2

DevOps

• Azure DevOps

• Git

• CI/CD Pipelines

• Infrastructure as Code (Terraform/Bicep/ARM)

• PowerShell

• Azure CLI

Networking

• TCP/IP

• Routing

• DNS

• VPN

• NAT

• Firewalls

• Load Balancers

• Network Security

• Hybrid Connectivity

• Cross-Cloud Networking

Multi-Cloud Exposure

Experience integrating Azure with:

• AWS

• Google Cloud Platform (GCP)

• Hybrid/On-Premises environments

Preferred Skills

• Experience supporting Azure Databricks, Azure Data Factory, Synapse Analytics,

and Azure Data Lake Storage.

• Knowledge of enterprise landing zones and cloud governance.

• Experience with backup, disaster recovery, and business continuity planning.

• Familiarity with enterprise monitoring and observability tools.

• Strong documentation and stakeholder communication skills.

Preferred Certifications

• Microsoft Certified: Azure Solutions Architect Expert

• Microsoft Certified: Azure Administrator Associate

• Microsoft Certified: Azure Network Engineer Associate

• Terraform Associate (preferred)

Key Deliverables

• Maintain a secure, scalable, and highly available Azure Data Lake platform.

• Successfully onboard new applications and establish secure connectivity across

Azure, AWS, GCP, and on-premises environments.

• Manage and optimize the enterprise Hub-and-Spoke network architecture.

• Ensure infrastructure security, governance, and compliance.

• Continuously improve platform performance while optimizing Azure infrastructure

costs.