Apache Airflow Administration

Job Description: Apache Airflow Administration & Platform Engineering

Experience: 10+ Years
Work Location: Any Delivery Center (DC)

Role Overview

We are looking for experienced professionals in Apache Airflow Administration and Platform Engineering to manage and support cloud infrastructure, data pipelines, and production environments. The ideal candidate should have strong hands-on experience with AWS cloud services, Python/Terraform automation, and production platform operations.

Key Responsibilities

• Administer, maintain, and troubleshoot Apache Airflow platforms and data pipeline operations.
• Manage AWS cloud infrastructure, including EC2, IAM, CloudWatch, and networking services.
• Automate infrastructure provisioning and operational tasks using Python and Terraform.
• Monitor platform performance, resolve production incidents, and ensure SLA compliance.
• Support Linux/Unix environments and scripting.
• Maintain CI/CD pipelines using tools such as Jenkins and GitHub.
• Implement monitoring and alerting using CloudWatch, Splunk, Grafana, or Dynatrace.
• Collaborate with Data Engineering and DevOps teams to ensure platform reliability and availability.

Required Skills

• Strong hands-on experience with Apache Airflow administration and platform operations.
• Good knowledge of AWS cloud services, including EC2, IAM, CloudWatch, and networking.
• Experience with Python scripting and Terraform automation.
• Knowledge of data pipelines, database operations, and production support.
• Experience supporting production environments with stringent SLA requirements.

Preferred Skills

• Linux/Unix administration and scripting.
• CI/CD tools such as Jenkins and GitHub.
• Infrastructure automation using AWS CloudFormation.
• Monitoring tools such as Splunk, Grafana, and Dynatrace.
• Familiarity with data engineering, data warehousing, and cloud platform operations.