Data Engineer - Bangalore
Duobridge · Bengaluru · onsite · Posted 9d ago
Not disclosedFresherfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Job Description
We are looking for an experienced Data Engineer to design, develop, and manage scalable cloud-native data engineering solutions on AWS. The role involves building automated ETL/ELT pipelines, real-time data processing frameworks, and governed data platforms.
Key Responsibilities
AWS, Python, SQL, Databricks, Snowflake, Apache Airflow, Docker, Kubernetes, Spark, Kafka, Terraform, Git, and Jenkins.
Note: Candidates must be comfortable working from the Bangalore office 4 days a week.
Skills: terraform,python,sql,aws kinesis,kafka,git,spark,docker,aws,snowflake,jenkins,ckad,databricks,airflow
We are looking for an experienced Data Engineer to design, develop, and manage scalable cloud-native data engineering solutions on AWS. The role involves building automated ETL/ELT pipelines, real-time data processing frameworks, and governed data platforms.
Key Responsibilities
- Build and maintain scalable data pipelines using AWS, Python, SQL, and Databricks.
- Work with Snowflake, Apache Airflow, Spark, Kafka, and AWS Kinesis for data processing and orchestration.
- Implement containerisation and deployment using Docker and Kubernetes.
- Manage CI/CD pipelines and infrastructure automation using Terraform, Git, and Jenkins.
- Ensure data quality, governance, monitoring, and performance optimisation.
AWS, Python, SQL, Databricks, Snowflake, Apache Airflow, Docker, Kubernetes, Spark, Kafka, Terraform, Git, and Jenkins.
Note: Candidates must be comfortable working from the Bangalore office 4 days a week.
Skills: terraform,python,sql,aws kinesis,kafka,git,spark,docker,aws,snowflake,jenkins,ckad,databricks,airflow
Sourced from foundit
Skills
JenkinsDockerTerraformKubernetesApache SparkApache Kafkaaws kinesisamazon web servicesapache airflowDatabricksPythonSQLSnowflakeGIT