Data Engineer - Cloud Platform

About Us

We run a professional process and only share your profile with your consent. We hire continuously.

Job Description

This is a remote position.

We are seeking an experienced Cloud Platform Data Engineer to design, build, and optimize scalable data solutions across Azure and AWS ecosystems. The successful candidate will play a key role in cloud-to-cloud migration activities, ensuring data integrity, platform reliability, and operational excellence throughout the transition. You will work closely with infrastructure, security, and business stakeholders to deliver robust data platforms and automated deployment processes. This role combines hands-on engineering with architectural design and cross-functional collaboration.

Responsibilities:

1. · Design, build, and maintain batch and streaming data pipelines across Azure and AWS environments.
2. · Lead data platform migration activities, including storage, processing, and orchestration workloads.
3. · Develop and optimize distributed data processing solutions using Python, SQL, Databricks, Spark, and related technologies.
4. · Implement and manage event streaming platforms, data validation frameworks, and automated testing solutions.
5. · Design and maintain containerized workloads, infrastructure-as-code, and CI/CD deployment pipelines.
6. · Collaborate with technical and non-technical stakeholders to manage migration risks, architecture decisions, and delivery planning.

Qualifications:

1. · Strong hands-on experience with Python, SQL, Databricks, Apache Spark, and large-scale data processing.
2. · Proven expertise in Azure and AWS data platforms, including cloud storage and lakehouse architectures.
3. · Experience with Kubernetes, GitOps practices, and containerized data platform deployments.
4. · Strong knowledge of Apache Airflow, Azure Data Factory, Kafka/MSK, and workflow orchestration.
5. · Proficiency with Terraform, CI/CD automation, and cloud networking concepts in multi-cloud environments.
6. · Excellent communication skills with experience supporting complex cloud migration and transformation programs.

Required skills

1. · Databricks
2. · Azure
3. · Kubernetes
4. · AWS
5. · Data Migration

Languages

English (Proficient)