Data Migration Platform Engineer

Job description

Job Description

Job Title: Data Migration Engineer

Summary

The Data Migration Engineer is responsible for designing, implementing, and supporting data replication, migration, and integration solutions across cloud and on-prem environments. This role ensures secure, reliable, and high-performance data movement between heterogeneous systems, leveraging modern ETL tools, lakehouse technologies, and DevOps practices. The role carries platform and administration responsibilities for the Snowflake environment and the AWS data platform services that support it, and requires 24x7 operational support for mission-critical data pipelines.

Key Responsibilities Data replication and migration

• Design and implement data replication and migration solutions across multiple platforms (AWS DocumentDB, PostgreSQL, DB2, Snowflake).
• Develop and maintain ETL workflows using AWS services (DMS, Glue) and other integration tools.
• Ensure data integrity, latency, and SLA compliance for replication and migration processes.
• Plan and execute migrations off legacy on-prem estates into AWS, including validation, reconciliation, cutover, and rollback planning.
• Provide 24x7 support for data replication platforms, including incident management and root cause analysis.
• Monitor and optimize replication performance, ensuring scalability and cost efficiency.

Platform and DevOps engineering

• Build and operate data platform services on AWS, including AWS Glue (ETL jobs, crawlers, Data Catalog), AWS Lambda, S3, Step Functions, and EventBridge.
• Develop and maintain lakehouse ingestion patterns using Apache Hudi (upserts, incremental processing, compaction, clustering, schema evolution), with awareness of comparable open table formats (Iceberg, Delta Lake).
• Implement DevOps practices for automation, CI/CD pipelines, and infrastructure-as-code (Terraform, CloudFormation), including automated testing and promotion between environments.
• Deploy and support Windows and Linux compute in AWS (EC2, clustering, networking, IAM) in support of replication and migration workloads.
• Implement observability across the platform: logging, metrics, alerting, and dashboarding (CloudWatch, Prometheus, Grafana).

Snowflake administration

• Administer the Snowflake platform as day-to-day operational owner: account, database, schema, and warehouse management.
• Design and manage role-based access control (RBAC), including role hierarchies and integration with enterprise identity (SSO/SCIM).
• Manage warehouse sizing, auto-suspend/auto-resume, resource monitors, and query optimization to control cost and performance.
• Operate ingestion into Snowflake via bulk loading (COPY INTO), Snowpipe, tasks, streams, and S3-based staging, alongside third-party replication tooling.
• Implement platform governance: data masking, row access policies, tagging, time travel/retention configuration, and usage monitoring.
• Establish and maintain runbooks, standards, and documentation for Snowflake administration, and support knowledge transfer across the team.

Security, governance, and collaboration

• Maintain compliance with security standards, including encryption in transit and at rest, IAM roles and policies, and vulnerability management.
• Collaborate with architecture and security teams to validate designs and ensure adherence to governance policies.
• Partner with business units and vendors (including vendor engineering/professional services teams) to deliver strategic data integration solutions.

Skills & Qualifications Core Expertise

• Minimum 3 years in data replication, migration, and integration engineering.
• Hands-on experience with AWS Data Migration Service (DMS), AWS Glue, AWS Lambda, and S3-based staging for Snowflake.
• Practical experience with Apache Hudi or a comparable open table format (Iceberg, Delta Lake) in a production environment.
• Strong knowledge of Snowflake architecture and administration: RBAC, warehouse and cost management, bulk loading (COPY INTO), and Snowpipe.
• Proficiency in PostgreSQL, DB2, and other relational databases.
• Experience migrating or re-platforming legacy Windows Server workloads into cloud environments.

Programming & Automation

• Scripting skills in Python and Shell; PySpark experience advantageous.
• Hands-on experience with Terraform or similar IaC tools.
• Familiarity with CI/CD pipelines and DevOps tools (Jenkins, Git, Docker).

Security & Compliance

• Understanding of TLS/SSL, encryption standards, IAM policies, and vulnerability management.

Additional Skills

• Experience with ETL/replication tools (Qlik Replicate, Matillion, Fivetran) is a plus.
• Knowledge of monitoring and alerting tools (CloudWatch, Prometheus, Grafana).
• Experience supporting the handover or transition of platform services between teams.

Certifications (Preferred)

• AWS Certified Solutions Architect, Data Engineer Associate, or Data Analytics Specialty.
• Snowflake SnowPro Core or Administrator Certification.
• DevOps-related certifications.

Other Requirements

• Ability to work in a 24x7 operational support model.
• Strong problem-solving and communication skills.
• Experience in Agile environments and ITSM tools (ServiceNow).

Qualifications

• Appropriate degree level or equivalent qualification.
• AWS experience.
• Snowflake administration.
• Database technology experience.

Qualifications

Qualifications

• Snowflake Administration Experience (Min 3 years)
• Cloud Patform Experience ( AWS Min 3 years)
  
  Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.