FULLTIME
ETL Developer Informatica PowerCenter | IDMC | AWS | GCP | Global Data Integration Platform | Engineering

GYS Technologies PVT LTD
Not specified · onsite · Posted 16d ago
Your match
Sign in to see your match score, skill gaps & tailored resume.
Section · 01
About this role
Client: TCS Payroll: VARITE INDIA PVT LTD Note: Moved to direct TCS payroll after 3-6 months, subject to BGV report Clearance. Requirement: ETL Develope rExp: 4+ Year sLocation: Any TCS location in INDIA (WFO )Max Budget: 15-20 LP AMax NP: Serving within 30day s ETL Develop erInformatica PowerCenter | IDMC | AWS | GCP | Global Data Integration Platform | Engineeri ngAbout the Ro leWe are seeking a skilled ETL Developer with 4+ years of experience to join our Global Data Integration Engineering team. You will design, develop, and deliver robust ETL/ELT pipelines that power business-critical data flows across on-premise and cloud platforms. Working with Informatica PowerCenter and Informatica Data Management Cloud (IDMC), you will enable enterprise-wide data integration, data quality, and analytics initiatives across AWS and GCP environment s.The ideal candidate combines strong Informatica expertise with modern cloud-native data engineering skills — including hands-on experience with Google Cloud Composer for pipeline orchestration — and a collaborative, architecture-minded approac h.Key Responsibiliti esETL Design & Developme nt• Design and develop scalable ETL/ELT pipelines using Informatica PowerCenter and IDMC (Cloud Data Integration, Mass Ingestion ).• Build complex mappings, workflows, and sessions handling large data volumes with optimal performanc e.• Implement data transformations including Joiner, Aggregator, Lookup, Router, Expression, and custom SQL override s.• Design and develop cloud-native data pipelines on IDMC integrating AWS (S3, Redshift, Glue, RDS, Lambda) and GCP (BigQuery, Cloud Storage, Dataflow, Cloud SQL, Cloud Composer) service s.• Translate business and technical requirements into reliable, maintainable, and reusable integration component s.• Apply incremental load, CDC (Change Data Capture), and full-load strategies appropriate to source system constraint s.Cloud & Platform Integrati on• Build and configure IDMC connectors for AWS S3, Redshift, Google BigQuery, Cloud Storage, Salesforce, REST APIs, and relational database s.• Design hybrid integration architectures spanning on-premise Informatica PowerCenter and cloud-based IDMC deployment s.• Work with cloud storage formats including Parquet, ORC, Avro, and Delta Lake for efficient data lake ingestion and transformatio n.• Implement data pipelines adhering to cloud security best practices — encryption, IAM roles, VPC configurations, and secrets managemen t.Pipeline Orchestration with Google Cloud Compos er• Design, develop, and maintain DAGs (Directed Acyclic Graphs) in Google Cloud Composer (managed Apache Airflow) to orchestrate end-to-end ETL/ELT workflows across GCP and hybrid environment s.• Integrate Cloud Composer DAGs with Informatica IDMC tasks, PowerCenter workflows, BigQuery jobs, Dataflow pipelines, Cloud Functions, and GCS operation s.• Implement robust DAG design patterns — including dynamic DAG generation, task dependencies, XComs for inter-task communication, branching logic, and SLA callback s.• Configure and use Airflow operators and hooks relevant to GCP services: BigQueryOperator, DataflowTemplateOperator, GCSToGCSOperator, and custom Python operators for Informatica API call s.• Manage Cloud Composer environment configuration — environment sizing, worker autoscaling, PyPI package dependencies, and variables via Secrets Manage r.Data Quality, Governance & Tuni ng• Utilise Informatica Data Quality (IDQ) and IDMC Data Quality assets to implement profiling, cleansing, standardisation, and validation rule s.• Partner with Data Governance teams to enforce metadata management, data lineage, and cataloguing using Informatica AXON or Enterprise Data Catalog (EDC ).• Tune Informatica sessions and mappings for throughput and resource efficiency — partition strategies, pushdown optimisation, and cache tunin g.• Integrate pipelines and DAGs into CI/CD workflows using Git, Cloud Build, Jenkins, or equivalent toolin g.Core Skills & Experience (Require d)• Informatica Architecture: Strong hands-on experience with Informatica PowerCenter Suite and IDMC (Informatica Intelligent Data Management Cloud) component s.• Google Cloud Composer & Airflow: Hands-on experience developing and maintaining Apache Airflow DAGs in Google Cloud Composer (v2/v3) for orchestrating ETL/ELT workflows using Pytho n.• Cloud Frameworks (AWS & GCP): Detailed functional background running analytical engineering pipelines natively within AWS and Google Cloud Platform environment s.• Data Engineering Foundations: Advanced SQL capability (window functions, CTEs, tuning) paired with structured Data Warehousing patterns (Star/Snowflake, SCD ).• Version Control: Familiarity with Git-based version control workflows and collaborative development practice s.Nice to Ha ve• Informatica certifications (PowerCenter Developer, IDMC/CDI Specialist, or equivalent ).• Google Cloud Professional Data Engineer certificatio n.• Experience migrating legacy on-premise pipeline workflows into modern cloud-nati ve
Sourced from linkedin · view original
Let the agent run this one for you.
Tailored resume, auto-apply, and referral lookup — in under 2 minutes.
Section · 02
Skills
Section · Company
About GYS Technologies

GYS Technologies PVT LTD
None
headquarters
About
Employees rate it well for
Find them on