Data Engineer
Ideasinfinite · Mumbai · onsite · Posted 55d ago
Undisclosed5–7 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Job Summary
Urgently required data engineer, for Navi Mumbai for 6 months project.
Position: Data Engineer
Experience: 5-7 years
Job Location: Navi Mumbai
Notice Period: As soon as possible
Responsibilities
- Develop and maintain ingestion pipelines using Cloud Composer (DAG Factory) and Cloud Dataflow.
- Implement historical and incremental data loads from Oracle to BigQuery.
- Design and manage watermarking, metadata, audit, and control tables in BigQuery.
- Support data validation, reconciliation, monitoring, and production issue resolution.
- Ensure compliance with data engineering standards, coding practices, and deployment processes.
- Strong hands-on experience with Cloud Composer (Airflow) and DAG Factory.
- Proven experience building Dataflow-based ingestion frameworks.
- Strong proficiency in Python and SQL. Experience with BigQuery, GCS, Pub/Sub, and Oracle databases.
- Good understanding of data warehousing, ETL/ELT, incremental loading, data quality, and data engineering best practices.
- Experience with monitoring, troubleshooting, and optimizing production-grade data pipelines.
- Knowledge of GCP IAM, security, and least-privilege access principles.
- Experience working on large-scale Oracle-to-BigQuery migration programs preferred.
Requirements
Disclaimer: This job posting and Location has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
data qualityData EngineerTroubleshootingaws iamgoogle cloud platformapache airfloweltbigquerymetadataCloud ComposerOracle DBdeploymentData EngineeringPythoncloudSQLData WarehousingcomplianceETLData ValidationGoogle ComposerData Pipeline