Data Engineer

Hi

Experience; 6- 8 Years / Location: Pan India.

Notice Period: Immediate 30 Days Only.

• Strong SQL skills including joins, window functions, CTEs, query optimization, data modeling, and analytical queries.
• Hands-on experience with BigQuery, Cloud SQL, data warehouse concepts, partitioning, clustering, views, and performance tuning.
• Experience in PySpark / Spark for distributed data processing, transformations, aggregations, and troubleshooting performance issues.
• Knowledge of Databricks, Delta Lake, Medallion Architecture, notebooks, jobs, and lakehouse implementation concepts.
• Experience designing ETL / ELT pipelines using Airflow DAGs, operators, sensors, scheduling, retries, dependencies, and monitoring.
• Understanding of data quality, reconciliation, lineage, metadata management, error handling, and production support practices.
• Experience working on GCP data services such as Cloud Storage, Dataflow, Pub/Sub, Composer, IAM, and monitoring tools.
• Exposure to CI/CD practices, Git, code reviews, deployment automation, and environment management.
• Understanding of cost optimization, query optimization, workload scheduling, and resource utilization in cloud data platforms.
• Ability to work with structured, semi-structured, and large-volume datasets in batch and near real-time processing scenarios.