Senior Data Engineer
Consult Asia · Mumbai · onsite · Posted 26d ago
₹18.0L - ₹27.5L PA6–9 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Develop and migrate data pipelines using Spark, Python/Scala. Move Hive and Control-M jobs to Airflow/DBT. Integrate with Kafka, Solace, S3, MinIO, and deploy on Kubernetes ensuring scalable, automated, production-ready solutions.
Required Candidate profile
Experienced Data Engineer (6–9 yrs) with strong Spark, Python/Scala, and SQL skills. Hands-on in Airflow, DBT, Kafka, Kubernetes, and data lakehouse tools.Capable of independent delivery and migrationSourced from naukri
Skills
DockerDelta Lake / Iceberg / HudiKafka / SolaceApache SparkScalaData LakehouseDeltaHiveControl-MicebergData Pipeline DevelopmentBig Data EngineeringHudiPythonKubernetes/DockerMinIOApache Spark/PySparkAirflow/dbtData MigrationSQLJavaETL