MUMBAI · FULLTIME
Senior Data Engineer
Talentmatics
Mumbai · onsite · Posted 37d ago
Sourced from
Not disclosed10–12 yrsfulltimeMumbai
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.3s
- Found the form on Foundit · 8 questions to answer1.1s
- Decided the answers for all of them2.7s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
We are hiring Senior FDE professionals with strong expertise in Databricks, Apache Spark, Data Engineering, Cloud, Data Migration and GenAI/RAG.
Required Skills :
- 10+ years overall experience with 7+ years in Data Engineering.
- Strong hands-on experience with Databricks.
- Strong expertise in Apache Spark, PySpark & Spark SQL.
- Hands-on experience with Data Migration / Cloud Migration / Data Modernization.
- Strong Data Architecture / Solution Architecture experience.
- Experience with AWS, Azure or GCP.
- Strong understanding of Delta Lake & Unity Catalog.
- Experience with batch & streaming data processing.
- Strong Python/PySpark coding skills.
- Experience with CI/CD and DevOps.
- Exposure to GenAI, LLM, RAG and MLOps/MLflow.
- Strong production troubleshooting, debugging and RCA skills.
- Customer-facing experience with strong stakeholder communication and technical solutioning.
Key Responsibilities :
- Design and implement scalable Databricks & Spark-based data solutions.
- Lead data migration and modernization initiatives.
- Design enterprise Lakehouse and data architectures.
- Develop production-grade data pipelines and integrations.
- Optimize Spark workloads and troubleshoot complex production issues.
- Implement batch and streaming data solutions.
- Work with Unity Catalog, Delta Lake and Databricks ecosystem.
- Contribute to GenAI/RAG and MLOps solutions.
- Engage with customers and stakeholders to understand requirements and provide technical solutions.
- Drive architecture discussions, technical design and end-to-end implementation.
Sourced from foundit
Section · 02
Skills
DevopsRetrieval Augmented GenerationApache SparkUnity CatalogSpark SQLmlflowDeltaSolution architectureMLOpsdata architecturegoogle cloud platformamazon web servicesLarge Language Models (LLMs)debuggingdata modernizationDatabricksPysparkPythonProduction troubleshootingData MigrationCloud MigrationRCAMicrosoft AzureGenerative AiCi/Cd