AHMEDABAD · FULLTIME
Lead Data Engineer - Databricks
Kanerika Software
Ahmedabad · onsite · Posted 37d ago
Sourced from
Undisclosed2–7 yrsfulltimeAhmedabad
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.2s
- Found the form on Naukri · 5 questions to answer1.8s
- Decided the answers for all of them2.1s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
":"
About Kanerika
Who we are:
Kanerika Inc. is a premier global software products and services firm that specializes in providing innovative solutions and services for data-driven enterprises. Our focus is to empower businesses to achieve their digital transformation goals and maximize their business impact through the effective use of data and AI. We leverage cutting-edge technologies in data analytics, data governance, AI-ML, GenAI/ LLM and industry best practices to deliver custom solutions that help organizations optimize their operations, enhance customer experiences, and drive growth.
Awards and Recognitions
Kanerika has won several awards over the years, including:
CMMI Level 3 Appraised in 2024.
Best Place to Work 2023 by Great Place to Work
Top 10 Most Recommended RPA Start-Ups in 2022 by RPA today.
Frost Sullivan India 2021 Technology Innovation Award for its Kompass composable solution architecture.
Kanerika has also been recognized for its commitment to customer privacy and data security, having achieved, ISO 9001, ISO 27701, SOC2, and GDPR compliances .
Working for us
Kanerika is rated 4.6/5 on Glassdoor, for many good reasons. We truly value our employees growth, well-being, and diversity, and peoples experiences bear this out. At Kanerika, we offer a host of enticing benefits that create an environment where you can thrive both personally and professionally. From our inclusive hiring practices and mandatory training on creating a safe work environment to our flexible working hours and generous parental leave, we prioritize the well-being and success of our employees. Our commitment to professional development is evident through our mentorship programs, job training initiatives, and support for professional certifications. Additionally, our company-sponsored outings and various time-off benefits ensure a healthy work-life balance. Join us at Kanerika and become part of a vibrant and diverse community where your talents are recognized, your growth is nurtured, and your contributions make a real impact. See the benefits section below for the perks you get while working for Kanerika.
Locations
We are located in Austin (USA), Singapore, Hyderabad, Indore and Ahmedabad (India).
Job Location: Hyderabad, Indore and Ahmedabad (India)
Requirements
Requirements
Role:
As one of the founding members of Kanerikas Databricks delivery practice, you will be a hands-on builder responsible for designing, developing, and optimizing data pipelines on Databricks for client engagements. Youll work closely with the Practice Lead to translate architecture into working solutions, build reusable accelerators ahead of client demand, and help establish engineering best practices for the growing team.
Key Responsibilities
Design, build, and optimize ETL/ELT data pipelines on Databricks using PySpark and Spark SQL.
Build and maintain incremental ingestion pipelines using Auto Loader and structured streaming, including checkpoint management and schema evolution handling.
Implement and maintain Delta Lake tables (including Change Data Feed and liquid clustering), Unity Catalog structures, and Databricks Workflows for client and internal projects.
Build reusable accelerators, templates, and demo environments to support pre-sales and speed up future client delivery.
Collaborate with the Practice Lead/Architect on solution design for client engagements, providing engineering-level input on feasibility and effort.
Perform data quality checks, performance tuning, and cost optimization on Databricks clusters and jobs.
Participate in client-facing technical discussions as needed, including discovery sessions and technical walkthroughs.
Write clean, well-documented, and testable code following team engineering standards.
Mentor junior engineers as the team scales, and contribute to internal knowledge-sharing and best-practice documentation.
Troubleshoot and resolve production data pipeline issues across client environments.
Stay current with Databricks platform releases across Unity Catalog, Lakeflow Declarative Pipelines, and share learnings with the team through internal knowledge sessions and documentation.
Required Skills Experience
59 years of data engineering experience, with at least 2 years of hands-on Databricks experience in production.
Strong proficiency in PySpark and/or Spark SQL for large-scale data processing.