LEAD ENGINEER - Databricks
Happiest Minds Technologies · Pune · onsite · Posted 58d ago
Not disclosedFresherfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Responsibilities
- Design, develop, and maintain scalable data pipelines and architectures using Databricks.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Implement data ingestion processes from various sources, ensuring data quality and integrity.
- Optimize data storage and retrieval processes for performance and cost efficiency.
- Monitor and troubleshoot data pipeline performance and reliability issues.
- Document data engineering processes, architectures, and best practices.
- Stay updated with the latest trends and technologies in data engineering and analytics.
- Strong expertise in Databricks and its ecosystem.
- Proficient in programming languages such as Python, Scala, or Java.
- Experience with data modeling, ETL processes, and data warehousing concepts.
- Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
- Solid understanding of SQL and experience with relational databases.
- Knowledge of big data technologies (e.g., Spark, Hadoop) is a plus.
- Experience with data visualization tools (e.g., Tableau, Power BI).
- Familiarity with machine learning concepts and frameworks.
- Knowledge of data governance and data security best practices.
- Experience with CI/CD pipelines and version control systems (e.g., Git).
Sourced from foundit
Skills
Apache SparkScalarelational databasesgoogle cloud platformamazon web servicesETL ProcessesApache HadoopDatabricksPythonPower BiTableauSQLData SecurityData WarehousingJavaData GovernanceMicrosoft AzureData ModelingGITMachine Learning
About Happiest Minds Technologies
Happiest Minds Technologies
IT Services & Consulting
6.5k+
employees
2011
15 years old
Bangalore / Bengaluru, Karnataka
India
About
A technology firm specializing in digital transformation services utilizing advanced technologies to enhance enterprise efficiency and customer experience.
Industries
IT Services & Consulting
Employee ratings
1,441 reviews
3.4/ 5
Culture
3.4
Career growth
2.8
Work-life
3.6
Employees rate it well for
Work Life Balance210Work Culture165Senior Management138Salary104Learning80
Find them on