Senior Databricks Engineer with Python
Luxoft · Pune · onsite · Posted today
Undisclosed4–9 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Job Summary
Responsibilities
Skills
Must have
Nice to have
Other
Languages
Seniority
We are looking for a Senior Databricks Engineer. The primary focus of this role is built in Python, while also leading the migration to Azure Databricks to improve performance, scalability, and efficiency. This role involves developing, optimizing, and automating reporting processes using PySpark and SQL, ensuring accurate and timely regulatory report generation. This is an exciting opportunity to work on.
Responsibilities
- Implement high-quality solutions that address business needs and adhere to industry standards
- Drive automation of manual processes to the next level
- Closely collaborate within an agile team and a global agile organization
- Translate high-level business requirements into technical requirements addressing reliability, scalability, and performance needs
Skills
Must have
- Minimum of 4+ years of experience developing enterprise Databricks applications.
- Hands-on experience with Databricks ETL/data-loading mechanisms using Databricks Jobs, including relevant performance tuning and optimisation.
- Ability to independently understand business requirements and translate them into efficient, high-performing Databricks implementations.
- Data modelling experience would be an added advantage.
- Experience with Databricks deployments using Databricks Asset Bundles (DAB) would be an added advantage.
- Excellent communication skills.
Nice to have
- Azure Data Services
- ETL Data Processing
- Financial Data Processing, experience handling risk, compliance, and regulatory data in an investment banking environment.
- Data Modeling, metadata management
- Git, GitHub, GitLab
- Jenkins
- Regulatory compliance knowledge: Basel, MiFID, GDPR
- Big Data
- Cloud security and access controls (IAM, RBAC)
- Familiarity with Docker, Kubernetes, Apache
Other
Languages
English: C1 Advanced
Seniority
Senior
Sourced from naukri
Skills
AutomationDockerAgileAzure Data ServicesApacheBusiness RequirementsAutomatingBankingDatabrickscloudCloud SecurityCommunication SkillsAzure DatabrickscomplianceData ProcessingETLMicrosoft AzureData ModelingBig Data
About Luxoft
Luxoft
IT Services & Consulting
2.3k+
employees
2000
26 years old
Zug, Switzerland
Switzerland
About
Luxoft offers the full spectrum of enterprise technology services, from modernizing legacy IT systems to delivering digital transformation at scale.
Industries
IT Services & Consulting
Employee ratings
832 reviews
3.6/ 5
Culture
3.6
Career growth
2.7
Work-life
3.9
Employees rate it well for
Work Life Balance165Salary128Senior Management87Work Culture76Appraisal64
Find them on