Aws Databricks Platform Engineer
Qualcomm · Hyderabad · onsite · Posted 28d ago
Undisclosed12–17 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Job Summary
We are hiring a Data Platform Engineer to design, build, and operate a modern, data platform with AWS Databricks Lakehouse as a core foundation. This role is ideal for a senior engineer who excels in system design, platform innovation, and hands on execution. You will help design, implement and improve reliability of the data platform, influence architectural direction, and mentor engineers while working closely with data scientists, analysts, and application teams. This is a hands on, high impact role with strong ownership across architecture, implementation, reliability, security, and cost optimization.
Key Responsibilities - Design and build scalable, distributed data platform systems
- Own Databricks workspace architecture, governance, and lifecycle management
- Implement infrastructure as code using Terraform/Terramate
- Build and support end to end data pipelines, from ingestion to analytics and ML
- Develop and maintain CI/CD pipelines for infrastructure, data pipelines, notebooks, SQL, and ML artifacts
- Operate and optimize Amazon EKS clusters supporting data workloads
- Define and monitor SLIs/SLOs for platform reliability and data quality
- Drive innovation and continuous improvement across platform architecture and tooling
- Lead incident response, on call rotations, and blameless post mortems
- Implement strong security, compliance, and governance controls
- Mentor engineers and influence platform standards and best practices
- 5+ years of IT-related work experience with a Bachelor's degree in Computer Engineering, Computer Science, Information Systems or a related field.
- OR 7+ years of IT-related work experience without a Bachelors degree.
- 3+ years of work experience with programming (e.g., Java, Python).
- 3+ years of work experience with SQL or NoSQL Databases.
- 3+ years of work experience with Data Structures and algorithms.
- 12+ years of IT-related work experience in Data Platform build-out with a Bachelor's degree.
- 10+ years of Platform engineering experience in building and operating AWS Databricks platforms
- System Design Innovation
- Proven experience in designing complex, distributed data systems end to end
- Strong system design skills across cloud infrastructure, data pipelines, storage, governance, and observability
- Ability to evaluate and communicate architectural trade offs (scalability, reliability, cost, security, operability)
- Demonstrated innovation mindset, such as: Modernizing or simplifying legacy data platforms, Introducing new architectural patterns or platform capabilities, Improving reliability, performance, or developer experience through design
- Cloud Data Platform Expertise
- Building and operating large scale cloud platforms experience with DevOps, SRE, or DataOps roles
- Expert level experience with AWS, including networking, IAM, security, and multi account environments
- Strong hands on experience with Databricks Lakehouse Platform, including: Unity Catalog, Delta Lake, MLflow
- Experience owning Databricks workspace architecture and governance
- Infrastructure, Automation Reliability
- Deep experience with Terraform/Terramate (or similar IaC tools)
- Proven experience building CI/CD pipelines (GitHub Actions, Jenkins)
- Advanced Python and Bash scripting skills
- Hands on experience managing Amazon EKS clusters and Helm deployments
- Experience defining and operating SLIs/SLOs for platform reliability and data quality
- Security Leadership
- Strong understanding of cloud security best practices
- Experience supporting SOX, GDPR, or regulated environments
- AWS Certified DevOps Engineer Professional (or equivalent experience)
- Ability to work independently and mentor team members
- Strong communication skills to explain complex system designs to technical and non technical stakeholders
- Experience with Acceldata, OpenTelemetry, or data observability tools
- Experience with Fivetran Hybrid / HVR or enterprise ingestion tools
- Experience working with Hashicorp vault or similar secret management tools
- Policy as code experience using OPA
- Experience working with static Code analysis tool like Sonar
- Experience with data lineage or metadata management tools
- Databricks serverless compute optimization and cost management
- Experience driving platform strategy across multiple teams distributed globally
Sourced from naukri
Skills
AutomationBashCI/CD Pipelinescloud platformsamazon web servicesarchitectural patternsAnalyticsAWS DatabricksCloud InfrastructurecloudCloud SecurityCommunication SkillsAlgorithmsArchitectureAWS Certifiedcompliance
About Qualcomm
Qualcomm
Semiconductors
22k+
employees
1996
30 years old
San Diego,California
United States
About
Qualcomm invents breakthrough technologies that transform how the world connects, computes and communicates.
Industries
SemiconductorsHardware & Networking
Employee ratings
1,207 reviews
3.7/ 5
Culture
3.4
Career growth
3.2
Work-life
3.3
Employees rate it well for
Work Life Balance267Salary160Work Culture155Learning100Senior Management91
Find them on