Senior Data Engineering Lead
Optum Global Solutions · Pune · hybrid · Posted 40d ago
Undisclosed8–13 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
- Overall 5+ YRS of experience in Data Engineering
- Advanced Python, SQL, and Apache Spark/PySpark; strong understanding of distributed processing and performance tuning.
- Production Databricks experience with Auto Loader, Delta Lake, Workflows, Unity Catalog, notebooks/jobs, SQL Warehouses, and cluster/job optimization.
- Hands-on AWS experience with S3, IAM, VPC, ECS/EKS or Lambda, Step Functions, EventBridge, CloudWatch, Secrets Manager, and KMS.
- Practical Apache Iceberg knowledge, including tables, catalogs, snapshots, schema/partition evolution, compaction, and interoperability with query engines.
- Experience with Git, pull requests, CI/CD, Docker, Terraform/CloudFormation, automated testing, observability, and incident response.
- Experience processing semi-structured data and building resilient ingestion pipelines with quality controls, error handling, and replay capability.
- Healthcare data knowledge: FHIR R4 and/or HL7 v2, OMOP CDM, clinical terminologies, PHI, HIPAA-aligned engineering controls, and de-identification concepts.
- Demonstrated responsible use of AI coding tools and the ability to critically review, test, and productionize generated code.
Sourced from naukri
Skills
amazon web servicesDatabricksPysparkMicrosoft Azure
About Optum Global Solutions
Optum Global Solutions
IT Services & Consulting
33.0k+
employees
2002
24 years old
Hyderabad / Secunderabad, Telangana
India
₹11L PA avg
Avg at Optum Global Solutions
About
We are at the helm of a digital health care revolution, which is being accelerated by a combination of technology and talent. We build and deliver end-to-end digital health solutions for our clients.
Industries
IT Services & ConsultingHardware & NetworkingHealthcareSoftware Product
Employee ratings
10 reviews
4.0/ 5
Culture
3.6
Career growth
3.0
Work-life
3.6
Employees rate it well for
Job Security42Work-Life Balance41
Find them on