Agent
Jobs
Applied
Tracker
Profile
    1. Jobs for you
    2. Job

    Job · 18393067

    HYDERABAD · FULLTIME

    Lead II - Data Engineering_BCBSA_Databricks; AWS; Python

    UST Global logo

    UST Global

    Hyderabad · onsite · Posted 33d ago

    Sourced fromNaukri
    Undisclosed7–12 yrsfulltimeHyderabad

    About a minute. You'll make an account on the way through.

    agent · working

    • Read this posting0.4s
    • Found the form on Naukri · 10 questions to answer1.7s
    • Decided the answers for all of them2.8s
    • Tailor your résumé to this role
    • Waiting for you

    Section · 01

    About this role

    Job Summary
    Lead Data Engineer (US Healthcare / Medicare Advantage) Position Overview We are seeking a Lead Data Engineer to architect, build, and optimize scalable, cloud-native data systems. In this role, you will lead the development of enterprise data platforms using Databricks and AWS. You must possess deep domain expertise in US Healthcare, with a strict requirement for hands-on experience handling Medicare Advantage data.


    Responsibilities
    • Lead the design, implementation, and maintenance of robust data pipelines on AWS using Databricks.
    • Architect scalable lakehouse structures leveraging Apache Iceberg to ingest, process, and store complex healthcare data types.
    • Establish comprehensive data governance and data lineage frameworks using Databricks Unity Catalog.
    • Implement secure access controls, data masking, and row-level security through Role-Based Access Control (RBAC) to ensure data security rules are enforced.
    • Architect and scale ingestion frameworks capable of processing HL7 and FHIR data feeds natively into the lakehouse ecosystem.
    • Oversee the end-to-end processing of Medicare Advantage data assets, ensuring accurate risk adjustment and reporting workflows.
    • Ensure strict adherence to healthcare regulations, including HIPAA compliance and robust data governance frameworks.
    • Mentor junior engineers, conduct code reviews, and drive technical best practices across the data team.


    Required Skills & Qualifications
    • 7+ years of data engineering experience, with at least 2 years in a technical lead role.
    • Production experience building and optimizing large-scale pipelines within Databricks.
    • Production experience deploying data infrastructure on AWS (specifically S3, EMR, Lambda, IAM, and Glue).
    • Comprehensive understanding of US Healthcare data, with explicit, hands-on experience processing Medicare Advantage data (e.g., CMS enrollment, RAPS/EDPS submissions, MMR/MOR files, or HCC risk adjustment models).
    • Proven experience working with healthcare interoperability standards, specifically FHIR and HL7 models.
    • Deep understanding and practical experience working with open table formats, specifically Apache Iceberg.
    • Expert-level knowledge of Databricks Unity Catalog for centralized data governance.
    • Proven experience implementing enterprise-level Role-Based Access Control (RBAC) and row-level security for protected health information (PHI).
    • Mastery of Python, PySpark, and advanced SQL for complex distributed computing tasks.


    Good-to-Have Skills
    • Databricks Certified Data Engineer Professional or AWS Certified Data Analytics certification.
    • Familiarity with orchestration tools like Apache Airflow or AWS Step Functions.


    Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

    Sourced from naukri

    Section · 02

    Skills

    CMSorchestrationApacheaccess controlhipaaUS HealthcarePythonSQLData SecurityData Governance

    Section · Company

    About UST

    UST Global logo

    UST Global

    IT Services & Consulting

    14.0k+

    employees

    1999

    27 years old

    Aliso Viejo, California

    US

    ₹12.9L PA avg

    Avg at UST

    About

    UST helps the world's best organizations succeed through digital transformation, crafting disruptive solutions and strategies bringing our clients vision to life.

    Industries

    IT Services & ConsultingManufacturing

    Employee ratings

    0 reviews

    3.7/ 5

    Employees rate it well for

    Work-Life Balance38Company Culture37

    Find them on

    WebsiteLinkedInAmbitionBox reviews

    Lead II - Data Engineering_BCBSA_Databricks; AWS; Python · waiting for your command