Consultant - Databricks Pyspark Developer
enGen Global · Chennai · onsite · Posted 50d ago
Undisclosed3–6 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Job Title
Databricks Developer
Job Summary Role Summary: This job involves design and develop data pipeline using Databricks, Pyspark to deliver CMS compliance initiatives. Job will involve extensive interfacing co-ordination with other senior tech folks (across India US) and complete development activities without any follow-ups required
Responsibilities - Understand the overall requirement design of the Project engaged
- Work closely with tech leads in India US to understand the existing data pipeline developed in Databricks,Pyspark GCP
- Own development and enhancement work in the data pipeline (Databricks) and provide regular updates to leads
- Collaborate closely with product managers, data engineers, and stakeholders to translate business requirements into technical solution.
- Bachelors degree or higher from a reputed university
- 3 to 6 years total experience with majority of that experience related to ETL experience with Strong Hands on experience in PySpark Databricks
- Good hands on experience in any Cloud Data platform, GCP is preferred.
- Experience in processing streaming data using Kafka / Pub-Sub
- Experience designing and deploying data pipelines orchestration using Apache Airflow.
- Healthcare industry experience
- Extensive experience in GCP associated Data services
Sourced from naukri
Skills
streamingCMSApache Kafkahealthcare industrydata servicesorchestrationApachegoogle cloud platformapache airflowBusiness Requirementsstreaming dataCloud DataDatabricksPysparkHealthcarecloudoperationscomplianceETLData Pipeline