Data Engineer

About Position:

We are seeking a highly skilled Data Engineer with strong expertise in Azure, Databricks, SQL, Python, and Generative AI technologies. The ideal candidate will be responsible for designing, developing, and optimizing scalable enterprise data platforms that support business intelligence, advanced analytics, AI/ML initiatives, and data-driven decision-making.

• Role: Data Engineer-LLM
• Location: All Persistent Locations
• Experience: 8 to 12 Years
• Job Type: Full-Time Employment

What You'll Do:

• Design, develop, and maintain scalable data pipelines and integration frameworks across cloud-based data platforms.
• Build and optimize enterprise data warehouses, data lakes, and modern data lakehouse architectures.
• Develop and support ETL/ELT pipelines for ingesting, transforming, and processing large-scale structured and unstructured datasets.
• Implement data engineering solutions using Azure Databricks, Spark, Python, and SQL.
• Support AI/ML and Generative AI initiatives through feature engineering, data preparation, and scalable data platform development.
• Collaborate with business stakeholders, analytics teams, and data scientists to deliver reliable and business-ready data products.
• Ensure data quality, governance, security, integrity, scalability, and availability across enterprise platforms.
• Optimize data processing workloads and improve platform performance through automation and monitoring.
• Build and maintain reusable data engineering frameworks and best practices.
• Participate in architecture discussions and contribute to data platform modernization initiatives.
• Support cloud migration, data integration, and platform optimization programs.
• Implement CI/CD processes, DevOps practices, and automation for data engineering solutions.
• Troubleshoot production issues and perform root cause analysis for data platform and pipeline failures.-native technologies and modern data platform architectures.

Expertise You'll Bring:

• 8-12 years of experience in Data Engineering, Data Warehousing, or Big Data development.
• Strong expertise in SQL and Python for large-scale data processing and engineering solutions.
• Hands-on experience with Azure cloud services, Azure Databricks, Spark, and enterprise data platforms.
• Experience designing, developing, and supporting scalable ETL/ELT pipelines.
• Strong understanding of data warehousing, data lake, and lakehouse architectures.
• Experience with data modeling, dimensional modeling, and enterprise data architecture.
• Knowledge of data governance, data quality management, metadata management, and data security practices.
• Experience supporting Business Intelligence, Advanced Analytics, AI/ML, and Generative AI initiatives.
• Exposure to LLM-based solutions, AI data preparation frameworks, and enterprise GenAI use cases.
• Experience with Azure Data Factory, Azure Synapse Analytics, Snowflake, or similar modern data platforms.
• Familiarity with CI/CD pipelines, DevOps practices, Infrastructure as Code, and automation frameworks.
• Experience working in Agile delivery environments and collaborating with cross-functional teams.
• Experience working with large-scale structured and unstructured datasets in cloud environments.
• Healthcare, payer/provider, claims, operations, or contact center domain experience is preferred.
• Strong analytical, troubleshooting, communication, and stakeholder management skills.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."