Data Engineer

About Position:

We are seeking a highly skilled Data Engineer with 5 to 10 years of experience in building enterprise-scale data platforms and modern cloud-based data solutions. The ideal candidate will have strong expertise in Azure, Databricks, SQL, Python, and Generative AI technologies, along with experience developing scalable data pipelines that support Business Intelligence, Advanced Analytics, and AI/ML initiatives.

• Role: Data Engineer
• Location: All Persistent Locations
• Experience: 5-8 yrs
• Job Type: Full Time Employment

What You'll Do:

• Design, develop, and maintain scalable ETL/ELT pipelines and enterprise data integration frameworks.
• Build and optimize data warehouses, data lakes, and cloud-based data platforms.
• Develop robust data transformation workflows using Databricks, Python, Spark, and SQL.
• Create and manage data models that support reporting, analytics, and AI/ML use cases.
• Ensure data quality, integrity, security, availability, and performance across platforms.
• Build and maintain scalable data pipelines for structured and unstructured datasets.
• Collaborate with analytics, AI/ML, and business teams to deliver trusted, analysis-ready data products.
• Support feature engineering and data preparation activities for AI/ML and Generative AI initiatives.
• Develop and optimize advanced SQL queries for data extraction, transformation, and validation.
• Implement automation, monitoring, alerting, and governance standards across data platforms.
• Support cloud data solutions using Azure, Databricks, Snowflake, and related technologies.
• Participate in code reviews and promote engineering best practices and development standards.
• Work closely with DevOps teams to implement CI/CD practices and deployment automation.
• Troubleshoot data pipeline issues and optimize system performance and reliability.
• Contribute to Agile ceremonies including sprint planning, estimation, reviews, and retrospectives.
• Leverage enterprise-approved AI tools to improve productivity, documentation, coding efficiency, and decision-making processes.

Expertise you will bring:

• 5 to 10 years of experience in Data Engineering, Data Warehousing, or Big Data development.
• Strong proficiency in SQL and Python for data engineering, transformation, and processing.
• Hands-on experience building and supporting enterprise-scale ETL/ELT pipelines.
• Strong expertise in Azure cloud services and modern cloud data architectures.
• Experience working with Databricks, Spark, Delta Lake, and large-scale distributed data processing systems.
• Experience designing and managing data lakes and enterprise data warehouse environments.
• Strong understanding of data modeling, data governance, data lineage, and data quality frameworks.
• Experience supporting AI/ML initiatives through feature engineering and data pipeline development.
• Knowledge of Generative AI concepts, LLMs, vector-based architectures, and AI-enabled analytics platforms.
• Experience with Snowflake, Azure Data Factory, Synapse, or similar enterprise data platforms.
• Familiarity with CI/CD pipelines, DevOps practices, Infrastructure as Code, and platform automation.
• Experience working with structured and unstructured datasets in cloud environments.
• Understanding of data security, privacy regulations, and governance best practices.
• Preferred experience within healthcare, payer/provider, claims, operations, or contact center domains.
• Strong analytical, troubleshooting, and performance optimization skills.
• Excellent communication, stakeholder management, and collaboration capabilities.
• Experience working in Agile delivery environments and cross-functional teams.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."