NOIDA · FULLTIME
Data Engineer - Lead
Iris Software
Noida · onsite · Posted 56d ago
Sourced from
Undisclosed8–13 yrsfulltimeNoida
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.6s
- Found the form on Naukri · 10 questions to answer1.3s
- Decided the answers for all of them2.7s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
Job Title: Data Engineer - Lead
Location: Noida, UP, India
Job Overview Summary - The Lead Data Engineer is a strategic and technical leadership role responsible for architecting, scaling, and evolving enterprise-grade data platforms that enable advanced analytics, AI/ML, and data-driven decision-making. Reporting to the Senior Director of Data Platforms, this role will lead the design and governance of modern data architectures, drive innovation in AI orchestration, and ensure the delivery of secure, compliant, and high-performing data solutions.
- This position combines hands-on engineering expertise with architectural vision and cross-functional leadership. The Lead Data Engineer will guide engineering teams, influence platform strategy, and establish best practices across the organizations data ecosystem.
- Bachelors or Masters degree in Computer Science, Engineering, Data Science, or related field.
- 8+ years of experience in data engineering and architecture, with a proven track record of leading large-scale data initiatives.
- Deep expertise in Python, PySpark.
- Strong hands-on experience with Databricks (Spark, Delta Lake, Workflows)
- Strong experience with AWS (S3, IAM, Textract, Bedrock or equivalent)
- Experience with design and implement scalable document ingestion pipelines using Databricks Auto Loader and AWS S3.
- Understanding of vector embeddings and semantic search
- Strong understanding of data governance, privacy, and compliance in regulated industries (healthcare, life sciences).
- Advanced knowledge of data modeling, lakehouse/lake/warehouse design, and performance optimization.
- Familiarity with generative AI platforms and use cases.
- Contributions to open-source projects or thought leadership in data engineering/architecture.
- Experience with Agile methodologies, CI/CD, and DevOps practices.
- Exposure to FastAPI, or API-based ML services
- Experience evaluating LLM output quality
- Lead Engineering Teams: Provide technical leadership and mentorship to data engineers, fostering a culture of excellence, innovation, and continuous improvement.
- AI/ML Enablement: Collaborate with Data Science and ML Engineering teams to operationalize models, implement AI orchestration frameworks (e.g., MLflow, Airflow), and ensure scalable deployment pipelines.
- Platform Strategy & Governance: Define and enforce architectural standards, data governance policies, and compliance frameworks (HIPAA, SOC 2, GDPR, etc.) across the data platform.
- Performance & Reliability Optimization: Drive observability, automation, and performance tuning across data pipelines and infrastructure to ensure reliability at scale.
- Cross-Functional Collaboration: Partner with product, analytics, compliance, and infrastructure teams to align data architecture with business goals and regulatory requirements.
- Innovation & Thought Leadership: Stay ahead of industry trends, evaluate emerging technologies, and contribute to strategic decisions on platform evolution, including generative AI integration and event-driven systems.
- Data Science and Machine Learning - Data Science and Machine Learning - Python
- Database - Database Programming - SQL
- Big Data - Big Data - Pyspark
- Data & AI - Data Engineering - Data Quality & Validation
- Beh - Communication and collaboration
Sourced from naukri
Section · 02
Skills
data qualityDevopsAgileApache SparkData Engineeraws iamperformance optimizationamazon web servicesapache airflowLarge Language Models (LLMs)AWS S3DatabricksPythonSQLArchitectureData GovernancecomplianceData ModelingBig DataData ScienceArtificial IntelligenceMachine Learning
Section · Company
About Iris Software
Iris Software
IT Services & Consulting
4.3k+
employees
1991
35 years old
Edison, New Jersey
United States (USA)
About
IT company for best tech-solutions to enhance business operations
Industries
IT Services & Consulting
Employee ratings
1,895 reviews
3.8/ 5
Culture
3.7
Career growth
3.3
Work-life
3.8
Employees rate it well for
Work Life Balance381Work Culture267Senior Management254Learning202Salary156
Find them on