NOIDA · FULLTIME
Senior Data Engineer
Iris Software
Noida · onsite · Posted 12d ago
Sourced from
Undisclosed7–8 yrsfulltimeNoida
Your match
?
Sign in to see your match score, skill gaps & tailored resume.
Section · 01
About this role
Job Summary
Job title: Senior Data Engineer
Location: Noida, Uttar Pradesh, India
Company: Iris Software
Job Details - Experience: 7-8 Years
- Locations: Noida, Gurugram, Pune
- Mandatory skills: Amazon Kinesis, Apache Spark, Data Quality Validation, PySpark, SQL, Apache Airflow, Delta Lake on Databricks
- Additional skills: Python, DevOps CI/CD Basics
- Design scalable data engineering solutions using PySpark and modern distributed data processing frameworks.
- Define data ingestion, transformation, and processing architectures aligned with business and analytical objectives.
- Design and optimize Snowflake or Delta Lake on Databricks solutions to support enterprise-scale data platforms.
- Lead implementation of high-performance batch and streaming data pipelines.
- Design and optimize event-driven data architectures using Apache Kafka or Amazon Kinesis.
- Define data streaming standards, integration frameworks, and scalable processing patterns.
- Architect workflow orchestration solutions using Apache Airflow or Databricks Workflows.
- Establish monitoring, scheduling, and operational controls for reliable pipeline execution.
- Drive data quality, validation, reconciliation, and governance practices across data engineering solutions.
- Design data engineering solutions following modern Lakehouse architecture principles, data observability practices, and platform engineering standards to improve scalability, reliability, and operational visibility.
- Drive development of business-focused data products by improving data quality, discoverability, usability, documentation, and trusted data consumption across analytical platforms.
- Promote responsible use of AI-assisted engineering capabilities to improve development productivity, testing, documentation, and engineering quality.
- Review data pipeline designs and implementations to ensure adherence to engineering, scalability, and performance standards.
- Troubleshoot complex data processing, workflow, and streaming platform issues through detailed root cause analysis.
- Mentor team members on PySpark, Snowflake, Delta Lake, Kafka, Kinesis, Airflow, and data engineering best practices.
- Collaborate with various teams and stakeholders to support end-to-end data platform delivery.
- Demonstrates strong ownership while driving data engineering excellence.
- Collaborate effectively with various teams and business stakeholders to ensure smooth delivery.
- Promotes quality-focused engineering through proactive validation, optimization, and continuous improvement.
- Apply strong analytical thinking to evaluate complex data engineering and platform challenges.
- Demonstrate adaptability while managing evolving technologies, data ecosystems, and business requirements.
- Communicates effectively regarding delivery status, risks, dependencies, and improvement opportunities.
- Maintains high attention to detail across data architecture, pipeline design, testing, and implementation activities.
- Encourages continuous improvement in data engineering practices and platform operations.
- Supports knowledge sharing and mentoring to strengthen team capabilities.
- Balances scalability, performance, reliability, and business priorities while driving delivery excellence.
- Promotes innovation by adopting modern data engineering practices, platform engineering principles, and AI-assisted development approaches to improve engineering productivity and solution quality.
Sourced from naukri
Let the agent run this one for you.
Tailored resume, auto-apply, and referral lookup — in under 2 minutes.
Section · 02
Skills
AutomationApache SparkData EngineerData ingestionApache KafkaApachedata architectureapache airflowBusiness RequirementsAnalyticsbusiness automationData ObservabilityData EngineeringcloudArchitectureArtificial Intelligence
Section · Company
About Iris Software
Iris Software
IT Services & Consulting
4.3k+
employees
1991
35 years old
Edison, New Jersey
United States (USA)
About
IT company for best tech-solutions to enhance business operations
Industries
IT Services & Consulting
Employee ratings
1,895 reviews
3.8/ 5
Culture
3.7
Career growth
3.3
Work-life
3.8
Employees rate it well for
Work Life Balance381Work Culture267Senior Management254Learning202Salary156
Find them on