NOIDA · FULLTIME
Big Data - Senior Engineer
Iris Software
Noida · onsite · Posted 49d ago
Sourced from
Undisclosed5–8 yrsfulltimeNoida
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.4s
- Found the form on Naukri · 13 questions to answer1.5s
- Decided the answers for all of them2.5s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
Job Summary
Big Data - Senior Engineer
Location Noida, Gurugram, Pune
Experience 5-8 Years
Mandatory Skills - Azure Databricks
- Data Ingestion Tools (Sqoop)
- Hadoop (HDFS + YARN)
- Hadoop Ecosystem Fundamentals (HBase + Impala)
- Scala
- Cloudera
- SQL
- Apache Iceberg
- Design scalable Big Data solutions using Apache Spark, Hadoop, Azure Databricks, and modern data platform technologies.
- Define data processing architecture, transformation strategies, and engineering standards aligned with business objectives.
- Lead development of distributed data processing pipelines using Spark (Scala or PySpark) and Hadoop ecosystem technologies.
- Design and optimize SQL and Hive-based data processing solutions to improve performance and scalability.
- Architect and optimize Azure Databricks solutions supporting large-scale data engineering and analytics workloads.
- Design and implement data Lakehouse solutions leveraging Apache Hudi or Apache Iceberg.
- Establish data ingestion, transformation, validation, and reconciliation frameworks to improve data reliability.
- Drive performance tuning initiatives across Spark jobs, Databricks workloads, Hive queries, and Hadoop processing environments.
- Review data engineering solutions to ensure adherence to architecture, performance, and engineering standards.
- Troubleshoot complex data processing, performance, and platform issues through detailed root cause analysis.
- Mentor team members on Spark, Hadoop, Databricks, Hudi/Iceberg, SQL optimization, and Big Data engineering best practices.
- Collaborate with various teams and stakeholders to support end-to-end data platform delivery.
- Drive continuous improvement initiatives focused on scalability, performance, reliability, and operational efficiency.
- Demonstrates strong ownership while driving Big Data Engineering excellence.
- Collaborate effectively with various teams and business stakeholders to ensure smooth delivery.
- Promotes quality-focused engineering through proactive validation, optimization, and continuous improvement.
- Applies strong analytical thinking to evaluate complex data engineering and platform challenges.
- Demonstrate adaptability while managing evolving technologies, data ecosystems, and business requirements.
- Communicates effectively regarding delivery status, risks, dependencies, and improvement opportunities.
- Maintains high attention to detail across data architecture, processing design, testing, and implementation activities.
- Encourages continuous improvement in data engineering practices and platform operations.
- Supports knowledge sharing and mentoring to strengthen team capabilities.
- Balances scalability, performance, reliability, and business priorities while driving delivery excellence.
- Big Data - Big Data - Azure Databricks
- Big Data - Big Data - Cloudera
- Programming Language - Scala - Scala
- Big Data - Big Data - Hadoop
- Big Data - Big Data - Impala
- Big Data - Big Data - HDFS
- Big Data - Big Data - Yarn
- Cloud - Cloud - Apache Iceberg
- Database - Query Language - SQL
Sourced from naukri
Section · 02
Skills
AutomationApache SparkData ingestionData LakehouseApachedata architectureBusiness RequirementsclouderaAnalyticsbusiness automationData EngineeringcloudArchitectureAzure DatabricksData ProcessingMicrosoft AzureBig Data
Section · Company
About Iris Software
Iris Software
IT Services & Consulting
4.3k+
employees
1991
35 years old
Edison, New Jersey
United States (USA)
About
IT company for best tech-solutions to enhance business operations
Industries
IT Services & Consulting
Employee ratings
1,895 reviews
3.8/ 5
Culture
3.7
Career growth
3.3
Work-life
3.8
Employees rate it well for
Work Life Balance381Work Culture267Senior Management254Learning202Salary156
Find them on