NOIDA · FULLTIME
Senior Data Engineer
Iris Software
Noida · onsite · Posted 65d ago
Sourced from
Undisclosed5–10 yrsfulltimeNoida
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.5s
- Found the form on Naukri · 13 questions to answer1.3s
- Decided the answers for all of them3.1s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
Senior Data Engineer
Location: Noida, UP, India
Company: Iris Software
Job Description Must Have - Python & Advanced SQL
- Spark / distributed processing / PySpark
- Cloud platforms (AWS) Modules like Lambda, Glue, EMR, Dynamo DB, S3, Redshift, EC2, RDS, Step Functions, Cloud Watch, Systems Manager, Event Bridge, DMS
- SSIS and experience with C# scripting
- Data pipeline automation
- Kafka/Kinesis streaming
- Basic knowledge of AI
- Power BI
We are seeking a skilled ETL Developer able to develop and maintain jobs in SSIS and ETL pipelines in AWS.
The ideal candidate will have a strong background in SSIS ETL tool and knowledge of AWS modules like Lambda, Glue or EMR.
Responsibilities: - Able to understand existing jobs in SSIS and ability to maintain them in production including resolving issues and making changes to them as per requirement.
- Basic understanding of C# coding.
- Hands on in Python and advanced SQL.
- Good understanding of Spark eco-system and PySpark programming.
- Able to convert existing SSIS workflows to ETL pipelines running on AWS. That includes knowledge of Lambda, Glue or EMR, Systems Manager, Event Bridge, DMS
- Knowledge of Dynamo DB, Redshift, RDS (Preferably Postgre)
- Awareness of reporting tool like Power BI.
- Monitor and troubleshoot migration processes, resolving issues in a timely manner.
- Work closely with business stakeholders, developers, and administrators to understand data requirements.
- Document migration procedures, processes, and best practices.
- Bachelors degree in Computer Science, Information Technology, or related field.
- 5+ years of experience in data migration or similar roles.
- Strong proficiency in SSIS.
- Proven experience in ETL tools like SSIS and data migration pipelines build on AWS.
- Familiarity with data modeling and schema design principles.
- Ability to analyze and resolve complex data-related issues.
- Strong analytical and problem-solving abilities.
- Excellent communication and collaboration skills.
- Ability to work independently and in a team-oriented environment.
- Familiarity with Agile project management methodologies.
- Data Science and Machine Learning - Data Science and Machine Learning - Python
- Data Science and Machine Learning - Data Science and Machine Learning - Apache Spark
- Data & AI - Data Engineering - Data Quality & Validation
- Big Data - Big Data - Pyspark
- Database - Database Programming - SQL
- Data Science and Machine Learning - Data Science and Machine Learning - Databricks
- Beh - Communication and collaboration
Sourced from naukri
Section · 02
Skills
data qualityAutomationAgileApache SparkData Engineerccloud platformsApacheagile project managementadvanced sqlamazon web servicesAnalyticsbusiness automationData EngineeringData MigrationcloudData ModelingBig DataData ScienceArtificial Intelligence
Section · Company
About Iris Software
Iris Software
IT Services & Consulting
4.3k+
employees
1991
35 years old
Edison, New Jersey
United States (USA)
About
IT company for best tech-solutions to enhance business operations
Industries
IT Services & Consulting
Employee ratings
1,895 reviews
3.8/ 5
Culture
3.7
Career growth
3.3
Work-life
3.8
Employees rate it well for
Work Life Balance381Work Culture267Senior Management254Learning202Salary156
Find them on