Senior Data Engineer AWS
Innova ESI Private Limited · Gurugram · onsite · Posted 1d ago
About a minute. You'll make an account on the way through.
About this role
- Experience Range – Standard for SAL2- 9+ Years
- Location – anywhere in NCR
SENIOR DATA ENGINEER
OVERVIEW OF ROLE
• Handle client communication to design and deliver large scale Data Transformation.
• Build and support large-scale batch and real-time data pipelines with data processing frameworks like AWS managed services.
• Help drive optimization, testing and tooling to improve data quality and our ability to use data to make product decisions.
• Work in multi-functional agile teams to continuously experiment, iterate and deliver on new product and infrastructure objectives.
• Contribute to and optimize the existing data infrastructure
• Support for the integration of API calls to gather third-party vendor data.
REQUIRED QUALIFICATIONS
• 7 + years of experience building ETL pipeline to handle large datasets
• 3 + years of experience with AWS: S3, Glue, Aurora,Databricks and other services
• 2+ years of experience in data modeling and database design
• 3 + years of experience with data modeling and/or migrating data from legacy systems
• Must have strong SQL skills. Proficient in at least one of programming languages: Python, Scala, Go or Java.
PREFERRED QUALIFICATIONS
• Data engineer with API development experience
• Experience with Redis or any in-memory database
• Relevant AWS Certifications in cloud computing, data engineering, and/or solutions architecture.
• Previous developing and debugging experience in a large team
• Detail-oriented with an ability to effectively multi-task in a deadline-driven atmosphere.
• 3 + years of experience writing and maintaining infrastructure code.
• 5 + years of experience using any automation tools and CI/CD pipelines
• Nice to have experience in Lambda functions, IAM, Step functions, CloudWatch
Sourced from foundit