Data Engineer

Project Role : Data Engineer

Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Must have skills : AWS BigData

Good to have skills : NA

Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Custom Software Engineer, you will develop custom software solutions to design, code, and enhance components across systems or applications. Your typical day will involve collaborating with cross-functional teams to understand business requirements, utilizing modern frameworks and agile practices to create scalable and high-performing solutions that meet specific business needs. You will engage in problem-solving discussions, contribute innovative ideas, and ensure that the software solutions align with the overall project goals and objectives. Roles & Responsibilities:

• Strong have strong experience in Data Engineering, ETL process, Data quality process
• Should have hands on experience in Python/Pyspark and SQL
• Should have hands on experience in AWS services EMR, EC2, S3, Glue etc. for ETL process
• Expected to perform independently and become an SME.
• Required active participation/contribution in team discussions.
• Contribute in providing solutions to work related problems.
• Collaborate with stakeholders to gather and analyze requirements for software development.
• Participate in code reviews to ensure code quality and adherence to best practices.
• Shift time will be 1 Pm to 10:30 PM
• Candidate should have good communication skills. Professional & Technical Skills:
• Must To Have Skills: Proficiency in AWS BigData.
• Strong understanding of cloud computing concepts and services.
• Experience with data processing frameworks such as Apache Spark or Hadoop.
• Familiarity with database technologies including SQL and NoSQL databases.
• Knowledge of data warehousing solutions and ETL processes. Additional Information:
• The candidate should have minimum 3 years of experience in AWS BigData.
• This position is based at our Bengaluru office.
• A 15 years full time education is required. , 15 years full time education