Data Engineer

Project Role : Data Engineer


Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.


Must have skills : AWS BigData


Good to have skills : NA
Minimum
3 year(s) of experience is required


Educational Qualification : 15 years full time education


Summary:
As a Custom Software Engineer, you will develop custom software solutions to design, code, and enhance components across systems or applications. Your typical day will involve collaborating with cross-functional teams to understand business requirements, utilizing modern frameworks and agile practices to create scalable and high-performing solutions that meet specific business needs. You will engage in problem-solving discussions, contribute innovative ideas, and ensure that the software solutions align with the overall project goals and objectives.


Roles & Responsibilities:

Strong have strong experience in Data Engineering, ETL process, Data quality process

Should have hands on experience in Python/Pyspark and SQL

Should have hands on experience in AWS services EMR, EC2, S3, Glue etc. for ETL process

Expected to perform independently and become an SME.

Required active participation/contribution in team discussions.

Contribute in providing solutions to work related problems.

Collaborate with stakeholders to gather and analyze requirements for software development.

Participate in code reviews to ensure code quality and adherence to best practices.

Shift time will be 1 Pm to 10:30 PM

Candidate should have good communication skills.


Professional & Technical Skills:


Must To Have Skills:

Proficiency in AWS BigData.

Strong understanding of cloud computing concepts and services.

Experience with data processing frameworks such as Apache Spark or Hadoop.

Familiarity with database technologies including SQL and NoSQL databases.

Knowledge of data warehousing solutions and ETL processes.

The candidate should have minimum 3 years of experience in AWS BigData.

This position is based at our Bengaluru office.

A 15 years full time education is required.


Qualification 15 years full time education