AEP Data Engineer

Skills Required6+ years(6 year) of professional software engineering mostly focused on the following:

• Developing ETL pipelines involving big data.
• Developing data processing\analytics applications primarily using PySpark.
• Experience of developing applications on cloud(AWS) mostly using services related to storage, compute, ETL, DWH, Analytics and streaming.
• Clear understanding and ability to implement distributed storage, processing and scalable applications.
• Experience of working with SQL and NoSQL database.
• Ability to write and analyze SQL, HQL and other query languages for NoSQL databases.
• Proficiency is writing disitributed & scalable data processing code using PySpark, Python and related libraries.ValidationStart Date ValidatedJob DescriptionWhat you’ll do
• Develop low level design as per approved Tech Specification or equivalent inputs provided.
• Build and deliver technology deliverables as per Tech Specifications/low level design or equivalent inputs.
• Build and delivery technology deliverables compliant with functional requirements.
• Build and deliver technology deliverables in accordance with the best practices to ensure compliance with non-functional aspects like scalability, maintainability, performance etc.
• Process technology deliverables through full development lifecycle.
• Maintain and support existing solutions and technology frameworks.
• Attend regular scrum events of equivalent and provide update on the deliverables.
• Work independently with none or minimum supervision. Skills: aws,data engineer,pyspark