Data Engineer

Job Description

• VERY Strong IN Python, and SQL, Spark / Pyspark (Must know PySpark OptimiZation)
• Real time cloud experience - AWS
• Must have experience in AWS EMR , Redshift, Databricks , airflow.

Roles & Responsibilities

1. We are looking for a self-starter to join our Data Engineering team. You will work in a fast-paced environment where you will get an opportunity to build and contribute to the full lifecycle development and maintenance of the data engineering platform. With the Data Engineering team, you will get an opportunity to -
2. Design and implement data engineering solutions that is scalable, reliable and secure on the Cloud environment
3. Understand and translate business needs into data engineering solutions
4. Build large scale data pipelines that can handle big data sets using distributed data processing techniques that supports the efforts of the data science and data application teams
5. Partner with cross-functional stakeholder including Product managers, Architects, Data Quality engineers, Application and Quantitative Science end users to deliver engineering solutions
6. Contribute to defining data governance across the data platform