Aws Data Engineer

Role & responsibilities

5/8+ years of experience managing development or engineering teams and operations.
You will have extensive knowledge of SQL, Python, AWS Glue and Apache Airflow along with data ETL processing from multiple cloud and on-premises based data sources.
Experience in designing and developing scalable, testable data pipeline using Python and PySpark.
Experience of delivering highly automated solutions and driving quality in data inputs / capture methodologies.
Orchestrating data workflows with AWS services like S3, Redshift, Lambda, Apache Airflow etc.
Experience with AWS cloud infrastructure is a must have for this role.
Strong experience working in a CI/CD environment (GitHub)
Experience with data modelling and data warehousing solutions.
Data architecture experience desirable.
Knowledge of Data Science and Machine Learning is a plus.
Experience in writing unit tests with Pytest framework is a plus.
Experience working in an Agile environment and using tools such as GitLab / Jira.