Aws Data Engineer

Roles & Responsibilities :

Hands-on experience in Python/PySpark with strong experience in Spark /PySpark, Databricks, AWS services ,Spark SQL for big data processing and,Kafka, Airflow.

• Worked in a complex deadline driven projects with minimal supervision. Ability to architect/design/develop with minimum requirements by effectively.
• 2+ experience on Apache Kafka streaming processing and Python/PySpark.
• End to end understanding of Databricks architecture, design, development and implementation.
• Min 5+ years of good experience on AWS clouds and Data bricks,Airflow.
• Excellent work ethics with ability to work independently.
• Hands-on experience in SQL, PL/SQL, Unix Shell Scripting, Autosys.
• Experience with relational databases such as Oracle, PostgreSQL as well as NoSQL databases
• Data integration techniques and tools including APIs and data streaming
• Strong analytical and problem solving skills, with the ability to identify and resolve issues in data pipelines and systems
• Experience with Agile software development methodology and version control systems like GitHub
• Expertise in Data Modeling and DB design with the skills in performance tuning