AWS Glue Professional

Mandatory Skills : AWS Glue, AWS Lambda, Python, Snowflake
Good to Have Skills : Apache Spark, Databricks

Engineer with strong data background and specific handson experience in AWS Glue Lambda Python Snowflake building and orchestrating production data pipelines including serverless ingestion and medallion architecture Skilled in sourcing data from across LOB systems and conforming it to enterprise standards and governed definitions Experience with API based ingestion native connector integrations and data warehouse design Able to partner with the business to elevate operations to the next level by translating requirements into scalable data solutions Primary Skills AWS Glue Lambda Python Snowflake Secondary Skills Databricks Design develop and maintain scalable ETLELT pipelines using AWS Glue and Python Build eventdriven and serverless solutions using AWS Lambda Step Functions S3 SNS and SQS Develop and optimize Snowflake data models stored procedures tasks streams and data ingestion frameworks Implement data transformation cleansing validation and reconciliation processes Design and maintain data lake and data warehouse architectures on AWS and Snowflake Optimize pipeline performance scalability reliability and cost efficiency Develop reusable framework components and automation utilities Troubleshoot production issues and perform root cause analysis Implement CICD pipelines using GitHub Jenkins Terraform or similar tools Collaborate with business stakeholders architects and analytics teams to deliver data solutions Ensure adherence to data governance security and compliance standards Create technical documentation and support knowledge transfer activities