Aws Data Engineer

Role Desired Competencies (Technical/Behavioral Competency)

Technical Skills

- Proficiency in Python for data transformation and automation.

- Experience with Terraform and AWS Cloud infrastructure.

- Familiarity with Java for SCADA software development.

- Understanding of Data Lake architecture and data modeling.

- Knowledge of MQTT, Greengrass, and OPC-UA protocols.

- Experience with Windows Server management and PowerShell scripting.

- Ability to create and manage Grafana dashboards using SQL queries.

- Basic knowledge of AWS CloudWatch and AWS Glue.

-

Responsibilities

- Design and implement data transformation workflows using Python and AWS services.

- Develop and maintain infrastructure using Terraform and AWS Cloud.

- Standardize and manage raw and curated data in a multi-source Data Lake.

- Build and maintain SCADA data collection software deployed on AWS Greengrass.

- Automate deployment of Greengrass across multiple sites and ensure operational stability.

- Monitor and manage Windows servers hosting Greengrass using PowerShell.

- Create and maintain Grafana dashboards for data visualization and system monitoring.

- Coordinate with IT teams to manage incidents and plan maintenance activities.

- Use AWS CloudWatch to monitor system health and report errors.

- Integrate CRM data (Salesforce) into Power BI using AWS Glue and Python Lambdas.

- Collaborate with Data Platform teams to manage access, API provisioning, and folder creation.

-

Mindset

- Strong problem-solving and debugging skills.

- Proactive and detail-oriented approach to system monitoring and incident management.

- Effective communication with IT and data platform teams.

-

Soft Skills

- Strong analytical and problem-solving abilities

- Clear communication in English

- Ability to work independently and collaboratively in a cross-functional team.

- Strong focus on code quality, documentation, and collaboration

-

Highly Recommended

- Technical Skills:

- Advanced understanding of SCADA systems and industrial data flows.

- Experience with automated deployment and multi-site configuration management.

- Familiarity with network administration and cybersecurity principles.

- Basic knowledge Salesforce integration.

- Optional

- Technical Skills:

- Experience with Power BI dashboard creation.

- Knowledge of API management and data access provisioning on enterprise platforms.

- le & responsibilities

Preferred candidate profile