Data Engineer

Company Brief:

One of our key employers is a Data & AI solutions company specializing in data management, analytics, cloud solutions, AI/ML, and business intelligence. The company helps organizations across multiple industries leverage data and technology to improve business performance, decision-making, and operational efficiency.

Roles & Responsibilities:

• Database/Data Warehouse Development: Strong understanding of SQL and designing efficient queries, conceptual understanding of tabular data model and its development etc.
• Data Pipeline Development: Assist in building and maintaining data pipelines for ETL (Extract, Transform, Load) processes using various tools and techniques in Azure (Data Factory, Databricks (incl. Data Lakehouse), DevOps, and Storage Accounts) & Snowflake environments.
• Data Lake Development: Assist in developing the medallion framework for persisting, transforming and creating data models. Depending on the data extraction frequency, design appropriate approaches for data ingestion i.e., full versus incremental data loads
• Data Visualization: Build powerful dashboard and reports in Power BI or Tableau or any other BI tool
• Documentation: Document data processes and workflows for knowledge sharing.
• Collaboration: Work with data analysts and software engineers to understand data requirements and deliver relevant datasets.

Must have:

• Experience: Minimum 3 years of experience is mandatory in data management projects with technologies like Microsoft Fabric, Snowflake, and Databricks with related tools and technologies
• Programming Skills: Excellent skills in SQL & Python are essential for this role
• Data Management: Basic understanding of database management systems, data warehouse and data modelling is essential for this role
• Analytical Skills: Strong analytical abilities to interpret trends and patterns in complex datasets.
• Communication Skills: Excellent verbal and written communication skills for collaborating with team members.