Senior Data Engineer

We're looking for

Senior Data Engineers (India) !

Responsibilities

• As part of the team, you will be responsible for building and running the data pipelines and services that are required to support business functions/reports/dashboard..
• We are heavily dependent on BigQuery/Snowflake, Airflow, Stitch/Fivetran, dbt , Tableau/Looker for our business intelligence and embrace AWS with some GCP.
• Developing end to end ETL/ELT Pipeline working with Data Analysts of business Function.
• Designing, developing, and implementing scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architecture
• Mentoring Fother Junior Engineers in the Team
• Be a go-to expert for data technologies and solutions
• Ability to provide on the ground troubleshooting and diagnosis to architecture and design challenges
• Troubleshooting and resolving technical issues as they arise
• Looking for ways of improving both what and how data pipelines are delivered by the department
• Translating business requirements into technical requirements, such as entities that need to be modelled, DBT models that need to be build, timings, tests and reports
• Owning the delivery of data models and reports end to end
• Perform exploratory data analysis in order to identify data quality issues early in the process and implement tests to ensure prevent them in the future
• Working with Data Analysts to ensure that all data feeds are optimised and available at the required times. This can include Change Capture, Change Data Control and other delta loading approaches
• Discovering, transforming, testing, deploying and documenting data sources
• Applying, help defining, and championing data warehouse governance: data quality, testing, coding best practices, and peer review ( *Note: Scoutit is an independent candidate sourcing partner for this hiring. All applications, candidate screening, and hiring-related actions are conducted directly by the respective employer’s authorized recruitment team. Relevant candidates will be contacted via email and asked to fill in additional details as part of the next stage of the application process.) Skills: snowflake,data,dbt