Lead - Big Data Engineer

Function as a core team member within one of our Agile teams building backend-end data applications and services that support the Analytics platforms of TransUnion

Deploy and Implement leading-edge analytics environments including software, end-user tools and other data services

Collaborate with product owners and team members on requirements and implementation approaches for addressing demand and challenges

Design and Develop tools and services enabling end-user productivity and system integrations

Partner with business resources to troubleshoot issues, manage capacity, and plan for the optimization and expansion of environments

Assist in technology innovation activities such as research, evaluations, and prototyping

Train, coach and support users on environment, tools, data and services

Maintain and ensure availability and quality of systems

Required Knowledge And Experiences

8 or more years of hands-on experience in a software development profession

Experience with Cloud technologies, tooling, and workflows

Proficiency in Cloud Technologies, specifically GCP – BigQuery, Data Proc

Proficiency in Big Data – Hadoop , Spark , Scala ,Hive

Experience in Java on basic coding and design

Experience in Python coding is preferable

Proficiency in SQL, relational and non-relational databases, query optimization, and data modeling

Experience with one or more Data Integration tools

Proficiency working in a Linux-based environment, including shell scripting and basic system administration

Experience working on teams operating under an Agile Scrum delivery methodology

Experience working within CI/CD environments and a passion for automation and system quality

Excellent analytical skills and the ability to provide alternative solutions to technical problems

Strong written and verbal communication skills

Bachelor’s degree in Computer Science, Information Systems Management or equivalent experience