Data Engineer- Associate 2

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions.

Years Of Experience Candidates with 2-4 years of hands-on experience

Position Requirements Must Have:

• Experience in architecting and delivering highly scalable, distributed, cloud-based enterprise data solutions
• Strong expertise in the end-to-end implementation of Cloud data engineering solutions like Enterprise Data Lake, Data hub in AWS
• Hands-on experience with Snowflake utilities, SnowSQL, SnowPipe,ETL data Pipelines, Big Data model techniques using
• Python / Java
• Experience in loading disparate data sets and translating complex functional and technical requirements into detailed design
• Should be aware of deploying Snowflake features such as data sharing, events and lake-house patterns
• Should have experience with data security and data access controls and design
• Deep understanding of relational as well as NoSQL data stores, methods and approaches (star and snowflake, dimensional modeling)
• Proficient in Lambda and Kappa Architectures
• Strong AWS hands-on expertise with a programming background preferably Python/Scala
• Good knowledge of Big Data frameworks and related technologies
• Experience in Hadoop and Spark is mandatory
• Strong experience in AWS compute services like AWS EMR, Glue and Sagemaker and storage services like S3, Redshift & Dynamodb
• Good experience with any one of the AWS Streaming Services like AWS Kinesis, AWS SQS and AWS MSK
• Troubleshooting and Performance tuning experience in Spark framework
• Spark core, Sql and Spark Streaming
• Experience in one of the flow tools like Airflow, Nifi or Luigi
• Good knowledge of Application DevOps tools (Git, CI/CD Frameworks)
• Experience in Jenkins or Gitlab with rich experience in source code management like Code Pipeline, Code Build and Code Commit
• Experience with AWS CloudWatch, AWS Cloud Trail, AWS Account Config, AWS Config Rules
• Strong understanding of Cloud data migration processes, methods and project lifecycle
• Good analytical & problem-solving skills
• Good communication and presentation skills

Desired Knowledge / Skills

• Experience in building stream-processing systems, using solutions such as Storm or Spark
• Streaming
• Experience in Big Data ML toolkits, such as Mahout, SparkML, or H2O
• Knowledge in Python
• Worked in Offshore / Onsite Engagements
• Experience in one of the flow tools like Airflow, Nifi or Luigi
• Experience in AWS services like STEP & Lambda

Professional And Educational Background BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBA

The Opportunity

• When you join PwC Acceleration Centers (ACs), you step into a pivotal role focused on actively supporting various Acceleration Center services, from Advisory to Assurance, Tax and Business Services. In our innovative hubs, you’ll engage in challenging projects and provide distinctive services to support client engagements through enhanced quality and innovation. You’ll also participate in dynamic and digitally enabled training that is designed to grow your technical and professional skills.
• As part of the Data and Analytics Engineering team you will design and implement innovative data solutions using AWS and Snowflake. As an Associate you will focus on learning and contributing to client engagement and projects while developing your skills and knowledge to deliver quality work. This role offers a unique chance to work with advanced technologies and collaborate with talented professionals in a fast-paced environment.

Responsibilities

• Design and implement innovative data solutions using AWS and Snowflake
• Collaborate with team members to enhance client engagement
• Develop skills and knowledge to secure quality deliverables
• Engage in research to support data-driven decision making
• Utilize analytical tools to interpret data and generate insights
• Contribute to project tasks in a fast-paced environment
• Support senior staff in various project phases
• Adapt to evolving technologies and methodologies

What You Must Have

• Bachelor's Degree
• 2 years of experience
• Oral and written proficiency in English required

What Sets You Apart

• Bachelor's Degree in Computer Science or related field
• Experience in architecting scalable cloud-based data solutions
• Skilled in Snowflake utilities and ETL data pipelines
• Understanding of data security and access controls
• Skilled in AWS compute and storage services
• Familiarity with Big Data frameworks like Hadoop and Spark
• Experience in building stream-processing systems
• Demonstrating analytical and problem-solving skills
• Travel to client locations may be required