Data Engineer IRC301397

Description

Job Responsibilities:

Design, develop, and maintain scalable ETL/ELT data pipelines using DBT, SSIS, and Python

Develop and optimize SQL queries, stored procedures, and database objects in Microsoft SQL Server, PostgreSQL, and Snowflake

Build and automate data workflows using Apache Airflow

Manage and optimize cloud-based data solutions on AWS (S3, Lambda, EC2, RDS, IAM)

Implement data quality checks, validation, and monitoring for production pipelines

Troubleshoot production issues, optimize pipeline performance, and resolve data-related problems

Maintain code quality through Git version control, code reviews, and documentation

Develop shell scripts to automate operational and deployment tasks

Containerize applications and data services using Docker

Participate in Agile ceremonies including sprint planning, stand-ups, and retrospectives

Utilize AI-assisted development tools such as GitHub Copilot and Claude to improve productivity and code quality

Document technical designs, workflows, and project progress using Jira and Confluence

Job Description:

Bachelor's degree in Computer Science, Information Technology, or a related field with 5+ years of experience in Data Engineering or ETL Development

Strong knowledge of SQL and relational database concepts

Experience working with Microsoft SQL Server, PostgreSQL, and Snowflake

Strong programming skills in Python with experience using NumPy and Pandas

Basic knowledge of PySpark for distributed data processing

Experience building ETL/ELT pipelines using SSIS and DBT

Experience scheduling and orchestrating workflows using Apache Airflow

Hands-on experience with AWS services including:-

• Amazon S3
• AWS Lambda
• Amazon EC2
• Amazon RDS
• AWS IAM
  
  

Strong understanding of database concepts including:-

Normalization and Denormalization

• OLTP vs OLAP
• Data Warehousing
• Data Modeling
• Performance Tuning
  
  

Experience with Git version control and collaborative development workflows

Knowledge of Docker and containerized application deployment

Experience with Shell Scripting for automation

Familiarity with Agile methodologies and project management tools such as Jira and Confluence

Strong analytical, problem-solving, and communication skills

Nice to Have:

Experience with cloud-native data platforms and modern data architectures

Knowledge of data processing using PySpark on large datasets

Exposure to CI/CD pipelines and DevOps practices

Experience using AI-assisted development tools such as GitHub Copilot or Claude

Understanding of data governance, security, and best practices for cloud data platforms

Requirements

Job Responsibilities:

• Design, develop, and maintain scalable ETL/ELT data pipelines using DBT, SSIS, and Python
• Develop and optimize SQL queries, stored procedures, and database objects in Microsoft SQL Server, PostgreSQL, and Snowflake
• Build and automate data workflows using Apache Airflow
• Manage and optimize cloud-based data solutions on AWS (S3, Lambda, EC2, RDS, IAM)
• Implement data quality checks, validation, and monitoring for production pipelines
• Troubleshoot production issues, optimize pipeline performance, and resolve data-related problems
• Maintain code quality through Git version control, code reviews, and documentation
• Develop shell scripts to automate operational and deployment tasks
• Containerize applications and data services using Docker
• Participate in Agile ceremonies including sprint planning, stand-ups, and retrospectives
• Utilize AI-assisted development tools such as GitHub Copilot and Claude to improve productivity and code quality
• Document technical designs, workflows, and project progress using Jira and Confluence
  
  

Job Description:

• Bachelor's degree in Computer Science, Information Technology, or a related field with 5+ years of experience in Data Engineering or ETL Development
• Strong knowledge of SQL and relational database concepts
• Experience working with Microsoft SQL Server, PostgreSQL, and Snowflake
• Strong programming skills in Python with experience using NumPy and Pandas
• Basic knowledge of PySpark for distributed data processing
• Experience building ETL/ELT pipelines using SSIS and DBT
• Experience scheduling and orchestrating workflows using Apache Airflow
• Hands-on experience with AWS services including:-
• Amazon S3
• AWS Lambda
• Amazon EC2
• Amazon RDS
• AWS IAM
• Strong understanding of database concepts including:-
• Normalization and Denormalization
• OLTP vs OLAP
• Data Warehousing
• Data Modeling
• Performance Tuning
• Experience with Git version control and collaborative development workflows
• Knowledge of Docker and containerized application deployment
• Experience with Shell Scripting for automation
• Familiarity with Agile methodologies and project management tools such as Jira and Confluence
• Strong analytical, problem-solving, and communication skills
  
  

Nice to Have:

• Experience with cloud-native data platforms and modern data architectures
• Knowledge of data processing using PySpark on large datasets
• Exposure to CI/CD pipelines and DevOps practices
• Experience using AI-assisted development tools such as GitHub Copilot or Claude
• Understanding of data governance, security, and best practices for cloud data platforms
  
  

Job responsibilities

Same as above

What we offer

Exciting Projects: We focus on industries like High-Tech, communication, media, healthcare, retail and telecom. Our customer list is full of fantastic global brands and leaders who love what we build for them.

Collaborative Environment: You Can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!

Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules, opportunities to work from home, and paid time off and holidays.

Professional Development: Our dedicated Learning & Development team regularly organizes Communication skills training(GL Vantage, Toast Master),Stress Management program, professional certifications, and technical and soft skill trainings.

Excellent Benefits: We provide our employees with competitive salaries, family medical insurance, Group Term Life Insurance, Group Personal Accident Insurance , NPS(National Pension Scheme ), Periodic health awareness program, extended maternity leave, annual performance bonuses, and referral bonuses.

Fun Perks: We want you to love where you work, which is why we host sports events, cultural activities, offer food on subsidies rates, Corporate parties. Our vibrant offices also include dedicated GL Zones, rooftop decks and GL Club where you can drink coffee or tea with your colleagues over a game of table and offer discounts for popular stores and restaurants!

About GlobalLogic

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world's largest and most forward-thinking companies. Since 2000, we've been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.