BENGALURU · FULLTIME
Senior Software Engineer Data Engineer - ETL, Python/Scala
cgi group
Bengaluru · onsite · Posted 12d ago
Sourced from
Undisclosed5–7 yrsfulltimeBengaluru
Your match
?
Sign in to see your match score, skill gaps & tailored resume.
Section · 01
About this role
Position Description:
Job Title: Data Engineer ETL, Python/Scala, Apache Spark
Position: Software Engineer
Experience: 5- 7 Years
Category: Software Development/ Engineering
Shift: 1-10PM (Hybrid)
Main location: Bangalore
Position ID: J0926-0281
Employment Type: Full Time
Education Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 3 years of relevant experience.
Position Description: We are looking for an experienced Data Engineer to join our team. The ideal candidate should be passionate about coding and developing scalable and high-performance applications.
#LI-BK7
Your future duties and responsibilities:
Required qualifications to be successful in this role:
Skills:
Job Title: Data Engineer ETL, Python/Scala, Apache Spark
Position: Software Engineer
Experience: 5- 7 Years
Category: Software Development/ Engineering
Shift: 1-10PM (Hybrid)
Main location: Bangalore
Position ID: J0926-0281
Employment Type: Full Time
Education Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 3 years of relevant experience.
Position Description: We are looking for an experienced Data Engineer to join our team. The ideal candidate should be passionate about coding and developing scalable and high-performance applications.
#LI-BK7
Your future duties and responsibilities:
Core Data Engineering
ETL/ELT Architecture: Design and implement complex data pipelines from disparate sources into our centralized data lake/warehouse.
Big Data Processing: Leverage Apache Spark (via Dataproc) and Python/Scala to handle petabyte scale transformations.
Advanced SQL: Write and optimize complex queries for data modeling, ensuring high performance in BigQuery.
Stream Batch: Develop real time processing solutions using Pub/Sub and Dataflow (Apache Beam).
GCP Infrastructure
Orchestration: Manage workflow automation using Cloud Composer (Airflow).
Storage Databases: Architect solutions across Cloud Storage, Cloud SQL, and Spanner, choosing the right tool for the specific latency and consistency requirements.
Environment Management: Ensure security, logging, and monitoring are integrated into every pipeline.
ETL/ELT Architecture: Design and implement complex data pipelines from disparate sources into our centralized data lake/warehouse.
Big Data Processing: Leverage Apache Spark (via Dataproc) and Python/Scala to handle petabyte scale transformations.
Advanced SQL: Write and optimize complex queries for data modeling, ensuring high performance in BigQuery.
Stream Batch: Develop real time processing solutions using Pub/Sub and Dataflow (Apache Beam).
GCP Infrastructure
Orchestration: Manage workflow automation using Cloud Composer (Airflow).
Storage Databases: Architect solutions across Cloud Storage, Cloud SQL, and Spanner, choosing the right tool for the specific latency and consistency requirements.
Environment Management: Ensure security, logging, and monitoring are integrated into every pipeline.
Required qualifications to be successful in this role:
Must-Have Skills:
Programming: Mastery of Python or Scala.
Spark Expertise: Proven experience tuning and debugging Spark jobs at scale.
GCP Professional: Deep hands on experience with the full Google data suite (BigQuery, Dataflow, Dataproc, Pub/Sub).
SQL Mastery: Ability to perform complex window functions, CTEs, and query optimization.
Bonus Points (Good to Have)
AI/ML Integration: Familiarity with Vertex AI and the GCP AI Platform.
Good-to-Have Skills:
GenAI Literacy: A basic understanding of LLMs, prompt engineering, and how data pipelines feed into RAG (Retrieval Augmented Generation) architectures.
Infrastructure as Code: Experience with Terraform for managing GCP resources.
Programming: Mastery of Python or Scala.
Spark Expertise: Proven experience tuning and debugging Spark jobs at scale.
GCP Professional: Deep hands on experience with the full Google data suite (BigQuery, Dataflow, Dataproc, Pub/Sub).
SQL Mastery: Ability to perform complex window functions, CTEs, and query optimization.
Bonus Points (Good to Have)
AI/ML Integration: Familiarity with Vertex AI and the GCP AI Platform.
Good-to-Have Skills:
GenAI Literacy: A basic understanding of LLMs, prompt engineering, and how data pipelines feed into RAG (Retrieval Augmented Generation) architectures.
Infrastructure as Code: Experience with Terraform for managing GCP resources.
Skills:
- Airflow
- Apache Spark
- Python
- Cloud architecture
- Scala That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.
Sourced from naukri
Let the agent run this one for you.
Tailored resume, auto-apply, and referral lookup — in under 2 minutes.
Section · 02
Skills
Apache SparkData EngineerScalaApachePythonETL
Section · Company
About CGI Group
cgi group
IT Services & Consulting
19.0k+
employees
1976
50 years old
Bangalore / Bengaluru, Karnataka
India
₹11.9L PA avg
Avg at CGI Group
About
CGI is among the largest IT and business consulting services firms in the world. We are insights-driven and outcomes-based to help accelerate returns on your investments.
Industries
IT Services & ConsultingMarketing & Advertising
Employee ratings
10 reviews
4.0/ 5
Culture
2.9
Career growth
2.2
Work-life
3.7
Employees rate it well for
Work-Life Balance42Company Culture41
Find them on