BENGALURU · FULLTIME
Lead Data Engineer
cgi group
Bengaluru · onsite · Posted 12d ago
Sourced from
Undisclosed7–12 yrsfulltimeBengaluru
Your match
?
Sign in to see your match score, skill gaps & tailored resume.
Section · 01
About this role
Position Description:
Skills:
What you can expect from us:
Data Engineer;
Mission:
. Analyze the business and technical needs of data/AI use cases in collaboration with Product Owners and Data Scientists
. Design and implement robust, scalable, and industrialize data pipelines (ingestion, transformation, exposure)
. Ensure data quality, monitoring and traceability
. Implement and optimize data architectures (batch and real time) according to performance and volume constraints
. Industrialize data flows to support analytical, ML and generative AI use cases (RAG, feature pipelines, etc.)
. Manage data storage and access (data lakes, warehouses, vector databases)
. Collaborate closely with Data Science / MLOps teams to facilitate the deployment of models in production
. Ensure data security and regulatory compliance
. Document pipelines and architectures to ensure maintainability and knowledge sharing
. Contribute to the continuous improvement of Data Engineering practices and the standardization of tools and frameworks
Skills:
Must have :
. Minimum 7 years of experience in Data Engineering with large scale data pipeline production
. Strong skills in designing distributed data architectures
. Expertise in: Data Engineering : ETL/ELT, data pipelines, data quality, orchestration Big Data : Spark / PySpark, Azure Data Lake, Databricks Stockage : Data Lake, Data Warehouse (Databricks) Databases: Advanced SQL Streaming: Kafka, Event Hub or similar
. Experience on AI/ML use cases with data exposure for models
. GenAI (data interactions): understanding of RAG architectures, management of vector DBs
. Programming: Python, SQL
. Cloud : Azure (Data Factory, Synapse, Data Lake, Event Hub) ou quivalent
. DevOps DataOps : Git, CI/CD, Docker, orchestration (Airflow, AWX)
. Best practice of agile methodologies
. Language: French (C1+) and English (B2+)
Nice to have :
. Experience with vector databases (PGVector, Azure AI Search, Weaviate...)
. Connaissance des outils MLOps (MLflow, feature stores)
. Experience in the industrialization of generative AI use cases
. Knowledge of advanced real time architectures
. Development Practices: TDD
. Experience on Kubernetes
Mission:
. Analyze the business and technical needs of data/AI use cases in collaboration with Product Owners and Data Scientists
. Design and implement robust, scalable, and industrialize data pipelines (ingestion, transformation, exposure)
. Ensure data quality, monitoring and traceability
. Implement and optimize data architectures (batch and real time) according to performance and volume constraints
. Industrialize data flows to support analytical, ML and generative AI use cases (RAG, feature pipelines, etc.)
. Manage data storage and access (data lakes, warehouses, vector databases)
. Collaborate closely with Data Science / MLOps teams to facilitate the deployment of models in production
. Ensure data security and regulatory compliance
. Document pipelines and architectures to ensure maintainability and knowledge sharing
. Contribute to the continuous improvement of Data Engineering practices and the standardization of tools and frameworks
Skills:
Must have :
. Minimum 7 years of experience in Data Engineering with large scale data pipeline production
. Strong skills in designing distributed data architectures
. Expertise in: Data Engineering : ETL/ELT, data pipelines, data quality, orchestration Big Data : Spark / PySpark, Azure Data Lake, Databricks Stockage : Data Lake, Data Warehouse (Databricks) Databases: Advanced SQL Streaming: Kafka, Event Hub or similar
. Experience on AI/ML use cases with data exposure for models
. GenAI (data interactions): understanding of RAG architectures, management of vector DBs
. Programming: Python, SQL
. Cloud : Azure (Data Factory, Synapse, Data Lake, Event Hub) ou quivalent
. DevOps DataOps : Git, CI/CD, Docker, orchestration (Airflow, AWX)
. Best practice of agile methodologies
. Language: French (C1+) and English (B2+)
Nice to have :
. Experience with vector databases (PGVector, Azure AI Search, Weaviate...)
. Connaissance des outils MLOps (MLflow, feature stores)
. Experience in the industrialization of generative AI use cases
. Knowledge of advanced real time architectures
. Development Practices: TDD
. Experience on Kubernetes
Skills:
- Artificial Intelligence
- Data Science
- Machine Learning
- AI Data Modeling
- Communication
What you can expect from us:
Together, as owners, lets turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, youll reach your full potential because
You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.
Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.
Come join our teamone of the largest IT and business consulting services firms in the world.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, youll reach your full potential because
You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.
Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.
Come join our teamone of the largest IT and business consulting services firms in the world.
Sourced from naukri
Let the agent run this one for you.
Tailored resume, auto-apply, and referral lookup — in under 2 minutes.
Section · 02
Skills
Apache SparkScalaHiveamazon web servicessqoopApache HadoopData AnalyticsPysparkData EngineeringPythonTableauSQLData Warehousingdata analysisETLMicrosoft AzureData ModelingBusiness IntelligenceSQL ServerBig DataMachine Learning
Section · Company
About CGI Group
cgi group
IT Services & Consulting
19.0k+
employees
1976
50 years old
Bangalore / Bengaluru, Karnataka
India
₹11.9L PA avg
Avg at CGI Group
About
CGI is among the largest IT and business consulting services firms in the world. We are insights-driven and outcomes-based to help accelerate returns on your investments.
Industries
IT Services & ConsultingMarketing & Advertising
Employee ratings
10 reviews
4.0/ 5
Culture
2.9
Career growth
2.2
Work-life
3.7
Employees rate it well for
Work-Life Balance42Company Culture41
Find them on