GEN AI Engineer
Quarks Technosoft Pvt Ltd · Bengaluru · onsite · Posted 28d ago
Undisclosed5–7 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
">GEN AI Engineer
5-7 Years Bengaluru
- GEN AI
- LLM
- Python
- SQL
- GCP
- Vertex AI
- DBT
Exp Required- 5+ Years
Role Objective
You will build a suite of AI-driven Accelerators and Autonomous Agents designed to automate the entire lifecycle of our Data Platform-from legacy migration and pipeline construction to incident response and ML lifecycle management. Your goal is to turn the Data Platform into a self-service, self-healing ecosystem.
Key Focus Areas Deliverables
1. Migration Construction Accelerators
- Legacy to dbt Engine: Build agents to parse legacy SQL, Stored Procedures, and ETL tool exports into modular, optimized dbt models.
- Copilot for Pipelines: Develop an internal "Pipeline Assistant" that generates boilerplate Spark/Python code and dbt transformations based on metadata and business requirements.
2. Autonomous Incident Problem Solver
- Self-Healing Ops: Build agents that monitor platform logs (Spark, dbt, Cloud-native) to identify failures, explain the root cause in plain language, and automatically propose (or commit) a fix.
- On-call Assistant: An AI agent that triages data quality alerts, identifies upstream dependencies, and notifies affected downstream stakeholders.
3. Machine Learning (MML) Construction
- Auto-MML: Develop agents to accelerate the "MML" (Machine Learning Modeling) lifecycle-from automated feature engineering suggestions to skeleton code for training and deployment.
Technical Stack Requirements
AI Agentic Frameworks (Must Have)
- Agent Orchestration: Expertise in LangChain, CrewAI, or AutoGPT to build multi-agent workflows.
- Code Generation: Proven experience using LLMs for Code-to-Code translation (specifically SQL to dbt/Python).
- RAG Mastery: Building advanced Retrieval-Augmented Generation systems over technical documentation, data catalogs, and codebases.
Data Engineering Platform
- Expert dbt: Deep knowledge of dbt Jinja, Macros, and Mesh-essential for teaching an AI how to write "good" code.
- Spark Lakehouse: Understanding of Spark internals to build agents that can optimize job performance and resolve OOM (Out of Memory) errors.
- Cloud Infrastructure: Experience with GCP (Vertex AI) or equivalent cloud AI suites
Disclaimer: This job posting and location has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
data qualityCrewaicloud aiIncident Responsegoogle cloud platformBusiness RequirementsDownstreamai engineerdbtfeature engineeringcopilotlakehouseconstructionLarge Language Models (LLMs)Cloud InfrastructuredeploymentData EngineeringcloudETLLangchainArtificial Intelligence
About Quarks Technosoft
Quarks Technosoft Pvt Ltd
IT Services & Consulting
350
employees
2012
14 years old
New Delhi, Delhi
India
₹10.3L PA avg
Avg at Quarks Technosoft
About
Quarks Technosoft is a multinational technology company that provides technology consulting, and outsourcing services with expertise in digital transformation and product development.
Industries
IT Services & ConsultingAgricultureAutomobileInternetLogisticsEmerging Technologies
Employee ratings
10 reviews
3.6/ 5
Culture
4.5
Career growth
4.0
Work-life
4.6
Employees rate it well for
Compensation & Benefits37Work-Life Balance37
Find them on