Data Platform & Acquisition (LLM Corpora)
Eternity Quests LLP · Delhi · onsite · Posted 41d ago
About a minute. You'll make an account on the way through.
About this role
Lead Engineer – Data Platform & Acquisition (LLM Corpora)
Build the data engine behind a frontier model — petabyte pipelines, and the deals that fill them.
Location: Delhi NCR or Bengaluru | Experience: 4 – 12 years
About the opportunity
We are retained by a well-funded AI lab building foundation models from the ground up in India — real compute, real pretraining, not fine-tuning on top of someone else's model. The team is small and the work is unusually direct: what you build ships into the model.
The client's identity is confidential at this stage and will be shared on first call.
What you will do
• Architect high-throughput pipelines processing petabytes of text and multimodal data.
• Implement deduplication, quality filtering and benchmark decontamination protocols.
• Lead licensing negotiations for proprietary datasets.
• Manage external vendors for large-scale digitisation and crowdsourcing.
What we are looking for
• 4+ years in data engineering or data acquisition.
• Proven ownership of large-scale data infrastructure.
• Strong vendor management and commercial negotiation ability.
What is on offer
• Compensation is open and benchmarked to the top of the Indian market for this profile, with meaningful equity.
• Delhi NCR is the primary base, but the client is flexible on Bengaluru for the right person.
• Relocation support, including for candidates returning from outside India.
How to apply
Apply here, or write to [HIDDEN TEXT] with your CV and links to anything you have published, shipped or open-sourced. We reply to every serious application within 48 hours.
Sourced from foundit