Agent
Jobs
Applied
Tracker
Profile
    1. Jobs for you
    2. Job

    Job · 18091905

    LL

    Member of Technical Staff, Pretraining

    lambdaq labs pvt. ltd. · Pune · onsite · Posted 36d ago

    Not disclosedFresherfulltimeSourced fromFoundit

    About a minute. You'll make an account on the way through.

    About this role

    About The Role

    You'll work at the core of LambdaQ: training the foundation models that power every Vikasit product. From data curation and tokenization to large-scale distributed training and post-training, you'll push our models up the frontier while keeping inference economics sane.

    What you'll do

    • —Own parts of the pretraining pipeline — data, architecture, or training infrastructure
    • —Run and analyze large-scale training runs on multi-node GPU clusters
    • —Improve data quality, mixtures, and curricula for Indian and global use
    • —Design experiments that move benchmark and downstream quality measurably

    What we're looking for

    • —Strong PyTorch and distributed-training experience (FSDP / DeepSpeed / Megatron)
    • —Solid grasp of transformer internals, optimization, and scaling laws
    • —Experience training models at 1B+ scale, or equivalent research depth

    Nice to have

    • —MoE training experience
    • —Tokenizer / data-pipeline work
    • —Publications at top ML venues

    Sound like you

    We hire for skill over credentials. Tell us why you're a fit — links and projects welcome.

    Apply for this role

    Sourced from foundit

    Skills

    transformer internalsMoE trainingtokenizerDeepspeedoptimizationPytorchdistributed trainingMegatronFSDPData Pipelinescaling laws

    Member of Technical Staff, Pretraining · waiting for your command