AI/ML & Data Engineer

Experience

4~6 years in ML/NLP, preferably in document-heavy domains (finance, legal, policy)

Key Responsibilities

• Data Ingestion and Preprocessing: Ability to build and maintain data pipelines to ingest unstructured data from PDFs, gazettes, HTML circulars etc. and process data extraction, parsing, and normalization
• NLP LLM Modeling: Ability to fine-tune or prompt-tune LLMs for summarization, classification, and change detection in regulations. Ability to develop embeddings for semantic similarity.
• Knowledge Graph Engineering: Ability to design entity relationships (regulation, control, policy) and implement retrieval over Neo4j or similar graph DBs.
• Information Retrieval (RAG): Ability to build RAG pipelines for natural language querying of regulations.
• Annotation and Validation: Ability to annotate training data by collaborating with SMEs and validate model outputs
• MLOps: Ability to build CI/CD for model retraining, versioning, and evaluation (precision, recall, BLEU, etc.)
• API and Integration: Ability to expose ML models as REST APIs (FastAPI) for integration with product frontend.

Skills

• Languages: Python, SQL
• AI/ML/NLP: Hugging face transformers, OpenAI API, Spacy, Scikit-Learn, LangChain, RAG, LLM prompt-tuning, LLM fine-tuning
• Vector Search: Pinecone, Weaviate, FAISS
• Data Engineering: Airflow, Kafka, OCR (Tesseract, pdfminer)
• MLOps: MLflow, Docker

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.