PUNE · FULLTIME
Data Solution Engineer
Robosoft Technologies
Pune · hybrid · Posted 11d ago
Sourced from
Undisclosed5–10 yrsfulltimePune
Your match
?
Sign in to see your match score, skill gaps & tailored resume.
Section · 01
About this role
- Core experience: Minimum 5 years of hands-on experience in data processing pipeline and API development, with strong proficiency in Python (PySpark) and Scala a must
- Big data & distributed systems: Apache Spark, Databricks, Blob Storage, BigQuery and managed Spark (Dataproc) on GCP; processing structured, semi-structured and multi-modal data (text, image, audio, video)
- Lakehouse & table formats: Delta Lake, Apache Iceberg and Apache Hudi
- Data modelling & stores: Designing data schemas, tables and partitioning strategies across SQL and NoSQL databases such as Cosmos DB and Redis
- Pipelines & orchestration: Building batch and streaming ETL/ELT processes over pub/sub platforms (Kafka, Azure Event Hubs, Google Cloud Pub/Sub), orchestrated with Airflow on Kubernetes, in containerized, scalable and serverless architectures
- Infrastructure as Code: Terraform or equivalent
- Performance & cost optimization: Spark tuning, shuffle optimization, caching, cluster sizing, query optimization, debugging long-running jobs and cloud cost control
- Data quality & lineage: Defining data quality rules and data lineage definitions, and creating monitoring alerts out of them
- Testing for data pipelines: Data validation, regression tests, reconciliation and end-to-end pipeline testing
- Observability & reliability: Centralized logging, metrics, tracing, job monitoring, SLAs/SLOs and incident troubleshooting
- ML engineering: Feature store, feature and training pipelines, model deployment and serving, model monitoring with drift detection and retraining (MLflow / MLOps)
- AI-assisted development: Hands-on experience using tools such as GitHub Copilot, Claude Code or equivalent for code generation, debugging, testing and developer productivity
- Nice to have: Past exposure to web analytics solutions (Adobe Analytics & Google Analytics)
Sourced from naukri
Let the agent run this one for you.
Tailored resume, auto-apply, and referral lookup — in under 2 minutes.
Section · 02
Skills
ScalaDeltagoogle cloud platformapache airflowDatabricksPysparkPython
Section · Company
About Robosoft Technologies
Robosoft Technologies
IT Services & Consulting
1.0k+
employees
1996
30 years old
New Udupi, Karnataka
India
₹13L PA avg
Avg at Robosoft Technologies
About
Robosoft is a full-service digital transformation company, with a vision to Simplify Lives. They offer end-to-end solutions in product advisory, design, engineering, and analytics.
Industries
IT Services & Consulting
Employee ratings
10 reviews
3.3/ 5
Culture
2.9
Career growth
3.3
Work-life
3.1
Employees rate it well for
Work-Life Balance33Skill Development33
Find them on