Senior Data Engineer - DBT
Quantiphi · Bengaluru · onsite · Posted 33d ago
Not disclosed4–7 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
JOB ROLE : Senior Data Engineer
Experience : 4-7 Years
Location : Mumbai/Bangalore
Must Have Primary Skills
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
JOB ROLE : Senior Data Engineer
Experience : 4-7 Years
Location : Mumbai/Bangalore
Must Have Primary Skills
- 3+ years of hands-on experience building large-scale AWS data engineering solutions.
- Strong hands-on experience with DBT(Cloud+Core).(highly recommended skill)
- Hands-on expertise into Redshift warehouse and Analytics.
- Strong hands-on expertise in SQL (analytical queries, window functions, stored procedures), Spark/PySpark, Python.
- Hands-on experience designing and implementing Lakehouse solutions using Apache Iceberg.
- Strong knowledge of AWS services including SMUS, EC2, DynamoDB, API Gateway, MWAA, EMR, S3, Athena, Glue Catalog, Aurora PostgreSQL, Lambda, CloudWatch, SQS, SNS, EventBridge, Secrets Manager, CloudWatch and IAM.
- Experience building scalable batch and streaming data pipelines on AWS.
- Strong experience in Spark/PySpark performance tuning and optimization.
- Hands-on experience optimizing Apache Iceberg and Aurora PostgreSQL for performance and scalability.
- Strong understanding of data modeling, partitioning, file formats, and Lakehouse/Data Lake architectures.
- Experience implementing monitoring, logging, alerting, and observability for production data pipelines.
- Strong knowledge of data quality, troubleshooting, debugging, and production support.
- Experience with CI/CD, Git, and data engineering best practices.
- Strong communication, problem-solving, and stakeholder management skills.
- AWS Data Engineer Associate or equivalent AWS Certification is preferred.
- Experience with AWS Step Functions.
- Experience with Terraform or Infrastructure as Code.
- Exposure to Kafka, Hive, HDFS or other Big Data technologies.
- Hands-on experience using GenAI-assisted development tools such as Kiro, Copilot,Cursor, or similar AI coding assistants to improve engineering productivity.
- Experience with ClickHouse Database
- Telecom/Mobile Network domain knowledge is preferred.
- Experience and knowledge of Atscale design and development.
- knowledge of Docker and Kubernetes.
Sourced from foundit
Skills
data qualityobservabilityLakehouse Data Lake architecturesApache Sparkamazon web servicesalertingredshiftloggingpartitioningMonitoringicebergDBT Cloudfile formatsPysparkPythonSQLData ModelingGIT
About Quantiphi
Quantiphi
Marlborough
NZ
About
Quantiphi is a digital engineering company that provides data science and machine learning software and services. Quantiphi is a category defining Data Science and Machine Learning software and services company focused on helping organizations translate the big promise of Big Data & Machine Learning technologies into quantifiable business impact. Quantiphi helps clients find and capture hidden value from data through a unique blend of business acumen, big-data, machine learning, and intuitive information design. Its signature approach combines deep industry experience, disciplined cloud, and data-engineering practices and cutting-edge Machine Learning research to achieve quantifiable impact. Quantiphi was founded in 2013 and is headquartered in Marlborough, Massachusetts.
Industries
Artificial Intelligence (AI)Cloud Data ServicesInsurTechMachine LearningSoftware