Senior Associate - Big Data Engineer
Affine Analytics · Bengaluru · onsite · Posted 35d ago
Undisclosed4–9 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Job Summary
Responsibilities
Job Type
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Role Objective: Big Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products.
Responsibilities
- Strong SQL Skills : Candidate should be proficient in writing and executing complex SQL queries (no PL/SQL) and be able to handle real-world scenarios confidently.
- Hands-on Functional Programming (Scala) : Strong hands-on experience in Scala is essential.
- Solid Data Engineering Fundamentals : Emphasis is on strong foundational understanding rather than tool-specific expertise.
- Experience in Data Quality Optimization : Candidate should have a sound understanding of data quality practices, performance optimization techniques, and solution design in both event-driven and batch processing contexts-including data modeling.
- Sound knowledge in Spark architecture and distributed computing and Spark streaming, including RDD and Data frames core functions, troubleshooting and performance tuning.
- Experience in analyzing, re-architecting, and re-platforming on-premises data warehouses to data platforms on any cloud (AWS is preferred)
- Experience in any cloud (ETL/ELT pipelines, Datalake and Data streaming) is preferred.
- Understand the client requirement and able to design, develop from scratch and deliver.
- Able to mentor new members for onboarding to the project.
Job Type
Full-time
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
data qualityScalaTroubleshootingPerformance Tuningperformance optimizationPLSQLcloudArchitectureData ModelingBig Data
About Affine
Affine Analytics
IT Services & Consulting
400
employees
2011
15 years old
Bangalore / Bengaluru, Karnataka
IN
₹12.4L PA avg
Avg at Affine
About
Affine is a pioneering consulting firm that specializes in AI-driven enterprise transformation.
Industries
IT Services & ConsultingManagement Consulting
Employee ratings
10 reviews
3.3/ 5
Culture
3.8
Career growth
3.5
Work-life
3.9
Employees rate it well for
Skill Development35Overall Company33
Find them on