Data Engineer

About The Company

Quantiphi is a leading AI-first digital transformation company dedicated to solving complex business problems through innovative data-driven solutions. With a focus on leveraging the latest advancements in artificial intelligence, machine learning, and cloud technologies, Quantiphi empowers organizations across various industries to achieve operational excellence, enhance customer experiences, and unlock new revenue streams. Our commitment to innovation, excellence, and client success has established us as a trusted partner for digital transformation initiatives worldwide.

About The Role

We are seeking an experienced Associate Technical Architect - Data to join our dynamic team in Mumbai or Bangalore. In this pivotal role, you will be responsible for designing, architecting, and implementing large-scale AWS data platforms and Lakehouse solutions. Your expertise will drive the end-to-end lifecycle of data engineering projects, ensuring the delivery of scalable, secure, and high-performance data architectures. You will serve as a technical leader, mentoring engineering teams, collaborating with stakeholders, and ensuring best practices are followed throughout the project lifecycle. The ideal candidate will possess a deep understanding of modern data engineering technologies, cloud architecture principles, and proven experience in implementing enterprise-grade data solutions on AWS.

Qualifications

To succeed in this role, candidates should possess a minimum of 8-12 years of relevant experience in data architecture and engineering, with a strong background in cloud-native data platforms. A bachelor's or master's degree in Computer Science, Information Technology, or related fields is preferred. Certifications such as AWS Solution Architect (Associate or Professional) or AWS Data Engineer are highly desirable. Candidates must demonstrate hands-on expertise in SQL, Spark/PySpark, Python, and AWS services such as S3, EMR, Athena, Glue, Aurora, Lambda, and CloudWatch. A thorough understanding of Lakehouse architectures, data modeling, distributed processing, and performance optimization is essential. Experience leading technical teams, conducting architecture reviews, and translating business requirements into technical solutions is critical. Familiarity with orchestration tools like Apache Airflow or AWS Step Functions will be advantageous.

Responsibilities

The key responsibilities of this role include designing scalable and secure data architectures tailored for enterprise needs, leading the implementation of cloud-native data platforms, and ensuring optimal performance and cost-efficiency. You will oversee the development of batch and streaming data pipelines using AWS native services and ensure their robustness and scalability. Your role involves evaluating and selecting appropriate technologies, defining best practices, and establishing architectural standards. Mentoring and guiding engineering teams, conducting code and architecture reviews, and fostering a culture of continuous improvement are vital aspects of your responsibilities. Additionally, you will collaborate with business stakeholders to understand their data needs, translate those into technical solutions, and ensure seamless integration with existing systems. Monitoring system health, troubleshooting issues, and optimizing performance will be ongoing tasks. You will also be responsible for documenting architectures, providing technical leadership during project delivery, and ensuring compliance with security and governance standards.

Benefits

Quantiphi offers a comprehensive benefits package designed to support our employees well-being and professional growth. This includes competitive salary packages, performance-based incentives, and health insurance coverage. Employees have access to ongoing training and certification programs to enhance their skills and stay abreast of emerging technologies. We promote a flexible work environment with options for remote work and flexible hours, fostering work-life balance. Additionally, our employees benefit from a collaborative and innovative culture that encourages knowledge sharing, mentorship, and leadership development. We also provide opportunities for career advancement within a rapidly growing organization, along with various employee engagement activities and wellness programs.

Equal Opportunity

Quantiphi is an equal opportunity employer committed to fostering a diverse and inclusive workplace. We do not discriminate based on race, religion, gender, age, sexual orientation, disability, or any other protected characteristic. We believe that a diverse team enhances our ability to innovate and deliver exceptional solutions to our clients. All qualified candidates are encouraged to apply and will be considered based on their skills, experience, and alignment with our organizational values.