Senior Data Engineer

Role description
Job Title: Senior Data Engineer
Location: Bangalore, Karnataka, India (Work from Office)
Industry/Field: Retail
Experience: 4-8 years
Company: Tredence

About Us:
Tredence differentiates itself from other analytics services firms by enabling last mile adoption of insights. We drive true business impact by uniting our strengths in business analytics, data science, and software engineering. We help our clients deliver on the artificial intelligence imperative, in a practical and demystified way. To know more about us, visit: www.tredence.com

Job Overview:
As a Senior Data Engineer at Tredence, you will spearhead the design, development, and optimization of scalable data solutions using Databricks technologies tailored for the retail sector. Success in this role means enabling seamless ingestion, transformation, and governance of large datasets to drive actionable business insights. You will collaborate closely with cross-functional teams to implement data architectures that support AI-driven analytics. This role is pivotal in advancing Tredence's mission of delivering impactful and practical AI-powered solutions to our clients.

What will your role look like
- Design, build, and maintain robust data pipelines and lakehouse architectures using Databricks Delta Lake technology.
- Develop and optimize PySpark, Python, and SQL code for high-performance data processing and transformation.
- Implement and manage data cataloging and data quality frameworks to ensure integrity, reliability, and accessibility of datasets.
- Collaborate with data scientists, business analysts, and software engineers to translate business requirements into scalable data solutions.
- Monitor pipeline performance, troubleshoot data issues, and continuously improve data workflows for efficiency and scalability.
- Participate in code reviews, documentation, and best practice enforcement to maintain high quality and maintainability.
- Stay updated with the latest advancements in Databricks and big data technologies to propose innovative solutions.

You will need:
- Demonstrate 4-8 years of professional experience as a Data Engineer, preferably in the retail industry or related domains.
- Exhibit strong expertise in Databricks technologies, including Delta Lake and Lakehouse architecture implementations.
- Utilize advanced skills in PySpark, Python, and SQL for complex data transformations and pipeline development.
- Apply knowledge of data catalog solutions and implement effective data quality practices.
- Hold a BE/B.Tech degree in Computer Science, Information Technology, or a related engineering discipline.
- Communicate effectively across technical and non-technical teams to deliver client-focused data solutions.

Good to Have Skills:
- Gain experience with cloud platforms such as AWS, Azure, or GCP, especially in context with Databricks deployments.
- Acquire certifications related to Databricks and big data engineering.
- Develop familiarity with containerization and orchestration tools like Docker and Kubernetes.
- Build understanding of AI and machine learning workflows integrated with data engineering pipelines.
- Contribute to open source projects or internal tools that support data engineering best practices.

Why you will love this job:
At Tredence, you will work at the forefront of AI-driven analytics delivering business impact in the retail sector. You will enjoy a collaborative and inclusive environment that fosters continuous learning and skill enhancement. This role offers a unique opportunity to grow your expertise in cutting-edge data engineering technologies like Databricks while influencing real-world business outcomes. Our Bangalore office provides a vibrant workspace ideal for innovation, creativity, and career progression within a supportive team culture