Databricks Data Engineer

About Exponentia.ai

Exponentia.ai is a fast-growing AI-first technology services company, partnering with enterprises to shape and accelerate their journey to AI maturity. With a presence across the US, UK, UAE, India, and Singapore, we bring together deep domain knowledge, cloud-scale engineering, and cutting-edge artificial intelligence to help our clients transform into agile, insight-driven organizations.

We are proud partners with global technology leaders such as Databricks, Microsoft, AWS, and Qlik, and have been consistently recognized for innovation, delivery excellence, and trusted advisories.

Awards & Recognitions:

• Innovation Partner of the Year, Databricks 2024
• Digital Impact Award, UK 2024 (TMT Sector)
• Rising Star, APJ Databricks Partner Awards 2023
• Qlik’s Most Enabled Partner, APAC

With a team of 450+ AI engineers, data scientists, and consultants, we are on a mission to redefine how work is done, by combining human intelligence with AI agents to deliver exponential outcomes.

Learn more: www.exponentia.ai

About the Role:

We are looking for skilled Data Engineers with strong expertise in Python, PySpark, SQL, and Data 
Engineering to design, develop, and optimize scalable data pipelines and data processing solutions.
The ideal candidate will have hands-on experience in building end-to-end data pipelines, data 
aggregation frameworks, and ETL solutions within cloud-based environments. Experience with data 
migration projects, data architecture, and schema design will be highly valued, as the organization is 
undertaking significant data transformation initiatives, including migration from one Learning 
Management System (LMS) to another.
This role offers an opportunity to contribute to large-scale data engineering projects while collaborating 
with analytics, AI, and business teams.

Key Responsibilities

• Design, develop, and maintain scalable ETL and data processing pipelines. 
• Build robust data aggregation and transformation workflows using Python and PySpark. 
• Global Presence: US - UK -UAE - IND - SGP | www.exponentia.ai | [email removed]
• www.exponentia.ai | [email removed]
• Develop and optimize SQL queries for large-scale datasets. 
• Implement end-to-end data pipelines for ingestion, transformation, and consumption. 
• Support data migration initiatives, including platform and LMS migrations. 
• Collaborate with stakeholders to understand business requirements and translate them into efficient data solutions. 
• Design and maintain data models, schemas, and architecture components. 
•  Ensure data quality, governance, and performance across data platforms. 
• Troubleshoot and optimize existing data pipelines and workflows. 
•  Work closely with AI, Analytics, and Business Intelligence teams to enable data-driven decisionmakin

Roles and Responsibilities

Required Skillset
• Strong Python Programming 
• PySpark 
• SQL 
• ETL Development 
• Data Engineering 
• Pipeline Development 
• Data Aggregation 
• Data Transformation & Processing 
• Data Modeling Fundamentals

Preferred Experience
• Data Migration Projects
• LMS Migration Experience
• Data Architecture Design
• Schema Design & Optimization
• End-to-End Data Pipeline Implementation
• AWS Data Ecosystem
• Large-Scale Data Processing Frameworks

Good to Have Skills
• Databricks 
• AWS Glue 
• Apache Spark 
• Airflow or Similar Workflow Orchestration Tools 
• Data Lake Technologies 
• CI/CD for Data Engineering Workflows

 

Why Join Exponentia.ai?

• Innovate with Purpose: Opportunity to create pioneering AI solutions in partnership with leading cloud and data platforms
• Shape the Practice: Build a marquee capability from the ground up with full ownership
• Work with the Best: Collaborate with top-tier talent and learn from industry leaders in AI
• Global Exposure: Be part of a high-growth firm operating across US, UK, UAE, India, and Singapore
• Continuous Growth: Access to certifications, tech events, and partner-led innovation labs
• Inclusive Culture: A supportive and diverse workplace that values learning, initiative, and ownership

Ready to build the future of AI with us?

• Apply now and become a part of a next-gen tech company that’s setting benchmarks in enterprise AI solutions.