Databricks-Data Engineer III

Summary

Position Summary Artificial Intelligence & Engineering AI & Engineering leverages cutting-edge engineering capabilities to help build, deploy, and operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions insights are powered by engineering for business advantage, helping transforming mission-critical operations. Join our AI & Engineering team to help in transforming technology platforms, driving innovation, and helping help make a significant impact on our clients' success achievements. You’ll work alongside talented professionals reimagining and re-engineering operations and processes that are could be critical to businesses.

Position Summary Level: Data Engineer III As a Data Engineer III at Deloitte Consulting, you will design, develop, and deploy enterprise-scale software solutions, lead the creation of robust pipelines and manage code deployment across environments. You will collaborate with cross-functional, global teams to translate functional requirements into effective deliverables, independently guiding and mentoring junior team members. Your role spans the full project lifecycle, including estimation, planning, execution, and tracking key metrics for analysis, ensuring high-quality and timely delivery of solutions.

Work you’ll do: Lead discussions with business and functional analysts to understand requirements and assess integration impacts on business architecture. Prepare technical architecture and design, clarify requirements, and resolve ambiguities. Develop solutions in line with established technical designs, integration standards, and quality processes. Create and enforce technical design and development guides, templates, and standards. Facilitate daily scrum meetings, manage deliverables, and prepare weekly status reports for leadership review. Conduct detailed deliverable reviews and provide technical guidance to team members. Collaborate with onsite clients, coordinators, analysts, and cross-functional teams. Design templates or scripts to automate routine development or operational tasks.

The Team: AI & Data offers a full spectrum of solutions for designing, developing, and operating cutting-edge Data and AI platforms, products, insights, and services. Our offering helps clients innovate, and enhance their data, AI, and analytics capabilities, ensuring they can mature and scale effectively. AI & Data professionals will work with our clients to:

• Design and modernize large-scale data and analytics platforms including data management, governance and the integration of structured and unstructured data to generate insights leveraging cloud, edge and AI/ML technologies, platforms and methodologies for storage, processing
• Leverage automation, cognitive and AI based solutions to manage data, predict scenarios and prescribe actions
• Drive operational efficiency by managing and upgrading their data ecosystems and application platforms, utilizing analytics expertise and providing As-a-Service models to ensure continuous insights and enhancements. Location: Hyderabad/Bengaluru/Chennai/Pune Shift Timings: 11 AM to 8 PM or 2 PM to 11 PM

Qualifications Must Have Skills/Project Experience/Certifications:

• 6–10 years of experience in data engineering with significant Databricks on Azure expertise
• Strong knowledge of Python, SQL, and PySpark (Scala optional)
• Experience building metadata-driven ingestion and data quality (DQ) frameworks using PySpark
• Solid grasp of Lakehouse architecture, Apache Spark, Delta Lake, and other key big data technologies
• Proven team collaboration abilities and excellent problem-solving and analytical skills

Good to Have Skills/Project Experience/Certifications:

• Cloud databases and storage (ADLS Gen2, Azure Key Vault, Cosmos DB, Azure Data Factory, Azure Synapse)
• Data toolsets (data warehouse, data marts, data lake, 3NF, dimensional models)
• Building pipelines using Delta Live Tables, Autoloader, Databricks Workflows, or Apache Airflow
• Databricks Unity Catalog and implementation of fine-grained access control
• Performance tuning in Databricks/Apache Spark

Education: BE/B.Tech/M.C.A./M.Sc (CS) degree or equivalent from accredited university

Our purpose Deloitte’s purpose is to make an impact that matters for our people, clients, and communities. At Deloitte, purpose is synonymous with how we work every day. It defines who we are. Our purpose comes through in our work with clients that enables impact and value in their organizations, as well as through our own investments, commitments, and actions across areas that help drive positive outcomes for our communities.

Our people and culture Our inclusive culture empowers our people to be who they are, contribute their unique perspectives, and make a difference individually and collectively. It enables us to leverage different ways of thinking, ideas and perspectives, and bring more creativity and innovation to help solve our clients’ most complex challenges. This makes Deloitte one of the most rewarding places to work.

Professional development At Deloitte, professionals have the opportunity to work with some of the best and discover what works best for them. Here, we prioritize professional growth, offering diverse learning and networking opportunities to help accelerate careers and enhance leadership skills. Our state-of-the-art DU: The Leadership Center in India, located in Hyderabad, represents a tangible symbol of our commitment to the holistic growth and development of our people. Explore DU: The Leadership Center in India .

Benefits To Help You Thrive At Deloitte, we know that great people make a great organization. Our comprehensive rewards program helps us deliver a distinctly Deloitte experience that helps that empowers our professionals to thrive mentally, physically, and financially—and live their purpose. To support our professionals and their loved ones, we offer a broad range of benefits. Eligibility requirements may be based on role, tenure, type of employment and/ or other criteria. Learn more about what working at Deloitte can mean for you.

Recruiting tips From developing a stand out resume to putting your best foot forward in the interview, we want you to feel prepared and confident as you explore opportunities at Deloitte. Check out recruiting tips from Deloitte recruiters. Requisition code: 350726