Lead Data Engineer

Job Purpose:

Design, build, and optimize scalable data engineering solutions that enable reliable, high-performance data platforms. Lead the development of modern data pipelines, cloud-native architectures, and data infrastructure while collaborating with cross-functional teams to deliver robust, client-focused data solutions.

Who You Are:

• 8+ years of experience in Data Engineering, with at least 2+ years in a Technical Lead or supervisory role
• Prior experience working in software services, IT consulting, or agency environments, managing multiple client engagements
• Strong proficiency in Python, SQL, and PySpark or Scala for large-scale data processing
• Hands-on experience with at least one major cloud platform (AWS, Azure, or GCP) and its data ecosystem (e.g., AWS Glue, Redshift, EMR, Azure Data Factory, Synapse, GCP BigQuery)
• Advanced experience working with modern data platforms such as Snowflake, Databricks, or Delta Lake
• Strong expertise in designing and building scalable ETL/ELT pipelines and data transformation workflows
• Experience with workflow orchestration tools such as Apache Airflow, dbt, or Prefect
• Hands-on experience with real-time data streaming technologies like Apache Kafka or Spark Streaming
• Good understanding of software engineering best practices, version control, testing, and CI/CD processes
• Excellent communication and stakeholder management skills with the ability to lead technical discussions and mentor engineering teams

What Will Excite Us:

• Experience designing enterprise-scale data platforms and modern cloud data architectures
• Strong expertise in Databricks, Snowflake, or Delta Lake implementations
• Experience building real-time data pipelines using Kafka, Spark Streaming, or similar technologies
• Hands-on experience with DevOps and Infrastructure-as-Code tools such as Docker, Kubernetes, Terraform, GitHub Actions, Azure DevOps, or Jenkins
• Experience optimizing data pipeline performance, scalability, reliability, and cost efficiency
• Strong understanding of data governance, data quality, security, and performance optimization
• Experience leading technical teams, conducting code reviews, and mentoring data engineers
• Exposure to modern DataOps practices and automation frameworks
• Ability to work across multiple client projects while ensuring high-quality delivery

What Will Excite You:

• Opportunity to architect and build large-scale cloud-native data platforms for global clients
• Work with modern technologies including Databricks, Snowflake, Kafka, Airflow, and leading cloud ecosystems
• Lead technical initiatives while mentoring and growing high-performing engineering teams
• Solve complex data engineering challenges involving large-scale data processing and real-time analytics
• Collaborate with cross-functional teams in a fast-paced, innovation-driven environment
• Competitive compensation, continuous learning opportunities, and significant career growth

Location: Ahmedabad (Work From Office)