Data Engineer

Work Experience: 4 to 7 Years

Work location: Bangalore/Gurgaon

Work Mode: Hybrid

Must Have Skills: Databricks, Python, Snowflake, SQL

Job Summary:

We are seeking an experienced Databricks & Snowflake Developer with strong expertise in PySpark, Delta Lake, Snowflake SQL, and Azure Data Engineering services. The ideal candidate will design, develop, and optimize large-scale data pipelines across both Databricks and Snowflake platforms to support analytics, reporting, and enterprise data initiatives. This role requires close collaboration with data engineers, analysts, architects, and business stakeholders to deliver scalable, high quality, and cost efficient cloud data solutions.

Key Responsibilities

• Develop, optimize, and maintain Databricks notebooks, workflows, jobs, and scalable PySpark applications, including Delta Lake implementation, performance tuning, and Git-based code management.
• Build and optimize Snowflake solutions using advanced SQL, data ingestion pipelines (Stages, File Formats, COPY, Snowpipe), and automated ELT workflows leveraging Streams, Tasks, and Materialized Views.
• Design, develop, and enhance end-to-end ETL/ELT data pipelines across Databricks, Snowflake, Azure Data Factory, and Synapse, ensuring scalability, performance, and cost efficiency.
• Integrate data from databases, APIs, file systems, and cloud platforms while aligning with enterprise data architecture, data modeling, governance, and security standards.
• Collaborate with business stakeholders to translate data requirements into technical solutions, support BI and analytics initiatives, and deliver high-quality, cost-effective cloud data solutions.
• Troubleshoot and resolve Databricks, Snowflake, and ADF platform issues, perform root cause analysis, maintain documentation, and implement preventive measures to ensure reliable operations.

Technical Skills and Experience

• 2+ years of experience in data engineering, big data development, and cloud-based data platforms.
• Hands-on experience with Databricks, PySpark, Delta Lake, Spark SQL, and Azure Data Engineering services.
• Strong expertise in Snowflake development, including Snowflake SQL, ELT processes, performance tuning, and warehouse optimization.
• Experience building and orchestrating data pipelines using Azure Data Factory (ADF), Synapse, ADLS, and Snowflake integration features.
• Proficiency with Snowflake automation and ingestion capabilities, including Snowpipe, Streams, Tasks, and workflow orchestration.
• Knowledge of data security and governance best practices, including RBAC, masking policies, and access control management.