Sr Data Engineer

Job Summary


Experience

• 3+ years of experience working in data engineering or big data environments.
• Experience working with services like EMR, Glue, Redshift within AWS, Snowflake, and Databricks
• Hands-on experience with AWS, Spark, Python, and SQL
• Solid understanding of data modeling and data warehouse design principles
• Experience with distributed data frameworks such as Spark (Core, SQL, Streaming) or Flink
• Hands-on experience with Snowflake or Databricks
• Experience working on setting up data warehouses/ lake or lakehouse platforms end-to-end
• Industry knowledge in Retail, Logistics, FSI, or Manufacturing would be an added advantage

Responsibilities

• Develop, maintain, and optimize ETL pipelines for batch and streaming data
• Work with data architects to implement scalable data models and warehouse structures
• Write efficient SQL and PySpark code for data transformation and analytics
• Support data quality, governance, and monitoring processes
• Collaborate with business and analytics teams to understand data requirements and ensure timely data delivery
• Participate in performance tuning and troubleshooting of data workflows
• Contribute to documentation, standards, and automation across data engineering projects
• Collaborate with cross-functional teams to ensure seamless data delivery and alignment with business goals

Key Skills

• Technologies: AWS, Spark, Python, SQL, Airflow, Kafka, Snowflake, Databricks
• Frameworks: Spark Core, Spark SQL, Spark Streaming/Flink
• Soft Skills: Customer communication, Team coordination, problem-solving, Ownership

Job Type


Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.