Data Engineer

Role: Data Engineer

Interested candidates who meet the below requirements may share their updated resume to: [email removed].

• 5-8 years of experience in designing, developing, and maintaining scalable data solutions.
• The ideal candidate should possess strong expertise in Python, PySpark, Snowflake, AWS (EMR, S3), Apache Airflow, and ETL/ELT processes.
• The role involves building robust data pipelines, enabling large-scale data processing, and supporting cloud-based analytics platforms.

Key Responsibilities

• Design, develop, and maintain scalable and high-performance data pipelines and ETL/ELT workflows.
• Build and optimize data ingestion, transformation, and processing solutions using Python, PySpark, and SQL.
• Develop and manage data workflows using Apache Airflow for orchestration and scheduling.
• Implement and optimize data solutions on Snowflake, including data modeling, performance tuning, and query optimization.
• Work with AWS services, particularly S3 and EMR, to build cloud-native data platforms.
• Process and analyze large datasets using Spark and other big data technologies.
• Collaborate with business stakeholders, data analysts, and engineering teams to understand data requirements and deliver solutions.
• Ensure data quality, reliability, security, and governance across data platforms.
• Troubleshoot and resolve performance bottlenecks in data pipelines and databases.

Desired Candidate Profile

• 5-8 years of experience in Data Engineering.
• Strong hands-on experience with Python, PySpark, Snowflake, ETL/ELT, AWS (EMR, S3), and Apache Airflow.
• Proven experience in building scalable data pipelines and cloud-based data processing solutions.
• Strong proficiency in SQL with experience in query optimization and performance tuning.
• Experience working with Apache Spark and large-scale data processing environments.
• Good understanding of data warehousing concepts, data modeling, and best practices.
• Experience with workflow orchestration tools and modern data engineering frameworks.
• Strong analytical, problem-solving, and debugging skills.
• Excellent communication and collaboration skills.

Mandatory Skills

• Python
• PySpark
• Snowflake
• SQL
• ETL/ELT
• AWS (S3, EMR)
• Apache Airflow
• Apache Spark

Good to Have

• AWS Glue
• Scala
• Hadoop
• Data Modeling & Data Warehousing

Experience: 5-8 Years
Location: Hyderabad
Employment Type: Full-Time
Notice Period: Immediate to 30 Days Preferred (Optional)

Interested candidates who meet the above requirements may share their updated resume at [email removed].

• Total Experience (in years): ___
• Relevant Experience in Data Engineering (in years): ___
• Relevant Experience in Python (in years): ___
• Relevant Experience in PySpark (in years): ___
• Relevant Experience in Snowflake (in years): ___
• Relevant Experience in AWS (EMR & S3) (in years): ___
• Relevant Experience in Apache Airflow (in years): ___
• Relevant Experience in ETL/ELT Development (in years): ___
• Current CTC (LPA): ___
• Expected CTC (LPA): ___
• Notice Period (Days): ___
• Current Location: ___
• Are you willing to work from Hyderabad? (Yes/No)
• Do you have hands-on experience with Snowflake in a production environment? (Yes/No)
• Have you built and maintained ETL/ELT pipelines using PySpark and AWS? (Yes/No)

Are you willing to attend a Face-to-Face interview in Hyderabad if shortlisted?

• Yes
• No

Are you willing to travel to Hyderabad for an in-person interview as part of the selection process?

• Yes
• No

Regards,

Saikumar