Senior Data Engineer

EPAM has presence across 40+ countries globally with 55,000 + professionals & numerous delivery centers, Key locations are North America, Eastern Europe, Central Europe, Western Europe, APAC, Mid East & Development Centers in India.

Location: Gurgaon/Pune/Hyderabad/Bengaluru/Chennai/Coimbatore

Work Mode: Hybrid (2-3 days office in a week) Full time

Job Description:

1. 5-14 Years of experience in Big Data & Data related technology experience
2. Expert level knowledge and experience in Apache Spark (Core Concepts e.g., RDDs, DataFrames, fault tolerance, Spark internals, Catalyst optimiser, and AQE)
3. Hands on programming with Python (Advance Concepts i.e. comprehensions, decorators, generators including their use cases and benefits and data structures)
4. Understands exception handling and its practical applications.
5. Experience with building stream-processing systems, using technologies such as Spark-Streaming
6. The candidate should have strong hands-on experience with Databricks, along with some practical experience in either Snowflake or Kafka.
7. Good understanding of SQL queries, joins, stored procedures, relational schemas
8. Performance tuning of Spark Jobs
9. Experience with native Cloud data services AWS
10. Ability to lead a team efficiently
11. Experience with designing and implementing Big data solutions
12. Practitioner of AGILE methodology

WE OFFER

1. Opportunity to work on technical challenges that may impact across geographies
2. Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications
3. Opportunity to share your ideas on international platforms
4. Sponsored Tech Talks & Hackathons
5. Possibility to relocate to any EPAM office for short and long-term projects
6. Focused individual development
7. Benefit package:

• Health benefits, Medical Benefits• Retirement benefits• Paid time off• Flexible benefits

1. Forums to explore beyond work passion (CSR, photography, painting, sports, etc.

About EPAM: https://vimeo.com/729865941