AWS Databricks Spark Scala Developer

Dear Professionals
Greetings from Tata consultancy Services,
Job Title : AWS Databricks Spark Scala Developer
Experiernce: 7 to 10 Years
Location: Bangalore / Hyderabad
Mode of Work : Work from Office
Mode of Interview: Virtual

If you are Interested in the above opportunity kindly share your updated resume to [email removed] immediately with the details below (Mandatory)

Name:
Contact No.
Email id:
Skillset:
Total exp:
Relevant Exp:
Fulltime highest qualification (Year of completion with percentage scored):
Current organization details (Payroll company):
Current CTC:
Expected CTC:
Notice period:
Current location:
Preffered Location
Any gaps between your education or career (If yes pls specify the duration):
Will you be able to join within 30/45 days? (Yes/NO)

Key Responsibilities

Job Title: AWS Databricks Spark Scala Developer

Experience: 7 to 10 Years
Location: Bangalore / Hyderabad

Job Description

We are seeking a highly skilled AWS Databricks Spark Scala Developer with 6 to 8 years of experience in designing, developing, and implementing large-scale data processing solutions. The ideal candidate should have strong expertise in AWS, Databricks, Apache Spark, Scala, and JAR application development with hands-on experience in building scalable data engineering solutions.

Key Responsibilities

• Design, develop, and maintain scalable data processing applications using Scala and Apache Spark.
• Develop and deploy JAR-based applications in Databricks and AWS environments.
• Build ETL/ELT pipelines for processing large volumes of structured and unstructured data.
• Optimize Spark jobs for performance, scalability, and reliability.
• Implement data engineering solutions using Databricks on AWS.
• Collaborate with business analysts, architects, and stakeholders to understand requirements and deliver solutions.
• Monitor, troubleshoot, and resolve production issues related to data pipelines.
• Participate in code reviews and ensure adherence to coding standards and best practices.

Required Skills

• Strong experience in Scala Programming
• Hands-on expertise in Apache Spark (Core, SQL, DataFrames)
• Experience with Databricks Platform
• Strong knowledge of AWS Cloud Services (S3, EC2, Lambda, IAM, Glue)
• Experience in JAR Development and Deployment
• Strong SQL skills and database concepts
• Experience with ETL and Data Warehousing concepts
• Hands-on experience with Git and CI/CD tools
• Knowledge of distributed computing and performance tuning
• Strong debugging and problem-solving skills

Preferred Skills

• Experience with Delta Lake
• Knowledge of Apache Kafka
• Exposure to PySpark
• Familiarity with Airflow or AWS Step Functions
• Experience with DevOps and Infrastructure as Code
• Understanding of Data Governance and Data Security practices