{"@context":"https://schema.org","@type":"JobPosting","title":"Pyspark Developer(Data Engineer)","description":"

Skills Required:

6+ years of hands-on experience designing and developing enterprise-scale applications, data platforms, or distributed systems.
6+ years of experience developing, and operating Big Data platforms and cloud-based infrastructure services, preferably using AWS EMR and the Hadoop ecosystem.
Strong hands-on experience with AWS, Spark, Python and/or Scala, Airflow, SQL, Hive, and related data processing technologies.
Proficiency in either Python or Scala, with the ability to build production-grade data pipelines and backend services. Experience with AWS cloud services, including S3, EC2, EMR, Lambda, DynamoDB, and API Gateway.
Strong experience with advanced Apache Airflow orchestration, including complex workflows, scheduling, dependency handling, monitoring, and operational support.
Strong understanding of data engineering concepts, including data pipelines, data transformation, batch processing, real-time processing, data quality, and performance optimization.
Excellent analytical and problem-solving skills. Strong communication and presentation skills, with the ability to explain technical concepts clearly to both technical and non-technical audiences. Experience with version control and CI/CD tools, including Git and Jenkins, for source code management, build automation, testing, and deployment workflows.
Ability to work effectively in cross-functional Agile/Scrum teams.

","datePosted":"2026-06-24T00:00:00.000Z","validThrough":"2026-08-23T00:00:00.000Z","employmentType":"FULL_TIME","identifier":{"@type":"PropertyValue","name":"myjobb-ai","value":"4323214"},"url":"https://myjobb.ai/jobs/pyspark-developer-data-engineer/4323214","directApply":false,"hiringOrganization":{"@type":"Organization","name":"SightSpectrum Technology Solutions","logo":"https://static.ambitionbox.com/assets/v2/images/rs:fit:200:200:false:false/aHR0cHM6Ly9tZWRpYS5uYXVrcmkuY29tL21lZGlhL2FiY29tcGxvZ28vc2lnaHRzcGVjdHJ1bS10ZWNobm9sb2d5LXNvbHV0aW9ucy1vcmlnaW5hbC5qcGc.webp","sameAs":"http://www.sightspectrum.com"},"jobLocation":[{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Hyderabad","addressRegion":"Telangana","addressCountry":"India"}}]}