Pyspark, Databricks

Role & responsibilities

Job Title: AWS PySpark Databricks Developer

Relevant Experience:

(in Yrs) 5-6 years+

Technical/Functional Skills

• 56 years of total experience in data engineering or big data development.

• 23 years hands-on experience with Databricks and Apache Spark. • Proficient in AWS cloud services (S3, Glue, Lambda, EMR, Redshift, CloudWatch, IAM).

• Strong programming skills in PySpark, Python, and optionally Scala.

• Solid understanding of data lakes, lakehouses, and Delta Lake concepts.

• Experience in SQL development and performance tuning.

• Familiarity with Airflow, dbt, or similar orchestration tools is a plus.

• Experience in CI/CD tools like Jenkins, GitHub Actions, or Code Pipeline.

• Knowledge of data security, governance, and compliance frameworks.