Python developer

Roles and Responsibilities :

• Design, develop, test, and deploy data pipelines using PySpark and Data Bricks to extract insights from large datasets.
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
• Develop high-quality code in Python to process and analyze big data sets, ensuring scalability and performance.
• Troubleshoot issues related to data processing, ETL processes, and visualization.

Job Requirements :

• 4-8 years of experience in software development with a focus on big data technologies such as Hadoop ecosystem (HDFS, MapReduce) or Spark (PySpark).
• Strong proficiency in programming languages like Python along with experience working with libraries like NumPy, Pandas, Matplotlib etc. .
• Experience with cloud-based platforms like AWS S3 buckets for storing large datasets.
• Knowledge of SQL concepts including joins, aggregations, filtering etc. .