Data Engineer

EXP: 4 to 10 year

Job description

Responsibilities:

• Data Solution Development: Design, develop, and optimize data solutions using Databricks, Spark, and related technologies.
• Data Engineering: Develop and maintain data pipelines, data lakes, and data warehouses using Databricks, Delta Lake, and other tools.
• Data Science: Collaborate with data scientists to deploy machine learning models and optimize data science workflows.
• Performance Optimization: Optimize Spark jobs, Databricks notebooks, and data pipelines for performance and scalability.
• Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance, and ensure data quality

Required Skills:

• Databricks: In-depth knowledge of Databricks, Spark, Delta Lake, and related technologies.
• Programming: Strong programming skills in Python, Scala, or Java.
• Data Engineering: Experience with data engineering, data warehousing, and ETL tools.
• Expertise in SQL, Unity Catalogue, Workflows/Jobs
• Data Science: Experience with data science, machine learning, and statistical modeling.
• Communication: Excellent communication and collaboration skills