Azure Data Engineer

Job Description

Cloud Data EngineerKey responsibilities:Ensure the stability, scalability, and performance of the data pipelines solution.Monitor and maintain batch data pipelines in a cloud-based environment.Improve operational processes including incident handling, performance monitoring, and issue resolution.Optimize Databricks workloads to improve efficiency and reduce costs.Analyze and fine-tune the cloud infrastructure for better cost optimization.Qualifications:Education:Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.Professional Experience:Experience in operating and maintaining large-scale cloud data solutions in production environments.Proven experience as a Data Engineer, with a strong focus on Azure Data factory and Databricks.Experience working in an automotive domain is a plus.Technical Skills:Solid understanding of common issues incloud-based data pipelinesand analytics solutionsWorking knowledge ofDatabricksandLakehouse architecturein a cloud environment.Working with Batch accounts, IAC, GitHub, IAM, and CI/CD pipelinesExperience withcommand-line scripting(e.g.,PowerShell).Experience withdata pipeline orchestration tools(e.g. Azure Data Factory)Understanding of monitoring and logging tools is a plus.

Qualifications

B.E

Additional Information

2 -6 Years