Specialist - Data Engineering
LTM · Kolkata · onsite · Posted 1d ago
Undisclosed5–7 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Job Summary
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Job Summary Seeking a Specialist with 5 to 7 years of experience in designing and implementing scalable data engineering solutions using Azure SQL and Databricks within the Azure Databricks skill cluster family.
Responsibilities - Design, develop and maintain scalable and efficient data pipelines and ETL processes using Azure SQL and Databricks
- Collaborate with source data application teams and product owners to understand data requirements and deliver robust analytics solutions
- Utilize Azure SQL and Databricks for data ingestion transformation storage and processing
- Implement data migration and transformation workflows leveraging Azure cloud services
- Ensure data quality and optimize performance of data pipelines
- Support continuous integration and continuous deployment CICD pipelines for data engineering projects
- Apply best practices for data governance privacy and security within Azure environments
- Stay updated with emerging Azure and data engineering technologies and recommend improvements to existing solutions
- Lead the design and implementation of batch and streaming data pipelines using Azure SQL and Databricks
- Provide technical leadership and mentorship to team members on Azure SQL and Databricks best practices
- Collaborate with DevOps teams to manage deployment monitoring and support of data engineering solutions
- Troubleshoot and resolve data pipeline issues ensuring high availability and reliability
- Participate in architectural discussions and contribute to the development of coding standards and security guidelines
- Engage with crossfunctional teams to align data engineering efforts with business objectives
- Drive automation of data workflows and improve operational efficiency
- Support production environments with timely incident response and root cause analysis
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
data qualityAutomationData ingestioncoding standardsAzure SQLAnalyticsData EngineeringData MigrationcloudAzure DatabricksData GovernanceMicrosoft AzureData PipelineCi/Cd