Azure Data Engineer

TCS Hiring for Azure Data Engineer (multiple locations)

Experience Range: - 06 To 08 Years

JOB DESCRIPTION

Must-Have Skills:

• Relevant experience in PySpark and Azure Synapse Analytics/Azure Databricks.
• Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources.
• Good experience in SQL or native SQL query languages.
• Strong experience in implementing Synapse Analytics/Databricks notebooks using Python/PySpark.
• Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, and Azure Functions.
• Advanced working knowledge in building robust data pipelines using ADF.
• Experience in building processes supporting data transformation, data structures, metadata, dependency, and workload management.
• Exposure to basic issues in working within a Cloud (Azure) environment.
• Advanced working SQL knowledge and experience working with relational/non-relational databases and queries.
• Exposure to Jira and Confluence required.
• Experience working in an Agile project management environment.
• A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
• Build data pipeline infrastructure for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, cloud-based relational or non-relational databases, and/or scripting languages such as Perl/Python.
• Identify, design, and implement internal process improvements, including automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability.

Good-to-Have Skills:

• Experience in SSIS/ETL transformation processes.
• Exposure to any cloud-based Data Warehouse.
• Experience in Azure DevOps and CI/CD deployments.
• DP-203 certification.

Minimum Qualification

15 years of Full Time Education