AHMEDABAD · FULLTIME
Data Engineer
Anblick Solutions
Ahmedabad · onsite · Posted 69d ago
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.7s
- Found the form on Foundit · 5 questions to answer1.0s
- Decided the answers for all of them2.1s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
Data Engineer to design, develop, and maintain data pipelines and ETL workflows for processing large-scale structured and unstructured data. The ideal candidate will have expertise in Azure Data Services (Azure Data Factory, Synapse, Databricks, SQL, SSIS, and Data Lake) along with big data processing, real-time analytics, and cloud data integration.
Key Responsibilities:
1. Data Pipeline Development ETL/ELT
Design and build scalable data pipelines using Azure Data Factory, Synapse Pipelines ,Databricks, SSIS and ADF Connectors like Salesforce.
Implement ETL/ELT workflows for structured and unstructured data processing.
Optimize data ingestion, transformation, and storage strategies.
2. Cloud Data Architecture Integration
Develop data integration solutions for ingesting data from multiple sources (APIs, databases, streaming data).
Work with Azure Data Lake, Azure Blob Storage, and Delta Lake for data storage and processing.
3. Database Management Optimization
Design and maintain cloud data bases (Azure Synapse, BigQuery, Cosmos DB).
Optimize SQL queries and indexing strategies for performance.
Implement data partitioning, compression, and caching for efficiency.
4. Data Governance, Security Compliance
Ensure data quality, lineage, and governance with tools like Purview.
Implement role-based access control (RBAC), encryption, and security policies.
Ensure compliance with GDPR, HIPAA, and ISO 27001 regulations.
5. Monitoring Performance Tuning
Use Azure Monitor, Log Analytics, and OpenTelemetry to track performance and troubleshoot data issues.
Automate data pipeline testing and validation.
6. Collaboration Documentation
Document data models, pipeline architectures, and data workflows.
Technical Skills:
Cloud Data Services: Azure Data Factory, Azure Synapse, Databricks, SSIS, BigQuery.
ETL Data Pipelines: Apache Spark, Python, SQL.
Big Data Processing: Delta Lake, Parquet, Hadoop, Event Hubs.
Database Management: SQL Server, Cosmos DB.
Security Compliance: RBAC, Data Masking, Encryption, Purview.
Scripting Automation: Python, PowerShell, Terraform for IaC.
Sourced from foundit
Section · 02
Skills
Section · Company
About Anblick Solutions
Anblick Solutions
454
employees
Addison
US
About
Anblicks, a team of specialists in strategic dUnlock the full potential of your data with Anblicks, a team of strategic data modernization experts. Our tailored services cover seamless data migration, robust re-architecture, and transformative solutions. The "AIM" Framework from Anblicks, encompassing Advise, Implement, and Manage, presents a dynamic methodology that simplifies data management. This approach effectively tailors, launches, and maintains data strategies. Anblicks guides its clients in customizing their data foundation, deploying an insight-driven platform, and provides continuous support with its innovative services. This empowers clients to fully leverage their data assets, securing their future capabilities. The framework promotes data democratization and governance, driving growth and enhancing competitive edges through strategic use of data and AI.
Industries
Find them on