CHENNAI · FULLTIME
DE - Cloud - Senior Data Platform Engineer - GDSN02
Ernst Young
Chennai · onsite · Posted 5d ago
Sourced from
Undisclosed4–8 yrsfulltimeChennai
Your match
?
Sign in to see your match score, skill gaps & tailored resume.
Section · 01
About this role
Job Summary
Senior Data Platform Engineer
Your role will be a Technology Lead, or Senior Technology Lead in the Cloud Engineering team. You will be responsible to be a part of the delivery of IT projects for our customers across the globe.
Your key responsibilities - Architect and manage Databricks/Snowflake infrastructure on Azure and AWS, ensuring scalable, secure, and cost-effective deployments.
- Establish and enforce data governance frameworks (including access controls, lineage, and compliance) across cloud and on-premises environments.
- Design and implement DataOps and MLOps pipelines for automated data ingestion, transformation, model training, deployment, and monitoring.
- Automate infrastructure provisioning using Terraform, ARM Templates, or Bicep for Databricks/Snowflake workspaces, clusters, and supporting resources.
- Integrate Databricks/Snowflake with enterprise CI/CD pipelines (Azure DevOps, GitHub Actions, Jenkins, etc.) for code, data, and model lifecycle management.
- Implement monitoring, logging, and alerting for Databricks workloads using native and third-party tools (e.g., Azure Monitor, AWS CloudWatch, Datadog).
- Optimize Databricks cluster performance and cost, including autoscaling, spot instance usage, and job scheduling.
- Ensure security best practices: manage secrets, network isolation, encryption, and compliance with organizational and regulatory standards.
- Collaborate with data engineering, analytics, and ML teams to enable seamless integration and workflow automation.
- Drive adoption of DevSecOps practices: integrate security scanning and compliance checks into DataOps/MLOps pipelines.
- Lead incident response and root cause analysis for Databricks platform issues, ensuring high availability and reliability.
- Document architecture, processes, and best practices for knowledge sharing and operational excellence.
- Databricks/Snowflake administration, including workspace, cluster, and job management.
- Azure and AWS cloud platforms, including networking, IAM, and cost management.
- Infrastructure as Code (Terraform, ARM, Bicep) and automation scripting (Python, Bash, PowerShell).
- CI/CD tools (Azure DevOps, GitHub Actions, Jenkins) and source control (Git).
- DataOps and MLOps concepts, including orchestration, versioning, and monitoring.
- Data governance tools and frameworks (Unity Catalog, Purview, AWS Lake Formation, etc.).
- Secure, compliant, and scalable data architectures in multi-cloud environments.
- Troubleshooting and performance optimization skills for distributed data and ML workloads.
- Monitoring and observability tools (Datadog, Prometheus, Grafana, Azure Monitor).
- DevSecOps practices and integrating security tools into data pipelines.
- Mentor and upskill teams on Databricks, DataOps, and MLOps best practices.
- Analytical and problem-solving skills; ability to assess risks and propose mitigation strategies.
- Experience with regulatory compliance (GDPR, HIPAA, etc.) in cloud data environments is a plus.
- Capability to identify software packages and solutions that could meet client solution requirements and develop requests for proposal (RFPs) from these vendors. Assist clients in the evaluation of the resulting proposals, including the package capabilities and fit to the requirements (business and technology), vendor proposals for pricing and support.
- Capability to design and developed AI infused DevOps and Platform Engineering framework.
- BE/B.Tech/MCA with a sound industry experience of 4 to 8 years
- Cloud Computing knowledge in multi cloud environments (Azure, AWS)
- Hands-on experience with Databricks administration on Azure and/or AWS, including workspace, cluster, and job management
- DevOps setup CI/CD pipeline using Azure DevOps, GitHub Actions, or GitLab CI
- Strong understanding of DataOps and MLOps practices, including orchestration, monitoring, and governance
- Hands-on experience with containerization, including Docker & Kubernetes (AKS/EKS/GKE)
- Scripting knowledge on PowerShell, Python, Groovy, Shell Scripting and cloud native CLIs
- Must be good in IAC tools such as Terraform or ARM or Bicep
- Must be good in Config Management Tools such as Ansible or Chef or Puppet
- Expertise in Golden Paths creation for end-to-end developer workflows.
- Microsoft Certified: DevOps Engineer Expert (AZ-400)
- Microsoft Certified: Designing Microsoft Azure Infrastructure Solutions (AZ-305)
- Microsoft Certified: Azure Solutions Architect Expert
- AWS Certified DevOps Engineer Professional
- AWS Certified Solutions Architect Associate
- Hashicorp Certified: Terraform Associates
Sourced from naukri
Let the agent run this one for you.
Tailored resume, auto-apply, and referral lookup — in under 2 minutes.
Section · 02
Skills
AutomationAgileAutomation Toolsappdynamicsamazon web servicesAksAnsible TowerAutomation Scriptingapplication performance managementAnalyticsArtifactoryArtifact ManagementArchitectureAdministrationAWS CertifiedAnsibleArm TemplatesArtificial Intelligence
Section · Company
About Ernst & Young
Ernst Young
Management Consulting
44k+
employees
2002
24 years old
Gurgaon / Gurugram, Haryana
India
₹15.3L PA avg
Avg at Ernst & Young
About
At EY, our purpose is Building a better working world. The insights and quality services we provide help build trust and confidence in the capital markets and in economies the world over.
Industries
Management Consulting
Employee ratings
10 reviews
3.4/ 5
Culture
1.9
Career growth
2.3
Work-life
2.5
Employees rate it well for
Job Security36Skill Development35
Find them on