MUMBAI · FULLTIME
Sr Data Engineer
AU Small Finance Bank
Mumbai · onsite · Posted 36d ago
Sourced from
Undisclosed7–10 yrsfulltimeMumbai
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.8s
- Found the form on Naukri · 15 questions to answer1.2s
- Decided the answers for all of them2.9s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
We are seeking a highly skilled Senior Data Engineer with 7-10 years of experience in designing, developing, and managing enterprise-scale data platforms and data warehousing solutions. The ideal candidate will have extensive experience in building scalable ETL/ELT pipelines, architecting cloud-based data solutions on AWS, and leading teams in delivering reliable, secure, and high-performance data ecosystems.
The role requires strong expertise in Data Warehousing, Big Data technologies, AWS Data Services, Data Modeling, Performance Optimization, and People Management within a fast-paced banking and financial services environment.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines for batch and real-time data processing.
- Architect end-to-end ETL/ELT solutions for data ingestion, transformation, and consumption across enterprise systems.
- Build and optimize cloud-native data platforms using AWS services such as S3, EMR, Redshift, Glue, Athena, and Airflow.
- Define and implement enterprise data strategies, including data sourcing, data flow, storage, governance, and consumption frameworks.
- Collaborate with Data Analytics, Business Intelligence, Product, and Technology teams to understand and fulfill data requirements.
- Design and implement scalable data models supporting reporting, analytics, and business intelligence initiatives.
- Monitor, troubleshoot, and support production data pipelines to ensure high availability and reliability.
- Lead performance tuning initiatives for complex SQL queries, ETL jobs, and large-scale data processing workloads.
- Ensure data quality, validation, governance, security, and compliance standards are adhered to.
- Drive cloud cost optimization initiatives while maintaining performance and user experience.
- Present technical architecture, solutions, and recommendations to business and technology stakeholders.
- Mentor junior engineers and coordinate tasks across project teams.
- Prepare and maintain technical documentation, architecture diagrams, and operational runbooks.
Data Engineering Data Warehousing
- Enterprise Data Warehousing Concepts
- Data Lake Data Lakehouse Architecture
- ETL/ELT Design and Development
- Data Integration and Data Migration
- Data Quality Validation Frameworks
- Python
- Scala
- Apache Spark (PySpark/Spark SQL)
- SQL Query Optimization
- Distributed Data Processing
- Amazon S3
- Amazon EMR
- Amazon Redshift
- AWS Glue
- Amazon Athena
- Apache Airflow
- IAM AWS Security Best Practices
- Dimensional Data Modeling
- Star Schema Snowflake Schema
- Data Architecture Design
- Metadata Management
- Data Governance Frameworks
- Apache Airflow
- Enterprise Job Scheduling Frameworks
- Workflow Automation
- Data Pipeline Monitoring
- Incident Management
- Root Cause Analysis
- SLA Management
- Data Security Principles
- Data Encryption Access Controls
- Regulatory and Compliance Awareness
- Minimum 7+ years of overall Data Engineering experience .
- Strong experience in Enterprise Data Warehousing (7+ years) .
- Hands-on expertise in building scalable ETL pipelines using Spark, Scala, and Python (7+ years) .
- Strong SQL development and performance tuning experience.
- Experience in Data Modeling, Data Architecture, and Data System Design.
- Extensive experience working with AWS Data Services including EMR, Redshift, S3, Athena, Glue, and Airflow.
- Experience supporting production environments and handling critical incidents.
- Exposure to banking, financial services, fintech, or large enterprise environments preferred.
- Experience leading and mentoring data engineering teams.
- Strong stakeholder management and communication skills.
- Ability to present complex technical solutions to leadership and cross-functional teams.
- Strong analytical and problem-solving capabilities.
- Excellent documentation and technical writing skills.
- Ability to manage multiple priorities and deliver under tight timelines.
- BE/B.Tech/M.Tech from reputed Tier-1 Institutes.
- AWS Certifications (Solutions Architect, Data Engineer, Developer Associate, etc.).
- Certifications in Spark, Big Data, or Cloud Technologies will be an added advantage.
Disclaimer: This job posting and Location has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Section · 02
Skills
Aws GlueAutomationschemaData EngineerScalaaws iamorchestrationApacheamazon web servicesredshiftencryptionapache airflowAws EmreltProgrammingmetadatalakehouseAnalyticsBankingAWS S3SLAFintechPysparkPythoncloudArchitecturecomplianceETL
Section · Company
About AU Small Finance Bank
AU Small Finance Bank
Banking
50.9k+
employees
1996
30 years old
Jaipur, Rajasthan
India
About
AU Small Finance Bank offer banking services such as personal banking, online banking, internet banking, business & corporate banking, insurance, loans, investments, retail banking & much more.
Industries
BankingFinancial Services
Employee ratings
14,223 reviews
3.8/ 5
Culture
3.6
Career growth
3.5
Work-life
3.7
Employees rate it well for
Work Culture1155Work Environment896Salary745Learning675Work Life Balance609
Find them on