BENGALURU · FULLTIME
Lead Data Engineer
Neoware Technology Solutions
Bengaluru · onsite · Posted 12d ago
Sourced from
Undisclosed8–13 yrsfulltimeBengaluru
Your match
?
Sign in to see your match score, skill gaps & tailored resume.
Section · 01
About this role
Development
Lead Data Engineer (AWS)
Requirements
- 8+ years of hands-on experience in delivering data engineering solutions
- Experience leading a team of 5+ team members, responsible for technical project management including stakeholder management, design review, code reviews and mentoring
- Strong hands-on experience in AWS, with experience in data engineering related services and technologies including AWS Glue, Lambda, Amazon Redshift, EMR, Amazon Kinesis etc.
- Expertise in database concepts, SQL and relational modelling
- Good understanding and experience working with NoSQL databases
- Strong hands-on experience in implementing data pipelines using Python and PySpark
- Good understanding of data lake and data warehouse concepts, modern data architecture patterns and industry trends in data engineering space
- Hands-on experience in data modelling, with a good understanding of both ER modelling and dimensional modelling
- Good understanding and experience implementing data quality management solutions
- Good understanding of metadata management for data engineering solutions and data platforms
- Good understanding of data governance concepts including data stewardship, data security and data privacy management
- Experience with version control tools like Git for managing version control for source code
- Experience with DevOps processes, including experience implementing CI/CD pipelines for data engineering solution components
- Strong analytical and problem-solving skills
- Excellent communication and collaboration skills
Responsibilities
- Lead technical architecture and design efforts for data engineering solution components for delivering business solutions
- Design and implement scalable, secure and resilient data engineering solutions on AWS, with a good understanding of data architecture patterns
- Evaluate and select appropriate technology stack for data engineering solution components cloud native services, open-source tools, data storage, data processing frameworks etc
- Lead, mentor and manage a team of dynamic data engineers for development, testing and implementation of data pipelines ensuing quality, performance and on-time delivery
- Responsible for detailed technical design and data mapping specification
- Ensure adherence to industry best practices, coding standards and guidelines driving continuous improvement in code quality and delivery excellence
- Optimize data solutions for performance, cost-efficiency and scalability
- Ensure data quality and integrity for downstream systems and applications
- Plan, prioritize and manage data engineering projects, ensuring timely delivery with quality
- Identify and mitigate risks, troubleshoot issues, handle customer escalations
- Ensure alignment with business requirements and priorities, working closely with stakeholders both internal and customer
- Maintain comprehensive technical documentation, including architecture diagrams, high level / low level data integration design, data mapping specifications, database design etc
- Working closely with peers, BI engineers and data scientists to enable advanced analytics, machine learning models and reporting solutions
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Let the agent run this one for you.
Tailored resume, auto-apply, and referral lookup — in under 2 minutes.
Section · 02
Skills
Aws GlueData EngineerCI/CD Pipelinescoding standardscode qualitycloud nativedata architectureamazon web servicesredshiftBusiness RequirementsAnalyticsData EngineeringcloudArchitectureAdvanced AnalyticsData Governance
Section · Company
About Neoware Technology Solutions
Neoware Technology Solutions
IT Services & Consulting
51-200
employees
2020
6 years old
Chennai, Tamil Nadu
India
₹10.2L PA avg
Avg at Neoware Technology Solutions
About
Neoware Technology Solutions is a technology company focused on Data Strategy, Data Engineering and Artificial Intelligence
Industries
Artificial Intelligence (AI)Business IntelligenceInformation Technology
Employee ratings
10 reviews
3.5/ 5
Culture
4.0
Career growth
3.5
Work-life
3.9
Employees rate it well for
Skill Development46Company Culture40
Find them on