Senior Data Engineer

Job Title: Senior Data Engineer

Location: Hyderabad Key Responsibilities

• Architect, Design, build, and measure complex ELT jobs to process disparate data sources and form a high integrity, high quality, clean data asset.
• Work with leaders and global teams to architect and deliver enterprise data solutions for the, including setting data strategy, governance, feasibility and longevity of solutions, leading to hands-on solution implementation and BAU support.
• Collaborate with key stakeholders to define multi-market data requirements and implement data and BI solutions
• Create and maintain data pipelines, integrations, and transformations to ensure efficient data processing, storage, and retrieval. Ensure data infrastructure is scalable, efficient, and aligned with best practices in data management
• Conduct complex business transformations to create dimensional models that serve as a foundation for analytical reporting. Extract, organize, and manage data to ensure accessibility for authorized users across the organization
• Perform data profiling, validation, and cleansing to maintain data integrity and accuracy.
• Perform unit test and conduct reviews with other team members to ensure code is rigorously designed, elegantly coded, and effectively tuned for performance.
• Identify and implement internal process improvements: automate manual processes, debug inefficient pipelines, and redesign infrastructure for optimal performance and scalability.
• Deliver Technical Design Documents that outline processes, data flows, definitions, and business rules.
• Champion engineering best practices and proactively seek opportunities to automate and construct tools that streamline operations and enhance overall reliability.
• Collaborate with business analysts to understand requirements and use cases, translating them into technical stories and tasks.
• Work independently within guidelines, responsible for initiating, planning, executing, controlling, and implementing projects using formal project management and agile methodologies.
• Coach, mentor, and provide technical direction and training to other Data & technology teams

Qualifications Experience :

• 6-9 years of experience in Data Warehousing and Business Intelligence roles.
• Advanced proficiency in relational database design, data modelling, and data warehousing principles.
• Excellent programming skills in Python with proficiency in version control tools like Git and CI/CD workflows
• Experience with Relational/NoSQL/Cloud/Columnar databases.
• Extensive knowledge of cloud services, relational database design principles, data warehousing, performance tuning, and optimization techniques.
• 5+years’ experience with Airflow Orchestration is must.
• Expertise in performance analysis and tuning to ensure optimal database performance
• Ability to translate business requirements into technical specifications
• Excellent communication skills with the ability to collaborate effectively with technical teams and business stakeholders to gather and refine requirements.
• Delivery-focused with a can-do attitude in challenging environments.

Other Key Competencies

• In-depth knowledge and experience of data warehousing strategies and techniques
• Experience in vertica will be a plus
• Familiarity with agile development techniques and objectives