Big Data Engineer

Job description: Job Description

Role Purpose As a Big Data Engineer at Wipro Technologies, you will play a pivotal role in transforming complex data sets into meaningful insights that drive strategic business decisions. Your expertise will enable the design, development, and implementation of scalable data solutions, utilizing cutting-edge big data technologies and cloud platforms to optimize performance and reliability. This position is ideal for professionals passionate about leveraging data engineering to empower organizations with actionable intelligence, shaping the future of data analytics and artificial intelligence within a global digital transformation context. You will collaborate closely with cross-functional teams including software engineers, data scientists, business analysts, and product managers to architect and deploy high-impact data platforms. Your work will encompass data ingestion, processing, storage, and orchestration pipelines, ensuring data integrity, security, and accessibility across the enterprise. This role typically demands innovative problem-solving skills, thorough technical knowledge of big data ecosystems, and the ability to translate complex requirements into robust technical solutions. ͏

Responsibilities:

• Lead and mentor engineering teams in designing scalable, maintainable software applications, providing thought leadership that aligns with both business goals and technical standards.
• Collaborate with stakeholders to analyze user stories, refine requirements, and champion agile development practices that promote continuous integration and delivery.
• Architect end-to-end data pipelines encompassing ingestion, transformation, and storage phases with emphasis on performance and security.
• Develop and maintain APIs, automate deployment workflows, and conduct rigorous code reviews and hands-on programming to ensure software quality and robustness.
• Drive adoption of innovative technologies by evaluating emerging tools and processes, anticipating future challenges, and recommending strategic solutions.
• Partner with technical product managers in strategic planning, feature road-mapping, and the creation of technical blueprints for data transformation initiatives.
• Promote consistency in development standards through the establishment of common tools, reusable components, and best practices.
• Engage in comprehensive architecture design and modeling, fostering alignment with organizational data infrastructures and platforms.

Preferred Qualifications:

• Minimum 4 years of applied experience in commercial software development within big data environments.
• Proficiency with Google Cloud Platform services including Google Cloud Storage and BigQuery.
• Expertise in big data tools such as Scala, Spark, Hive SQL, and data lake architectures, alongside strong familiarity with ETL processes and data modeling methodologies.
• Experience implementing secure file transfer procedures and managing data flow across heterogeneous systems.
• Hands-on exposure to Agile methodologies, continuous integration and delivery pipelines, utilizing tools like Maven, Salt, Git, and Jenkins.
• Strong understanding of web technologies (HTTP, Apache) and Unix/Linux operating systems.
• Demonstrated leadership capabilities with excellent communication skills to collaborate effectively with multidisciplinary teams and stakeholders.
• Excellent problem-solving skills, with a proactive mindset toward identifying and implementing continuous improvement opportunities. ͏

Deliverables and Performance Metrics No. Performance Parameter Measurement Criteria 1 Data Analysis & Insight Delivery Number of automated solutions developed; On-time delivery rates; Client Satisfaction (CSAT) scores; Zero escalations from internal or external clients; High levels of data accuracy and reliability. 2 System Reliability and Performance Uptime percentages; Performance benchmarks of data pipelines and applications; Successful execution of load testing and performance tuning exercises. 3 Innovation and Improvement Initiatives Number and impact of new technologies or workflow enhancements introduced; Engagement in continuous learning and professional development activities. 4 Team Leadership and Collaboration Effectiveness in guiding teams towards goals; Cross-functional collaboration success; Stakeholder feedback and peer evaluations. ͏

Core Competencies

• Client Centricity: Ability to understand and anticipate client needs, delivering solutions that exceed expectations.
• Passion for Results: Commitment to delivering high-quality outputs with a strong focus on continuous improvement.
• Execution Excellence: Effective planning, prioritization, and follow-through to meet deadlines and objectives consistently.
• Collaborative Working: Building strong relationships and promoting teamwork across diverse groups.
• Learning Agility: Quickly adapting to new technologies, methodologies, and evolving business requirements.
• Problem Solving & Decision Making: Utilizing analytical thinking and sound judgment to resolve complex challenges and guide strategic decisions.
• Effective Communication: Articulating ideas clearly and influencing stakeholders at all organizational levels, both technical and non-technical. ͏

Additional Skills and Expertise

• Design and development of comprehensive business intelligence solutions utilizing the Power BI suite.
• Expertise in creating and optimizing data models, metrics, and key performance indicators to support advanced reporting and analytics.
• Skillful development of scalable, multidimensional and tabular models designed to facilitate interactive analytics across various business domains.
• Strong command of DAX, Power Query, and SQL enabling the creation of visually compelling and user-friendly dashboards to drive data-driven decision-making.
• Experience troubleshooting, debugging, and enhancing BI solutions to ensure exceptional performance, scalability, and reliability.
• Development and maintenance of BI frameworks, semantic layers, and metadata repositories that promote data governance, standardization, and administration best practices.
• Continuous involvement in refining BI architectures aligned with enterprise data strategy and evolving business needs.
• Commitment to fostering an inclusive, diverse, and innovative workplace where collaboration and personal growth are actively supported. Mandatory Skills: Big Data . Experience: 5-8 Years . Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.