AWS Data Engineer

About The Company

Tata Consultancy Services (TCS) is a global leader in IT services, consulting, and business solutions. Established in 1968, TCS has grown to become one of the most respected and innovative technology companies worldwide. With a presence in over 50 countries, TCS is committed to delivering innovative solutions that enable clients to achieve their business objectives. Known for its strong culture of excellence, integrity, and continuous learning, TCS leverages cutting-edge technologies to transform businesses across various industries, including banking and finance, healthcare, manufacturing, and retail. The company's focus on sustainability and corporate social responsibility underscores its dedication to creating a positive impact on society and the environment.

About The Role

We are seeking a highly skilled and experienced Data Engineer to join our dynamic team at Tata Consultancy Services. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and architectures that support our clients data-driven initiatives. This role requires expertise in cloud platforms, data streaming, and big data technologies to ensure the seamless flow and processing of large volumes of data. The Data Engineer will collaborate with cross-functional teams including data scientists, analysts, and software engineers to deliver robust data solutions that drive strategic decision-making. This position offers an excellent opportunity to work on innovative projects in a fast-paced environment, leveraging the latest technologies to solve complex data challenges.

Qualifications

• Minimum of 5+ years of professional experience in data engineering, with a focus on cloud-based environments.
• Proficiency in AWS Cloud services, Databricks, and Apache Airflow.
• Hands-on experience with Apache Kafka, Python, and PySpark.
• Deep understanding of Databricks architecture, design, development, and implementation.
• Proven ability to develop scalable batch and streaming data pipelines.
• Strong skills in SQL, PL/SQL, Unix Shell Scripting, and Autosys.
• Experience working with databases such as Oracle, PostgreSQL, and NoSQL options.
• Knowledge of Data Integration, APIs, and Data Streaming technologies.
• Expertise in Data Modeling, Database Design, and Performance Tuning.
• Experience with version control tools like GitHub and familiarity with Agile development methodologies.
• Excellent analytical, problem-solving, and communication skills.
• Ability to work independently and efficiently in a fast-paced, deadline-driven environment.
  
  

Responsibilities

• Design, develop, and maintain scalable data pipelines for batch and real-time data processing.
• Implement data integration solutions utilizing AWS services, Databricks, and related technologies.
• Collaborate with data scientists and analysts to understand data requirements and deliver optimal solutions.
• Optimize database performance through tuning, indexing, and schema design.
• Ensure data quality, security, and compliance across all platforms and pipelines.
• Automate workflows using Apache Airflow and Autosys to streamline data operations.
• Monitor and troubleshoot data pipelines to ensure high availability and reliability.
• Participate in code reviews, documentation, and knowledge sharing within the team.
• Stay updated with the latest industry trends and incorporate best practices into data engineering processes.
  
  

Benefits

Tata Consultancy Services offers a comprehensive benefits package designed to support the well-being and professional growth of our employees. This includes competitive salary packages, health insurance, and retirement plans. Employees have access to continuous learning and development programs, including certifications, workshops, and training sessions to enhance their skills. TCS promotes a healthy work-life balance through flexible working hours and leave policies. Additionally, employees benefit from a collaborative and inclusive work environment that fosters innovation, diversity, and career advancement opportunities. TCS also provides various employee engagement initiatives, wellness programs, and recognition schemes to motivate and retain top talent.

Equal Opportunity

Tata Consultancy Services is an equal opportunity employer. We are committed to fostering an inclusive environment where all employees and applicants are treated with respect and dignity, regardless of race, color, religion, gender, sexual orientation, gender identity or expression, age, national origin, disability, or any other characteristic protected by law. We believe that diversity and inclusion drive innovation and excellence, and we strive to create a workplace that reflects these values in all aspects of our operations.