Data Engineer

Job Summary

We are looking for a Data Engineer to join our data team to solve data-driven critical business problems. The person in this role will be responsible for expanding and optimizing the existing end-to-end architecture including the data pipeline architecture. The Data Engineer will collaborate with software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture (consistency throughout ongoing projects). The right candidate should have hands-on experience in developing a hybrid set of data-pipelines depending on the business requirements.

Requirements

• 2+ years of relevant work experience as a Data Engineer or in a similar role.
• Graduate or Postgraduate in Computer Science or in similar quantitative area (B. Tech/B.E. or M. Tech/M.E. in Computers, IT)
• Experience with GCP cloud services: GCS, Big query, VMs is a must.
• Hands-on experience on different databases, python tools and ability to solve complex business problems using data.
• Advanced SQL knowledge, Data-Modelling and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience in developing and optimizing ETL pipelines, big data data pipelines, and data-driven architectures.
• Strong knowledge in programming using Python Shell.
• Strong analytical skills related to working with different types of datasets.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Strong knowledge of working with different OS Linux, Windows, etc.
• Experience with big data tools: Hadoop, Spark, Hive, Airflow, etc
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
• Experience with object-oriented/object function scripting languages: Python

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.