Senior Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Python, SQL, and cloud technologies such as AWS or GCP.
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs through the use of AI/ML models like ChatGPT.
• Develop scalable architectures for storing and processing large datasets on vectorized databases for improved performance.
• Ensure high availability, security, and reliability of all systems by implementing monitoring tools and performing regular maintenance tasks.

Job Requirements :

• 6-12 years of experience in a similar role as a Data Engineer with expertise in artificial intelligence (AI), large language models (LLMs), chatbots.
• Strong proficiency in programming languages such as Python along with experience working with popular libraries like scikit-learn or TensorFlow.
• Experience working with cloud computing platforms including Amazon Web Services (AWS) or Google Cloud Platform (GCP).
• Proficiency in SQL database management systems.