Associate III - Data Engineering

Role Description

• Design, develop, and maintain big data pipelines and ETL workflows.
• Build scalable data processing systems using technologies such as Apache Hadoop and Apache Spark.
• Manage data ingestion from multiple sources, including databases, APIs, and streaming platforms.
• Optimize data storage and retrieval performance.
• Implement data quality, security, and governance standards.
• Work with cloud-based data platforms and services.
• Monitor and troubleshoot data processing jobs and infrastructure.
• Collaborate with data scientists and business teams to support analytics and machine learning initiatives.
• Document data architecture, workflows, and technical processes.
• • Knowledge of SQL and NoSQL databases.
• Understanding of data modeling, data warehousing, and ETL concepts.
• Familiarity with containerization and orchestration tools such as Docker and Kubernetes.

Skills big data,apache spark,scala,sql,