Lead Data Engineer

About Vericence

Vericence is a digital engineering and technology consulting firm helping enterprises build AI-driven platforms, modernize legacy systems, and scale innovation through cloud, data, and intelligent engineering. We partner with global organizations to deliver high-impact technology solutions and build world-class engineering teams.

Job Summary

We are looking for a skilled Lead Data Engineer with 8-10 years of experience in designing, developing, and maintaining scalable data pipelines and data integration solutions. The ideal candidate should have strong expertise in Python, Oracle Cloud Infrastructure (OCI), and PL/SQL, along with hands-on experience in ETL development, data modeling, and database performance optimization. Experience working with cloud-native data services and large-scale enterprise data platforms is highly preferred.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Python and PL/SQL.
• Develop data integration solutions on Oracle Cloud Infrastructure (OCI).
• Build and optimize data ingestion, transformation, and validation processes.
• Write complex SQL and PL/SQL packages, procedures, functions, and triggers for enterprise applications.
• Design and maintain data models to support analytics and operational reporting.
• Optimize SQL queries and database objects for high performance and scalability.
• Work with Oracle Autonomous Database, Oracle Database, and OCI Object Storage.
• Develop data workflows using OCI Data Integration and related cloud services.
• Ensure data quality, integrity, governance, and security across the data platform.
• Troubleshoot production issues, perform root cause analysis, and implement permanent fixes.
• Collaborate with business analysts, application developers, and data architects to gather and implement data requirements.
• Automate operational tasks using Python scripts and cloud-native services.
• Participate in code reviews, documentation, and deployment activities.

Required Skills

• 8-10 years of experience in Data Engineering or ETL development.
• Strong programming experience in Python.
• Advanced SQL and PL/SQL development skills.
• Hands-on experience with Oracle Cloud Infrastructure (OCI).
• Experience with Oracle Database (12c/19c), Autonomous Database, and Oracle SQL Developer.
• Strong understanding of ETL/ELT concepts, data warehousing, and dimensional modeling.
• Experience with OCI Data Integration, Object Storage, Data Flow, or related OCI services.
• Knowledge of REST APIs, JSON, XML, and file-based integrations.
• Experience with Git and CI/CD pipelines.
• Strong debugging, analytical, and performance tuning skills.

Preferred Skills

• Experience with Apache Airflow or other workflow orchestration tools.
• Familiarity with Spark or distributed data processing frameworks.
• Experience with Docker and Kubernetes.
• Knowledge of Linux shell scripting.
• Exposure to Oracle Analytics Cloud (OAC), Oracle Integration Cloud (OIC), or Oracle GoldenGate.
• Understanding of data governance and security best practices.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• Oracle Cloud certifications (OCI Foundations, OCI Data Management, or Oracle Database certifications) are a plus.

Preferred Technologies

• Programming: Python, PL/SQL, SQL
• Cloud: Oracle Cloud Infrastructure (OCI)
• Database: Oracle Database, Autonomous Database
• Data Services: OCI Data Integration, Object Storage, Data Flow
• Version Control: Git
• Operating System: Linux
• Tools: Oracle SQL Developer, VS Code, Postman