Data Engineer

Interested suitable candidates please be in touch with [email removed]

Job Title: Data Engineer

Shift details - 12.30PM to 09.30PM IST

Work mode - Temporary Remote

Job Summary

We are looking for a Data Engineer with 2 to 4 years of experience to help build, optimize, and maintain our core data pipelines and integrations. In this role, you will leverage Python and SQL / PostgreSQL to build efficient ETL/ELT workflows, perform data cleansing and transformation, and integrate disparate data sources. You will collaborate closely with senior engineers and analytics teams to ensure our data ecosystem remains reliable, structured, and production-ready.

Key Responsibilities

• ETL/ELT Pipeline Development: Design, build, and maintain automated ETL/ELT pipelines using Python and SQL to move and transform data across systems.
• Database Management & SQL Optimization: Write, debug, and optimize complex SQL queries, stored procedures, and views within PostgreSQL environments.
• System Integration & API Ingestion: Use Python to ingest data from REST APIs, third-party applications, operational databases, and flat files.
• Data Cleansing & Transformation: Write automated Python scripts and SQL transformations for data validation, cleansing, parsing, and deduplication.
• Data Quality & Monitoring: Implement data testing and basic monitoring to identify pipeline failures, schema changes, and data quality issues early.
• Collaboration & Documentation: Partner with senior engineers and analysts to deliver clean dataset structures and maintain clear technical documentation for pipelines and data models.

Required Qualifications

• Experience: 24 years of experience in data engineering, data integration, or software engineering focused on data pipelines.
• Core Languages: Strong proficiency in both Python (pandas, SQLAlchemy, request libraries) and SQL.
• Primary Database: Hands-on experience working with PostgreSQL (schema design, indexing, query optimization, window functions).
• Pipeline Concepts: Practical experience with ETL/ELT architecture, data staging, and data integration patterns.
• Data Processing Tools: Experience or familiarity with workflow orchestration tools (e.g., Apache Airflow) or transformation frameworks (e.g., dbt).
• Version Control: Standard use of Git for code management and collaboration.

Preferred / Nice-to-Have Skills

• Exposure to cloud data platforms (AWS, GCP, or Azure).
• Experience with containerization using Docker.
• Experience writing unit tests for Python data pipelines (e.g., pytest).

Soft Skills & Candidate Profile

• High attention to detail with a strong focus on data accuracy and consistency.
• Solid problem-solving ability and eagerness to continuously learn and expand technical skills.
• Effective communication skills to collaborate with technical and non-technical team members.