Data Engineer (6 To 8 years, bangalore)

Job Description:

We are looking for a Data Engineer with strong experience in designing, building, and supporting scalable data pipelines, data warehouse solutions, and analytics-ready data platforms. The candidate should have hands-on knowledge of BigQuery, SQL, PySpark, ETL / ELT processes, Airflow orchestration, Cloud SQL, and Databricks. The role requires the ability to work with structured and semi-structured data, optimize data processing jobs, ensure data quality, and collaborate with business, analytics, and application teams to deliver reliable data solutions.

• Design, develop, and maintain efficient ETL / ELT data pipelines using SQL, PySpark, Airflow, and cloud-native data services.
• Build and optimize BigQuery datasets, tables, views, partitioning, clustering, and query performance for large-scale analytical workloads.
• Develop data ingestion frameworks from multiple sources including databases, files, APIs, and cloud storage into enterprise data platforms.
• Implement data validation, reconciliation, monitoring, logging, and alerting mechanisms to ensure data accuracy and pipeline reliability.
• Work on Databricks and PySpark jobs for large-volume batch processing, transformation, and performance tuning.
• Collaborate with stakeholders to understand reporting requirements and convert them into scalable data models and reusable datasets.
• Support production data pipelines, troubleshoot failures, perform root-cause analysis, and drive timely remediation.