Data Engineer

Job Description Data Engineer

Position: Data Engineer

Experience: 5+ Years

Location: Any Calsoft Location

Notice Period: Immediate Joiner

Employment Type: Full-Time

Role Overview: We are looking for an experienced Data Engineer with 5+ years of hands-on experience in designing, developing, and maintaining scalable data pipelines and ETL solutions. The ideal candidate should have strong expertise in AWS or Azure, ETL, SQL, and Python, along with working knowledge of GCP.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.

• Develop data integration solutions using AWS or Azure cloud services. • Write complex and optimized SQL queries for data extraction, transformation, and analysis.

• Develop and maintain data processing solutions using Python.

• Work with structured and semi-structured data from multiple sources. • Perform data transformation, cleansing, validation, and quality checks. • Monitor and troubleshoot data pipelines and resolve production issues.

• Collaborate with Data Architects, Developers, Analysts, and other stakeholders.

• Ensure data pipelines are scalable, reliable, secure, and optimized for performance.

• Support cloud-based data platform development and migration initiatives. Required Skills

• 5+ years of experience in Data Engineering.

• Strong hands-on experience with ETL/ELT processes.

• Strong SQL skills, including query optimization.

• Good hands-on experience with Python for data engineering.

• Strong experience with GCP, AWS or Azure.

• Understanding of Data Warehousing and Data Modeling concepts.

• Experience working with large-scale data and production data pipelines.

Good to Have

• Experience with AWS Glue / S3 / Lambda / Redshift.

• Experience with Azure Data Factory / Azure Data Lake / Synapse.

• Knowledge of GCP BigQuery / Cloud Storage / Dataflow.

• Experience with Apache Spark / PySpark.

• Knowledge of Airflow or other workflow orchestration tools.

• Exposure to Git, CI/CD, Docker, or cloud-native technologies. Candidate Profile

• Strong problem-solving and analytical skills.

• Good communication and stakeholder management skills.

• Ability to work independently and as part of a technical team.

• Experience working in enterprise production environments.

Key Hiring Criteria Experience: 5+ Years

Cloud: AWS OR Azure

Knowledge: GCP

Core Skills: ETL + SQL + Python + Data Engineering