Sr. Software Engineer - Databricks

We are looking forward to hire Databricks Professionals in the following areas :

Data Engineer -- Databricks, Python, ETL, Postgres

Experience Level 4 -6 Years

:

• • Strong expertise in SQL , including stored procedures, functions, indexes, query optimization, and performance tuning.
  • Hands-on experience with PySpark, Python, and Databricks for designing and developing scalable data solutions.
  • Strong experience in designing, developing, and supporting ETL/ELT pipelines for data ingestion, transformation, and integration.
  • Experience working with AWS cloud data services such as RDS, S3, and Glue , and building end-to-end data pipelines.
  • Strong experience with PostgreSQL , including database design, query development, performance tuning, data modeling, and database administration concepts.
  • Experience in data migration , data integration, organization-wide reporting, and building data products.
  • Good understanding of Databricks workflow orchestration, pipeline execution, monitoring, and optimization .
  • Experience in data cleansing, data validation, reconciliation, and data quality management .
  • Strong analytical and problem-solving skills with the ability to organize, analyze, and interpret large datasets.
  • Good understanding of data warehousing concepts and best practices.
  • Knowledge of Scala, Git, and CI/CD practices for code versioning and deployment automation.
  • Strong verbal, written, and interpersonal communication skills.
  • Organized and structured approach with the ability to work independently and collaboratively in a team environment.
  Migration Modernization Responsibilities

  • Analyze key mainframe jobs and identify DB2 database components requiring migration.
  • Identify and assess DB2 schemas, tables, and dependent objects for migration.
  • Lead the decommissioning of DB2 schemas as part of application and database modernization initiatives.
  • Plan and execute migration of identified DB2 schemas and data to AWS PostgreSQL .
  • Perform schema conversion, data validation, reconciliation, and post-migration testing.
  • Migrate identified schemas/data to AMS while ensuring data integrity and business continuity.
  • Collaborate with cross-functional teams to support migration planning, cutover activities, and production deployment.
  • Ensure compliance with data quality, governance, and security standards throughout the migration lifecycle.
  Primary Skills

  Databricks, PySpark, Python, SQL, PostgreSQL, ETL/ELT, AWS (S3, RDS, Glue), Data Migration

  Secondary Skills

  Scala, Git, CI/CD, DB2 Migration, Mainframe Modernization, Data Quality, Data Validation Reconciliation

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture