Data Engineer

Designation: Senior Data Engineer / Lead Data Engineer:

About Us : TheMathCompany or MathCo is a global Enterprise AI and Analytics company trusted by leading Fortune 500 and Global 2000 enterprises for data-driven decision making. Founded in 2016, MathCo builds custom AI and advanced analytics solutions to solve enterprise challenges through its hybrid model. NucliOS, MathCos proprietary platform, enables connected intelligence at a lower total cost of ownership (TCO). At MathCo, we foster an open, transparent, and collaborative culture, making it a great place to work. We provide exciting growth opportunities and value capabilities and attitude over experience, enabling our Mathemagicians to 'Leave a Mark'.

Job Description:

As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and infrastructure. You will contribute to multiple projects from both operational and technical standpoints, drive architectural discussions, and guide teams on data engineering best practices. This role requires strong knowledge of data architecture, cloud platforms, data modeling, ETL/ELT, and modern data processing patterns across batch and real-time workflows.

Key Responsibilities :

• 3-12 years of relevant work experience.

• Design, store, process, and maintain large-scale data systems and related infrastructure.

• Drive multiple projects from both operational and technical standpoints.

Ideate and build PoVs/PoCs for new products that can help drive more business.

• Define, design, and implement data engineering best practices, strategies, and solutions.

• Act as an architect guiding customers, the team, and the organization on tools, technologies, and best practices in data engineering.

• Lead architecture discussions and align them with business needs, security, and best practices.

• Demonstrate strong conceptual understanding of Data Warehousing, ETL, Data Governance, Security, Cloud Computing, and Batch & Real-Time Data Processing.

• Apply strong execution knowledge of Data Modeling, SQL/NoSQL databases, SDLC practices, unit testing, and functional programming.

• Understand and work with Medallion architecture patterns. • Work on at least one major cloud platform.

• Execute multiple end-to-end data engineering projects as a data architect.

• Possess extensive knowledge of various data architecture designs and data modeling concepts.

• Manage conversations with client stakeholders, understand requirements, and translate them into technical outcomes. Required Skills and Experience

• Strong proficiency in SQL.

• Experience working with any major cloud platform (AWS, Azure, or GCP).

• Working knowledge of ETL/orchestration tools (IICS, Talend, Matillion, Airflow, ADF, AWS Glue, GCP Composer, etc.).

• Working knowledge of OLTP databases (Postgres, MySQL, SQL Server, etc.).

• Working knowledge of Data Warehouses such as Snowflake, Redshift, Azure Synapse, Hive, BigQuery, etc.

• Proficiency in at least one data engineering programming language such as Python (or Scala/Rust/Java).

• Strong execution knowledge of Data Modeling (star schema, snowflake schema, fact/dimension tables).

• Proficient in Spark and related platforms (Databricks, GCP DataProc, AWS Glue, EMR, etc.).

• Experience working with Kafka and real-time streaming.

• Strong understanding of data architecture patterns (Lambda, Kappa, data harmonization, CDP patterns, etc.).

• Experience in code and SQL optimization.

• Strong knowledge of Git and CI/CD pipeline design for continuous delivery.

• Experience with data and networking security (RBAC, secret management, key vaults, VNets/subnets, certificates). Being a Mathemagician

• Embody MathCos culture and way of working.

• Demonstrate ownership and strive for excellence in delivering results. • Actively engage and contribute to initiatives fostering company growth.

• Support diversity and appreciate different perspectives. Recognitions

• Positioned as a Leader in Top Generative AI Service Providers PeMa Quadrant 2023 by AIMResearch.

• Recognized among Inspiring Workplaces in North America, 2023.

• Accredited for Inclusive Practices by Great Place to Work Institute, India.

• Recognized among India’s Best Workplaces™ for Diversity, Equity, Inclusion & Belonging 2023 by Great Place To Work® India. For more information, please visit our website.