Data Engineer

Company Overview

Milestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over 25 years, we have a demonstrated history of supporting category-defining enterprise clients that are growing ahead of the market. The company specializes in providing solutions across Application Services and Consulting, Digital Product Engineering, Digital Workplace Services, Private Cloud Services, AI/Automation, and ServiceNow. Milestone culture is built to provide a collaborative, inclusive environment that supports employees and empowers them to reach their full potential.

Our seasoned professionals deliver services based on Milestone's best practices and service delivery framework. By leveraging our vast knowledge base to execute initiatives, we deliver both short-term and long-term value to our clients and apply continuous service improvement to deliver transformational benefits to IT. With Intelligent Automation, Milestone helps businesses further accelerate their IT transformation. The result is a sharper focus on business objectives and a dramatic improvement in employee productivity. Through our key technology partnerships and our people-first approach, Milestone continues to deliver industry-leading innovation to our clients. With more than 3,000 employees serving over 200 companies worldwide, we are following our mission of revolutionizing the way IT is deployed.

Responsibilities

Job Overview Data Engineer – Responsibilities (4–7 Years Exp)

• Develop and maintain scalable data ingestion and processing pipelines using SQL, Spark, and Python/Scala.
• Develop and optimize Apache Spark batch and streaming jobs for large-scale data processing.
• Design and implement data models including Dimension and Fact tables, with clearly defined grain, relationships, and measures.
• Implement Slowly Changing Dimensions (SCD) and appropriate incremental processing strategies.
• Work with AWS data engineering and serverless services such as Glue, S3, Lambda, EMR, and Step Functions.
• Develop and maintain reliable, scalable data pipelines with appropriate error handling, logging, monitoring, and data quality checks.
• Apply data engineering fundamentals including partitioning, incremental processing, schema evolution, data quality, and pipeline reliability.
• Work with Apache Iceberg, including table design, partitioning, schema evolution, and incremental processing.
• Develop data transformation workflows using DBT and orchestrate pipelines using Airflow.
• Troubleshoot and optimize data pipelines for performance, scalability, and cost efficiency.
• Participate in code reviews, testing, debugging, and continuous improvement of data engineering solutions.
  
  

Required Skills

• 4–7 years of relevant Data Engineering experience.
• Strong SQL skills — SQL is a core requirement.
• Strong hands-on experience with Apache Spark and Python or Scala.
• Hands-on experience with AWS data engineering and serverless services, particularly AWS Glue and S3.
• Good understanding of Data Modelling, including:
• Dimension and Fact table design
• Defining appropriate Fact grain
• Dimension-to-Fact relationships
• Implementing SCD Type 1 / Type 2 and other appropriate SCD patterns
• Strong understanding of data engineering fundamentals including partitioning, incremental processing, schema evolution, data quality, and pipeline reliability.
• Good understanding of distributed data processing and Spark performance optimization.

Additional Responsibilities / Good to Have

• Experience with Apache Iceberg and lakehouse architectures.
• Experience with DBT for data transformation and modelling.
• Experience with Airflow for workflow orchestration.
• Kafka / Kafka Streaming experience is a good to have.
• Exposure to AI/LLM tools for development, debugging, testing, and documentation.
  
  

Compensation

Estimated Pay Range:

Exact compensation and offers of employment are dependent on circumstances of each case and will be determined based on job-related knowledge, skills, experience, licenses or certifications, and location.

Our Commitment to Diversity & Inclusion

At Milestone we strive to create a workplace that reflects the communities we serve and work with, where we all feel empowered to bring our full, authentic selves to work. We know creating a diverse and inclusive culture that champions equity and belonging is not only the right thing to do for our employees but is also critical to our continued success.

Milestone Technologies provides equal employment opportunity for all applicants and employees. All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, religion, gender, gender identity, marital status, age, disability, veteran status, sexual orientation, national origin, or any other category protected by applicable federal and state law, or local ordinance. Milestone also makes reasonable accommodations for disabled applicants and employees. 

We welcome the unique background, culture, experiences, knowledge, innovation, self-expression and perspectives you can bring to our global community. Our recruitment team is looking forward to meeting you.

***Notice to Job Seekers Regarding Impersonation and Fraudulent Job Offers***

It has come to our attention that unauthorized individuals and entities are impersonating Milestone Technologies, Inc. on various job boards/portals, specifically Naukri.com and Linkedin.com

Please be advised of the following official Milestone Technologies recruitment policies:

Official Communication Channels

All legitimate email communications from our recruitment team will originate ONLY from the domains: @milestone.tech. We do not use generic email services (e.g. @gmail.com, @yahoo.com, @outlook.com) or unofficial third party messaging apps to conduct formal business.

No Recruitment Fees

Milestone Technologies never requests any form of payment, security deposit, laptop/equipment fee, or processing fee at any stage of the recruitment or onboarding process. Any request for money in exchange for an interview or job offer is a scam.