Iceberg, Doris, Trino

Job Description:

• Step into a high impact role where you ll lead the design and evolution of modern analytics platforms powered by Iceberg Doris and Trino
• You ll work at the intersection of data engineering and query performance helping teams unlock fast reliable insights from large scale datasets
• This role is ideal for someone who enjoys solving complex data architecture challenges optimizing distributed systems and guiding engineers toward clean scalable implementations
• You ll collaborate closely with data engineers platform teams and stakeholders to build dependable data products improve developer experience and ensure data is accessible governed and performant
• If you re excited by open table formats high concurrency analytical workloads and building systems that make data truly usable across an organization this is a great place to grow and lead with purpose

Key Responsibilities:

• Key Responsibilities
• Lead the architecture and implementation of lakehouse and analytics solutions using Iceberg Doris and Trino for scalable querying and reporting
• Design and maintain Iceberg table layouts partitioning strategies schema evolution patterns and data lifecycle management compaction snapshots retention
• Build and optimize distributed query workflows in Trino including connector configuration query tuning resource governance and workload management
• Develop and optimize analytical data models and ingestion patterns leveraging Doris for high performance OLAP workloads
• Implement robust batch stream processing pipelines using Spark ensuring correctness scalability and cost efficiency
• Establish performance benchmarks monitor SLAs and troubleshoot production issues across compute storage and query layers
• Drive best practices for data quality reliability and operational excellence through automation documentation and runbooks
• Mentor engineers conduct design reviews and lead technical decision making aligned with long term platform goals
• Minimum Qualifications
• Bachelor s or Master s degree in BTECH MTECH MCA MSC or a related field
• 6 8 years of experience in data engineering analytics engineering or building distributed data platforms
• Strong hands on expertise with Iceberg including table design partitioning schema evolution and maintenance operations
• Strong hands on expertise with Trino for federated distributed querying performance tuning and operational troubleshooting
• Strong hands on expertise with Doris for OLAP use cases data modeling and query performance optimization
• Proven experience building data pipelines using Spark in production environments
• Solid understanding of distributed systems query execution concepts and data storage formats for analytics workloads

Technical Requirements:

• Iceberg Doris Trino

Additional Responsibilities:

• Preferred Qualifications
• Experience designing end to end lakehouse architectures integrating Iceberg with multiple compute engines and downstream consumers
• Advanced expertise in query optimization techniques statistics partition pruning file sizing caching strategies across Trino and OLAP systems
• Experience with Spark optimization shuffle tuning join strategies adaptive execution and building reusable pipeline frameworks
• Strong operational ownership monitoring alerting incident management and capacity planning for analytics platforms
• Ability to lead cross team technical initiatives influence standards and improve platform adoption through enablement and documentation

Preferred Skills:

Foundational->Development process generic->Big Data Analytics Process->Big Data,Technology->Cloud Platform->Azure Analytics Services->Azure Data Lake,Technology->Java->Apache->Apache