PUNE · FULLTIME
Data Engineer-Apache Iceberg
Pi-square Technologies
Pune · hybrid · Posted 13d ago
Your match
Sign in to see your match score, skill gaps & tailored resume.
Section · 01
About this role
Job Location- Pune, Chennai, Bangalore
Must have skills which are non-negotiable
- Databricks,
- Apache iceberg
- Pyspark
- AWS Core Data Services
Role: Technology Lead Databricks, AWS & Big Data
Experience: 7+ Years
Domain: Banking / Financial Services
Location: Offshore(Pune, Chennai and Bangalore) / Hybrid
Job Summary
We are seeking an experienced Technology Lead with strong expertise in Databricks, AWS, Big Data, and PySpark development to design, develop, and deliver scalable data engineering solutions for
Banking and Financial Services clients.
The ideal candidate will have hands-on experience building
modern data platforms using Databricks, Apache Iceberg, AWS cloud services, and Spark-based technologies while leading development activities in an Agile environment.
Key Responsibilities
- Design, develop, and maintain scalable data engineering solutions using Databricks, Apache Iceberg, AWS, PySpark, and Spark.
- Build and optimize batch and real-time data processing pipelines to support business analytics and reporting requirements.
- Develop highly efficient ETL/ELT solutions using Python, SQL, and PySpark.
- Design and implement cloud-native data architectures leveraging AWS services such as Glue, Lake Formation, CloudFormation, IAM, Lambda, and Redshift.
- Translate business and functional requirements into robust technical solutions while ensuring adherence to quality standards and best practices.
- Collaborate with business stakeholders, architects, data analysts, and cross-functional teams to identify and resolve data-related challenges.
- Perform code reviews, troubleshooting, performance tuning, and optimization of data pipelines and Spark workloads.
- Ensure data security, governance, and access management using AWS and Databricks best practices.
- Support production deployments, incident resolution, root cause analysis, and continuous process improvement initiatives.
- Stay current with emerging technologies, industry trends, and best practices in Big Data and Cloud Engineering.
Required Technical Skills
Databricks & Big Data
Databricks
Apache Iceberg
Apache Spark
PySpark
Spark SQL
Data Lake / Lakehouse Architecture
AWS Cloud Services
AWS Glue
AWS CloudFormation
AWS Lake Formation
AWS IAM
AWS Lambda
Amazon Redshift
Programming Languages
- Python
- SQL Data Engineering
- ETL / ELT Development
- Data Warehousing
• Data Integration
- Data Modeling
Performance Optimization --- Agile & Collaboration Skills
Experience working in Agile/Scrum environments.
Active participation in Scrum ceremonies.
Important :
Notice period : Immediate to 15-30 days ONLY.
Candidates serving Notice period will be preferred.
Please note - There should not be Career Gap more than 6 months(No Career Break)
Graduation score should be 60% & above
Pre Screening BGV (Background Verification)is mandatory [UAN/PF without any overlap issue is required.]
Sourced from naukri
Let the agent run this one for you.
Tailored resume, auto-apply, and referral lookup — in under 2 minutes.
Section · 02
Skills
Section · Company
About Pi-square Technologies
Pi-square Technologies
IT Services & Consulting
350
employees
2015
11 years old
Hyderabad/Secunderabad, Telangana
India
₹5.6L PA avg
Avg at Pi-square Technologies
About
Overview
Businesses are challenged to stay ahead of the latest trends and competitive developments while building a responsive and agile capability to support growth. However, since everyone has access to the same tools, technology alone does not offer a competitive advantage. Your advantage depends on how you apply technology—more specifically, on the people who lead, support and optimize your initiatives.
Pi-square technologies is a state of the art Automotive Embedded Software Development, Training and Consulting company having tie ups with major OEM’s and many Tier 1 suppliers in Automotive Industry. We aim to build diverse teams that are reflective of the communities we serve. The different perspectives and experiences of our workforce give us the competitive edge that is vital for success in an ever-changing multicultural world.
We have positioned diversity and inclusion as a catalyst for achieving our business objectives. Through our strategic alliances with diverse organizations in the communities where we live, work and serve, we consistently deliver high-quality, market-specific business solutions to our customers.
Our Vision
Provide Fast, Simple and Cost-effective Staffing, Training and automotive embedded solutions by bridging skill gaps between the Employees and Employers!!
Our Mission
To help our clients succeed by providing creative business solutions using our knowledge, experience, and the highest quality tools in the industry. Pi-Sqaure technologies is unique and growing organization with an entrepreneurial spirit. We are a company that values our employees as individuals by promoting professionalism and strong work ethics. Ultimately, there are only two things that are important to us – our customers and our employees.
Industries
Employee ratings
10 reviews
Culture
4.0
Career growth
4.0
Work-life
3.9
Employees rate it well for
Find them on