HYDERABAD · FULLTIME
Data Engineering Lead
Lecan Solutions
Hyderabad · onsite · Posted 48d ago
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.6s
- Found the form on Naukri · 6 questions to answer1.0s
- Decided the answers for all of them2.1s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
JOB Details
Experience: 7 to 10 yrs
Location : Pan India
Primary skills – Databricks
Secondary Skill -Graph DB,AI/ML use case , GCP
Sift timing: 12:30 pm to 9:30 pm
JD:
Demonstrated expertise in Data Engineering, including the design, development, and optimization of scalable data pipelines, data platforms, and data processing solutions
Experience designing and implementing solutions that leverage both structured and unstructured data to support AI, enterprise search, knowledge management, and analytics use cases
Advanced experience designing and implementing modern data lake architectures and leveraging Google Cloud Platform / Databricks to build and maintain data engineering solutions
Hands-on experience implementing enterprise-scale document processing capabilities, including OCR, metadata extraction, content enrichment, indexing, and knowledge discovery solutions
Familiarity with graph databases and knowledge graph concepts to support enterprise search, knowledge discovery, and AI solutions
Strong knowledge of data modeling, data structures and algorithms, and data integration techniques to support efficient and reliable data management
Proven experience applying DevOps principles and practices, including automation, deployment, monitoring, and continuous improvement of data products and platforms.
Strong understanding of workflow management and orchestration tools to support complex data processing and integration workflows.
Strong business acumen with the ability to understand organizational priorities and translate business requirements into effective technical solutions
Experience working within Agile environments, including the Scaled Agile Framework (SAFe), and collaborating effectively across cross-functional teams
Excellent stakeholder management, communication, and influencing skills, with the ability to build consensus and drive outcomes across technical and non-technical audiences
Thanks & Regards,
Shilpi Kumari
Recruiting Analyst
India Recruitment
Lecan Solutions PVT LTD
[email removed]
Sourced from naukri
Section · 02
Skills
Section · Company
About Lecan Solutions
Lecan Solutions
Recruitment
51-200
employees
2004
22 years old
Naraina
IN
₹2.7L PA avg
Avg at Lecan Solutions
About
Job Description Python Spark Developer
Position
Python Spark Developer
Experience
3 to 7 Years
Work Location
- Chennai – Sholinganallur SEZ
- Bangalore – RMZ Ecoworld, Bellandur
Job Summary
We are seeking a highly skilled Python Spark Developer with strong expertise in big data technologies and distributed data processing. The ideal candidate should have hands-on experience in Python, Apache Spark, SQL, Unix Shell Scripting, and Airflow, along with a solid understanding of the Hadoop ecosystem.
The candidate will be responsible for designing, developing, optimizing, and maintaining scalable data processing applications while collaborating with cross-functional teams and mentoring junior developers.
Key Responsibilities
- Develop and maintain scalable applications using Python and Apache Spark.
- Design and implement data processing pipelines using:
- Spark Core
- Spark SQL
- Spark Streaming
- Work extensively with the Hadoop Ecosystem for distributed data processing.
- Perform data manipulation, transformation, and analysis using Pandas.
- Develop and manage workflows using Apache Airflow.
- Write efficient and optimized SQL queries and Unix Shell scripts.
- Design low-latency, high-availability, and high-performance applications.
- Perform coding, testing, debugging, troubleshooting, and deployment activities.
- Monitor and optimize application performance, scalability, and usability.
- Implement automation and performance tuning solutions.
- Lead and mentor junior Python developers and provide technical guidance.
- Collaborate with stakeholders, architects, analysts, and development teams to deliver quality solutions.
Industries
Employee ratings
10 reviews
Culture
4.2
Career growth
2.9
Work-life
4.3
Employees rate it well for
Find them on