Python + Big Data

Proven, extensive experience (8 to 12 Years) as a Python Lead Developer, with a portfolio of successful projects. In-depth knowledge and hands-on experience with Python frameworks like Django, Flask, FastAPI, or others depending on the specialization. Looking for The role is for a Data Engineer who would be responsible to work independently on end-to-end data acquisition, transformation and Governance including Infra set ups in Big Data. The resource should have around 8-10 years of experience in the IT Industry with hands on development experience in Cloudera/AWS/Azure with expertise in Python, Hive, Shell scripting. Experience with RESTful APIs, web services, and containerization technologies like Docker and Kubernetes. Experience with version control systems (e.g., Git) and familiarity with CI/CD pipelines and agile methodologies. Strong proficiency with databases, including both SQL (e.g., Oracle) and NoSQL databases (e.g., MongoDB), along with an understanding of schema design. Excellent analytical and problem-solving skills to troubleshoot complex software issues and propose innovative solutions. Write clean, well-crafted, and maintainable Python code for server-side logic and backend features. Work with cross-functional teams, including UX/UI designers, AbInitio & Spark Scala developers, to integrate / migrate different application components and deliver features. Create and maintain technical documentation and specifications for software applications.