COIMBATORE · FULLTIME
Python Data Extraction Engineer
Vserve Ebusiness Solutions
Coimbatore · onsite · Posted 20d ago
Sourced from
Undisclosed3–7 yrsfulltimeCoimbatore
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.2s
- Found the form on Naukri · 7 questions to answer1.7s
- Decided the answers for all of them2.4s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
We are building a data intelligence platform that looks to analyze fragmented public information into structured, actionable business data.
We are looking for a strong Python Data Extraction Engineer who can discover, extract, clean, normalize and integrate data from government portals, public websites, PDFs, APIs and other open data sources.
This is not a conventional application-development role. The ideal candidate enjoys solving difficult data-acquisition problems involving poorly structured websites, inconsistent government portals, changing schemas, PDFs, JavaScript-rendered pages and large volumes of semi-structured information.
What You Will Own
You will build and maintain the data-acquisition layer of the platform.
Key responsibilities include:
We are looking for a strong Python Data Extraction Engineer who can discover, extract, clean, normalize and integrate data from government portals, public websites, PDFs, APIs and other open data sources.
This is not a conventional application-development role. The ideal candidate enjoys solving difficult data-acquisition problems involving poorly structured websites, inconsistent government portals, changing schemas, PDFs, JavaScript-rendered pages and large volumes of semi-structured information.
What You Will Own
You will build and maintain the data-acquisition layer of the platform.
Key responsibilities include:
Identify and evaluate government and public data sources relevant to property, businesses and commercial activity.
Build Python-based crawlers and extraction pipelines for government portals and public websites.
Extract structured information from HTML pages, tables, PDFs, downloadable files and publicly accessible APIs.
Work with JavaScript-rendered websites and multi-step public search interfaces.
Automate recurring extraction from multiple sources while respecting applicable access rules, rate limits, and terms.
Clean, standardize and normalize inconsistent data from different government authorities.
Perform entity matching and record linkage across datasets using fields such as owner name, company name, address, survey number, coordinates and project information.
Develop mechanisms to detect website/schema changes and extraction failures.
Build validation and QA processes to measure completeness and accuracy.
Store extracted information in structured databases and expose clean datasets to downstream applications.
Work closely with GIS, product and engineering teams to combine location-based signals with government/public records.
Research new public and open-data sources that can improve the accuracy and completeness of our intelligence.
Examples of Data Sources
The work may involve sources such as:
The work may involve sources such as:
Municipal corporation portals
State planning and development authorities
DTCP and similar planning authorities
RERA databases
Building and planning permission records
Land and property records
Tender and procurement portals
Company/business registries
Government open-data portals
Environmental and regulatory approvals
Public notices and downloadable government documents
Maps and geospatial datasets
Other legally accessible public and open-source information
Required Technical Skills
Strong hands-on experience with:
Strong hands-on experience with:
Python
Web scraping and crawling