The client wanted job listings to be extracted from 3 job sites such as Indeed, bayt.com and Gulftalent. The data
points that the client needed were Job postings including job titles, location, wages, company profiles, Job descriptions and candidate resumes.
We set up crawlers to extract the required data fields from the list of websites provided by the client. The client wanted the data in JSON format, once the initial setup was done, we started our crawling process.