Scraping job offers from Glassdoor

How to find data scientist’s positions using Octoparse

Photo by Thought Catalog on Unsplash

If you are looking for a new data science role, it can be tiring to check manually the new positions on many different websites, like LinkedIn, Indeed and Glassdoor.

But, why should we suffer while finding jobs? Can we transform it into funny research? In this post, I am going to show how to scrape the data from one of the widely used websites for job search abroad, Glassdoor.

Glassdoor doesn’t only provide job positions, but also salary information, reviews regarding the company and the typical interview questions.

This task will be possible using Octoparse, a software with a user-friendly interface that enables web scraping without using any programming language.

Table of Content:

1. Intro to Octoparse
2. Download Octoparse
3. Create the Scraping Task
4. Create Loop item with Partial Scroll

1. Intro to Octoparse

Octoparse is a free web scraping software able to fetch data from websites in an automated way. It’s adapted for people that come from all backgrounds and don’t require programming knowledge. Anyone can extract the data by…