Web Scraping

Scraping Medium Stories with Selenium

How to extract data from Medium Search results

Image for post
Image for post
photo by Nathan da Silva on Unsplash

1. Prerequisites

2.Introduction of Selenium

Image for post
Image for post
Credit: w3schools

3. Getting Started with Selenium

Image for post
Image for post

4. Interact with elements within the page

Image for post
Image for post
Image for post
Image for post
Image for post
Image for post
Image for post
Image for post

5. Create DataFrame and export it into CSV file

Image for post
Image for post
Image for post
Image for post

Final thoughts:

Written by

I am a Data Science student and a Traveller enthusiast | I learn something new everyday | https://www.linkedin.com/in/eugenia-anello-545711146

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store