Member-only story
Web Scraping with Selenium
In this article, I will explain how we can easily retrieve data from a desired website in different ways using the Selenium library in Python.
Selenium library is an API that allows almost all the operations we do in a browser. With this API, we can perform many operations such as data retrieval, page navigation, inputting inputs, and getting the properties of html blocks. However, a WebDriver is needed to use Selenium. This WebDriver allows the automation of most operations that can be done in any browser installed on your computer. It supports many browsers such as Firefox, Google Chrome, Opera, Microsoft Edge.
I will use Google Chrome’s WebDriver for data extraction. Let’s follow the steps below to download this WebDriver.
- For Chrome: You need to download the driver suitable for your version from https://chromedriver.storage.googleapis.com/index.html.
**(To find out the version: Chrome > Help > About Chrome)
**(I was using version 103.0.5060.66 while writing this article, so I downloaded version 103.0.5060.53 of the driver.)
