Google-Autosuggestion-Scraper

Just as the name suggests! This scraper utilizes Python Selenium, openpyxl, Pandas libraries and Firefox as its default browser.

Stars
0
Committers
2

Google Autosuggestion Scraper | Q1 Solution

Overview

This repository contains a Python script for scraping Google Autosuggestions. It was developed as part of the 4Beats INTERN TA & DevOps screening.

Author: Alina Hasan

Prerequisites

  • Python: Ensure you have Python installed on your system.
  • Firefox Browser: The script uses Firefox as the browser for automation.
  • Geckodriver: The script requires geckodriver to interface with Firefox. Ensure geckodriver is located in the same directory as the script or is in your system PATH.

Libraries

  • Selenium: For web automation and scraping.
  • openpyxl: For handling Excel files.
  • Pandas: For handling tabular data and performing operations on Excel sheets.

Setup

  1. Install Dependencies: Install the required Python libraries using pip:

    pip install selenium openpyxl pandas
    
  2. Download Geckodriver:

    • Download the appropriate version of geckodriver for your operating system from Geckodriver Releases.

      A Gecko release is available in the 'Setup' folder of this repository.

    • Place geckodriver in the same directory as the script or add it to your system PATH.

  3. Firefox Installation:

    • Ensure Firefox is installed on your system.

      A Firefox Installer is available in the 'Setup' folder of this repository.

  4. Run Script:

    • Either, open the provided Jupyter Notebook file in a Jupyter environment to run the script. The notebook demonstrates the functionality and provides instructions for use.

    • Or, run the Python file in a Python environment.

Sample

A Sample Output is provided in the 'Sample Output' folder.

Related Projects