A web scraper application that fetches some specified set of data from one of my favorite JavaScript tutorial websites (https://javascript.info). Built with Ruby and Nokogiri Gem.
This project aims to develop a Web Scraper using Ruby. It is a capstone project that marks the completion of Ruby module in Microverse technical curriculum. The full project specification can be found here.
To get a local copy up and running follow these simple steps.
git clone
, and then paste the URL you copied in Step 3.$ git clone https://github.com/teekaytech/Scraper.git
Please Note that you must have github installed on your PC, this can be done here.
Since all the code is written using ruby, Ruby Runtime >= 1.9
is required to interpret the code. If you don't have ruby runtime already setup on your computer, follow the instruction for your specific operating system on the official installation guide. Internet Connection is a must, for successful scraping
After cloning on your computer, open the folder using your terminal/command prompt window and run
bin/main.rb
Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites. Web scraping software may access the World Wide Web directly using the Hypertext Transfer Protocol, or through a web browser. read-more.
I chose to scrape this website because this resource have been important to my personal development before my microverse days. I love the way in which the tutorials are structured and it really helped me during my coding challenges in the application process. Right now, I still visit the website and I believe this scraper will be a major player to my development when I get to JavaScript Module.
bin/main.rb
), the app instructs the user to choose from the displayed options.Note: The app requires internet connection for successful scraping!
RSpec gem was used for the automated testing. To run the test cases,
rspec
on the terminal and press the enter button.👤 Taofeek Olalere
Contributions, issues and feature requests are welcome!
Give a ⭐️ if you like this project.
This project is MIT licensed.