Technical stack


All the libraries and frameworks used to develop and make Open Scraper functional are 100% open source.

We encourage you to discover all those great frameworks, and we would like to thank and applaude all the contributors involved in those projects without whom we wouldn't have been able to make Open Scraper possible.


server-side

"Python is a programming language that lets you work quickly and integrate systems more effectively."

Open Scraper uses Python as the backend language
Discover Python

"Tornado is a Python web framework and asynchronous networking library, originally developed at FriendFeed. By using non-blocking network I/O, Tornado can scale to tens of thousands of open connections, making it ideal for long polling, WebSockets, and other applications that require a long-lived connection to each user."

Open Scraper uses Tornado as its web server
Discover Tornado

scraping

"An open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way."

Open Scraper uses Scrapy as its primary framework for scraping
Discover Scrapy

"Through Selenium Python API you can access all functionalities of Selenium WebDriver in an intuitive way."

Open Scraper uses Selenium Python as its secondary framework for scraping
Discover Selenium Python

database

"MongoDB is a document database with the scalability and flexibility that you want with the querying and indexing that you need"

Open Scraper uses MongoDB as its database
Discover MongoDB

styling and visualisation

"Simple yet flexible JavaScript charting for designers & developers"

Open Scraper uses Chartjs for data visualisation
Discover Chart.js

"Bulma is an open source CSS framework based on Flexbox and used by more than 100,000 developers"

Open Scraper uses Bulma as its CSS framework
Discover Bulma