Introduction

Anansi is a web crawler which is designed to operate in clusters of parallel processing nodes. Originally developed as a generic web crawling framework, it is bundled with modules to support its specific use as part of the Research & Education Space.

Anansi is open source software, released under the terms of the Apache License, 2.0. The public Git repository for Anansi is hosted at Github.