RAA - webfetcher

webfetcher / 0.5.5

Short description: WebFetcher
Category: Library/WWW
Status: working, not fully tested
Created: 2001-11-02 10:25:36 GMT
Last update: 2004-07-08 15:19:40 GMT
Owner: Niklas Frykholm (Projects of this owner)
Homepage: http://www.acc.umu.se/~r2d2/programming/ruby/webfetcher/
Download: http://www.acc.umu.se/~r2d2/programming/ruby/webfetcher/webfetcher-0.5.5.tar.gz
License: Ruby's
Dependency:
None
Description:

WebFetcher is a module designed to facilitate fetching large ammounts of documents and images from the web. With WebFetcher it is easy to do such things as downloading all the images on a page. You can also do more complex tasks, such as fetching all the pages linked to by a certain page and all the images on those pages. You can save the documents in a tree structure mirroring the server layout or flat in a single directory. In either case, WebFetcher can translate the links on the pages so that all relationships are preserved.

version 0.5.5 adds bug fixes for ruby 1.8.1 and better URL handling contributed by Xiangrong Fang.

Versions: [0.5.5 (2004-07-08)] [0.5.2 (2001-11-02)]

Edit this project (for project owner)

back to RAA top