RAA - rq/0.1.7

rq / 0.1.7

Short description: clustering software based on nfs mounted priority work queues
Category: Application/Cluster
Status: beta
Created: 2004-08-13 22:53:19 GMT
Last update: 2004-11-01 18:55:07 GMT
Owner: ahoward (Projects of this owner)
Homepage: http://www.codeforpeople.com/lib/ruby/nfsstore/
Download: http://www.codeforpeople.com/lib/ruby/nfsstore/
License: Ruby's
Dependency:
Requires: arrayfields/3.4.0 keyword access to arrays
Requires: sqlite-ruby/1.3.1(+) jamis buck's fantastic sqlite interface
Requires: lockfile/1.2.0(*) bulletproof nfs safe lockfiles
Requires: posixlock/0.0.1 posix (nfs safe) locking (c ext for fcntl locks)
Requires: sqlite/2.8.15 SQLite is a small C library that implements a self-contained, embeddable, zero-configuration SQL database engine.
(*): newer version exists
(+): no such version
Description:

ruby queue (rq) is a tool used to create instant linux clusters by managing sqlite databases as nfs mounted priority work queues. multiple instances of rq running from multiples hosts can work from these queues to distribute processing load to n nodes - bringing many dozens of otherwise powerful cpus to their knees with a single blow. clearly this software should be kept out of the hands of free radicals, seti enthusiasts, and j. safran.

the central concept of rq is that n nodes work in isolation to pull jobs from an central nfs mounted work priority work queue in a synchronized fashion. the nodes have absolutely no knowledge of each other and all communication if done via the queue meaning that, so long as the queue is available via nfs and a single node is running jobs from it, the system will continue to process jobs. there is no centralized process whatsoever - all nodes work to take jobs from the queue and run them as fast as possible. this creates a system which load balances automatically and is robus

Versions: [2.1.0 (2005-02-16)] [1.0.0 (2004-11-10)] [0.1.7 (2004-11-01)] [0.1.3 (2004-09-05)] [0.1.2 (2004-08-13)]

Edit this project (for project owner)

back to RAA top