| Short description: |
rq is a tool used to build instant linux clusters |
| Category: |
Application/Cluster |
| Status: |
release |
| Created: |
2004-08-13 22:53:19 GMT |
| Last update: |
2005-02-16 02:34:14 GMT |
| Owner: |
ahoward
(Projects of this owner) |
| Homepage: |
http://www.codeforpeople.com/lib/ruby/rq/ |
| Download: |
http://www.codeforpeople.com/lib/ruby/rq/
|
| License: |
Ruby's |
| Dependency: |
| Requires: |
arrayfields/3.4.0
|
keyword access to arrays |
| Requires: |
sqlite-ruby/1.3.1(+)
|
jamis buck's fantastic sqlite interface |
| Requires: |
lockfile/1.3.0
|
bulletproof nfs safe lockfiles |
| Requires: |
posixlock/0.0.1
|
posix (nfs safe) locking (c ext for fcntl locks) |
| Requires: |
sqlite/2.8.15
|
SQLite is a small C library that implements a self-contained, embeddable, zero-configuration SQL database engine. |
| (+): no such version |
|
| Description: |
ruby queue (rq) is a tool used to create instant linux clusters by managing sqlite databases as nfs mounted priority work queues. multiple instances of rq running from multiples hosts can work from these queues to distribute processing load to n nodes - bringing many dozens of otherwise powerful cpus to their knees with a single blow. clearly this software should be kept out of the hands of free radicals, seti enthusiasts, and j. safran.
the central concept of rq is that n nodes work in isolation to pull jobs from an central nfs mounted priority work queue in a synchronized fashion. the nodes have absolutely no knowledge of each other and all communication if done via the queue meaning that, so long as the queue is available via nfs and a single node is running jobs from it, the system will continue to process jobs. there is no centralized process whatsoever - all nodes work to take jobs from the queue and run them as fast as possible. this creates a system which load balances automatically and is robust in face of node failures.
|
| Versions: |
[2.1.0 (2005-02-16)]
[1.0.0 (2004-11-10)]
[0.1.7 (2004-11-01)]
[0.1.3 (2004-09-05)]
[0.1.2 (2004-08-13)]
|