File tree Expand file tree Collapse file tree 3 files changed +24
-0
lines changed Expand file tree Collapse file tree 3 files changed +24
-0
lines changed Original file line number Diff line number Diff line change
1
+ ## 0.8 (2010-04-24)
2
+ * added the pyres_manager and the horde module. This allows a more prefork like model for processing jobs.
3
+ * setproctitle usage. Allows better process titles when viewing via ps
4
+ * ability to delete and requeue failed items
5
+
1
6
## 0.7.5.1 (2010-03-18)
2
7
* fixed the pyres_scheduler script
3
8
* changed download link to remove v from version number
Original file line number Diff line number Diff line change
1
+ Prefork Manager
2
+ ===============
3
+
4
+ Sometimes the fork for every job method of processing can be a bit too slow and
5
+ take up too many resources. Pyres provides an alternative to the pyres_worker through
6
+ the pyres_manager script and the horde module.
7
+
8
+ The pyres_manager script is very similar to the pyres_worker. However, instead
9
+ of forking a child for every job, the manager takes advantage of the multiprocessing
10
+ module in python 2.6 (backported to 2.5 as well) and forks off a pool of children
11
+ at startup time. These children then query the redis queue and perform the necessary work.
12
+ It is the managers job to manage the pool via signals or a command queue on the redis
13
+ server.
14
+
15
+ ex::
16
+
17
+ pyres_manager --pool=5 queue_one,queue_two
18
+
Original file line number Diff line number Diff line change @@ -17,6 +17,7 @@ Contents:
17
17
class
18
18
tests
19
19
failures
20
+ horde
20
21
21
22
22
23
Indices and tables
You can’t perform that action at this time.
0 commit comments