documentcloud / cloud-crowd

Parallel Processing for the Rest of Us

Home Page:https://github.com/documentcloud/cloud-crowd/wiki

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

I only got 1024 for shakespeare wc

baloney opened this issue · comments

Anyone know why?
[root@xxx crowd]# crowd console
irb(main):001:0> load '~/Downloads/count_shakespeare.rb'
=> []
irb(main):002:0> CloudCrowd::Job.last.display_status
=> "succeeded"
irb(main):003:0> CloudCrowd::Job.last.time_taken
=> 27.4962
irb(main):004:0> JSON.parse CloudCrowd::Job.last.outputs
=> [1012]
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
Starting CloudCrowd Node on port 9063...

Thin web server (v1.2.11 codename Bat-Shit Crazy)
Maximum connections set to 1024
Listening on 0.0.0.0:9063, CTRL+C to stop
Worker #3475: starting unit #1 (word_count/processing)
Worker #3478: starting unit #3 (word_count/processing)
Worker #3481: starting unit #5 (word_count/processing)
Worker #3484: starting unit #7 (word_count/processing)
Worker #3487: starting unit #9 (word_count/processing)
Worker #3512: starting unit #2 (word_count/processing)
Worker #3487: finished unit #9 (word_count/processing) in 5.151717 seconds
Worker #3518: starting unit #4 (word_count/processing)
Worker #3524: starting unit #6 (word_count/processing)
Worker #3530: starting unit #8 (word_count/processing)
Worker #3536: starting unit #10 (word_count/processing)
Worker #3484: finished unit #7 (word_count/processing) in 5.205661 seconds
Worker #3478: finished unit #3 (word_count/processing) in 5.280586 seconds
Worker #3481: finished unit #5 (word_count/processing) in 5.253926 seconds
Worker #3475: finished unit #1 (word_count/processing) in 5.32947 seconds
Worker #3545: starting unit #11 (word_count/processing)
Worker #3512: finished unit #2 (word_count/processing) in 5.048194 seconds
Worker #3559: starting unit #12 (word_count/processing)
Worker #3569: starting unit #13 (word_count/processing)
Worker #3518: finished unit #4 (word_count/processing) in 5.099513 seconds
Worker #3524: finished unit #6 (word_count/processing) in 5.0611 seconds
Worker #3575: starting unit #14 (word_count/processing)
Worker #3581: starting unit #15 (word_count/processing)
Worker #3530: finished unit #8 (word_count/processing) in 5.094387 seconds
Worker #3536: finished unit #10 (word_count/processing) in 5.077729 seconds
Worker #3590: starting unit #16 (word_count/processing)
Worker #3545: finished unit #11 (word_count/processing) in 5.082832 seconds
Worker #3599: starting unit #17 (word_count/processing)
Worker #3559: finished unit #12 (word_count/processing) in 5.128716 seconds
Worker #3608: starting unit #18 (word_count/processing)
Worker #3569: finished unit #13 (word_count/processing) in 5.053837 seconds
Worker #3617: starting unit #19 (word_count/processing)
Worker #3575: finished unit #14 (word_count/processing) in 5.070532 seconds
Worker #3626: starting unit #20 (word_count/processing)
Worker #3581: finished unit #15 (word_count/processing) in 5.110265 seconds
Worker #3635: starting unit #21 (word_count/processing)
Worker #3590: finished unit #16 (word_count/processing) in 5.052478 seconds
Worker #3644: starting unit #22 (word_count/processing)
Worker #3599: finished unit #17 (word_count/processing) in 5.069817 seconds
Worker #3608: finished unit #18 (word_count/processing) in 5.048104 seconds
Worker #3617: finished unit #19 (word_count/processing) in 5.062562 seconds
Worker #3626: finished unit #20 (word_count/processing) in 5.051103 seconds
Worker #3635: finished unit #21 (word_count/processing) in 5.05036 seconds
Worker #3665: starting unit #23 (word_count/merging)
Worker #3644: finished unit #22 (word_count/processing) in 5.106753 seconds
Worker #3665: finished unit #23 (word_count/merging) in 0.003837 seconds