Comments on: Distributed Ruby Workers on EC2 http://www.igvita.com/2007/05/15/distributed-ruby-workers-on-ec2/ A goal is a dream with a deadline. Thu, 20 Nov 2008 22:41:25 +0000 http://wordpress.org/?v=2.5.1 By: Ilya Grigorik http://www.igvita.com/2007/05/15/distributed-ruby-workers-on-ec2/#comment-101673 Ilya Grigorik Thu, 28 Feb 2008 02:50:47 +0000 http://www.igvita.com/blog/2007/05/15/distributed-ruby-workers-on-ec2/#comment-101673 Josh, I've been hearing nothing but great things about the latest BackgrounDRb release. I haven't tried it myself yet, but it's definitely at the top of my list. Ari, thanks for the heads up on ProcessorPool, looks like a nifty gem! Josh, I’ve been hearing nothing but great things about the latest BackgrounDRb release. I haven’t tried it myself yet, but it’s definitely at the top of my list.

Ari, thanks for the heads up on ProcessorPool, looks like a nifty gem!

]]> By: Ari http://www.igvita.com/2007/05/15/distributed-ruby-workers-on-ec2/#comment-101651 Ari Tue, 26 Feb 2008 00:04:51 +0000 http://www.igvita.com/blog/2007/05/15/distributed-ruby-workers-on-ec2/#comment-101651 For running specific tasks remotely on EC2, you should check out the ProcessorPool gem: http://blog.citrusbyte.com/2008/2/20/effortlessly-farm-work-to-an-ec2-instance-without-batting-an-eye We moved away from BackgroundDrb for the bugginess specifically and just fork our heavy processes now to EC2 using the gem. For running specific tasks remotely on EC2, you should check out the ProcessorPool gem:

http://blog.citrusbyte.com/2008/2/20/effortlessly-farm-work-to-an-ec2-instance-without-batting-an-eye

We moved away from BackgroundDrb for the bugginess specifically and just fork our heavy processes now to EC2 using the gem.

]]> By: Josh Adams http://www.igvita.com/2007/05/15/distributed-ruby-workers-on-ec2/#comment-101606 Josh Adams Wed, 20 Feb 2008 21:18:27 +0000 http://www.igvita.com/blog/2007/05/15/distributed-ruby-workers-on-ec2/#comment-101606 I can back up that BackgrounDRb has plenty of issues in deployment - I regularly have to maintain an instance on one of our apps. Having said that, it was recently rewritten through a remote session on one of my friends' machines (we discovered a bug in its TCP/IP packet handling on OS X, oddly). Anyway, I haven't used the latest rewrite in production, so I can't speak for it... I can back up that BackgrounDRb has plenty of issues in deployment - I regularly have to maintain an instance on one of our apps. Having said that, it was recently rewritten through a remote session on one of my friends’ machines (we discovered a bug in its TCP/IP packet handling on OS X, oddly).

Anyway, I haven’t used the latest rewrite in production, so I can’t speak for it…

]]> By: Ruby on Grids at Bleeding Edge Biotech http://www.igvita.com/2007/05/15/distributed-ruby-workers-on-ec2/#comment-53325 Ruby on Grids at Bleeding Edge Biotech Fri, 20 Jul 2007 04:40:05 +0000 http://www.igvita.com/blog/2007/05/15/distributed-ruby-workers-on-ec2/#comment-53325 [...] Multicore Hardware and the Future of Ruby Multi-core hysteria and the thread confusion News for Week 25/2007 Distributed Ruby Workers on EC2 [...] [...] Multicore Hardware and the Future of Ruby Multi-core hysteria and the thread confusion News for Week 25/2007 Distributed Ruby Workers on EC2 [...]

]]> By: award tour » Drb on EC2 http://www.igvita.com/2007/05/15/distributed-ruby-workers-on-ec2/#comment-40159 award tour » Drb on EC2 Mon, 28 May 2007 19:51:36 +0000 http://www.igvita.com/blog/2007/05/15/distributed-ruby-workers-on-ec2/#comment-40159 [...] Distributed Ruby Workers on EC2 - igvita.com. a quick how-to. [...] [...] Distributed Ruby Workers on EC2 - igvita.com. a quick how-to. [...]

]]> By: links for 2007-05-18 « It’s Not Rocket Surgery http://www.igvita.com/2007/05/15/distributed-ruby-workers-on-ec2/#comment-38696 links for 2007-05-18 « It’s Not Rocket Surgery Fri, 18 May 2007 20:23:51 +0000 http://www.igvita.com/blog/2007/05/15/distributed-ruby-workers-on-ec2/#comment-38696 [...] Distributed Ruby Workers on EC2 - igvita.com [...] [...] Distributed Ruby Workers on EC2 - igvita.com [...]

]]> By: Ilya Grigorik http://www.igvita.com/2007/05/15/distributed-ruby-workers-on-ec2/#comment-38253 Ilya Grigorik Wed, 16 May 2007 14:27:20 +0000 http://www.igvita.com/blog/2007/05/15/distributed-ruby-workers-on-ec2/#comment-38253 gnufied, no I haven't used it in a live production system yet. Having said that, I will be rolling out an application very soon which is relying on this combination. I've been stress testing EC2/BackgrounDRb for some time now without any problems - I have a feeling that it may be task dependent. I'm using EC2 to perform relatively short, but very CPU/Bandwidth intensive tasks. It could be that I'm simply not encountering the conditions you described. gnufied, no I haven’t used it in a live production system yet. Having said that, I will be rolling out an application very soon which is relying on this combination. I’ve been stress testing EC2/BackgrounDRb for some time now without any problems - I have a feeling that it may be task dependent.

I’m using EC2 to perform relatively short, but very CPU/Bandwidth intensive tasks. It could be that I’m simply not encountering the conditions you described.

]]> By: Morning Brew #2 http://www.igvita.com/2007/05/15/distributed-ruby-workers-on-ec2/#comment-38248 Morning Brew #2 Wed, 16 May 2007 13:37:32 +0000 http://www.igvita.com/blog/2007/05/15/distributed-ruby-workers-on-ec2/#comment-38248 [...] Distributed Ruby Workers on EC2. [...] [...] Distributed Ruby Workers on EC2. [...]

]]> By: gnufied http://www.igvita.com/2007/05/15/distributed-ruby-workers-on-ec2/#comment-38082 gnufied Tue, 15 May 2007 13:56:51 +0000 http://www.igvita.com/blog/2007/05/15/distributed-ruby-workers-on-ec2/#comment-38082 Did you actually use BackgrounDrb in a production environment over a long period, for anything critical? Its pretty buggy for long running jobs. Exception aren't often raised in workers. Workers running at long intervals doesn't run and miss cycles, you get corrupted result hash. Did you actually use BackgrounDrb in a production environment over a long period, for anything critical?

Its pretty buggy for long running jobs. Exception aren’t often raised in workers. Workers running at long intervals doesn’t run and miss cycles, you get corrupted result hash.

]]>