Comments for Jason's .plan http://blogs.digitar.com/jjww thoughts & musings Thu, 18 Mar 2010 22:48:09 -0700 http://wordpress.org/?v=2.9.2 hourly 1 Comment on Cloud-scale DBs in the cloud…just a quickie by Jason http://blogs.digitar.com/jjww/2010/03/cloud-scale-dbs-in-the-cloud-just-a-quickie/comment-page-1/#comment-14749 Jason Thu, 18 Mar 2010 22:48:09 +0000 http://blogs.digitar.com/jjww/?p=134#comment-14749 The question is, how do you get 11TB of highly available database. And as noted in the article, the servers used at the cloud provider were dedicated servers not cloud VMs per se. If you have a large dataset, something like Cassandra will cost you disproportionally more money than using MySQL vertically scaled and then partitioned (when deployed at a cloud provider). Alternately, you could vertically scale and use 3 beefy Cassandra nodes, but that obviates the point of the architecture. My real goal with this posting was to get cloud providers to realize they've got to cut the costs on their 1U servers if things like Cassandra are going to be affordable when deployed in the cloud with multi-TB datasets. The 1U costs are way out of line with what the same cloud provider charges for the beefier box. If you bundle colo space/power/bandwidth into the costs of the 1U and 4U servers deployed on your own you're still at a 1/5 ratio for 1Us vs 1/11 ratio for 4Us (ratio being calculated as (cost per month at cloud provider/cost of hardware itself plus colo/power/bandwidth). Ideally, 1U or 4U beefy the ratio would be the same. The question is, how do you get 11TB of highly available database. And as noted in the article, the servers used at the cloud provider were dedicated servers not cloud VMs per se. If you have a large dataset, something like Cassandra will cost you disproportionally more money than using MySQL vertically scaled and then partitioned (when deployed at a cloud provider). Alternately, you could vertically scale and use 3 beefy Cassandra nodes, but that obviates the point of the architecture.

My real goal with this posting was to get cloud providers to realize they’ve got to cut the costs on their 1U servers if things like Cassandra are going to be affordable when deployed in the cloud with multi-TB datasets. The 1U costs are way out of line with what the same cloud provider charges for the beefier box. If you bundle colo space/power/bandwidth into the costs of the 1U and 4U servers deployed on your own you’re still at a 1/5 ratio for 1Us vs 1/11 ratio for 4Us (ratio being calculated as (cost per month at cloud provider/cost of hardware itself plus colo/power/bandwidth). Ideally, 1U or 4U beefy the ratio would be the same.

]]> Comment on Cloud-scale DBs in the cloud…just a quickie by Jonathan Ellis http://blogs.digitar.com/jjww/2010/03/cloud-scale-dbs-in-the-cloud-just-a-quickie/comment-page-1/#comment-14746 Jonathan Ellis Thu, 18 Mar 2010 16:12:32 +0000 http://blogs.digitar.com/jjww/?p=134#comment-14746 You're not getting apples to apples here. The amount of disk is similar but you have an order of magnitude more CPU and RAM in the scale-out hardware, which is huge for many workloads. That said, I also blogged recently about why cloud VMs aren't usually the right fit vs bare metal. You’re not getting apples to apples here. The amount of disk is similar but you have an order of magnitude more CPU and RAM in the scale-out hardware, which is huge for many workloads.

That said, I also blogged recently about why cloud VMs aren’t usually the right fit vs bare metal.

]]> Comment on Rabbits and warrens. by Jason http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/comment-page-1/#comment-14195 Jason Tue, 02 Mar 2010 19:33:32 +0000 http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/#comment-14195 Hi Hackeron. The embedded download links still work for me. Hi Hackeron. The embedded download links still work for me.

]]> Comment on Rabbits and warrens. by Jason http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/comment-page-1/#comment-14194 Jason Tue, 02 Mar 2010 19:32:37 +0000 http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/#comment-14194 Very cool! Thanks Jeffrey! Very cool! Thanks Jeffrey!

]]> Comment on Rabbits and warrens. by Jason http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/comment-page-1/#comment-14193 Jason Tue, 02 Mar 2010 19:31:57 +0000 http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/#comment-14193 Hi Bart. E-mail me and I'll try and see if there's a problem with the code: williamsjj at digitar dot com Hi Bart. E-mail me and I’ll try and see if there’s a problem with the code: williamsjj at digitar dot com

]]> Comment on Rabbits and warrens. by Hackeron http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/comment-page-1/#comment-13789 Hackeron Thu, 18 Feb 2010 03:06:22 +0000 http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/#comment-13789 Can someone post the consumer.py and publisher.py files again somewhere? Can someone post the consumer.py and publisher.py files again somewhere?

]]> Comment on Rabbits and warrens. by Tumulous Times with Tornado « yP! http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/comment-page-1/#comment-12917 Tumulous Times with Tornado « yP! Tue, 19 Jan 2010 19:17:39 +0000 http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/#comment-12917 [...] the excellent RabbitMQ for handling a number of asynchronous jobs (great instructions for Python here), it seemed like a good idea to bring that messaging technology forward for the user’s [...] [...] the excellent RabbitMQ for handling a number of asynchronous jobs (great instructions for Python here), it seemed like a good idea to bring that messaging technology forward for the user’s [...]

]]> Comment on Rabbits and warrens. by sendmail ? thread http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/comment-page-1/#comment-12797 sendmail ? thread Sat, 09 Jan 2010 11:13:07 +0000 http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/#comment-12797 [...] http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/ [...] [...] http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/ [...]

]]> Comment on OpenSolaris & SMF adventures with PowerDNS by links for 2009-06-28 | blog/shl@INTERDOSE http://blogs.digitar.com/jjww/2007/02/opensolaris-smf-adventures-with-powerdns/comment-page-1/#comment-12248 links for 2009-06-28 | blog/shl@INTERDOSE Tue, 22 Dec 2009 12:01:30 +0000 #comment-12248 [...] OpenSolaris & SMF adventures with PowerDNS – Jason’s .plan (tags: opensolaris network solaris) [...] [...] OpenSolaris & SMF adventures with PowerDNS – Jason’s .plan (tags: opensolaris network solaris) [...]

]]> Comment on Rabbits and warrens. by Jeffrey04 http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/comment-page-1/#comment-11560 Jeffrey04 Tue, 01 Dec 2009 06:15:03 +0000 http://blogs.digitar.com/jjww/2009/01/rabbits-and-warrens/#comment-11560 thanks, ported your code to php using php-rabbit library :D http://pastebin.com/f1c4f71e6 http://pastebin.com/f11210548 thanks, ported your code to php using php-rabbit library :D

http://pastebin.com/f1c4f71e6
http://pastebin.com/f11210548

]]>