Comments on: Drizzle Replication – The Command Message http://www.joinfu.com/2009/08/drizzle-replication-the-command-message/ the art of sql Thu, 09 Sep 2010 03:38:00 -0400 http://wordpress.org/?v=2.9.2 hourly 1 By: louis vuitton for sale http://www.joinfu.com/2009/08/drizzle-replication-the-command-message/comment-page-1/#comment-215682 louis vuitton for sale Fri, 09 Jul 2010 08:52:00 +0000 http://joinfu.com/2009/08/drizzle-replication--the-command-message#comment-215682 "Here <a href="http://www.air-jordan-21.net" >air jordan 21</a> products xx, has fashion model, superior quality and service, cheap price and updates quickly.I support strongly always! I want to buy XX, I hesitate to select which style more better.Hope your unique recommends. " “Here air jordan 21 products xx, has fashion model, superior quality and service, cheap price and updates quickly.I support strongly always! I want to buy XX, I hesitate to select which style more better.Hope your unique recommends.
“

]]> By: Siddharth Prakash Singh http://www.joinfu.com/2009/08/drizzle-replication-the-command-message/comment-page-1/#comment-215457 Siddharth Prakash Singh Tue, 30 Mar 2010 22:39:13 +0000 http://joinfu.com/2009/08/drizzle-replication--the-command-message#comment-215457 Link in the Update section is broken. Link in the Update section is broken.

]]> By: Siddharth Prakash Singh http://www.joinfu.com/2009/08/drizzle-replication-the-command-message/comment-page-1/#comment-215683 Siddharth Prakash Singh Tue, 30 Mar 2010 21:39:00 +0000 http://joinfu.com/2009/08/drizzle-replication--the-command-message#comment-215683 Link in the Update section is broken. Link in the Update section is broken.

]]> By: Recent Work on Improving Drizzle’s Storage Engine API « join-fu! http://www.joinfu.com/2009/08/drizzle-replication-the-command-message/comment-page-1/#comment-215313 Recent Work on Improving Drizzle’s Storage Engine API « join-fu! Sat, 13 Mar 2010 07:08:06 +0000 http://joinfu.com/2009/08/drizzle-replication--the-command-message#comment-215313 [...] log was called the Command Log, because the Google Protobuffer messages it contained were called message::Commands.  The API  for implementing replication plugins was very simple and within a month or so of [...] [...] log was called the Command Log, because the Google Protobuffer messages it contained were called message::Commands.  The API  for implementing replication plugins was very simple and within a month or so of [...]

]]> By: Drizzle Replication – The CommandReplicator and CommandApplier Plugin API « join-fu! http://www.joinfu.com/2009/08/drizzle-replication-the-command-message/comment-page-1/#comment-215310 Drizzle Replication – The CommandReplicator and CommandApplier Plugin API « join-fu! Sat, 13 Mar 2010 04:14:59 +0000 http://joinfu.com/2009/08/drizzle-replication--the-command-message#comment-215310 [...] be joinfu? « Drizzle Replication – The Command Message Pop Quiz – What Does REPLACE Do? [...] [...] be joinfu? « Drizzle Replication – The Command Message Pop Quiz – What Does REPLACE Do? [...]

]]> By: Robert Hodges http://www.joinfu.com/2009/08/drizzle-replication-the-command-message/comment-page-1/#comment-186113 Robert Hodges Fri, 14 Aug 2009 00:35:04 +0000 http://joinfu.com/2009/08/drizzle-replication--the-command-message#comment-186113 Thanks Jay. I'm looking forward to more articles as well as a solid drink from the Drizzle fire hose with your team next week. Thanks Jay. I’m looking forward to more articles as well as a solid drink from the Drizzle fire hose with your team next week.

]]> By: Jay Pipes http://www.joinfu.com/2009/08/drizzle-replication-the-command-message/comment-page-1/#comment-186110 Jay Pipes Thu, 13 Aug 2009 19:06:42 +0000 http://joinfu.com/2009/08/drizzle-replication--the-command-message#comment-186110 "This is a great intro to programming with Command Message classes. One question--will your future posts cover the high-level message workflow?" Yep, the very next article describes the flow of the Command message through the system. "For instance, does a replicator plug-in get Command messages in the order they are logged or all at once at commit time?" One at a time, in the order in which they are executed on the server. It is up to the author of some semi-or-full synchronous replication module to "wrangle" Command messages into a Transaction message (I'll explain that in a later article, too) :) "One of the virtues of the MySQL binlog is that it provides transactions in serial order, which makes it far easier to process than reading a "real" log like Oracle redo logs or the PostgreSQL WAL." Wait until the 3rd article (on the command log) for this :) Cheers, and see you next week! Jay “This is a great intro to programming with Command Message classes. One question–will your future posts cover the high-level message workflow?”

Yep, the very next article describes the flow of the Command message through the system.

“For instance, does a replicator plug-in get Command messages in the order they are logged or all at once at commit time?”

One at a time, in the order in which they are executed on the server. It is up to the author of some semi-or-full synchronous replication module to “wrangle” Command messages into a Transaction message (I’ll explain that in a later article, too) :)

“One of the virtues of the MySQL binlog is that it provides transactions in serial order, which makes it far easier to process than reading a “real” log like Oracle redo logs or the PostgreSQL WAL.”

Wait until the 3rd article (on the command log) for this :)

Cheers, and see you next week!

Jay

]]> By: Jay Pipes http://www.joinfu.com/2009/08/drizzle-replication-the-command-message/comment-page-1/#comment-186109 Jay Pipes Thu, 13 Aug 2009 18:55:13 +0000 http://joinfu.com/2009/08/drizzle-replication--the-command-message#comment-186109 "Can you back up a bit and explain what how it's supposed to function, so that I can relate that to the mechanics of it." All in due time :) I'm writing the series of articles in a way that should allow folks to really understand the guts of the replication system in a systematic manner, so this was just a starter article to familiarize readers with the concepts of Google Protobuffers and the Command message which is logged and passed around in the new replication system. "Is it a P2P type of arrangement, or Master/Slave('s)?" The new replication system is designed to be extremely flexible and modular. I am working on a module called "async_replication" which will be the default replication system and will behave similarly to MySQL's master/slave model. Lots more information to come on that. Keep in mind, it is very early in development, and literally as I write code for the module, I'll be writing articles about it and explaining design choices asking for input, suggestions, and criticism on the code. "Can you set up a cluster of Drizzle servers for load balancing, and backup?" This is not currently in the scope of my work, but there's no reason at all such features cannot be written as either external programs/scripts, or modules for Drizzle. "If a server is offline, will it automatically synchronise when it's back online? What if the master fails?" There is work going on to design hot-standby/failover, yes. I wouldn't expect it to hit the trees for a few months, though. Cheers! Jay “Can you back up a bit and explain what how it’s supposed to function, so that I can relate that to the mechanics of it.”

All in due time :) I’m writing the series of articles in a way that should allow folks to really understand the guts of the replication system in a systematic manner, so this was just a starter article to familiarize readers with the concepts of Google Protobuffers and the Command message which is logged and passed around in the new replication system.

“Is it a P2P type of arrangement, or Master/Slave(’s)?”

The new replication system is designed to be extremely flexible and modular. I am working on a module called “async_replication” which will be the default replication system and will behave similarly to MySQL’s master/slave model. Lots more information to come on that. Keep in mind, it is very early in development, and literally as I write code for the module, I’ll be writing articles about it and explaining design choices asking for input, suggestions, and criticism on the code.

“Can you set up a cluster of Drizzle servers for load balancing, and backup?”

This is not currently in the scope of my work, but there’s no reason at all such features cannot be written as either external programs/scripts, or modules for Drizzle.

“If a server is offline, will it automatically synchronise when it’s back online? What if the master fails?”

There is work going on to design hot-standby/failover, yes. I wouldn’t expect it to hit the trees for a few months, though.

Cheers!

Jay

]]> By: Robert Hodges http://www.joinfu.com/2009/08/drizzle-replication-the-command-message/comment-page-1/#comment-186107 Robert Hodges Thu, 13 Aug 2009 18:09:34 +0000 http://joinfu.com/2009/08/drizzle-replication--the-command-message#comment-186107 This is a great intro to programming with Command Message classes. One question--will your future posts cover the high-level message workflow? For instance, does a replicator plug-in get Command messages in the order they are logged or all at once at commit time? One of the virtues of the MySQL binlog is that it provides transactions in serial order, which makes it far easier to process than reading a "real" log like Oracle redo logs or the PostgreSQL WAL. This is a great intro to programming with Command Message classes. One question–will your future posts cover the high-level message workflow? For instance, does a replicator plug-in get Command messages in the order they are logged or all at once at commit time? One of the virtues of the MySQL binlog is that it provides transactions in serial order, which makes it far easier to process than reading a “real” log like Oracle redo logs or the PostgreSQL WAL.

]]> By: Bill http://www.joinfu.com/2009/08/drizzle-replication-the-command-message/comment-page-1/#comment-186105 Bill Thu, 13 Aug 2009 14:15:10 +0000 http://joinfu.com/2009/08/drizzle-replication--the-command-message#comment-186105 I understand that this is a foundational article, so its sorta light on the overall explanation. But its great to hear a decent sized project is using protocol buffers. It just makes it that much easier to justify using it in other projects, instead of hacking together an in house solution. I understand that this is a foundational article, so its sorta light on the overall explanation. But its great to hear a decent sized project is using protocol buffers. It just makes it that much easier to justify using it in other projects, instead of hacking together an in house solution.

]]>