Comments on: Multicast your DB backups with UDPCast http://kylecordes.com/2008/multicast-your-db-backups-with-udpcast Software, Business, and Life Tue, 20 Dec 2011 16:22:18 +0000 hourly 1 http://wordpress.org/?v=3.2.1 By: Kyle Cordes http://kylecordes.com/2008/multicast-your-db-backups-with-udpcast/comment-page-1#comment-27057 Kyle Cordes Mon, 27 Oct 2008 02:32:46 +0000 http://kylecordes.com/?p=192#comment-27057 An update: I tested several approaches, looking for the best performance shipping a Postgres backup from one machine to several others. The best I found was to use the pg_dump -Z0 option (no PG compression of the backup), then install lzop (apt-get install lzop), a very fast compression tool. The sending command looks like this: pg_dump -Fc -Z0 dbnameonserver1 | udp-sender --min-wait 5 --nokbd --pipe lzop and on the receiving end: udp-receiver --nokbd | lzop -d | pg_restore -Fc -v -O -x -d dbnameonserverN lzop doesn't compress quite as well as gzip, but uses much less CPU. It's probably not worth compressing at all over gigabit ethernet, but it is worthwhile over a 100mbit ethernet between fast servers. An update: I tested several approaches, looking for the best performance shipping a Postgres backup from one machine to several others. The best I found was to use the pg_dump -Z0 option (no PG compression of the backup), then install lzop (apt-get install lzop), a very fast compression tool. The sending command looks like this:

pg_dump -Fc -Z0 dbnameonserver1 | udp-sender –min-wait 5 –nokbd –pipe lzop

and on the receiving end:

udp-receiver –nokbd | lzop -d | pg_restore -Fc -v -O -x -d dbnameonserverN

lzop doesn’t compress quite as well as gzip, but uses much less CPU. It’s probably not worth compressing at all over gigabit ethernet, but it is worthwhile over a 100mbit ethernet between fast servers.

]]>