[Ocfs2-users] Backup issues

Tue Apr 3 11:37:25 PDT 2012

Hi,

I've did the --stats thing:

Number of files: 1495981
Number of files transferred: 2944
Total file size: 201701039047 bytes
Total transferred file size: 613318155 bytes
Literal data: 613292255 bytes
Matched data: 25900 bytes
File list size: 24705311
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 118692
Total bytes received: 638195567

sent 118692 bytes  received 638195567 bytes  154163.57 bytes/sec
total size is 201701039047  speedup is 315.99

This took a staggering 69 minutes, over a Gb connection, useing rsync
direcly (no ssh overhead)

To compare this, this is a similar backup, only this is an ext3
filesystem over a 100 Mbit connection, using an ssh shell:

Number of files: 6486854
Number of files transferred: 0
Total file size: 506568034168 bytes
Total transferred file size: 0 bytes
Literal data: 0 bytes
Matched data: 0 bytes
File list size: 153625912
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 335
Total bytes received: 153627330

sent 335 bytes  received 153627330 bytes  419175.08 bytes/sec
total size is 506568034168  speedup is 3297.38
Total backup took 368 seconds.
Rsync took 368 seconds.

(I left the -q switch in this the first time... oeps, so this is the
second run. It took 1315 seconds (21 minutes) the first time,
transferring about 10.000 files).

Any ideas?

Kind regards,

Dirk

Op 3-4-2012 11:26, Eduardo Diaz - Gmail schreef:
> For backup I use a local copy using tar, but I use rsync too.
>
> I don't compare but if you send any stadistics about rsync we can said
> more information.
>
> use rsync **--stats
>
> I don't note difernt speed, but did you make a full rsync, and show
> --progress for see that file it is going at what speed?
>
> regards
> **
>
> On Mon, Apr 2, 2012 at 9:04 PM, Dirk Bonenkamp - ProActive
> <dirk at proactive.nl <mailto:dirk at proactive.nl>> wrote:
>
>     Hi All,
>
>     I'm currently testing a OCFS2 set-up, and I'm having issues with
>     creating backups.
>
>     I have a 2 node cluster, running OCFS2 on a dual primary DRBD device.
>
>     The file system is 3.7Tb of which 211 Gb is used: about 1.5 million
>     files in 95 directories.
>
>     Everything works fine, except for the backups, which are taking
>     way more
>     time than on 'regular' file systems.
>
>     I'm using rsync for my backups. When I rsync the file system
>     above, this
>     takes more than an hour, without any modifications to the file system.
>
>     Network / disk speed is good. I can rsync a 10 Gb file from the OCFS2
>     filesystem to the same backup server with just under 100 Mb/s.
>
>     I know there is some penalty to be expected from a clustered file
>     system, but this is al lot. Rsyncing an ext3 file system double
>     the size
>     (in Mb's and files) of this file system takes about 600 seconds...
>
>     Has anybody some advice on a backup strategy for me? Or some
>     tuning tips?
>
>     Thanks in advance,
>
>     Dirk
>
>     --
>     <http://www.proactive.nl>
>     T       023 - 5422299
>     F       023 - 5422728
>
>     www.proactive.nl <http://www.proactive.nl> <http://www.proactive.nl>
>
>
>
>     _______________________________________________
>     Ocfs2-users mailing list
>     Ocfs2-users at oss.oracle.com <mailto:Ocfs2-users at oss.oracle.com>
>     http://oss.oracle.com/mailman/listinfo/ocfs2-users
>
>

-- 
<http://www.proactive.nl>
T 	023 - 5422299
F 	023 - 5422728

www.proactive.nl <http://www.proactive.nl>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20120403/64ecc520/attachment-0001.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.gif
Type: image/gif
Size: 3966 bytes
Desc: not available
Url : http://oss.oracle.com/pipermail/ocfs2-users/attachments/20120403/64ecc520/attachment-0001.gif 