[Ocfs2-users] Backup issues

Wed Apr 4 02:56:36 PDT 2012

Hi,

The file-system is clean, a check with -f reports no issues. Changing
the direction of rsync doesn't help much either....

I'll give this issue a try on the drdb mailing list, maybe there is
somebody on there with a similar set-up.

Regards,

Dirk
<http://www.proactive.nl>

Op 4-4-2012 1:14, Eduardo Diaz - Gmail schreef:
>  Try if are a problem of try rsync or a copy try cp and see if the
> size are difernt.
>
> try too rsyncd in the server or rsynd in the other side. "do you has
> similar results?"
>
> make a fsck of ocfs2 system for discard errors
>
>
> On Tue, Apr 3, 2012 at 8:37 PM, Dirk Bonenkamp - ProActive
> <dirk at proactive.nl <mailto:dirk at proactive.nl>> wrote:
>
>     Hi,
>
>     I've did the --stats thing:
>
>     Number of files: 1495981
>     Number of files transferred: 2944
>     Total file size: 201701039047 bytes
>     Total transferred file size: 613318155 <tel:613318155> bytes
>     Literal data: 613292255 <tel:613292255> bytes
>     Matched data: 25900 bytes
>     File list size: 24705311
>     File list generation time: 0.001 seconds
>     File list transfer time: 0.000 seconds
>     Total bytes sent: 118692
>     Total bytes received: 638195567 <tel:638195567>
>
>     sent 118692 bytes  received 638195567 <tel:638195567> bytes 
>     154163.57 bytes/sec
>     total size is 201701039047  speedup is 315.99
>
>     This took a staggering 69 minutes, over a Gb connection, useing
>     rsync direcly (no ssh overhead)
>
>     To compare this, this is a similar backup, only this is an ext3
>     filesystem over a 100 Mbit connection, using an ssh shell:
>
>     Number of files: 6486854
>     Number of files transferred: 0
>     Total file size: 506568034168 bytes
>     Total transferred file size: 0 bytes
>     Literal data: 0 bytes
>     Matched data: 0 bytes
>     File list size: 153625912
>     File list generation time: 0.001 seconds
>     File list transfer time: 0.000 seconds
>     Total bytes sent: 335
>     Total bytes received: 153627330
>
>     sent 335 bytes  received 153627330 bytes  419175.08 bytes/sec
>     total size is 506568034168  speedup is 3297.38
>     Total backup took 368 seconds.
>     Rsync took 368 seconds.
>
>     (I left the -q switch in this the first time... oeps, so this is
>     the second run. It took 1315 seconds (21 minutes) the first time,
>     transferring about 10.000 files).
>
>     Any ideas?
>
>     Kind regards,
>
>     Dirk
>
>
>     Op 3-4-2012 11:26, Eduardo Diaz - Gmail schreef:
>>     For backup I use a local copy using tar, but I use rsync too.
>>
>>     I don't compare but if you send any stadistics about rsync we can
>>     said more information.
>>
>>     use rsync **--stats
>>
>>     I don't note difernt speed, but did you make a full rsync, and
>>     show --progress for see that file it is going at what speed?
>>
>>     regards
>>     **
>>
>>     On Mon, Apr 2, 2012 at 9:04 PM, Dirk Bonenkamp - ProActive
>>     <dirk at proactive.nl <mailto:dirk at proactive.nl>> wrote:
>>
>>         Hi All,
>>
>>         I'm currently testing a OCFS2 set-up, and I'm having issues with
>>         creating backups.
>>
>>         I have a 2 node cluster, running OCFS2 on a dual primary DRBD
>>         device.
>>
>>         The file system is 3.7Tb of which 211 Gb is used: about 1.5
>>         million
>>         files in 95 directories.
>>
>>         Everything works fine, except for the backups, which are
>>         taking way more
>>         time than on 'regular' file systems.
>>
>>         I'm using rsync for my backups. When I rsync the file system
>>         above, this
>>         takes more than an hour, without any modifications to the
>>         file system.
>>
>>         Network / disk speed is good. I can rsync a 10 Gb file from
>>         the OCFS2
>>         filesystem to the same backup server with just under 100 Mb/s.
>>
>>         I know there is some penalty to be expected from a clustered file
>>         system, but this is al lot. Rsyncing an ext3 file system
>>         double the size
>>         (in Mb's and files) of this file system takes about 600
>>         seconds...
>>
>>         Has anybody some advice on a backup strategy for me? Or some
>>         tuning tips?
>>
>>         Thanks in advance,
>>
>>         Dirk
>>
>>         --
>>         <http://www.proactive.nl>
>>         T       023 - 5422299
>>         F       023 - 5422728
>>
>>         www.proactive.nl <http://www.proactive.nl>
>>         <http://www.proactive.nl>
>>
>>
>>
>>         _______________________________________________
>>         Ocfs2-users mailing list
>>         Ocfs2-users at oss.oracle.com <mailto:Ocfs2-users at oss.oracle.com>
>>         http://oss.oracle.com/mailman/listinfo/ocfs2-users
>>
>>
>
>     -- 
>     <http://www.proactive.nl>
>
>     T 	023 - 5422299
>     F 	023 - 5422728
>      
>     www.proactive.nl <http://www.proactive.nl>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20120404/bc2bd87c/attachment-0001.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.gif
Type: image/gif
Size: 3966 bytes
Desc: not available
Url : http://oss.oracle.com/pipermail/ocfs2-users/attachments/20120404/bc2bd87c/attachment-0002.gif 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 3966 bytes
Desc: not available
Url : http://oss.oracle.com/pipermail/ocfs2-users/attachments/20120404/bc2bd87c/attachment-0003.gif 