[Ocfs2-users] Backup issues

Tue Apr 3 16:14:27 PDT 2012

 Try if are a problem of try rsync or a copy try cp and see if the size are
difernt.

try too rsyncd in the server or rsynd in the other side. "do you has
similar results?"

make a fsck of ocfs2 system for discard errors

On Tue, Apr 3, 2012 at 8:37 PM, Dirk Bonenkamp - ProActive <
dirk at proactive.nl> wrote:

>  Hi,
>
> I've did the --stats thing:
>
> Number of files: 1495981
> Number of files transferred: 2944
> Total file size: 201701039047 bytes
> Total transferred file size: 613318155 bytes
> Literal data: 613292255 bytes
> Matched data: 25900 bytes
> File list size: 24705311
> File list generation time: 0.001 seconds
> File list transfer time: 0.000 seconds
> Total bytes sent: 118692
> Total bytes received: 638195567
>
> sent 118692 bytes  received 638195567 bytes  154163.57 bytes/sec
> total size is 201701039047  speedup is 315.99
>
> This took a staggering 69 minutes, over a Gb connection, useing rsync
> direcly (no ssh overhead)
>
> To compare this, this is a similar backup, only this is an ext3 filesystem
> over a 100 Mbit connection, using an ssh shell:
>
> Number of files: 6486854
> Number of files transferred: 0
> Total file size: 506568034168 bytes
> Total transferred file size: 0 bytes
> Literal data: 0 bytes
> Matched data: 0 bytes
> File list size: 153625912
> File list generation time: 0.001 seconds
> File list transfer time: 0.000 seconds
> Total bytes sent: 335
> Total bytes received: 153627330
>
> sent 335 bytes  received 153627330 bytes  419175.08 bytes/sec
> total size is 506568034168  speedup is 3297.38
> Total backup took 368 seconds.
> Rsync took 368 seconds.
>
> (I left the -q switch in this the first time... oeps, so this is the
> second run. It took 1315 seconds (21 minutes) the first time, transferring
> about 10.000 files).
>
> Any ideas?
>
> Kind regards,
>
> Dirk
>
>
> Op 3-4-2012 11:26, Eduardo Diaz - Gmail schreef:
>
> For backup I use a local copy using tar, but I use rsync too.
>
> I don't compare but if you send any stadistics about rsync we can said
> more information.
>
> use rsync *--stats
>
> I don't note difernt speed, but did you make a full rsync, and show
> --progress for see that file it is going at what speed?
>
> regards
> *
>
> On Mon, Apr 2, 2012 at 9:04 PM, Dirk Bonenkamp - ProActive <
> dirk at proactive.nl> wrote:
>
>> Hi All,
>>
>> I'm currently testing a OCFS2 set-up, and I'm having issues with
>> creating backups.
>>
>> I have a 2 node cluster, running OCFS2 on a dual primary DRBD device.
>>
>> The file system is 3.7Tb of which 211 Gb is used: about 1.5 million
>> files in 95 directories.
>>
>> Everything works fine, except for the backups, which are taking way more
>> time than on 'regular' file systems.
>>
>> I'm using rsync for my backups. When I rsync the file system above, this
>> takes more than an hour, without any modifications to the file system.
>>
>> Network / disk speed is good. I can rsync a 10 Gb file from the OCFS2
>> filesystem to the same backup server with just under 100 Mb/s.
>>
>> I know there is some penalty to be expected from a clustered file
>> system, but this is al lot. Rsyncing an ext3 file system double the size
>> (in Mb's and files) of this file system takes about 600 seconds...
>>
>> Has anybody some advice on a backup strategy for me? Or some tuning tips?
>>
>> Thanks in advance,
>>
>> Dirk
>>
>> --
>> <http://www.proactive.nl>
>> T       023 - 5422299
>> F       023 - 5422728
>>
>> www.proactive.nl <http://www.proactive.nl>
>>
>>
>>
>> _______________________________________________
>> Ocfs2-users mailing list
>> Ocfs2-users at oss.oracle.com
>> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>>
>
>
> --
>  <http://www.proactive.nl>
>
>   T 023 - 5422299  F 023 - 5422728     www.proactive.nl
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20120404/044d8d76/attachment.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 3966 bytes
Desc: not available
Url : http://oss.oracle.com/pipermail/ocfs2-users/attachments/20120404/044d8d76/attachment.gif 