[Ocfs2-users] Backup issues
Dirk Bonenkamp - ProActive
dirk at proactive.nl
Wed Apr 4 02:56:36 PDT 2012
Hi,
The file-system is clean, a check with -f reports no issues. Changing
the direction of rsync doesn't help much either....
I'll give this issue a try on the drdb mailing list, maybe there is
somebody on there with a similar set-up.
Regards,
Dirk
<http://www.proactive.nl>
Op 4-4-2012 1:14, Eduardo Diaz - Gmail schreef:
> Try if are a problem of try rsync or a copy try cp and see if the
> size are difernt.
>
> try too rsyncd in the server or rsynd in the other side. "do you has
> similar results?"
>
> make a fsck of ocfs2 system for discard errors
>
>
> On Tue, Apr 3, 2012 at 8:37 PM, Dirk Bonenkamp - ProActive
> <dirk at proactive.nl <mailto:dirk at proactive.nl>> wrote:
>
> Hi,
>
> I've did the --stats thing:
>
> Number of files: 1495981
> Number of files transferred: 2944
> Total file size: 201701039047 bytes
> Total transferred file size: 613318155 <tel:613318155> bytes
> Literal data: 613292255 <tel:613292255> bytes
> Matched data: 25900 bytes
> File list size: 24705311
> File list generation time: 0.001 seconds
> File list transfer time: 0.000 seconds
> Total bytes sent: 118692
> Total bytes received: 638195567 <tel:638195567>
>
> sent 118692 bytes received 638195567 <tel:638195567> bytes
> 154163.57 bytes/sec
> total size is 201701039047 speedup is 315.99
>
> This took a staggering 69 minutes, over a Gb connection, useing
> rsync direcly (no ssh overhead)
>
> To compare this, this is a similar backup, only this is an ext3
> filesystem over a 100 Mbit connection, using an ssh shell:
>
> Number of files: 6486854
> Number of files transferred: 0
> Total file size: 506568034168 bytes
> Total transferred file size: 0 bytes
> Literal data: 0 bytes
> Matched data: 0 bytes
> File list size: 153625912
> File list generation time: 0.001 seconds
> File list transfer time: 0.000 seconds
> Total bytes sent: 335
> Total bytes received: 153627330
>
> sent 335 bytes received 153627330 bytes 419175.08 bytes/sec
> total size is 506568034168 speedup is 3297.38
> Total backup took 368 seconds.
> Rsync took 368 seconds.
>
> (I left the -q switch in this the first time... oeps, so this is
> the second run. It took 1315 seconds (21 minutes) the first time,
> transferring about 10.000 files).
>
> Any ideas?
>
> Kind regards,
>
> Dirk
>
>
> Op 3-4-2012 11:26, Eduardo Diaz - Gmail schreef:
>> For backup I use a local copy using tar, but I use rsync too.
>>
>> I don't compare but if you send any stadistics about rsync we can
>> said more information.
>>
>> use rsync **--stats
>>
>> I don't note difernt speed, but did you make a full rsync, and
>> show --progress for see that file it is going at what speed?
>>
>> regards
>> **
>>
>> On Mon, Apr 2, 2012 at 9:04 PM, Dirk Bonenkamp - ProActive
>> <dirk at proactive.nl <mailto:dirk at proactive.nl>> wrote:
>>
>> Hi All,
>>
>> I'm currently testing a OCFS2 set-up, and I'm having issues with
>> creating backups.
>>
>> I have a 2 node cluster, running OCFS2 on a dual primary DRBD
>> device.
>>
>> The file system is 3.7Tb of which 211 Gb is used: about 1.5
>> million
>> files in 95 directories.
>>
>> Everything works fine, except for the backups, which are
>> taking way more
>> time than on 'regular' file systems.
>>
>> I'm using rsync for my backups. When I rsync the file system
>> above, this
>> takes more than an hour, without any modifications to the
>> file system.
>>
>> Network / disk speed is good. I can rsync a 10 Gb file from
>> the OCFS2
>> filesystem to the same backup server with just under 100 Mb/s.
>>
>> I know there is some penalty to be expected from a clustered file
>> system, but this is al lot. Rsyncing an ext3 file system
>> double the size
>> (in Mb's and files) of this file system takes about 600
>> seconds...
>>
>> Has anybody some advice on a backup strategy for me? Or some
>> tuning tips?
>>
>> Thanks in advance,
>>
>> Dirk
>>
>> --
>> <http://www.proactive.nl>
>> T 023 - 5422299
>> F 023 - 5422728
>>
>> www.proactive.nl <http://www.proactive.nl>
>> <http://www.proactive.nl>
>>
>>
>>
>> _______________________________________________
>> Ocfs2-users mailing list
>> Ocfs2-users at oss.oracle.com <mailto:Ocfs2-users at oss.oracle.com>
>> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>>
>>
>
> --
> <http://www.proactive.nl>
>
> T 023 - 5422299
> F 023 - 5422728
>
> www.proactive.nl <http://www.proactive.nl>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20120404/bc2bd87c/attachment-0001.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.gif
Type: image/gif
Size: 3966 bytes
Desc: not available
Url : http://oss.oracle.com/pipermail/ocfs2-users/attachments/20120404/bc2bd87c/attachment-0002.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 3966 bytes
Desc: not available
Url : http://oss.oracle.com/pipermail/ocfs2-users/attachments/20120404/bc2bd87c/attachment-0003.gif
More information about the Ocfs2-users
mailing list