[Ocfs2-users] Backup issues

Wed Apr 4 03:31:53 PDT 2012

Sure, I am on the same list too :).

I don't have the issue, but only make copy over rsync to a USB disk.

my recomendation mount the filesystem over NFS and try make the rsync and
use cp (only copy the new) too.. (usually see the diference in time..)

good luck

On Wed, Apr 4, 2012 at 11:56 AM, Dirk Bonenkamp - ProActive <
dirk at proactive.nl> wrote:

>  Hi,
>
> The file-system is clean, a check with -f reports no issues. Changing the
> direction of rsync doesn't help much either....
>
> I'll give this issue a try on the drdb mailing list, maybe there is
> somebody on there with a similar set-up.
>
> Regards,
>
> Dirk
>  <http://www.proactive.nl>
>
>
>
>
>
>
>
>
>
>  Op 4-4-2012 1:14, Eduardo Diaz - Gmail schreef:
>
>  Try if are a problem of try rsync or a copy try cp and see if the size
> are difernt.
>
> try too rsyncd in the server or rsynd in the other side. "do you has
> similar results?"
>
> make a fsck of ocfs2 system for discard errors
>
>
> On Tue, Apr 3, 2012 at 8:37 PM, Dirk Bonenkamp - ProActive <
> dirk at proactive.nl> wrote:
>
>>  Hi,
>>
>> I've did the --stats thing:
>>
>> Number of files: 1495981
>> Number of files transferred: 2944
>> Total file size: 201701039047 bytes
>> Total transferred file size: 613318155 bytes
>> Literal data: 613292255 bytes
>> Matched data: 25900 bytes
>> File list size: 24705311
>> File list generation time: 0.001 seconds
>> File list transfer time: 0.000 seconds
>> Total bytes sent: 118692
>> Total bytes received: 638195567
>>
>> sent 118692 bytes  received 638195567 bytes  154163.57 bytes/sec
>> total size is 201701039047  speedup is 315.99
>>
>> This took a staggering 69 minutes, over a Gb connection, useing rsync
>> direcly (no ssh overhead)
>>
>> To compare this, this is a similar backup, only this is an ext3
>> filesystem over a 100 Mbit connection, using an ssh shell:
>>
>> Number of files: 6486854
>> Number of files transferred: 0
>> Total file size: 506568034168 bytes
>> Total transferred file size: 0 bytes
>> Literal data: 0 bytes
>> Matched data: 0 bytes
>> File list size: 153625912
>> File list generation time: 0.001 seconds
>> File list transfer time: 0.000 seconds
>> Total bytes sent: 335
>> Total bytes received: 153627330
>>
>> sent 335 bytes  received 153627330 bytes  419175.08 bytes/sec
>> total size is 506568034168  speedup is 3297.38
>> Total backup took 368 seconds.
>> Rsync took 368 seconds.
>>
>> (I left the -q switch in this the first time... oeps, so this is the
>> second run. It took 1315 seconds (21 minutes) the first time, transferring
>> about 10.000 files).
>>
>> Any ideas?
>>
>> Kind regards,
>>
>> Dirk
>>
>>
>> Op 3-4-2012 11:26, Eduardo Diaz - Gmail schreef:
>>
>> For backup I use a local copy using tar, but I use rsync too.
>>
>> I don't compare but if you send any stadistics about rsync we can said
>> more information.
>>
>> use rsync *--stats
>>
>> I don't note difernt speed, but did you make a full rsync, and show
>> --progress for see that file it is going at what speed?
>>
>> regards
>> *
>>
>> On Mon, Apr 2, 2012 at 9:04 PM, Dirk Bonenkamp - ProActive <
>> dirk at proactive.nl> wrote:
>>
>>> Hi All,
>>>
>>> I'm currently testing a OCFS2 set-up, and I'm having issues with
>>> creating backups.
>>>
>>> I have a 2 node cluster, running OCFS2 on a dual primary DRBD device.
>>>
>>> The file system is 3.7Tb of which 211 Gb is used: about 1.5 million
>>> files in 95 directories.
>>>
>>> Everything works fine, except for the backups, which are taking way more
>>> time than on 'regular' file systems.
>>>
>>> I'm using rsync for my backups. When I rsync the file system above, this
>>> takes more than an hour, without any modifications to the file system.
>>>
>>> Network / disk speed is good. I can rsync a 10 Gb file from the OCFS2
>>> filesystem to the same backup server with just under 100 Mb/s.
>>>
>>> I know there is some penalty to be expected from a clustered file
>>> system, but this is al lot. Rsyncing an ext3 file system double the size
>>> (in Mb's and files) of this file system takes about 600 seconds...
>>>
>>> Has anybody some advice on a backup strategy for me? Or some tuning tips?
>>>
>>> Thanks in advance,
>>>
>>> Dirk
>>>
>>> --
>>> <http://www.proactive.nl>
>>> T       023 - 5422299
>>> F       023 - 5422728
>>>
>>> www.proactive.nl <http://www.proactive.nl>
>>>
>>>
>>>
>>> _______________________________________________
>>> Ocfs2-users mailing list
>>> Ocfs2-users at oss.oracle.com
>>> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>>>
>>
>>
>>  --
>>  <http://www.proactive.nl>
>>
>>   T 023 - 5422299  F 023 - 5422728     www.proactive.nl
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20120404/2cf068c6/attachment.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 3966 bytes
Desc: not available
Url : http://oss.oracle.com/pipermail/ocfs2-users/attachments/20120404/2cf068c6/attachment.gif 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 3966 bytes
Desc: not available
Url : http://oss.oracle.com/pipermail/ocfs2-users/attachments/20120404/2cf068c6/attachment-0001.gif 