[Ocfs2-users] Backup issues

Wed Apr 4 06:34:46 PDT 2012

Hi,

Here we go:

OCFS2 version:
1.6.3-2ubuntu3~ppa3 (Ubuntu HA maintainers version for 10.04 LTS)

Filesytem options:
tunefs.ocfs2 -Q "Block size = %B\nCluster size = %T\nCompat flags =
%M\nIncompat flags = %H\nRO compat flags = %O\nNumSlots = %N\n" /dev/drbd0
Block size = 4096
Cluster size = 4096
Compat flags = backup-super strict-journal-super
Incompat flags = sparse extended-slotmap userspace-stack inline-data
xattr indexed-dirs
RO compat flags = unwritten
NumSlots = 2

Mount info:
/dev/drbd0 on /var/scans type ocfs2 (rw,_netdev,noatime,cluster_stack=pcmk)

Regards,

Dirk

Op 4-4-2012 14:01, Sérgio Surkamp schreef:
> Hello,
>
> Please provide the ocfs2 version that you are using with the mount
> options and filesystem creation options (see -Q parameter from
> tunefs.ocfs2).
>
> Regards,
> Sérgio
>
> Em Tue, 03 Apr 2012 20:37:25 +0200
> Dirk Bonenkamp - ProActive <dirk at proactive.nl> escreveu:
>
>> Hi,
>>
>> I've did the --stats thing:
>>
>> Number of files: 1495981
>> Number of files transferred: 2944
>> Total file size: 201701039047 bytes
>> Total transferred file size: 613318155 bytes
>> Literal data: 613292255 bytes
>> Matched data: 25900 bytes
>> File list size: 24705311
>> File list generation time: 0.001 seconds
>> File list transfer time: 0.000 seconds
>> Total bytes sent: 118692
>> Total bytes received: 638195567
>>
>> sent 118692 bytes  received 638195567 bytes  154163.57 bytes/sec
>> total size is 201701039047  speedup is 315.99
>>
>> This took a staggering 69 minutes, over a Gb connection, useing rsync
>> direcly (no ssh overhead)
>>
>> To compare this, this is a similar backup, only this is an ext3
>> filesystem over a 100 Mbit connection, using an ssh shell:
>>
>> Number of files: 6486854
>> Number of files transferred: 0
>> Total file size: 506568034168 bytes
>> Total transferred file size: 0 bytes
>> Literal data: 0 bytes
>> Matched data: 0 bytes
>> File list size: 153625912
>> File list generation time: 0.001 seconds
>> File list transfer time: 0.000 seconds
>> Total bytes sent: 335
>> Total bytes received: 153627330
>>
>> sent 335 bytes  received 153627330 bytes  419175.08 bytes/sec
>> total size is 506568034168  speedup is 3297.38
>> Total backup took 368 seconds.
>> Rsync took 368 seconds.
>>
>> (I left the -q switch in this the first time... oeps, so this is the
>> second run. It took 1315 seconds (21 minutes) the first time,
>> transferring about 10.000 files).
>>
>> Any ideas?
>>
>> Kind regards,
>>
>> Dirk
>>
>>
>> Op 3-4-2012 11:26, Eduardo Diaz - Gmail schreef:
>>> For backup I use a local copy using tar, but I use rsync too.
>>>
>>> I don't compare but if you send any stadistics about rsync we can
>>> said more information.
>>>
>>> use rsync **--stats
>>>
>>> I don't note difernt speed, but did you make a full rsync, and show
>>> --progress for see that file it is going at what speed?
>>>
>>> regards
>>> **
>>>
>>> On Mon, Apr 2, 2012 at 9:04 PM, Dirk Bonenkamp - ProActive
>>> <dirk at proactive.nl <mailto:dirk at proactive.nl>> wrote:
>>>
>>>     Hi All,
>>>
>>>     I'm currently testing a OCFS2 set-up, and I'm having issues with
>>>     creating backups.
>>>
>>>     I have a 2 node cluster, running OCFS2 on a dual primary DRBD
>>> device.
>>>
>>>     The file system is 3.7Tb of which 211 Gb is used: about 1.5
>>> million files in 95 directories.
>>>
>>>     Everything works fine, except for the backups, which are taking
>>>     way more
>>>     time than on 'regular' file systems.
>>>
>>>     I'm using rsync for my backups. When I rsync the file system
>>>     above, this
>>>     takes more than an hour, without any modifications to the file
>>> system.
>>>
>>>     Network / disk speed is good. I can rsync a 10 Gb file from the
>>> OCFS2 filesystem to the same backup server with just under 100 Mb/s.
>>>
>>>     I know there is some penalty to be expected from a clustered
>>> file system, but this is al lot. Rsyncing an ext3 file system double
>>>     the size
>>>     (in Mb's and files) of this file system takes about 600
>>> seconds...
>>>
>>>     Has anybody some advice on a backup strategy for me? Or some
>>>     tuning tips?
>>>
>>>     Thanks in advance,
>>>
>>>     Dirk
>>>
>>>     --
>>>     <http://www.proactive.nl>
>>>     T       023 - 5422299
>>>     F       023 - 5422728
>>>
>>>     www.proactive.nl <http://www.proactive.nl>
>>> <http://www.proactive.nl>
>>>
>>>
>>>
>>>     _______________________________________________
>>>     Ocfs2-users mailing list
>>>     Ocfs2-users at oss.oracle.com <mailto:Ocfs2-users at oss.oracle.com>
>>>     http://oss.oracle.com/mailman/listinfo/ocfs2-users
>>>
>>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20120404/17994763/attachment.html 