[Ocfs2-users] Backup issues
Dirk Bonenkamp - ProActive
dirk at proactive.nl
Wed Apr 4 06:34:46 PDT 2012
Hi,
Here we go:
OCFS2 version:
1.6.3-2ubuntu3~ppa3 (Ubuntu HA maintainers version for 10.04 LTS)
Filesytem options:
tunefs.ocfs2 -Q "Block size = %B\nCluster size = %T\nCompat flags =
%M\nIncompat flags = %H\nRO compat flags = %O\nNumSlots = %N\n" /dev/drbd0
Block size = 4096
Cluster size = 4096
Compat flags = backup-super strict-journal-super
Incompat flags = sparse extended-slotmap userspace-stack inline-data
xattr indexed-dirs
RO compat flags = unwritten
NumSlots = 2
Mount info:
/dev/drbd0 on /var/scans type ocfs2 (rw,_netdev,noatime,cluster_stack=pcmk)
Regards,
Dirk
Op 4-4-2012 14:01, Sérgio Surkamp schreef:
> Hello,
>
> Please provide the ocfs2 version that you are using with the mount
> options and filesystem creation options (see -Q parameter from
> tunefs.ocfs2).
>
> Regards,
> Sérgio
>
> Em Tue, 03 Apr 2012 20:37:25 +0200
> Dirk Bonenkamp - ProActive <dirk at proactive.nl> escreveu:
>
>> Hi,
>>
>> I've did the --stats thing:
>>
>> Number of files: 1495981
>> Number of files transferred: 2944
>> Total file size: 201701039047 bytes
>> Total transferred file size: 613318155 bytes
>> Literal data: 613292255 bytes
>> Matched data: 25900 bytes
>> File list size: 24705311
>> File list generation time: 0.001 seconds
>> File list transfer time: 0.000 seconds
>> Total bytes sent: 118692
>> Total bytes received: 638195567
>>
>> sent 118692 bytes received 638195567 bytes 154163.57 bytes/sec
>> total size is 201701039047 speedup is 315.99
>>
>> This took a staggering 69 minutes, over a Gb connection, useing rsync
>> direcly (no ssh overhead)
>>
>> To compare this, this is a similar backup, only this is an ext3
>> filesystem over a 100 Mbit connection, using an ssh shell:
>>
>> Number of files: 6486854
>> Number of files transferred: 0
>> Total file size: 506568034168 bytes
>> Total transferred file size: 0 bytes
>> Literal data: 0 bytes
>> Matched data: 0 bytes
>> File list size: 153625912
>> File list generation time: 0.001 seconds
>> File list transfer time: 0.000 seconds
>> Total bytes sent: 335
>> Total bytes received: 153627330
>>
>> sent 335 bytes received 153627330 bytes 419175.08 bytes/sec
>> total size is 506568034168 speedup is 3297.38
>> Total backup took 368 seconds.
>> Rsync took 368 seconds.
>>
>> (I left the -q switch in this the first time... oeps, so this is the
>> second run. It took 1315 seconds (21 minutes) the first time,
>> transferring about 10.000 files).
>>
>> Any ideas?
>>
>> Kind regards,
>>
>> Dirk
>>
>>
>> Op 3-4-2012 11:26, Eduardo Diaz - Gmail schreef:
>>> For backup I use a local copy using tar, but I use rsync too.
>>>
>>> I don't compare but if you send any stadistics about rsync we can
>>> said more information.
>>>
>>> use rsync **--stats
>>>
>>> I don't note difernt speed, but did you make a full rsync, and show
>>> --progress for see that file it is going at what speed?
>>>
>>> regards
>>> **
>>>
>>> On Mon, Apr 2, 2012 at 9:04 PM, Dirk Bonenkamp - ProActive
>>> <dirk at proactive.nl <mailto:dirk at proactive.nl>> wrote:
>>>
>>> Hi All,
>>>
>>> I'm currently testing a OCFS2 set-up, and I'm having issues with
>>> creating backups.
>>>
>>> I have a 2 node cluster, running OCFS2 on a dual primary DRBD
>>> device.
>>>
>>> The file system is 3.7Tb of which 211 Gb is used: about 1.5
>>> million files in 95 directories.
>>>
>>> Everything works fine, except for the backups, which are taking
>>> way more
>>> time than on 'regular' file systems.
>>>
>>> I'm using rsync for my backups. When I rsync the file system
>>> above, this
>>> takes more than an hour, without any modifications to the file
>>> system.
>>>
>>> Network / disk speed is good. I can rsync a 10 Gb file from the
>>> OCFS2 filesystem to the same backup server with just under 100 Mb/s.
>>>
>>> I know there is some penalty to be expected from a clustered
>>> file system, but this is al lot. Rsyncing an ext3 file system double
>>> the size
>>> (in Mb's and files) of this file system takes about 600
>>> seconds...
>>>
>>> Has anybody some advice on a backup strategy for me? Or some
>>> tuning tips?
>>>
>>> Thanks in advance,
>>>
>>> Dirk
>>>
>>> --
>>> <http://www.proactive.nl>
>>> T 023 - 5422299
>>> F 023 - 5422728
>>>
>>> www.proactive.nl <http://www.proactive.nl>
>>> <http://www.proactive.nl>
>>>
>>>
>>>
>>> _______________________________________________
>>> Ocfs2-users mailing list
>>> Ocfs2-users at oss.oracle.com <mailto:Ocfs2-users at oss.oracle.com>
>>> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>>>
>>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20120404/17994763/attachment.html
More information about the Ocfs2-users
mailing list