[Ocfs2-users] Backup issues

[Sérgio Surkamp]

Hello,

Please provide the ocfs2 version that you are using with the mount
options and filesystem creation options (see -Q parameter from
tunefs.ocfs2).

Regards,
Sérgio

Em Tue, 03 Apr 2012 20:37:25 +0200
Dirk Bonenkamp - ProActive <dirk at proactive.nl> escreveu:

> Hi,
> 
> I've did the --stats thing:
> 
> Number of files: 1495981
> Number of files transferred: 2944
> Total file size: 201701039047 bytes
> Total transferred file size: 613318155 bytes
> Literal data: 613292255 bytes
> Matched data: 25900 bytes
> File list size: 24705311
> File list generation time: 0.001 seconds
> File list transfer time: 0.000 seconds
> Total bytes sent: 118692
> Total bytes received: 638195567
> 
> sent 118692 bytes  received 638195567 bytes  154163.57 bytes/sec
> total size is 201701039047  speedup is 315.99
> 
> This took a staggering 69 minutes, over a Gb connection, useing rsync
> direcly (no ssh overhead)
> 
> To compare this, this is a similar backup, only this is an ext3
> filesystem over a 100 Mbit connection, using an ssh shell:
> 
> Number of files: 6486854
> Number of files transferred: 0
> Total file size: 506568034168 bytes
> Total transferred file size: 0 bytes
> Literal data: 0 bytes
> Matched data: 0 bytes
> File list size: 153625912
> File list generation time: 0.001 seconds
> File list transfer time: 0.000 seconds
> Total bytes sent: 335
> Total bytes received: 153627330
> 
> sent 335 bytes  received 153627330 bytes  419175.08 bytes/sec
> total size is 506568034168  speedup is 3297.38
> Total backup took 368 seconds.
> Rsync took 368 seconds.
> 
> (I left the -q switch in this the first time... oeps, so this is the
> second run. It took 1315 seconds (21 minutes) the first time,
> transferring about 10.000 files).
> 
> Any ideas?
> 
> Kind regards,
> 
> Dirk
> 
> 
> Op 3-4-2012 11:26, Eduardo Diaz - Gmail schreef:
> > For backup I use a local copy using tar, but I use rsync too.
> >
> > I don't compare but if you send any stadistics about rsync we can
> > said more information.
> >
> > use rsync **--stats
> >
> > I don't note difernt speed, but did you make a full rsync, and show
> > --progress for see that file it is going at what speed?
> >
> > regards
> > **
> >
> > On Mon, Apr 2, 2012 at 9:04 PM, Dirk Bonenkamp - ProActive
> > <dirk at proactive.nl <mailto:dirk at proactive.nl>> wrote:
> >
> >     Hi All,
> >
> >     I'm currently testing a OCFS2 set-up, and I'm having issues with
> >     creating backups.
> >
> >     I have a 2 node cluster, running OCFS2 on a dual primary DRBD
> > device.
> >
> >     The file system is 3.7Tb of which 211 Gb is used: about 1.5
> > million files in 95 directories.
> >
> >     Everything works fine, except for the backups, which are taking
> >     way more
> >     time than on 'regular' file systems.
> >
> >     I'm using rsync for my backups. When I rsync the file system
> >     above, this
> >     takes more than an hour, without any modifications to the file
> > system.
> >
> >     Network / disk speed is good. I can rsync a 10 Gb file from the
> > OCFS2 filesystem to the same backup server with just under 100 Mb/s.
> >
> >     I know there is some penalty to be expected from a clustered
> > file system, but this is al lot. Rsyncing an ext3 file system double
> >     the size
> >     (in Mb's and files) of this file system takes about 600
> > seconds...
> >
> >     Has anybody some advice on a backup strategy for me? Or some
> >     tuning tips?
> >
> >     Thanks in advance,
> >
> >     Dirk
> >
> >     --
> >     <http://www.proactive.nl>
> >     T       023 - 5422299
> >     F       023 - 5422728
> >
> >     www.proactive.nl <http://www.proactive.nl>
> > <http://www.proactive.nl>
> >
> >
> >
> >     _______________________________________________
> >     Ocfs2-users mailing list
> >     Ocfs2-users at oss.oracle.com <mailto:Ocfs2-users at oss.oracle.com>
> >     http://oss.oracle.com/mailman/listinfo/ocfs2-users
> >
> >
> 



-- 
  .:''''':.
.:'        `     Sérgio Surkamp | Administrador de Redes
::    ........   sergio at gruposinternet.com.br
`:.        .:'
  `:,   ,.:'     *Grupos Internet S.A.*
    `: :'        R. Lauro Linhares, 2123 Torre B - Sala 201
     : :         Trindade - Florianópolis - SC
     :.'
     ::          +55 48 3234-4109
     :
     '           http://www.gruposinternet.com.br