[Ocfs2-users] Backup issues

Mon Apr 9 07:48:37 PDT 2012

Hello Dirk,

What is the main propose of your filesystem? It seems like its being
used to store many small files (> 4KBytes), if so, your flags seems ok.
If you are storing larger files, then changing to larger Cluster and
Block sizes is recommended as it will avoid hitting global locks, that
could lead to big performance bottlenecks if occur often.

Regards,
Sérgio

Em Wed, 04 Apr 2012 15:34:46 +0200
Dirk Bonenkamp - ProActive <dirk at proactive.nl> escreveu:

> Hi,
> 
> Here we go:
> 
> OCFS2 version:
> 1.6.3-2ubuntu3~ppa3 (Ubuntu HA maintainers version for 10.04 LTS)
> 
> Filesytem options:
> tunefs.ocfs2 -Q "Block size = %B\nCluster size = %T\nCompat flags =
> %M\nIncompat flags = %H\nRO compat flags = %O\nNumSlots =
> %N\n" /dev/drbd0 Block size = 4096
> Cluster size = 4096
> Compat flags = backup-super strict-journal-super
> Incompat flags = sparse extended-slotmap userspace-stack inline-data
> xattr indexed-dirs
> RO compat flags = unwritten
> NumSlots = 2
> 
> Mount info:
> /dev/drbd0 on /var/scans type ocfs2
> (rw,_netdev,noatime,cluster_stack=pcmk)
> 
> Regards,
> 
> Dirk
> 
> 
> Op 4-4-2012 14:01, Sérgio Surkamp schreef:
> > Hello,
> >
> > Please provide the ocfs2 version that you are using with the mount
> > options and filesystem creation options (see -Q parameter from
> > tunefs.ocfs2).
> >
> > Regards,
> > Sérgio
> >
> > Em Tue, 03 Apr 2012 20:37:25 +0200
> > Dirk Bonenkamp - ProActive <dirk at proactive.nl> escreveu:
> >
> >> Hi,
> >>
> >> I've did the --stats thing:
> >>
> >> Number of files: 1495981
> >> Number of files transferred: 2944
> >> Total file size: 201701039047 bytes
> >> Total transferred file size: 613318155 bytes
> >> Literal data: 613292255 bytes
> >> Matched data: 25900 bytes
> >> File list size: 24705311
> >> File list generation time: 0.001 seconds
> >> File list transfer time: 0.000 seconds
> >> Total bytes sent: 118692
> >> Total bytes received: 638195567
> >>
> >> sent 118692 bytes  received 638195567 bytes  154163.57 bytes/sec
> >> total size is 201701039047  speedup is 315.99
> >>
> >> This took a staggering 69 minutes, over a Gb connection, useing
> >> rsync direcly (no ssh overhead)
> >>
> >> To compare this, this is a similar backup, only this is an ext3
> >> filesystem over a 100 Mbit connection, using an ssh shell:
> >>
> >> Number of files: 6486854
> >> Number of files transferred: 0
> >> Total file size: 506568034168 bytes
> >> Total transferred file size: 0 bytes
> >> Literal data: 0 bytes
> >> Matched data: 0 bytes
> >> File list size: 153625912
> >> File list generation time: 0.001 seconds
> >> File list transfer time: 0.000 seconds
> >> Total bytes sent: 335
> >> Total bytes received: 153627330
> >>
> >> sent 335 bytes  received 153627330 bytes  419175.08 bytes/sec
> >> total size is 506568034168  speedup is 3297.38
> >> Total backup took 368 seconds.
> >> Rsync took 368 seconds.
> >>
> >> (I left the -q switch in this the first time... oeps, so this is
> >> the second run. It took 1315 seconds (21 minutes) the first time,
> >> transferring about 10.000 files).
> >>
> >> Any ideas?
> >>
> >> Kind regards,
> >>
> >> Dirk
> >>
> >>
> >> Op 3-4-2012 11:26, Eduardo Diaz - Gmail schreef:
> >>> For backup I use a local copy using tar, but I use rsync too.
> >>>
> >>> I don't compare but if you send any stadistics about rsync we can
> >>> said more information.
> >>>
> >>> use rsync **--stats
> >>>
> >>> I don't note difernt speed, but did you make a full rsync, and
> >>> show --progress for see that file it is going at what speed?
> >>>
> >>> regards
> >>> **
> >>>
> >>> On Mon, Apr 2, 2012 at 9:04 PM, Dirk Bonenkamp - ProActive
> >>> <dirk at proactive.nl <mailto:dirk at proactive.nl>> wrote:
> >>>
> >>>     Hi All,
> >>>
> >>>     I'm currently testing a OCFS2 set-up, and I'm having issues
> >>> with creating backups.
> >>>
> >>>     I have a 2 node cluster, running OCFS2 on a dual primary DRBD
> >>> device.
> >>>
> >>>     The file system is 3.7Tb of which 211 Gb is used: about 1.5
> >>> million files in 95 directories.
> >>>
> >>>     Everything works fine, except for the backups, which are
> >>> taking way more
> >>>     time than on 'regular' file systems.
> >>>
> >>>     I'm using rsync for my backups. When I rsync the file system
> >>>     above, this
> >>>     takes more than an hour, without any modifications to the file
> >>> system.
> >>>
> >>>     Network / disk speed is good. I can rsync a 10 Gb file from
> >>> the OCFS2 filesystem to the same backup server with just under
> >>> 100 Mb/s.
> >>>
> >>>     I know there is some penalty to be expected from a clustered
> >>> file system, but this is al lot. Rsyncing an ext3 file system
> >>> double the size
> >>>     (in Mb's and files) of this file system takes about 600
> >>> seconds...
> >>>
> >>>     Has anybody some advice on a backup strategy for me? Or some
> >>>     tuning tips?
> >>>
> >>>     Thanks in advance,
> >>>
> >>>     Dirk
> >>>
> >>>     --
> >>>     <http://www.proactive.nl>
> >>>     T       023 - 5422299
> >>>     F       023 - 5422728
> >>>
> >>>     www.proactive.nl <http://www.proactive.nl>
> >>> <http://www.proactive.nl>
> >>>
> >>>
> >>>
> >>>     _______________________________________________
> >>>     Ocfs2-users mailing list
> >>>     Ocfs2-users at oss.oracle.com <mailto:Ocfs2-users at oss.oracle.com>
> >>>     http://oss.oracle.com/mailman/listinfo/ocfs2-users
> >>>
> >>>
> >
> >

-- 
  .:''''':.
.:'        `     Sérgio Surkamp | Administrador de Redes
::    ........   sergio at gruposinternet.com.br
`:.        .:'
  `:,   ,.:'     *Grupos Internet S.A.*
    `: :'        R. Lauro Linhares, 2123 Torre B - Sala 201
     : :         Trindade - Florianópolis - SC
     :.'
     ::          +55 48 3234-4109
     :
     '           http://www.gruposinternet.com.br