<html>
<head>
<meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Hi,<br>
<br>
I've did the --stats thing:<br>
<br>
Number of files: 1495981<br>
Number of files transferred: 2944<br>
Total file size: 201701039047 bytes<br>
Total transferred file size: 613318155 bytes<br>
Literal data: 613292255 bytes<br>
Matched data: 25900 bytes<br>
File list size: 24705311<br>
File list generation time: 0.001 seconds<br>
File list transfer time: 0.000 seconds<br>
Total bytes sent: 118692<br>
Total bytes received: 638195567<br>
<br>
sent 118692 bytes received 638195567 bytes 154163.57 bytes/sec<br>
total size is 201701039047 speedup is 315.99<br>
<br>
This took a staggering 69 minutes, over a Gb connection, useing
rsync direcly (no ssh overhead)<br>
<br>
To compare this, this is a similar backup, only this is an ext3
filesystem over a 100 Mbit connection, using an ssh shell:<br>
<br>
Number of files: 6486854<br>
Number of files transferred: 0<br>
Total file size: 506568034168 bytes<br>
Total transferred file size: 0 bytes<br>
Literal data: 0 bytes<br>
Matched data: 0 bytes<br>
File list size: 153625912<br>
File list generation time: 0.001 seconds<br>
File list transfer time: 0.000 seconds<br>
Total bytes sent: 335<br>
Total bytes received: 153627330<br>
<br>
sent 335 bytes received 153627330 bytes 419175.08 bytes/sec<br>
total size is 506568034168 speedup is 3297.38<br>
Total backup took 368 seconds.<br>
Rsync took 368 seconds.<br>
<br>
(I left the -q switch in this the first time... oeps, so this is the
second run. It took 1315 seconds (21 minutes) the first time,
transferring about 10.000 files).<br>
<br>
Any ideas?<br>
<br>
Kind regards,<br>
<br>
Dirk<br>
<br>
<br>
Op 3-4-2012 11:26, Eduardo Diaz - Gmail schreef:
<blockquote
cite="mid:CANvvECi=t83BYTcCsXrwXiOOvz7=J_T6-cxM05T3V0Hu8N+AHQ@mail.gmail.com"
type="cite">For backup I use a local copy using tar, but I use
rsync too.<br>
<br>
I don't compare but if you send any stadistics about rsync we can
said more information.<br>
<br>
use rsync <strong><strong>--stats<br>
<br>
I don't note difernt speed, but did you make a full rsync, and
show --progress for see that file it is going at what speed?<br>
<br>
regards<br>
</strong></strong><br>
<br>
<div class="gmail_quote">On Mon, Apr 2, 2012 at 9:04 PM, Dirk
Bonenkamp - ProActive <span dir="ltr"><<a
moz-do-not-send="true" href="mailto:dirk@proactive.nl">dirk@proactive.nl</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">Hi All,<br>
<br>
I'm currently testing a OCFS2 set-up, and I'm having issues
with<br>
creating backups.<br>
<br>
I have a 2 node cluster, running OCFS2 on a dual primary DRBD
device.<br>
<br>
The file system is 3.7Tb of which 211 Gb is used: about 1.5
million<br>
files in 95 directories.<br>
<br>
Everything works fine, except for the backups, which are
taking way more<br>
time than on 'regular' file systems.<br>
<br>
I'm using rsync for my backups. When I rsync the file system
above, this<br>
takes more than an hour, without any modifications to the file
system.<br>
<br>
Network / disk speed is good. I can rsync a 10 Gb file from
the OCFS2<br>
filesystem to the same backup server with just under 100 Mb/s.<br>
<br>
I know there is some penalty to be expected from a clustered
file<br>
system, but this is al lot. Rsyncing an ext3 file system
double the size<br>
(in Mb's and files) of this file system takes about 600
seconds...<br>
<br>
Has anybody some advice on a backup strategy for me? Or some
tuning tips?<br>
<br>
Thanks in advance,<br>
<br>
Dirk<br>
<br>
--<br>
<<a moz-do-not-send="true" href="http://www.proactive.nl"
target="_blank">http://www.proactive.nl</a>><br>
T 023 - 5422299<br>
F 023 - 5422728<br>
<br>
<a moz-do-not-send="true" href="http://www.proactive.nl"
target="_blank">www.proactive.nl</a> <<a
moz-do-not-send="true" href="http://www.proactive.nl"
target="_blank">http://www.proactive.nl</a>><br>
<br>
<br>
<br>
_______________________________________________<br>
Ocfs2-users mailing list<br>
<a moz-do-not-send="true"
href="mailto:Ocfs2-users@oss.oracle.com">Ocfs2-users@oss.oracle.com</a><br>
<a moz-do-not-send="true"
href="http://oss.oracle.com/mailman/listinfo/ocfs2-users"
target="_blank">http://oss.oracle.com/mailman/listinfo/ocfs2-users</a><br>
</blockquote>
</div>
<br>
</blockquote>
<br>
<div class="moz-signature">-- <br>
<title>ProActive Software</title>
<style type="text/css">
html, body, table {
font-family: arial, helvetica, sans-serif;
font-size: 11px;
}
a {
color: #25aae1;
text-decoration: none;
}
</style><a href="http://www.proactive.nl"><img alt=""
src="cid:part7.00030401.04060506@proactive.nl" border="0"
height="105" width="84"></a><br>
<table cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td width="20">T</td>
<td>023 - 5422299</td>
</tr>
<tr>
<td>F</td>
<td>023 - 5422728</td>
</tr>
<tr>
<td colspan="2"> </td>
</tr>
<tr>
<td colspan="2"><a href="http://www.proactive.nl">www.proactive.nl</a></td>
</tr>
</tbody>
</table>
<br>
</div>
</body>
</html>