[Ocfs2-users] out of memory?

[Paul Jimenez]

On Jun 29, 2006, at 8:22 AM, Brian Long wrote:

> On Wed, 2006-06-28 at 17:03 -0500, Paul Jimenez wrote:
>> I'm getting out of memory errors trying to do 'rsync -av /foo /bar'
>> where /foo is a local dir and /bar is an ocfs2 filesystem running on
>> an ~ 6T ATA-over-Ethernet box.
>
> Paul,
>
> Can you also include some information about your /foo partition?   
> It is
> millions of little files or hundreds of large files?  What is the  
> RSS of
> rsync when you run out of memory?
>
> http://samba.anu.edu.au/rsync/FAQ.html#5
> http://lists.samba.org/archive/rsync/2002-July/003160.html
>

/foo is ~ 4600 files each about 60GB for a total of ~259GB.

Some output after or slightly-before it crashed:


Every 2s: cat /proc/slabinfo | sort -rnk 2 |  
head                           Thu Jun 29 11:58:01 2006

buffer_head       754620 754632     52   72    1 : tunables  120    
60    8 : slabdata  10481  10481
      0
bio               225600 225600    128   30    1 : tunables  120    
60    8 : slabdata   7520   7520
      0
biovec-1          225593 225736     16  203    1 : tunables  120    
60    8 : slabdata   1112   1112
      0
journal_head      175548 182448     52   72    1 : tunables  120    
60    8 : slabdata   2530   2534
      0
aoe_bufs          112536 112554     48   78    1 : tunables  120    
60    8 : slabdata   1443   1443
      0
radix_tree_node    41510  41510    276   14    1 : tunables   54    
27    8 : slabdata   2965   2965
      0
sysfs_dir_cache     3644   3772     40   92    1 : tunables  120    
60    8 : slabdata     41     41
      0
size-32             2938   4407     32  113    1 : tunables  120    
60    8 : slabdata     39     39
      0
size-64             2354   2596     64   59    1 : tunables  120    
60    8 : slabdata     44     44
      0
dentry_cache        2086   3090    128   30    1 : tunables  120    
60    8 : slabdata    103    103
      0


Free swap: 16779608kB
4718592 pages of RAM
4489216 pages of HIGHMEM
562809 reserved pages
530215 pages shared
0 pages swap cached
136994 pages dirty
61878 pages writeback
142502 pages mapped
29403 pages slab
480 pages pagetables

4718592 pages of RAM
4489216 pages of HIGHMEM
562809 reserved pages
530215 pages shared
0 pages swap cached
136994 pages dirty
61876 pages writeback
142502 pages mapped
29425 pages slab
480 pages pagetables

I don't think it's rsync running things oom; its memory consumption  
is filecount based and 4600 files just isn't that many.

The tunables that I had in place from the AoE faq (http:// 
www.coraid.com/support/linux/EtherDrive-2.6-HOWTO.html#toc5.18)
this time were:

vm.overcommit_memory=2
vm.dirty_ratio=3
vm.dirty_background_ratio=3
vm.min_free_kbytes=5120

Any help appreciated.

   --pj