[Ocfs2-users] out of memory?
Paul Jimenez
pj at rgmadvisors.com
Thu Jun 29 16:32:13 CDT 2006
I have that complete file - from before rsync to the crash (~ 4MB) at
http://www.rgmadvisors.com/~pj/memslabinfo.
Kernel is 2.6.16.7 vanilla, and the version of ocfs2 it came with.
--pj
On Jun 29, 2006, at 2:10 PM, Sunil Mushran wrote:
> I would like the entire /proc/meminfo and /proc/slabinfo.
> Dump it to a file every 1 min or so.
>
> What version of the kernel/ocfs2?
>
> Paul Jimenez wrote:
>> On Jun 29, 2006, at 8:22 AM, Brian Long wrote:
>>
>>
>>> On Wed, 2006-06-28 at 17:03 -0500, Paul Jimenez wrote:
>>>
>>>> I'm getting out of memory errors trying to do 'rsync -av /foo /bar'
>>>> where /foo is a local dir and /bar is an ocfs2 filesystem
>>>> running on
>>>> an ~ 6T ATA-over-Ethernet box.
>>>>
>>> Paul,
>>>
>>> Can you also include some information about your /foo
>>> partition? It is
>>> millions of little files or hundreds of large files? What is
>>> the RSS of
>>> rsync when you run out of memory?
>>>
>>> http://samba.anu.edu.au/rsync/FAQ.html#5
>>> http://lists.samba.org/archive/rsync/2002-July/003160.html
>>>
>>>
>>
>> /foo is ~ 4600 files each about 60GB for a total of ~259GB.
>>
>> Some output after or slightly-before it crashed:
>>
>>
>> Every 2s: cat /proc/slabinfo | sort -rnk 2 |
>> head Thu Jun 29 11:58:01 2006
>>
>> buffer_head 754620 754632 52 72 1 : tunables
>> 120 60 8 : slabdata 10481 10481
>> 0
>> bio 225600 225600 128 30 1 : tunables
>> 120 60 8 : slabdata 7520 7520
>> 0
>> biovec-1 225593 225736 16 203 1 : tunables
>> 120 60 8 : slabdata 1112 1112
>> 0
>> journal_head 175548 182448 52 72 1 : tunables
>> 120 60 8 : slabdata 2530 2534
>> 0
>> aoe_bufs 112536 112554 48 78 1 : tunables
>> 120 60 8 : slabdata 1443 1443
>> 0
>> radix_tree_node 41510 41510 276 14 1 : tunables
>> 54 27 8 : slabdata 2965 2965
>> 0
>> sysfs_dir_cache 3644 3772 40 92 1 : tunables
>> 120 60 8 : slabdata 41 41
>> 0
>> size-32 2938 4407 32 113 1 : tunables
>> 120 60 8 : slabdata 39 39
>> 0
>> size-64 2354 2596 64 59 1 : tunables
>> 120 60 8 : slabdata 44 44
>> 0
>> dentry_cache 2086 3090 128 30 1 : tunables
>> 120 60 8 : slabdata 103 103
>> 0
>>
>>
>> Free swap: 16779608kB
>> 4718592 pages of RAM
>> 4489216 pages of HIGHMEM
>> 562809 reserved pages
>> 530215 pages shared
>> 0 pages swap cached
>> 136994 pages dirty
>> 61878 pages writeback
>> 142502 pages mapped
>> 29403 pages slab
>> 480 pages pagetables
>>
>> 4718592 pages of RAM
>> 4489216 pages of HIGHMEM
>> 562809 reserved pages
>> 530215 pages shared
>> 0 pages swap cached
>> 136994 pages dirty
>> 61876 pages writeback
>> 142502 pages mapped
>> 29425 pages slab
>> 480 pages pagetables
>>
>> I don't think it's rsync running things oom; its memory
>> consumption is filecount based and 4600 files just isn't that many.
>>
>> The tunables that I had in place from the AoE faq (http://
>> www.coraid.com/support/linux/EtherDrive-2.6-HOWTO.html#toc5.18)
>> this time were:
>>
>> vm.overcommit_memory=2
>> vm.dirty_ratio=3
>> vm.dirty_background_ratio=3
>> vm.min_free_kbytes=5120
>>
>> Any help appreciated.
>>
>> --pj
>>
>> _______________________________________________
>> Ocfs2-users mailing list
>> Ocfs2-users at oss.oracle.com
>> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>>
More information about the Ocfs2-users
mailing list