[Ocfs2-users] ocfs2 - disk usage inconsistencies
Sunil Mushran
Sunil.Mushran at oracle.com
Mon Sep 25 18:06:03 PDT 2006
8G consumed by inode_allocs. 1G by the journals.
3099590656 2-May-2006 16:11 inode_alloc:0000
1879048192 2-May-2006 16:11 inode_alloc:0001
3137339392 2-May-2006 16:11 inode_alloc:0002
In ocfs2, a block holds only one inode. If you use 2K blocksize,
you will be reduce this consumption by a half.
In 1.4 we hope to add data-in-the-inode. That will allow users to
use 4K blocksizes for all kinds of usage.
Matthew Flusche wrote:
> I have since formatted the new file system (I'm testing different block
> sizes). But here is the output from the original file system:
>
> [root at tul1tmapp1 ~]# echo "ls -l //" | debugfs.ocfs2 /dev/emcpowera
> debugfs.ocfs2 1.2.1
> debugfs: 10 drwxr-xr-x 6 0 0
> 4096 2-May-2006 16:11 .
> 10 drwxr-xr-x 6 0 0 4096
> 2-May-2006 16:11 ..
> 11 -rw-r--r-- 1 0 0 0
> 2-May-2006 16:11 bad_blocks
> 12 -rw-r--r-- 1 0 0 835584
> 2-May-2006 16:11 global_inode_alloc
> 13 -rw-r--r-- 1 0 0 16384
> 2-May-2006 16:11 slot_map
> 14 -rw-r--r-- 1 0 0 1048576
> 2-May-2006 16:11 heartbeat
> 15 -rw-r--r-- 1 0 0 53687091200
> 2-May-2006 16:11 global_bitmap
> 16 drwxr-xr-x 2 0 0 774144
> 10-Sep-2006 00:08 orphan_dir:0000
> 17 drwxr-xr-x 2 0 0 4096
> 2-May-2006 16:11 orphan_dir:0001
> 18 drwxr-xr-x 2 0 0 94208
> 5-Jul-2006 17:13 orphan_dir:0002
> 19 drwxr-xr-x 2 0 0 4096
> 2-May-2006 16:11 orphan_dir:0003
> 20 -rw-r--r-- 1 0 0 12582912
> 2-May-2006 16:11 extent_alloc:0000
> 21 -rw-r--r-- 1 0 0 0
> 2-May-2006 16:11 extent_alloc:0001
> 22 -rw-r--r-- 1 0 0 0
> 2-May-2006 16:11 extent_alloc:0002
> 23 -rw-r--r-- 1 0 0 0
> 2-May-2006 16:11 extent_alloc:0003
> 24 -rw-r--r-- 1 0 0 3099590656
> 2-May-2006 16:11 inode_alloc:0000
> 25 -rw-r--r-- 1 0 0 1879048192
> 2-May-2006 16:11 inode_alloc:0001
> 26 -rw-r--r-- 1 0 0 3137339392
> 2-May-2006 16:11 inode_alloc:0002
> 27 -rw-r--r-- 1 0 0 0
> 2-May-2006 16:11 inode_alloc:0003
> 28 -rw-r--r-- 1 0 0 268435456
> 2-May-2006 16:11 journal:0000
> 29 -rw-r--r-- 1 0 0 268435456
> 2-May-2006 16:11 journal:0001
> 30 -rw-r--r-- 1 0 0 268435456
> 2-May-2006 16:11 journal:0002
> 31 -rw-r--r-- 1 0 0 268435456
> 2-May-2006 16:11 journal:0003
> 32 -rw-r--r-- 1 0 0 0
> 2-May-2006 16:11 local_alloc:0000
> 33 -rw-r--r-- 1 0 0 0
> 2-May-2006 16:11 local_alloc:0001
> 34 -rw-r--r-- 1 0 0 0
> 2-May-2006 16:11 local_alloc:0002
> 35 -rw-r--r-- 1 0 0 0
> 2-May-2006 16:11 local_alloc:0003
> 36 -rw-r--r-- 1 0 0 0
> 2-May-2006 16:11 truncate_log:0000
> 37 -rw-r--r-- 1 0 0 0
> 2-May-2006 16:11 truncate_log:0001
> 38 -rw-r--r-- 1 0 0 0
> 2-May-2006 16:11 truncate_log:0002
> 39 -rw-r--r-- 1 0 0 0
> 2-May-2006 16:11 truncate_log:0003
> debugfs:
>
> -----Original Message-----
> From: Sunil Mushran [mailto:Sunil.Mushran at oracle.com]
> Sent: Monday, September 25, 2006 5:09 PM
> To: Matthew Flusche
> Cc: Ocfs2-users at oss.oracle.com
> Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies
>
> Do:
> # echo "ls -l //" | debugfs.ocfs2 /dev/sdX
>
> This will list the sizes of the system files. Email me the info.
>
> Matthew Flusche wrote:
>
>> I created another 50 GB OCFS2 file system with the same parameters
>>
> (16k
>
>> cluster 4k block) and copied the contents of the original file system.
>> My 26GB of data only takes up 38GB now (43 GB on the original file
>> system). After I delete all the contents of the new file system,
>>
> there
>
>> is still 3.7 GB used. Any ideas?
>>
>> -----Original Message-----
>> From: ocfs2-users-bounces at oss.oracle.com
>> [mailto:ocfs2-users-bounces at oss.oracle.com] On Behalf Of Matthew
>>
> Flusche
>
>> Sent: Sunday, September 24, 2006 3:06 PM
>> To: Sunil Mushran
>> Cc: Ocfs2-users at oss.oracle.com
>> Subject: RE: [Ocfs2-users] ocfs2 - disk usage inconsistencies
>>
>> I unmounted the file system from each node and ran the fsck.ocfs2 on
>>
> it.
>
>> That cleaned up the orphan_dirs but I did not get my 17 GB of space
>> back. Any other suggestions? Am I going to have to
>> backup,format,restore to fix this?
>>
>> -----Original Message-----
>> From: Sunil Mushran [mailto:Sunil.Mushran at oracle.com]
>> Sent: Wednesday, September 20, 2006 2:31 PM
>> To: Matthew Flusche
>> Cc: Ocfs2-users at oss.oracle.com
>> Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies
>>
>> Yes.
>>
>> Matthew Flusche wrote:
>>
>>
>>> When I stat the only file listed in //orphan_dir:0002 it shows 0
>>> clusters. There are only directories listed in //orphan_dir:0000 and
>>> none of the directories have contents. So my next courses of action
>>> (since I don't know what has these unlinked files opened) would be to
>>> stop every process accessing this file system? Possibly umount/mount
>>> the file system? would fsck.ocfs2 clean this up?
>>>
>>> -----Original Message-----
>>> From: Sunil Mushran [mailto:Sunil.Mushran at oracle.com]
>>> Sent: Wednesday, September 20, 2006 1:52 PM
>>> To: Matthew Flusche
>>> Cc: Ocfs2-users at oss.oracle.com
>>> Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies
>>>
>>> Another node or that node itself.
>>>
>>> As far as the filesize goes, "ls -l" does not give the ondisk size.
>>> Do "stat <inodenum>" on the unlinked files and see the "Clusters".
>>>
>>> Matthew Flusche wrote:
>>>
>>>
>>>
>>>> There has been a lot of file system activity recently.
>>>>
>>>> I have files in orphan_dir:0000 and orphan_dir:0002. But that
>>>>
>>>>
>> doesn't
>>
>>
>>>> seem to account for the 17 GB missing. The truncate logs seem
>>>>
> clean.
>
>>>> So having files in orphan_dir:0000 is telling me that the node in
>>>>
>>>>
>> slot
>>
>>
>>>>
>>>>
>>>>
>>> 0
>>>
>>>
>>>
>>>> deleted files and another node(s) still has the file open, correct?
>>>>
>>>> Matt
>>>>
>>>> debugfs: ls -l //orphan_dir:0000
>>>> 16 drwxr-xr-x 13 0 0 774144
>>>> 10-Sep-2006 00:08 .
>>>> 10 drwxr-xr-x 6 0 0 4096
>>>> 2-May-2006 16:11 ..
>>>> 3052182 drwxrwxrwx 0 501 500 4096
>>>> 19-Jul-2006 17:50 00000000002e9296
>>>> 8234094 drwxrwxrwx 0 501 500 4096
>>>> 19-Jul-2006 17:50 00000000007da46e
>>>> 13063783 drwxrwxrwx 0 501 500 4096
>>>> 19-Jul-2006 17:50 0000000000c75667
>>>> 7869995 drwxrwxrwx 0 501 500 4096
>>>> 22-Aug-2006 13:27 000000000078162b
>>>> 3741473 drwxrwxrwx 0 501 500 4096
>>>> 22-Aug-2006 13:29 0000000000391721
>>>> 3351057 drwxrwxrwx 0 501 500 4096
>>>> 19-Jul-2006 17:50 0000000000332211
>>>> 7842503 drwxrwxrwx 0 501 500 4096
>>>> 19-Jul-2006 17:50 000000000077aac7
>>>> 2056493 drwxrwxrwx 0 501 500 4096
>>>> 5-Sep-2006 08:53 00000000001f612d
>>>> 7861894 drwxrwxrwx 0 501 500 4096
>>>> 5-Sep-2006 08:53 000000000077f686
>>>> 1487817 drwxrwxrwx 0 501 500 4096
>>>> 5-Sep-2006 08:53 000000000016b3c9
>>>> 1702439 drwxrwxrwx 0 501 500 4096
>>>> 5-Sep-2006 08:53 000000000019fa27
>>>>
>>>> debugfs: ls -l //orphan_dir:0002
>>>> 18 drwxr-xr-x 2 0 0 94208
>>>> 5-Jul-2006 17:13 .
>>>> 10 drwxr-xr-x 6 0 0 4096
>>>> 2-May-2006 16:11 ..
>>>> 4301446 -rw-r--r-- 0 503 500 0
>>>> 12-Aug-2006 10:40 000000000041a286
>>>>
>>>> -----Original Message-----
>>>> From: Sunil Mushran [mailto:Sunil.Mushran at oracle.com]
>>>> Sent: Wednesday, September 20, 2006 12:32 PM
>>>> To: Matthew Flusche
>>>> Cc: Ocfs2-users at oss.oracle.com
>>>> Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies
>>>>
>>>> Did you remove some large files recently? If so, check the
>>>>
> orphan_dir
>
>>>> and truncate_log for all the slots.
>>>>
>>>> 1. Start debugfs:
>>>> # debugfs.ocfs2 /dev/sdX
>>>>
>>>> 2. List system directory:
>>>> > ls -l //
>>>>
>>>> 3. List files in all orphan_dir(s):
>>>> > ls -l //orphan_dir:0000
>>>>
>>>> If there are files, means some process in the cluster is still using
>>>>
>
>
>>>> that file.
>>>>
>>>> 4. stat all trancate_log(s):
>>>> > stat //truncate_log:0000
>>>>
>>>> I will be surprised if you see any bits here. If there are, do
>>>> "sync;sync;sync;" on the
>>>> appropriate node.
>>>>
>>>> 5. You can find the appropriate node by dumping the slotmap:
>>>> > slotmap
>>>> Find the slot-to-nodenum mapping. Do the sync on that node.
>>>>
>>>> For this and more, refer to the on-disk format support guide.
>>>>
>>>>
>>>>
>>>>
> http://oss.oracle.com/projects/ocfs2/dist/documentation/03-disk_format.p
>
>>
>>
>>>
>>>
>>>
>>>> df
>>>>
>>>> Matthew Flusche wrote:
>>>>
>>>>
>>>>
>>>>
>>>>> Hi all.
>>>>>
>>>>> I have a 50 GB OCFS2 file system. I'm currently using ~26GB of
>>>>>
> space
>
>>>>>
>>>>>
>>
>>
>>>>> but df is reporting 43 GB used. Any ideas how to find out where the
>>>>>
>
>
>>>>> missing 17GB is at?
>>>>>
>>>>> The file system was formatted with a 16K cluster & 4K block size.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Matt
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
> ------------------------------------------------------------------------
>
>>
>>
>>>
>>>
>>>
>>>>
>>>>
>>>>
>>>>
>>>>> _______________________________________________
>>>>> Ocfs2-users mailing list
>>>>> Ocfs2-users at oss.oracle.com
>>>>> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>> _______________________________________________
>>>> Ocfs2-users mailing list
>>>> Ocfs2-users at oss.oracle.com
>>>> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>>>>
>>>>
>>>>
>>>>
>> _______________________________________________
>> Ocfs2-users mailing list
>> Ocfs2-users at oss.oracle.com
>> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>>
>> _______________________________________________
>> Ocfs2-users mailing list
>> Ocfs2-users at oss.oracle.com
>> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>>
>>
>
> _______________________________________________
> Ocfs2-users mailing list
> Ocfs2-users at oss.oracle.com
> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>
More information about the Ocfs2-users
mailing list