[Ocfs2-users] Ocfs2-users Digest, Vol 90, Issue 2

Vasyl S. Kostroma admin at v-sf.info
Thu Jun 2 22:21:47 PDT 2011


Ok, different thing.
On ext4 partition my folder size is 14Gb
On ocfs2 partition it's ... 645Gb! How is it possible?!

-----Исходное сообщение----- 
From: ocfs2-users-request at oracle.com
Sent: Thursday, June 02, 2011 10:59 PM
To: ocfs2-users at oss.oracle.com
Subject: Ocfs2-users Digest, Vol 90, Issue 2

Send Ocfs2-users mailing list submissions to
ocfs2-users at oss.oracle.com

To subscribe or unsubscribe via the World Wide Web, visit
http://oss.oracle.com/mailman/listinfo/ocfs2-users
or, via email, send a message with subject or body 'help' to
ocfs2-users-request at oss.oracle.com

You can reach the person managing the list at
ocfs2-users-owner at oss.oracle.com

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Ocfs2-users digest..."


Today's Topics:

   1. Problems with descriptions. (Vasyl S. Kostroma)
   2. Re: Problems with descriptions. (S?rgio Surkamp)
   3. Re: Problems with descriptions. (Sunil Mushran)


----------------------------------------------------------------------

Message: 1
Date: Thu, 2 Jun 2011 09:37:37 +0400
From: "Vasyl S. Kostroma" <admin at v-sf.info>
Subject: [Ocfs2-users] Problems with descriptions.
To: <ocfs2-users at oss.oracle.com>
Message-ID: <4B669AA1916A4A56A3D63CE75CE69142 at VasylD>
Content-Type: text/plain; charset="utf-8"

Hi guys!
I can?t find an answer in google, so my last hope is this mailing list.

Story.
I have two servers with same arrays. Servers connected by DRBD.
I used ocfs2 as file system, also I used NFS4 to access to the
ocfs2 drive. I do not have any idea, but the allocated descriptors in
/proc/sys/fs/file-nr increasing every time while drive accessed.
So after some time allocated descriptions over max value and all
processes make error ?To much opened files? (something like
this). I do not see any error messages in log files... Any idea?
I haven?t sleep two days

Thank you all in advance.

Configs:
cat /etc/drbd.conf
# You can find an example in  /usr/share/doc/drbd.../drbd.conf.example

include "drbd.d/global_common.conf";
include "drbd.d/*.res";


resource nfs {

        protocol C;

        handlers {
                split-brain "/usr/lib/drbd/notify-split-brain.sh root";
                pri-on-incon-degr "echo o > /proc/sysrq-trigger ; halt -f";
                pri-lost-after-sb "echo o > /proc/sysrq-trigger ; halt -f";
                local-io-error "echo o > /proc/sysrq-trigger ; halt -f";
        }

        startup {
                become-primary-on both;
                degr-wfc-timeout 120;
        }

        disk {
                on-io-error detach;
        }

        net {
                cram-hmac-alg sha1;
                shared-secret "password";
                allow-two-primaries;
                after-sb-0pri discard-zero-changes;
                after-sb-1pri discard-secondary;
                after-sb-2pri disconnect;
                rr-conflict disconnect;
        }

        syncer {
                rate 500M;
                verify-alg sha1;
                al-extents 257;
        }

        on st01 {
                device  /dev/drbd0;
                disk    /dev/sdb;
                address 192.168.3.151:7788;
                meta-disk internal;
        }

        on st02 {
                device  /dev/drbd0;
                disk    /dev/sdb;
                address 192.168.3.152:7788;
                meta-disk internal;
        }
}

---
cat /etc/ocfs2/cluster.conf
#/etc/ocfs2/cluster.conf
node:
    ip_port = 7777
    ip_address = 192.168.1.151
    number = 1
    name = st01
    cluster = ocfs2

node:
    ip_port = 7777
    ip_address = 192.168.1.152
    number = 2
    name = st02
    cluster = ocfs2

cluster:
    node_count = 2
    name = ocfs2
---
cat /etc/exports
# /etc/exports: the access control list for filesystems which may be 
exported
#               to NFS clients.  See exports(5).
/snfs 
192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check,fsid=0)
/snfs/projects 
192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check)
/snfs/configs 
192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check)
/snfs/variables 
192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check)
/snfs/backups 
192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check)
---
-------------- next part --------------
An HTML attachment was scrubbed...
URL: 
http://oss.oracle.com/pipermail/ocfs2-users/attachments/20110602/2ee78406/attachment-0001.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 1088 bytes
Desc: not available
Url : 
http://oss.oracle.com/pipermail/ocfs2-users/attachments/20110602/2ee78406/attachment-0001.png

------------------------------

Message: 2
Date: Thu, 2 Jun 2011 11:28:07 -0300
From: S?rgio Surkamp <sergio at gruposinternet.com.br>
Subject: Re: [Ocfs2-users] Problems with descriptions.
To: ocfs2-users at oss.oracle.com
Message-ID: <20110602112807.398b3992 at icedearth.corp.grupos.com.br>
Content-Type: text/plain; charset=utf-8

Maybe some problem with NFSv4, as OCFS2 officially support only NFSv2
and NFSv3. Try to export the volume with NFSv3 only. Also note that
DRDB isn't officially supported too.

Regards,
S?rgio

Em Thu, 2 Jun 2011 09:37:37 +0400
"Vasyl S. Kostroma" <admin at v-sf.info> escreveu:

> Hi guys!
> I can?t find an answer in google, so my last hope is this mailing
> list.
>
> Story.
> I have two servers with same arrays. Servers connected by DRBD.
> I used ocfs2 as file system, also I used NFS4 to access to the
> ocfs2 drive. I do not have any idea, but the allocated descriptors in
> /proc/sys/fs/file-nr increasing every time while drive accessed.
> So after some time allocated descriptions over max value and all
> processes make error ?To much opened files? (something like
> this). I do not see any error messages in log files... Any idea?
> I haven?t sleep two days
>
> Thank you all in advance.
>
> Configs:
> cat /etc/drbd.conf
> # You can find an example in  /usr/share/doc/drbd.../drbd.conf.example
>
> include "drbd.d/global_common.conf";
> include "drbd.d/*.res";
>
>
> resource nfs {
>
>         protocol C;
>
>         handlers {
>                 split-brain "/usr/lib/drbd/notify-split-brain.sh
> root"; pri-on-incon-degr "echo o > /proc/sysrq-trigger ; halt -f";
>                 pri-lost-after-sb "echo o > /proc/sysrq-trigger ;
> halt -f"; local-io-error "echo o > /proc/sysrq-trigger ; halt -f";
>         }
>
>         startup {
>                 become-primary-on both;
>                 degr-wfc-timeout 120;
>         }
>
>         disk {
>                 on-io-error detach;
>         }
>
>         net {
>                 cram-hmac-alg sha1;
>                 shared-secret "password";
>                 allow-two-primaries;
>                 after-sb-0pri discard-zero-changes;
>                 after-sb-1pri discard-secondary;
>                 after-sb-2pri disconnect;
>                 rr-conflict disconnect;
>         }
>
>         syncer {
>                 rate 500M;
>                 verify-alg sha1;
>                 al-extents 257;
>         }
>
>         on st01 {
>                 device  /dev/drbd0;
>                 disk    /dev/sdb;
>                 address 192.168.3.151:7788;
>                 meta-disk internal;
>         }
>
>         on st02 {
>                 device  /dev/drbd0;
>                 disk    /dev/sdb;
>                 address 192.168.3.152:7788;
>                 meta-disk internal;
>         }
> }
>
> ---
> cat /etc/ocfs2/cluster.conf
> #/etc/ocfs2/cluster.conf
> node:
>     ip_port = 7777
>     ip_address = 192.168.1.151
>     number = 1
>     name = st01
>     cluster = ocfs2
>
> node:
>     ip_port = 7777
>     ip_address = 192.168.1.152
>     number = 2
>     name = st02
>     cluster = ocfs2
>
> cluster:
>     node_count = 2
>     name = ocfs2
> ---
> cat /etc/exports
> # /etc/exports: the access control list for filesystems which may be
> exported #               to NFS clients.  See exports(5).
> /snfs
> 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check,fsid=0) 
> /snfs/projects
> 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check) /snfs/configs
> 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check) /snfs/variables
> 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check) /snfs/backups
> 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check) ---



-- 
  .:''''':.
.:'        `     S?rgio Surkamp | Gerente de Rede
::    ........   sergio at gruposinternet.com.br
`:.        .:'
  `:,   ,.:'     *Grupos Internet S.A.*
    `: :'        R. Lauro Linhares, 2123 Torre B - Sala 201
     : :         Trindade - Florian?polis - SC
     :.'
     ::          +55 48 3234-4109
     :
     '           http://www.gruposinternet.com.br



------------------------------

Message: 3
Date: Thu, 02 Jun 2011 11:59:13 -0700
From: Sunil Mushran <sunil.mushran at oracle.com>
Subject: Re: [Ocfs2-users] Problems with descriptions.
To: ocfs2-users at oss.oracle.com
Message-ID: <4DE7DD81.2000801 at oracle.com>
Content-Type: text/plain; charset="utf-8"

That's the number of files open on the system. So this looks like
an app problem. Some app has many files open.

On 06/01/2011 10:37 PM, Vasyl S. Kostroma wrote:
> Hi guys!
> I can?t find an answer in google, so my last hope is this mailing list.
> Story.
> I have two servers with same arrays. Servers connected by DRBD.
> I used ocfs2 as file system, also I used NFS4 to access to the
> ocfs2 drive. I do not have any idea, but the allocated descriptors in
> /proc/sys/fs/file-nr increasing every time while drive accessed.
> So after some time allocated descriptions over max value and all
> processes make error ?To much opened files? (something like
> this). I do not see any error messages in log files... Any idea?
> I haven?t sleep two days ????????? ??????
> Thank you all in advance.
> Configs:
> /cat /etc/drbd.conf/
> /# You can find an example in  /usr/share/doc/drbd.../drbd.conf.example/
> //
> /include "drbd.d/global_common.conf";/
> /include "drbd.d/*.res";/
> //
> //
> /resource nfs {/
> //
> /        protocol C;/
> //
> /        handlers {/
> /                split-brain "/usr/lib/drbd/notify-split-brain.sh root";/
> /                pri-on-incon-degr "echo o > /proc/sysrq-trigger ; 
> halt -f";/
> /                pri-lost-after-sb "echo o > /proc/sysrq-trigger ; 
> halt -f";/
> /                local-io-error "echo o > /proc/sysrq-trigger ; halt -f";/
> /        }/
> //
> /        startup {/
> /                become-primary-on both;/
> /                degr-wfc-timeout 120;/
> /        }/
> //
> /        disk {/
> /                on-io-error detach;/
> /        }/
> //
> /        net {/
> /                cram-hmac-alg sha1;/
> /                shared-secret "password";/
> //
> /                allow-two-primaries;/
> /                after-sb-0pri discard-zero-changes;/
> /                after-sb-1pri discard-secondary;/
> /                after-sb-2pri disconnect;/
> /                rr-conflict disconnect;/
> /        }/
> //
> /        syncer {/
> /                rate 500M;/
> /                verify-alg sha1;/
> /                al-extents 257;/
> /        }/
> //
> /        on st01 {/
> /                device  /dev/drbd0;/
> /                disk    /dev/sdb;/
> /                address 192.168.3.151:7788;/
> /                meta-disk internal;/
> /        }/
> //
> /        on st02 {/
> /                device  /dev/drbd0;/
> /                disk    /dev/sdb;/
> /                address 192.168.3.152:7788;/
> /                meta-disk internal;/
> /        }/
> /}/
> ---
> /cat /etc/ocfs2/cluster.conf/
> /#/etc/ocfs2/cluster.conf/
> /node:/
> /    ip_port = 7777/
> /    ip_address = 192.168.1.151/
> /    number = 1/
> /    name = st01/
> /    cluster = ocfs2/
> //
> /node:/
> /    ip_port = 7777/
> /    ip_address = 192.168.1.152/
> /    number = 2/
> /    name = st02/
> /    cluster = ocfs2/
> //
> /cluster:/
> /    node_count = 2/
> /    name = ocfs2/
> /---/
> /cat /etc/exports/
> /# /etc/exports: the access control list for filesystems which may be 
> exported/
> /#               to NFS clients.  See exports(5)./
> //snfs 
> 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check,fsid=0)/
> //snfs/projects 
> 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check)/
> //snfs/configs 
> 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check)/
> //snfs/variables 
> 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check)/
> //snfs/backups 
> 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check)/
> ---
>
>
> _______________________________________________
> Ocfs2-users mailing list
> Ocfs2-users at oss.oracle.com
> http://oss.oracle.com/mailman/listinfo/ocfs2-users

-------------- next part --------------
An HTML attachment was scrubbed...
URL: 
http://oss.oracle.com/pipermail/ocfs2-users/attachments/20110602/d4a74063/attachment.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 1088 bytes
Desc: not available
Url : 
http://oss.oracle.com/pipermail/ocfs2-users/attachments/20110602/d4a74063/attachment.png

------------------------------

_______________________________________________
Ocfs2-users mailing list
Ocfs2-users at oss.oracle.com
http://oss.oracle.com/mailman/listinfo/ocfs2-users

End of Ocfs2-users Digest, Vol 90, Issue 2
****************************************** 




More information about the Ocfs2-users mailing list