Thanks for the help, I really appropriate it. However, I still can not run on more then 4 nodes with all the processors. I have set ARMCI_DEFAULT_SHMMAX to 8092 in my run script and added memory heap 100 mb stack 500 mb global 500 mb to my NWCHEM input file.
Some system info:
OS - RHEL 6
8 cores/socket (2 sockets per node)
32 GB memory per node
Infiniband 4X QDR, Fat Tree, Qlogic chipset
kernel.shmmax = 20971520000
The error again:
argument 1 = PCBM.nw
48:armci_ListenSockAll: listen failed: 0
(rank:48 hostname:node31 pid:44518):ARMCI DASSERT fail. ../../ga-5-1/armci/src/devices/sockets/sockets.c:armci_ListenSockAll():614 cond:0
0:Terminate signal was sent, status=: 15
(rank:0 hostname:node28 pid:106662):ARMCI DASSERT fail. ../../ga-5-1/armci/src/common/signaltrap.c:SigTermHandler():472 cond:0
|