Setting ARMCI DEFAULT SHMMAX properly


Click here for full thread
Forum Vet
Size
The size of ARMCI_DEFAULT_SHMMAX should be about the size or a little larger than the amount of shared memory that is being used.

If you have X cores running on a node, and for each core you specify the shared memory to be Y (this is the global memory in the input, which is per core), your ARMCI_DEFAULT_SHMMAX should be set to X*Y, and this number should be smaller than the shmmax set in the kernel. This should not be an issue as you have only 22 Gbyte per node and the shmmax is way larger than that.

I would say, for your system you have between 1.5-1.6 Gbyte available per core. If you do not specifically specify heap, stack, and global, and only a total, 1/2 of that goes to global shared memory.

Bert