set the LimitMEMLOCK=infinity (whcih means jobs are unrestricted) hopefully this allows the use the mellanox communciation lib in mpi jobs