Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issues with RDMA an unsquash #63

Open
fnikolai opened this issue Jan 2, 2023 · 0 comments
Open

Issues with RDMA an unsquash #63

fnikolai opened this issue Jan 2, 2023 · 0 comments

Comments

@fnikolai
Copy link
Member

fnikolai commented Jan 2, 2023

When singularity --unsquash is enabled, the RDMA fails.

Logs:

(gdb) backtrace
#0  0x00007fffe48e33f5 in try_all_drivers () from /usr/lib64/libibverbs.so.1
#1  0x00007fffe48e3bef in ibverbs_get_device_list () from /usr/lib64/libibverbs.so.1
#2  0x00007fffe48e12ba in ibv_get_device_list () from /usr/lib64/libibverbs.so.1
#3  0x00007fffdfdd933e in btl_openib_component_init () from /opt/cluster/openmpi/4.1.2/gcc/11.2.0/lib/openmpi/mca_btl_openib.so
#4  0x00007ffff49003f2 in mca_btl_base_select () from /opt/cluster/openmpi/4.1.2/gcc/11.2.0/lib/libopen-pal.so.40
#5  0x00007fffe5e16454 in mca_bml_r2_component_init () from /opt/cluster/openmpi/4.1.2/gcc/11.2.0/lib/openmpi/mca_bml_r2.so
#6  0x00007ffff632f6d4 in mca_bml_base_init () from /opt/cluster//openmpi/4.1.2/gcc/11.2.0/lib/libmpi.so.40
#7  0x00007ffff637ca74 in ompi_mpi_init () from /opt/cluster//openmpi/4.1.2/gcc/11.2.0/lib/libmpi.so.40
#8  0x00007ffff6313b5e in PMPI_Init () from /opt/cluster//openmpi/4.1.2/gcc/11.2.0/lib/libmpi.so.40
#9  0x000000000040348a in main ()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant