Re: lib/54017: jemalloc deadlock?

[Thomas Klausner <wiz%NetBSD.org@localhost>]

The following reply was made to PR lib/54017; it has been noted by GNATS.

From: Thomas Klausner <wiz%NetBSD.org@localhost>
To: gnats-bugs%NetBSD.org@localhost
Cc: Christos Zoulas <christos%zoulas.com@localhost>
Subject: Re: lib/54017: jemalloc deadlock?
Date: Sun, 10 Mar 2019 00:01:32 +0100

 I have installed a userland with the new jemalloc, but not rebuilt all
 packages. Do I have to?
 
 For thunderbird I see:
 
 ld: ../../../../memory/mozalloc/Unified_cpp_memory_mozalloc0.o:(.bss.malloc=
 _conf+0x0): multiple definition of `malloc_conf'; ../../../../memory/build/=
 Unified_cpp_memory_build0.o:(.bss.malloc_conf+0x0): first defined here
 ld: ../../../../memory/mozalloc/Unified_cpp_memory_mozalloc0.o:(.bss.malloc=
 _message+0x0): multiple definition of `malloc_message'; ../../../../memory/=
 build/Unified_cpp_memory_build0.o:(.bss.malloc_message+0x0): first defined =
 here
 
 Not sure if that is relevant, but the build doesn't finish.
 
 
 tor-browser (mostly same code as firefox) failed with:
 
 error: build failed
 gmake[3]: *** [/scratch/security/tor-browser/work/tor-browser/config/rules.=
 mk:979: force-cargo-library-build] Error 101
 
 (I had not rebuilt rust with the new jemalloc.)
 
 And the firefox build seems stuck in cargo:
 gmake[3]: Entering directory '/scratch/www/firefox/work/build/js/src/fronte=
 nd/binsource'
 js/src/frontend/binsource/force-cargo-host-program-build
 env   CARGO_TARGET_DIR=3D. RUSTFLAGS=3D'-C opt-level=3D2 ' RUSTC=3D/usr/pkg=
 /bin/rustc RUSTDOC=3D/usr/pkg/bin/rustdoc RUSTFMT=3D/usr/pkg/bin/rustfmt CC=
 _x86_64_unknown_netbsd=3D" /scratch/www/firefox/work/.cwrapper/bin/gcc" CXX=
 _x86_64_unknown_netbsd=3D" /scratch/www/firefox/work/.cwrapper/bin/c++" CFL=
 AGS_x86_64_unknown_netbsd=3D"-I/scratch/www/firefox/work/build/dist/system_=
 wrappers -include /scratch/www/firefox/work/firefox-65.0.2/config/gcc_hidde=
 n.h -DNDEBUG=3D1 -DTRIMMED=3D1 -I/scratch/www/firefox/work/firefox-65.0.2/j=
 s/src/frontend/binsource -I/scratch/www/firefox/work/build/js/src/frontend/=
 binsource -I/scratch/www/firefox/work/build/dist/include -I/usr/pkg/include=
 /nspr -fPIC -DPIC -include /scratch/www/firefox/work/build/js/src/js-confde=
 fs.h -DMOZILLA_CLIENT -g -I/usr/include -I/usr/pkg/include -I/usr/pkg/inclu=
 de/nspr -I/usr/pkg/include/nss/nss -I/usr/pkg/include/libdrm -I/usr/pkg/inc=
 lude/glib/glib-2.0 -I/usr/pkg/include/glib/gio-unix-2.0 -I/usr/pkg/lib/glib=
 -2.0/include -I/usr/pkg/include/ffmpeg4 -I/usr/pkg/include/freetype2 -U_FOR=
 TIFY_SOURCE -D_FORTIFY_SOURCE=3D2 -O2 -I/usr/pkg/include/nspr -D_GLIBCXX_IN=
 CLUDE_NEXT_C_HEADERS -g -D_FORTIFY_SOURCE=3D2 -fstack-check -I/usr/include =
 -I/usr/pkg/include -I/usr/pkg/include/nss/nss -I/usr/pkg/include/libdrm -I/=
 usr/pkg/include/glib/glib-2.0 -I/usr/pkg/include/glib/gio-unix-2.0 -I/usr/p=
 kg/lib/glib-2.0/include -I/usr/pkg/include/ffmpeg4 -I/usr/pkg/include/freet=
 ype2 -U_FORTIFY_SOURCE
 -D_FORTIFY_SOURCE=3D2 -Dunix -ffunction-sections -fdata-sections -fno-math-=
 errno -pthread -pipe -I/usr/pkg/include -O2 -fomit-frame-pointer -funwind-t=
 ables -Wall -Wempty-body -Wignored-qualifiers -Wpointer-arith -Wsign-compar=
 e -Wtype-limits -Wunreachable-code -Wduplicated-cond -Wno-error=3Dmaybe-uni=
 nitialized -Wno-error=3Ddeprecated-declarations -Wno-error=3Darray-bounds -=
 Wno-error=3Dfree-nonheap-object -Wformat -Wformat-overflow=3D2" CXXFLAGS_x8=
 6_64_unknown_netbsd=3D"-I/scratch/www/firefox/work/build/dist/system_wrappe=
 rs -include /scratch/www/firefox/work/firefox-65.0.2/config/gcc_hidden.h -D=
 NDEBUG=3D1 -DTRIMMED=3D1 -I/scratch/www/firefox/work/firefox-65.0.2/js/src/=
 frontend/binsource -I/scratch/www/firefox/work/build/js/src/frontend/binsou=
 rce -I/scratch/www/firefox/work/build/dist/include -I/usr/pkg/include/nspr =
 -fPIC -DPIC -DMOZILLA_CLIENT -include /scratch/www/firefox/work/build/js/sr=
 c/js-confdefs.h -g -I/usr/include -I/usr/pkg/include -I/usr/pkg/include/nsp=
 r -I/usr/pkg/include/nss/nss -I/usr/pkg/include/libdrm -I/usr/pkg/include/g=
 lib/glib-2.0 -I/usr/pkg/include/glib/gio-unix-2.0 -I/usr/pkg/lib/glib-2.0/i=
 nclude -I/usr/pkg/include/ffmpeg4 -I/usr/pkg/include/freetype2 -U_FORTIFY_S=
 OURCE -D_FORTIFY_SOURCE=3D2 -Wall -Wempty-body -Wignored-qualifiers -Woverl=
 oaded-virtual -Wpointer-arith -Wsign-compare -Wtype-limits -Wunreachable-co=
 de -Wwrite-strings -Wno-invalid-offsetof -Wc++1z-compat -Wduplicated-cond -=
 Wimplicit-fallthrough -Wno-error=3Dmaybe-uninitialized -Wno-error=3Ddepreca=
 ted-declarations -Wno-error=3Darray-bounds -Wno-error=3Dfree-nonheap-object=
  -Wformat -Wformat-overflow=3D2 -Wno-noexcept-type -fno-sized-deallocation =
 -O2 -I/usr/pkg/include/nspr -D_GLIBCXX_INCLUDE_NEXT_C_HEADERS -g -D_FORTIFY=
 _SOURCE=3D2 -fstack-check -I/usr/include -I/usr/pkg/include -I/usr/pkg/incl=
 ude/nss/nss -I/usr/pkg/include/libdrm -I/usr/pkg/include/glib/glib-2.0 -I/u=
 sr/pkg/include/glib/gio-unix-2.0 -I/usr/pkg/lib/glib-2.0/include -I/usr/pkg=
 /include/ffmpeg4 -I/usr/pkg/include/freetype2 -D__HAVE_INLINE___ISINF -U_FO=
 RTIFY_SOURCE -D_FORTIFY_SOURCE=3D2 -Dunix -fno-rtti -ffunction-sections -fd=
 ata-sections -fno-exceptions -fno-math-errno -pthread -pipe -I/usr/pkg/incl=
 ude -O2 -fomit-frame-pointer -funwind-tables" AR_x86_64_unknown_netbsd=3D"a=
 r"  MOZ_SRC=3D/scratch/www/firefox/work/firefox-65.0.2 MOZ_DIST=3D/scratch/=
 www/firefox/work/build/dist LIBCLANG_PATH=3D"/usr/pkg/lib" CLANG_PATH=3D"/u=
 sr/pkg/bin/clang" PKG_CONFIG_ALLOW_CROSS=3D1 RUST_BACKTRACE=3Dfull MOZ_TOPO=
 BJDIR=3D/scratch/www/firefox/work/build   /usr/pkg/bin/cargo rustc  --relea=
 se --frozen --manifest-path
 /scratch/www/firefox/work/firefox-65.0.2/js/src/frontend/binsource/Cargo.to=
 ml --bin binsource --target=3Dx86_64-unknown-netbsd
 (no line for leaving that directory in the log.)
 gmake[3]: Leaving directory '/scratch/www/firefox/work/build/gfx/thebes'
 (nothing after that)
 
 29378 2000      43    0   312M   42M parked/5   0:02  0.00%  0.00% cargo
 
 I tried looking at it but:
 
 # gdb /usr/pkg/bin/cargo 29378
 GNU gdb (GDB) 8.0.1
 Copyright (C) 2017 Free Software Foundation, Inc.
 License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.htm=
 l>
 This is free software: you are free to change and redistribute it.
 There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
 and "show warranty" for details.
 This GDB was configured as "x86_64--netbsd".
 Type "show configuration" for configuration details.
 For bug reporting instructions, please see:
 <http://www.gnu.org/software/gdb/bugs/>.
 Find the GDB manual and other documentation resources online at:
 <http://www.gnu.org/software/gdb/documentation/>.
 For help, type "help".
 Type "apropos word" to search for commands related to "word"...
 Reading symbols from /usr/pkg/bin/cargo...done.
 Attaching to program: /usr/pkg/bin/cargo, process 29378
 ptrace: Operation not permitted.
 /usr/pkgsrc/www/firefox/29378: No such file or directory.
 (gdb)
 
 Cheers,
  Thomas