Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

aarch64: openjdk11 crashed on OSv in JIT mode #1157

Closed
wkozaczuk opened this issue Jun 30, 2021 · 0 comments
Closed

aarch64: openjdk11 crashed on OSv in JIT mode #1157

wkozaczuk opened this issue Jun 30, 2021 · 0 comments
Labels
aarch64

Comments

@wkozaczuk
Copy link
Collaborator

wkozaczuk commented Jun 30, 2021 •
edited
Loading

Sometimes when running java-example or always when hitting java-httpserver with curl, OSv crashes like so:

OSv v0.55.0-241-g8d4039b3
eth0: 192.168.122.15
Booted up in 61.89 ms
Cmdline: /usr/lib/jvm/java/bin/java -cp /java-httpserver HttpServerApp !
Listening on port 8000 ...
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x0000200009248830, pid=2, tid=47
#
# JRE version: OpenJDK Runtime Environment (11.0.10+9) (build 11.0.10+9-Ubuntu-0ubuntu1.20.10)
# Java VM: OpenJDK 64-Bit Server VM (11.0.10+9-Ubuntu-0ubuntu1.20.10, mixed mode, tiered, compressed oops, serial gc, linux-aarch64)
# Problematic frame:
# v  ~BufferBlob::I2C/C2I adapters
#
# Core dump will be written. Default location: core.2 (may not exist)
#
# An error report file with more information is saved as:
# /tmp/hs_err_pid2.log
Could not load hsdis-aarch64.so; library not loadable; PrintAssembly is disabled
#
# If you would like to submit a bug report, please visit:
#   https://bugs.launchpad.net/ubuntu/+source/openjdk-lts
#
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x0000200009248830, pid=2, tid=47
#
# JRE version: OpenJDK Runtime Environment (11.0.10+9) (build 11.0.10+9-Ubuntu-0ubuntu1.20.10)
# Java VM: OpenJDK 64-Bit Server VM (11.0.10+9-Ubuntu-0ubuntu1.20.10, mixed mode, tiered, compressed oops, serial gc, linux-aarch64)
# Problematic frame:
# v  ~BufferBlob::I2C/C2I adapters
#
# Core dump will be written. Default location: core.2 (may not exist)
#
# If you would like to submit a bug report, please visit:
#   https://bugs.launchpad.net/ubuntu/+source/openjdk-lts
#

---------------  S U M M A R Y ------------

Command Line: HttpServerApp

Host: AArch64, 1 cores, 1G, Linux
Time: Sat Apr 24 04:10:05 2021 UTC elapsed time: 13.255518 seconds (0d 0h 0m 13s)

---------------  T H R E A D  ---------------

Current thread (0xffff900042e8b000):  JavaThread "HTTP-Dispatcher" [_thread_in_Java, id=47, stack(0x000020007a801000,0x000020007aa00000)]

Stack: [0x000020007a801000,0x000020007aa00000],  sp=0x000020007a9fdb40,  free space=2034k
Native frames: (J=compiled Java code, A=aot compiled Java code, j=interpreted, Vv=VM code, C=native code)
v  ~BufferBlob::I2C/C2I adapters
J 356 c1 java.lang.invoke.InvokerBytecodeGenerator.emitStaticInvoke(Ljava/lang/invoke/MemberName;Ljava/lang/invoke/LambdaForm$Name;)V [email protected] (258 bytes) @ 0x000020000982c21c [0x000020000982be00+0x000000000000041c]
C  0x0000200078a6de18


siginfo: si_signo: 11 (SIGSEGV), si_code: 2057296688 (unknown), si_errno: 8192, si_addr: 0x0000a00042f0f000

Register to memory mapping:

R0=0x00002000188d48c0
R1=0x00002000188d3f40
R2=0x00000000000000c0
R3=0x00002000188d48c0
R4=0x00002000188d3f40
R5=0x0000200078a67c70
R6=0x0000000014400026
R7=0x0000000000000008
R8=0x0000200038673e80
R9=0x0000a00042f0f580
R10=0x000020007a9fdb40
R11=0x00001000010c0720
R12=0x0000200078a6f057
R13=0x000020007a9ff080
R14=0x000020007a9fdb30
R15=0x000000000000000c
R16=0x0000200078a720a8
R17=0x0000200018400000
R18=0xffff900042e8b000
R19=0x000020007a9fde40
R20=0x000020007a9fdb40
R21=0x00001000010c0720
R22=0x0000200078a6f057
R23=0x000020007a9ff080
R24=0x000020007a9fdb30
R25=0x000000000000000c
R26=0x0000200078a720a8
R27=0x0000200018400000
R28=0xffff900042e8b000
R29=0x000020007a9fde40
R30=0x0000200009822ed4


Registers:
R0 =0x00002000188d48c0 is an oop: java.lang.String 
{0x00002000188d48c0} - klass: 'java/lang/String'
R1 =0x00002000188d3f40 is an oop: jdk.internal.org.objectweb.asm.MethodWriter 
{0x00002000188d3f40} - klass: 'jdk/internal/org/objectweb/asm/MethodWriter'
R2 =
[error occurred during error reporting (printing registers, top of stack, instructions near pc), id 0xb, SIGSEGV (0xb) at pc=0x00001000010cc000]

Stack slot to memory mapping:
stack at sp + 0 slots: 0x000020007a9fe020 is pointing into the stack for thread: 0xffff900042e8b000
stack at sp + 1 slots: 
[error occurred during error reporting (inspecting top of stack), id 0xb, SIGSEGV (0xb) at pc=0x00001000010cc000]



---------------  P R O C E S S  ---------------

Threads class SMR info:
_java_thread_list=0xffffa00042e89080, length=11, elements={
0xffff90004176b000, 0xffff9000bf004000, 0xffff90004178b000, 0xffff900041788000,
0xffff9000be804000, 0xffff9000be603000, 0xffff900041780000, 0xffff9000424e8000,
0xffff900042cc5000, 0xffff900042e8b000, 0xffff90004111a000
}

Java Threads: ( => current thread )
  0xffff90004176b000 JavaThread "Reference Handler" daemon [_thread_blocked, id=37, stack(0x0000200079201000,0x0000200079400000)]
  0xffff9000bf004000 JavaThread "Finalizer" daemon [_thread_blocked, id=38, stack(0x0000200079401000,0x0000200079600000)]
  0xffff90004178b000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=39, stack(0x0000200079601000,0x0000200079800000)]
  0xffff900041788000 JavaThread "Service Thread" daemon [_thread_blocked, id=40, stack(0x0000200079801000,0x0000200079a00000)]
  0xffff9000be804000 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=41, stack(0x0000200079a01000,0x0000200079c00000)]
  0xffff9000be603000 JavaThread "C1 CompilerThread0" daemon [_thread_blocked, id=42, stack(0x0000200079c01000,0x0000200079e00000)]
  0xffff900041780000 JavaThread "Sweeper thread" daemon [_thread_blocked, id=43, stack(0x0000200079e01000,0x000020007a000000)]
  0xffff9000424e8000 JavaThread "Common-Cleaner" daemon [_thread_blocked, id=45, stack(0x000020007a401000,0x000020007a600000)]
  0xffff900042cc5000 JavaThread "server-timer" daemon [_thread_blocked, id=46, stack(0x000020007a601000,0x000020007a800000)]
=>0xffff900042e8b000 JavaThread "HTTP-Dispatcher" [_thread_in_Java, id=47, stack(0x000020007a801000,0x000020007aa00000)]
  0xffff90004111a000 JavaThread "DestroyJavaVM" [_thread_blocked, id=35, stack(0x0000200000801000,0x0000200000a00000)]

Other Threads:
  0xffff90004173f000 VMThread "VM Thread" [stack: 0x0000200078e01000,0x0000200079001000] [id=36]
  0xffff9000424f6000 WatcherThread [stack: 0x000020007a001000,0x000020007a201000] [id=44]

Threads with active compile tasks:

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap address: 0x0000200018600000, size: 512 MB, Compressed Oops mode: Non-zero based: 0x0000200018400000, Oop shift amount: 3
Narrow klass base: 0x0000200038600000, Narrow klass shift: 0
Compressed class space size: 1073741824 Address: 0x0000200038600000

Heap:
 def new generation   total 9792K, used 2961K [0x0000200018600000, 0x00002000190a0000, 0x00002000230a0000)
  eden space 8704K,  34% used [0x0000200018600000, 0x00002000188e4758, 0x0000200018e80000)
  from space 1088K,   0% used [0x0000200018e80000, 0x0000200018e80000, 0x0000200018f90000)
  to   space 1088K,   0% used [0x0000200018f90000, 0x0000200018f90000, 0x00002000190a0000)
 tenured generation   total 21888K, used 0K [0x00002000230a0000, 0x0000200024600000, 0x0000200038600000)
   the space 21888K,   0% used [0x00002000230a0000, 0x00002000230a0000, 0x00002000230a0200, 0x0000200024600000)
 Metaspace       used 7274K, capacity 7362K, committed 7424K, reserved 1056768K
  class space    used 671K, capacity 730K, committed 768K, reserved 1048576K

Card table byte_map: [0x00002000182eb000,0x00002000183ec000] _byte_map_base: 0x00001ff018228000

Polling page: 0x0000200000101000

Metaspace:

Usage:
  Non-class:      6.48 MB capacity,     6.45 MB (>99%) used,    21.14 KB ( <1%) free+waste,     7.25 KB ( <1%) overhead. 
      Class:    730.00 KB capacity,   671.02 KB ( 92%) used,    55.30 KB (  8%) free+waste,     3.69 KB ( <1%) overhead. 
       Both:      7.19 MB capacity,     7.10 MB ( 99%) used,    76.44 KB (  1%) free+waste,    10.94 KB ( <1%) overhead. 

Virtual space:
  Non-class space:        8.00 MB reserved,       6.50 MB ( 81%) committed 
      Class space:        1.00 GB reserved,     768.00 KB ( <1%) committed 
             Both:        1.01 GB reserved,       7.25 MB ( <1%) committed 

Chunk freelists:
   Non-Class:  24.00 KB
       Class:  6.00 KB
        Both:  30.00 KB

MaxMetaspaceSize: unlimited
CompressedClassSpaceSize: 1.00 GB

CodeHeap 'non-profiled nmethods': size=120036Kb used=105Kb max_used=105Kb free=119930Kb
 bounds [0x0000200010cc7000, 0x0000200010f37000, 0x0000200018200000]
CodeHeap 'profiled nmethods': size=120032Kb used=735Kb max_used=735Kb free=119296Kb
 bounds [0x000020000978f000, 0x00002000099ff000, 0x0000200010cc7000]
CodeHeap 'non-nmethods': size=5692Kb used=994Kb max_used=1013Kb free=4697Kb
 bounds [0x0000200009200000, 0x0000200009470000, 0x000020000978f000]
 total_blobs=759 nmethods=414 adapters=262
 compilation: enabled
              stopped_count=0, restarted_count=0
 full_count=0

Compilation events (20 events):
Event: 13.232 Thread 0xffff9000be603000  405       3       java.io.DataInputStream::readUTF (5 bytes)
Event: 13.232 Thread 0xffff9000be603000 nmethod 405 0x0000200009843590 code [0x0000200009843740, 0x0000200009843900]
Event: 13.232 Thread 0xffff9000be603000  406  s    3       java.io.BufferedInputStream::read (113 bytes)
Event: 13.233 Thread 0xffff9000be603000 nmethod 406 0x0000200009843990 code [0x0000200009843c00, 0x0000200009844710]
Event: 13.233 Thread 0xffff9000be603000  407       3       java.io.BufferedInputStream::read1 (108 bytes)
Event: 13.234 Thread 0xffff9000be603000 nmethod 407 0x0000200009844990 code [0x0000200009844c40, 0x00002000098455b0]
Event: 13.236 Thread 0xffff9000be603000  408       3       java.io.DataInputStream::readShort (40 bytes)
Event: 13.236 Thread 0xffff9000be603000 nmethod 408 0x0000200009845910 code [0x0000200009845b00, 0x0000200009845fa0]
Event: 13.236 Thread 0xffff9000be603000  409       3       java.io.DataInputStream::readFully (9 bytes)
Event: 13.236 Thread 0xffff9000be603000 nmethod 409 0x0000200009846110 code [0x00002000098462c0, 0x00002000098464c0]
Event: 13.239 Thread 0xffff9000be804000  410       4       java.lang.String::hashCode (49 bytes)
Event: 13.243 Thread 0xffff9000be804000 nmethod 410 0x0000200010ce0790 code [0x0000200010ce0940, 0x0000200010ce0b10]
Event: 13.247 Thread 0xffff9000be603000  411       1       java.net.URL::getProtocol (5 bytes)
Event: 13.247 Thread 0xffff9000be603000 nmethod 411 0x0000200010ce0c10 code [0x0000200010ce0dc0, 0x0000200010ce0f10]
Event: 13.247 Thread 0xffff9000be603000  412       1       java.net.URL::getHost (5 bytes)
Event: 13.247 Thread 0xffff9000be603000 nmethod 412 0x0000200010ce0f90 code [0x0000200010ce1140, 0x0000200010ce1290]
Event: 13.248 Thread 0xffff9000be603000  413       1       jdk.internal.loader.BuiltinClassLoader$LoadedModule::loader (5 bytes)
Event: 13.248 Thread 0xffff9000be603000 nmethod 413 0x0000200010ce1310 code [0x0000200010ce14c0, 0x0000200010ce1610]
Event: 13.251 Thread 0xffff9000be603000  414       3       java.lang.invoke.LambdaForm::uncustomize (57 bytes)
Event: 13.251 Thread 0xffff9000be603000 nmethod 414 0x0000200009846590 code [0x0000200009846780, 0x0000200009846b80]

GC Heap History (0 events):
No events

Deoptimization events (4 events):
Event: 0.347 Thread 0xffff90004111a000 Uncommon trap: trap_request=0xffffff4d fr.pc=0x0000200010ccb4a4 relative=0x0000000000000164
Event: 0.347 Thread 0xffff90004111a000 Uncommon trap: reason=unstable_if action=reinterpret pc=0x0000200010ccb4a4 method=java.lang.String.hashCode()I @ 14 c2
Event: 0.348 Thread 0xffff90004111a000 DEOPT PACKING pc=0x0000200010ccb4a4 sp=0x00002000009fe170
Event: 0.348 Thread 0xffff90004111a000 DEOPT UNPACKING pc=0x000020000922321c sp=0x00002000009fe100 mode 2

Classes redefined (0 events):
No events

Internal exceptions (4 events):
Event: 0.489 Thread 0xffff90004111a000 Exception <a 'java/security/PrivilegedActionException'{0x0000200018726b68}> (0x0000200018726b68) thrown at [src/hotspot/share/prims/jvm.cpp, line 1304]
Event: 0.489 Thread 0xffff90004111a000 Exception <a 'java/security/PrivilegedActionException'{0x0000200018726e38}> (0x0000200018726e38) thrown at [src/hotspot/share/prims/jvm.cpp, line 1304]
Event: 0.744 Thread 0xffff90004111a000 Exception <a 'java/lang/NoSuchMethodError'{0x00002000187bd530}: 'java.lang.Object java.lang.invoke.DirectMethodHandle$Holder.invokeStatic(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, int)'> (0x00002000187bd530) thrown at [src/hotspot/share/interpreter/linkResolver.cpp, line 772]
Event: 0.762 Thread 0xffff90004111a000 Exception <a 'java/lang/NoSuchMethodError'{0x00002000187cb548}: 'java.lang.Object java.lang.invoke.DirectMethodHandle$Holder.invokeStatic(java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, java.lang.Object, int, int)'> (0x00002000187cb548) thrown at [src/hotspot/share/interpreter/linkResolver.cpp, line 772]

Events (20 events):
Event: 13.222 loading class sun/util/calendar/ZoneInfoFile$1
Event: 13.222 loading class sun/util/calendar/ZoneInfoFile$1 done
Event: 13.222 loading class java/io/DataInputStream
Event: 13.222 loading class java/io/DataInput
Event: 13.222 loading class java/io/DataInput done
Event: 13.222 loading class java/io/DataInputStream done
Event: 13.243 loading class sun/util/calendar/ZoneInfoFile$ZoneOffsetTransitionRule
Event: 13.244 loading class sun/util/calendar/ZoneInfoFile$ZoneOffsetTransitionRule done
Event: 13.244 loading class java/text/DateFormat
Event: 13.245 loading class java/text/Format
Event: 13.245 loading class java/text/Format done
Event: 13.245 loading class java/text/DateFormat done
Event: 13.245 loading class java/text/SimpleDateFormat
Event: 13.247 loading class java/text/SimpleDateFormat done
Event: 13.247 Executing VM operation: RevokeBias
Event: 13.247 Executing VM operation: RevokeBias done
Event: 13.250 Executing VM operation: RevokeBias
Event: 13.250 Executing VM operation: RevokeBias done
Event: 13.251 Executing VM operation: RevokeBias
Event: 13.251 Executing VM operation: RevokeBias done


Dynamic libraries:
Can not get library information for pid = 47


VM Arguments:
java_command: HttpServerApp
java_class_path (initial): /java-httpserver
Launcher Type: SUN_STANDARD

[Global flags]
     intx CICompilerCount                          = 2                                         {product} {ergonomic}
   size_t InitialHeapSize                          = 33554432                                  {product} {ergonomic}
   size_t MaxHeapSize                              = 536870912                                 {product} {ergonomic}
   size_t MaxNewSize                               = 178913280                                 {product} {ergonomic}
   size_t MinHeapDeltaBytes                        = 196608                                    {product} {ergonomic}
   size_t NewSize                                  = 11141120                                  {product} {ergonomic}
    uintx NonNMethodCodeHeapSize                   = 5825228                                {pd product} {ergonomic}
    uintx NonProfiledCodeHeapSize                  = 122916506                              {pd product} {ergonomic}
   size_t OldSize                                  = 22413312                                  {product} {ergonomic}
    uintx ProfiledCodeHeapSize                     = 122916506                              {pd product} {ergonomic}
    uintx ReservedCodeCacheSize                    = 251658240                              {pd product} {ergonomic}
     bool SegmentedCodeCache                       = true                                      {product} {ergonomic}
     bool UseCompressedClassPointers               = true                                 {lp64_product} {ergonomic}
     bool UseCompressedOops                        = true                                 {lp64_product} {ergonomic}
     bool UseSerialGC                              = true                                      {product} {ergonomic}

Logging:
Log output configuration:
 #0: stdout all=warning uptime,level,tags
 #1: stderr all=off uptime,level,tags

Environment Variables:

Signal Handlers:
SIGSEGV: [libjvm.so+0xc72680], sa_mask[0]=11111111111111111111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGBUS: [libjvm.so+0xc72680], sa_mask[0]=11111111111111111111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGFPE: [libjvm.so+0xc72680], sa_mask[0]=11111111111111111111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGPIPE: [libjvm.so+0x9df8c0], sa_mask[0]=11111111111111111111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGXFSZ: [libjvm.so+0x9df8c0], sa_mask[0]=11111111111111111111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGILL: [libjvm.so+0xc72680], sa_mask[0]=11111111111111111111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGUSR2: [libjvm.so+0x9df770], sa_mask[0]=00000000000000000000000000000000, sa_flags=SA_RESTART|SA_SIGINFO
SIGHUP: [libjvm.so+0x9dfd10], sa_mask[0]=11111111111111111111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGINT: [libjvm.so+0x9dfd10], sa_mask[0]=11111111111111111111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGTERM: [libjvm.so+0x9dfd10], sa_mask[0]=11111111111111111111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGQUIT: [libjvm.so+0x9dfd10], sa_mask[0]=11111111111111111111111111111111, sa_flags=SA_RESTART|SA_SIGINFO


---------------  S Y S T E M  ---------------

OS:Linux
uname:Linux 3.7.0 #1 SMP aarch64
OS uptime: 0 days 0:00 hours
WARNING!! /proc file system not found.
Java may be unstable running multithreaded in a chroot environment on Linux when /proc filesystem is not mounted.
libc:NPTL 2.16 NPTL 2.16 
rlimit (soft/hard): STACK 1024k/1024k , CORE infinity/infinity , NPROC infinity/infinity , NOFILE 10240/10240 , AS infinity/infinity , CPU infinity/infinity , DATA infinity/infinity , FSIZE infinity/infinity , MEMLOCK infinity/infinity
load average:0.50 0.50 0.50

/proc/meminfo:
MemTotal:	2089232 kB
MemFree: 	2005284 kB

/sys/kernel/mm/transparent_hugepage/enabled:
<Not Available>
/sys/kernel/mm/transparent_hugepage/defrag (defrag/compaction efforts parameter):
<Not Available>

/proc/sys/kernel/threads-max (system-wide limit on the number of threads):
<Not Available>
/proc/sys/vm/max_map_count (maximum number of memory map areas a process may have):
<Not Available>
/proc/sys/kernel/pid_max (system-wide limit on number of process identifiers):
<Not Available>


CPU:total 1 (initial active 1) 0x00:0x0:0x000:0

/proc/cpuinfo:
fp asimd pmull aes sha1 sha2 crc32 a64Online cpus:
<Not Available>
Offline cpus:
<Not Available>

Memory: 4k page, physical 2089232k(2005284k free), swap 0k(0k free)

vm_info: OpenJDK 64-Bit Server VM (11.0.10+9-Ubuntu-0ubuntu1.20.10) for linux-aarch64 JRE (11.0.10+9-Ubuntu-0ubuntu1.20.10), built on Jan 20 2021 02:32:18 by "unknown" with gcc 10.2.0

END.
Aborted

[backtrace]
0x0000100000a719a4 <???+10951076>
0x0000100000d01bb4 <???+13638580>
0x0000100000d02488 <???+13640840>
0x0000100000d02758 <???+13641560>
0x000000004020a228 <call_signal_handler+276>
0x000000004020b990 <???+1075886480>

Please note that in order to get this backtrace, one needs to apply this patch to enable the signal handler.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
aarch64
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@wkozaczuk