JDK-8291555 : Implement alternative fast-locking scheme
  • Type: Enhancement
  • Component: hotspot
  • Sub-Component: runtime
  • Affected Version: 20
  • Priority: P4
  • Status: Resolved
  • Resolution: Fixed
  • OS: generic
  • CPU: generic
  • Submitted: 2022-07-29
  • Updated: 2024-01-18
  • Resolved: 2023-05-08
The Version table provides details related to the release that this issue/RFE will be addressed.

Unresolved : Release in which this issue/RFE will be addressed.
Resolved: Release in which this issue/RFE has been resolved.
Fixed : Release in which this issue/RFE has been fixed. The release containing this fix may be available for download as an Early Access Release or a General Availability Release.

To download the current JDK release, click here.
JDK 21
21 b22Fixed
Related Reports
Blocks :  
Blocks :  
CSR :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Relates :  
Description
Current stack-locking overloads object headers with pointers into the stack. This makes it difficult to get hold of the actual mark word, because locking can change the header at any time.
Comments
[~rkennke] we run with -XX:+UnlockDiagnosticVMOptions -XX:+UnlockExperimentalVMOptions -XX:LockingMode=0 .
10-05-2023

Ah, I think I understand whats happening. I opened https://bugs.openjdk.org/browse/JDK-8307810.
10-05-2023

[~mbaesken] Could you please open a new issue, link it to this issue, and append the hs-err file? Thanks!
10-05-2023

[~mbaesken] possibly. is it running with LockingMode=2 ? I don't have access to a ppc64 machine, so I can't narrow it down.
10-05-2023

On ppc64 platforms when running with fastdebug binaries we run now into the assertion # Internal Error (/nb/linuxppc64le/jdk/src/hotspot/share/runtime/synchronizer.cpp:1518), pid=122670, tid=122673 # assert(mark.is_neutral()) failed: invariant: header=0x00007a414044dba8 # (in the test runtime/CommandLine/OptionsValidation/TestOptionsWithRanges.java#id3 ) Is this related ?
10-05-2023

Changeset: 7f6358a8 Author: Roman Kennke <rkennke@openjdk.org> Date: 2023-05-08 17:51:39 +0000 URL: https://git.openjdk.org/jdk/commit/7f6358a8b53a35a87c9413c68f8fe6c5fdec0caf
08-05-2023

> > - 1 failed test task: > > - the test task failed due to timeout; a single test, java/foreign/trivial/TestTrivialUpcall.java, > > timed out in that run and was the last test result reported before a ~2.5 gap before the > > test task itself timed out. > > Is this something we need to worry about and investigate? I don't think this failure is related to the fast-locking changes so no I don't think you need to investigate. Obviously it's on my radar though...
08-05-2023

Mach5 testing of v77 with default stack-locking: Mach5 Tier1: - no failures Mach5 Tier2: - no failures Mach5 Tier3: - no failures Mach5 Tier4: - no test failures - the open/test/jdk/:jdk_desktop_part1 test task failed due to a hangup signal, but there are no signs of any test failures in that run Mach5 Tier5: - no failures Mach5 Tier6: - no failures Mach5 Tier7: - no failures Mach5 Tier8: - 5 known, unrelated test failures: - runtime/stack/4732557/b4732557.java#id0 failed 4x due to JDK-8307570 - applications/javafuzzer/BigTest.java failed due to JDK-8307131
08-05-2023

> - 1 failed test task: > - the test task failed due to timeout; a single test, java/foreign/trivial/TestTrivialUpcall.java, > timed out in that run and was the last test result reported before a ~2.5 gap before the > test task itself timed out. Is this something we need to worry about and investigate?
07-05-2023

Mach5 testing of v77 + forced-fast-locking: Mach5 Tier1: - no failures Mach5 Tier2: - no failures Mach5 Tier3: - no failures Mach5 Tier4: - no test failures - the open/test/jdk/:jdk_desktop_part1 test task failed due to a hangup signal, but there are no signs of any test failures in that run Mach5 Tier5: - no failures Mach5 Tier6: - no failures Mach5 Tier7: - no failures Mach5 Tier8: - 4 known, unrelated test failures: - runtime/stack/4732557/b4732557.java#id0 failed due to JDK-8307570 - 1 failed test task: - the test task failed due to timeout; a single test, java/foreign/trivial/TestTrivialUpcall.java, timed out in that run and was the last test result reported before a ~2.5 gap before the test task itself timed out.
07-05-2023

Mach5 testing of v70 with default stack-locking: Mach5 Tier1: - no test failures
05-05-2023

Mach5 testing of v70 + forced-fast-locking: Mach5 Tier1: - no failures Mach5 Tier2: - 1 unknown, probably unrelated test failure: - compiler/c2/Test6851282.java failed with: # Internal Error (/System/Volumes/Data/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S92340/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/d11128e4-39be-4b94-8276-92a557ca6071/runs/994df091-2009-4baf-b5b2-01944f370f3b/workspace/open/src/hotspot/share/opto/type.hpp:1203), pid=11522, tid=30467 # assert(!is_loaded()) failed: only for unloaded types - crashing thread's stack trace: --------------- T H R E A D --------------- Current thread (0x000000010180ac10): JavaThread "C2 CompilerThread2" daemon [_thread_in_native, id=30467, stack(0x0000000170c60000,0x0000000170e63000)] Current CompileTask: C2: 104 107 java.util.ArrayList::add (23 bytes) Stack: [0x0000000170c60000,0x0000000170e63000], sp=0x0000000170e5eda0, free space=2043k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [libjvm.dylib+0x12b0e64] VMError::report_and_die(int, char const*, char const*, char*, Thread*, unsigned char*, void*, void*, char const*, int, unsigned long)+0x4bc (type.hpp:1203) V [libjvm.dylib+0x12b1800] VMError::report_and_die(Thread*, void*, char const*, int, char const*, char const*, char*)+0x40 V [libjvm.dylib+0x670954] report_vm_error(char const*, int, char const*, char const*, ...)+0x6c V [libjvm.dylib+0x8c7800] GraphKit::null_check_common(Node*, BasicType, bool, Node**, bool)+0x41c V [libjvm.dylib+0xd290b4] LibraryCallKit::inline_array_copyOf(bool)+0x4c0 V [libjvm.dylib+0xd1636c] LibraryIntrinsic::generate(JVMState*)+0x164 V [libjvm.dylib+0x726aac] Parse::do_call()+0xc78 V [libjvm.dylib+0xfb3dd4] Parse::do_one_bytecode()+0x280 V [libjvm.dylib+0xfa0e70] Parse::do_one_block()+0x4d8 V [libjvm.dylib+0xf9f03c] Parse::do_all_blocks()+0x5e0 V [libjvm.dylib+0xf9b188] Parse::Parse(JVMState*, ciMethod*, float)+0xbd4 V [libjvm.dylib+0x49a7e0] ParseGenerator::generate(JVMState*)+0x18c V [libjvm.dylib+0x726aac] Parse::do_call()+0xc78 V [libjvm.dylib+0xfb3dd4] Parse::do_one_bytecode()+0x280 V [libjvm.dylib+0xfa0e70] Parse::do_one_block()+0x4d8 V [libjvm.dylib+0xf9f03c] Parse::do_all_blocks()+0x5e0 V [libjvm.dylib+0xf9b188] Parse::Parse(JVMState*, ciMethod*, float)+0xbd4 V [libjvm.dylib+0x49a7e0] ParseGenerator::generate(JVMState*)+0x18c V [libjvm.dylib+0x49ecb0] PredictedCallGenerator::generate(JVMState*)+0x234 V [libjvm.dylib+0x726aac] Parse::do_call()+0xc78 V [libjvm.dylib+0xfb3dd4] Parse::do_one_bytecode()+0x280 V [libjvm.dylib+0xfa0e70] Parse::do_one_block()+0x4d8 V [libjvm.dylib+0xf9f03c] Parse::do_all_blocks()+0x5e0 V [libjvm.dylib+0xf9b188] Parse::Parse(JVMState*, ciMethod*, float)+0xbd4 V [libjvm.dylib+0x49a7e0] ParseGenerator::generate(JVMState*)+0x18c V [libjvm.dylib+0x49ecb0] PredictedCallGenerator::generate(JVMState*)+0x234 V [libjvm.dylib+0x726aac] Parse::do_call()+0xc78 V [libjvm.dylib+0xfb3dd4] Parse::do_one_bytecode()+0x280 V [libjvm.dylib+0xfa0e70] Parse::do_one_block()+0x4d8 V [libjvm.dylib+0xf9f03c] Parse::do_all_blocks()+0x5e0 V [libjvm.dylib+0xf9b188] Parse::Parse(JVMState*, ciMethod*, float)+0xbd4 V [libjvm.dylib+0x49a7e0] ParseGenerator::generate(JVMState*)+0x18c V [libjvm.dylib+0x5d1188] Compile::Compile(ciEnv*, ciMethod*, int, Options, DirectiveSet*)+0x11cc V [libjvm.dylib+0x498d88] C2Compiler::compile_method(ciEnv*, ciMethod*, int, bool, DirectiveSet*)+0x190 V [libjvm.dylib+0x5f1784] CompileBroker::invoke_compiler_on_method(CompileTask*)+0xa0c V [libjvm.dylib+0x5f0ae8] CompileBroker::compiler_thread_loop()+0x3c8 V [libjvm.dylib+0x9c0b50] JavaThread::thread_main_inner()+0x2cc V [libjvm.dylib+0x11ea708] Thread::call_run()+0x134 V [libjvm.dylib+0xf6b7fc] thread_native_entry(Thread*)+0x160 C [libsystem_pthread.dylib+0x706c] _pthread_start+0x94 Mach5 Tier3: - 1 unknown, related test failure: - serviceability/monitoring/ThreadInfo/GetLockOwnerName/GetLockOwnerName.java failed with: # Internal Error (/opt/mach5/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S90932/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/1bb31343-e93d-4142-aafb-122a17ceeab1/runs/8ccc3133-4777-4168-ac0f-33c872850ad4/workspace/open/src/hotspot/share/runtime/lockStack.cpp:68), pid=2035168, tid=2035198 # assert(_base[i] != nullptr) failed: no zapped before top - crashing thread's stack trace: --------------- T H R E A D --------------- Current thread (0x0000fffc682d51e0): JavaThread "MainThread" [_thread_in_vm, id=2035198, stack(0x0000fff9f39f0000,0x0000fff9f3bf0000)] _threads_hazard_ptr=0x0000fff9e80ab650, _nested_threads_hazard_ptr_cnt=0 Stack: [0x0000fff9f39f0000,0x0000fff9f3bf0000], sp=0x0000fff9f3bed8f0, free space=2038k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [libjvm.so+0x10c2a60] LockStack::verify(char const*) const+0x3cc (lockStack.cpp:68) V [libjvm.so+0x15b8d74] Threads::owning_thread_from_object(ThreadsList*, oop)+0x104 (lockStack.inline.hpp:102) V [libjvm.so+0x15b91c8] Threads::owning_thread_from_monitor(ThreadsList*, ObjectMonitor*)+0xa8 (threads.cpp:1224) V [libjvm.so+0x1550f3c] ObjectSynchronizer::get_lock_owner(ThreadsList*, Handle)+0x11c (synchronizer.cpp:1087) V [libjvm.so+0x15af178] ThreadSnapshot::initialize(ThreadsList*, JavaThread*)+0x2b8 (threadService.cpp:942) V [libjvm.so+0x15af904] ThreadDumpResult::add_thread_snapshot(JavaThread*)+0x84 (threadService.cpp:567) V [libjvm.so+0x11a705c] jmm_GetThreadInfo+0x458 (management.cpp:1136) j sun.management.ThreadImpl.getThreadInfo1([JI[Ljava/lang/management/ThreadInfo;)V+0 java.management@21-internal j sun.management.ThreadImpl.getThreadInfo([JI)[Ljava/lang/management/ThreadInfo;+60 java.management@21-internal j sun.management.ThreadImpl.getThreadInfo(JI)Ljava/lang/management/ThreadInfo;+13 java.management@21-internal j GetLockOwnerName.doWork(ILjava/io/PrintStream;)I+426 j GetLockOwnerName.run(ILjava/io/PrintStream;)I+9 j GetLockOwnerName.main([Ljava/lang/String;)V+126 j java.lang.invoke.LambdaForm$DMH+0x0000000801002000.invokeStatic(Ljava/lang/Object;Ljava/lang/Object;)V+10 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x0000000801003400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+33 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+55 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j com.sun.javatest.regtest.agent.MainWrapper$MainTask.run()V+134 j java.lang.Thread.runWith(Ljava/lang/Object;Ljava/lang/Runnable;)V+5 java.base@21-internal j java.lang.Thread.run()V+19 java.base@21-internal v ~StubRoutines::call_stub 0x0000fffc5818016c V [libjvm.so+0xd32184] JavaCalls::call_helper(JavaValue*, methodHandle const&, JavaCallArguments*, JavaThread*)+0x434 (javaCalls.cpp:415) V [libjvm.so+0xd32698] JavaCalls::call_virtual(JavaValue*, Klass*, Symbol*, Symbol*, JavaCallArguments*, JavaThread*)+0x248 (javaCalls.cpp:329) V [libjvm.so+0xd32884] JavaCalls::call_virtual(JavaValue*, Handle, Klass*, Symbol*, Symbol*, JavaThread*)+0x64 (javaCalls.cpp:191) V [libjvm.so+0xe7c964] thread_entry(JavaThread*, JavaThread*)+0xa0 (jvm.cpp:2919) V [libjvm.so+0xd65988] JavaThread::thread_main_inner()+0x184 (javaThread.cpp:719) V [libjvm.so+0x15a1f80] Thread::call_run()+0xac (thread.cpp:215) V [libjvm.so+0x12fcce8] thread_native_entry(Thread*)+0x134 (os_linux.cpp:740) C [libpthread.so.0+0x7908] start_thread+0x188 Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) j sun.management.ThreadImpl.getThreadInfo1([JI[Ljava/lang/management/ThreadInfo;)V+0 java.management@21-internal j sun.management.ThreadImpl.getThreadInfo([JI)[Ljava/lang/management/ThreadInfo;+60 java.management@21-internal j sun.management.ThreadImpl.getThreadInfo(JI)Ljava/lang/management/ThreadInfo;+13 java.management@21-internal j GetLockOwnerName.doWork(ILjava/io/PrintStream;)I+426 j GetLockOwnerName.run(ILjava/io/PrintStream;)I+9 j GetLockOwnerName.main([Ljava/lang/String;)V+126 j java.lang.invoke.LambdaForm$DMH+0x0000000801002000.invokeStatic(Ljava/lang/Object;Ljava/lang/Object;)V+10 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x0000000801003400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+33 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+55 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j com.sun.javatest.regtest.agent.MainWrapper$MainTask.run()V+134 j java.lang.Thread.runWith(Ljava/lang/Object;Ljava/lang/Runnable;)V+5 java.base@21-internal j java.lang.Thread.run()V+19 java.base@21-internal v ~StubRoutines::call_stub 0x0000fffc5818016c
05-05-2023

A pull request was submitted for review. URL: https://git.openjdk.org/jdk/pull/10907 Date: 2022-10-28 20:17:37 +0000
05-05-2023

The following test fails with v70 bits with forced-fast-locking: serviceability/monitoring/ThreadInfo/GetLockOwnerName/GetLockOwnerName.java Here's a snippet from the log file: #section:main ----------messages:(6/301)---------- command: main -agentlib:GetLockOwnerName GetLockOwnerName reason: User specified action: run main/othervm/native -agentlib:GetLockOwnerName GetLockOwnerName started: Thu May 04 22:03:20 UTC 2023 Mode: othervm [/othervm specified] finished: Thu May 04 22:03:36 UTC 2023 elapsed time (seconds): 16.339 ----------configuration:(0/0)---------- ----------System.out:(25/1943)---------- Agent_OnLoad started Agent_OnLoad finished Loaded library: GetLockOwnerName About to execute for 60 seconds. # # A fatal error has been detected by the Java Runtime Environment: # # Internal Error (/opt/mach5/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S90932/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/1bb31343-e93d-4142-aafb-122a17ceeab1/runs/8ccc3133-4777-4168-ac0f-33c872850ad4/workspace/open/src/hotspot/share/runtime/lockStack.cpp:68), pid=2035168, tid=2035198 # assert(_base[i] != nullptr) failed: no zapped before top # # JRE version: Java(TM) SE Runtime Environment (21.0) (fastdebug build 21-internal-LTS-2023-05-04-1946475.daniel.daugherty.8291555forjdk21.git) # Java VM: Java HotSpot(TM) 64-Bit Server VM (fastdebug 21-internal-LTS-2023-05-04-1946475.daniel.daugherty.8291555forjdk21.git, mixed mode, sharing, tiered, compressed class ptrs, z gc, linux-aarch64) # Problematic frame: # V [libjvm.so+0x10c2a60] LockStack::verify(char const*) const+0x3cc # # Core dump will be written. Default location: Core dumps may be processed with "/opt/core.sh %p" (or dumping to /opt/mach5/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S90971/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/32b56a50-b3e5-4ab1-b6bf-3b04c9f9013b/runs/ea14ff3e-cd2d-4d39-8df8-e6931475b2d1/testoutput/test-support/jtreg_open_test_hotspot_jtreg_hotspot_serviceability/scratch/1/core.2035168) # # An error report file with more information is saved as: # /opt/mach5/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S90971/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/32b56a50-b3e5-4ab1-b6bf-3b04c9f9013b/runs/ea14ff3e-cd2d-4d39-8df8-e6931475b2d1/testoutput/test-support/jtreg_open_test_hotspot_jtreg_hotspot_serviceability/scratch/1/hs_err_pid2035168.log # # If you would like to submit a bug report, please visit: # https://bugreport.java.com/bugreport/crash.jsp # ----------System.err:(0/0)---------- ----------rerun:(38/7307)*---------- Here's the crashing thread's stack: --------------- T H R E A D --------------- Current thread (0x0000fffc682d51e0): JavaThread "MainThread" [_thread_in_vm, id=2035198, stack(0x0000fff9f39f0000,0x0000fff9f3bf0000)] _threads_hazard_ptr=0x0000fff9e80ab650, _nested_threads_hazard_ptr_cnt=0 Stack: [0x0000fff9f39f0000,0x0000fff9f3bf0000], sp=0x0000fff9f3bed8f0, free space=2038k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [libjvm.so+0x10c2a60] LockStack::verify(char const*) const+0x3cc (lockStack.cpp:68) V [libjvm.so+0x15b8d74] Threads::owning_thread_from_object(ThreadsList*, oop)+0x104 (lockStack.inline.hpp:102) V [libjvm.so+0x15b91c8] Threads::owning_thread_from_monitor(ThreadsList*, ObjectMonitor*)+0xa8 (threads.cpp:1224) V [libjvm.so+0x1550f3c] ObjectSynchronizer::get_lock_owner(ThreadsList*, Handle)+0x11c (synchronizer.cpp:1087) V [libjvm.so+0x15af178] ThreadSnapshot::initialize(ThreadsList*, JavaThread*)+0x2b8 (threadService.cpp:942) V [libjvm.so+0x15af904] ThreadDumpResult::add_thread_snapshot(JavaThread*)+0x84 (threadService.cpp:567) V [libjvm.so+0x11a705c] jmm_GetThreadInfo+0x458 (management.cpp:1136) j sun.management.ThreadImpl.getThreadInfo1([JI[Ljava/lang/management/ThreadInfo;)V+0 java.management@21-internal j sun.management.ThreadImpl.getThreadInfo([JI)[Ljava/lang/management/ThreadInfo;+60 java.management@21-internal j sun.management.ThreadImpl.getThreadInfo(JI)Ljava/lang/management/ThreadInfo;+13 java.management@21-internal j GetLockOwnerName.doWork(ILjava/io/PrintStream;)I+426 j GetLockOwnerName.run(ILjava/io/PrintStream;)I+9 j GetLockOwnerName.main([Ljava/lang/String;)V+126 j java.lang.invoke.LambdaForm$DMH+0x0000000801002000.invokeStatic(Ljava/lang/Object;Ljava/lang/Object;)V+10 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x0000000801003400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+33 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+55 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j com.sun.javatest.regtest.agent.MainWrapper$MainTask.run()V+134 j java.lang.Thread.runWith(Ljava/lang/Object;Ljava/lang/Runnable;)V+5 java.base@21-internal j java.lang.Thread.run()V+19 java.base@21-internal v ~StubRoutines::call_stub 0x0000fffc5818016c V [libjvm.so+0xd32184] JavaCalls::call_helper(JavaValue*, methodHandle const&, JavaCallArguments*, JavaThread*)+0x434 (javaCalls.cpp:415) V [libjvm.so+0xd32698] JavaCalls::call_virtual(JavaValue*, Klass*, Symbol*, Symbol*, JavaCallArguments*, JavaThread*)+0x248 (javaCalls.cpp:329) V [libjvm.so+0xd32884] JavaCalls::call_virtual(JavaValue*, Handle, Klass*, Symbol*, Symbol*, JavaThread*)+0x64 (javaCalls.cpp:191) V [libjvm.so+0xe7c964] thread_entry(JavaThread*, JavaThread*)+0xa0 (jvm.cpp:2919) V [libjvm.so+0xd65988] JavaThread::thread_main_inner()+0x184 (javaThread.cpp:719) V [libjvm.so+0x15a1f80] Thread::call_run()+0xac (thread.cpp:215) V [libjvm.so+0x12fcce8] thread_native_entry(Thread*)+0x134 (os_linux.cpp:740) C [libpthread.so.0+0x7908] start_thread+0x188 Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) j sun.management.ThreadImpl.getThreadInfo1([JI[Ljava/lang/management/ThreadInfo;)V+0 java.management@21-internal j sun.management.ThreadImpl.getThreadInfo([JI)[Ljava/lang/management/ThreadInfo;+60 java.management@21-internal j sun.management.ThreadImpl.getThreadInfo(JI)Ljava/lang/management/ThreadInfo;+13 java.management@21-internal j GetLockOwnerName.doWork(ILjava/io/PrintStream;)I+426 j GetLockOwnerName.run(ILjava/io/PrintStream;)I+9 j GetLockOwnerName.main([Ljava/lang/String;)V+126 j java.lang.invoke.LambdaForm$DMH+0x0000000801002000.invokeStatic(Ljava/lang/Object;Ljava/lang/Object;)V+10 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x0000000801003400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+33 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+55 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j com.sun.javatest.regtest.agent.MainWrapper$MainTask.run()V+134 j java.lang.Thread.runWith(Ljava/lang/Object;Ljava/lang/Runnable;)V+5 java.base@21-internal j java.lang.Thread.run()V+19 java.base@21-internal v ~StubRoutines::call_stub 0x0000fffc5818016c This failure occurred on linux-aarch64 and the test task's JVM args are: -XX:+CreateCoredumpOnCrash -XX:+UseZGC
04-05-2023

Mach5 testing of v66 with default stack-locking: Mach5 Tier1: - no test failures Mach5 Tier2: - no test failures Mach5 Tier3: - 1 known, unrelated test failure: - serviceability/sa/ClhsdbLongConstant.java failed due to JDK-8258744 Mach5 Tier4: - 35 known, unrelated client test failures: - 35 client tests failed due to MACH5-6118 (black screen) Mach5 Tier5: - no test failures - 2 zero build tasks failed Mach5 Tier6: - no failures Mach5 Tier7: - no failures Mach5 Tier8: - 1 known, unrelated test failure - applications/javafuzzer/BigTest.java failed due to JDK-8307131
04-05-2023

Mach5 testing of v66 + forced-enable of new lightweight locking: Mach5 Tier1: - 1 known, unrelated test failure: - jdk/test/lib/process/ProcessToolsStartProcessTest.java failed due to JDK-8306946 Mach5 Tier2: - no test failures - 1 slowdebug build failure due to an sjavac glitch Mach5 Tier3: - no failures Mach5 Tier4: - no failures Mach5 Tier5: -no test failures - 4 zero build tasks failed Mach5 Tier6: - no failures Mach5 Tier7: - no failures Mach5 Tier8: - 2 known unrelated test failures: - java/lang/Thread/virtual/HoldsLock.java#id0 faied due to JDK-8305919 - vmTestbase/nsk/jvmti/AttachOnDemand/attach020/TestDescription.java failed due to JDK-8287324 - 1 task failed due to a "health check timed out". The test suite run itself passed all the tests and the results were uploaded just fined, but I'm guessing the machine went offline right at the tail end of the results recording process.
01-05-2023

Mach5 testing of v62 + forced-enable of new lightweight locking: Mach5 Tier1: - no failures Mach5 Tier2: - no failures Mach5 Tier3: - no failures Mach5 Tier4: - no failures Mach5 Tier5: - no test failures - 4 zero build tasks failed
28-04-2023

Mach5 testing of v61 + forced-enable of new lightweight locking: Mach5 Tier1: - no failures Mach5 Tier2: - no failures Mach5 Tier3: - 1 known, unrelated test failure: - sanity/client/SwingSet/src/EditorPaneDemoTest.java due to JDK-8212240 Mach5 Tier4: - no failures Mach5 Tier5: - no test failures - 4 zero build tasks failed Mach5 Tier6: - 1 known, unrelated test failure: - applications/javafuzzer/MediumTest.java failed due to JDK-8303466 Mach5 Tier7: - no failures Mach5 Tier8: - 14 known, unrelated test failures: - Here's the distribution of the 14 failures: 1 applications/javafuzzer/BigTest.java - due to JDK-8303466 1 java/lang/ProcessBuilder/UnblockSignals.java - due to JDK-8298993 2 java/lang/Thread/virtual/HoldsLock.java#id0 - due to JDK-8305919 1 vmTestbase/nsk/monitoring/stress/thread/strace002/TestDescription.java 1 vmTestbase/nsk/monitoring/stress/thread/strace004/TestDescription.java 2 vmTestbase/nsk/monitoring/stress/thread/strace005/TestDescription.java 1 vmTestbase/nsk/monitoring/stress/thread/strace006/TestDescription.java 4 vmTestbase/nsk/monitoring/stress/thread/strace007/TestDescription.java 1 vmTestbase/nsk/monitoring/stress/thread/strace008/TestDescription.java - the vmTestbase/nsk/monitoring/stress/thread/strace* failures are all due to JDK-8306006
27-04-2023

Mach5 testing of v54 + forced-enable of new lightweight locking: Mach5 Tier1: - no failures Mach5 Tier2: - no failures Mach5 Tier3: - no failures Mach5 Tier4: - no failures Mach5 Tier5: - no test failures - 4 zero build failures: Mach5 Tier6 - 1 known, unrelated test failure: - applications/javafuzzer/MediumTest.java due to JDK-8303466 Mach5 Tier7 - no failures Mach5 Tier8 - no failures
09-04-2023

I applied the following fix to my test repo: $ git diff diff --git a/src/hotspot/share/runtime/synchronizer.cpp b/src/hotspot/share/runtime/synchronizer.cpp index bf8afffd693..3c269885f97 100644 --- a/src/hotspot/share/runtime/synchronizer.cpp +++ b/src/hotspot/share/runtime/synchronizer.cpp @@ -894,9 +894,11 @@ static inline intptr_t get_next_hash(Thread* current, oop obj) { return value; } +// Can be called from non JavaThreads (e.g., VMThread) for FastHashCode +// calculations as part of JVM/TI tagging. static bool is_lock_owned(Thread* thread, oop obj) { assert(LockingMode == 2, "only call this with new lightweight locking enabled"); - return JavaThread::cast(thread)->lock_stack().contains(obj); + return thread->is_Java_thread() ? JavaThread::cast(thread)->lock_stack().contains(obj) : false; } intptr_t ObjectSynchronizer::FastHashCode(Thread* current, oop obj) { and reran Mach5 Tier4 and Mach5 Tier5 and there was one known, unrelated failure in Tier5.
06-04-2023

Mach5 testing of v52 + forced-enable of new lightweight locking: Mach5 Tier1: - no failures Mach5 Tier2: - no test failures - 1 slowdebug build task failure: - build machine ran out of disk space Mach5 Tier3: - no failures Mach5 Tier4: - 129 test failures: - They are all likely due to: # Internal Error (/opt/mach5/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S40935/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/b154597d-2ba7-420d-81c1-ef13f408c137/runs/d52e181d-f011-47c8-a35f-30fcbba5c164/workspace/open/src/hotspot/share/runtime/javaThread.hpp:983), pid=1112738, tid=1112747 # assert(t->is_Java_thread()) failed: incorrect cast to JavaThread # # JRE version: Java(TM) SE Runtime Environment (21.0) (fastdebug build 21-internal-LTS-2023-04-04-2141101.daniel.daugherty.8291555forjdk21.git) # Java VM: Java HotSpot(TM) 64-Bit Server VM (fastdebug 21-internal-LTS-2023-04-04-2141101.daniel.daugherty.8291555forjdk21.git, compiled mode, sharing, tiered, compressed oops, compressed class ptrs, g1 gc, linux-aarch64) # Problematic frame: # V [libjvm.so+0x155baa4] is_lock_owned(Thread*, oop)+0x254 Mach5 Tier5: - 769 test failures: - These are all also likely due to: # Internal Error (c:\sb\prod\1680644703\workspace\open\src\hotspot\share\runtime/javaThread.hpp:983), pid=69692, tid=43496 # assert(t->is_Java_thread()) failed: incorrect cast to JavaThread # # JRE version: Java(TM) SE Runtime Environment (21.0) (fastdebug build 21-internal-LTS-2023-04-04-2141101.daniel.daugherty.8291555forjdk21.git) # Java VM: Java HotSpot(TM) 64-Bit Server VM (fastdebug 21-internal-LTS-2023-04-04-2141101.daniel.daugherty.8291555forjdk21.git, mixed mode, sharing, tiered, compressed class ptrs, z gc, windows-amd64)
05-04-2023

The following test failed in my Mach5 Tier3 testing on linux-aarch64-debug: vmTestbase/jit/graph/cgt11.java The test task's JVM args are: -XX:+CreateCoredumpOnCrash -XX:+UseSerialGC Here's a snippet from the log file: #section:main ----------messages:(7/522)---------- command: main jit.graph.CGT -path /opt/mach5/mesos/work_dir/jib-master/install/2023-03-31-1908037.daniel.daugherty.8291555_for_jdk21.git/src.full/open/test/hotspot/jtreg/vmTestbase/jit/graph/data/main.data -numTestClass 12 -randomLoop 40 -staticLoop 40 reason: User specified action: run main jit.graph.CGT -path ${test.src}/data/main.data -numTestClass 12 -randomLoop 40 -staticLoop 40 started: Fri Mar 31 21:01:30 UTC 2023 Mode: agentvm Agent id: 7 finished: Fri Mar 31 21:01:46 UTC 2023 elapsed time (seconds): 16.356 ----------configuration:(16/2500)---------- <snip> ----------stdout:(19/1882)---------- # # A fatal error has been detected by the Java Runtime Environment: # # Internal Error (/opt/mach5/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S30407/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/b94a7623-5f98-46f3-8e2c-08444e95afa4/runs/a5754c45-3d7a-46fa-ba4b-c52efcf6ca3b/workspace/open/src/hotspot/share/runtime/lockStack.cpp:78), pid=1731612, tid=1731617 # assert((_top < end_offset())) failed: lockstack overflow: _top 1704 end_offset 1704 # # JRE version: Java(TM) SE Runtime Environment (21.0) (fastdebug build 21-internal-LTS-2023-03-31-1908037.daniel.daugherty.8291555forjdk21.git) # Java VM: Java HotSpot(TM) 64-Bit Server VM (fastdebug 21-internal-LTS-2023-03-31-1908037.daniel.daugherty.8291555forjdk21.git, mixed mode, tiered, compressed oops, compressed class ptrs, serial gc, linux-aarch64) # Problematic frame: # V [libjvm.so+0x10cfa0c] LockStack::verify_no_thread(char const*) const+0x288 # # Core dump will be written. Default location: Core dumps may be processed with "/opt/core.sh %p" (or dumping to /opt/mach5/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S30290/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/2f2d4f6b-101d-49c1-8b0d-8da8be1d37f9/runs/5cc0b4c6-d927-4532-bf48-c30b85e51249/testoutput/test-support/jtreg_open_test_hotspot_jtreg_vmTestbase_vm_compiler/scratch/1/core.1731612) # # An error report file with more information is saved as: # /opt/mach5/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S30290/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/2f2d4f6b-101d-49c1-8b0d-8da8be1d37f9/runs/5cc0b4c6-d927-4532-bf48-c30b85e51249/testoutput/test-support/jtreg_open_test_hotspot_jtreg_vmTestbase_vm_compiler/scratch/1/hs_err_pid1731612.log # # If you would like to submit a bug report, please visit: # https://bugreport.java.com/bugreport/crash.jsp # result: Error. Agent communication error: java.io.EOFException; check console log for any additional details Here's the crashing thread's stack: --------------- T H R E A D --------------- Current thread (0x0000fffd281b43a0): VMThread "VM Thread" [stack: 0x0000fffd0f750000,0x0000fffd0f950000] [id=1731617] Stack: [0x0000fffd0f750000,0x0000fffd0f950000], sp=0x0000fffd0f94d9c0, free space=2038k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [libjvm.so+0x10cfa0c] LockStack::verify_no_thread(char const*) const+0x288 (lockStack.cpp:78) V [libjvm.so+0xd7fb04] JavaThread::oops_do_no_frames(OopClosure*, CodeBlobClosure*)+0x1e0 (lockStack.inline.hpp:124) V [libjvm.so+0x15ad384] Thread::oops_do(OopClosure*, CodeBlobClosure*)+0x90 (thread.cpp:438) V [libjvm.so+0x15c50b0] Threads::oops_do(OopClosure*, CodeBlobClosure*)+0x90 (threads.cpp:1280) V [libjvm.so+0xc2ffd0] GenCollectedHeap::process_roots(GenCollectedHeap::ScanningOption, OopClosure*, CLDClosure*, CLDClosure*, CodeBlobToOopClosure*)+0xec (genCollectedHeap.cpp:740) V [libjvm.so+0x1450788] SerialHeap::young_process_roots(OopClosure*, OopIterateClosure*, CLDClosure*)+0x44 (serialHeap.cpp:100) V [libjvm.so+0x974d6c] DefNewGeneration::collect(bool, bool, unsigned long, bool)+0x338 (defNewGeneration.cpp:778) V [libjvm.so+0xc2fc0c] GenCollectedHeap::collect_generation(Generation*, bool, unsigned long, bool, bool, bool)+0x26c (genCollectedHeap.cpp:456) V [libjvm.so+0xc30bc8] GenCollectedHeap::do_collection(bool, bool, unsigned long, bool, GenCollectedHeap::GenerationType)+0x468 (genCollectedHeap.cpp:520) V [libjvm.so+0xc316ac] GenCollectedHeap::satisfy_failed_allocation(unsigned long, bool)+0x7c (genCollectedHeap.cpp:654) V [libjvm.so+0xc1cbb8] VM_GenCollectForAllocation::doit()+0x44 (gcVMOperations.cpp:179) V [libjvm.so+0x16872d0] VM_Operation::evaluate()+0x120 (vmOperations.cpp:71) V [libjvm.so+0x16b2f20] VMThread::evaluate_operation(VM_Operation*)+0xd0 (vmThread.cpp:281) V [libjvm.so+0x16b3a14] VMThread::inner_execute(VM_Operation*)+0x374 (vmThread.cpp:428) V [libjvm.so+0x16b3c0c] VMThread::loop()+0x8c (vmThread.cpp:495) V [libjvm.so+0x16b3d3c] VMThread::run()+0x9c (vmThread.cpp:175) V [libjvm.so+0x15adc40] Thread::call_run()+0xac (thread.cpp:224) V [libjvm.so+0x130c348] thread_native_entry(Thread*)+0x134 (os_linux.cpp:740) C [libpthread.so.0+0x7908] start_thread+0x188 JavaThread 0x0000fffd285a0b90 (nid = 1731653) was being processed Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) j jit.graph.test5.pascalTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+33 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test3.callMe(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+123 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test5.fiboTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+197 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test4.callMe(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+147 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test5.factTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+195 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test5.fiboTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+197 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test5.combTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+220 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test5.factTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+195 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.test2.callMe(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+147 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test4.callMe(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+233 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test5.combTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+220 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.Globals.callMethod(Ljit/graph/MethodData;Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+29 j jit.graph.test6.rbTest(Ljava/util/Vector;Ljava/util/Vector;Ljava/lang/Long;Ljava/lang/Integer;)V+598 j java.lang.invoke.LambdaForm$DMH+0x0000000100145400.invokeVirtual(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V+18 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x000000010014b400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+137 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+104 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j jit.graph.CGT.run()V+82 j jit.graph.CGT.main([Ljava/lang/String;)V+15 j java.lang.invoke.LambdaForm$DMH+0x00000001000c0000.invokeStatic(Ljava/lang/Object;Ljava/lang/Object;)V+10 java.base@21-internal j java.lang.invoke.LambdaForm$MH+0x0000000100144400.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+33 java.base@21-internal j java.lang.invoke.Invokers$Holder.invokeExact_MT(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+20 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invokeImpl(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+55 java.base@21-internal j jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+23 java.base@21-internal j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+102 java.base@21-internal j com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run()V+10 j java.lang.Thread.runWith(Ljava/lang/Object;Ljava/lang/Runnable;)V+5 java.base@21-internal j java.lang.Thread.run()V+19 java.base@21-internal v ~StubRoutines::call_stub 0x0000fffd1784017c I've attached both log files: dcubed-8291555_for_jdk21.git-20230331-2052-44050096-tier3-gc-vmTestbase_vm_compiler-linux-aarch64-debug-77-1680296705-40.log dcubed-8291555_for_jdk21.git-20230331-2052-44050096-tier3-gc-vmTestbase_vm_compiler-linux-aarch64-debug-77-1680296705-40.hs_err_pid1731612.log
31-03-2023

Mach5 testing of v47 + forced-enable of UseFastLocking: Mach5 Tier1: - no failures Mach5 Tier2: - 13 closed test failures: - the failures occurred on linux-aarch64, linux-x64 and macosx-aarch64. - all 13 of the closed test failures look like this: # Internal Error (/opt/mach5/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S30265/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/11f26ee9-7672-4784-9827-7daa505c8fbe/runs/fb8cf629-973c-4196-8cff-4ec75aa82c19/workspace/open/src/hotspot/share/runtime/lockStack.cpp:78), pid=3909585, tid=3909657 # assert((_top < end_offset())) failed: lockstack overflow: _top 1688 end_offset 1688 # # JRE version: Java(TM) SE Runtime Environment (21.0) (fastdebug build 21-internal-LTS-2023-03-31-1908037.daniel.daugherty.8291555forjdk21.git) # Java VM: Java HotSpot(TM) 64-Bit Server VM (fastdebug 21-internal-LTS-2023-03-31-1908037.daniel.daugherty.8291555forjdk21.git, mixed mode, sharing, compressed oops, compressed class ptrs, g1 gc, linux-amd64) # Problematic frame: # V [libjvm.so+0x120dc74] LockStack::verify_no_thread(char const*) const+0x244 Mach5 Tier3: - just started, hoping to get the same crash as in Tier2 in an open test
31-03-2023

> Even the current code examines all threads to find the owner. Yes my mistake - we of course have to see which stack a BasicObjectLock address is located in. Sorry for the noise on that part.
29-03-2023

Is there a way to do proper replies in JBS, except copy&pasting and manually adding '>' all over the place? > However, when we're racing > we see at least one of the 16 target thread's thread state go from: > RUNNING -> BLOCKED -> RUNNING -> BLOCKED > For my JavaDeadlock005 test case, it is expecting the thread state to > go from: > RUNNING -> BLOCKED > and expects the target thread to stay BLOCKED. So this fix doesn't > explain why we see this thread state flicker with fast-locking enabled > and we don't see it with stack-locking enabled. Yes, I'm still confused > by this weird failure. I have discovered another problem that affects ZGC and Shenandoah GC: when inspecting foreign lock-stacks outside of a safepoint, we may see invalid oops in the lock-stack because those roots are processed concurrently. One thread may look at the lock-stack of another thread that has not yet updated its own roots, and LS::contains() may yield false negatives in this situation. The fix is to do StackWatermark::start_processing() at the beginning of ::contains() when inspecting a foreign thread. The fix is not necessary for self-inspection, because when a JavaThread gets to inspect itself, it must already have gone through the watermark processing (which happens directly when leaving a safepoint, but before resuming own Java execution). I have pushed a fix for this, plus some verifications in LockStack. Can you check if your test behaves better now?
29-03-2023

>> Wrapping in an OopHandle would be nice, but wouldn't it make it the fast-path slower, because it needs to deal with an additional indirection? > >There may be an impact on performance but the code would be safer and more robust. [~eosterlund] what do you think? I had a chat with [~eosterlund] yesterday and we think it's simpler to use plain oops, and do a StackWatermark::start_processing() at the beginning of LockStack::contains(), when we inspect a foreign thread outside of a safepoint. That should really be all that is needed. >> If I understand correctly, the management code needs to check *all* thread's lock-stack, and therefore we'd need to handshake all threads, at which point it is equivalent to a safepoint, right? > >You can handshake the threads one-at-a-time so more efficient than a STW safepoint. Mmm yes, maybe. But the current code already provides a way to take a safepoint when max_depth > 0, it's easy to also take that STW path when using the new locking scheme. That whole STW path could be reworked to take one handshake at a time, if considered useful, and independently from the new locking change. >That aside do I have this right: the management code allows you to find the owner of an object monitor for an arbitrary object? With existing code this is trivial as the Object links directly or indirectly to the monitor owner. With the new lock-stack you have examine the lock-stack of every single Java thread in the system! That is potentially a real performance hit! No. Even the current code examines all threads to find the owner. See: https://github.com/openjdk/jdk/blob/master/src/hotspot/share/runtime/threads.cpp#L1391 The new code is not very much worse, still O(N) on number of threads, possibly some more work to do per thread, but nothing that looks like a show-stopper to me.
29-03-2023

> Wrapping in an OopHandle would be nice, but wouldn't it make it the fast-path slower, because it needs to deal with an additional indirection? There may be an impact on performance but the code would be safer and more robust. [~eosterlund] what do you think? > If I understand correctly, the management code needs to check *all* thread's lock-stack, and therefore we'd need to handshake all threads, at which point it is equivalent to a safepoint, right? You can handshake the threads one-at-a-time so more efficient than a STW safepoint. That aside do I have this right: the management code allows you to find the owner of an object monitor for an arbitrary object? With existing code this is trivial as the Object links directly or indirectly to the monitor owner. With the new lock-stack you have examine the lock-stack of every single Java thread in the system! That is potentially a real performance hit!
29-03-2023

I have rolled my repo forward to v29 and verified that your change there has stopped: vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/Deadlock/JavaDeadlock005/TestDescription.java from failing on my MBP13. The key part of that patch is this: diff --git a/src/hotspot/share/services/management.cpp b/src/hotspot/share/services/management.cpp index 9ba1284ae82c..b08271fb50c7 100644 --- a/src/hotspot/share/services/management.cpp +++ b/src/hotspot/share/services/management.cpp @@ -1121,7 +1121,7 @@ JVM_ENTRY(jint, jmm_GetThreadInfo(JNIEnv *env, jlongArray ids, jint maxDepth, jo // in the ThreadSnapshot are marked and adjusted during GC. ThreadDumpResult dump_result(num_threads); - if (maxDepth == 0) { + if (!UseFastLocking && maxDepth == 0) { // No stack trace to dump so we do not need to stop the world. // Since we never do the VM op here we must set the threads list. dump_result.set_t_list(); and that forces the GetThreadInfo() call in the observer thread to happen in a safepoint so it can no longer race in parallel execution with the test threads that are racing to be in a deadlock. However, when we're racing we see at least one of the 16 target thread's thread state go from: RUNNING -> BLOCKED -> RUNNING -> BLOCKED For my JavaDeadlock005 test case, it is expecting the thread state to go from: RUNNING -> BLOCKED and expects the target thread to stay BLOCKED. So this fix doesn't explain why we see this thread state flicker with fast-locking enabled and we don't see it with stack-locking enabled. Yes, I'm still confused by this weird failure.
28-03-2023

I am having some trouble to keep up with PR comments because I was out since last Friday. I will take time today to work through all of them. Wrapping in an OopHandle would be nice, but wouldn't it make it the fast-path slower, because it needs to deal with an additional indirection? If I understand correctly, the management code needs to check *all* thread's lock-stack, and therefore we'd need to handshake all threads, at which point it is equivalent to a safepoint, right?
28-03-2023

I put this in the PR but maybe it is better here. Should the lock-stack store OopHandle instead of raw Oops to avoid these kinds of issues? Otherwise to avoid the need for STW safepoint in the management code, a handshake could be used when you need to check another thread's lock-stack.
28-03-2023

I think I may have found the root of the 'weird bug': https://github.com/openjdk/jdk/pull/10907/commits/32fdda25fba6d6d57d48d5f2891e001062e7647b When scanning the lock-stack to find the owner of a monitor/lock we must be sure that threads don't move. It is not entirely clear to me how the code in question can be safe with traditional stack-locks. ? Another problem, and I believe this is the one that is triggering this bug, when running with ZGC we must either use an appropriate barrier or be at a safepoint when accessing the oops on the lock-stack, so that the oops get their coloring bits masked. As far as I understand, for oops that are on the actual stack this is already the case, but for oops that live in an outside structure this may be problematic. If that is not done, we may see oops with colored bits in the lock-stack which may lead to false negatives when comparing to oops on the lock-stack. My fix is to ensure that all calls that scans the lock-stack from threads other than self must happen at safepoints. Everything else doesn't seem sane. It would be good to confirm that the fix is really what we need there.
27-03-2023

It is definitely a weird bug. I'm able to reliably reproduce JavaDeadlock005 on my MBP13 and I've been doing various things to the test and test infrastructure to try and figure out what's going on. Will keep you posted...
22-03-2023

This has got to be one of the weirdest bugs that I have ever seen. On the positive side, it reproduces very reliably (nothing spurious) on linux-x64: make run-test TEST=vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/BlockedThread/BlockedThread005/TestDescription.java TEST_VM_OPTS="-XX:+UseZGC -Xcomp -XX:-TieredCompilation -XX:+UnlockExperimentalVMOptions -XX:+UseFastLocking" All of the flags are required. It doesn't reproduce with other GCs, with C1 or interpreter, it needs -Xcomp and also fast-locking. I believe the other failures that you've seen are variants of the same problem. So far so good. I reduced C2_MacroAssembler::fast_unlock() to a skeleton that only loads the mark-word of the locked object and then forces ZF=0 to take the slow-path on exit (no, it doesn't do anything with the mark word). Nothing else. See attached patch bug-dissection.patch. This *still* makes the test fail reliably. Notice how there's nothing fast-locking or even the monitor-locking, stack-locking or RTM locking left in there. Now, comment-out the loading of the mark-word. This makes the test no longer fail for me, and quite reliably, too. This is really puzzling me. Why does the same not happen with C1 compiled or interpreted code? There we almost literally do the same as in C2, certainly we do load the object's mark-word there. Why does the bug go away when we no longer load the mark-word? Why does it not happen with stack-locking? Why only with ZGC?
22-03-2023

Mach5 test results on v28: Mach5 Tier1: - 1 known, unrelated failure: - jdk/internal/jimage/JImageOpenTest.java failed on macosx-x64 with a SIGSEGV which is a sighting of: JDK-8261837 SIGSEGV in ciVirtualCallTypeData::translate_from - please note that serviceability/sa/UniqueVtableTest.java did not fail in this Tier1 even though we are still using the same baseline. Mach5 Tier2: - no failures, v28 is a definite improvement Mach5 Tier3: - no failures, v28 is a definite improvement Mach5 Tier4: - serviceability/sa/UniqueVtableTest.java failed twice due to JDK-8303921 - v28 is a definite improvement Mach5 Tier5: - 3 known, unrelated failures: - serviceability/sa/UniqueVtableTest.java failed twice due to JDK-8303921 - vmTestbase/nsk/jvmti/AttachOnDemand/attach009/TestDescription.java failed once due to JDK-8300189 Mach5 Tier6: - 5 known, unrelated failures: - serviceability/sa/UniqueVtableTest.java failed 5x due to JDK-8303921 Mach5 Tier7: - 3 known, unrelated failures: - serviceability/sa/ClhsdbInspect.java failed due to JDK-8288578 - serviceability/AsyncGetCallTrace/MyPackage/ASGCTBaseTest.java failed twice due to JDK-8303168 Mach5 Tier8: - 4 known, possibly related test failures: - vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/BlockedThread/BlockedThread005/TestDescription.java failed twice, once on linux-x64-debug and once on windows-x64-debug - windows-x64-debug test task's JVM args are: -XX:+UseZGC -Xcomp -XX:-TieredCompilation - linux-x64-debug test task's JVM args are: -XX:+UseZGC -Xcomp - vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/Deadlock/JavaDeadlock005/TestDescription.java failed once on macosx-x64-debug - macosx-x64-debug test task's JVM args are: -XX:+UseZGC -Xcomp - vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/NativeBlockedThread/NativeBlockedThread005/TestDescription.java failed once on linux-x64-debug - linux-x64-debug test task's JVM args are: -XX:+UseZGC -Xcomp
17-03-2023

JavaDeadLock005 only happens on macosx-x64 which is why I'm looking at that one. See the log files that I attached for the other test failures. There are two for linux-x64 and those will show you the exact command lines.
17-03-2023

I am trying to reproduce the JavaDeadLock005 test. I am using the following cmd line: make run-test TEST=vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/Deadlock/JavaDeadlock005/TestDescription.java TEST_VM_OPTS="-XX:+UseZGC -Xcomp" -XX:+UseZGC -Xcomp seems to be the common flags that make it fail, is that right? I have changed my build to use +UseFastLocking by default, that is why I am not explicitely passing that here. However, it does not fail, not on linux-x64 and not on linux-aarch64 and not on macosx-aarch64. Is there anything special that I need to set? Can you send me the exact cmd line that you used when you got the failure on your MBP?
17-03-2023

vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/Deadlock/JavaDeadlock005/TestDescription.java passes with baseline bits on all three configs: INFO: JTREG options: INFO: JOBS=4 INFO: TEST_MODE=agentvm INFO: EXTRA_PROBLEM_LISTS=ProblemList-extra.txt INFO: VM_OPTIONS=-XX:+UseZGC -Xcomp INFO: test_val=vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/Deadlock/JavaDeadlock005/TestDescription.java Test Config: macosx-x86_64-normal-server-release INFO: TIMEOUT_FACTOR=4 Done testing Test Run macosx-x86_64-normal-server-release time: 0.97 minutes. TEST TOTAL PASS FAIL ERROR jtreg:open/test/hotspot/jtreg/vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/Deadlock/JavaDeadlock005/TestDescription.java 1 1 0 0 Test Config: macosx-x86_64-normal-server-fastdebug INFO: TIMEOUT_FACTOR=6 Done testing Test Run macosx-x86_64-normal-server-fastdebug time: 3.09 minutes. TEST TOTAL PASS FAIL ERROR jtreg:open/test/hotspot/jtreg/vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/Deadlock/JavaDeadlock005/TestDescription.java 1 1 0 0 Test Config: macosx-x86_64-normal-server-slowdebug INFO: TIMEOUT_FACTOR=12 Done testing Test Run macosx-x86_64-normal-server-slowdebug time: 11.80 minutes. TEST TOTAL PASS FAIL ERROR jtreg:open/test/hotspot/jtreg/vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/Deadlock/JavaDeadlock005/TestDescription.java 1 1 0 0 Total test time: 15.86 minutes.
17-03-2023

I can reproduce the vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/Deadlock/JavaDeadlock005/TestDescription.java test failure on my MBP13 with fastdebug and slowdebug bits. Release bits passed: $ unzip -l ThreadMXBean-ThreadInfo-Deadlock0JavaDeadlock005-2023-03-17-121509.zip Archive: ThreadMXBean-ThreadInfo-Deadlock0JavaDeadlock005-2023-03-17-121509.zip Length Date Time Name --------- ---------- ----- ---- 27191 03-17-2023 12:39 test_failures.2023-03-17-121509/TestDescription.jtr.fastdebug 27196 03-17-2023 12:39 test_failures.2023-03-17-121509/TestDescription.jtr.slowdebug --------- ------- 54387 2 files
17-03-2023

I'm attaching log files for the Tier8 test failures: vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/BlockedThread/BlockedThread005/TestDescription.java on linux-x64-debug: dcubed-8291555_for_jdk21.git-20230317-0510-43363684-tier8-gc-ZGC-Xcomp-vmTestbase_nsk_monitoring-linux-x64-debug-linux-x64-2629-1679042609-194 vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/NativeBlockedThread/NativeBlockedThread005/TestDescription.java on linux-x64-debug: dcubed-8291555_for_jdk21.git-20230317-0510-43363684-tier8-gc-ZGC-Xcomp-vmTestbase_nsk_monitoring-linux-x64-debug-linux-x64-2629-1679042609-223 vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/Deadlock/JavaDeadlock005/TestDescription.java on macosx-x64-debug: dcubed-8291555_for_jdk21.git-20230317-0510-43363684-tier8-gc-ZGC-Xcomp-vmTestbase_nsk_monitoring-macosx-x64-debug-macosx-x64-2633-1679044640-199 vmTestbase/nsk/monitoring/ThreadMXBean/ThreadInfo/BlockedThread/BlockedThread005/TestDescription.java failure on windows-x64-debug: dcubed-8291555_for_jdk21.git-20230317-0510-43363684-tier8-gc-ZGC-Xcomp-vmTestbase_nsk_monitoring-windows-x64-debug-windows-x64-1803-or-later-2632-1679047389-194
17-03-2023

[~rehn] - Thanks for finding that. And I'm the knucklehead that filed that bug back on 2021.02.16. Rare, very, very rare...
17-03-2023

It seem like we have an older with same stack-trace: https://bugs.openjdk.org/browse/JDK-8261837
17-03-2023

Hmm, this is a compiler thread, not a true Java thread. I have checked the stack for any signs of Java locking, but could not find any. The compiler only invokes some VM locks, but I don't see how this could interfere with Java locking. Also, my changes don't change any C1 code, except in the backend code generator, but again, I don't see how this could mess with C1 in a way that could lead to that crash. Unfortunately I don't have a MacOS-x64 machine available. I tried to reproduce on MacOS-aarch64 but could not get it to crash. I will continue investigating. (I suspect the replay is so short precisely because the compiler crashed during compilation.) If you find a way to reproduce, and could try with the baseline JDK and verify that it doesn't reproduce there, it would be very helpful. Thanks, Daniel, for your immense help!
17-03-2023

The following test failed in my v28 Mach5 Tier1 testing: jdk/internal/jimage/JImageOpenTest.java Here's a snippet from the log file: #section:main ----------messages:(6/287)---------- command: main -Djdk.image.map.all=false JImageOpenTest reason: User specified action: run main/othervm -Djdk.image.map.all=false JImageOpenTest started: Thu Mar 16 22:11:39 GMT 2023 Mode: othervm [/othervm specified] finished: Thu Mar 16 22:11:48 GMT 2023 elapsed time (seconds): 9.732 ----------configuration:(0/0)---------- ----------System.out:(20/1264)---------- # # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x0000000107311fed, pid=32250, tid=24067 # # JRE version: Java(TM) SE Runtime Environment (21.0) (build 21-internal-LTS-2023-03-16-2128484.daniel.daugherty.8291555forjdk21.git) # Java VM: Java HotSpot(TM) 64-Bit Server VM (21-internal-LTS-2023-03-16-2128484.daniel.daugherty.8291555forjdk21.git, mixed mode, sharing, tiered, compressed oops, compressed class ptrs, g1 gc, bsd-amd64) # Problematic frame: # V [libjvm.dylib+0x311fed] ciVirtualCallTypeData::translate_from(ProfileData const*)+0xcd # # Core dump will be written. Default location: core.32250 # # An error report file with more information is saved as: # /System/Volumes/Data/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S6047/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/3af20187-e4c0-4a6b-bb7f-f117d7a50c5b/runs/44b28f3b-d551-4938-a601-82e5999a47e3/testoutput/test-support/jtreg_open_test_jdk_tier1_part1/scratch/3/hs_err_pid32250.log [error occurred during error reporting (), id 0xe0000000, Internal Error (open/src/hotspot/share/ci/ciMethodData.cpp:701)] # # If you would like to submit a bug report, please visit: # https://bugreport.java.com/bugreport/crash.jsp # ----------System.err:(0/0)---------- ----------rerun:(36/6583)*---------- Here's the crashing thread's stack: --------------- T H R E A D --------------- Current thread (0x00007fc10a009800): JavaThread "C1 CompilerThread0" daemon [_thread_in_vm, id=24067, stack(0x0000700010008000,0x0000700010108000)] Current CompileTask: C1: 1320 828 2 java.util.concurrent.ConcurrentHashMap::setTabAt (20 bytes) Stack: [0x0000700010008000,0x0000700010108000], sp=0x00007000101070c0, free space=1020k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [libjvm.dylib+0x311fed] ciVirtualCallTypeData::translate_from(ProfileData const*)+0xcd V [libjvm.dylib+0x30ea70] ciMethodData::load_data()+0x200 V [libjvm.dylib+0x30ac23] ciMethod::ensure_method_data()+0x1f3 V [libjvm.dylib+0x2279b8] Compilation::compile_java_method()+0x58 V [libjvm.dylib+0x227efc] Compilation::compile_method()+0x11c V [libjvm.dylib+0x228342] Compilation::Compilation(AbstractCompiler*, ciEnv*, ciMethod*, int, BufferBlob*, bool, DirectiveSet*)+0x232 V [libjvm.dylib+0x22a5b1] Compiler::compile_method(ciEnv*, ciMethod*, int, bool, DirectiveSet*)+0x61 V [libjvm.dylib+0x390e4a] CompileBroker::invoke_compiler_on_method(CompileTask*)+0x4ca V [libjvm.dylib+0x3908cc] CompileBroker::compiler_thread_loop()+0x5ec V [libjvm.dylib+0x5b3994] JavaThread::thread_main_inner()+0x94 V [libjvm.dylib+0xab3a55] Thread::call_run()+0xa5 V [libjvm.dylib+0x917ab7] thread_native_entry(Thread*)+0x147 C [libsystem_pthread.dylib+0x68fc] _pthread_start+0xe0 C [libsystem_pthread.dylib+0x2443] thread_start+0xf siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr: 0x00000000000f7fe8 Here's the replay_pid32250.log data: version 2 JvmtiExport can_access_local_variables 0 JvmtiExport can_hotswap_or_post_breakpoint 0 JvmtiExport can_post_on_exceptions 0 # 171 ciObject found instanceKlass java/util/concurrent/ConcurrentHashMap ciMethodData java/util/concurrent/ConcurrentHashMap setTabAt ([Ljava/util/concurrent/ConcurrentHashMap$Node;ILjava/util/concurrent/ConcurrentHashMap$Node;)V 0 0 orig 80 0 0 0 0 0 0 0 0 0 0 0 0 0 208 149 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 data 23 0x10000b 0x917 0x0 0x0 0x0 0x0 0x0 0x4 0x1 0x7fc0c02891c8 0x4 0xf7f53 0x7fc0c0288f80 0x700010107798 0x500000197 0x7fc0c0289fe8 0x19800000001 0x7fc0c0289f88 0x0 0x7fc0c0289ed0 0x9 0x700010107798 0x1 oops 1 9 [Ljava/util/concurrent/ConcurrentHashMap$Node; I think that is the shortest replay_pid that I've ever seen.
16-03-2023

I've reproduced the -Xcheck:jni failure in one of the javadoc test. I'm investigating.
16-03-2023

12 of the open test failures appear to happen due to the same cause. For example: jdk/javadoc/doclet/5093723/T5093723.java failed with: ----------stdout:(19/1823)---------- # # A fatal error has been detected by the Java Runtime Environment: # # Internal Error (/opt/mach5/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S4941/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/16dff4d2-dc33-4a4a-b3e0-5648b415efb9/runs/5d427f4e-f1a9-4b4c-98f6-0ff8a2c6e9ba/workspace/open/src/hotspot/share/runtime/sharedRuntime.cpp:2221), pid=3506469, tid=3526585 # fatal error: Object has been unlocked by JNI # # JRE version: Java(TM) SE Runtime Environment (21.0) (fastdebug build 21-internal-LTS-2023-03-15-1856216.daniel.daugherty.8291555forjdk21.git) # Java VM: Java HotSpot(TM) 64-Bit Server VM (fastdebug 21-internal-LTS-2023-03-15-1856216.daniel.daugherty.8291555forjdk21.git, mixed mode, tiered, compressed oops, compressed class ptrs, g1 gc, linux-aarch64) # Problematic frame: # V [libjvm.so+0x16bc4c8] SharedRuntime::monitor_exit_helper(oopDesc*, BasicLock*, JavaThread*)+0x1a8 and the crashing thread's stack is: --------------- T H R E A D --------------- Current thread (0x0000ffffac632be0): JavaThread "AgentVMThread" [_thread_in_Java, id=3526585, stack(0x0000ffff847e0000,0x0000ffff849e0000)] Stack: [0x0000ffff847e0000,0x0000ffff849e0000], sp=0x0000ffff849cfb10, free space=1982k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [libjvm.so+0x16bc4c8] SharedRuntime::monitor_exit_helper(oopDesc*, BasicLock*, JavaThread*)+0x1a8 (sharedRuntime.cpp:2221) V [libjvm.so+0x16bc5d4] SharedRuntime::complete_monitor_unlocking_C(oopDesc*, BasicLock*, JavaThread*)+0xc0 (sharedRuntime.cpp:2231) All 12 of the failures occurred on linux-aarch64 and the test task's JVM args are: -Xcheck:jni
16-03-2023

Mach5 test results on v26: Mach5 Tier1: - 2 known, unrelated test failure: - serviceability/sa/UniqueVtableTest.java failed twice due to JDK-8303921 Mach5 Tier2: - 4 unknown, related, closed test failures: - closed vmTestbase/vm/compiler/regression/b4268494/b4268494.java failed twice on linux-aarch64 and twice on macosx-aarch64. The associated bug (4268494) is open so it's not clear why the test is closed. I think it's closed because that's where regression tests lived back in 1999. - one of the macosx-aarch64 crashes using these test task JVM options: -XX:+CreateCoredumpOnCrash -ea -esa -XX:CompileThreshold=100 -XX:+UnlockExperimentalVMOptions -server -XX:-TieredCompilation - I've been able to reproduce the crash on my M1 MacMini with both fastdebug and slowdebug bits with those options. Mach5 Tier3: - 7 test failures, some tests failed in more than one config. - Here's the distribution: 3 closed test failures: <snip> 4 open test failures: 4 serviceability/sa/UniqueVtableTest.java - The 4 serviceability/sa/UniqueVtableTest.java failures are known and unrelated. Mach5 Tier4: - 23 test failures, some tests failed in more than one config. - Here's the distribution: 6 closed test failures: <snip> - The 6 closed test failures are unknown and probably related. 17 open test failures: 1 jdk/javadoc/doclet/5093723/T5093723.java 1 jdk/javadoc/doclet/AccessAsciiArt/AccessAsciiArt.java 1 jdk/javadoc/doclet/AccessH1/AccessH1.java 1 jdk/javadoc/tool/reporter_generates_warnings/ReporterGeneratesWarningsInsteadOfNotes.java 5 serviceability/sa/UniqueVtableTest.java 1 tools/javac/T8231622/T8231622.java 1 tools/javac/annotations/typeAnnotations/TypeProcOnly.java 1 tools/javac/classreader/T7031108.java 1 tools/javac/processing/6348499/T6348499.java 1 tools/javac/processing/model/element/TestSealed.java 1 tools/javac/processing/model/type/TestUnionType.java 1 tools/javac/sealed/SealedCompilationTests.java 1 tools/javac/util/T6597678.java - The 5 serviceability/sa/UniqueVtableTest.java failures are known and unrelated. - The other 12 open test failures are unknown and probably related.
16-03-2023

Mach5 test results on v25: Mach5 Tier1: - 1 known, unrelated test failure: - serviceability/sa/UniqueVtableTest.java failed due to JDK-8303921 Mach5 Tier2: - 4 unknown, related, closed test failures: - closed vmTestbase/vm/compiler/regression/b4268494/b4268494.java failed twice on linux-aarch64 and twice on macosx-aarch64. The associated bug (4268494) is open so it's not clear why the test is closed. I think it's closed because that's where regression tests lived back in 1999. - one of the macosx-aarch64 crashes using these test task JVM options: -XX:+CreateCoredumpOnCrash -ea -esa -XX:CompileThreshold=100 -XX:+UnlockExperimentalVMOptions -server -XX:-TieredCompilation - I've been able to reproduce the crash on my M1 MacMini with both fastdebug and slowdebug bits with those options. Mach5 Tier3: - 26 test failures, some tests failed in more than one config. - Here's the distribution: 8 closed test failures: <snip> 18 open test failures: 2 compiler/arraycopy/TestCloneWithStressReflectiveCode.java 1 compiler/codecache/stress/UnexpectedDeoptimizationAllTest.java 1 compiler/loopopts/TestPeelingRemoveDominatedTest.java 1 compiler/vectorapi/VectorCastShape128Test.java 1 compiler/vectorapi/VectorMaskLoadStoreTest.java#id0 1 compiler/vectorapi/VectorMaskLoadStoreTest.java#id1 1 compiler/vectorapi/reshape/TestVectorCastAVX1.java 1 compiler/vectorapi/reshape/TestVectorCastAVX2.java 2 jdk/incubator/vector/VectorMaxConversionTests.java#id1 1 runtime/Metaspace/FragmentMetaspace.java 2 serviceability/sa/UniqueVtableTest.java 2 vmTestbase/metaspace/shrink_grow/ShrinkGrowMultiJVM/ShrinkGrowMultiJVM.java 1 vmTestbase/metaspace/shrink_grow/ShrinkGrowTest/ShrinkGrowTest.java 1 vmTestbase/metaspace/staticReferences/StaticReferences.java - The 2 serviceability/sa/UniqueVtableTest.java failures are known and unrelated. - The other 16 open test failures are unknown and appear to be related.
16-03-2023

5 of the 8 closed test failures appear to be of the "# assert(max_size >= actual_size) failed: ..." style. 2 of the 8 closed test failures appear to be of the: # Internal Error (/System/Volumes/Data/mesos/work_dir/slaves/91e16c40-06d4-468a-9fc3-7198a5bb7d5a-S119877/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/09bce1bd-98b6-4a00-8c63-1828c9e34516/runs/47ddf3ab-c674-4338-a3d2-2bd20fe31def/workspace/open/src/hotspot/share/runtime/vframeArray.cpp:98), pid=58355, tid=5891 # assert(monitor->owner() == nullptr || !monitor->owner()->is_unlocked()) failed: object must be null or locked # # JRE version: Java(TM) SE Runtime Environment (21.0) (fastdebug build 21-internal-LTS-2023-03-14-1914487.daniel.daugherty.8291555forjdk21.git) # Java VM: Java HotSpot(TM) 64-Bit Server VM (fastdebug 21-internal-LTS-2023-03-14-1914487.daniel.daugherty.8291555forjdk21.git, mixed mode, sharing, compressed oops, compressed class ptrs, g1 gc, bsd-aarch64) while doing Deoptimization that was seen in the Tier2 testing. 1 of the 8 closed test failures has this assertion failure: # Internal Error (/opt/mach5/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S5056/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/3a54a41b-1553-483e-b2b3-0fef94371896/runs/c09d02d6-09a3-41da-821f-f5e7b2e82a87/workspace/open/src/hotspot/share/runtime/javaThread.cpp:1921), pid=3344806, tid=3344807 # assert(_held_monitor_count >= 0) failed: Must always be greater than 0: -1 # # JRE version: Java(TM) SE Runtime Environment (21.0) (fastdebug build 21-internal-LTS-2023-03-14-1914487.daniel.daugherty.8291555forjdk21.git) # Java VM: Java HotSpot(TM) 64-Bit Server VM (fastdebug 21-internal-LTS-2023-03-14-1914487.daniel.daugherty.8291555forjdk21.git, mixed mode, sharing, compressed oops, compressed class ptrs, g1 gc, linux-aarch64) # Problematic frame: # V [libjvm.so+0xf0f49c] JavaThread::inc_held_monitor_count(int, bool)+0x7c with this stack trace: --------------- T H R E A D --------------- Current thread (0x0000fffccc033510): JavaThread "main" [_thread_in_vm, id=3344807, stack(0x0000fffcd3c20000,0x0000fffcd3e20000)] Stack: [0x0000fffcd3c20000,0x0000fffcd3e20000], sp=0x0000fffcd3e1c1b0, free space=2032k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [libjvm.so+0xf0f49c] JavaThread::inc_held_monitor_count(int, bool)+0x7c (javaThread.cpp:1921) V [libjvm.so+0x17df59c] ObjectSynchronizer::enter(Handle, BasicLock*, JavaThread*)+0x78 (synchronizer.cpp:487) V [libjvm.so+0xeb4d60] InterpreterRuntime::monitorenter(JavaThread*, BasicObjectLock*)+0x350 (interpreterRuntime.cpp:744) j java.io.FileDescriptor.close()V+0 java.base@21-internal j java.io.FileInputStream$1.close()V+7 java.base@21-internal j java.io.FileDescriptor.closeAll(Ljava/io/Closeable;)V+92 java.base@21-internal j java.io.FileInputStream.close()V+65 java.base@21-internal j jdk.internal.loader.Resource.getBytes()[B+183 java.base@21-internal j jdk.internal.loader.BuiltinClassLoader.defineClass(Ljava/lang/String;Ljdk/internal/loader/Resource;)Ljava/lang/Class;+84 java.base@21-internal j jdk.internal.loader.BuiltinClassLoader.findClassOnClassPathOrNull(Ljava/lang/String;)Ljava/lang/Class;+37 java.base@21-internal j jdk.internal.loader.BuiltinClassLoader.loadClassOrNull(Ljava/lang/String;Z)Ljava/lang/Class;+111 java.base@21-internal j jdk.internal.loader.BuiltinClassLoader.loadClass(Ljava/lang/String;Z)Ljava/lang/Class;+3 java.base@21-internal j jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(Ljava/lang/String;Z)Ljava/lang/Class;+36 java.base@21-internal j java.lang.ClassLoader.loadClass(Ljava/lang/String;)Ljava/lang/Class;+3 java.base@21-internal v ~StubRoutines::call_stub 0x0000fffcd025017c V [libjvm.so+0xed962c] JavaCalls::call_helper(JavaValue*, methodHandle const&, JavaCallArguments*, JavaThread*)+0x5ac (javaCalls.cpp:415) V [libjvm.so+0xed9cb0] JavaCalls::call_virtual(JavaValue*, Klass*, Symbol*, Symbol*, JavaCallArguments*, JavaThread*)+0x410 (javaCalls.cpp:329) V [libjvm.so+0xeda22c] JavaCalls::call_virtual(JavaValue*, Handle, Klass*, Symbol*, Symbol*, Handle, JavaThread*)+0x6c (javaCalls.cpp:198) V [libjvm.so+0x17ee948] SystemDictionary::load_instance_class_impl(Symbol*, Handle, JavaThread*)+0x118 (systemDictionary.cpp:1382) V [libjvm.so+0x17ecd4c] SystemDictionary::load_instance_class(Symbol*, Handle, JavaThread*)+0x1c (systemDictionary.cpp:1413) V [libjvm.so+0x17ed58c] SystemDictionary::resolve_instance_class_or_null(Symbol*, Handle, Handle, JavaThread*)+0x6e8 (systemDictionary.cpp:769) V [libjvm.so+0x17edd18] SystemDictionary::resolve_or_fail(Symbol*, Handle, Handle, bool, JavaThread*)+0x24 (systemDictionary.cpp:318) V [libjvm.so+0xa3c7fc] ConstantPool::klass_at_impl(constantPoolHandle const&, int, JavaThread*)+0x1cc (constantPool.cpp:531) V [libjvm.so+0xa3da18] ConstantPool::klass_ref_at(int, JavaThread*)+0x48 (constantPool.hpp:405) V [libjvm.so+0x12a4f48] LinkInfo::LinkInfo(constantPoolHandle const&, int, JavaThread*)+0x44 (linkResolver.cpp:249) V [libjvm.so+0x12b26ec] LinkResolver::resolve_invoke(CallInfo&, Handle, constantPoolHandle const&, int, Bytecodes::Code, JavaThread*)+0x58 (linkResolver.cpp:1671) V [libjvm.so+0xebef84] InterpreterRuntime::resolve_invoke(JavaThread*, Bytecodes::Code)+0x370 (interpreterRuntime.cpp:843) V [libjvm.so+0xebfb20] InterpreterRuntime::resolve_from_cache(JavaThread*, Bytecodes::Code)+0xf0 (interpreterRuntime.cpp:978) j sun.hotspot.tools.ctw.PathHandler.processClass(Ljava/lang/String;Ljava/util/concurrent/Executor;)V+97 j sun.hotspot.tools.ctw.PathHandler.lambda$process$0(Ljava/util/concurrent/Executor;Ljava/lang/String;)V+3 j sun.hotspot.tools.ctw.PathHandler$$Lambda+0x00000008010066d0.accept(Ljava/lang/Object;)V+12 j java.util.stream.ForEachOps$ForEachOp$OfRef.accept(Ljava/lang/Object;)V+5 java.base@21-internal j java.util.stream.DistinctOps$1$2.accept(Ljava/lang/Object;)V+18 java.base@21-internal j java.util.stream.ReferencePipeline$3$1.accept(Ljava/lang/Object;)V+17 java.base@21-internal j java.util.stream.ReferencePipeline$2$1.accept(Ljava/lang/Object;)V+21 java.base@21-internal j java.util.stream.ReferencePipeline$3$1.accept(Ljava/lang/Object;)V+17 java.base@21-internal j java.util.zip.ZipFile$EntrySpliterator.tryAdvance(Ljava/util/function/Consumer;)Z+80 java.base@21-internal j java.util.Spliterator.forEachRemaining(Ljava/util/function/Consumer;)V+2 java.base@21-internal j java.util.stream.AbstractPipeline.copyInto(Ljava/util/stream/Sink;Ljava/util/Spliterator;)V+32 java.base@21-internal j java.util.stream.AbstractPipeline.wrapAndCopyInto(Ljava/util/stream/Sink;Ljava/util/Spliterator;)Ljava/util/stream/Sink;+13 java.base@21-internal j java.util.stream.ForEachOps$ForEachOp.evaluateSequential(Ljava/util/stream/PipelineHelper;Ljava/util/Spliterator;)Ljava/lang/Void;+3 java.base@21-internal j java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(Ljava/util/stream/PipelineHelper;Ljava/util/Spliterator;)Ljava/lang/Object;+3 java.base@21-internal j java.util.stream.AbstractPipeline.evaluate(Ljava/util/stream/TerminalOp;)Ljava/lang/Object;+88 java.base@21-internal j java.util.stream.ReferencePipeline.forEach(Ljava/util/function/Consumer;)V+6 java.base@21-internal j sun.hotspot.tools.ctw.PathHandler.process(Ljava/util/concurrent/Executor;)V+32 j sun.hotspot.tools.ctw.CompileTheWorld.lambda$main$0(Ljava/util/concurrent/ExecutorService;Lsun/hotspot/tools/ctw/PathHandler;)V+2 j sun.hotspot.tools.ctw.CompileTheWorld$$Lambda+0x0000000801003800.accept(Ljava/lang/Object;)V+8 j java.util.stream.ForEachOps$ForEachOp$OfRef.accept(Ljava/lang/Object;)V+5 java.base@21-internal j java.util.Collections$2.tryAdvance(Ljava/util/function/Consumer;)Z+29 java.base@21-internal j java.util.Collections$2.forEachRemaining(Ljava/util/function/Consumer;)V+2 java.base@21-internal j java.util.stream.ReferencePipeline$Head.forEach(Ljava/util/function/Consumer;)V+12 java.base@21-internal j java.util.stream.ReferencePipeline$7$1.accept(Ljava/lang/Object;)V+41 java.base@21-internal j java.util.stream.ReferencePipeline$3$1.accept(Ljava/lang/Object;)V+17 java.base@21-internal j java.util.Spliterators$ArraySpliterator.forEachRemaining(Ljava/util/function/Consumer;)V+53 java.base@21-internal j java.util.stream.AbstractPipeline.copyInto(Ljava/util/stream/Sink;Ljava/util/Spliterator;)V+32 java.base@21-internal j java.util.stream.AbstractPipeline.wrapAndCopyInto(Ljava/util/stream/Sink;Ljava/util/Spliterator;)Ljava/util/stream/Sink;+13 java.base@21-internal j java.util.stream.ForEachOps$ForEachOp.evaluateSequential(Ljava/util/stream/PipelineHelper;Ljava/util/Spliterator;)Ljava/lang/Void;+3 java.base@21-internal j java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(Ljava/util/stream/PipelineHelper;Ljava/util/Spliterator;)Ljava/lang/Object;+3 java.base@21-internal j java.util.stream.AbstractPipeline.evaluate(Ljava/util/stream/TerminalOp;)Ljava/lang/Object;+88 java.base@21-internal j java.util.stream.ReferencePipeline.forEach(Ljava/util/function/Consumer;)V+6 java.base@21-internal j sun.hotspot.tools.ctw.CompileTheWorld.main([Ljava/lang/String;)V+125 v ~StubRoutines::call_stub 0x0000fffcd025017c V [libjvm.so+0xed962c] JavaCalls::call_helper(JavaValue*, methodHandle const&, JavaCallArguments*, JavaThread*)+0x5ac (javaCalls.cpp:415) V [libjvm.so+0x1017b40] jni_invoke_static(JNIEnv_*, JavaValue*, _jobject*, JNICallType, _jmethodID*, JNI_ArgumentPusher*, JavaThread*) [clone .constprop.1]+0x1bc (jni.cpp:887) V [libjvm.so+0x101ae8c] jni_CallStaticVoidMethod+0x17c (jni.cpp:1711) C [libjli.so+0x4828] JavaMain+0xc54 (java.c:547) C [libjli.so+0x757c] ThreadJavaMain+0xc (java_md.c:650) C [libpthread.so.0+0x7908] start_thread+0x188 Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) j java.io.FileDescriptor.close()V+0 java.base@21-internal j java.io.FileInputStream$1.close()V+7 java.base@21-internal j java.io.FileDescriptor.closeAll(Ljava/io/Closeable;)V+92 java.base@21-internal j java.io.FileInputStream.close()V+65 java.base@21-internal j jdk.internal.loader.Resource.getBytes()[B+183 java.base@21-internal j jdk.internal.loader.BuiltinClassLoader.defineClass(Ljava/lang/String;Ljdk/internal/loader/Resource;)Ljava/lang/Class;+84 java.base@21-internal j jdk.internal.loader.BuiltinClassLoader.findClassOnClassPathOrNull(Ljava/lang/String;)Ljava/lang/Class;+37 java.base@21-internal j jdk.internal.loader.BuiltinClassLoader.loadClassOrNull(Ljava/lang/String;Z)Ljava/lang/Class;+111 java.base@21-internal j jdk.internal.loader.BuiltinClassLoader.loadClass(Ljava/lang/String;Z)Ljava/lang/Class;+3 java.base@21-internal j jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(Ljava/lang/String;Z)Ljava/lang/Class;+36 java.base@21-internal j java.lang.ClassLoader.loadClass(Ljava/lang/String;)Ljava/lang/Class;+3 java.base@21-internal v ~StubRoutines::call_stub 0x0000fffcd025017c j sun.hotspot.tools.ctw.PathHandler.processClass(Ljava/lang/String;Ljava/util/concurrent/Executor;)V+97 j sun.hotspot.tools.ctw.PathHandler.lambda$process$0(Ljava/util/concurrent/Executor;Ljava/lang/String;)V+3 j sun.hotspot.tools.ctw.PathHandler$$Lambda+0x00000008010066d0.accept(Ljava/lang/Object;)V+12 j java.util.stream.ForEachOps$ForEachOp$OfRef.accept(Ljava/lang/Object;)V+5 java.base@21-internal j java.util.stream.DistinctOps$1$2.accept(Ljava/lang/Object;)V+18 java.base@21-internal j java.util.stream.ReferencePipeline$3$1.accept(Ljava/lang/Object;)V+17 java.base@21-internal j java.util.stream.ReferencePipeline$2$1.accept(Ljava/lang/Object;)V+21 java.base@21-internal j java.util.stream.ReferencePipeline$3$1.accept(Ljava/lang/Object;)V+17 java.base@21-internal j java.util.zip.ZipFile$EntrySpliterator.tryAdvance(Ljava/util/function/Consumer;)Z+80 java.base@21-internal j java.util.Spliterator.forEachRemaining(Ljava/util/function/Consumer;)V+2 java.base@21-internal j java.util.stream.AbstractPipeline.copyInto(Ljava/util/stream/Sink;Ljava/util/Spliterator;)V+32 java.base@21-internal j java.util.stream.AbstractPipeline.wrapAndCopyInto(Ljava/util/stream/Sink;Ljava/util/Spliterator;)Ljava/util/stream/Sink;+13 java.base@21-internal j java.util.stream.ForEachOps$ForEachOp.evaluateSequential(Ljava/util/stream/PipelineHelper;Ljava/util/Spliterator;)Ljava/lang/Void;+3 java.base@21-internal j java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(Ljava/util/stream/PipelineHelper;Ljava/util/Spliterator;)Ljava/lang/Object;+3 java.base@21-internal j java.util.stream.AbstractPipeline.evaluate(Ljava/util/stream/TerminalOp;)Ljava/lang/Object;+88 java.base@21-internal j java.util.stream.ReferencePipeline.forEach(Ljava/util/function/Consumer;)V+6 java.base@21-internal j sun.hotspot.tools.ctw.PathHandler.process(Ljava/util/concurrent/Executor;)V+32 j sun.hotspot.tools.ctw.CompileTheWorld.lambda$main$0(Ljava/util/concurrent/ExecutorService;Lsun/hotspot/tools/ctw/PathHandler;)V+2 j sun.hotspot.tools.ctw.CompileTheWorld$$Lambda+0x0000000801003800.accept(Ljava/lang/Object;)V+8 j java.util.stream.ForEachOps$ForEachOp$OfRef.accept(Ljava/lang/Object;)V+5 java.base@21-internal j java.util.Collections$2.tryAdvance(Ljava/util/function/Consumer;)Z+29 java.base@21-internal j java.util.Collections$2.forEachRemaining(Ljava/util/function/Consumer;)V+2 java.base@21-internal j java.util.stream.ReferencePipeline$Head.forEach(Ljava/util/function/Consumer;)V+12 java.base@21-internal j java.util.stream.ReferencePipeline$7$1.accept(Ljava/lang/Object;)V+41 java.base@21-internal j java.util.stream.ReferencePipeline$3$1.accept(Ljava/lang/Object;)V+17 java.base@21-internal j java.util.Spliterators$ArraySpliterator.forEachRemaining(Ljava/util/function/Consumer;)V+53 java.base@21-internal j java.util.stream.AbstractPipeline.copyInto(Ljava/util/stream/Sink;Ljava/util/Spliterator;)V+32 java.base@21-internal j java.util.stream.AbstractPipeline.wrapAndCopyInto(Ljava/util/stream/Sink;Ljava/util/Spliterator;)Ljava/util/stream/Sink;+13 java.base@21-internal j java.util.stream.ForEachOps$ForEachOp.evaluateSequential(Ljava/util/stream/PipelineHelper;Ljava/util/Spliterator;)Ljava/lang/Void;+3 java.base@21-internal j java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(Ljava/util/stream/PipelineHelper;Ljava/util/Spliterator;)Ljava/lang/Object;+3 java.base@21-internal j java.util.stream.AbstractPipeline.evaluate(Ljava/util/stream/TerminalOp;)Ljava/lang/Object;+88 java.base@21-internal j java.util.stream.ReferencePipeline.forEach(Ljava/util/function/Consumer;)V+6 java.base@21-internal j sun.hotspot.tools.ctw.CompileTheWorld.main([Ljava/lang/String;)V+125 v ~StubRoutines::call_stub 0x0000fffcd025017c
15-03-2023

compiler/arraycopy/TestCloneWithStressReflectiveCode.java failed on linux-x64 and windows-x64. Here's a snippet from the linux-x64 log: ----------System.out:(22/2247)---------- # # A fatal error has been detected by the Java Runtime Environment: # # Internal Error (/opt/mach5/mesos/work_dir/slaves/782b3f2b-1fe4-42ad-a0aa-b7bf2f5b3ebf-S3869/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/c69b0741-7166-4808-bd63-0a2c46c4de90/runs/d446e95f-7171-4414-b706-f2172921e5c6/workspace/open/src/hotspot/share/opto/c2_CodeStubs.cpp:52), pid=190321, tid=190351 # assert(max_size >= actual_size) failed: Expected stub size (17) must be larger than or equal to actual stub size (18) # # JRE version: Java(TM) SE Runtime Environment (21.0) (fastdebug build 21-internal-LTS-2023-03-14-1914487.daniel.daugherty.8291555forjdk21.git) # Java VM: Java HotSpot(TM) 64-Bit Server VM (fastdebug 21-internal-LTS-2023-03-14-1914487.daniel.daugherty.8291555forjdk21.git, compiled mode, sharing, compressed class ptrs, z gc, linux-amd64) # Problematic frame: # V [libjvm.so+0x909e8e] C2CodeStubList::emit(CodeBuffer&)+0x14e # # Core dump will be written. Default location: Core dumps may be processed with "/opt/core.sh %p" (or dumping to /opt/mach5/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S8525/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/cdcabfd5-ee77-441d-8ada-7c16c13e63a8/runs/bc8a28fb-624c-461b-8113-9086d28d13d7/testoutput/test-support/jtreg_open_test_hotspot_jtreg_hotspot_compiler_all_gcs/scratch/1/core.190321) # # An error report file with more information is saved as: # /opt/mach5/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S8525/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/cdcabfd5-ee77-441d-8ada-7c16c13e63a8/runs/bc8a28fb-624c-461b-8113-9086d28d13d7/testoutput/test-support/jtreg_open_test_hotspot_jtreg_hotspot_compiler_all_gcs/scratch/1/hs_err_pid190321.log # # Compiler replay data is saved as: # /opt/mach5/mesos/work_dir/slaves/741e9afd-8c02-45c3-b2e2-9db1450d0832-S8525/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/cdcabfd5-ee77-441d-8ada-7c16c13e63a8/runs/bc8a28fb-624c-461b-8113-9086d28d13d7/testoutput/test-support/jtreg_open_test_hotspot_jtreg_hotspot_compiler_all_gcs/scratch/1/replay_pid190321.log # # If you would like to submit a bug report, please visit: # https://bugreport.java.com/bugreport/crash.jsp # ----------System.err:(0/0)---------- Here's snippets from the linux-x64 hs_err_pid file: # Internal Error (/opt/mach5/mesos/work_dir/slaves/782b3f2b-1fe4-42ad-a0aa-b7bf2f5b3ebf-S3869/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/c69b0741-7166-4808-bd63-0a2c46c4de90/runs/d446e95f-7171-4414-b706-f2172921e5c6/workspace/open/src/hotspot/share/opto/c2_CodeStubs.cpp:52), pid=190321, tid=190351 # assert(max_size >= actual_size) failed: Expected stub size (17) must be larger than or equal to actual stub size (18) <snip> --------------- T H R E A D --------------- Current thread (0x00007fcea4198c30): JavaThread "C2 CompilerThread0" daemon [_thread_in_native, id=190351, stack(0x00007fce983f3000,0x00007fce984f4000)] Current CompileTask: C2: 2189 460 !b java.util.concurrent.ConcurrentHashMap::putVal (432 bytes) Stack: [0x00007fce983f3000,0x00007fce984f4000], sp=0x00007fce984eeba0, free space=1006k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [libjvm.so+0x909e8e] C2CodeStubList::emit(CodeBuffer&)+0x14e (c2_CodeStubs.cpp:52) V [libjvm.so+0x175cf9a] PhaseOutput::fill_buffer(CodeBuffer*, unsigned int*)+0x235a (output.cpp:1754) V [libjvm.so+0xb2869e] Compile::Code_Gen()+0x48e (compile.cpp:2971) V [libjvm.so+0xb2e199] Compile::Compile(ciEnv*, ciMethod*, int, Options, DirectiveSet*)+0x19f9 (compile.cpp:866) V [libjvm.so+0x93a497] C2Compiler::compile_method(ciEnv*, ciMethod*, int, bool, DirectiveSet*)+0x4e7 (c2compiler.cpp:113) V [libjvm.so+0xb3b9ac] CompileBroker::invoke_compiler_on_method(CompileTask*)+0xa7c (compileBroker.cpp:2265) V [libjvm.so+0xb3c820] CompileBroker::compiler_thread_loop()+0x690 (compileBroker.cpp:1944) V [libjvm.so+0x108ea96] JavaThread::thread_main_inner()+0x206 (javaThread.cpp:712) V [libjvm.so+0x1a996e0] Thread::call_run()+0x100 (thread.cpp:224) V [libjvm.so+0x1733173] thread_native_entry(Thread*)+0x103 (os_linux.cpp:740) All 16 of the open, unknown and probably related failures appear to match the above failure mode.
15-03-2023

Here's the crash notification for the Mach5 Tier2 failure as reproduced with fastdebug bits on my M1 MacMini: # Internal Error (/System/Volumes/Data/work/shared/bug_hunt/8291555_for_jdk21.git/open/src/hotspot/share/runtime/vframeArray.cpp:98), pid=41593, tid=24835 # assert(monitor->owner() == nullptr || !monitor->owner()->is_unlocked()) failed: object must be null or locked # # JRE version: Java(TM) SE Runtime Environment (21.0) (fastdebug build 21-internal-LTS-2023-03-14-2057038.dcubed...) # Java VM: Java HotSpot(TM) 64-Bit Server VM (fastdebug 21-internal-LTS-2023-03-14-2057038.dcubed..., mixed mode, sharing, compressed oops, compressed class ptrs, g1 gc, bsd-aarch64) And with slowdebug bits as reproduced on my M1 MacMini: # Internal Error (/System/Volumes/Data/work/shared/bug_hunt/8291555_for_jdk21.git/open/src/hotspot/share/runtime/vframeArray.cpp:98), pid=41774, tid=38659 # assert(monitor->owner() == nullptr || !monitor->owner()->is_unlocked()) failed: object must be null or locked # # JRE version: Java(TM) SE Runtime Environment (21.0) (slowdebug build 21-internal-LTS-2023-03-14-2057231.dcubed...) # Java VM: Java HotSpot(TM) 64-Bit Server VM (slowdebug 21-internal-LTS-2023-03-14-2057231.dcubed..., mixed mode, sharing, compressed oops, compressed class ptrs, g1 gc, bsd-aarch64) I'm attaching the two hs_err_pid files: m5_tier2_fastdebug_hs_err_pid41593.log m5_tier2_slowdebug_hs_err_pid41774.log
14-03-2023

A pull request was submitted for review. URL: https://git.openjdk.org/jdk/pull/10590 Date: 2022-10-06 10:23:04 +0000
06-10-2022

A pull request was submitted for review. URL: https://git.openjdk.org/jdk/pull/9680 Date: 2022-07-28 19:58:34 +0000
06-10-2022