JDK-8340695 : GenShen: Clean up failing tests
  • Type: Task
  • Component: hotspot
  • Sub-Component: gc
  • Affected Version: repo-shenandoah
  • Priority: P4
  • Status: Open
  • Resolution: Unresolved
  • Submitted: 2024-09-23
  • Updated: 2025-03-10
The Version table provides details related to the release that this issue/RFE will be addressed.

Unresolved : Release in which this issue/RFE will be addressed.
Resolved: Release in which this issue/RFE has been resolved.
Fixed : Release in which this issue/RFE has been fixed. The release containing this fix may be available for download as an Early Access Release or a General Availability Release.

To download the current JDK release, click here.
Other
repo-shenandoahUnresolved
Related Reports
Relates :  
JDK-8337511 - Implement JEP 404: Generational Shenandoah (Experimental)
Sub Tasks
JDK-8342570 :  
gc.*.gcUntilOld() assumes that full gc always promotes objects to old generation in a generational heap - Open
JDK-8342580 :  
GenShen: TestChurnNotifications fails executing in unintended test-id modes with ShenandoahGCMode=generational - Resolved
JDK-8342640 :  
GenShen: Silently ignoring ShenandoahGCHeuristics considered poor user-experience - Open
JDK-8342786 :  
Shenandoah: test/hotspot/jtreg/gc/stress/jfr/TestStressBigAllocationGCEventsWithShenandoah.java tests for event not emitted by Shenandoah - Open
Description
GenShen nightly testing is showing a few failures, some of which are spurious. We need to clean up the spurious failures, and fix the real failures.

This is a top-level task and sub-tasks will address individual classes of these spurious or real failures so as to clean up the testing results.
Comments
I'll work on these in the first round of cleanups, and create tickets for those that require more than @requires as I go. ``` Arm/Hotspot/jtreg/tier1 catalog: ------------------------------------------ Focusing on only Hotspot testing for the moment: (other failures seem to be largely isomorphic, which is good news) ------------------------------------------------------------------------------------------------------------------- TIER 1: ------- BINARY GC #Failures #Errors -------------------------------------------------------------------------------- fastdebug none 2 0 release none fastdebug G1 1 0 ; fastdebug & release fail identically same test release G1 1 0 fastdebug Shen 1 1 ; same failure release Shen 1 2 ; 1 additional timeout error fastdebug GenShen 7 10 release GenShen 7 10 ; fd & r identical fail/error -------------------------------------------------------------------------------- Failures with fatsdebug/nogc: ----------------------------- 1. Failure: serviceability/sa/ClhsdbCDSCore.java TEST RESULT: Failed. Execution failed: `main' threw exception: java.lang.RuntimeException: Test ERROR java.lang.RuntimeException: '_nofast_aload_0' missing from stdout/stderr 2. Failure: compiler/loopopts/superword/TestSplitPacks.java [interestingly, this passes in other modes, including G1. why? Flakey test?] TEST RESULT: Failed. Execution failed: `main' threw exception: compiler.lib.ir_framework.driver.irmatching.IRViolationException: There were one or multiple IR rule failures. Please check stderr for more information. -------------------------------------------------------------------------------- Failures with fastdebug/g1_gc & release/g1_gc: (identical) ---------------------------------------------------------- 1. Failure: serviceability/sa/ClhsdbCDSCore.java [same as for no gc: can ignore for release: file ticket] TEST RESULT: Failed. Execution failed: `main' threw exception: java.lang.RuntimeException: Test ERROR java.lang.RuntimeException: '_nofast_aload_0' missing from stdout/stderr -------------------------------------------------------------------------------- Failures with fastdebug/shenandoah & release/shenandoah: (identical) -------------------------------------------------------- 1. Failure: serviceability/sa/ClhsdbCDSCore.java [same as for no gc: can ignore for release: file ticket] TEST RESULT: Failed. Execution failed: `main' threw exception: java.lang.RuntimeException: Test ERROR java.lang.RuntimeException: '_nofast_aload_0' missing from stdout/stderr Error with fastdebug/shenandoah -------------------------------- 1. Error with both fastdebug & release: gc/TestConcurrentGCBreakpoints.java TEST RESULT: Error. Program `/home/ysr/genshen-ysr/shenandoah/build/linux-aarch64-server-fastdebug/images/jdk/bin/java' timed out (timeout set to 480000ms, elapsed time including timeout handling was 480588ms). Error with release/shenandoah ----------------------------- 1. Error with both fastdebug & release: gc/TestConcurrentGCBreakpoints.java TEST RESULT: Error. Program `/home/ysr/genshen-ysr/shenandoah/build/linux-aarch64-server-release/images/jdk/bin/java' timed out (timeout set to 480000ms, elapsed time including timeout handling was 480245ms). 2. Error with release: gc/TestJNIWeak/TestJNIWeak.java TEST RESULT: Error. Program `/home/ysr/genshen-ysr/shenandoah/build/linux-aarch64-server-release/images/jdk/bin/java' timed out (timeout set to 480000ms, elapsed time including timeout handling was 480237ms). -------------------------------------------------------------------------------- Failures with fastdebug/genshen & release/genshen: (idenitical) -------------------------------------------------- 1. Failure (both fd & r): gc/TestReferenceRefersTo.java TEST RESULT: Failed. Execution failed: `main' threw exception: java.lang.RuntimeException: object not promoted by full gc 2. Failure (both fd & r): gc/TestReferenceRefersToDuringConcMark.java TEST RESULT: Failed. Execution failed: `main' threw exception: java.lang.RuntimeException: object not promoted by full gc 3. Failure (both fd & r): serviceability/sa/ClhsdbCDSCore.java TEST RESULT: Failed. Execution failed: `main' threw exception: java.lang.RuntimeException: Test ERROR java.lang.RuntimeException: '_nofast_aload_0' missing from stdout/stderr 4. Failure (both fd & r): gc/shenandoah/mxbeans/TestChurnNotifications.java#adaptive TEST RESULT: Failed. Execution failed: `main' threw exception: java.lang.IllegalStateException: Expected = [0; 2127] (1999), actual = 0 5. Failure (both fd & r): gc/shenandoah/mxbeans/TestChurnNotifications.java#aggressive TEST RESULT: Failed. Execution failed: `main' threw exception: java.lang.IllegalStateException: Expected = [0; 2127] (1999), actual = 0 6. Failure (both fd & r): gc/shenandoah/mxbeans/TestChurnNotifications.java#compact TEST RESULT: Failed. Execution failed: `main' threw exception: java.lang.IllegalStateException: Expected = [0; 2127] (1999), actual = 0 7. Failure (both fd & r): gc/shenandoah/mxbeans/TestChurnNotifications.java#static TEST RESULT: Failed. Execution failed: `main' threw exception: java.lang.IllegalStateException: Expected = [0; 2127] (1999), actual = 0 Errors with fastdebug/genshen ----------------------------- 1. Error (both fd & r): runtime/ClassInitErrors/InitExceptionUnloadTest.java TEST RESULT: Error. Program `/home/ysr/genshen-ysr/shenandoah/build/linux-aarch64-server-fastdebug/images/jdk/bin/java' timed out (timeout set to 480000ms, elapsed time including timeout handling was 496049ms). 2. Error (both fd & r): runtime/ClassUnload/ConstantPoolDependsTest.java TEST RESULT: Error. Program `/home/ysr/genshen-ysr/shenandoah/build/linux-aarch64-server-fastdebug/images/jdk/bin/java' timed out (timeout set to 480000ms, elapsed time including timeout handling was 496048ms). 3. Error (both fd & r): runtime/ClassUnload/DictionaryDependsTest.java TEST RESULT: Error. Program `/home/ysr/genshen-ysr/shenandoah/build/linux-aarch64-server-fastdebug/images/jdk/bin/java' timed out (timeout set to 480000ms, elapsed time including timeout handling was 496041ms). 4. Error (both fd & r): runtime/ClassUnload/KeepAliveClass.java TEST RESULT: Error. Program `/home/ysr/genshen-ysr/shenandoah/build/linux-aarch64-server-fastdebug/images/jdk/bin/java' timed out (timeout set to 480000ms, elapsed time including timeout handling was 496052ms). 5. Error (both fd & r): runtime/ClassUnload/KeepAliveClassLoader.java TEST RESULT: Error. Program `/home/ysr/genshen-ysr/shenandoah/build/linux-aarch64-server-fastdebug/images/jdk/bin/java' timed out (timeout set to 480000ms, elapsed time including timeout handling was 496049ms). 6. Error (both fd & r): runtime/ClassUnload/KeepAliveObject.java TEST RESULT: Error. Program `/home/ysr/genshen-ysr/shenandoah/build/linux-aarch64-server-fastdebug/images/jdk/bin/java' timed out (timeout set to 480000ms, elapsed time including timeout handling was 496052ms). 7. Error (both fd & r): runtime/ClassUnload/KeepAliveSoftReference.java TEST RESULT: Error. Program `/home/ysr/genshen-ysr/shenandoah/build/linux-aarch64-server-fastdebug/images/jdk/bin/java' timed out (timeout set to 480000ms, elapsed time including timeout handling was 496067ms). 8. Error (both fd & r): runtime/ClassUnload/SuperDependsTest.java TEST RESULT: Error. Program `/home/ysr/genshen-ysr/shenandoah/build/linux-aarch64-server-fastdebug/images/jdk/bin/java' timed out (timeout set to 480000ms, elapsed time including timeout handling was 496055ms). 9. Error (both fd & r): runtime/ClassUnload/UnloadInterfaceTest.java TEST RESULT: Error. Program `/home/ysr/genshen-ysr/shenandoah/build/linux-aarch64-server-fastdebug/images/jdk/bin/java' timed out (timeout set to 480000ms, elapsed time including timeout handling was 496046ms). 10. Error (both fd & r): runtime/ClassUnload/UnloadTest.java TEST RESULT: Error. Program `/home/ysr/genshen-ysr/shenandoah/build/linux-aarch64-server-fastdebug/images/jdk/bin/java' timed out (timeout set to 480000ms, elapsed time including timeout handling was 496059ms). ```
18-10-2024
A few summaries (fastdebug/aarch64/tier1) with the differences with various GC options: ``` dev-dsk-ysr-2a-36fc2250 % tail -12 test.out.fastdebug.tier1.g1_gc | head -10 ============================== TEST TOTAL PASS FAIL ERROR >> jtreg:test/hotspot/jtreg:tier1 2129 2128 1 0 << >> jtreg:test/jdk:tier1 2388 2368 20 0 << >> jtreg:test/langtools:tier1 4568 4498 70 0 << jtreg:test/jaxp:tier1 0 0 0 0 jtreg:test/lib-test:tier1 33 33 0 0 ============================== TEST FAILURE (24-09-27 15:57:30) <0> [~/genshen-ysr/shenandoah] dev-dsk-ysr-2a-36fc2250 % tail -12 test.out.fastdebug.tier1.shen_gc | head -10 ============================== TEST TOTAL PASS FAIL ERROR >> jtreg:test/hotspot/jtreg:tier1 2033 2031 1 1 << >> jtreg:test/jdk:tier1 2387 2367 20 0 << >> jtreg:test/langtools:tier1 4568 4498 70 0 << jtreg:test/jaxp:tier1 0 0 0 0 jtreg:test/lib-test:tier1 33 33 0 0 ============================== TEST FAILURE (24-09-27 15:57:37) <0> [~/genshen-ysr/shenandoah] dev-dsk-ysr-2a-36fc2250 % tail -12 test.out.fastdebug.tier1.genshen_gc | head -10 ============================== TEST TOTAL PASS FAIL ERROR >> jtreg:test/hotspot/jtreg:tier1 2033 2016 7 10 << >> jtreg:test/jdk:tier1 2387 2367 20 0 << >> jtreg:test/langtools:tier1 4568 4498 70 0 << jtreg:test/jaxp:tier1 0 0 0 0 jtreg:test/lib-test:tier1 33 33 0 0 ============================== TEST FAILURE ``` More details to follow with other tiers and builds. We'll then summarize the failures and determine how to proceed with the specific failures caused by testing in unintended modes.
27-09-2024