The following test failed in the JDK20 CI:
applications/javafuzzer/MediumTest.java
Here's a snippet from the log file:
Summary of the JavaFuzzer run:
------------------------------
Host: ol8-aarch64-690819
Tests: 8 x 50
Args: -conf config.yml
Started at: Tue Jul 26 16:40:51 UTC 2022
r1- 50: 34 passed, 0 crashes, 0 fails, 0 hangs, 0 incorrect tests, 16 Reference Java failures
r4- 50: 33 passed, 0 crashes, 0 fails, 0 hangs, 0 incorrect tests, 17 Reference Java failures
r3- 50: 30 passed, 0 crashes, 0 fails, 0 hangs, 0 incorrect tests, 20 Reference Java failures
r8- 50: 31 passed, 0 crashes, 0 fails, 0 hangs, 0 incorrect tests, 19 Reference Java failures
r5- 50: 34 passed, 0 crashes, 0 fails, 0 hangs, 0 incorrect tests, 16 Reference Java failures
r2- 50: 33 passed, 0 crashes, 2 fails, 0 hangs, 0 incorrect tests, 16 Reference Java failures
r6- 50: 30 passed, 0 crashes, 0 fails, 0 hangs, 0 incorrect tests, 20 Reference Java failures
r7- 50: 24 passed, 0 crashes, 0 fails, 0 hangs, 0 incorrect tests, 26 Reference Java failures
Finished at: Tue Jul 26 17:58:15 UTC 2022
[2022-07-26T17:58:15.361211790Z] Waiting for completion for process 247374
[2022-07-26T17:58:15.361369431Z] Waiting for completion finished for process 247374
----------System.err:(13/728)----------
java.lang.RuntimeException: assertEquals: expected 1 to equal 2
at jdk.test.lib.Asserts.fail(Asserts.java:594)
at jdk.test.lib.Asserts.assertEquals(Asserts.java:205)
at jdk.test.lib.Asserts.assertEquals(Asserts.java:189)
at applications.javafuzzer.JavaFuzzerRunner.main(JavaFuzzerRunner.java:235)
at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
at java.base/java.lang.reflect.Method.invoke(Method.java:578)
at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:312)
at java.base/java.lang.Thread.run(Thread.java:1589)
JavaTest Message: Test threw exception: java.lang.RuntimeException
JavaTest Message: shutting down test
result: Failed. Execution failed: `main' threw exception: java.lang.RuntimeException: assertEquals: expected 1 to equal 2
I downloaded the test run's artifacts and there are no hs_err_pid files.
Taking a closer look at the above:
r2- 50: 33 passed, 0 crashes, 2 fails, 0 hangs, 0 incorrect tests, 16 Reference Java failures
so we have "2 fails", but they didn't result in crashes.
I filed another recent failure for another fuzzer test:
JDK-8290910 applications/javafuzzer/BigTest.java fails "r6- 300" with 2 failures
and the synopsis has been updated to:
JDK-8290910 Incorrect result with C2 compiled code