JDK-8339617 : 3D Jemmy tests are failing because of color difference
  • Type: Task
  • Component: javafx
  • Sub-Component: graphics
  • Affected Version: jfx24
  • Priority: P4
  • Status: Open
  • Resolution: Unresolved
  • OS: os_x
  • CPU: generic
  • Submitted: 2024-09-05
  • Updated: 2024-09-05
The Version table provides details related to the release that this issue/RFE will be addressed.

Unresolved : Release in which this issue/RFE will be addressed.
Resolved: Release in which this issue/RFE has been resolved.
Fixed : Release in which this issue/RFE has been fixed. The release containing this fix may be available for download as an Early Access Release or a General Availability Release.

To download the current JDK release, click here.
Other
tbdUnresolved
Related Reports
Relates :  
JDK-8325445 - [macOS] Colors are not displayed in sRGB color space
Description
We are seeing failure of 22 3D Jemmy tests in latest code.
Failing tests are :
test/scenegraph/fx3d/camera/fixedeye/PerspectiveCameraFixedEyeAsChildTest.java:
test/scenegraph/fx3d/camera/fixedeye/PerspectiveCameraFixedEyeIsolateTest.java:
test/scenegraph/fx3d/camera/perspective/PerspectiveCameraAsChildTest.java:
test/scenegraph/fx3d/camera/perspective/PerspectiveCameraIsolateTest.java:
test/scenegraph/fx3d/depth/DepthTest.java:
test/scenegraph/fx3d/depth/IntersectionTest.java:
test/scenegraph/fx3d/lighting/MultipleLightingTest.java:
test/scenegraph/fx3d/lighting/SingleLightingTest.java: 
test/scenegraph/fx3d/shapes/BoxTest.java:
test/scenegraph/fx3d/shapes/CylinderTest.java:
test/scenegraph/fx3d/shapes/MeshTest.java:
test/scenegraph/fx3d/shapes/SphereTest.java:
test/scenegraph/fx3d/subscene/SubSceneBasicPropsTest.java:
test/scenegraph/fx3d/subscene/camera/fixedeye/SubScenePerspectiveCameraFixedEyeAsChildTest.java:
test/scenegraph/fx3d/subscene/camera/fixedeye/SubScenePerspectiveCameraFixedEyeIsolateTest.java:
test/scenegraph/fx3d/subscene/camera/perspective/SubScenePerspectiveCameraAsChildTest.java:
test/scenegraph/fx3d/subscene/camera/perspective/SubScenePerspectiveCameraIsolateTest.java:
test/scenegraph/fx3d/subscene/lighting/scoping/SubSceneLightScopingTest.java:
test/scenegraph/fx3d/subscene/shapes/SubSceneBoxTest.java:
test/scenegraph/fx3d/subscene/shapes/SubSceneCylinderTest.java:
test/scenegraph/fx3d/subscene/shapes/SubSceneMeshTest.java:
test/scenegraph/fx3d/subscene/shapes/SubSceneSphereTest.java: 

All these test produce diff.png in build folder and all of them show visible saturation difference in color. Attached expected, generated and diff image for once such test. This is observed in macOS 14.6.1 machine while verifying metal implementation.

This color difference can be seen in both OpenGL and Metal pipeline in macOS.
Comments
If this does turn out to be an expected result of JDK-8325445, then yes, the remedy will be to regenerate the golden images. If it turns out to be something else, then we will need to file a new bug (either a product bug or a test bug depending on what the problem is).
05-09-2024
All these tests which are failing use golden image to verify the expected output. This failure can be related to https://bugs.openjdk.org/browse/JDK-8325445 and we need to update our golden image and then run these tests again.
05-09-2024