JDK-8260904 : Test results of Early Access (EA-9) build - IntelliJ IDEA IDE
Type:Task
Component:client-libs
Sub-Component:2d
Affected Version:internal
Priority:P3
Status:Closed
Resolution:Delivered
OS:os_x
CPU:x86_64
Submitted:2021-02-02
Updated:2021-02-19
Resolved:2021-02-11
The Version table provides details related to the release that this issue/RFE will be addressed.
Unresolved : Release in which this issue/RFE will be addressed. Resolved: Release in which this issue/RFE has been resolved. Fixed : Release in which this issue/RFE has been fixed. The release containing this fix may be available for download as an Early Access Release or a General Availability Release.
This bug is to capture the results of IntelliJ IDEA IDE testing with EA-9 build and metal pipeline.
1) IntelliJ IDEA IDE usage - manual testing
2) IntelliJ IDEA IDE rendering performance
Comments
More measurements of Editor Rendering benchmark were made for various scales. It was observed that the amount of opened windows affects scores. So measurements were made with opened IDE, Google sheet (for registering scores), System Prferences | Displays.
HW MacBookPro mid2015, AMD Radeon R9 M370X 2 GB, Intel Iris Pro 1536 MB Graphics and two monitors (internal and external)
SCALE1
=====
1) internal monitor Scaled looks like: 1024x640, Colour Display profile=sRGB IEC61966-2.1, Editor frame: 982x467
- OGL
avg: 476.4 FPS
median: 476.6 FPS
- Metal
avg: 533.6 FPS
median: 546.5 FPS
2) external monitor Scaled looks like: 1504x846, Colour Display profile=DELL P2415Q, Editor frame: 1462x703
- OGL
avg: 48.1 FPS
median: 48.2 FPS
- Metal
avg: 28.3 FPS
median: 28.6 FPS
SCALE2
=====
1) internal monitor Scaled looks like: 1280x800, Editor frame: 1238x619
- OGL
avg: 304.7 FPS
median: 305.2 FPS
- Metal
avg: 398.9 FPS
median: 400.1 FPS
2) external monitor Scaled looks like: 1920x1080, Editor frame: 1462x703
- OGL
avg: 40.7 FPS
median: 40.6 FPS
- Metal
avg: 28.4 FPS
median: 28.7 FPS
SCALE3
=====
1) internal monitor Scaled looks like: 1440x900, Editor frame: 1398x716
- OGL
avg: 234.2 FPS
median: 234.2 FPS
- Metal
avg: 344.7 FPS
median: 354.7 FPS
2) external monitor Scaled looks like: 2304x1296, Editor frame: 2262x1153
- OGL
avg: 78.1 FPS
median: 78.0 FPS
- Metal
avg: 27.7 FPS
median: 27.6 FPS
SCALE4
=====
1) internal monitor Scaled looks like: 1680x1050, Editor frame: 1638x860
- OGL
avg: 154.6 FPS
median: 154.5 FPS
- Metal
avg: 251.8 FPS
median: 255.0 FPS
2) external monitor Scaled looks like: 2560x1440, Editor frame: 2518x1297
- OGL
avg: 60.1 FPS
median: 60.2 FPS
- Metal
avg: 108.7 FPS
median: 108.9 FPS
SCALE5
=====
1) internal monitor Scaled looks like: 1920x1200, Editor frame: 1878x1005
- OGL
avg: 114.4 FPS
median: 114.6 FPS
- Metal
avg: 198.7 FPS
median: 198.8 FPS
2) external monitor Scaled looks like: 3008x1692, Editor frame: 2966x1549
- OGL
avg: 45 FPS
median: 45 FPS
- Metal
avg: 80.0 FPS
median: 80.1 FPS
Here is result of OGL rendering vs Metal comparison by IDEA Editor Rendering Benchmark on the build EA 9 Build 17-lanai+2-49 (2021/1/20)
HW MacBookPro mid2015 equipped with AMD Radeon R9 M370X 2 GB, Intel Iris Pro 1536 MB Graphics and two monitors (internal and external)
1) internal monitor Scaled looks like: 1680x1050, Colour Display profile=sRGB IEC61966-2.1, Editor frame: 1638��853
- OGL
avg: 41.8 FPS
median: 41.8 FPS
- Metal
avg: 26.0 FPS
median: 25.7 FPS
2) external monitor Scaled looks like: 2304x1296, Colour Display profile=DELL P2415Q, Editor frame: 2518��1342
- OGL
avg: 30.8 FPS
median: 30.8 FPS
- Metal
avg: 26.0 FPS
median: 26.2 FPS
The above scores were produced based on 10-12 launches of the benchmark for each case monitor+framework.
see the attached chart OGL_vs_Metal_meas1.png
11-02-2021
Results are awaited.
It is not a blocker for JEP "Proposed To Target" - as earlier testing had revealed good results - see last comment on JDK-8252726.