JDK-8203848 : Missing remembered set entry in j.l.ref.references after JDK-8203028
  • Type: Bug
  • Component: hotspot
  • Sub-Component: gc
  • Affected Version: 11
  • Priority: P2
  • Status: Closed
  • Resolution: Fixed
  • Submitted: 2018-05-27
  • Updated: 2021-10-20
  • Resolved: 2018-07-02
The Version table provides details related to the release that this issue/RFE will be addressed.

Unresolved : Release in which this issue/RFE will be addressed.
Resolved: Release in which this issue/RFE has been resolved.
Fixed : Release in which this issue/RFE has been fixed. The release containing this fix may be available for download as an Early Access Release or a General Availability Release.

To download the current JDK release, click here.
JDK 11 JDK 12
11 b21Fixed 12Fixed
Related Reports
Relates :  
JDK-8204081 - Mismatch in rebuild policy and collection set chooser causes remembered sets to be kept errorneously
Relates :  
JDK-8204169 - Humongous continues region remembered set states do not match the one from the corresponding humongous start region
Relates :  
JDK-8203028 - Simplify reference processing in light of JDK-8175797
Description
----------System.err:(251/30449)----------
 stdout: [[0.023s][info][gc] Using G1
[0.519s][info][gc] GC(0) Pause Initial Mark (G1 Humongous Allocation) 1M->1M(128M) 88.102ms
[0.519s][info][gc] GC(1) Concurrent Cycle
[0.555s][info][gc] GC(1) Pause Remark 14M->14M(128M) 13.830ms
[0.569s][info][gc] GC(1) Pause Cleanup 22M->22M(128M) 0.432ms
[0.572s][info][gc] GC(1) Concurrent Cycle 53.136ms
[0.685s][info][gc] GC(2) Pause Young (G1 Evacuation Pause) 23M->23M(128M) 106.133ms
[0.788s][info][gc] GC(3) Pause Initial Mark (G1 Evacuation Pause) 24M->24M(128M) 91.816ms
[0.789s][info][gc] GC(4) Concurrent Cycle
[0.895s][info][gc] GC(5) Pause Young (G1 Evacuation Pause) 25M->25M(128M) 84.076ms
[1.018s][info][gc] GC(6) Pause Young (G1 Evacuation Pause) 26M->26M(128M) 115.441ms
[1.051s][info][gc] GC(4) Pause Remark 27M->27M(128M) 20.201ms
[1.231s][info][gc] GC(7) Pause Young (G1 Evacuation Pause) 27M->27M(128M) 177.253ms
[1.332s][info][gc] GC(8) Pause Young (G1 Evacuation Pause) 28M->28M(128M) 97.227ms
[1.485s][info][gc] GC(9) Pause Young (G1 Evacuation Pause) 29M->29M(128M) 145.482ms
[1.697s][info][gc] GC(10) Pause Young (G1 Evacuation Pause) 30M->30M(128M) 203.001ms
[1.843s][info][gc] GC(11) Pause Young (G1 Evacuation Pause) 31M->31M(128M) 136.155ms
[1.982s][info][gc] GC(12) Pause Young (G1 Evacuation Pause) 32M->32M(128M) 136.008ms
[1.989s][info][gc] GC(4) Pause Cleanup 32M->32M(128M) 0.591ms
[2.115s][info][gc] GC(13) Pause Young (G1 Evacuation Pause) 33M->33M(128M) 123.047ms
[2.119s][info][gc] GC(4) Concurrent Cycle 1330.725ms
[2.269s][info][gc] GC(14) Pause Young (G1 Evacuation Pause) 34M->34M(128M) 145.047ms
[2.404s][info][gc] GC(15) Pause Initial Mark (G1 Evacuation Pause) 35M->35M(128M) 132.807ms
[2.404s][info][gc] GC(16) Concurrent Cycle
[2.538s][info][gc] GC(17) Pause Young (G1 Evacuation Pause) 36M->37M(128M) 131.392ms
[2.685s][info][gc] GC(18) Pause Young (G1 Evacuation Pause) 38M->38M(128M) 143.652ms
[2.829s][info][gc] GC(16) Pause Remark 39M->39M(128M) 3.344ms
[2.962s][info][gc] GC(19) Pause Young (G1 Evacuation Pause) 39M->37M(128M) 131.286ms
[3.096s][info][gc] GC(16) Pause Cleanup 38M->38M(128M) 0.433ms
[3.097s][info][gc] GC(16) Concurrent Cycle 693.097ms
[3.347s][info][gc] GC(20) Pause Young (G1 Evacuation Pause) 38M->37M(128M) 215.267ms
[I@1c53fd30 [I@50cbc42f [I@75412c2f [I@282ba1e
[3.523s][info][gc] GC(21) Pause Initial Mark (G1 Humongous Allocation) 37M->37M(128M) 148.560ms
[3.524s][info][gc] GC(22) Concurrent Cycle
[3.770s][info][gc] GC(23) Pause Young (G1 Evacuation Pause) 54M->42M(128M) 212.023ms
[4.055s][info][gc] GC(24) Pause Young (G1 Evacuation Pause) 43M->43M(128M) 282.975ms
[4.068s][info][gc] GC(22) Pause Remark 43M->29M(128M) 11.675ms
[4.194s][info][gc] GC(25) Pause Young (G1 Evacuation Pause) 30M->30M(128M) 110.929ms
[4.314s][info][gc] GC(26) Pause Young (G1 Evacuation Pause) 31M->31M(128M) 103.372ms
[4.408s][info][gc] GC(27) Pause Young (G1 Evacuation Pause) 32M->32M(128M) 92.045ms
[4.409s][info][gc] GC(22) Pause Cleanup 33M->33M(128M) 0.632ms
[4.502s][info][gc] GC(28) Pause Young (G1 Evacuation Pause) 33M->29M(128M) 91.495ms
[4.502s][info][gc] GC(22) Concurrent Cycle 977.611ms
[4.591s][info][gc] GC(29) Pause Young (G1 Evacuation Pause) 30M->30M(128M) 88.637ms
[4.682s][info][gc] GC(30) Pause Initial Mark (G1 Evacuation Pause) 31M->31M(128M) 89.358ms
[4.682s][info][gc] GC(31) Concurrent Cycle
[4.808s][info][gc] GC(32) Pause Young (G1 Evacuation Pause) 32M->32M(128M) 121.832ms
[4.925s][info][gc] GC(33) Pause Young (G1 Evacuation Pause) 33M->33M(128M) 115.892ms
[5.050s][info][gc] GC(34) Pause Young (G1 Evacuation Pause) 34M->34M(128M) 118.002ms
[5.207s][info][gc] GC(35) Pause Young (G1 Evacuation Pause) 35M->35M(128M) 154.480ms
[5.383s][info][gc] GC(36) Pause Young (G1 Evacuation Pause) 36M->36M(128M) 174.368ms
[5.589s][info][gc] GC(37) Pause Young (G1 Evacuation Pause) 37M->37M(128M) 194.299ms
[5.865s][info][gc] GC(38) Pause Young (G1 Evacuation Pause) 38M->38M(128M) 253.509ms
[I@13b6d03 [I@f5f2bb7 [I@73035e27 [I@64c64813
[6.122s][info][gc] GC(39) Pause Young (G1 Evacuation Pause) 55M->42M(128M) 237.649ms
[6.341s][info][gc] GC(40) Pause Young (G1 Evacuation Pause) 43M->43M(128M) 217.373ms
[6.570s][info][gc] GC(41) Pause Young (G1 Evacuation Pause) 44M->44M(128M) 220.074ms
[6.785s][error][gc,verify] ----------
[6.785s][error][gc,verify] Missing rem set entry:
[6.785s][error][gc,verify] Field 0x00000000fa516298 of obj 0x00000000fa516280, in region 37:(O)[0x00000000fa500000,0x00000000fa600000,0x00000000fa600000]
[6.785s][error][gc,verify] java.lang.invoke.MethodType$ConcurrentWeakInternSet$WeakEntry 
[6.785s][error][gc,verify] {0x00000000fa516280} - klass: 'java/lang/invoke/MethodType$ConcurrentWeakInternSet$WeakEntry'
[6.785s][error][gc,verify]  - ---- fields (total size 4 words):
[6.785s][error][gc,verify]  - private strict 'referent' 'Ljava/lang/Object;' @12  a 'java/lang/invoke/MethodType'{0x00000000fa566290} = (Ljava/lang/invoke/MethodHandle;II)Ljava/lang/Object; (fa566290)
[6.785s][error][gc,verify]  - volatile strict 'queue' 'Ljava/lang/ref/ReferenceQueue;' @16  a 'java/lang/ref/ReferenceQueue'{0x00000000fa5766f0} (fa5766f0)
[6.785s][error][gc,verify]  - volatile 'next' 'Ljava/lang/ref/Reference;' @20  NULL (0)
[6.785s][error][gc,verify]  - private transient strict 'discovered' 'Ljava/lang/ref/Reference;' @24  a 'java/lang/invoke/MethodType$ConcurrentWeakInternSet$WeakEntry'{0x00000000f8a42758} (f8a42758)
[6.785s][error][gc,verify]  - public final 'hashcode' 'I' @28  289086954 (113b1dea)
[6.785s][error][gc,verify] points to obj 0x00000000f8a42758 in region 10:(O)[0x00000000f8a00000,0x00000000f8b00000,0x00000000f8b00000] remset Complete
[6.785s][error][gc,verify] java.lang.invoke.MethodType$ConcurrentWeakInternSet$WeakEntry 
[6.785s][error][gc,verify] {0x00000000f8a42758} - klass: 'java/lang/invoke/MethodType$ConcurrentWeakInternSet$WeakEntry'
[6.785s][error][gc,verify]  - ---- fields (total size 4 words):
[6.785s][error][gc,verify]  - private strict 'referent' 'Ljava/lang/Object;' @12  a 'java/lang/invoke/MethodType'{0x00000000fa563020} = (ILjava/lang/Object;Ljava/lang/invoke/MemberName;)I (fa563020)
[6.785s][error][gc,verify]  - volatile strict 'queue' 'Ljava/lang/ref/ReferenceQueue;' @16  a 'java/lang/ref/ReferenceQueue'{0x00000000fa5766f0} (fa5766f0)
[6.785s][error][gc,verify]  - volatile 'next' 'Ljava/lang/ref/Reference;' @20  NULL (0)
[6.785s][error][gc,verify]  - private transient strict 'discovered' 'Ljava/lang/ref/Reference;' @24  a 'java/lang/invoke/MethodType$ConcurrentWeakInternSet$WeakEntry'{0x00000000f8a427b8} (f8a427b8)
[6.785s][error][gc,verify]  - public final 'hashcode' 'I' @28  520407875 (1f04cb43)
[6.785s][error][gc,verify] Obj head CTE = -1, field CTE = -1.
[6.785s][error][gc,verify] ----------
[6.801s][error][gc,verify] Heap after failed verification (kind 0):
[6.801s][error][gc,verify]  garbage-first heap   total 131072K, used 46479K [0x00000000f8000000, 0x0000000100000000)
[6.801s][error][gc,verify]   region size 1024K, 1 young (1024K), 1 survivors (1024K)
[6.801s][error][gc,verify]  Metaspace       used 5403K, capacity 5507K, committed 5632K, reserved 1056768K
[6.801s][error][gc,verify]   class space    used 442K, capacity 474K, committed 512K, reserved 1048576K
[6.801s][error][gc,verify] Heap Regions: E=young(eden), S=young(survivor), O=old, HS=humongous(starts), HC=humongous(continues), CS=collection set, F=free, A=archive, TAMS=top-at-mark-start (previous, next)
[6.801s][error][gc,verify] |   0|0x00000000f8000000, 0x00000000f8100000, 0x00000000f8100000|100%| O|  |TAMS 0x00000000f8100000, 0x00000000f8100000| Untracked 
[6.801s][error][gc,verify] |   1|0x00000000f8100000, 0x00000000f8200000, 0x00000000f8200000|100%|HS|  |TAMS 0x00000000f8200000, 0x00000000f8200000| Complete 
[6.801s][error][gc,verify] |   2|0x00000000f8200000, 0x00000000f8300000, 0x00000000f8300000|100%|HC|  |TAMS 0x00000000f8300000, 0x00000000f8300000| Complete 
[6.801s][error][gc,verify] |   3|0x00000000f8300000, 0x00000000f8400000, 0x00000000f8400000|100%|HC|  |TAMS 0x00000000f8400000, 0x00000000f8400000| Complete 
[6.801s][error][gc,verify] |   4|0x00000000f8400000, 0x00000000f8500000, 0x00000000f8500000|100%|HC|  |TAMS 0x00000000f8500000, 0x00000000f8500000| Complete 
[6.801s][error][gc,verify] |   5|0x00000000f8500000, 0x00000000f8600000, 0x00000000f8600000|100%|HC|  |TAMS 0x00000000f8600000, 0x00000000f8600000| Complete 
[6.801s][error][gc,verify] |   6|0x00000000f8600000, 0x00000000f8700000, 0x00000000f8700000|100%| O|  |TAMS 0x00000000f8600000, 0x00000000f8700000| Untracked 
[6.801s][error][gc,verify] |   7|0x00000000f8700000, 0x00000000f8800000, 0x00000000f8800000|100%| O|  |TAMS 0x00000000f8700000, 0x00000000f87a5000| Untracked 
[6.801s][error][gc,verify] |   8|0x00000000f8800000, 0x00000000f8900000, 0x00000000f8900000|100%| O|  |TAMS 0x00000000f8800000, 0x00000000f8800000| Untracked 
[6.801s][error][gc,verify] |   9|0x00000000f8900000, 0x00000000f8a00000, 0x00000000f8a00000|100%| O|  |TAMS 0x00000000f8900000, 0x00000000f8900000| Untracked 
[6.801s][error][gc,verify] |  10|0x00000000f8a00000, 0x00000000f8b00000, 0x00000000f8b00000|100%| O|  |TAMS 0x00000000f8a00000, 0x00000000f8b00000| Complete 
[6.801s][error][gc,verify] |  11|0x00000000f8b00000, 0x00000000f8c00000, 0x00000000f8c00000|100%| O|  |TAMS 0x00000000f8b00000, 0x00000000f8c00000| Untracked 
[6.801s][error][gc,verify] |  12|0x00000000f8c00000, 0x00000000f8d00000, 0x00000000f8d00000|100%| O|  |TAMS 0x00000000f8c00000, 0x00000000f8d00000| Untracked 
[6.801s][error][gc,verify] |  13|0x00000000f8d00000, 0x00000000f8e00000, 0x00000000f8e00000|100%| O|  |TAMS 0x00000000f8d00000, 0x00000000f8e00000| Untracked 
[6.801s][error][gc,verify] |  14|0x00000000f8e00000, 0x00000000f8f00000, 0x00000000f8f00000|100%| O|  |TAMS 0x00000000f8e00000, 0x00000000f8f00000| Untracked 
[6.801s][error][gc,verify] |  15|0x00000000f8f00000, 0x00000000f9000000, 0x00000000f9000000|100%| O|  |TAMS 0x00000000f8f00000, 0x00000000f8f00000| Untracked 
[6.801s][error][gc,verify] |  16|0x00000000f9000000, 0x00000000f9100000, 0x00000000f9100000|100%| O|  |TAMS 0x00000000f9000000, 0x00000000f9000000| Untracked 
[6.801s][error][gc,verify] |  17|0x00000000f9100000, 0x00000000f9200000, 0x00000000f9200000|100%| O|  |TAMS 0x00000000f9100000, 0x00000000f9100000| Untracked 
[6.801s][error][gc,verify] |  18|0x00000000f9200000, 0x00000000f9300000, 0x00000000f9300000|100%| O|  |TAMS 0x00000000f9200000, 0x00000000f9200000| Untracked 
[6.801s][error][gc,verify] |  19|0x00000000f9300000, 0x00000000f9400000, 0x00000000f9400000|100%| O|  |TAMS 0x00000000f9300000, 0x00000000f9300000| Untracked 
[6.801s][error][gc,verify] |  20|0x00000000f9400000, 0x00000000f9500000, 0x00000000f9500000|100%| O|  |TAMS 0x00000000f9400000, 0x00000000f9400000| Untracked 
[6.801s][error][gc,verify] |  21|0x00000000f9500000, 0x00000000f9600000, 0x00000000f9600000|100%| O|  |TAMS 0x00000000f9500000, 0x00000000f9500000| Untracked 
[6.801s][error][gc,verify] |  22|0x00000000f9600000, 0x00000000f9700000, 0x00000000f9700000|100%| O|  |TAMS 0x00000000f9700000, 0x00000000f9700000| Untracked 
[6.801s][error][gc,verify] |  23|0x00000000f9700000, 0x00000000f9800000, 0x00000000f9800000|100%|HS|  |TAMS 0x00000000f9700000, 0x00000000f9700000| Complete 
[6.801s][error][gc,verify] |  24|0x00000000f9800000, 0x00000000f9900000, 0x00000000f9900000|100%|HC|  |TAMS 0x00000000f9800000, 0x00000000f9800000| Complete 
[6.801s][error][gc,verify] |  25|0x00000000f9900000, 0x00000000f9a00000, 0x00000000f9a00000|100%|HC|  |TAMS 0x00000000f9900000, 0x00000000f9900000| Complete 
[6.801s][error][gc,verify] |  26|0x00000000f9a00000, 0x00000000f9b00000, 0x00000000f9b00000|100%|HC|  |TAMS 0x00000000f9a00000, 0x00000000f9a00000| Complete 
[6.801s][error][gc,verify] |  27|0x00000000f9b00000, 0x00000000f9c00000, 0x00000000f9c00000|100%|HS|  |TAMS 0x00000000f9b00000, 0x00000000f9b00000| Complete 
[6.801s][error][gc,verify] |  28|0x00000000f9c00000, 0x00000000f9d00000, 0x00000000f9d00000|100%|HC|  |TAMS 0x00000000f9c00000, 0x00000000f9c00000| Complete 
[6.801s][error][gc,verify] |  29|0x00000000f9d00000, 0x00000000f9e00000, 0x00000000f9e00000|100%|HC|  |TAMS 0x00000000f9d00000, 0x00000000f9d00000| Complete 
[6.801s][error][gc,verify] |  30|0x00000000f9e00000, 0x00000000f9f00000, 0x00000000f9f00000|100%|HC|  |TAMS 0x00000000f9e00000, 0x00000000f9e00000| Complete 
[6.801s][error][gc,verify] |  31|0x00000000f9f00000, 0x00000000fa000000, 0x00000000fa000000|100%|HS|  |TAMS 0x00000000f9f00000, 0x00000000f9f00000| Complete 
[6.801s][error][gc,verify] |  32|0x00000000fa000000, 0x00000000fa100000, 0x00000000fa100000|100%|HC|  |TAMS 0x00000000fa000000, 0x00000000fa000000| Complete 
[6.801s][error][gc,verify] |  33|0x00000000fa100000, 0x00000000fa200000, 0x00000000fa200000|100%|HC|  |TAMS 0x00000000fa100000, 0x00000000fa100000| Complete 
[6.801s][error][gc,verify] |  34|0x00000000fa200000, 0x00000000fa300000, 0x00000000fa300000|100%|HC|  |TAMS 0x00000000fa200000, 0x00000000fa200000| Complete 
[6.801s][error][gc,verify] |  35|0x00000000fa300000, 0x00000000fa363c00, 0x00000000fa400000| 38%| O|  |TAMS 0x00000000fa300000, 0x00000000fa300000| Untracked 
[6.801s][error][gc,verify] |  36|0x00000000fa400000, 0x00000000fa400000, 0x00000000fa500000|  0%| F|  |TAMS 0x00000000fa400000, 0x00000000fa400000| Untracked 
[6.801s][error][gc,verify] |  37|0x00000000fa500000, 0x00000000fa600000, 0x00000000fa600000|100%| O|  |TAMS 0x00000000fa510c00, 0x00000000fa600000| Untracked 
[6.801s][error][gc,verify] |  38|0x00000000fa600000, 0x00000000fa700000, 0x00000000fa700000|100%|HS|  |TAMS 0x00000000fa600000, 0x00000000fa700000| Untracked 
[6.801s][error][gc,verify] |  39|0x00000000fa700000, 0x00000000fa800000, 0x00000000fa800000|100%|HC|  |TAMS 0x00000000fa700000, 0x00000000fa800000| Complete 
[6.801s][error][gc,verify] |  40|0x00000000fa800000, 0x00000000fa900000, 0x00000000fa900000|100%|HC|  |TAMS 0x00000000fa800000, 0x00000000fa900000| Complete 
[6.801s][error][gc,verify] |  41|0x00000000fa900000, 0x00000000faa00000, 0x00000000faa00000|100%|HC|  |TAMS 0x00000000fa900000, 0x00000000faa00000| Complete 
[6.801s][error][gc,verify] |  42|0x00000000faa00000, 0x00000000faa00000, 0x00000000fab00000|  0%| F|  |TAMS 0x00000000faa00000, 0x00000000faa00000| Untracked 
[6.801s][error][gc,verify] |  43|0x00000000fab00000, 0x00000000fab00000, 0x00000000fac00000|  0%| F|  |TAMS 0x00000000fab00000, 0x00000000fab00000| Untracked 
[6.801s][error][gc,verify] |  44|0x00000000fac00000, 0x00000000fac00000, 0x00000000fad00000|  0%| F|  |TAMS 0x00000000fac00000, 0x00000000fac00000| Untracked 
[6.801s][error][gc,verify] |  45|0x00000000fad00000, 0x00000000fad00000, 0x00000000fae00000|  0%| F|  |TAMS 0x00000000fad00000, 0x00000000fad00000| Untracked 
[6.801s][error][gc,verify] |  46|0x00000000fae00000, 0x00000000fae00000, 0x00000000faf00000|  0%| F|  |TAMS 0x00000000fae00000, 0x00000000fae00000| Untracked 
[6.801s][error][gc,verify] |  47|0x00000000faf00000, 0x00000000faf00000, 0x00000000fb000000|  0%| F|  |TAMS 0x00000000faf00000, 0x00000000faf00000| Untracked 
[6.801s][error][gc,verify] |  48|0x00000000fb000000, 0x00000000fb000000, 0x00000000fb100000|  0%| F|  |TAMS 0x00000000fb000000, 0x00000000fb000000| Untracked 
[6.801s][error][gc,verify] |  49|0x00000000fb100000, 0x00000000fb100000, 0x00000000fb200000|  0%| F|  |TAMS 0x00000000fb100000, 0x00000000fb100000| Untracked 
[6.801s][error][gc,verify] |  50|0x00000000fb200000, 0x00000000fb200000, 0x00000000fb300000|  0%| F|  |TAMS 0x00000000fb200000, 0x00000000fb200000| Untracked 
[6.801s][error][gc,verify] |  51|0x00000000fb300000, 0x00000000fb300000, 0x00000000fb400000|  0%| F|  |TAMS 0x00000000fb300000, 0x00000000fb300000| Untracked 
[6.801s][error][gc,verify] |  52|0x00000000fb400000, 0x00000000fb400000, 0x00000000fb500000|  0%| F|  |TAMS 0x00000000fb400000, 0x00000000fb400000| Untracked 
[6.801s][error][gc,verify] |  53|0x00000000fb500000, 0x00000000fb500000, 0x00000000fb600000|  0%| F|  |TAMS 0x00000000fb500000, 0x00000000fb500000| Untracked 
[6.801s][error][gc,verify] |  54|0x00000000fb600000, 0x00000000fb700000, 0x00000000fb700000|100%|HS|  |TAMS 0x00000000fb600000, 0x00000000fb600000| Complete 
[6.801s][error][gc,verify] |  55|0x00000000fb700000, 0x00000000fb800000, 0x00000000fb800000|100%|HC|  |TAMS 0x00000000fb700000, 0x00000000fb700000| Complete 
[6.801s][error][gc,verify] |  56|0x00000000fb800000, 0x00000000fb900000, 0x00000000fb900000|100%|HC|  |TAMS 0x00000000fb800000, 0x00000000fb800000| Complete 
[6.801s][error][gc,verify] |  57|0x00000000fb900000, 0x00000000fba00000, 0x00000000fba00000|100%|HC|  |TAMS 0x00000000fb900000, 0x00000000fb900000| Complete 
[6.801s][error][gc,verify] |  58|0x00000000fba00000, 0x00000000fba00000, 0x00000000fbb00000|  0%| F|  |TAMS 0x00000000fba00000, 0x00000000fba00000| Untracked 
[6.801s][error][gc,verify] |  59|0x00000000fbb00000, 0x00000000fbb00000, 0x00000000fbc00000|  0%| F|  |TAMS 0x00000000fbb00000, 0x00000000fbb00000| Untracked 
[6.801s][error][gc,verify] |  60|0x00000000fbc00000, 0x00000000fbc00000, 0x00000000fbd00000|  0%| F|  |TAMS 0x00000000fbc00000, 0x00000000fbc00000| Untracked 
[6.801s][error][gc,verify] |  61|0x00000000fbd00000, 0x00000000fbd00000, 0x00000000fbe00000|  0%| F|  |TAMS 0x00000000fbd00000, 0x00000000fbd00000| Untracked 
[6.801s][error][gc,verify] |  62|0x00000000fbe00000, 0x00000000fbe00000, 0x00000000fbf00000|  0%| F|  |TAMS 0x00000000fbe00000, 0x00000000fbe00000| Untracked 
[6.801s][error][gc,verify] |  63|0x00000000fbf00000, 0x00000000fbf00000, 0x00000000fc000000|  0%| F|  |TAMS 0x00000000fbf00000, 0x00000000fbf00000| Untracked 
[6.801s][error][gc,verify] |  64|0x00000000fc000000, 0x00000000fc000000, 0x00000000fc100000|  0%| F|  |TAMS 0x00000000fc000000, 0x00000000fc000000| Untracked 
[6.801s][error][gc,verify] |  65|0x00000000fc100000, 0x00000000fc100000, 0x00000000fc200000|  0%| F|  |TAMS 0x00000000fc100000, 0x00000000fc100000| Untracked 
[6.801s][error][gc,verify] |  66|0x00000000fc200000, 0x00000000fc200000, 0x00000000fc300000|  0%| F|  |TAMS 0x00000000fc200000, 0x00000000fc200000| Untracked 
[6.801s][error][gc,verify] |  67|0x00000000fc300000, 0x00000000fc300000, 0x00000000fc400000|  0%| F|  |TAMS 0x00000000fc300000, 0x00000000fc300000| Untracked 
[6.801s][error][gc,verify] |  68|0x00000000fc400000, 0x00000000fc400000, 0x00000000fc500000|  0%| F|  |TAMS 0x00000000fc400000, 0x00000000fc400000| Untracked 
[6.801s][error][gc,verify] |  69|0x00000000fc500000, 0x00000000fc500000, 0x00000000fc600000|  0%| F|  |TAMS 0x00000000fc500000, 0x00000000fc500000| Untracked 
[6.801s][error][gc,verify] |  70|0x00000000fc600000, 0x00000000fc600000, 0x00000000fc700000|  0%| F|  |TAMS 0x00000000fc600000, 0x00000000fc600000| Untracked 
[6.801s][error][gc,verify] |  71|0x00000000fc700000, 0x00000000fc700000, 0x00000000fc800000|  0%| F|  |TAMS 0x00000000fc700000, 0x00000000fc700000| Untracked 
[6.801s][error][gc,verify] |  72|0x00000000fc800000, 0x00000000fc800000, 0x00000000fc900000|  0%| F|  |TAMS 0x00000000fc800000, 0x00000000fc800000| Untracked 
[6.801s][error][gc,verify] |  73|0x00000000fc900000, 0x00000000fc900000, 0x00000000fca00000|  0%| F|  |TAMS 0x00000000fc900000, 0x00000000fc900000| Untracked 
[6.801s][error][gc,verify] |  74|0x00000000fca00000, 0x00000000fca00000, 0x00000000fcb00000|  0%| F|  |TAMS 0x00000000fca00000, 0x00000000fca00000| Untracked 
[6.801s][error][gc,verify] |  75|0x00000000fcb00000, 0x00000000fcb00000, 0x00000000fcc00000|  0%| F|  |TAMS 0x00000000fcb00000, 0x00000000fcb00000| Untracked 
[6.801s][error][gc,verify] |  76|0x00000000fcc00000, 0x00000000fcc00000, 0x00000000fcd00000|  0%| F|  |TAMS 0x00000000fcc00000, 0x00000000fcc00000| Untracked 
[6.801s][error][gc,verify] |  77|0x00000000fcd00000, 0x00000000fcd00000, 0x00000000fce00000|  0%| F|  |TAMS 0x00000000fcd00000, 0x00000000fcd00000| Untracked 
[6.801s][error][gc,verify] |  78|0x00000000fce00000, 0x00000000fce00000, 0x00000000fcf00000|  0%| F|  |TAMS 0x00000000fce00000, 0x00000000fce00000| Untracked 
[6.801s][error][gc,verify] |  79|0x00000000fcf00000, 0x00000000fcf00000, 0x00000000fd000000|  0%| F|  |TAMS 0x00000000fcf00000, 0x00000000fcf00000| Untracked 
[6.801s][error][gc,verify] |  80|0x00000000fd000000, 0x00000000fd000000, 0x00000000fd100000|  0%| F|  |TAMS 0x00000000fd000000, 0x00000000fd000000| Untracked 
[6.801s][error][gc,verify] |  81|0x00000000fd100000, 0x00000000fd100000, 0x00000000fd200000|  0%| F|  |TAMS 0x00000000fd100000, 0x00000000fd100000| Untracked 
[6.801s][error][gc,verify] |  82|0x00000000fd200000, 0x00000000fd200000, 0x00000000fd300000|  0%| F|  |TAMS 0x00000000fd200000, 0x00000000fd200000| Untracked 
[6.801s][error][gc,verify] |  83|0x00000000fd300000, 0x00000000fd300000, 0x00000000fd400000|  0%| F|  |TAMS 0x00000000fd300000, 0x00000000fd300000| Untracked 
[6.801s][error][gc,verify] |  84|0x00000000fd400000, 0x00000000fd400000, 0x00000000fd500000|  0%| F|  |TAMS 0x00000000fd400000, 0x00000000fd400000| Untracked 
[6.801s][error][gc,verify] |  85|0x00000000fd500000, 0x00000000fd500000, 0x00000000fd600000|  0%| F|  |TAMS 0x00000000fd500000, 0x00000000fd500000| Untracked 
[6.801s][error][gc,verify] |  86|0x00000000fd600000, 0x00000000fd600000, 0x00000000fd700000|  0%| F|  |TAMS 0x00000000fd600000, 0x00000000fd600000| Untracked 
[6.801s][error][gc,verify] |  87|0x00000000fd700000, 0x00000000fd700000, 0x00000000fd800000|  0%| F|  |TAMS 0x00000000fd700000, 0x00000000fd700000| Untracked 
[6.801s][error][gc,verify] |  88|0x00000000fd800000, 0x00000000fd800000, 0x00000000fd900000|  0%| F|  |TAMS 0x00000000fd800000, 0x00000000fd800000| Untracked 
[6.801s][error][gc,verify] |  89|0x00000000fd900000, 0x00000000fd900000, 0x00000000fda00000|  0%| F|  |TAMS 0x00000000fd900000, 0x00000000fd900000| Untracked 
[6.801s][error][gc,verify] |  90|0x00000000fda00000, 0x00000000fda00000, 0x00000000fdb00000|  0%| F|  |TAMS 0x00000000fda00000, 0x00000000fda00000| Untracked 
[6.801s][error][gc,verify] |  91|0x00000000fdb00000, 0x00000000fdb00000, 0x00000000fdc00000|  0%| F|  |TAMS 0x00000000fdb00000, 0x00000000fdb00000| Untracked 
[6.801s][error][gc,verify] |  92|0x00000000fdc00000, 0x00000000fdc00000, 0x00000000fdd00000|  0%| F|  |TAMS 0x00000000fdc00000, 0x00000000fdc00000| Untracked 
[6.801s][error][gc,verify] |  93|0x00000000fdd00000, 0x00000000fdd00000, 0x00000000fde00000|  0%| F|  |TAMS 0x00000000fdd00000, 0x00000000fdd00000| Untracked 
[6.801s][error][gc,verify] |  94|0x00000000fde00000, 0x00000000fde00000, 0x00000000fdf00000|  0%| F|  |TAMS 0x00000000fde00000, 0x00000000fde00000| Untracked 
[6.801s][error][gc,verify] |  95|0x00000000fdf00000, 0x00000000fdf00000, 0x00000000fe000000|  0%| F|  |TAMS 0x00000000fdf00000, 0x00000000fdf00000| Untracked 
[6.801s][error][gc,verify] |  96|0x00000000fe000000, 0x00000000fe000000, 0x00000000fe100000|  0%| F|  |TAMS 0x00000000fe000000, 0x00000000fe000000| Untracked 
[6.801s][error][gc,verify] |  97|0x00000000fe100000, 0x00000000fe100000, 0x00000000fe200000|  0%| F|  |TAMS 0x00000000fe100000, 0x00000000fe100000| Untracked 
[6.801s][error][gc,verify] |  98|0x00000000fe200000, 0x00000000fe200000, 0x00000000fe300000|  0%| F|  |TAMS 0x00000000fe200000, 0x00000000fe200000| Untracked 
[6.801s][error][gc,verify] |  99|0x00000000fe300000, 0x00000000fe300000, 0x00000000fe400000|  0%| F|  |TAMS 0x00000000fe300000, 0x00000000fe300000| Untracked 
[6.801s][error][gc,verify] | 100|0x00000000fe400000, 0x00000000fe400000, 0x00000000fe500000|  0%| F|  |TAMS 0x00000000fe400000, 0x00000000fe400000| Untracked 
[6.801s][error][gc,verify] | 101|0x00000000fe500000, 0x00000000fe500000, 0x00000000fe600000|  0%| F|  |TAMS 0x00000000fe500000, 0x00000000fe500000| Untracked 
[6.801s][error][gc,verify] | 102|0x00000000fe600000, 0x00000000fe600000, 0x00000000fe700000|  0%| F|  |TAMS 0x00000000fe600000, 0x00000000fe600000| Untracked 
[6.801s][error][gc,verify] | 103|0x00000000fe700000, 0x00000000fe700000, 0x00000000fe800000|  0%| F|  |TAMS 0x00000000fe700000, 0x00000000fe700000| Untracked 
[6.801s][error][gc,verify] | 104|0x00000000fe800000, 0x00000000fe800000, 0x00000000fe900000|  0%| F|  |TAMS 0x00000000fe800000, 0x00000000fe800000| Untracked 
[6.801s][error][gc,verify] | 105|0x00000000fe900000, 0x00000000fe900000, 0x00000000fea00000|  0%| F|  |TAMS 0x00000000fe900000, 0x00000000fe900000| Untracked 
[6.801s][error][gc,verify] | 106|0x00000000fea00000, 0x00000000fea00000, 0x00000000feb00000|  0%| F|  |TAMS 0x00000000fea00000, 0x00000000fea00000| Untracked 
[6.801s][error][gc,verify] | 107|0x00000000feb00000, 0x00000000feb00000, 0x00000000fec00000|  0%| F|  |TAMS 0x00000000feb00000, 0x00000000feb00000| Untracked 
[6.801s][error][gc,verify] | 108|0x00000000fec00000, 0x00000000fec00000, 0x00000000fed00000|  0%| F|  |TAMS 0x00000000fec00000, 0x00000000fec00000| Untracked 
[6.801s][error][gc,verify] | 109|0x00000000fed00000, 0x00000000fed00000, 0x00000000fee00000|  0%| F|  |TAMS 0x00000000fed00000, 0x00000000fed00000| Untracked 
[6.801s][error][gc,verify] | 110|0x00000000fee00000, 0x00000000fee00000, 0x00000000fef00000|  0%| F|  |TAMS 0x00000000fee00000, 0x00000000fee00000| Untracked 
[6.801s][error][gc,verify] | 111|0x00000000fef00000, 0x00000000fef00000, 0x00000000ff000000|  0%| F|  |TAMS 0x00000000fef00000, 0x00000000fef00000| Untracked 
[6.801s][error][gc,verify] | 112|0x00000000ff000000, 0x00000000ff000000, 0x00000000ff100000|  0%| F|  |TAMS 0x00000000ff000000, 0x00000000ff000000| Untracked 
[6.801s][error][gc,verify] | 113|0x00000000ff100000, 0x00000000ff100000, 0x00000000ff200000|  0%| F|  |TAMS 0x00000000ff100000, 0x00000000ff100000| Untracked 
[6.801s][error][gc,verify] | 114|0x00000000ff200000, 0x00000000ff200000, 0x00000000ff300000|  0%| F|  |TAMS 0x00000000ff200000, 0x00000000ff200000| Untracked 
[6.801s][error][gc,verify] | 115|0x00000000ff300000, 0x00000000ff300000, 0x00000000ff400000|  0%| F|  |TAMS 0x00000000ff300000, 0x00000000ff300000| Untracked 
[6.801s][error][gc,verify] | 116|0x00000000ff400000, 0x00000000ff400000, 0x00000000ff500000|  0%| F|  |TAMS 0x00000000ff400000, 0x00000000ff400000| Untracked 
[6.801s][error][gc,verify] | 117|0x00000000ff500000, 0x00000000ff500000, 0x00000000ff600000|  0%| F|  |TAMS 0x00000000ff500000, 0x00000000ff500000| Untracked 
[6.801s][error][gc,verify] | 118|0x00000000ff600000, 0x00000000ff600000, 0x00000000ff700000|  0%| F|  |TAMS 0x00000000ff600000, 0x00000000ff600000| Untracked 
[6.801s][error][gc,verify] | 119|0x00000000ff700000, 0x00000000ff700000, 0x00000000ff800000|  0%| F|  |TAMS 0x00000000ff700000, 0x00000000ff700000| Untracked 
[6.801s][error][gc,verify] | 120|0x00000000ff800000, 0x00000000ff800000, 0x00000000ff900000|  0%| F|  |TAMS 0x00000000ff800000, 0x00000000ff800000| Untracked 
[6.801s][error][gc,verify] | 121|0x00000000ff900000, 0x00000000ff900000, 0x00000000ffa00000|  0%| F|  |TAMS 0x00000000ff900000, 0x00000000ff900000| Untracked 
[6.801s][error][gc,verify] | 122|0x00000000ffa00000, 0x00000000ffa00000, 0x00000000ffb00000|  0%| F|  |TAMS 0x00000000ffa00000, 0x00000000ffa00000| Untracked 
[6.801s][error][gc,verify] | 123|0x00000000ffb00000, 0x00000000ffb00000, 0x00000000ffc00000|  0%| F|  |TAMS 0x00000000ffb00000, 0x00000000ffb00000| Untracked 
[6.801s][error][gc,verify] | 124|0x00000000ffc00000, 0x00000000ffc00000, 0x00000000ffd00000|  0%| F|  |TAMS 0x00000000ffc00000, 0x00000000ffc00000| Untracked 
[6.801s][error][gc,verify] | 125|0x00000000ffd00000, 0x00000000ffd00000, 0x00000000ffe00000|  0%| F|  |TAMS 0x00000000ffd00000, 0x00000000ffd00000| Untracked 
[6.801s][error][gc,verify] | 126|0x00000000ffe00000, 0x00000000fff00000, 0x00000000fff00000|100%| S|CS|TAMS 0x00000000ffe00000, 0x00000000ffe00000| Complete 
[6.801s][error][gc,verify] | 127|0x00000000fff00000, 0x00000000fff00000, 0x0000000100000000|  0%| F|  |TAMS 0x00000000fff00000, 0x00000000fff00000| Untracked 
# To suppress the following error report, specify this argument
# after -XX: or in .hotspotrc:  SuppressErrorAt=/g1HeapVerifier.cpp:468
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  Internal Error (/scratch/opt/mach5/mesos/work_dir/slaves/c4ee7e63-1ded-4e8c-9581-ce26f27e3af4-S198/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/89d5c2cf-874f-460b-8c8b-c40ac3379923/runs/b9c2da05-721f-4a49-8173-79c566f3cd7c/workspace/open/src/hotspot/share/gc/g1/g1HeapVerifier.cpp:468), pid=8228, tid=8240
#  guarantee(!failures) failed: there should not have been any failures
#
# JRE version: Java(TM) SE Runtime Environment (11.0) (fastdebug build 11-internal+0-2018-05-26-2016584.robbin.ehn.vanilla-jdk)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (fastdebug 11-internal+0-2018-05-26-2016584.robbin.ehn.vanilla-jdk, mixed mode, tiered, compressed oops, g1 gc, linux-amd64)
# Core dump will be written. Default location: Core dumps may be processed with "/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t e" (or dumping to /scratch/opt/mach5/mesos/work_dir/slaves/c4ee7e63-1ded-4e8c-9581-ce26f27e3af4-S525/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/fbab1ef1-66e7-4153-b36d-1988d0e16f4d/runs/7868f829-20f1-4d2f-8935-64874da77053/testoutput/jtreg/JTwork/scratch/1/core.8228)
#
# An error report file with more information is saved as:
# /scratch/opt/mach5/mesos/work_dir/slaves/c4ee7e63-1ded-4e8c-9581-ce26f27e3af4-S525/frameworks/1735e8a2-a1db-478c-8104-60c8b0af87dd-0196/executors/fbab1ef1-66e7-4153-b36d-1988d0e16f4d/runs/7868f829-20f1-4d2f-8935-64874da77053/testoutput/jtreg/JTwork/scratch/1/hs_err_pid8228.log
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
#
Current thread is 8240
Dumping core ...
];
 stderr: []
 exitValue = 134

java.lang.RuntimeException: Expected to get exit value of [0]

	at jdk.test.lib.process.OutputAnalyzer.shouldHaveExitValue(OutputAnalyzer.java:396)
	at TestEagerReclaimHumongousRegionsClearMarkBits.main(TestEagerReclaimHumongousRegionsClearMarkBits.java:132)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.sun.javatest.regtest.agent.MainActionHelper$SameVMRunnable.run(MainActionHelper.java:229)
	at java.base/java.lang.Thread.run(Thread.java:832)

JavaTest Message: Test threw exception: java.lang.RuntimeException
JavaTest Message: shutting down test

result: Failed. Execution failed: `main' threw exception: java.lang.RuntimeException: Expected to get exit value of [0]


test result: Failed. Execution failed: `main' threw exception: java.lang.RuntimeException: Expected to get exit value of [0]
Comments
URL: http://hg.openjdk.java.net/jdk/jdk11/rev/d9160a3c97c1 User: tschatzl Date: 2018-07-02 07:39:09 +0000
02-07-2018
Note that after JDK-8204081 this issue can not occur any more because we never maintain remembered sets for old gen regions during marking. Only humongous regions, but no j.l.ref.Reference Object can be in there. The problem is still there, just masked by other behavior.
18-06-2018
Deleted
06-06-2018
Having thought about this a bit more I do not really see a reason to not do remset updates for the discovered field. It unnecessarily restricts the ability to evacuate (old) regions for eg. region defragmentation purposes in the future (nevertheless that there are some other assumptions about that in place). "Discovery by design doesn't do remset updates" seems something that has been designed with the other STW collectors in mind that only ever collect old gen in a stw pause (with atomic discovery). I.e. it looks more like some kind of premature optimization, because non-G1 collectors do not need it. I am not advocating changing this behavior right here and now for this fix, but I really do not see a problem for adding remembered set entries in any collector for this operation.
04-06-2018
Another point is that this seems to be a benign issue potentially caused by overzealous verification with no further consequences: - we do not evacuate old regions during marking (we can't for a few reasons, i.e. by now there are a few implicit assumptions about that in the code), so the missing remembered set entry will have no effect - with JDK-8204081 old gen regions won't have remembered sets any more (at this point) where like 2000+ runs of that test with JDK-8204081 applied accidentally obviously showed no occurrence of that verification error - Kim's above statement
31-05-2018
Discovery by design doesn't do remset updates. It's not until the reference is notified that the discovered field is treated as a completely normal reference field. For discovery we don't apply any barriers to the discovered field. The problem may be on the verification side, having expections that are incorrect. This may also be a place where the ReferentBased discovery policy doesn't work for concurrent collectors; a mix of young and old References in the discovered set needs additional work. I don't remember where (if) that happens.
31-05-2018
Some more logging showed that the problem seems to be a Reference object (there may be more) in the list of References discovered by the concurrent discovery for Remark. E.g. [5.949s][info ][gc ] GC(51) Pause Young (G1 Evacuation Pause) 58M->58M(128M) 203.230ms [I@50cbc42f [I@75412c2f [I@282ba1e [I@13b6d03 [5.963s][trace][gc,ref ] GC(32) Thread 0 gets list 0x000000010039e0b8 [5.963s][trace][gc,ref ] GC(32) Discovered reference (mt) (0x00000007fa567c80: java.lang.invoke.MethodType$ConcurrentWeakInternSet$WeakEntry) [5.965s][trace][gc,ref ] GC(32) Thread 0 gets list 0x000000010039e0b8 [5.965s][trace][gc,ref ] GC(32) Discovered reference (mt) (0x00000007fa5c6838: java.lang.invoke.MethodType$ConcurrentWeakInternSet$WeakEntry) [5.965s][trace][gc,ref ] GC(32) Thread 0 gets list 0x000000010039e0b8 [5.965s][trace][gc,ref ] GC(32) Discovered reference (mt) (0x00000007fa5c7550: java.lang.invoke.MethodType$ConcurrentWeakInternSet$WeakEntry) [5.965s][trace][gc,ref ] GC(32) Thread 0 gets list 0x000000010039e0b8 [5.965s][trace][gc,ref ] GC(32) Discovered reference (mt) (0x00000007fa5c7688: java.lang.invoke.MethodType$ConcurrentWeakInternSet$WeakEntry) [5.969s][trace][gc,ref ] GC(52) Dropped 0 dead Refs out of 0 discovered Refs by policy, from list 0x000000010039e740 [...] [6.129s][error][gc,verify ] ---------- [6.129s][error][gc,verify ] Missing rem set entry: [6.129s][error][gc,verify ] Field 0x00000007fa567c98 of obj 0x00000007fa567c80, in region 37:(O)[0x00000007fa500000,0x00000007fa600000,0x00000007fa600000] [6.129s][error][gc,verify ] java.lang.invoke.MethodType$ConcurrentWeakInternSet$WeakEntry [6.129s][error][gc,verify ] {0x00000007fa567c80} - klass: 'java/lang/invoke/MethodType$ConcurrentWeakInternSet$WeakEntry' [6.129s][error][gc,verify ] points to obj 0x00000007f8a4b320 in region 10:(O)[0x00000007f8a00000,0x00000007f8b00000,0x00000007f8b00000] remset Complete [6.129s][error][gc,verify ] java.lang.ClassValue$Entry [6.129s][error][gc,verify ] {0x00000007f8a4b320} - klass: 'java/lang/ClassValue$Entry' [6.129s][error][gc,verify ] Obj head CTE = -1, field CTE = -1. [...] I.e. after a young gc (GC 51), we discover a Reference (0x00000007fa567c80) concurrently for the pending mark (GC 32), and the next young gc (GC 52) can' t find the remembered set entry for that Reference (0x00000007fa567c80) and verification fails. I do not know yet whether it's particularly the discovered field of the first Reference object that does not get a remembered set entry, or this is a systematic problem with concurrently discovered Reference objects.
31-05-2018
JDK-8204169 covers the somewhat annoying issue with HC regions' remembered set being out of sync with their corresponding HS region.
31-05-2018
I changed the title to reflect latest understanding that without JDK-8203028 after 3600 runs there is no failure.
30-05-2018
What is common to all the failures I am looking at is that this happens during a young gc during the concurrent cycle; this does not need to mean anything as marking is running constantly, but I have never seen an occurrence of this crash outside of a conc cycle.
30-05-2018
There may actually be two issues here: one where the remembered sets of regions are not cleared before initial mark, and one about the missing remembered set entry. The former has likely been introduced somewhere in the rebuild remembered sets concurrently timeframe, and apart from a performance issue, should not have too much other impact. The other may be new; it's always the "discovered" field of the WeakReference (offset 24) that has this issue. I do not have an understanding whether it has been introduced by JDK-8203028 or earlier.
30-05-2018
The issue with some regions having remembered sets if the mixed phase is aborted is a different issue than this one. Filed JDK-8204081 for that.
30-05-2018
Another observation is that in all the observed failures, there is one Old region that has a remembered set, and one HS region that does not (but it's HC regions do have a remembered set).
29-05-2018
Some run with additional code that during initial mark checks that old regions' remembered sets are untracked gives the same error and the following example output. Maybe some race condition with collector state? As for the impact, not completely sure but: since we should only ever evacuate old gen regions in mixed gc that are (hopefully) only scheduled after the concurrent cycle, we are still good (i.e. at that time we are certain to have completed remembered sets). [[0.009s][info][gc] Using G1 [0.142s][info][gc] GC(0) Pause Initial Mark (G1 Humongous Allocation) 1M->1M(128M) 13.676ms [0.142s][info][gc] GC(1) Concurrent Cycle [0.146s][info][gc] GC(1) Pause Remark 6M->6M(128M) 1.162ms [0.150s][info][gc] GC(1) Pause Cleanup 10M->10M(128M) 0.125ms [0.151s][info][gc] GC(1) Concurrent Cycle 9.243ms [0.154s][warning][gc] GC(2) Remembered set for old region 0 is tracked but should not // <--- ! [0.166s][info ][gc] GC(2) Pause Initial Mark (G1 Humongous Allocation) 14M->14M(128M) 12.076ms [0.166s][info ][gc] GC(3) Concurrent Cycle [0.173s][info ][gc] GC(3) Pause Remark 22M->22M(128M) 1.441ms [0.190s][info ][gc] GC(4) Pause Young (G1 Evacuation Pause) 23M->23M(128M) 14.227ms [0.190s][info ][gc] GC(3) Pause Cleanup 23M->23M(128M) 0.103ms [0.203s][info ][gc] GC(5) Pause Young (G1 Evacuation Pause) 24M->24M(128M) 12.188ms [0.220s][info ][gc] GC(6) Pause Young (G1 Evacuation Pause) 25M->25M(128M) 14.910ms [0.220s][info ][gc] GC(3) Concurrent Cycle 54.266ms [0.236s][info ][gc] GC(7) Pause Young (G1 Evacuation Pause) 26M->26M(128M) 14.870ms [0.237s][warning][gc] GC(8) Remembered set for old region 0 is tracked but should not [0.237s][warning][gc] GC(8) Remembered set for old region 14 is tracked but should not [0.237s][warning][gc] GC(8) Remembered set for old region 23 is tracked but should not [0.237s][warning][gc] GC(8) Remembered set for old region 24 is tracked but should not [0.237s][warning][gc] GC(8) Remembered set for old region 25 is tracked but should not [0.253s][info ][gc] GC(8) Pause Initial Mark (G1 Evacuation Pause) 27M->27M(128M) 15.790ms [0.253s][info ][gc] GC(9) Concurrent Cycle [0.272s][info ][gc] GC(10) Pause Young (G1 Evacuation Pause) 28M->28M(128M) 18.021ms [0.292s][info ][gc] GC(11) Pause Young (G1 Evacuation Pause) 29M->29M(128M) 18.284ms [0.315s][info ][gc] GC(12) Pause Young (G1 Evacuation Pause) 30M->30M(128M) 21.701ms [0.339s][info ][gc] GC(13) Pause Young (G1 Evacuation Pause) 31M->31M(128M) 23.409ms [0.364s][info ][gc] GC(14) Pause Young (G1 Evacuation Pause) 32M->32M(128M) 23.713ms [0.389s][info ][gc] GC(15) Pause Young (G1 Evacuation Pause) 33M->33M(128M) 23.394ms [0.415s][info ][gc] GC(16) Pause Young (G1 Evacuation Pause) 34M->34M(128M) 24.453ms [0.444s][info ][gc] GC(17) Pause Young (G1 Evacuation Pause) 35M->35M(128M) 28.349ms [0.477s][info ][gc] GC(18) Pause Young (G1 Evacuation Pause) 36M->36M(128M) 31.857ms [0.514s][info ][gc] GC(19) Pause Young (G1 Evacuation Pause) 37M->37M(128M) 35.614ms [0.520s][info ][gc] GC(9) Pause Remark 38M->38M(128M) 1.419ms [0.534s][info ][gc] GC(9) Pause Cleanup 38M->38M(128M) 0.134ms [0.534s][info ][gc] GC(9) Concurrent Cycle 281.460ms [0.609s][info ][gc] GC(20) Pause Young (G1 Evacuation Pause) 38M->37M(128M) 27.351ms [0.664s][warning][gc] GC(21) Remembered set for old region 0 is tracked but should not [0.664s][warning][gc] GC(21) Remembered set for old region 14 is tracked but should not [0.664s][warning][gc] GC(21) Remembered set for old region 23 is tracked but should not [0.664s][warning][gc] GC(21) Remembered set for old region 24 is tracked but should not [0.664s][warning][gc] GC(21) Remembered set for old region 25 is tracked but should not [0.664s][warning][gc] GC(21) Remembered set for old region 26 is tracked but should not [0.664s][warning][gc] GC(21) Remembered set for old region 27 is tracked but should not [0.664s][warning][gc] GC(21) Remembered set for old region 28 is tracked but should not [0.664s][warning][gc] GC(21) Remembered set for old region 29 is tracked but should not [0.664s][warning][gc] GC(21) Remembered set for old region 30 is tracked but should not [0.664s][warning][gc] GC(21) Remembered set for old region 31 is tracked but should not [0.664s][warning][gc] GC(21) Remembered set for old region 32 is tracked but should not [0.664s][warning][gc] GC(21) Remembered set for old region 33 is tracked but should not [0.664s][warning][gc] GC(21) Remembered set for old region 34 is tracked but should not [0.664s][warning][gc] GC(21) Remembered set for old region 35 is tracked but should not [0.695s][info ][gc] GC(21) Pause Initial Mark (G1 Evacuation Pause) 38M->37M(128M) 31.657ms [0.695s][info ][gc] GC(22) Concurrent Cycle
29-05-2018
From reading the hs_err log: - this is an Old->Old reference - cleanup pause should have occurred (we should only have "Complete" remembered sets of "Old" regions after Cleanup); I can't find the respective log messages though so this seems strange. - it is also the only "Complete" Old gen region, but that may be coincidence - the "discovered" field of a WeakEntry instance (child of WeakReference) is missing a remembered set entry to another WeakEntry. - reference processing within a minor GC pause (i.e. atomic)
28-05-2018
[rehn@rehn-ws open]$ hg heads changeset: 50277:f84ae8aa5d88 tag: tip user: kbarrett date: Sat May 26 03:11:50 2018 -0400 summary: 8203028: Simplify reference processing in light of JDK-8175797 I have seen this twice, once with my local changes and this time with vanilla-jdk. I tried to reproduce, it failed. Frequency is twice in ~200 runs.
27-05-2018