JDK-6715676 : Nortel reports intermittent failure with JDK 1.4.2 on Windows using their Application
  • Type: Bug
  • Component: hotspot
  • Sub-Component: compiler
  • Affected Version: 1.4.2_15
  • Priority: P1
  • Status: Closed
  • Resolution: Duplicate
  • OS: windows_2000
  • CPU: x86
  • Submitted: 2008-06-17
  • Updated: 2010-05-10
  • Resolved: 2008-10-31
Related Reports
Duplicate :  
JDK-6321689 - Ideal_DU_postCCP not conservative enough
Description
[Copy and paste error messages from /var/adm or console log outputs.] 
# 
# An unexpected error has been detected by HotSpot Virtual Machine: 
# 
#  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x08083782, pid=4064, tid=2776 
# 
# Java VM: Java HotSpot(TM) Server VM (1.4.2_15-b02 mixed mode) 
# Problematic frame: 
# V  [jvm.dll+0x83782] 
# 
 
---------------  T H R E A D  --------------- 
 
Current thread (0x083ac570):  JavaThread "Thread-16" [_thread_in_vm, id=2776] 
 
siginfo: ExceptionCode=0xc0000005, reading address 0x00000000 
 
Registers: 
EAX=0x00000000, EBX=0x0c3fa378, ECX=0x0c3fa33c, EDX=0x00000000 
ESP=0x0c3fa2dc, EBP=0x0c3fa334, ESI=0x0c3fa354, EDI=0x00000000 
EIP=0x08083782, EFLAGS=0x00010212 
 
Top of Stack: (sp=0x0c3fa2dc) 
0x0c3fa2dc:   0802c419 083a47a0 08c18350 0c3fa378 
0x0c3fa2ec:   04914d24 0c3fa640 1001c358 00000013 
0x0c3fa2fc:   12860cd0 1448ae48 00000013 13965fa0 
0x0c3fa30c:   10058790 00000046 10058790 00000007 
0x0c3fa31c:   12860cd0 00000000 10058790 00000000 
0x0c3fa32c:   0484a930 00000000 083a47a8 0802d0ab 
0x0c3fa33c:   00000000 00000001 30074690 00000000 
0x0c3fa34c:   0c3fa39c 0c3fa378 ffffffff 00000001  
 
Instructions: (pc=0x08083782) 
0x08083772:   0c 8b c6 5e 5b 8b e5 5d c3 90 90 90 90 90 8b 01 
0x08083782:   8b 00 c3 90 90 90 90 90 90 90 90 90 90 90 8b 4c  
 
 
Stack: [0x0c300000,0x0c400000),  sp=0x0c3fa2dc,  free space=1000k 
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) 
V  [jvm.dll+0x83782] 
 
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) 
v  ~StubRoutines::call_stub 
 
---------------  P R O C E S S  --------------- 
 
Java Threads: ( => current thread ) 
  0x08f53518 JavaThread "RMI ConnectionExpiration-[172.18.61.10:1450]" daemon [_thread_blocked, id=212] 
  0x08e96518 JavaThread "RMI ConnectionExpiration-[172.18.61.12:1954]" daemon [_thread_blocked, id=2900] 
  0x08c28490 JavaThread "pool-1-thread-11" [_thread_blocked, id=4036] 
  0x089d8408 JavaThread "RMI TCP Connection(18)-172.18.61.10" daemon [_thread_in_native, id=2820] 
  0x08ac17f8 JavaThread "RMI ConnectionExpiration-[172.18.61.10:1380]" daemon [_thread_blocked, id=2320] 
  0x08df55b0 JavaThread "pool-1-thread-10" [_thread_blocked, id=2960] 
  0x089c1408 JavaThread "RMI TCP Connection(15)-172.18.61.12" daemon [_thread_in_native, id=2700] 
  0x08761298 JavaThread "pool-1-thread-9" [_thread_blocked, id=2952] 
  0x0b2bbc30 JavaThread "pool-1-thread-8" [_thread_blocked, id=180] 
  0x085d51d8 JavaThread "pool-1-thread-7" [_thread_blocked, id=2848] 
  0x0b93db08 JavaThread "pool-1-thread-6" [_thread_blocked, id=2876] 
  0x08482830 JavaThread "Thread-28" [_thread_in_native, id=344] 
  0x0f647008 JavaThread "pool-1-thread-5" [_thread_blocked, id=408] 
  0x08fcac88 JavaThread "Thread-27" [_thread_in_native, id=2768] 
  0x088b6888 JavaThread "Thread-26" [_thread_in_native, id=1672] 
  0x08c18df8 JavaThread "Thread-25" [_thread_in_native, id=1604] 
  0x0b3af808 JavaThread "Thread-24" [_thread_in_native, id=2764] 
  0x08392170 JavaThread "Thread-23" [_thread_in_native, id=1056] 
  0x04431008 JavaThread "Thread-22" [_thread_in_native, id=1844] 
  0x086da408 JavaThread "Thread-21" [_thread_in_native, id=1592] 
  0x08392008 JavaThread "Thread-20" [_thread_in_native, id=3492] 
  0x083a4d08 JavaThread "Thread-19" [_thread_in_native, id=832] 
  0x083a4ba0 JavaThread "Thread-18" [_thread_in_native, id=1924] 
  0x0852db88 JavaThread "Thread-17" [_thread_in_native, id=3044] 
=>0x083ac570 JavaThread "Thread-16" [_thread_in_vm, id=2776] 
  0x083ac408 JavaThread "Thread-15" [_thread_in_native, id=3552] 
  0x08535408 JavaThread "Thread-14" [_thread_in_native, id=3948] 
  0x08d4b310 JavaThread "Thread-13" [_thread_in_native, id=2496] 
  0x089eb518 JavaThread "Thread-12" [_thread_in_native, id=3084] 
  0x08fee518 JavaThread "Thread-11" [_thread_in_native, id=1868] 
  0x0861a008 JavaThread "Thread-10" [_thread_in_native, id=1368] 
  0x086eb2a8 JavaThread "Thread-9" [_thread_in_native, id=2756] 
  0x0b2bbac8 JavaThread "RMI RenewClean-[172.18.61.10:1450]" daemon [_thread_blocked, id=2600] 
  0x090b7ee0 JavaThread "Thread-8" [_thread_in_native, id=2864] 
  0x08ea7838 JavaThread "RMI TCP Connection(5)-172.18.61.10" daemon [_thread_in_native, id=2816] 
  0x08ba0008 JavaThread "Thread-7" daemon [_thread_blocked, id=2364] 
  0x0b2bb508 JavaThread "Thread-6" [_thread_in_native, id=3080] 
  0x089f0170 JavaThread "RMI RenewClean-[172.18.61.12:1954]" daemon [_thread_blocked, id=3820] 
  0x089f0008 JavaThread "Replicator-SPContainer:tapi-ClientContainer:client" [_thread_blocked, id=1684] 
  0x0877ed80 JavaThread "Replicator-SPContainer:tapi-OAMContainer:oam" [_thread_blocked, id=3816] 
  0x087f1d68 JavaThread "Lease Manager" daemon [_thread_blocked, id=3832] 
  0x08e02520 JavaThread "CacheGC" [_thread_blocked, id=1088] 
  0x088f4808 JavaThread "RecentsFifoThread 1" [_thread_blocked, id=3876] 
  0x084c8b90 JavaThread "RecentsFifoThread 0" [_thread_blocked, id=3924] 
  0x08c8c5d0 JavaThread "pool-1-thread-1" [_thread_blocked, id=3420] 
  0x08c8c3a0 JavaThread "pool-2-thread-1" [_thread_blocked, id=3764] 
  0x08c8c170 JavaThread "pool-1-thread-4" [_thread_blocked, id=3448] 
  0x08c8c008 JavaThread "pool-1-thread-3" [_thread_blocked, id=3184] 
  0x08c94c70 JavaThread "pool-1-thread-2" [_thread_blocked, id=3748] 
  0x08cf00c0 JavaThread "pool-1-thread-1" [_thread_blocked, id=3216] 
  0x0878ec38 JavaThread "RMI LeaseChecker" daemon [_thread_blocked, id=2088] 
  0x0849c808 JavaThread "RMI RenewClean-[172.18.61.10:1380]" daemon [_thread_blocked, id=792] 
  0x08903e98 JavaThread "GC Daemon" daemon [_thread_blocked, id=2512] 
  0x08e47008 JavaThread "RMI Reaper" [_thread_blocked, id=3156] 
  0x08a84008 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=3880] 
  0x08a28e48 JavaThread "AsyncLog" daemon [_thread_blocked, id=2972] 
  0x08498230 JavaThread "RMI TCP Accept-8098" daemon [_thread_in_native, id=3812] 
  0x08c395e8 JavaThread "Thread-3" daemon [_thread_blocked, id=1060] 
  0x08487de8 JavaThread "Thread-1" daemon [_thread_blocked, id=2396] 
  0x08388438 JavaThread "Thread-0" daemon [_thread_blocked, id=3860] 
  0x04479318 JavaThread "CompilerThread1" daemon [_thread_blocked, id=748] 
  0x044782d8 JavaThread "CompilerThread0" daemon [_thread_blocked, id=3424] 
  0x04477580 JavaThread "AdapterThread" daemon [_thread_blocked, id=1524] 
  0x04474c78 JavaThread "Finalizer" daemon [_thread_blocked, id=2208] 
  0x044740e8 JavaThread "Reference Handler" daemon [_thread_blocked, id=2212] 
  0x003961d8 JavaThread "main" [_thread_in_native, id=4032] 
 
Other Threads: 
  0x04473778 VMThread [id=2220] 
  0x0447ab20 WatcherThread [id=2500] 
 
VM state:not at safepoint (normal execution) 
 
VM Mutex/Monitor currently owned by a thread: None 
 
Heap 
 def new generation   total 52416K, used 41020K [0x10070000, 0x13950000, 0x13950000) 
  eden space 46592K,  88% used [0x10070000, 0x1287f330, 0x12df0000) 
  from space 5824K,   0% used [0x133a0000, 0x133a0000, 0x13950000) 
  to   space 5824K,   0% used [0x12df0000, 0x12df0000, 0x133a0000) 
 tenured generation   total 466048K, used 22853K [0x13950000, 0x30070000, 0x30070000) 
   the space 466048K,   4% used [0x13950000, 0x14fa14b0, 0x14fa1600, 0x30070000) 
 compacting perm gen  total 16384K, used 11028K [0x30070000, 0x31070000, 0x34070000) 
   the space 16384K,  67% used [0x30070000, 0x30b35310, 0x30b35400, 0x31070000) 
 
Dynamic libraries: 
0x00400000 - 0x00630000  C:\Program Files\Nortel\CCT\CCTTapiC.exe 
0x7c800000 - 0x7c8c0000  C:\WINDOWS\system32\ntdll.dll 
0x79000000 - 0x79045000  C:\WINDOWS\system32\mscoree.dll 
0x77e40000 - 0x77f42000  C:\WINDOWS\system32\KERNEL32.dll 
0x77f50000 - 0x77feb000  C:\WINDOWS\system32\advapi32.dll 
0x77c50000 - 0x77cef000  C:\WINDOWS\system32\RPCRT4.dll 
0x76f50000 - 0x76f63000  C:\WINDOWS\system32\Secur32.dll 
0x76e60000 - 0x76e8f000  C:\WINDOWS\system32\TAPI32.dll 
0x77ba0000 - 0x77bfa000  C:\WINDOWS\system32\msvcrt.dll 
0x77c00000 - 0x77c48000  C:\WINDOWS\system32\GDI32.dll 
0x77380000 - 0x77411000  C:\WINDOWS\system32\USER32.dll 
0x77da0000 - 0x77df2000  C:\WINDOWS\system32\SHLWAPI.dll 
0x76e30000 - 0x76e3c000  C:\WINDOWS\system32\rtutils.dll 
0x76aa0000 - 0x76acd000  C:\WINDOWS\system32\WINMM.dll 
0x10000000 - 0x10064000  C:\Program Files\Nortel\CCT\CppRt20.dll 
0x77b90000 - 0x77b98000  C:\WINDOWS\system32\VERSION.dll 
0x7c3a0000 - 0x7c41b000  C:\Program Files\Nortel\CCT\MSVCP71.dll 
0x7c340000 - 0x7c396000  C:\Program Files\Nortel\CCT\MSVCR71.dll 
0x77420000 - 0x77523000  C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.3790.3959_x-ww_D8713E55\comctl32.dll 
0x791b0000 - 0x79419000  C:\WINDOWS\Microsoft.NET\Framework\v1.1.4322\mscorwks.dll 
0x00890000 - 0x008d5000  C:\WINDOWS\Microsoft.NET\Framework\v1.1.4322\fusion.dll 
0x77670000 - 0x777a9000  C:\WINDOWS\system32\ole32.dll 
0x7c8d0000 - 0x7d0cf000  C:\WINDOWS\system32\SHELL32.dll 
0x79780000 - 0x7998e000  c:\windows\microsoft.net\framework\v1.1.4322\mscorlib.dll 
0x79990000 - 0x79cce000  c:\windows\assembly\nativeimages1_v1.1.4322\mscorlib\1.0.5000.0__b77a5c561934e089_cbb4f182\mscorlib.dll 
0x79510000 - 0x79523000  C:\WINDOWS\Microsoft.NET\Framework\v1.1.4322\mscorsn.dll 
0x79430000 - 0x7947d000  C:\WINDOWS\Microsoft.NET\Framework\v1.1.4322\MSCORJIT.DLL 
0x7b0a0000 - 0x7b1d0000  c:\windows\assembly\gac\system\1.0.5000.0__b77a5c561934e089\system.dll 
0x7b1d0000 - 0x7b3b4000  c:\windows\assembly\nativeimages1_v1.1.4322\system\1.0.5000.0__b77a5c561934e089_6ee0508e\system.dll 
0x7bc10000 - 0x7bd60000  c:\windows\assembly\gac\system.xml\1.0.5000.0__b77a5c561934e089\system.xml.dll 
0x7bd60000 - 0x7bf66000  c:\windows\assembly\nativeimages1_v1.1.4322\system.xml\1.0.5000.0__b77a5c561934e089_6e542d41\system.xml.dll 
0x03ff0000 - 0x041d3000  C:\Program Files\Nortel\CCT\CMFSPListeners.dll 
0x08000000 - 0x082bd000  C:\PROGRA~1\Java\JRE14~1.2_1\bin\server\jvm.dll 
0x01000000 - 0x01007000  C:\PROGRA~1\Java\JRE14~1.2_1\bin\hpi.dll 
0x76b70000 - 0x76b7b000  C:\WINDOWS\system32\PSAPI.DLL 
0x01020000 - 0x0102e000  C:\PROGRA~1\Java\JRE14~1.2_1\bin\verify.dll 
0x01030000 - 0x01049000  C:\PROGRA~1\Java\JRE14~1.2_1\bin\java.dll 
0x01050000 - 0x0105e000  C:\PROGRA~1\Java\JRE14~1.2_1\bin\zip.dll 
0x68000000 - 0x68035000  C:\WINDOWS\system32\rsaenh.dll 
0x04310000 - 0x0431f000  C:\Program Files\Java\JRE1.4.2_15\bin\net.dll 
0x71c00000 - 0x71c17000  C:\WINDOWS\system32\WS2_32.dll 
0x71bf0000 - 0x71bf8000  C:\WINDOWS\system32\WS2HELP.dll 
0x71b20000 - 0x71b61000  C:\WINDOWS\System32\mswsock.dll 
0x76ed0000 - 0x76efa000  C:\WINDOWS\system32\DNSAPI.dll 
0x76f70000 - 0x76f77000  C:\WINDOWS\System32\winrnr.dll 
0x76f10000 - 0x76f3e000  C:\WINDOWS\system32\WLDAP32.dll 
0x76f80000 - 0x76f85000  C:\WINDOWS\system32\rasadhlp.dll 
0x5f270000 - 0x5f2ca000  C:\WINDOWS\system32\hnetcfg.dll 
0x71ae0000 - 0x71ae8000  C:\WINDOWS\System32\wshtcpip.dll 
0x07fe0000 - 0x07fe5000  C:\Program Files\Java\JRE1.4.2_15\bin\rmi.dll 
0x0cc00000 - 0x0cec5000  C:\WINDOWS\system32\xpsp2res.dll 
0x79640000 - 0x79692000  c:\windows\assembly\gac\system.runtime.remoting\1.0.5000.0__b77a5c561934e089\system.runtime.remoting.dll 
0x0aa20000 - 0x0aa70000  c:\program files\nortel\cct\nortel.cct.dal.dll 
0x7a6e0000 - 0x7a820000  c:\windows\assembly\gac\system.data\1.0.5000.0__b77a5c561934e089\system.data.dll 
0x0b1b0000 - 0x0b1bc000  c:\program files\nortel\cct\nortel.cct.eventlogger.dll 
0x79fe0000 - 0x79ff6000  c:\windows\assembly\gac\system.configuration.install\1.0.5000.0__b03f5f7f11d50a3a\system.configuration.install.dll 
0x0b1c0000 - 0x0b1c7000  c:\program files\nortel\cct\nortel.cct.diagnostics.dll 
0x77d00000 - 0x77d8b000  C:\WINDOWS\system32\OLEAUT32.dll 
 
VM Arguments: 
jvm_args: -Dcom.gs.home=C:\PROGRA~1\Nortel\CCT\CMF -Dcom.nortel.app=sp -Xms512m -Xmx512m -Xrs -Djava.security.policy=.\CMF\policy.all -Dcom.nortel.cmf.config=C:\PROGRA~1\Nortel\CCT\CMF -Dcom.gs.timer_provider=com.j_spaces.kernel.GigaSystemTimer 
java_command: <unknown> 
Launcher Type: generic 
 
Environment Variables: 
PATH=C:\Program Files\Nortel\SSsuite\bin;C:\Program Files\Nortel\SSsuite;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\Program Files\Microsoft SQL Server\80\Tools\Binn\;C:\Program Files\Java\JRE1.4.2_08\bin;C:\Program Files\Nortel\CCT\;C:\Program Files\Nortel\CCT\TAPI 
OS=Windows_NT 
PROCESSOR_IDENTIFIER=x86 Family 6 Model 15 Stepping 11, GenuineIntel 
 
 
---------------  S Y S T E M  --------------- 
 
OS: Windows Server 2003 family Build 3790 Service Pack 2 
 
CPU:total 2 family 6, cmov, cx8, fxsr, mmx, sse, sse2 
 
Memory: 4k page, physical 2097151k(2097151k free), swap 4194303k(4194303k free) 
 
vm_info: Java HotSpot(TM) Server VM (1.4.2_15-b02) for windows-x86, built on May 22 2007 16:52:42 by "java_re" with MS VC++ 6.0
This system is SRS Net Connect enabled: No
I will be sending an Explorer file: No
List steps to reproduce the problem(if applicable): This is an intermittent problem that is not always reproducible. 
When we run our software under load this problem can happen.
When was the problem first noticed: It is appearing on several sites over the last year. I have several hotspot and crash dump files that impliate the JVM.  Need help in determing what is causing the hotspots.  
Can upload hotspot files if I have a location 
 
The problems is getting worse as the system is remaining up for longer periods >4 weeks. Some of the other components using the same software remain up for months without any problems
The problem is: getting worse
Comments
EVALUATION This is dup of 6321689.
31-10-2008
EVALUATION Although it is clear from thread names that the application is using RMI, I don't see any reason to believe that the cause of the VM crash is related to RMI, and the VM folks would be in a better position to evaluate the crash, so I am recategorizing.
17-06-2008