JDK-6896918 : Mixed ceritification scenarios are making browser/VM to hang
  • Type: Bug
  • Component: deploy
  • Sub-Component: plugin
  • Affected Version: 6u18
  • Priority: P2
  • Status: Closed
  • Resolution: Cannot Reproduce
  • OS: generic
  • CPU: generic
  • Submitted: 2009-10-30
  • Updated: 2010-09-10
  • Resolved: 2010-09-10
Related Reports
Relates :  
JDK-6809570 - Certificate prompt totally lock up when a webstart apps connect via SSL
Relates :  
JDK-6940127 - New Deployment mixed code security dialog can hang in some instances
Description
With latest 6u18 nightly bundels sometimes browser/VM hangs while running the mixed certification scenario, where different classes signed using different signer CAs exits under differnt packages.
Stack trace when VM/browser hanged (NOt able to click on the second security pop-up dialog):
http://sqeweb.sfbay.sun.com/deployment2/jitu/deployment_mustang_exec_ws/deployment/src/plugin/RSATestsuite/RSATestsuite/mystack.txt

Steps to reproduce:
-------------------
1) Try to load any of the following applets
http://sqeweb.sfbay.sun.com/deployment2/jitu/deployment_mustang_exec_ws/deployment/src/plugin/RSATestsuite/RSATestsuite/html/MixedCertDifferentPackage/MixedCerificationSigned4.html
http://sqeweb.sfbay.sun.com/deployment2/jitu/deployment_mustang_exec_ws/deployment/src/plugin/RSATestsuite/RSATestsuite/html/MixedCertDifferentPackageJNLP/JNLPMixedCertTestDraw.html

2) There is going to be 2 security pop-ups coming from different signer CAs. If at any point of time browser hangs and you are not able to click any button on the security dialog then bug is reporduced
Comments
EVALUATION Got better thread dump by using the jconsole tool. The AWT-EventQueue-2, which calls the applet's paint method is blocked on: sun.plugin2.applet.Applet2ClassLoader@19134f4 owned by: thread applet-CallerApplet-1 thread applet-CallerApplet-1 is the thread showing the second security dialog. Attaching relevant threads obtained from jconsole in the attachement (jconsole-stack.txt). Another observation is that with the old plugin, the thread running the "AnimationPanel2" (for drawing the animation while applet is loading) is still running when the second security dialog is being shown; with the new plugin, the thread running the "AnimationPanel2" is no longer there when the second security dialog is being shown. So the problem could be due to the animation thread is stopped (or exits) too early in the new plugin.
07-11-2009
EVALUATION This was introduced in 6u15 b02 and can be reproduced with both IE and FF browsers. Attaching java thread dump obtained from jstack for both client vm (client.txt) and server vm (server.txt) when running the testcase using the IE browser. Java thread dumps for FF browser look about the same as for IE browser.
04-11-2009
EVALUATION I only reproduce the bug in new Java plugin, the old Java plugin works fine.
02-11-2009