When I ran iMM4.5( market maker ) with S1AS7 using 1.4.0_03 on Solaris 9 U2,
appserver7 crashed 19 times within 3 hours and we got core dumps. The crash
happened within a few minutes when test started.
Test machine is E4500, 8 cpus, Memory size: 8192 Megabytes
big5server% uname -a
SunOS big5server 5.9 Generic_112233-03 sun4u sparc SUNW,Ultra-Enterprise
big5server% cat /etc/release
Solaris 9 12/02 s9s_u2wos_08 SPARC
Copyright 2002 Sun Microsystems, Inc. All Rights Reserved.
Use is subject to license terms.
Assembled 07 October 2002
big5server% /usr/j2se/bin/java -version
java version "1.4.0_03"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.0_03-b03)
Java HotSpot(TM) Client VM (build 1.4.0_03-b03, mixed mode)
=>[1] 0xf9816db0(0x718edda4, 0xf6599c18, 0x0, 0xf9816b50, 0x0, 0x718edcb0), at 0xf9816daf
[2] 0xf980588c(0x718ede48, 0xa, 0x0, 0xf9816b50, 0xc, 0x718edd30), at 0xf980588b
[3] 0xf98437b4(0x7f9c5810, 0x7fa2c068, 0x7bde5b40, 0x4, 0xc, 0x718ede00), at 0xf98437b3
[4] 0xf9cf3738(0x9, 0x0, 0x7fa2c068, 0x1, 0xa, 0x983d00), at 0xf9cf3737
[5] 0xf98424ec(0x7bde5b40, 0x7f9c5a00, 0x7f9c5810, 0xf9815ac0, 0x4, 0x718edeb8), at 0xf98424eb
[6] 0xf980588c(0x718ee04c, 0xf6581c50, 0x0, 0xf9816dfc, 0xc, 0x718edf38), at 0xf980588b
[7] 0xf9805b14(0x718ee0dc, 0x2e6465f0, 0x0, 0xf9816b50, 0x10, 0x718edfe0), at 0xf9805b13
[8] 0xf980588c(0x718ee158, 0xa4fdb1a0, 0x0, 0xf9816b98, 0xc, 0x718ee068), at 0xf980588b
[9] 0xf9853c74(0x7f9c48a8, 0x7f9c5820, 0x7f9c5a00, 0x7f9c5a90, 0xc, 0x718ee110), at 0xf9853c73
[10] 0xf9d505fc(0xf64bdc50, 0x7be66678, 0x7f9c48a8, 0x7f9c5968, 0x7f9c5974, 0x9), at 0xf9d505fb
[11] 0xf983cae0(0x7be66678, 0x7f9c48a8, 0x0, 0xf98157a4, 0x0, 0x718ee1d0), at 0xf983cadf
[12] 0xf980588c(0x718ee338, 0x0, 0x0, 0xf9816b50, 0x8, 0x718ee250), at 0xf980588b
[13] 0xf980588c(0x718ee3e4, 0xf64ae330, 0x0, 0xf9816b50, 0x4, 0x718ee2d8), at 0xf980588b
[14] 0xf9805940(0x718ee49c, 0xf64147a0, 0x0, 0xf9816b50, 0x8, 0x718ee368), at 0xf980593f
[15] 0xf9805b14(0x718ee510, 0x7bde8588, 0x0, 0xf981711c, 0x8, 0x718ee420), at 0xf9805b13
[16] 0xf986cb74(0x7bde1cf0, 0x7536, 0x7bde9498, 0x7bde8530, 0xc, 0x718ee4c8), at 0xf986cb73
[17] 0xf9a18618(0xf54084f0, 0x7536, 0x73056000, 0x1, 0xf5403f80, 0x0), at 0xf9a18617
[18] 0xf990d52c(0xa0b01a08, 0x7536, 0x7bde1cf0, 0xf9814d08, 0x8, 0x718ee588), at 0xf990d52b
[19] 0xf9805940(0x718ee714, 0x7bde7a78, 0x0, 0xf9816b50, 0xc, 0x718ee610), at 0xf980593f
[20] 0xf983ef30(0x7bde1cf0, 0xa0b01a08, 0x73056000, 0x7bde7968, 0x8, 0x718ee6d0), at 0xf983ef2f
[21] 0xf9c47ebc(0x7bda9bb0, 0x1, 0xa0b01a08, 0x7bde75e0, 0x65, 0x0), at 0xf9c47ebb
[22] 0xf990d52c(0xa0b01a08, 0xea6c, 0x7bda9bb0, 0xf9814d08, 0x8, 0x718ee710), at 0xf990d52b
[23] 0xf9805940(0x718ee89c, 0xf633f310, 0x0, 0xf9816b50, 0xc, 0x718ee798), at 0xf980593f
[24] 0xf983ef30(0x7bda9bb0, 0xa0b01a08, 0x1, 0x7bda0a98, 0x8, 0x718ee858), at 0xf983ef2f
[25] 0xf9bb0d3c(0xf5449c40, 0xf5fb0e68, 0x7bda9bb0, 0x983d00, 0xf6359fc0, 0xf5fb7398), at 0xf9bb0d3b
[26] 0xf9848bd4(0x7bda9bb0, 0x718eea90, 0x0, 0xf981711c, 0x8, 0x718ee920), at 0xf9848bd3
[27] 0xf9805940(0x718eeaa4, 0x7bda3158, 0x0, 0xf9816b50, 0x4, 0x718ee9a0), at 0xf980593f
[28] 0xf9805940(0x718eec34, 0xf5facfc8, 0xf6513e18, 0xf9816b50, 0x14, 0x718eea28), at 0xf980593f
[29] 0xf9805bc8(0x718eecb4, 0x718eed38, 0x0, 0xf981711c, 0xc, 0x718eebd0), at 0xf9805bc7
[30] 0xf9805940(0x718eed44, 0xd8, 0x0, 0xf9816dfc, 0xc, 0x718eec50), at 0xf980593f
[31] 0xf9805940(0x718eeddc, 0xf5e497a8, 0x0, 0xf9816dfc, 0xc, 0x718eecd8), at 0xf980593f
[32] 0xf9805bc8(0x718eee74, 0x718eef04, 0x0, 0xf981711c, 0xc, 0x718eed78), at 0xf9805bc7
[33] 0xf9805940(0x718eef14, 0xa0b01a08, 0x0, 0xf9816b50, 0xc, 0x718eee00), at 0xf980593f
[34] 0xf9805940(0x718eefa4, 0x718ef038, 0x0, 0xf9816dfc, 0x10, 0x718eeea8), at 0xf980593f
[35] 0xf9805940(0x718ef044, 0xf5e497a8, 0x0, 0xf9816b50, 0xc, 0x718eef40), at 0xf980593f
[36] 0xf9805bc8(0x718ef0ec, 0xf5e271e8, 0x0, 0xf981711c, 0xc, 0x718eefd0), at 0xf9805bc7
[37] 0xf9805940(0x718ef1b4, 0xf5566168, 0x0, 0xf9816dfc, 0x10, 0x718ef078), at 0xf980593f
[38] 0xf9805b38(0x718ef244, 0xf5569570, 0xf65e9898, 0xf981711c, 0xc, 0x718ef148), at 0xf9805b37
[39] 0xf9805bc8(0x718ef2ec, 0xf5566168, 0x0, 0xf981711c, 0xc, 0x718ef1e0), at 0xf9805bc7
[40] 0xf9805b38(0x718ef360, 0xa015bea0, 0xf65e9898, 0xf981711c, 0xc, 0x718ef280), at 0xf9805b37
[41] 0xf9853c74(0xa015c108, 0xa0b01798, 0xa0b01d58, 0xf98157ac, 0xc, 0x718ef318), at 0xf9853c73
[42] 0xf9cdb168(0xa0177af8, 0xa0b01798, 0xa0b01d58, 0xf98157a4, 0x0, 0x0), at 0xf9cdb167
[43] 0xf9845d2c(0xa0b01d58, 0xa0b01798, 0xa0122f18, 0xf9814d10, 0xf5f54ec0, 0x718ef350), at 0xf9845d2b
[44] 0xf9805b38(0x718ef4ec, 0xf5569570, 0xf65e9898, 0xf981711c, 0xc, 0x718ef3e8), at 0xf9805b37
[45] 0xf9805bc8(0x718ef594, 0x718efa94, 0x0, 0xf981716c, 0xc, 0x718ef480), at 0xf9805bc7
[46] 0xf98058b0(0x718ef63c, 0x0, 0x0, 0xf9816b50, 0x24, 0x718ef518), at 0xf98058af
[47] 0xf980042c(0x718ef6c8, 0x718ef878, 0xa, 0xf555f628, 0x2c, 0x718ef5b8), at 0xf980042b
[48] JavaCalls::call_helper(0x718ef870, 0x718ef778, 0x718ef798, 0x983d00, 0x983d00, 0x6000), at 0xfd544688
[49] jni_invoke(0x0, 0x718ef870, 0x0, 0x0, 0x4ee228, 0x718ef854), at 0xfd54cde8
[50] jni_CallStaticIntMethodV(0x983d94, 0x47b1e0, 0x4ee228, 0x718ef938, 0x718ef8d8, 0x1511fc), at 0xfd7d4a90
[51] JNIEnv_::CallStaticIntMethod(0x983d94, 0x47b1e0, 0x4ee228, 0x0, 0x718efa94, 0x47af24), at 0xfde4dcc0
[52] NSAPIConnector::service(0x983d94, 0xab3360, 0xab335c, 0x4dca78, 0xab32f8, 0xb33a38), at 0xfde4ba08
[53] service_j2ee_thread(0x718efa94, 0x0, 0xb33e4d, 0x0, 0x2e6a7370, 0x2e6a7370), at 0xfde49df4
[54] NSJavaUtil::runGlobal(0xfde49d90, 0x718efa94, 0x0, 0x57ea40, 0x718efa94, 0x2e6a7370), at 0xfde44140
[55] service_j2ee(0x1faa80, 0x57e9f8, 0x57ea40, 0xfdd00108, 0xfed6ea90, 0x1272ef0), at 0xfde498c4
[56] func_exec_str(0x0, 0xff3119b0, 0x0, 0xff303908, 0xf, 0x1511fc), at 0xff1d0dcc
[57] INTobject_execute(0xff311974, 0x57e9f8, 0x57ea40, 0x2000, 0x0, 0x0), at 0xff1d21d4
[58] INTservact_service(0x0, 0xff30b4f0, 0x0, 0x4, 0x1, 0x0), at 0xff1d65c8
[59] INTservact_handle_processed(0x1fcb48, 0x718efc54, 0xff303908, 0x2c, 0x20, 0xff0000), at 0xff1d6ba4
[60] HttpRequest::UnacceleratedRespond(0x57e948, 0xb335e0, 0x10, 0x0, 0x30, 0xb335d0), at 0xff21270c
[61] HttpRequest::HandleRequest(0x2000, 0x1, 0xb335e0, 0x57e964, 0x57eaf0, 0xb335d0), at 0xff211c8c
[62] DaemonSession::run(0x0, 0xff3109b8, 0xff3109c0, 0x3000, 0x3384, 0x0), at 0xff2103f0
[63] ThreadMain(0x57e258, 0x57f4e8, 0x718cff84, 0xb44d00, 0x0, 0x0), at 0xff14588c
[64] _pt_root(0x57f4e8, 0x0, 0x0, 0x0, 0x390, 0x0), at 0xfed558c0
How to reproduce the failure:
1. log on to big5server.sfbay
go to /export1/bigapps/appserver7/domains/domain1/server/bin
./stopserv
./startserv ( to start appserver 7 )
2. check if appserver7 started successfully.
browse http://big5server.sfbay:6060/iMM/iMM/imm.jsp
3. go to machine jtg-win16, from silk performer, start a run.
4. crash happened within minutes.
###@###.### 2002-10-28