|
Duplicate :
|
FULL PRODUCT VERSION : java version " 1.7.0_05 " Java(TM) SE Runtime Environment (build 1.7.0_05-b06) Java HotSpot(TM) 64-Bit Server VM (build 23.1-b03, mixed mode) FULL OS VERSION : Linux qa3519c 2.6.32-220.23.1.el6.x86_64 #1 SMP Tue Jun 12 11:20:15 EDT 2012 x86_64 x86_64 x86_64 GNU/Linux A DESCRIPTION OF THE PROBLEM : When using the -XX:+UseConcMarkSweepGC -XX:+UseParNewGC the VM cores dump when using more than 129G of memory 3 secs after startup, With anything lower or equal to 129g, the vm starts We have an application that requires 256G of memory and we really want to use that collector. we tried with 1.6 but it fails as well but this time at 129Gb. Things are fine with any other collector including g1 THE PROBLEM WAS REPRODUCIBLE WITH -Xint FLAG: Yes THE PROBLEM WAS REPRODUCIBLE WITH -server FLAG: Yes STEPS TO FOLLOW TO REPRODUCE THE PROBLEM : jvmArg=-server jvmArg=-Xint jvmArg=-Xms130g -Xmx130g jvmArg=-XX:PermSize=256m -XX:MaxPermSize=256m jvmArg=-XX:+UseConcMarkSweepGC -XX:+UseParNewGC EXPECTED VERSUS ACTUAL BEHAVIOR : just start ERROR MESSAGES/STACK TRACES THAT OCCUR : # # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x0000003bf60826d0, pid=33001, tid=139878265677568 # # JRE version: 7.0_13-b20 # Java VM: Java HotSpot(TM) 64-Bit Server VM (23.7-b01 interpreted mode linux-amd64 ) # Problematic frame: # C [libc.so.6+0x826d0] __tls_get_addr@@GLIBC_2.3+0x826d0 # # Core dump written. Default location: core.33001 (max size 4194304 kB). To ensure a full core dump, try " ulimit -c unlimited " before starting Java again # # If you would like to submit a bug report, please visit: # http://bugreport.sun.com/bugreport/crash.jsp # --------------- T H R E A D --------------- Current thread (0x00007f37ec00a800): JavaThread " Unknown thread " [_thread_in_vm, id=33009, stack(0x00007f37f2466000,0x00007f37f2567000)] siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR), si_addr=0x0000003bd614dce2 Registers: RAX=0x00007f1747424000, RBX=0x00007f37ec0410e8, RCX=0x0000003bf614dce0, RDX=0x4747474747474747 RSP=0x00007f37f2565738, RBP=0x00007f37f2565790, RSI=0x0000000000000047, RDI=0x00007f1737424001 R8 =0xfffffffff0000001, R9 =0x0101010101010101, R10=0x0000000000000001, R11=0x0000003bf60826dc R12=0x0000000000000000, R13=0x0000000000000047, R14=0x0000000000000020, R15=0x000000001004337f RIP=0x0000003bf60826d0, EFLAGS=0x0000000000010203, CSGSFS=0x0000000000000033, ERR=0x0000000000000004 TRAPNO=0x000000000000000e Top of Stack: (sp=0x00007f37f2565738) 0x00007f37f2565738: 00007f37f2800e47 0000000000042000 0x00007f37f2565748: 00007f37f3230821 0000000000000001 0x00007f37f2565758: 0000000000000001 ffffffffffffffff 0x00007f37f2565768: 0000000000000000 00007f37ec041228 0x00007f37f2565778: 00007f37ec041070 00007f37f2565860 0x00007f37f2565788: 0000000000000000 00007f37f2565810 0x00007f37f2565798: 00007f37f290fb81 0000000000000001 0x00007f37f25657a8: 0100000000000000 00007f17d0990000 0x00007f37f25657b8: 00000004010ce000 000000000000c308 0x00007f37f25657c8: 00007f37f25657f0 000000000000c308 0x00007f37f25657d8: 00007f37f2ca57f7 00007f37ec040e80 0x00007f37f25657e8: 00007f37ec041070 00007f37ec040e80 0x00007f37f25657f8: 0000000000000001 0000000000000000 0x00007f37f2565808: 00007f37f25659e0 00007f37f25658a0 0x00007f37f2565818: 00007f37f295b120 00007f17d0990000 0x00007f37f2565828: 0000002008670000 0000000000000000 0x00007f37f2565838: 0000000000010000 00007f37ec000000 0x00007f37f2565848: 0000003bf60797d1 0000000000000140 0x00007f37f2565858: 00007f37f2565880 00007f17d0990000 0x00007f37f2565868: 00000004010ce000 00007f37ec0109a0 0x00007f37f2565878: 00007f37ec040e80 00007f37ec03dc80 0x00007f37f2565888: 0000000000000001 0000002008670000 0x00007f37f2565898: 00007f37f25659e0 00007f37f2565930 0x00007f37f25658a8: 00007f37f2a38272 00007f17d0990000 0x00007f37f25658b8: 0000002008670000 0000000000000000 0x00007f37f25658c8: 0000000000010000 00007f37ec000000 0x00007f37f25658d8: 00007f37ec03dc80 0000000000000004 0x00007f37f25658e8: 00007f37f2565a2c 00007f37f2565e50 0x00007f37f25658f8: 00007f37f25659e0 00007f37f2565930 0x00007f37f2565908: 00007f37f2909640 0000000000000008 0x00007f37f2565918: 00007f37ec0109d0 0000000000000002 0x00007f37f2565928: 00007f37f2565980 00007f37f2565a60 Instructions: (pc=0x0000003bf60826d0) 0x0000003bf60826b0: af d1 49 81 f8 90 00 00 00 0f 8f e1 02 00 00 4c 0x0000003bf60826c0: 01 c7 4c 8d 1d 13 00 00 00 48 8d 0d 10 b6 0c 00 0x0000003bf60826d0: 4a 0f bf 0c 41 4e 8d 1c 19 41 ff e3 c3 0f 1f 00 0x0000003bf60826e0: 48 89 97 77 ff ff ff 48 89 97 7f ff ff ff 48 89 Stack: [0x00007f37f2466000,0x00007f37f2567000], sp=0x00007f37f2565738, free space=1021k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) C [libc.so.6+0x826d0] __tls_get_addr@@GLIBC_2.3+0x826d0 V [libjvm.so+0x3a8b81] CompactibleFreeListSpace::CompactibleFreeListSpace(BlockOffsetSharedArray*, MemRegion, bool, FreeBlockDictionary::DictionaryChoice)+0xc1 V [libjvm.so+0x3f4120] ConcurrentMarkSweepGeneration::ConcurrentMarkSweepGeneration(ReservedSpace, unsigned long, int, CardTableRS*, bool, FreeBlockDictionary::DictionaryChoice)+0x100 V [libjvm.so+0x4d1272] GenerationSpec::init(ReservedSpace, int, GenRemSet*)+0xf2 V [libjvm.so+0x4c0bd9] GenCollectedHeap::initialize()+0x2e9 V [libjvm.so+0x87d7f8] Universe::initialize_heap()+0xb8 V [libjvm.so+0x87fecd] universe_init()+0x7d V [libjvm.so+0x503d25] init_globals()+0x65 V [libjvm.so+0x867052] Threads::create_vm(JavaVMInitArgs*, bool*)+0x1e2 V [libjvm.so+0x563c34] JNI_CreateJavaVM+0x74 C [libjli.so+0x2f8e] JavaMain+0x9e --------------- P R O C E S S --------------- Java Threads: ( => current thread ) Other Threads: =>0x00007f37ec00a800 (exited) JavaThread " Unknown thread " [_thread_in_vm, id=33009, stack(0x00007f37f2466000,0x00007f37f2567000)] VM state:not at safepoint (not fully initialized) VM Mutex/Monitor currently owned by a thread: None GC Heap History (0 events): No events Deoptimization events (0 events): No events Internal exceptions (0 events): No events Events (0 events): No events Dynamic libraries: 00400000-00401000 r-xp 00000000 08:01 9438451 /usr/java/jdk1.7.0_13-x86_64/bin/java 00600000-00601000 rw-p 00000000 08:01 9438451 /usr/java/jdk1.7.0_13-x86_64/bin/java 019a0000-019c1000 rw-p 00000000 00:00 0 [heap] 3bf5800000-3bf5820000 r-xp 00000000 08:01 29622787 /lib64/ld-2.12.so 3bf5a1f000-3bf5a20000 r--p 0001f000 08:01 29622787 /lib64/ld-2.12.so 3bf5a20000-3bf5a21000 rw-p 00020000 08:01 29622787 /lib64/ld-2.12.so 3bf5a21000-3bf5a22000 rw-p 00000000 00:00 0 3bf5c00000-3bf5c02000 r-xp 00000000 08:01 29622370 /lib64/libdl-2.12.so 3bf5c02000-3bf5e02000 ---p 00002000 08:01 29622370 /lib64/libdl-2.12.so 3bf5e02000-3bf5e03000 r--p 00002000 08:01 29622370 /lib64/libdl-2.12.so 3bf5e03000-3bf5e04000 rw-p 00003000 08:01 29622370 /lib64/libdl-2.12.so 3bf6000000-3bf6186000 r-xp 00000000 08:01 29622788 /lib64/libc-2.12.so 3bf6186000-3bf6386000 ---p 00186000 08:01 29622788 /lib64/libc-2.12.so 3bf6386000-3bf638a000 r--p 00186000 08:01 29622788 /lib64/libc-2.12.so 3bf638a000-3bf638b000 rw-p 0018a000 08:01 29622788 /lib64/libc-2.12.so 3bf638b000-3bf6390000 rw-p 00000000 00:00 0 3bf6400000-3bf6417000 r-xp 00000000 08:01 29622790 /lib64/libpthread-2.12.so 3bf6417000-3bf6616000 ---p 00017000 08:01 29622790 /lib64/libpthread-2.12.so 3bf6616000-3bf6617000 r--p 00016000 08:01 29622790 /lib64/libpthread-2.12.so 3bf6617000-3bf6618000 rw-p 00017000 08:01 29622790 /lib64/libpthread-2.12.so 3bf6618000-3bf661c000 rw-p 00000000 00:00 0 3bf6800000-3bf6883000 r-xp 00000000 08:01 29622793 /lib64/libm-2.12.so 3bf6883000-3bf6a82000 ---p 00083000 08:01 29622793 /lib64/libm-2.12.so 3bf6a82000-3bf6a83000 r--p 00082000 08:01 29622793 /lib64/libm-2.12.so 3bf6a83000-3bf6a84000 rw-p 00083000 08:01 29622793 /lib64/libm-2.12.so 3bf7000000-3bf7007000 r-xp 00000000 08:01 29622791 /lib64/librt-2.12.so 3bf7007000-3bf7206000 ---p 00007000 08:01 29622791 /lib64/librt-2.12.so 3bf7206000-3bf7207000 r--p 00006000 08:01 29622791 /lib64/librt-2.12.so 3bf7207000-3bf7208000 rw-p 00007000 08:01 29622791 /lib64/librt-2.12.so 7f173722c000-7f1758f7f000 rw-p 00000000 00:00 0 7f1758f7f000-7f1758fff000 rw-p 00000000 00:00 0 7f1758fff000-7f37d9000000 rw-p 00000000 00:00 0 7f37d9000000-7f37e9000000 rw-p 00000000 00:00 0 7f37e9000000-7f37e9270000 rwxp 00000000 00:00 0 7f37e9270000-7f37ec0ad000 rw-p 00000000 00:00 0 7f37ec0ad000-7f37f0000000 ---p 00000000 00:00 0 7f37f0010000-7f37f0011000 ---p 00000000 00:00 0 7f37f0011000-7f37f0111000 rw-p 00000000 00:00 0 7f37f0111000-7f37f0112000 ---p 00000000 00:00 0 7f37f0112000-7f37f0212000 rw-p 00000000 00:00 0 7f37f0212000-7f37f0213000 ---p 00000000 00:00 0 7f37f0213000-7f37f0313000 rw-p 00000000 00:00 0 7f37f0313000-7f37f0314000 ---p 00000000 00:00 0 7f37f0314000-7f37f0414000 rw-p 00000000 00:00 0 7f37f0414000-7f37f0415000 ---p 00000000 00:00 0 7f37f0415000-7f37f0515000 rw-p 00000000 00:00 0 7f37f0515000-7f37f0516000 ---p 00000000 00:00 0 7f37f0516000-7f37f0616000 rw-p 00000000 00:00 0 7f37f0616000-7f37f0617000 ---p 00000000 00:00 0 7f37f0617000-7f37f0717000 rw-p 00000000 00:00 0 7f37f0717000-7f37f0718000 ---p 00000000 00:00 0 7f37f0718000-7f37f0818000 rw-p 00000000 00:00 0 7f37f0818000-7f37f0819000 ---p 00000000 00:00 0 7f37f0819000-7f37f0919000 rw-p 00000000 00:00 0 7f37f0919000-7f37f091a000 ---p 00000000 00:00 0 7f37f091a000-7f37f0a1a000 rw-p 00000000 00:00 0 7f37f0a1a000-7f37f0a1b000 ---p 00000000 00:00 0 7f37f0a1b000-7f37f0b1b000 rw-p 00000000 00:00 0 7f37f0b1b000-7f37f0b1c000 ---p 00000000 00:00 0 7f37f0b1c000-7f37f0c1c000 rw-p 00000000 00:00 0 7f37f0c1c000-7f37f0c1d000 ---p 00000000 00:00 0 7f37f0c1d000-7f37f0d1d000 rw-p 00000000 00:00 0 7f37f0d1d000-7f37f0d1e000 ---p 00000000 00:00 0 7f37f0d1e000-7f37f0e1e000 rw-p 00000000 00:00 0 7f37f0e1e000-7f37f0e1f000 ---p 00000000 00:00 0 7f37f0e1f000-7f37f0f1f000 rw-p 00000000 00:00 0 7f37f0f1f000-7f37f0f20000 ---p 00000000 00:00 0 7f37f0f20000-7f37f1020000 rw-p 00000000 00:00 0 7f37f1020000-7f37f1021000 ---p 00000000 00:00 0 7f37f1021000-7f37f1121000 rw-p 00000000 00:00 0 7f37f1121000-7f37f1122000 ---p 00000000 00:00 0 7f37f1122000-7f37f1222000 rw-p 00000000 00:00 0 7f37f1222000-7f37f1223000 ---p 00000000 00:00 0 7f37f1223000-7f37f1323000 rw-p 00000000 00:00 0 7f37f1323000-7f37f1324000 ---p 00000000 00:00 0 7f37f1324000-7f37f1424000 rw-p 00000000 00:00 0 7f37f1424000-7f37f1425000 ---p 00000000 00:00 0 7f37f1425000-7f37f1525000 rw-p 00000000 00:00 0 7f37f1525000-7f37f1526000 ---p 00000000 00:00 0 7f37f1526000-7f37f1626000 rw-p 00000000 00:00 0 7f37f1626000-7f37f1627000 ---p 00000000 00:00 0 7f37f1627000-7f37f1731000 rw-p 00000000 00:00 0 7f37f1731000-7f37f17e7000 rw-p 00000000 00:00 0 7f37f17e7000-7f37f1801000 r-xp 00000000 08:01 9834172 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/libzip.so 7f37f1801000-7f37f1a01000 ---p 0001a000 08:01 9834172 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/libzip.so 7f37f1a01000-7f37f1a02000 rw-p 0001a000 08:01 9834172 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/libzip.so 7f37f1a02000-7f37f1a06000 r-xp 00000000 08:01 29622607 /lib64/libnss_sss.so.2 7f37f1a06000-7f37f1c06000 ---p 00004000 08:01 29622607 /lib64/libnss_sss.so.2 7f37f1c06000-7f37f1c07000 rw-p 00004000 08:01 29622607 /lib64/libnss_sss.so.2 7f37f1c07000-7f37f1c13000 r-xp 00000000 08:01 29622302 /lib64/libnss_files-2.12.so 7f37f1c13000-7f37f1e13000 ---p 0000c000 08:01 29622302 /lib64/libnss_files-2.12.so 7f37f1e13000-7f37f1e14000 r--p 0000c000 08:01 29622302 /lib64/libnss_files-2.12.so 7f37f1e14000-7f37f1e15000 rw-p 0000d000 08:01 29622302 /lib64/libnss_files-2.12.so 7f37f1e23000-7f37f1e2d000 r-xp 00000000 08:01 9834125 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/libinstrument.so 7f37f1e2d000-7f37f202c000 ---p 0000a000 08:01 9834125 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/libinstrument.so 7f37f202c000-7f37f202d000 rw-p 00009000 08:01 9834125 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/libinstrument.so 7f37f202d000-7f37f2056000 r-xp 00000000 08:01 9834156 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/libjava.so 7f37f2056000-7f37f2256000 ---p 00029000 08:01 9834156 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/libjava.so 7f37f2256000-7f37f2258000 rw-p 00029000 08:01 9834156 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/libjava.so 7f37f2258000-7f37f2265000 r-xp 00000000 08:01 9834154 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/libverify.so 7f37f2265000-7f37f2464000 ---p 0000d000 08:01 9834154 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/libverify.so 7f37f2464000-7f37f2466000 rw-p 0000c000 08:01 9834154 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/libverify.so 7f37f2466000-7f37f2469000 ---p 00000000 00:00 0 7f37f2469000-7f37f2567000 rw-p 00000000 00:00 0 7f37f2567000-7f37f2fae000 r-xp 00000000 08:01 9834162 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/server/libjvm.so 7f37f2fae000-7f37f31ae000 ---p 00a47000 08:01 9834162 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/server/libjvm.so 7f37f31ae000-7f37f3251000 rw-p 00a47000 08:01 9834162 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/server/libjvm.so 7f37f3251000-7f37f3290000 rw-p 00000000 00:00 0 7f37f3290000-7f37f32a6000 r-xp 00000000 08:01 9834131 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/jli/libjli.so 7f37f32a6000-7f37f34a6000 ---p 00016000 08:01 9834131 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/jli/libjli.so 7f37f34a6000-7f37f34a7000 rw-p 00016000 08:01 9834131 /usr/java/jdk1.7.0_13-x86_64/jre/lib/amd64/jli/libjli.so 7f37f34a7000-7f37f34a8000 rw-p 00000000 00:00 0 7f37f34aa000-7f37f34ac000 rw-p 00000000 00:00 0 7f37f34ac000-7f37f34b4000 rw-s 00000000 08:01 19399909 /tmp/hsperfdata_clqa/33001 7f37f34b4000-7f37f34b5000 rw-p 00000000 00:00 0 7f37f34b5000-7f37f34b6000 r--p 00000000 00:00 0 7f37f34b6000-7f37f34b7000 rw-p 00000000 00:00 0 7fff290b1000-7fff290c6000 rw-p 00000000 00:00 0 [stack] 7fff29141000-7fff29142000 r-xp 00000000 00:00 0 [vdso] ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall] VM Arguments: jvm_args: -javaagent:/home/perftools/jHiccup.1.2.2/jHiccup/bin/jHiccup.jar=-d 10000 -i 1000 -r 1 -l hiccup.130321.1553.33001 -DAPPNAME=xxxxx-xxxxx -DHOSTNAME=xxxx -DENVIRO=xxxx -Xint -Xms130g -Xmx130g -XX:PermSize=256m -XX:MaxPermSize=256m -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -Dcatalina.base=tomcat -Dcatalina.home=/opt/apache-tomcat/7.0.29.0 -Dcatalina.config=file:cfg/xxxxxx/catalina.properties -Dconfig=xxxxxx.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=cfg/xxxxxx/logging.properties -Dlog4j.configuration=../cfg/xxxxxx/log4j.properties -Dcom.sun.management.jmxremote.port=00000 -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Djava.net.preferIPv4Stack=true -Dcmb.connection=tibco jav ( This report has more than 16,000 characters and has been truncated. )