This problem looks very similar to 
bug 4489387 -Xrunhprof crashed jvm or got program run to hang

Ihac profiling their server with -Xrunhprof:heap=dump
and the system terminates with an OutOfMemoryError.

Here's the settings that are being passed to the JVM:

-DDefaultCompilationConfig=en_US
-server
-Xms256m
-Xmx256m
-XX:NewSize=90m
-XX:MaxNewSize=128m
-XX:SurvivorRatio=1
-XX:TargetSurvivorRatio=90
-XX:+DisableExplicitGC
-XX:+UseDefaultStackSize
-verbose:gc
-Xss256K
-Xrunhprof:heap=dump,format=a,file=c:\hprof-results.txt,doe=y

The OutOfMemoryError occurs after a few minutes; it doesn't happen
immediately.

In the following run, the system started at 17:48:38.461 and got an out of memory at 17:54:02.721. No stack trace appears to be available.

Here's the output of verbose:gc

Tue Jan 07 05:48:32 PM[GC 196K->112K(231424K), 0.0017769 secs]
Tue Jan 07 05:48:40 PM[Full GC 93544K->11364K(231424K), 0.5762291 secs]
Tue Jan 07 05:48:41 PM[Full GC 72804K->11364K(231424K), 0.1126402 secs]
Tue Jan 07 05:48:57 PM[Full GC 124744K->13247K(231424K), 1.2927010 secs]
Tue Jan 07 05:48:58 PM[Full GC 74687K->4706K(231424K), 0.3998397 secs]
Tue Jan 07 05:49:59 PM[Full GC 231423K->26398K(231424K), 6.3712812 secs]
Tue Jan 07 05:50:05 PM[Full GC 87838K->26398K(231424K), 0.3869270 secs]
Tue Jan 07 05:50:58 PM[Full GC 231423K->25385K(231424K), 6.7176261 secs]
Tue Jan 07 05:51:04 PM[Full GC 86825K->16891K(231424K), 1.1593196 secs]
Tue Jan 07 05:51:56 PM[Full GC 231423K->22032K(231424K), 6.2966807 secs]
Tue Jan 07 05:52:02 PM[Full GC 83472K->22026K(231424K), 0.5107893 secs]
Tue Jan 07 05:52:55 PM[Full GC 231423K->22061K(231424K), 6.5633389 secs]
Tue Jan 07 05:53:01 PM[Full GC 83501K->13562K(231424K), 0.7705600 secs]
Tue Jan 07 05:53:55 PM[Full GC 231423K->21075K(231424K), 6.6609371 secs]
Tue Jan 07 05:54:02 PM[Full GC 82515K->21006K(231424K), 0.3516694 secs]

They have also tried increasing permanent size to 256M in case
perm gen is being exhausted but the system still throws an OutOfMemoryError.