Re: [jetty-dev] 500% CPU utilization

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [jetty-dev] 500% CPU utilization
From: Eirik Bjørsnøs <eirbjo@xxxxxxxxx>
Date: Tue, 27 Jan 2015 18:59:21 +0100
Delivered-to: jetty-dev@xxxxxxxxxxx
List-archive: <https://dev.eclipse.org/mailman/private/jetty-dev>
List-help: <mailto:jetty-dev-request@eclipse.org?subject=help>
List-subscribe: <https://dev.eclipse.org/mailman/listinfo/jetty-dev>, <mailto:jetty-dev-request@eclipse.org?subject=subscribe>
List-unsubscribe: <https://dev.eclipse.org/mailman/options/jetty-dev>, <mailto:jetty-dev-request@eclipse.org?subject=unsubscribe>
I know, I know, this is better managed as a bug:

https://bugs.eclipse.org/bugs/show_bug.cgi?id=458565

:-)

On Tue, Jan 27, 2015 at 6:44 PM, Eirik Bjørsnøs <eirbjo@xxxxxxxxx> wrote:
> When inspecting the SelectionKeys on ManagedSelector.select:405, I see
> that the attachment fields are SelectChannelEndpoints to the various
> ports which lsop shows as in CLOSE_WAIT. The toString of the
> SelectChannelEndpoints are as follows:
>
> SelectChannelEndPoint@6c66b85e{/0:0:0:0:0:0:0:1:54524<->8081,Open,ISHUT,out,R,-,0,HttpConnection}{io=1,kio=1,kro=1}
>
> Other interesting state/fields:
>
> _interestState: UPDATED
> _open: true
> _interestOps: -1
> _ishut: true
> _oshut: false
> _timeout: null
> _fillInterest: FillInterest@5be7932f{true,AC.ReadCB@43136851{HttpConnection@43136851{FILL_INTERESTED}}}
> _writeFlusher: WriteFlusher@21a6445{IDLE}
>
>
> $ java -version
>
> java version "1.8.0_25"
>
> OS X Yosemite 10.10.1.
>
> Eirik.
>
> On Tue, Jan 27, 2015 at 6:29 PM, Eirik Bjørsnøs <eirbjo@xxxxxxxxx> wrote:
>> lsof output:
>>
>> $ lsof -nP -p 10982 |grep TCP
>>
>> java    10982 eirbjo    6u    IPv4 0x265455402e62839       0t0
>> TCP 127.0.0.1:8000->127.0.0.1:54506 (ESTABLISHED)
>>
>> java    10982 eirbjo  189u    IPv6 0x26545540323ccb9       0t0
>> TCP *:8443 (LISTEN)
>>
>> java    10982 eirbjo  258u    IPv6 0x2654554025adeb9       0t0
>> TCP *:8081 (LISTEN)
>>
>> java    10982 eirbjo  271u    IPv6 0x265455401b49ab9       0t0
>> TCP [::1]:8081->[::1]:54519 (CLOSE_WAIT)
>>
>> java    10982 eirbjo  272u    IPv6 0x26545540ca888b9       0t0
>> TCP [::1]:8081->[::1]:54520 (CLOSE_WAIT)
>>
>> java    10982 eirbjo  273u    IPv6 0x2654554025bc7b9       0t0
>> TCP [::1]:8081->[::1]:54521 (CLOSE_WAIT)
>>
>> java    10982 eirbjo  274u    IPv6 0x2654554025af7b9       0t0
>> TCP [::1]:8081->[::1]:54522 (CLOSE_WAIT)
>>
>> java    10982 eirbjo  275u    IPv6 0x265455403239ab9       0t0
>> TCP [::1]:8081->[::1]:54523 (CLOSE_WAIT)
>>
>> java    10982 eirbjo  276u    IPv6 0x265455403238bb9       0t0
>> TCP [::1]:8081->[::1]:54524 (CLOSE_WAIT)
>>
>> java    10982 eirbjo  277u    IPv6 0x26545540ca8a1b9       0t0
>> TCP [::1]:8081->[::1]:54525 (CLOSE_WAIT)
>>
>> java    10982 eirbjo  278u    IPv6 0x265455403239fb9       0t0
>> TCP [::1]:8081->[::1]:54526 (CLOSE_WAIT)
>>
>> java    10982 eirbjo  283u    IPv6 0x2654554025ac0b9       0t0
>> TCP *:54963 (LISTEN)
>>
>>
>> On Tue, Jan 27, 2015 at 6:18 PM, Eirik Bjørsnøs <eirbjo@xxxxxxxxx> wrote:
>>> Hi,
>>>
>>> I just noticed that my Jetty process is running at 400-500% CPU on my
>>> development laptop.
>>>
>>> In addition to jetty:run default config, I'm also running a separate
>>> Server instance with the following ConnectionFactories: [ssl, alnp,
>>> http/2, spdy, http/]
>>>
>>> I'm running 9.3.0.M1.
>>>
>>> I have debugging enabled, so I'm able to step through line by line. I
>>> also have VisualVM connected. You'll find a thread dump at the end of
>>> this email.
>>>
>>> Analysis:
>>>
>>> Seems like there is a loop which starts at:
>>>
>>> ManagedSelector.run:528
>>>
>>> This continues to:
>>>
>>> ManagedSelector.select
>>>    _state == PROCESSING
>>>    _runChanges.size() == 0
>>>   _addChanges.isEmpty returns true
>>>   loop breaks at 574
>>>   _selector.select(); at line 603
>>>   _state is SELECTING at line 611
>>>   _state.compareAndSet(State.SELECTING, State.PROCESSING) fails at line 616
>>>   out loop continues from line 617
>>>   _state is now PROCESSING
>>>   out loop breaks at 622
>>>   _selector.selectedKeys() returns two SelectionKeys at line 635
>>>   both keys isValid and are processed
>>>  Thread.yield(); at 653
>>>   selectedKeys are updated and cleared
>>>
>>> while loop at SelectorManager.run:527 continues.
>>>
>>> Does this sound like normal behaviour? I'm not familiar enough with
>>> NIO to tell what the code does / should do.
>>>
>>> Is the problem here that Selector.select returns too fast?
>>>
>>> I have no active connections to this server. Closed all browsers did
>>> not change the situation.
>>>
>>> I'm letting this code hang in my debugger for a while in case someone
>>> has instructions for further debugging.
>>>
>>> Thread dump:
>>>
>>>
>>> 2015-01-27 17:40:59
>>>
>>> Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.25-b02 mixed mode):
>>>
>>>
>>> "RMI TCP Connection(3)-172.16.0.125" #54 daemon prio=9 os_prio=31
>>> tid=0x00007fbb060ec000 nid=0x7e0b runnable [0x0000000184ca5000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>> at java.net.SocketInputStream.socketRead0(Native Method)
>>>
>>> at java.net.SocketInputStream.read(SocketInputStream.java:150)
>>>
>>> at java.net.SocketInputStream.read(SocketInputStream.java:121)
>>>
>>> at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>>>
>>> at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>>>
>>> - locked <0x000000011bbed920> (a java.io.BufferedInputStream)
>>>
>>> at java.io.FilterInputStream.read(FilterInputStream.java:83)
>>>
>>> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:539)
>>>
>>> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:812)
>>>
>>> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:671)
>>>
>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>
>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - <0x000000011bbedae0> (a java.util.concurrent.ThreadPoolExecutor$Worker)
>>>
>>>
>>> "RMI TCP Connection(2)-172.16.0.125" #53 daemon prio=9 os_prio=31
>>> tid=0x00007fbb06b6f000 nid=0x9503 runnable [0x00000001845e7000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>> at java.net.SocketInputStream.socketRead0(Native Method)
>>>
>>> at java.net.SocketInputStream.read(SocketInputStream.java:150)
>>>
>>> at java.net.SocketInputStream.read(SocketInputStream.java:121)
>>>
>>> at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>>>
>>> at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>>>
>>> - locked <0x000000011bb1b900> (a java.io.BufferedInputStream)
>>>
>>> at java.io.FilterInputStream.read(FilterInputStream.java:83)
>>>
>>> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:539)
>>>
>>> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:812)
>>>
>>> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:671)
>>>
>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>
>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - <0x000000011bb1dd38> (a java.util.concurrent.ThreadPoolExecutor$Worker)
>>>
>>>
>>> "qtp837249677-52" #52 prio=5 os_prio=31 tid=0x00007fbb02692000
>>> nid=0x9303 waiting on condition [0x000000018439f000]
>>>
>>>    java.lang.Thread.State: WAITING (parking)
>>>
>>> at sun.misc.Unsafe.park(Native Method)
>>>
>>> - parking to wait for  <0x0000000119b474a0> (a
>>> java.util.concurrent.locks.ReentrantLock$NonfairSync)
>>>
>>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireInterruptibly(AbstractQueuedSynchronizer.java:897)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1222)
>>>
>>> at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:335)
>>>
>>> at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:380)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:575)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "JMX server connection timeout 51" #51 daemon prio=9 os_prio=31
>>> tid=0x00007fbb023d1800 nid=0x9103 in Object.wait()
>>> [0x000000018429c000]
>>>
>>>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>>>
>>> at java.lang.Object.wait(Native Method)
>>>
>>> at com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:168)
>>>
>>> - locked <0x000000011bab0358> (a [I)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "RMI Scheduler(0)" #50 daemon prio=9 os_prio=31 tid=0x00007fbb075ef800
>>> nid=0x8f03 waiting on condition [0x0000000183f99000]
>>>
>>>    java.lang.Thread.State: TIMED_WAITING (parking)
>>>
>>> at sun.misc.Unsafe.park(Native Method)
>>>
>>> - parking to wait for  <0x000000011bab1eb0> (a
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>>>
>>> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>>>
>>> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
>>>
>>> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
>>>
>>> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
>>>
>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
>>>
>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "RMI TCP Connection(1)-172.16.0.125" #49 daemon prio=9 os_prio=31
>>> tid=0x00007fbb06859800 nid=0x8d03 runnable [0x0000000183e96000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>> at java.net.SocketInputStream.socketRead0(Native Method)
>>>
>>> at java.net.SocketInputStream.read(SocketInputStream.java:150)
>>>
>>> at java.net.SocketInputStream.read(SocketInputStream.java:121)
>>>
>>> at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>>>
>>> at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>>>
>>> - locked <0x000000011bab7b90> (a java.io.BufferedInputStream)
>>>
>>> at java.io.FilterInputStream.read(FilterInputStream.java:83)
>>>
>>> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:539)
>>>
>>> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:812)
>>>
>>> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:671)
>>>
>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>
>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - <0x000000011bab7a28> (a java.util.concurrent.ThreadPoolExecutor$Worker)
>>>
>>>
>>> "RMI TCP Accept-0" #48 daemon prio=9 os_prio=31 tid=0x00007fbb06062000
>>> nid=0x8c07 runnable [0x0000000183d93000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>> at java.net.PlainSocketImpl.socketAccept(Native Method)
>>>
>>> at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:404)
>>>
>>> at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>>>
>>> at java.net.ServerSocket.accept(ServerSocket.java:513)
>>>
>>> at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:52)
>>>
>>> at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:389)
>>>
>>> at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:361)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp837249677-47" #47 prio=5 os_prio=31 tid=0x00007fbb06962000
>>> nid=0x840b waiting on condition [0x000000018117d000]
>>>
>>>    java.lang.Thread.State: TIMED_WAITING (parking)
>>>
>>> at sun.misc.Unsafe.park(Native Method)
>>>
>>> - parking to wait for  <0x0000000119b474c0> (a
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>>>
>>> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>>>
>>> at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:575)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp837249677-43" #43 prio=5 os_prio=31 tid=0x00007fbb060a6000
>>> nid=0x8603 runnable [0x0000000183c90000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>> at sun.misc.Unsafe.unpark(Native Method)
>>>
>>> at java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer.unparkSuccessor(AbstractQueuedSynchronizer.java:662)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer.release(AbstractQueuedSynchronizer.java:1264)
>>>
>>> at java.util.concurrent.locks.ReentrantLock.unlock(ReentrantLock.java:457)
>>>
>>> at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:408)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:575)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp837249677-41" #41 prio=5 os_prio=31 tid=0x00007fbb06c57000
>>> nid=0x8203 waiting on condition [0x0000000183425000]
>>>
>>>    java.lang.Thread.State: TIMED_WAITING (parking)
>>>
>>> at sun.misc.Unsafe.park(Native Method)
>>>
>>> - parking to wait for  <0x0000000119b474c0> (a
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>>>
>>> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>>>
>>> at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:575)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp837249677-40" #40 prio=5 os_prio=31 tid=0x00007fbb043af000
>>> nid=0x7c07 waiting on condition [0x0000000181c2d000]
>>>
>>>    java.lang.Thread.State: TIMED_WAITING (parking)
>>>
>>> at sun.misc.Unsafe.park(Native Method)
>>>
>>> - parking to wait for  <0x0000000119b474c0> (a
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>>>
>>> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>>>
>>> at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:575)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "org.eclipse.jetty.server.session.HashSessionManager@759a678aTimer"
>>> #36 daemon prio=5 os_prio=31 tid=0x00007fbb027f7800 nid=0x7807 waiting
>>> on condition [0x00000001812d7000]
>>>
>>>    java.lang.Thread.State: TIMED_WAITING (parking)
>>>
>>> at sun.misc.Unsafe.park(Native Method)
>>>
>>> - parking to wait for  <0x000000011ab36270> (a
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>>>
>>> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>>>
>>> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
>>>
>>> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
>>>
>>> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
>>>
>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
>>>
>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp837249677-35" #35 prio=5 os_prio=31 tid=0x00007fbb048e8000
>>> nid=0x7a03 waiting on condition [0x0000000182c34000]
>>>
>>>    java.lang.Thread.State: TIMED_WAITING (parking)
>>>
>>> at sun.misc.Unsafe.park(Native Method)
>>>
>>> - parking to wait for  <0x0000000119b474c0> (a
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>>>
>>> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>>>
>>> at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:575)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp837249677-33-selector-ServerConnectorManager@5b060162/2" #33
>>> prio=4 os_prio=31 tid=0x00007fbb01e24800 nid=0x7603 runnable
>>> [0x0000000183322000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>> at java.lang.Thread.yield(Native Method)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:653)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:528)
>>>
>>> at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:620)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:540)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp837249677-32-acceptor-0@54385f05-ServerConnector@197ce367{HTTP/1.1,[http/1.1]}{0.0.0.0:8081}"
>>> #32 prio=3 os_prio=31 tid=0x00007fbb01e1e800 nid=0x7403 runnable
>>> [0x000000018321f000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>> at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>>
>>> at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:241)
>>>
>>> - locked <0x000000011ab3a5b0> (a java.lang.Object)
>>>
>>> at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:387)
>>>
>>> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:531)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:620)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:540)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp837249677-31-selector-ServerConnectorManager@5b060162/0" #31
>>> prio=4 os_prio=31 tid=0x00007fbb01e1d800 nid=0x7203 runnable
>>> [0x000000018311c000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>> at sun.nio.ch.IOUtil.drain(Native Method)
>>>
>>> at sun.nio.ch.KQueueSelectorImpl.updateSelectedKeys(KQueueSelectorImpl.java:167)
>>>
>>> - locked <0x000000011ac1aa98> (a java.lang.Object)
>>>
>>> at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:108)
>>>
>>> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>>>
>>> - locked <0x000000011ac1a910> (a sun.nio.ch.Util$2)
>>>
>>> - locked <0x000000011ac1a900> (a java.util.Collections$UnmodifiableSet)
>>>
>>> - locked <0x000000011ac03e80> (a sun.nio.ch.KQueueSelectorImpl)
>>>
>>> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>>>
>>> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:603)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:528)
>>>
>>> at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:620)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:540)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp837249677-30-selector-ServerConnectorManager@5b060162/3" #30
>>> prio=4 os_prio=31 tid=0x00007fbb01e1f800 nid=0x7003 runnable
>>> [0x0000000183019000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>> at java.lang.Thread.yield(Native Method)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:653)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:528)
>>>
>>> at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:620)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:540)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp837249677-29-selector-ServerConnectorManager@5b060162/1" #29
>>> prio=4 os_prio=31 tid=0x00007fbb0195e000 nid=0x6e03 runnable
>>> [0x0000000181de8000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>> at java.lang.Thread.yield(Native Method)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:653)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:528)
>>>
>>> at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:620)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:540)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp837249677-28" #28 prio=5 os_prio=31 tid=0x00007fbb018d0000
>>> nid=0x6c03 runnable [0x00000001814c4000]
>>>
>>>    java.lang.Thread.State: TIMED_WAITING (parking)
>>>
>>> at sun.misc.Unsafe.park(Native Method)
>>>
>>> - parking to wait for  <0x0000000119b474c0> (a
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>>>
>>> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>>>
>>> at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:575)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp837249677-27" #27 prio=5 os_prio=31 tid=0x00007fbb028b3000
>>> nid=0x6a03 waiting on condition [0x0000000180894000]
>>>
>>>    java.lang.Thread.State: TIMED_WAITING (parking)
>>>
>>> at sun.misc.Unsafe.park(Native Method)
>>>
>>> - parking to wait for  <0x0000000119b474c0> (a
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>>>
>>> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>>>
>>> at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:575)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp890160784-23" #23 prio=5 os_prio=31 tid=0x00007fbb025ed000
>>> nid=0x6603 waiting on condition [0x0000000182b31000]
>>>
>>>    java.lang.Thread.State: TIMED_WAITING (parking)
>>>
>>> at sun.misc.Unsafe.park(Native Method)
>>>
>>> - parking to wait for  <0x000000011a422e90> (a
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>>>
>>> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>>>
>>> at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:575)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp890160784-22" #22 prio=5 os_prio=31 tid=0x00007fbb040f7000
>>> nid=0x6403 waiting on condition [0x0000000182a2e000]
>>>
>>>    java.lang.Thread.State: TIMED_WAITING (parking)
>>>
>>> at sun.misc.Unsafe.park(Native Method)
>>>
>>> - parking to wait for  <0x000000011a422e90> (a
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>>>
>>> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>>>
>>> at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:575)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp890160784-21" #21 prio=5 os_prio=31 tid=0x00007fbb048e2800
>>> nid=0x6203 waiting on condition [0x000000018292b000]
>>>
>>>    java.lang.Thread.State: TIMED_WAITING (parking)
>>>
>>> at sun.misc.Unsafe.park(Native Method)
>>>
>>> - parking to wait for  <0x000000011a422e90> (a
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>>>
>>> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>
>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>>>
>>> at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:575)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp890160784-20-acceptor-0@50f352d3-ServerConnector@1c57f6b2{SSL,[ssl,
>>> alpn, h2-14, spdy/3, spdy/2, http/1.1]}{0.0.0.0:8443}" #20 prio=3
>>> os_prio=31 tid=0x00007fbb05273800 nid=0x6003 runnable
>>> [0x0000000182828000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>> at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>>>
>>> at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:241)
>>>
>>> - locked <0x000000011a420d48> (a java.lang.Object)
>>>
>>> at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:387)
>>>
>>> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:531)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:620)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:540)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp890160784-19-selector-ServerConnectorManager@25e6c171/3" #19
>>> prio=4 os_prio=31 tid=0x00007fbb040f6000 nid=0x5e03 runnable
>>> [0x00000001822d5000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>> at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
>>>
>>> at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)
>>>
>>> at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
>>>
>>> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>>>
>>> - locked <0x000000011a423d98> (a sun.nio.ch.Util$2)
>>>
>>> - locked <0x000000011a423da8> (a java.util.Collections$UnmodifiableSet)
>>>
>>> - locked <0x000000011a423d48> (a sun.nio.ch.KQueueSelectorImpl)
>>>
>>> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>>>
>>> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:603)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:528)
>>>
>>> at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:620)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:540)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp890160784-18-selector-ServerConnectorManager@25e6c171/2" #18
>>> prio=4 os_prio=31 tid=0x00007fbb041e7800 nid=0x5c03 runnable
>>> [0x00000001821d2000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>> at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
>>>
>>> at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)
>>>
>>> at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
>>>
>>> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>>>
>>> - locked <0x000000011a4240f0> (a sun.nio.ch.Util$2)
>>>
>>> - locked <0x000000011a424100> (a java.util.Collections$UnmodifiableSet)
>>>
>>> - locked <0x000000011a4240a0> (a sun.nio.ch.KQueueSelectorImpl)
>>>
>>> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>>>
>>> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:603)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:528)
>>>
>>> at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:620)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:540)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp890160784-17-selector-ServerConnectorManager@25e6c171/1" #17
>>> prio=4 os_prio=31 tid=0x00007fbb0244e800 nid=0x5a03 runnable
>>> [0x00000001820cf000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>> at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
>>>
>>> at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)
>>>
>>> at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
>>>
>>> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>>>
>>> - locked <0x000000011a421778> (a sun.nio.ch.Util$2)
>>>
>>> - locked <0x000000011a421768> (a java.util.Collections$UnmodifiableSet)
>>>
>>> - locked <0x000000011a421638> (a sun.nio.ch.KQueueSelectorImpl)
>>>
>>> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>>>
>>> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:603)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:528)
>>>
>>> at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:620)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:540)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "qtp890160784-16-selector-ServerConnectorManager@25e6c171/0" #16
>>> prio=4 os_prio=31 tid=0x00007fbb0239a800 nid=0x5807 runnable
>>> [0x0000000181fcc000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>> at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
>>>
>>> at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)
>>>
>>> at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
>>>
>>> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>>>
>>> - locked <0x000000011a421a68> (a sun.nio.ch.Util$2)
>>>
>>> - locked <0x000000011a421a58> (a java.util.Collections$UnmodifiableSet)
>>>
>>> - locked <0x000000011a421928> (a sun.nio.ch.KQueueSelectorImpl)
>>>
>>> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>>>
>>> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:603)
>>>
>>> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:528)
>>>
>>> at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:620)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:540)
>>>
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "Attach Listener" #14 daemon prio=9 os_prio=31 tid=0x00007fbb01e3f800
>>> nid=0x5603 waiting on condition [0x0000000000000000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "Service Thread" #12 daemon prio=9 os_prio=31 tid=0x00007fbb01858800
>>> nid=0x5203 runnable [0x0000000000000000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "C1 CompilerThread3" #11 daemon prio=9 os_prio=31
>>> tid=0x00007fbb02005000 nid=0x5003 waiting on condition
>>> [0x0000000000000000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "C2 CompilerThread2" #10 daemon prio=9 os_prio=31
>>> tid=0x00007fbb02004800 nid=0x4e03 waiting on condition
>>> [0x0000000000000000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "C2 CompilerThread1" #9 daemon prio=9 os_prio=31
>>> tid=0x00007fbb02003800 nid=0x3f07 waiting on condition
>>> [0x0000000000000000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "C2 CompilerThread0" #8 daemon prio=9 os_prio=31
>>> tid=0x00007fbb02001000 nid=0x3b07 waiting on condition
>>> [0x0000000000000000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "JDWP Command Reader" #7 daemon prio=10 os_prio=31
>>> tid=0x00007fbb03048000 nid=0x3707 runnable [0x0000000000000000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "JDWP Event Helper Thread" #6 daemon prio=10 os_prio=31
>>> tid=0x00007fbb03047800 nid=0x4b03 runnable [0x0000000000000000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "JDWP Transport Listener: dt_socket" #5 daemon prio=10 os_prio=31
>>> tid=0x00007fbb0303c000 nid=0x4903 runnable [0x0000000000000000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "Signal Dispatcher" #4 daemon prio=9 os_prio=31 tid=0x00007fbb0303a800
>>> nid=0x3c17 runnable [0x0000000000000000]
>>>
>>>    java.lang.Thread.State: RUNNABLE
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "Finalizer" #3 daemon prio=8 os_prio=31 tid=0x00007fbb02850000
>>> nid=0x3503 in Object.wait() [0x000000017dc92000]
>>>
>>>    java.lang.Thread.State: WAITING (on object monitor)
>>>
>>> at java.lang.Object.wait(Native Method)
>>>
>>> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:142)
>>>
>>> - locked <0x0000000119b45460> (a java.lang.ref.ReferenceQueue$Lock)
>>>
>>> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:158)
>>>
>>> at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "Reference Handler" #2 daemon prio=10 os_prio=31
>>> tid=0x00007fbb03014800 nid=0x3303 in Object.wait()
>>> [0x000000017db8f000]
>>>
>>>    java.lang.Thread.State: WAITING (on object monitor)
>>>
>>> at java.lang.Object.wait(Native Method)
>>>
>>> at java.lang.Object.wait(Object.java:502)
>>>
>>> at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:157)
>>>
>>> - locked <0x0000000119b44340> (a java.lang.ref.Reference$Lock)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "main" #1 prio=5 os_prio=31 tid=0x00007fbb03000000 nid=0x1303 in
>>> Object.wait() [0x00000001081d7000]
>>>
>>>    java.lang.Thread.State: WAITING (on object monitor)
>>>
>>> at java.lang.Object.wait(Native Method)
>>>
>>> at java.lang.Object.wait(Object.java:502)
>>>
>>> at org.eclipse.jetty.util.thread.QueuedThreadPool.join(QueuedThreadPool.java:373)
>>>
>>> - locked <0x0000000119b47380> (a java.lang.Object)
>>>
>>> at org.eclipse.jetty.server.Server.join(Server.java:572)
>>>
>>> at org.eclipse.jetty.maven.plugin.AbstractJettyMojo.startJetty(AbstractJettyMojo.java:535)
>>>
>>> at org.eclipse.jetty.maven.plugin.AbstractJettyMojo.execute(AbstractJettyMojo.java:359)
>>>
>>> at org.eclipse.jetty.maven.plugin.JettyRunMojo.execute(JettyRunMojo.java:167)
>>>
>>> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
>>>
>>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>>>
>>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>>>
>>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>>>
>>> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>>>
>>> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>>>
>>> at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>>>
>>> at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
>>>
>>> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
>>>
>>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
>>>
>>> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
>>>
>>> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
>>>
>>> at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
>>>
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>>
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>
>>> at java.lang.reflect.Method.invoke(Method.java:483)
>>>
>>> at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>>>
>>> at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>>>
>>> at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>>>
>>> at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>>>
>>>
>>>    Locked ownable synchronizers:
>>>
>>> - None
>>>
>>>
>>> "VM Thread" os_prio=31 tid=0x00007fbb0300f800 nid=0x3103 runnable
>>>
>>>
>>> "GC task thread#0 (ParallelGC)" os_prio=31 tid=0x00007fbb0300d000
>>> nid=0x2103 runnable
>>>
>>>
>>> "GC task thread#1 (ParallelGC)" os_prio=31 tid=0x00007fbb0300e000
>>> nid=0x2303 runnable
>>>
>>>
>>> "GC task thread#2 (ParallelGC)" os_prio=31 tid=0x00007fbb0300e800
>>> nid=0x2503 runnable
>>>
>>>
>>> "GC task thread#3 (ParallelGC)" os_prio=31 tid=0x00007fbb0300f000
>>> nid=0x2703 runnable
>>>
>>>
>>> "GC task thread#4 (ParallelGC)" os_prio=31 tid=0x00007fbb02801000
>>> nid=0x2903 runnable
>>>
>>>
>>> "GC task thread#5 (ParallelGC)" os_prio=31 tid=0x00007fbb02802000
>>> nid=0x2b03 runnable
>>>
>>>
>>> "GC task thread#6 (ParallelGC)" os_prio=31 tid=0x00007fbb02802800
>>> nid=0x2d03 runnable
>>>
>>>
>>> "GC task thread#7 (ParallelGC)" os_prio=31 tid=0x00007fbb02803000
>>> nid=0x2f03 runnable
>>>
>>>
>>> "VM Periodic Task Thread" os_prio=31 tid=0x00007fbb01828800 nid=0x5403
>>> waiting on condition
>>>
>>>
>>> JNI global references: 19651
References:
- [jetty-dev] 500% CPU utilization
  - From: Eirik Bjørsnøs
- Re: [jetty-dev] 500% CPU utilization
  - From: Eirik Bjørsnøs
- Re: [jetty-dev] 500% CPU utilization
  - From: Eirik Bjørsnøs
Prev by Date: Re: [jetty-dev] 500% CPU utilization
Next by Date: [jetty-dev] Bug in jetty 9.x
Previous by thread: Re: [jetty-dev] 500% CPU utilization
Next by thread: [jetty-dev] Bug in jetty 9.x
Index(es):
- Date
- Thread
Breadcrumbs
