java - JVM Garbage Collector suddenly consumes 100% CPU after running for several hours -


i've got strange problem in clojure app.

i'm using http-kit write websocket based chat application.

client's rendered using react single page app, first thing when navigate home page (after signing in) create websocket receive things real-time updates , chat messages. can see site here: www.csgoteamfinder.com

the problem have after indeterminate amount of time, might 30 minutes after restart or 48 hours, jvm running chat server starts consuming cpu. when inspect nr (new relic) can see time being used garbage collector -- @ stage have no idea it's doing.

i've take number of screenshots can see effect.

new relic showing memory usage on 7 day period

more new relic statistics

you can see number of spikes, spikes correspond large increases in cpu usage because of garbage collector. free cpu have restart jvm, have been relying on receiving cpu alert nr in slack account make sure jump on these quickly....but need root of problem.

my initial thought was possibly holding onto socket reference when client closed @ end, not case. i've been looking @ socket count periodically , stable.

any ideas of start?

kind regards, jason.

it's hard imagine have caused such issue. @ first taking heap dump @ time of crash. can enabled -xx:+heapdumponoutofmemoryerror -xx:heapdumppath=<path_to_your_heap_dump> jvm args. as general practice don't increase heap size more size of physical memory available on server machine. in rare cases jvm unable dump heap space because process doomed; in such cases can use gcore(if you're on linux, not sure windows).

once grab heap dump, analyse mat, have debugged such applications , worked pin down memory related issues. mat allows dissect heap dump in depth you're sure find cause of memory issue if not case have allocated small heap space.


Comments

Post a Comment

Popular posts from this blog

javascript - jQuery: Add class depending on URL in the best way -

i have html progress meter: <div class="col-md-3" style="margin-left: -20px;"> <div class="progress-pos active" id="progess-1"> <div class="progress-pos-inner"> login </div> </div> </div> <div class="col-md-3 progress-pos-container"> <div class="progress-pos" id="progess-2"> <div class="progress-pos-inner"> scan items </div> </div> </div> <div class="col-md-3 progress-pos-container"> <div class="progress-pos" id="progess-3"> <div class="progress-pos-inner"> confirm address </div> </div> </div> <div class="col-md-3 progress-pos-container"> <div class="progress-pos" id="progess-4"> <div class="progress-pos-in
Read more

caching - How to check if a url path exists in the service worker cache -

i need check if particular url path exists in service worker cache. example, suppose url is: /myserviceworker/service?a=110&b=70 this url exists in cache, there many of them different values of , b. now, suppose want refresh of these urls, how can that? i want know how access key values service worker cache. if know key, plan follows: var url = new url(key); if(url.pathname === "\/myserviceworker/service") refetch key but not sure how cache key , in format is. mean, string or url? cache api has match() method returns promise resolving in response object if match or undefined if no match exists. second parameter object can specify ignoresearch not take account url parameters. the ignoresearch option supported firefox ( chrome status here ). in other hand, retrieve cache entries, can use keys() method.
Read more

Redirect to a HTTPS version using .htaccess -

i need modify .htaccess file redirect urls https version without "www". http://example.com --> https://example.com http://www.example.com --> https://example.com https://www.example.com --> https://example.com this how .htaccess file looks like: rewriteengine on rewritecond %{request_filename} !-d rewritecond %{request_filename} !-f rewriterule ^(.*)$ redirect.php?id=$1&page=$2 [qsa,l] what modifications need make .htaccess in order forward https without "www"? it depends on doing current code. looks file called redirect trying display php page seo friendly url. think might confusing people. anyway, need , force https without www, need 1 more rule above. also second rule needs two capture groups in rewriterule test string because wanting 2 different values using $1 , $2 references. rewriteengine on #rediect www non www and/or http https --- combinations. rewritecond %{http_host} !^example\.com [nc,or] rewritecond %{https} !^
Read more