https://pinboard.in/u:jm/public/ recent bookmarks from jm 2025-03-21T10:30:41+00:00 https://byroot.github.io/ruby/performance/2025/03/04/the-pitchfork-story.html jm ruby performance optimisation optimization heap memory fork forking http services servers monolith rails gc https://pinboard.in/ https://pinboard.in/u:jm/b:2839524a8511/ 2025-01-27T10:43:30+00:00 https://github.com/cloudwego/goref jm go heap memory gc memory-leaks https://pinboard.in/ https://pinboard.in/u:jm/b:379d693d5af4/ 2025-01-23T14:45:35+00:00 https://www.infoq.com/presentations/optimizing-java-app-kubernetes/ jm kubernetes java eks resources ops scaling scalability gc optimization jvm https://pinboard.in/ https://pinboard.in/u:jm/b:2c9522ab8d41/ 2020-12-04T10:57:55+00:00 https://gceasy.io/ jm java gc tuning performance jvm logs ops https://pinboard.in/ https://pinboard.in/u:jm/b:d3d8327d2376/ 2020-03-11T13:21:50+00:00 https://medium.com/thron-tech/lessons-learned-about-monitoring-the-jvm-in-the-era-of-containers-47e7fe0b77dc jm jvm g1 g1gc gc tuning metrics ops https://pinboard.in/ https://pinboard.in/u:jm/b:44d5b27b29bf/ 2019-03-22T15:03:45+00:00 https://dzone.com/articles/troubleshooting-problems-with-native-off-heap-memo jm java off-heap buffers memory memory-leaks gc jdk ops https://pinboard.in/ https://pinboard.in/u:jm/b:cc36a7f2cf9b/ 2017-09-11T15:31:40+00:00 https://www.cockroachlabs.com/blog/how-to-optimize-garbage-collection-in-go/ jmIn this post, we’ll share a few powerful optimizations that mitigate many of the performance problems common to Go’s garbage collection (we will cover “fun with deadlocks” in a follow-up). In particular, we’ll share how embedding structs, using sync.Pool, and reusing backing arrays can minimize memory allocations and reduce garbage collection overhead. ]]> garbage performance gc golang go coding https://pinboard.in/ https://pinboard.in/u:jm/b:7367dc904501/ 2015-09-08T10:43:41+00:00 http://chrisvest.github.io/stormpot/ jman object pooling library for Java. Use it to recycle objects that are expensive to create. The library will take care of creating and destroying your objects in the background. Stormpot is very mature, is used in production, and has done over a trillion claim-release cycles in testing. It is faster and scales better than any competing pool. Apache-licensed, and extremely fast: https://medium.com/@chrisvest/released-stormpot-2-4-eeab4aec86d0]]> java stormpot object-pooling object-pools pools allocation gc open-source apache performance https://pinboard.in/ https://pinboard.in/u:jm/b:ef38e7baa4ad/ 2015-06-06T07:02:50+00:00 https://databricks.com/blog/2015/05/28/tuning-java-garbage-collection-for-spark-applications.html jm g1gc gc java jvm performance spark ops tuning https://pinboard.in/ https://pinboard.in/u:jm/b:431050bae8c9/ 2015-05-09T08:19:41+00:00 http://www.slideshare.net/MonicaBeckwith/garbage-first-garbage-collector-g1-gc-migration-to-expectations-and-advanced-tuning jm gc g1gc jvm java tuning performance ops migration https://pinboard.in/ https://pinboard.in/u:jm/b:1dbd33f78572/ 2015-05-06T16:34:59+00:00 https://timharris.uk/papers/2015-hotos.pdf jm blade via:adriancolyer papers gc distsys algorithms distributed java jvm latency spark cassandra https://pinboard.in/ https://pinboard.in/u:jm/b:bf80614a2fb9/ 2015-04-29T15:42:34+00:00 https://issues.apache.org/jira/browse/CASSANDRA-7486 jm cassandra tuning ops g1gc cms gc java jvm production performance memory https://pinboard.in/ https://pinboard.in/u:jm/b:0b4b3d1abe38/ 2015-04-17T09:46:59+00:00 http://arxiv.org/pdf/1504.02578.pdf jm gc latency tail-latencies papers blade go java scheduling clustering load-balancing low-latency performance https://pinboard.in/ https://pinboard.in/u:jm/b:604440c5b5eb/ 2015-04-11T20:21:41+00:00 http://engineering.linkedin.com/java/optimizing-java-cms-garbage-collections-its-difficulties-and-using-jtune-solution jm java jvm tuning gc cms linkedin performance ops https://pinboard.in/ https://pinboard.in/u:jm/b:717dfe95f072/ 2015-03-26T22:16:21+00:00 http://www.evanjones.ca/jvm-mmap-pause.html jmThe JVM by default exports statistics by mmap-ing a file in /tmp (hsperfdata). On Linux, modifying a mmap-ed file can block until disk I/O completes, which can be hundreds of milliseconds. Since the JVM modifies these statistics during garbage collection and safepoints, this causes pauses that are hundreds of milliseconds long. To reduce worst-case pause latencies, add the -XX:+PerfDisableSharedMem JVM flag to disable this feature. This will break tools that read this file, like jstat. ]]> bugs gc java jvm disk mmap latency ops jstat https://pinboard.in/ https://pinboard.in/u:jm/b:a8b7f0defa11/ 2015-02-26T15:49:43+00:00 http://www.jclarity.com/2015/02/24/why-we-built-illuminate-where-apm-is-going-next/ jmUsers download and install an Illuminate Daemon using a simple installer which starts up a small stand alone Java process. The Daemon sits quietly unless it is asked to start gathering SLA data and/or to trigger a diagnosis. Users can set SLA’s via the dashboard and can opt to collect latency measurements of their transactions manually (using our library) or by asking Illuminate to automatically instrument their code (Servlet and JDBC based transactions are currently supported). SLA latency data for transactions is collected on a short cycle. When the moving average of latency measurements goes above the SLA value (e.g. 150ms), a diagnosis is triggered. The diagnosis is very quick, gathering key data from O/S, JVM(s), virtualisation and other areas of the system. The data is then run through the machine learned algorithm which will quickly narrow down the possible causes and gather a little extra data if needed. Once Illuminate has determined the root cause of the performance problem, the diagnosis report is sent back to the dashboard and an alert is sent to the user. That alert contains a link to the result of the diagnosis which the user can share with colleagues. Illuminate has all sorts of backoff strategies to ensure that users don’t get too many alerts of the same type in rapid succession! ]]> illuminate jclarity java jvm scala latency gc tuning performance https://pinboard.in/ https://pinboard.in/u:jm/b:d8f4dcc75538/ 2014-11-30T22:34:29+00:00 http://arthurtw.github.io/2014/11/30/rust-borrow-lifetimes.html jmRust achieves memory safety without GC by using a sophiscated borrow system. For any resource (stack memory, heap memory, file handle and so on), there is exactly one owner which takes care of its resource deallocation, if needed. You may create new bindings to refer to the resource using & or &mut, which is called a borrow or mutable borrow. The compiler ensures all owners and borrowers behave correctly. ]]> languages rust gc borrow lifecycle stack heap allocation https://pinboard.in/ https://pinboard.in/u:jm/b:cf250eeb69f7/ 2014-09-17T22:39:46+00:00 http://noahlz.roughdraft.io/865cc30e0fd93ad48369-troubleshooting-production-jvms-with-jcmd jm jvm jcmd debugging ops java gc heap troubleshooting https://pinboard.in/ https://pinboard.in/u:jm/b:cc90aa62a26d/ 2014-09-17T14:29:55+00:00 http://sourceforge.net/projects/ccfreaks/files/papers/LeftRight/leftright-extended.pdf jm left-right concurrency multithreading wait-free blocking realtime gc latency reader-writer locking synchronization java https://pinboard.in/ https://pinboard.in/u:jm/b:71e20ba2b8b1/ 2014-09-04T08:37:12+00:00 http://spin.atomicobject.com/2014/09/03/visualizing-garbage-collection-algorithms/ jm algorithms gc memory visualization garbage-collection dataviz refcounting mark-and-sweep https://pinboard.in/ https://pinboard.in/u:jm/b:b610cc881a74/ 2014-08-20T13:07:51+00:00 http://vanillajava.blogspot.it/2014/08/try-optimising-memory-consumption-first.html jm yourkit memory java jvm allocation gc bottlenecks performance https://pinboard.in/ https://pinboard.in/u:jm/b:ba674f43806e/ 2014-05-16T08:56:30+00:00 http://boundary.com/blog/2014/05/15/dynamic-tuple-performance-on-the-jvm/ jmgenerates heterogeneous collections of primitive values and ensures as best it can that they will be laid out adjacently in memory. The individual values in the tuple can either be accessed from a statically bound interface, via an indexed accessor, or via reflective or other dynamic invocation techniques. FastTuple is designed to deal with a large number of tuples therefore it will also attempt to pool tuples such that they do not add significantly to the GC load of a system. FastTuple is also capable of allocating the tuple value storage entirely off-heap, using Java’s direct memory capabilities. ]]> jvm java gc off-heap storage boundary memory https://pinboard.in/ https://pinboard.in/u:jm/b:bac458affd01/ 2014-04-08T21:54:13+00:00 http://engineering.linkedin.com/garbage-collection/garbage-collection-optimization-high-throughput-and-low-latency-java-applications jm performance optimization linkedin java jvm gc tuning https://pinboard.in/ https://pinboard.in/u:jm/b:77cabe371f7c/ 2014-03-31T13:34:36+00:00 http://blog.phusion.nl/2014/01/31/phusion-passenger-now-supports-the-new-ruby-2-1-out-of-band-gc/ jm ruby gc ops performance phusion passenger rails unicorn out-of-band web-services https://pinboard.in/ https://pinboard.in/u:jm/b:8ec55f6f8a2d/ 2014-03-29T08:15:41+00:00 http://www.omniref.com/blog/blog/2014/03/27/ruby-garbage-collection-still-not-ready-for-production/ jm ruby gc memory https://pinboard.in/ https://pinboard.in/u:jm/b:93972f7594a7/ 2014-01-24T10:14:24+00:00 http://tech.shift.com/post/74311817513/cassandra-tuning-the-jvm-for-read-heavy-workloads jmThe cluster we tuned is hosted on AWS and is comprised of 6 hi1.4xlarge EC2 instances, with 2 1TB SSDs raided together in a raid 0 configuration. The cluster’s dataset is growing steadily. At the time of this writing, our dataset is 341GB, up from less than 200GB a few months ago, and is growing by 2-3GB per day. The workload on this cluster is very read heavy, with quorum reads making up 99% of all operations. Some careful GC tuning here. Probably not applicable to anyone else, but good approach in general.]]> java performance jvm scaling gc tuning cassandra ops https://pinboard.in/ https://pinboard.in/u:jm/b:bc4cff6803b7/ 2013-11-10T00:10:17+00:00 http://blog.ragozin.info/2013/11/hotspot-jvm-garbage-collection-options.html jm jvm hotspot java tuning ops gc https://pinboard.in/ https://pinboard.in/u:jm/b:a6b132013693/ 2013-10-08T11:15:46+00:00 http://java-is-the-new-c.blogspot.de/2013/07/what-drives-full-gc-duration-its.html jmFull GC duration depends on the number of objects allocated and the locality of their references. It does not depend that much on actual heap size. Reference locality has a surprisingly high effect.]]> java jvm data gc tuning performance cms g1 https://pinboard.in/ https://pinboard.in/u:jm/b:71efc8abad7c/ 2013-09-18T21:34:06+00:00 http://www.infoq.com/articles/tuning-tips-G1-GC jmg1gc gc java jvm tuning ops optimization https://pinboard.in/ https://pinboard.in/u:jm/b:6b12d8d218aa/ 2013-09-04T14:26:32+00:00 http://www.slideshare.net/amywtang/wbdb2012-voldemortssd jm With SSD, we find that garbage collection will become a very significant bottleneck, especially for systems which have little control over the storage layer and rely on Java memory management. Big heapsizes make the cost of garbage collection expensive, especially the single threaded CMS Initial mark. We believe that data systems must revisit their caching strategies with SSDs. In this regard, SSD has provided an efficient solution for handling fragmentation and moving towards predictable multitenancy.]]> voldemort storage ssd disk linkedin big-data jvm tuning ops gc https://pinboard.in/ https://pinboard.in/u:jm/b:086f50102a3b/ 2013-07-25T11:43:37+00:00 http://www.jclarity.com/products/censum/ jm[JVM] GC is a difficult, specialised area that can be very frustrating for busy developers or devops folks to deal with. The JVM has a number of Garbage Collectors and a bewildering array of switches that can alter the behaviour of each collector. Censum does all of the parsing, number crunching and statistical analysis for you, so you don't have to go and get that PhD in Computer Science in order to solve your GC performance problem. Censum gives you straight answers as opposed to a ton of raw data. can eat any GC log you care to throw at it. is easy to install and use. Commercial software, UKP 495 per license.]]> censum gc tuning ops java jvm commercial https://pinboard.in/ https://pinboard.in/u:jm/b:ed538dc1a0a6/ 2013-07-25T11:27:30+00:00 http://java-is-the-new-c.blogspot.ie/2013/07/tuning-and-benchmarking-java-7s-garbage.html jm java gc tuning jvm cms g1 ops https://pinboard.in/ https://pinboard.in/u:jm/b:6ef833ae0fa3/ 2013-07-16T22:22:21+00:00 http://mechanical-sympathy.blogspot.ca/2013/07/java-garbage-collection-distilled.html jm jvm java gc garbage-collection tuning memory performance martin-thompson https://pinboard.in/ https://pinboard.in/u:jm/b:f32e30988004/ 2013-06-19T10:07:19+00:00 http://www.infoq.com/articles/Java_Garbage_Collection_Distilled jmSerial, Parallel, Concurrent, CMS, G1, Young Gen, New Gen, Old Gen, Perm Gen, Eden, Tenured, Survivor Spaces, Safepoints, and the hundreds of JVM start-up flags. Does this all baffle you when trying to tune the garbage collector while trying to get the required throughput and latency from your Java application? If it does then don’t worry, you are not alone. Documentation describing garbage collection feels like man pages for an aircraft. Every knob and dial is detailed and explained but nowhere can you find a guide on how to fly. This article will attempt to explain the tradeoffs when choosing and tuning garbage collection algorithms for a particular workload. ]]> gc java garbage-collection coding cms g1 jvm optimization https://pinboard.in/ https://pinboard.in/u:jm/b:f59114d2c748/ 2013-06-17T10:37:00+00:00 http://www.slideshare.net/r39132/q-con-ny2013modernwebsitescalabilityfinal-22989785 jm gc-scout gc java scaling scalability linkedin qcon async threadpools rest slas timeouts networking distcomp netty tcp udp failover fault-tolerance packet-loss https://pinboard.in/ https://pinboard.in/u:jm/b:8766348f43f5/ 2013-05-02T11:41:48+00:00 https://github.com/blog/1489-hey-judy-don-t-make-it-bad jm ruby github gc judy-arrays linguist hashes data-structures https://pinboard.in/ https://pinboard.in/u:jm/b:8a17f7e093d8/ 2012-12-06T22:14:32+00:00 https://github.com/cowtowncoder/low-gc-membuffers jm gc java jvm bytebuffer https://pinboard.in/ https://pinboard.in/u:jm/b:3ff7ac76f33b/ 2012-12-01T18:51:22+00:00 http://www.slideshare.net/aszegedi/everything-i-ever-learned-about-jvm-performance-tuning-twitter jm tuning jvm java gc cms presentations slides twitter https://pinboard.in/ https://pinboard.in/u:jm/b:80c49db84474/ 2012-12-01T18:36:58+00:00 http://static.usenix.org/events/vee05/full_papers/p46-click.pdf jm via:b3n azul gc jvm java usenix papers https://pinboard.in/ https://pinboard.in/u:jm/b:1a4308ccbf52/ 2012-09-01T08:09:44+00:00 http://blog.ragozin.info/2011/09/hotspot-jvm-garbage-collection-options.html jm hotspot jvm coding gc java performance https://pinboard.in/ https://pinboard.in/u:jm/b:b55a15b22be0/ 2012-04-05T09:06:56+00:00 http://blog.ragozin.info/2012/03/secret-hotspot-option-improving-gc.html jm java jvm gc performance hotspot undocumented https://pinboard.in/ https://pinboard.in/u:jm/b:2fa6006fc991/ 2012-02-26T22:58:24+00:00 https://github.com/twitter/jvmgcprof jm gc java performance twitter jvm tools https://pinboard.in/ https://pinboard.in/u:jm/b:5e922d601dca/ 2011-12-04T23:00:35+00:00 http://www.slideshare.net/boundary_slides/garbage-garbage-everywhere jm gc java jvm event-streams event-processing tuning slides presentations scott-andreas performance https://pinboard.in/ https://pinboard.in/u:jm/b:750e291a35af/ 2011-10-22T21:20:06+00:00 http://www.cloudera.com/blog/2011/03/avoiding-full-gcs-in-hbase-with-memstore-local-allocation-buffers-part-3/ jm memory allocation java gc jvm hbase memstore via:dehora slab-allocator https://pinboard.in/ https://pinboard.in/u:jm/b:76e4aad99f52/ 2009-09-01T17:06:24+00:00 http://blogs.azulsystems.com/cliff/2007/08/why-weakhashmap.html jm softreferences weakreferences weak references gc java jvm caching hash memory collections vm weakhashmap via:spyced https://pinboard.in/u:jm/b:30d2ba377aa4/