jvm-code-cache
Introduction to JVM Code Cache
1. Introduction
2. What is the Code Cache?
Simply put, JVM Code Cache is an area where JVM stores its bytecode compiled into native code. We call each block of the executable native code a nmethod. The nmethod might be a complete or inlined Java method.
The just-in-time (JIT) compiler is the biggest consumer of the code cache area. That’s why some developers call this memory a JIT code cache.
3. Code Cache Tuning
The code cache has a fixed size. Once it is full, the JVM won’t compile any additional code as the JIT compiler is now off. Furthermore, we will receive the “CodeCache is full… The compiler has been disabled” warning message. As a result, we’ll end up with degraded performance in our application. To avoid this, we can tune the code cache with the following size options:
-
InitialCodeCacheSize – the initial code cache size, 160K default
-
ReservedCodeCacheSize – the default maximum size is 48MB
-
CodeCacheExpansionSize – the expansion size of the code cache, 32KB or 64KB
Increasing the ReservedCodeCacheSize can be a solution, but this is typically only a temporary workaround.
Fortunately, the JVM offers a UseCodeCacheFlushing option to control the flushing of the code cache area. Its default value is false. When we enable it, it frees the occupied area when the following conditions are met:
-
the code cache is full; this area is flushed if its size exceeds a certain threshold
-
the certain interval is passed since the last cleanup
-
the precompiled code isn’t hot enough. For each compiled method the JVM keeps track with a special hotness counter. If the value of this counter is less than a computed threshold, the JVM frees this piece of precompiled code
4. Code Cache Usage
To get information on code cache usage, we can specify the –XX:+PrintCodeCache JVM option. After running our application, we’ll see a similar output:
CodeCache: size=32768Kb used=542Kb max_used=542Kb free=32226KbLet’s see what each of these values mean:
-
size in the output shows the maximum size of the memory, which is identical to ReservedCodeCacheSize
-
used is the actual size of the memory that currently is in use
-
max_used is the maximum size that has been in use
-
free is the remaining memory which is not occupied yet
The PrintCodeCache option is very useful, as we can:
-
see when the flushing happens
-
determine if we reached a critical memory usage point
