sparkmem

Where does your executor memory go?

Enter the executor settings you use. You get what the cluster is asked for per executor, how the heap splits into reserved, execution, storage and user memory, how much sits outside the unified pool, and the totals across the cluster. The rules are the documented ones for Spark 3.

For a worked example of memory at scale, see Where 480 GB goes.

Runs entirely in your browser. Nothing you type is uploaded, logged or analysed, and the page's security policy stops it making network requests at all. How that works