Remote Call Rate
Test the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.
Started
Mon, 23 Mar 2026 19:50:32 UTC
Peer count
250
Peer count at end
2734
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.3
Wind Tunnel version
0.6.0
Run ID
remote_call_rate_23456025822
Dispatch timing
The time between sending a remote call and the remote handler being invoked.
Mean
mean
-4.103613s
(SD =
35.747293s)
Max
Highest per-partition mean latency
max mean
75.703459s
Min
Lowest per-partition mean latency
min mean
-28.130087s
Round-trip timing
The total elapsed time to get a response to the client.
Mean
mean
0.592848s
(SD =
0.966881s)
Max
Highest per-partition mean latency
max mean
11.22285s
Min
Lowest per-partition mean latency
min mean
0.017806s
Host Metrics
User CPU usage
CPU usage by user space
5.67%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 866 B/s
<
mean 294.61 KiB/s
(SD = 431.94 KiB/s)
<
p951015.31 KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 0 B/s
<
mean 22.96 KiB/s
(SD = 36.49 KiB/s)
<
p9580.17 KiB/s
Total bytes received
Total bytes received on primary network interface
count
32.53 GiB
mean
5.23 MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.53 GiB
mean
416.70 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 1856.49 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (83.0% swap used)
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.7%
<
mean
8.03%
(SD =
16.13%)
<
p95
48.87%
System
2.36%
CPU percentiles
CPU usage percentiles
p50
3.10%
p95
48.87%
p99
88.97%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
141 hosts
mean time
0.04s
Memory used percentage
Percentage of memory used
p5
5.38%
<
mean
8.93%
(SD =
6.38%)
<
p95
16.37%
Memory available percentage
Percentage of available memory
p5
83.63%
<
mean
91.07%
(SD =
6.38%)
<
p95
94.62%
Max host memory used
Maximum memory usage percentage across all hosts
max
75.45%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
83.03%
Memory growth rate
Rate of memory growth over time
growth
1856.49MB/s
Disk read throughput
Disk read throughput in MB/s
0.37MB/s
Disk write throughput
Disk write throughput in MB/s
65.27MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/215hosts
Mount Point
/efi-boot
0/6hosts
Mount Point
/etc/hostname
0/24hosts
Mount Point
/etc/hosts
0/24hosts
Mount Point
/etc/resolv.conf
0/24hosts
Mount Point
/nix/store
0/9hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.24
5 min
0.14
15 min
0.06
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
1.4914%
(SD =
5.9566%)
<
p95
4.86%
60 second average
1.3238%
300 second average
0.7300%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.0003%
(SD =
0.0199%)
≤
p95
0%
60 second average
0.0036%
300 second average
0.0037%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.0002%
(SD =
0.0147%)
≤
p95
0%
60 second average
0.0027%
300 second average
0.0028%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.3689%
(SD =
1.289%)
<
p95
2.12%
60 second average
0.3459%
300 second average
0.2304%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.3162%
(SD =
1.1503%)
<
p95
1.82%
60 second average
0.2970%
300 second average
0.2019%
Holochain process CPU usage
CPU usage by Holochain process
p5
0%
<
mean
7.2%
(SD =
15.96%)
<
p95
46.27%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 190.35 KiB
<
mean 223.71 KiB
(SD = 34.30 KiB)
<
p95251.78 KiB
Holochain process threads
Number of threads in Holochain process
p5
6 threads
<
mean
21.69 threads
(SD =
16.43 threads)
<
p95
49 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
32 file descriptors
<
mean
67.02 file descriptors
(SD =
24.02 file descriptors)
<
p95
96 file descriptors
Remote Signals
This scenario tests the throughput of remote_signals operations.
Started
Mon, 23 Mar 2026 20:03:53 UTC
Peer count
250
Peer count at end
1993
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.3
Wind Tunnel version
0.6.0
Run ID
remote_signals_23456025822
Round trip time
The time from origin signal dispatch to origin receive of the remote side's response signal.
mean
0.35044s
(SD =
1.453973s)
p50
0.188196s
p95
0.948527s
p99
3.747506s
Timeouts
The number of timeouts waiting for the remote side's response signal (default timeout is 20 seconds).
map[count:269 mean_rate_per_second:19544.59 measurement_duration:map[nanos:741083946 secs:1057] p5_rate_per_second:0 p95_rate_per_second:29670.74 peak_rate_per_second:2.857142857e+07 rate_trend:map[trend:[0 0 3.04 1.85 2.92 3.39 9.75 1120.62 30.21 222.46 62.27 52.57 1740.07 93.15 67.38 88.17 114.66 222.71 524.23 277.14 99.4 726.71 176.37 117.94 524.99 6689.29 107.28 150.79 360.4 1279.88 747.82 928.35 567.21 421.19 83.61 36.33 27.99 709.39 2787.93 3454.09 5827.12 6712.87 4706.68 5152.85 9603.21 6922.78 2958.21 8987.13 34128.73 5155.62 5432.8 31177.74 19596.21 20641.01 14285.51 12552.4 32597.73 19079.32 86281.25 16799.13 40854.71 224643.12 98571.37 23380.93 20172.43 22313.88 8496.33 29331.47 61549.06 10159.54 586.5 57.48 1323.8 210.33 559.4 373.17 509.93 1338.54 1252.4 2548.71 1853.37 1086.94 839.43 222.87 2005.06 860.19 1 0.99 0.99 0.99 1 1 0.99 0.99 0.99 0.99 0.99 0.99 0.99 0.99 0.99 0.99 0.99 0.99 0.99] window_duration:10s] std_rate_per_second:421130.86]
Host Metrics
User CPU usage
CPU usage by user space
5.45%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 481 B/s
<
mean 296.71 KiB/s
(SD = 459.22 KiB/s)
<
p95967.48 KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 0 B/s
<
mean 23.86 KiB/s
(SD = 59.04 KiB/s)
<
p9575.61 KiB/s
Total bytes received
Total bytes received on primary network interface
count
39.51 GiB
mean
7.04 MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
3.14 GiB
mean
573.35 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 91.0%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 903.51 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (83.0% swap used)
System overload anomaly
System overload anomaly was detected
Detected
Warning 0% of hosts overloaded (load5/ncpus > 1.0)
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.55%
<
mean
7.79%
(SD =
15.97%)
<
p95
41.37%
System
2.34%
CPU percentiles
CPU usage percentiles
p50
3.02%
p95
41.37%
p99
91.02%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
129 hosts
mean time
0.04s
Memory used percentage
Percentage of memory used
p5
5.49%
<
mean
9.34%
(SD =
6.41%)
<
p95
15.63%
Memory available percentage
Percentage of available memory
p5
84.37%
<
mean
90.66%
(SD =
6.41%)
<
p95
94.51%
Max host memory used
Maximum memory usage percentage across all hosts
max
75.66%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
83.02%
Memory growth rate
Rate of memory growth over time
growth
903.51MB/s
Disk read throughput
Disk read throughput in MB/s
0.18MB/s
Disk write throughput
Disk write throughput in MB/s
61.33MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/208hosts
Mount Point
/efi-boot
0/7hosts
Mount Point
/etc/hostname
0/22hosts
Mount Point
/etc/hosts
0/22hosts
Mount Point
/etc/resolv.conf
0/22hosts
Mount Point
/nix/store
0/9hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.22
5 min
0.16
15 min
0.10
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.43%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
1.6417%
(SD =
6.3749%)
<
p95
5.75%
60 second average
1.4211%
300 second average
1.0153%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0001%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0001%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.2944%
(SD =
1.162%)
<
p95
1.71%
60 second average
0.2677%
300 second average
0.2119%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.2371%
(SD =
1.0309%)
<
p95
1.33%
60 second average
0.2179%
300 second average
0.1736%
Holochain process CPU usage
CPU usage by Holochain process
p5
0%
<
mean
6.14%
(SD =
15.14%)
<
p95
32.22%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 164.11 KiB
<
mean 222.33 KiB
(SD = 41.74 KiB)
<
p95252.78 KiB
Holochain process threads
Number of threads in Holochain process
p5
5 threads
<
mean
16.44 threads
(SD =
13.69 threads)
<
p95
39 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
32 file descriptors
<
mean
58.47 file descriptors
(SD =
25.32 file descriptors)
<
p95
94 file descriptors