Remote Call Rate

Test the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

Started
Wed, 18 Mar 2026 00:24:44 UTC
Peer count
50
Peer count at end
50
Behaviours
  • default (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
remote_call_rate_23222252791
Dispatch timing
The time between sending a remote call and the remote handler being invoked.
Mean
mean 0.239815s (SD = 0.431348s)
Max
Highest per-partition mean latency
max mean 6.245351s
Min
Lowest per-partition mean latency
min mean 0.040637s
Round-trip timing
The total elapsed time to get a response to the client.
Mean
mean 0.322908s (SD = 0.450915s)
Max
Highest per-partition mean latency
max mean 6.814357s
Min
Lowest per-partition mean latency
min mean 0.107369s
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean 0.197661s (SD = 1.620499s) p50 0.116061s p95 0.292903s p99 0.507808s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean 0.141332s (SD = 0.352696s) p50 0.123831s p95 0.304976s p99 0.430765s
Request roundtrip duration: 'call_remote'
The time spent sending a call_remote request and awaiting its response
mean 0.273251s (SD = 1.953008s) p50 0.126859s p95 0.31929s p99 3.206568s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean 5.5e-05s (SD = 0.00014s) p50 2.5e-05s p95 0.000233s p99 0.00047s
Handle incoming request duration: 'call_remote'
The time spent handling an incoming call_remote request
mean 0.058933s (SD = 0.85321s) p50 0.007109s p95 0.018398s p99 0.667099s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean 0.001044s (SD = 0.003341s) p50 0.000619s p95 0.002731s p99 0.007839s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean 0.006733s (SD = 0.015642s) p50 0.003628s p95 0.019842s p99 0.053316s
Host Metrics
User CPU usage
CPU usage by user space
11.30%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 142 B/s < mean 277.49 KiB/s (SD = 1022.79 KiB/s) < p952.61 MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 607 B/s < mean 9.76 KiB/s (SD = 19.46 KiB/s) < p9549.15 KiB/s
Total bytes received
Total bytes received on primary network interface
count
3.90 GiB
mean
12.47 MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
139.96 MiB
mean
447.87 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 94.7%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 592.09 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
p5 3.06% < mean 15.61% (SD = 18.79%) < p95 66.16%
System
4.31%
CPU percentiles
CPU usage percentiles
p50
10.19%
p95
66.16%
p99
94.68%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
23 hosts
mean time
0.07s
Memory used percentage
Percentage of memory used
p5 6.74% < mean 10.05% (SD = 2.05%) < p95 12.24%
Memory available percentage
Percentage of available memory
p5 87.76% < mean 89.95% (SD = 2.05%) < p95 93.26%
Max host memory used
Maximum memory usage percentage across all hosts
max 11.03%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 0.00%
Memory growth rate
Rate of memory growth over time
growth 592.09MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
0.00MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/49hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.42
5 min
0.22
15 min
0.09
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5 0.19% < mean 3.7851% (SD = 5.0418%) < p95 12.4%
60 second average
3.3282%
300 second average
1.6699%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5 0% mean 0% (SD = 0%) p95 0%
60 second average
0.0000%
300 second average
0.0304%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5 0% mean 0% (SD = 0%) p95 0%
60 second average
0.0000%
300 second average
0.0218%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5 0% < mean 0.458% (SD = 1.4316%) < p95 2.45%
60 second average
0.6704%
300 second average
0.5478%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5 0% < mean 0.3916% (SD = 1.3255%) < p95 2.08%
60 second average
0.5796%
300 second average
0.4687%
Holochain process CPU usage
CPU usage by Holochain process
p5 1.94% < mean 9.06% (SD = 16.85%) < p95 46.35%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 95.16 KiB < mean 207.39 KiB (SD = 47.80 KiB) < p95231.56 KiB
Holochain process threads
Number of threads in Holochain process
p5 4 threads < mean 19.62 threads (SD = 13.2 threads) < p95 41 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5 11 file descriptors < mean 72.07 file descriptors (SD = 19.48 file descriptors) < p95 90 file descriptors

Remote Signals

This scenario tests the throughput of remote_signals operations.

Started
Wed, 18 Mar 2026 00:26:56 UTC
Peer count
50
Peer count at end
50
Behaviours
  • default (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
remote_signals_23222252791
Round trip time
The time from origin signal dispatch to origin receive of the remote side's response signal.
mean 0.240991s (SD = 0.61721s) p50 0.158415s p95 0.382005s p99 3.129724s
Timeouts
The number of timeouts waiting for the remote side's response signal (default timeout is 20 seconds).
map[count:2 mean_rate_per_second:0.21 measurement_duration:map[nanos:313767697 secs:8] p5_rate_per_second:0 p95_rate_per_second:0.5 peak_rate_per_second:0.5 rate_trend:map[trend:[0.17 0.33] window_duration:10s] std_rate_per_second:0.21]
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean 0.129129s (SD = 0.097087s) p50 0.11474s p95 0.302604s p99 0.474091s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean 0.138786s (SD = 0.137439s) p50 0.124803s p95 0.305261s p99 0.438312s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean 2.7e-05s (SD = 3.5e-05s) p50 2.1e-05s p95 6.5e-05s p99 0.000118s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean 0.001272s (SD = 0.011722s) p50 0.000581s p95 0.002298s p99 0.005774s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean 0.010976s (SD = 0.107744s) p50 0.003409s p95 0.014219s p99 0.040792s
Handle incoming request duration: 'remote_signal'
The time spent handling an incoming remote_signal request
mean 0.043844s (SD = 0.38282s) p50 0.007137s p95 0.017784s p99 0.954403s
Host Metrics
User CPU usage
CPU usage by user space
8.31%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 255 B/s < mean 84.01 KiB/s (SD = 506.80 KiB/s) p9547.55 KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 389 B/s < mean 14.89 KiB/s (SD = 16.87 KiB/s) < p9547.20 KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.18 GiB
mean
3.67 MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
214.46 MiB
mean
665.47 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 90.8%

Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
p5 3.35% < mean 12.4% (SD = 14.37%) < p95 38.16%
System
4.09%
CPU percentiles
CPU usage percentiles
p50
9.01%
p95
38.16%
p99
90.84%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
20 hosts
mean time
0.04s
Memory used percentage
Percentage of memory used
p5 8.09% < mean 10.25% (SD = 1.77%) < p95 12.24%
Memory available percentage
Percentage of available memory
p5 87.76% < mean 89.75% (SD = 1.77%) < p95 91.91%
Max host memory used
Maximum memory usage percentage across all hosts
max 10.99%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 0.00%
Memory growth rate
Rate of memory growth over time
growth -256.98MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
0.00MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/49hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.39
5 min
0.28
15 min
0.13
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5 0.13% < mean 3.6009% (SD = 5.0268%) < p95 12.27%
60 second average
3.5760%
300 second average
2.3728%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5 0% mean 0% (SD = 0%) p95 0%
60 second average
0.0000%
300 second average
0.0187%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5 0% mean 0% (SD = 0%) p95 0%
60 second average
0.0000%
300 second average
0.0133%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5 0% < mean 1.3615% (SD = 6.7393%) < p95 2.88%
60 second average
1.2501%
300 second average
0.7961%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5 0% < mean 1.2602% (SD = 6.3717%) < p95 2.41%
60 second average
1.1462%
300 second average
0.7084%
Holochain process CPU usage
CPU usage by Holochain process
p5 2% < mean 6.51% (SD = 11.36%) < p95 9.47%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 23.33 KiB < mean 198.19 KiB (SD = 59.74 KiB) < p95231.60 KiB
Holochain process threads
Number of threads in Holochain process
p5 1 threads < mean 19.81 threads (SD = 14.33 threads) < p95 44 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5 6 file descriptors < mean 66.03 file descriptors (SD = 23.51 file descriptors) < p95 90 file descriptors