App Install
Measure app installation speed. This scenario has two roles:
minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.
These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.
Started
Tue, 17 Mar 2026 14:57:43 UTC
Peer count
1
Peer count at end
1
Behaviours
-
large(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
app_install_large_23194537823
First install time
The time from conductor startup to completion of the first app installation attempt.
1.540542768s
Install app timing
The time taken to install an app.
mean
0.324304s
(SD =
0.20327s)
p50
0.272058s
p95
0.605898s
p99
1.229797s
Host Metrics
User CPU usage
CPU usage by user space
14.54%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 14.48 KiB/s
<
mean 404.06 KiB/s
(SD = 1.31 MiB/s)
<
p952.43 MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 5.83 KiB/s
<
mean 17.57 KiB/s
(SD = 19.62 KiB/s)
<
p9537.63 KiB/s
Total bytes received
Total bytes received on primary network interface
count
122.32 MiB
mean
404.06 KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
5.32 MiB
mean
17.57 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 2217.65 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
9.39%
<
mean
17.71%
(SD =
9.52%)
<
p95
20.59%
System
3.17%
CPU percentiles
CPU usage percentiles
p50
17.37%
p95
20.59%
p99
66.20%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
13.96%
<
mean
31.77%
(SD =
8.73%)
<
p95
39.82%
Memory available percentage
Percentage of available memory
p5
60.18%
<
mean
68.23%
(SD =
8.73%)
<
p95
86.04%
Max host memory used
Maximum memory usage percentage across all hosts
max
31.77%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
1.24%
Memory growth rate
Rate of memory growth over time
growth
2217.65MB/s
Disk read throughput
Disk read throughput in MB/s
0.77MB/s
Disk write throughput
Disk write throughput in MB/s
9.67MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/1hosts
Mount Point
/efi-boot
0/1hosts
Mount Point
/nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.43
5 min
0.76
15 min
0.34
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.4784%
(SD =
0.3525%)
<
p95
0.96%
60 second average
0.4612%
300 second average
0.2391%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
2.5975%
(SD =
4.147%)
<
p95
12.79%
60 second average
1.8719%
300 second average
0.6266%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
2.4991%
(SD =
3.9925%)
<
p95
12.21%
60 second average
1.8038%
300 second average
0.6031%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
11.81%
<
mean
18.2625%
(SD =
6.4245%)
<
p95
28.79%
60 second average
15.8656%
300 second average
9.9456%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
11.5%
<
mean
17.8144%
(SD =
6.1846%)
<
p95
28.25%
60 second average
15.4544%
300 second average
9.7031%
Holochain process CPU usage
CPU usage by Holochain process
p5
8.29%
<
mean
16.54%
(SD =
9.83%)
<
p95
19.23%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 385.46 KiB
<
mean 1.50 MiB
(SD = 600.03 KiB)
<
p952.02 MiB
Holochain process threads
Number of threads in Holochain process
p5
17 threads
<
mean
54.07 threads
(SD =
12.83 threads)
<
p95
59 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
133 file descriptors
<
mean
773.03 file descriptors
(SD =
291.24 file descriptors)
<
p95
1091 file descriptors
App Install
Measure app installation speed. This scenario has two roles:
minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.
These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.
Started
Tue, 17 Mar 2026 15:03:01 UTC
Peer count
1
Behaviours
-
minimal(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
app_install_minimal_23194537823
First install time
The time from conductor startup to completion of the first app installation attempt.
0.296592882s
Install app timing
The time taken to install an app.
mean
0.063421s
(SD =
0.009793s)
p50
0.065077s
p95
0.077357s
p99
0.090822s
Host Metrics
User CPU usage
CPU usage by user space
19.07%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 10.32 KiB/s
<
mean 72.61 KiB/s
(SD = 44.34 KiB/s)
<
p95110.03 KiB/s
Not enough time data to show a trend.
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 3.49 KiB/s
<
mean 22.56 KiB/s
(SD = 13.50 KiB/s)
<
p9532.61 KiB/s
Not enough time data to show a trend.
Total bytes received
Total bytes received on primary network interface
count
2.13 MiB
mean
72.61 KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
676.87 KiB
mean
22.56 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 1413.73 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
18.35%
<
mean
23.11%
(SD =
6.47%)
<
p95
32.26%
Not enough time data to show a trend.
System
4.05%
CPU percentiles
CPU usage percentiles
p50
18.73%
p95
32.26%
p99
32.26%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
8.95%
<
mean
11.38%
(SD =
2.79%)
<
p95
16.1%
Memory available percentage
Percentage of available memory
p5
83.9%
<
mean
88.62%
(SD =
2.79%)
<
p95
91.05%
Max host memory used
Maximum memory usage percentage across all hosts
max
11.38%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00%
Memory growth rate
Rate of memory growth over time
growth
1413.73MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
13.71MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname
0/1hosts
Mount Point
/etc/hosts
0/1hosts
Mount Point
/etc/resolv.conf
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.95
5 min
0.23
15 min
0.08
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.02%
<
mean
0.2225%
(SD =
0.2233%)
<
p95
0.59%
60 second average
0.0925%
300 second average
0.0175%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Holochain process CPU usage
CPU usage by Holochain process
p5
17.57%
<
mean
19.57%
(SD =
2.35%)
<
p95
22.88%
Not enough time data to show a trend.
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 377.28 KiB
<
mean 793.32 KiB
(SD = 466.32 KiB)
<
p951.54 MiB
Holochain process threads
Number of threads in Holochain process
p5
18 threads
<
mean
19.5 threads
(SD =
0.87 threads)
<
p95
20 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
167 file descriptors
<
mean
690.75 file descriptors
(SD =
348.84 file descriptors)
<
p95
1024 file descriptors
DHT Sync Lag
Measure lag time between an agent publishing data and other peers being able to see it. This scenario has two roles:
write: A simple job that just creates entries with a timestamp field. Those entries are linked to a known base hash. For each write, the metricws.custom.dht_sync_sent_countis incremented.record_lag: A job that repeatedly queries for links from the known base hash. It keeps track of records that it has seen and when a new record is found, and calculates the time difference between the timestamp of the new record and the current time. That time difference is then recorded as a custom metric calledwt.custom.dht_sync_lag.
After each behaviour loop the metric ws.custom.dht_sync_recv_count is incremented.
Started
Tue, 17 Mar 2026 15:18:36 UTC
Peer count
10
Peer count at end
37
Behaviours
-
record_lag(1 agent) -
write(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
dht_sync_lag_23194537823
Create rate
The average number of created records per agent.
Mean
mean
68.27/s
Max
Highest per-partition mean rate
max
135.5/s
Min
Lowest per-partition mean rate
min
34.86/s
Sync lag timing
The average time between when a record was created and when it is first seen by an agent.
Mean
mean
117.841954s
(SD =
49.753969s)
Max
Highest per-partition mean latency
max mean
178.72373s
Min
Lowest per-partition mean latency
min mean
35.297668s
Sync lag rate
The average number of created records discovered per agent.
Mean
mean
83.68/s
Max
Highest per-partition mean rate
max
195.67/s
Min
Lowest per-partition mean rate
min
33.41/s
Error count
The number of errors encountered during the scenario.
4
Cascade duration
The time taken to execute a cascade query.
mean
0.002713s
(SD =
0.00996s)
p50
0.001197s
p95
0.007308s
p99
0.047515s
WASM usage
The metered usage of a wasm ribosome.
Total
total
37309184over 410.975798253s
mean rate
1.38299234201e+09/s
std
1.2983565975913e+11/s
p5
0/s
p95
4.3830370848e+08/s
peak
2.020502567975831e+13/s
zome=timed,fn=created_timed_entry
total
0over 316.961017795s
Not enough time data to show a trend.
zome=timed,fn=get_timed_entries_local
total
37265575over 394.172548412s
mean rate
4.5151144491e+08/s
std
8.50185094312e+09/s
p5
0/s
p95
4.4755718026e+08/s
peak
3.7940769635763e+11/s
zome=timed_integrity,fn=entry_defs
total
0over 408.220872542s
Not enough time data to show a trend.
post_commit durationThe time spent executing a post commit.
mean
0.00069s
(SD =
0.001196s)
p50
0.000284s
p95
0.003004s
p99
0.005369s
Publish DHT ops workflow duration
The time spent running the publish workflow.
mean
0.08415s
(SD =
0.124827s)
p50
0.056142s
p95
0.206594s
p99
0.533951s
Integrate DHT ops workflow duration
The time spent running the integration workflow.
mean
0.019555s
(SD =
0.097607s)
p50
0.004376s
p95
0.054664s
p99
0.38025s
Countersigning workflow duration
Duration
mean
0.002896s
(SD =
0.004101s)
p50
0.001063s
p95
0.014152s
p99
0.014152s
App validation workflow duration
The time spent running the app validation workflow.
mean
0.457657s
(SD =
3.099514s)
p50
0.002449s
p95
1.520434s
p99
10.471643s
System validation workflow duration
The time spent running the sys validation workflow.
mean
0.20622s
(SD =
1.155618s)
p50
0.019961s
p95
0.490589s
p99
10.003792s
Validation receipt workflow duration
The time spent running the validation receipt workflow.
mean
0.897495s
(SD =
9.799173s)
p50
0.002907s
p95
0.803292s
p99
21.604031s
Authored DB
The utilization of connections in the authored database connection pool.
Utilisation
p5
0%
<
mean
0.1%
(SD =
0.08%)
<
p95
0.22%
Use time
mean
0.002891s
(SD =
0.010841s)
p50
0.001003s
p95
0.0093s
p99
0.057698s
Conductor DB
The utilization of connections in the conductor database connection pool.
Utilisation
p5
0%
≤
mean
0%
(SD =
0.02%)
≤
p95
0%
Use time
mean
0.000279s
(SD =
0.000682s)
p50
0.00011s
p95
0.001069s
p99
0.002954s
DHT DB
The utilization of connections in the DHT database connection pool.
Utilisation
p5
0.11%
<
mean
0.2%
(SD =
0.11%)
<
p95
0.44%
Use time
mean
0.001476s
(SD =
0.013421s)
p50
0.000415s
p95
0.002982s
p99
0.017037s
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.109279s
(SD =
0.101013s)
p50
0.082286s
p95
0.292943s
p99
0.360873s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.746237s
(SD =
2.067364s)
p50
0.345261s
p95
1.932476s
p99
10.222875s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
1.6e-05s
(SD =
0.000108s)
p50
1e-05s
p95
2.9e-05s
p99
8.4e-05s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.001437s
(SD =
0.00872s)
p50
0.000567s
p95
0.00527s
p99
0.010474s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.652182s
(SD =
2.058949s)
p50
0.230093s
p95
1.832419s
p99
10.001887s
Host Metrics
User CPU usage
CPU usage by user space
39.90%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 30.87 KiB/s
<
mean 551.56 KiB/s
(SD = 1.03 MiB/s)
<
p952.17 MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 16.91 KiB/s
<
mean 177.73 KiB/s
(SD = 192.26 KiB/s)
<
p95557.22 KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.47 GiB
mean
3.97 MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
485.98 MiB
mean
1.28 MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.4%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 375.33 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Warning Moderate swap usage (14.1% swap used)
System overload anomaly
System overload anomaly was detected
Detected
Warning 11% of hosts overloaded (load5/ncpus > 1.0)
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
18.74%
<
mean
48.44%
(SD =
26.1%)
<
p95
97.9%
System
8.55%
CPU percentiles
CPU usage percentiles
p50
36.04%
p95
97.90%
p99
98.40%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
3 hosts
mean time
0.53s
Memory used percentage
Percentage of memory used
p5
6.2%
<
mean
21.13%
(SD =
12.26%)
<
p95
47.25%
Memory available percentage
Percentage of available memory
p5
52.75%
<
mean
78.87%
(SD =
12.26%)
<
p95
93.8%
Max host memory used
Maximum memory usage percentage across all hosts
max
46.96%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
14.12%
Memory growth rate
Rate of memory growth over time
growth
375.33MB/s
Disk read throughput
Disk read throughput in MB/s
0.03MB/s
Disk write throughput
Disk write throughput in MB/s
140.04MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/4hosts
Mount Point
/efi-boot
0/4hosts
Mount Point
/etc/hostname
0/4hosts
Mount Point
/etc/hosts
0/4hosts
Mount Point
/etc/resolv.conf
0/4hosts
Mount Point
/nix/store
0/4hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.78
5 min
1.38
15 min
0.64
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
11.11%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.07%
<
mean
19.5907%
(SD =
29.4102%)
<
p95
98.93%
60 second average
16.2535%
300 second average
7.8221%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.0069%
(SD =
0.0829%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
17.4464%
(SD =
14.5907%)
<
p95
39.07%
60 second average
15.0392%
300 second average
8.4231%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
13.3399%
(SD =
11.9602%)
<
p95
31.72%
60 second average
11.6076%
300 second average
6.7386%
Holochain process CPU usage
CPU usage by Holochain process
p5
0%
<
mean
39.38%
(SD =
27.03%)
<
p95
91.1%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 180.67 KiB
<
mean 282.04 KiB
(SD = 49.82 KiB)
<
p95339.85 KiB
Holochain process threads
Number of threads in Holochain process
p5
1 threads
<
mean
31.27 threads
(SD =
14.34 threads)
<
p95
56 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0 file descriptors
<
mean
71.26 file descriptors
(SD =
28.68 file descriptors)
<
p95
94 file descriptors
First Call
This scenario installs a simple app which implements the init callback, and measures the time elapsed between start of install and calling init. It will uninstall the app it installed so that it can re-install it on the next iteration. This is required to re-run the initialisation callback.
Started
Tue, 17 Mar 2026 12:52:46 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
first_call_23194537823
Zome call timing
The time elapsed between start of install and calling
init.
mean
0.022273s
(SD =
0.023509s)
p50
0.019927s
p95
0.023738s
p99
0.19308s
Host Metrics
User CPU usage
CPU usage by user space
8.85%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 33 B/s
<
mean 627.33 KiB/s
(SD = 1.19 MiB/s)
<
p952.92 MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 25 B/s
<
mean 17.31 KiB/s
(SD = 31.04 KiB/s)
<
p9575.50 KiB/s
Total bytes received
Total bytes received on primary network interface
count
183.79 MiB
mean
627.33 KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
5.07 MiB
mean
17.31 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 260.78 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
8.01%
<
mean
12.22%
(SD =
8.08%)
<
p95
18.44%
System
3.37%
CPU percentiles
CPU usage percentiles
p50
9.80%
p95
18.44%
p99
53.10%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
18.88%
<
mean
23.44%
(SD =
1.47%)
<
p95
24.18%
Memory available percentage
Percentage of available memory
p5
75.82%
<
mean
76.56%
(SD =
1.47%)
<
p95
81.12%
Max host memory used
Maximum memory usage percentage across all hosts
max
23.44%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00%
Memory growth rate
Rate of memory growth over time
growth
260.78MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
11.67MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname
0/1hosts
Mount Point
/etc/hosts
0/1hosts
Mount Point
/etc/resolv.conf
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.75
5 min
0.83
15 min
0.34
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.54%
<
mean
0.9552%
(SD =
0.4503%)
<
p95
1.83%
60 second average
0.8261%
300 second average
0.4123%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
11.56%
<
mean
40.5384%
(SD =
11.3962%)
<
p95
55.05%
60 second average
34.3400%
300 second average
16.9942%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
11.17%
<
mean
38.82%
(SD =
11.0852%)
<
p95
52.14%
60 second average
32.7429%
300 second average
16.2106%
Holochain process CPU usage
CPU usage by Holochain process
p5
4.22%
<
mean
7.58%
(SD =
7.74%)
<
p95
12.57%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 193.13 KiB
<
mean 446.20 KiB
(SD = 103.40 KiB)
<
p95488.13 KiB
Holochain process threads
Number of threads in Holochain process
p5
6 threads
<
mean
20.13 threads
(SD =
4.75 threads)
<
p95
22 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
15 file descriptors
<
mean
141.68 file descriptors
(SD =
155.62 file descriptors)
<
p95
516 file descriptors
Full-Arc Create (Validated) / Zero-Arc Read
A full-arc/zero-arc mixed scenario where full-arc nodes create data that gets validated and zero-arc nodes read the data. The scenario has two roles:
full: A full-arc conductor that creates entries with a timestamp field. Those entries get validated and then retrieved by zero-arc nodes.zero: A zero-arc conductor that reads the entries created by the full-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Tue, 17 Mar 2026 17:32:02 UTC
Peer count
10
Peer count at end
37
Behaviours
-
full(1 agent) -
zero(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
full_arc_create_validated_zero_arc_read_23194537823
Create rate
The number of timed entries created by the full-arc node(s) per second.
Mean
mean
73.45/s
Max
Highest per-partition mean rate
max
168.39/s
Min
Lowest per-partition mean rate
min
11.78/s
Fetch lag timing
For each entry, the time lag between when it was created by a full-arc node and when a zero-arc node fetched it from the network.
Mean
mean
133.549261s
(SD =
42.731351s)
Max
Highest per-partition mean latency
max mean
263.692914s
Min
Lowest per-partition mean latency
min mean
18.780295s
Fetch rate
The number of entries per second fetched by zero-arc nodes.
Mean
mean
179.76/s
Max
Highest per-partition mean rate
max
432.33/s
Min
Lowest per-partition mean rate
min
0/s
Open connections
The number of currently open connections to other conductors.
full-arc
p5
0
<
mean
4.27
(SD =
3.36)
<
p95
8
zero-arc
p5
1
<
mean
4.53
(SD =
1.82)
<
p95
7
Retrieval errors
Errors encountered by zero-arc nodes when attempting to retrieve entries created by full-arc nodes.
Total
13
Agents affected
6 / 6
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
2
Max
Highest count in any single partition
4
Min
Lowest count in any single partition
1
App validation workflow duration
The time taken to apply app validation to the data.
mean
4.882249s
(SD =
14.172713s)
p50
1.275517s
p95
26.922674s
p99
96.199615s
System validation workflow duration
The time taken to apply system validation to the data.
mean
0.336208s
(SD =
1.272016s)
p50
0.01537s
p95
1.390068s
p99
10.013s
Error count
The number of errors accumulated across all nodes.
13
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.030758s
(SD =
0.042867s)
p50
0.012306s
p95
0.130838s
p99
0.24261s
Request roundtrip duration: 'get_links'
The time spent sending a get_links request and awaiting its response
mean
2.361672s
(SD =
11.279822s)
p50
0.058583s
p95
1.200936s
p99
60.00152s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.476308s
(SD =
0.927185s)
p50
0.019715s
p95
2.627536s
p99
4.181265s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
7.1e-05s
(SD =
0.000279s)
p50
1.3e-05s
p95
0.000115s
p99
0.001641s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.000527s
(SD =
0.000404s)
p50
0.000431s
p95
0.001084s
p99
0.001862s
Handle incoming request duration: 'get_links'
The time spent handling an incoming get_links request
mean
0.048376s
(SD =
0.033493s)
p50
0.042538s
p95
0.106362s
p99
0.115773s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.426329s
(SD =
0.892868s)
p50
0.00959s
p95
2.480899s
p99
4.052508s
Local Signals
This scenario is for testing the speed and reliability of local signals. It uses a zome with a function that will emit 10,000 signals. The scenario measures how long it takes to send the signals and how many have been received by the time the zome call ends.
Started
Tue, 17 Mar 2026 13:05:43 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
local_signals_23194537823
Send timing
The time taken to emit a batch of 10,000 signals.
mean
1.27386s
(SD =
0.636937s)
p50
1.350483s
p95
2.191649s
p99
2.191649s
Receive timing
The time taken to receive the completed batch, to the nearest 250ms.
mean
27.722625s
(SD =
6.835572s)
p50
30.001161s
p95
30.001797s
p99
30.001797s
Success ratio
The proportion of signals successfully received in a batch.
min
0.9445000290870668
<
mean
0.9774
(SD =
0.0155)
<
max
0.9994000196456908
Host Metrics
User CPU usage
CPU usage by user space
4.95%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 55 B/s
<
mean 1.26 MiB/s
(SD = 2.46 MiB/s)
<
p957.04 MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 132 B/s
<
mean 18.09 KiB/s
(SD = 35.02 KiB/s)
<
p95106.85 KiB/s
Total bytes received
Total bytes received on primary network interface
count
378.64 MiB
mean
1.26 MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
5.30 MiB
mean
18.09 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 9.52 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.78%
<
mean
8.27%
(SD =
9.2%)
<
p95
26.92%
System
3.32%
CPU percentiles
CPU usage percentiles
p50
5.17%
p95
26.92%
p99
41.34%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
15.95%
<
mean
16.33%
(SD =
0.62%)
<
p95
16.95%
Memory available percentage
Percentage of available memory
p5
83.05%
<
mean
83.67%
(SD =
0.62%)
<
p95
84.05%
Max host memory used
Maximum memory usage percentage across all hosts
max
16.33%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00%
Memory growth rate
Rate of memory growth over time
growth
9.52MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
4.05MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/1hosts
Mount Point
/efi-boot
0/1hosts
Mount Point
/nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.87
5 min
0.46
15 min
0.23
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.18%
<
mean
1.679%
(SD =
1.5986%)
<
p95
5.25%
60 second average
1.2600%
300 second average
0.5323%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.62%
<
mean
7.7294%
(SD =
7.4291%)
<
p95
23.74%
60 second average
7.9097%
300 second average
6.9223%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.6%
<
mean
7.01%
(SD =
6.853%)
<
p95
21.78%
60 second average
7.1613%
300 second average
6.4397%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.12%
<
mean
1.55%
(SD =
6.7%)
≤
p95
0.6%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 99.99 KiB
<
mean 225.61 KiB
(SD = 46.30 KiB)
<
p95238.77 KiB
Holochain process threads
Number of threads in Holochain process
p5
11 threads
≤
mean
11 threads
(SD =
1.02 threads)
≤
p95
11 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
47 file descriptors
<
mean
49.81 file descriptors
(SD =
11.54 file descriptors)
<
p95
69 file descriptors
Mixed Arc get_agent_activity
A mixed-arc scenario that measures the DHT's ability to propagate agent activity and make it available via get_agent_activity calls. The scenario has three roles:
zero_write: A zero-arc conductor that creates entries on its source chain.full_write: A full-arc conductor that creates entries on its source chain.zero_read: A zero-arc conductor that picks a random writer and repeatedly callsget_agent_activityto observe new entries appearing on the writer's chain, measuring the lag between creation and discovery.
Started
Tue, 17 Mar 2026 17:46:02 UTC
Peer count
10
Peer count at end
37
Behaviours
-
full_write(1 agent) -
zero_read(1 agent) -
zero_write(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
mixed_arc_get_agent_activity_23194537823
Entry created count
The total number of entries created by write agents over the run, partitioned by agent and behaviour.
Total
8779
Agents affected
3 / 3
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
2926
Max
Highest count in any single partition
6497
Min
Lowest count in any single partition
703
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
3603.5
Max
Highest chain head value observed for any single write agent.
6497
Write agents observed
2
Chain head delay timing
The time lag between when a writer creates a new entry and when a reader discovers it via
get_agent_activity. This is measured per new action in the chain.Mean
mean
0.403023s
(SD =
0.823308s)
Max
Highest per-partition mean latency
max mean
0.649249s
Min
Lowest per-partition mean latency
min mean
0.089909s
Chain head delay rate
The rate at which readers detect new chain heads appearing on writers' chains.
Mean
mean
16.56/s
Max
Highest per-partition mean rate
max
35.31/s
Min
Lowest per-partition mean rate
min
10.77/s
get_agent_activity_full zome call timingThe time taken to complete the
get_agent_activity_full zome call that queries a writer's chain.Mean
mean
0.11894s
(SD =
0.052218s)
Max
Highest per-partition mean latency
max mean
0.205857s
Min
Lowest per-partition mean latency
min mean
0.038005s
Open connections
The number of currently open connections to other conductors, partitioned by agent behaviour.
behaviour:full_write
p5
4
<
mean
7.46
(SD =
1.31)
<
p95
8
behaviour:zero_read
p5
2
<
mean
4.37
(SD =
1.61)
<
p95
6
behaviour:zero_write
p5
3
<
mean
5.7
(SD =
1.41)
<
p95
7
Final error count
The total number of errors accumulated across all agents over the run.
52
Host Metrics
User CPU usage
CPU usage by user space
25.76%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 10.66 KiB/s
<
mean 1.33 MiB/s
(SD = 1.56 MiB/s)
<
p954.59 MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 9.08 KiB/s
<
mean 714.04 KiB/s
(SD = 1.26 MiB/s)
<
p954.16 MiB/s
Total bytes received
Total bytes received on primary network interface
count
3.63 GiB
mean
10.92 MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.90 GiB
mean
5.72 MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 94.2%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 672.43 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected
Warning 11% of hosts overloaded (load5/ncpus > 1.0)
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
3.59%
<
mean
31.79%
(SD =
25.69%)
<
p95
91.53%
System
6.02%
CPU percentiles
CPU usage percentiles
p50
27.02%
p95
91.53%
p99
94.15%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
3 hosts
mean time
0.22s
Memory used percentage
Percentage of memory used
p5
8.6%
<
mean
22.71%
(SD =
10.57%)
<
p95
38.87%
Memory available percentage
Percentage of available memory
p5
61.13%
<
mean
77.29%
(SD =
10.57%)
<
p95
91.4%
Max host memory used
Maximum memory usage percentage across all hosts
max
37.87%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
3.42%
Memory growth rate
Rate of memory growth over time
growth
672.43MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
96.40MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/4hosts
Mount Point
/boot
0/1hosts
Mount Point
/efi-boot
0/2hosts
Mount Point
/etc/hostname
0/5hosts
Mount Point
/etc/hosts
0/5hosts
Mount Point
/etc/resolv.conf
0/5hosts
Mount Point
/nix/store
0/4hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.06
5 min
1.93
15 min
1.13
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
11.11%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
7.4113%
(SD =
15.6107%)
<
p95
63.05%
60 second average
7.1759%
300 second average
4.1444%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
24.1154%
(SD =
23.4722%)
<
p95
62.33%
60 second average
22.6492%
300 second average
15.5215%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
18.0719%
(SD =
18.3471%)
<
p95
52.76%
60 second average
17.0014%
300 second average
12.2175%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.15%
<
mean
12.41%
(SD =
16.91%)
<
p95
57.84%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 48.04 KiB
<
mean 235.72 KiB
(SD = 109.62 KiB)
<
p95486.84 KiB
Holochain process threads
Number of threads in Holochain process
p5
9 threads
<
mean
16.5 threads
(SD =
6.98 threads)
<
p95
28 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
12 file descriptors
<
mean
59.69 file descriptors
(SD =
18.89 file descriptors)
<
p95
86 file descriptors
Mixed Arc must_get_agent_activity
A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.
The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.
This test is similar to Write Validated must_get_agent_activity, but some write agents are zero-arc and all must_get_agent_activity agents are zero-arc. This forces the must_get_agent_activity host call to go to the network.
Started
Tue, 17 Mar 2026 18:03:22 UTC
Peer count
10
Peer count at end
27
Behaviours
-
full_write(1 agent) -
zero_must_get_agent_activity(1 agent) -
zero_write(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
mixed_arc_must_get_agent_activity_23194537823
Highest observed
action_seqThe maximum chain length observed per
write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
577
Max
Highest chain head value observed for any single write agent.
577
Write agents observed
1
Chain batch delay timing
The time between a
write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.Mean
mean
8.767995s
(SD =
6.574567s)
Max
Highest per-partition mean latency
max mean
24.494652s
Min
Lowest per-partition mean latency
min mean
0.610275s
Chain batch delay rate
The rate at which a
must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.Mean
mean
2.69/s
Max
Highest per-partition mean rate
max
4.4/s
Min
Lowest per-partition mean rate
min
1.81/s
create_validated_sample_entry zome call timingThe time taken to complete the zome function call that creates the entry that depends on a
write agent's source chain.Mean
mean
0.130532s
(SD =
0.098495s)
Max
Highest per-partition mean latency
max mean
0.219655s
Min
Lowest per-partition mean latency
min mean
0.078096s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on
must_get_agent_activity calls.Total
1323
Agents affected
2 / 2
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
662
Max
Highest count in any single partition
1276
Min
Lowest count in any single partition
47
Open connections
The average number of open connections maintained by an agent over the run, broken down by behaviour.
behaviour:full_write
p5
1
<
mean
5.32
(SD =
1.46)
<
p95
6
behaviour:zero_must_get_agent_activity
p5
0
<
mean
3.08
(SD =
2.25)
<
p95
6
behaviour:zero_write
p5
1
<
mean
3.28
(SD =
1.18)
<
p95
5
Final error count
The total number of all types of error accumulated over the run by all agents.
3215
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.115712s
(SD =
0.210497s)
p50
0.08234s
p95
0.297187s
p99
1.265488s
Request roundtrip duration: 'get_links'
The time spent sending a get_links request and awaiting its response
mean
0.13957s
(SD =
1.268964s)
p50
0.086477s
p95
0.254325s
p99
0.427236s
Request roundtrip duration: 'must_get_agent_activity'
The time spent sending a must_get_agent_activity request and awaiting its response
mean
0.017646s
(SD =
0.048463s)
p50
0.006886s
p95
0.027717s
p99
0.252001s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.431973s
(SD =
4.252216s)
p50
0.09774s
p95
1.522382s
p99
3.463859s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
3.1e-05s
(SD =
0.000107s)
p50
1.8e-05s
p95
7.6e-05s
p99
0.000296s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.001303s
(SD =
0.001105s)
p50
0.000963s
p95
0.00362s
p99
0.005556s
Handle incoming request duration: 'get_links'
The time spent handling an incoming get_links request
mean
0.193482s
(SD =
3.754129s)
p50
0.000875s
p95
0.009605s
p99
0.019125s
Handle incoming request duration: 'must_get_agent_activity'
The time spent handling an incoming must_get_agent_activity request
mean
10.57926s
(SD =
29.875009s)
p50
0.00624s
p95
122.533231s
p99
128.047706s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.167899s
(SD =
0.529753s)
p50
0.00376s
p95
1.31004s
p99
2.989152s
Host Metrics
User CPU usage
CPU usage by user space
10.35%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 98 B/s
<
mean 370.33 KiB/s
(SD = 1.06 MiB/s)
<
p952.75 MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 108 B/s
<
mean 121.53 KiB/s
(SD = 648.23 KiB/s)
<
p95182.05 KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.17 GiB
mean
3.62 MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
56.45 MiB
mean
175.16 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 1732.00 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2.03%
<
mean
13.92%
(SD =
16.34%)
<
p95
56.55%
System
3.56%
CPU percentiles
CPU usage percentiles
p50
6.66%
p95
56.55%
p99
75.20%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
2 hosts
mean time
0.03s
Memory used percentage
Percentage of memory used
p5
16.51%
<
mean
20.43%
(SD =
3.31%)
<
p95
25.6%
Memory available percentage
Percentage of available memory
p5
75.93%
<
mean
79.57%
(SD =
3.31%)
<
p95
83.55%
Max host memory used
Maximum memory usage percentage across all hosts
max
22.93%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.05%
Memory growth rate
Rate of memory growth over time
growth
1732.00MB/s
Disk read throughput
Disk read throughput in MB/s
6.66MB/s
Disk write throughput
Disk write throughput in MB/s
22.63MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/5hosts
Mount Point
/efi-boot
0/5hosts
Mount Point
/etc/hostname
0/2hosts
Mount Point
/etc/hosts
0/2hosts
Mount Point
/etc/resolv.conf
0/2hosts
Mount Point
/nix/store
0/5hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.97
5 min
0.66
15 min
0.53
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.6916%
(SD =
1.6649%)
<
p95
3.79%
60 second average
0.6428%
300 second average
0.3793%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
11.3629%
(SD =
15.9326%)
<
p95
53.5%
60 second average
10.0753%
300 second average
7.7871%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
9.6926%
(SD =
13.6045%)
<
p95
45.06%
60 second average
8.6197%
300 second average
6.8893%
Holochain process CPU usage
CPU usage by Holochain process
p5
0%
<
mean
9.87%
(SD =
14.89%)
<
p95
25.47%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 277.98 KiB
<
mean 488.28 KiB
(SD = 114.64 KiB)
<
p95669.60 KiB
Holochain process threads
Number of threads in Holochain process
p5
1 threads
<
mean
17.12 threads
(SD =
9.36 threads)
<
p95
32 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0 file descriptors
<
mean
63.18 file descriptors
(SD =
28.91 file descriptors)
<
p95
89 file descriptors
Remote Call Rate
Test the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.
Started
Tue, 17 Mar 2026 13:21:18 UTC
Peer count
2
Peer count at end
2
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
remote_call_rate_23194537823
Dispatch timing
The time between sending a remote call and the remote handler being invoked.
Mean
mean
0.001915s
(SD =
0.000717s)
Max
Highest per-partition mean latency
max mean
0.001919s
Min
Lowest per-partition mean latency
min mean
0.001911s
Round-trip timing
The total elapsed time to get a response to the client.
Mean
mean
0.004421s
(SD =
0.001182s)
Max
Highest per-partition mean latency
max mean
0.004422s
Min
Lowest per-partition mean latency
min mean
0.00442s
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.000412s
(SD =
3.2e-05s)
p50
0.000444s
p95
0.000444s
p99
0.000444s
Not enough time data to show a trend.
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.001262s
(SD =
0.000713s)
p50
0.000988s
p95
0.002649s
p99
0.002649s
Request roundtrip duration: 'call_remote'
The time spent sending a call_remote request and awaiting its response
mean
0.002063s
(SD =
0.000726s)
p50
0.001961s
p95
0.002368s
p99
0.004434s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
7e-06s
(SD =
5e-06s)
p50
7e-06s
p95
1e-05s
p99
1.5e-05s
Handle incoming request duration: 'call_remote'
The time spent handling an incoming call_remote request
mean
0.001778s
(SD =
0.00064s)
p50
0.001679s
p95
0.002039s
p99
0.003864s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.000157s
(SD =
1e-06s)
p50
0.000159s
p95
0.000159s
p99
0.000159s
Not enough time data to show a trend.
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.001012s
(SD =
0.000685s)
p50
0.000747s
p95
0.002354s
p99
0.002354s
Host Metrics
User CPU usage
CPU usage by user space
18.84%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 6.23 KiB/s
<
mean 636.37 KiB/s
(SD = 1.69 MiB/s)
<
p955.91 MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 651 B/s
<
mean 13.63 KiB/s
(SD = 22.31 KiB/s)
<
p9571.46 KiB/s
Total bytes received
Total bytes received on primary network interface
count
180.22 MiB
mean
636.37 KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
3.86 MiB
mean
13.63 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 3.30 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Warning Moderate swap usage (16.6% swap used)
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
32.23%
<
mean
32.27%
(SD =
2.96%)
<
p95
35.47%
System
13.43%
CPU percentiles
CPU usage percentiles
p50
32.44%
p95
35.47%
p99
36.35%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
31.62%
<
mean
32.38%
(SD =
0.36%)
<
p95
32.87%
Memory available percentage
Percentage of available memory
p5
67.13%
<
mean
67.62%
(SD =
0.36%)
<
p95
68.38%
Max host memory used
Maximum memory usage percentage across all hosts
max
32.38%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
16.57%
Memory growth rate
Rate of memory growth over time
growth
3.30MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
18.62MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname
0/1hosts
Mount Point
/etc/hosts
0/1hosts
Mount Point
/etc/resolv.conf
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.35
5 min
1.31
15 min
0.69
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.15%
<
mean
1.3047%
(SD =
3.6867%)
<
p95
7.43%
60 second average
1.1670%
300 second average
0.6993%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.0197%
(SD =
0.0559%)
<
p95
0.12%
60 second average
0.0180%
300 second average
0.0017%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.0087%
(SD =
0.0337%)
<
p95
0.06%
60 second average
0.0073%
300 second average
0.0003%
Holochain process CPU usage
CPU usage by Holochain process
p5
12.49%
≤
mean
12.39%
(SD =
1.19%)
<
p95
12.65%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 218.75 KiB
<
mean 222.40 KiB
(SD = 3.77 KiB)
<
p95230.81 KiB
Holochain process threads
Number of threads in Holochain process
p5
15 threads
≤
mean
15 threads
(SD =
0 threads)
≤
p95
15 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
50 file descriptors
<
mean
55.33 file descriptors
(SD =
7.92 file descriptors)
<
p95
72 file descriptors
Remote Signals
This scenario tests the throughput of remote_signals operations.
Started
Tue, 17 Mar 2026 13:37:52 UTC
Peer count
2
Peer count at end
2
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
remote_signals_23194537823
Round trip time
The time from origin signal dispatch to origin receive of the remote side's response signal.
mean
0.031379s
(SD =
0.041088s)
p50
0.017121s
p95
0.047294s
p99
0.277089s
Timeouts
The number of timeouts waiting for the remote side's response signal (default timeout is 20 seconds).
0
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.00335s
(SD =
0.004971s)
p50
0.001235s
p95
0.016246s
p99
0.016246s
Not enough time data to show a trend.
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
1.7e-05s
(SD =
1.9e-05s)
p50
1.1e-05s
p95
6.8e-05s
p99
6.8e-05s
Not enough time data to show a trend.
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.002745s
(SD =
0.004819s)
p50
0.000739s
p95
0.015324s
p99
0.015324s
Not enough time data to show a trend.
Handle incoming request duration: 'remote_signal'
The time spent handling an incoming remote_signal request
mean
0.005263s
(SD =
0.019469s)
p50
0.004679s
p95
0.005979s
p99
0.008791s
Host Metrics
User CPU usage
CPU usage by user space
15.92%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 69 B/s
<
mean 624.25 KiB/s
(SD = 1.08 MiB/s)
<
p951.84 MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 64 B/s
<
mean 16.19 KiB/s
(SD = 28.44 KiB/s)
<
p9561.93 KiB/s
Total bytes received
Total bytes received on primary network interface
count
182.89 MiB
mean
624.25 KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
4.74 MiB
mean
16.19 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.2%
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.81%
<
mean
18.34%
(SD =
21.75%)
<
p95
53.52%
System
2.42%
CPU percentiles
CPU usage percentiles
p50
7.53%
p95
53.52%
p99
98.15%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1 hosts
mean time
0.03s
Memory used percentage
Percentage of memory used
p5
18.32%
<
mean
19.89%
(SD =
2.09%)
<
p95
23.12%
Memory available percentage
Percentage of available memory
p5
76.88%
<
mean
80.11%
(SD =
2.09%)
<
p95
81.68%
Max host memory used
Maximum memory usage percentage across all hosts
max
19.89%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00%
Memory growth rate
Rate of memory growth over time
growth
-374.24MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
5.56MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/1hosts
Mount Point
/efi-boot
0/1hosts
Mount Point
/nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.35
5 min
1.76
15 min
0.91
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
3.6723%
(SD =
10.4444%)
<
p95
30.52%
60 second average
3.8261%
300 second average
2.3729%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
1.17%
<
mean
11.1845%
(SD =
9.4425%)
<
p95
27.6%
60 second average
13.8710%
300 second average
13.6026%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
1.04%
<
mean
9.5803%
(SD =
7.6329%)
<
p95
24.19%
60 second average
12.1890%
300 second average
12.4342%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.47%
<
mean
3.27%
(SD =
8.01%)
<
p95
28.17%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 126.40 KiB
<
mean 204.44 KiB
(SD = 35.13 KiB)
<
p95221.68 KiB
Holochain process threads
Number of threads in Holochain process
p5
9 threads
<
mean
16.29 threads
(SD =
2.25 threads)
<
p95
17 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
47 file descriptors
<
mean
50.26 file descriptors
(SD =
9.58 file descriptors)
<
p95
66 file descriptors
Single-write, many-read
Creates an entry in the agent setup, then read one's own record back. This tests the maximum read performance for reading back local data when the chain is short.
Started
Tue, 17 Mar 2026 13:50:58 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
single_write_many_read_23194537823
read call timingThe time it takes to complete the zome call that retrieves the record.
mean
0.003921s
(SD =
0.016354s)
p50
0.00312s
p95
0.004669s
p99
0.006126s
read call rateThe number of read zome calls completed per second.
mean
2534.59/s
Error count
The number of errors collected.
0
Host Metrics
User CPU usage
CPU usage by user space
17.59%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 72 B/s
<
mean 164.36 KiB/s
(SD = 645.74 KiB/s)
<
p951.47 MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 232 B/s
<
mean 2.67 KiB/s
(SD = 7.95 KiB/s)
<
p9518.04 KiB/s
Total bytes received
Total bytes received on primary network interface
count
46.55 MiB
mean
164.36 KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
775.63 KiB
mean
2.67 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 1.61 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
21.21%
<
mean
25.28%
(SD =
6.5%)
<
p95
25.98%
System
7.69%
CPU percentiles
CPU usage percentiles
p50
24.67%
p95
25.98%
p99
58.70%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
16.93%
<
mean
17.73%
(SD =
0.65%)
<
p95
18.57%
Memory available percentage
Percentage of available memory
p5
81.43%
<
mean
82.27%
(SD =
0.65%)
<
p95
83.07%
Max host memory used
Maximum memory usage percentage across all hosts
max
17.73%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00%
Memory growth rate
Rate of memory growth over time
growth
1.61MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
6.42MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/1hosts
Mount Point
/efi-boot
0/1hosts
Mount Point
/nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.26
5 min
0.68
15 min
0.40
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.1193%
(SD =
0.2481%)
<
p95
0.69%
60 second average
0.1073%
300 second average
0.0577%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
3.61%
<
mean
9.846%
(SD =
10.4565%)
<
p95
36.96%
60 second average
10.0430%
300 second average
7.2393%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
3.54%
<
mean
8.8633%
(SD =
8.4721%)
<
p95
30.39%
60 second average
9.0923%
300 second average
6.6197%
Holochain process CPU usage
CPU usage by Holochain process
p5
15.33%
<
mean
21.84%
(SD =
6.09%)
<
p95
22.37%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 227.07 KiB
<
mean 238.77 KiB
(SD = 41.79 KiB)
<
p95256.08 KiB
Holochain process threads
Number of threads in Holochain process
p5
12 threads
≤
mean
11.8 threads
(SD =
1.08 threads)
<
p95
12 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
58 file descriptors
<
mean
59.13 file descriptors
(SD =
9.6 file descriptors)
<
p95
70 file descriptors
Two-party countersigning
This scenario tests the performance of countersigning operations. There are two roles: initiate and participate. The participants commit an entry to advertise that they are willing to participate in sessions. They listen for sessions and participate in one at a time.
Started
Tue, 17 Mar 2026 16:31:29 UTC
Peer count
3
Peer count at end
3
Behaviours
-
initiate(1 agent) -
participate(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
two_party_countersigning_23194537823
Session accepted -- timing
The duration of the session from acceptance to completion.
Mean
mean
1.424741s
(SD =
2.468815s)
Max
Highest per-partition mean latency
max mean
2.080363s
Min
Lowest per-partition mean latency
min mean
0.769119s
Session accepted -- success rate
The number of accepted sessions that completed per second.
Mean
mean
5.47/s
Max
Highest per-partition mean rate
max
5.8/s
Min
Lowest per-partition mean rate
min
5.14/s
Session accepted -- success ratio
Fraction of accepted sessions that completed successfully (0–1).
1
Session accepted -- failures
Accepted sessions that failed to complete.
Total
13
Agents affected
2 / 2
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
7
Max
Highest count in any single partition
9
Min
Lowest count in any single partition
4
Session initiated -- timing
The duration of the session from initiation to completion.
Mean
mean
1.678031s
(SD =
3.653684s)
Max
Highest per-partition mean latency
max mean
1.678031s
Min
Lowest per-partition mean latency
min mean
1.678031s
Session initiated -- success rate
The number of initiated sessions that completed per second.
Mean
mean
9.71/s
Max
Highest per-partition mean rate
max
9.71/s
Min
Lowest per-partition mean rate
min
9.71/s
Session initiated -- success ratio
Fraction of initiated sessions that completed successfully (0–1).
1
Session initiated -- failures
Initiated sessions that failed to complete.
Total
20
Agents affected
1 / 1
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
20
Max
Highest count in any single partition
20
Min
Lowest count in any single partition
20
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.182177s
(SD =
0.150976s)
p50
0.238469s
p95
0.442085s
p99
0.653254s
Request roundtrip duration: 'get_links'
The time spent sending a get_links request and awaiting its response
mean
0.315339s
(SD =
0s)
p50
0.315339s
p95
0.315339s
p99
0.315339s
Not enough time data to show a trend.
Request roundtrip duration: 'get_agent_activity'
The time spent sending a get_agent_activity request and awaiting its response
mean
0.245009s
(SD =
1.056377s)
p50
0.043713s
p95
0.714538s
p99
3.478582s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.245788s
(SD =
0.597091s)
p50
0.240711s
p95
0.420018s
p99
1.974519s
Request roundtrip duration: 'call_remote'
The time spent sending a call_remote request and awaiting its response
mean
0.44858s
(SD =
2.14606s)
p50
0.182103s
p95
0.913688s
p99
11.187487s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
2e-05s
(SD =
1.1e-05s)
p50
1.9e-05s
p95
3.6e-05s
p99
5.3e-05s
Handle incoming request duration: 'call_remote'
The time spent handling an incoming call_remote request
mean
0.007466s
(SD =
0.002737s)
p50
0.007607s
p95
0.010953s
p99
0.015513s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.000625s
(SD =
0.000278s)
p50
0.000603s
p95
0.00093s
p99
0.002036s
Handle incoming request duration: 'get_links'
The time spent handling an incoming get_links request
mean
0.006255s
(SD =
0.005305s)
p50
0.01156s
p95
0.01156s
p99
0.01156s
Handle incoming request duration: 'get_agent_activity'
The time spent handling an incoming get_agent_activity request
mean
0.003048s
(SD =
0.00264s)
p50
0.002421s
p95
0.007139s
p99
0.016281s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.002899s
(SD =
0.002518s)
p50
0.002211s
p95
0.006735s
p99
0.014008s
Handle incoming request duration: 'publish_counter_sign'
The time spent handling an incoming publish_counter_sign request
mean
8.3e-05s
(SD =
3.2e-05s)
p50
8.3e-05s
p95
0.000137s
p99
0.000173s
Handle incoming request duration: 'countersigning_session_negotiation'
The time spent handling an incoming countersigning_session_negotiation request
mean
4.3e-05s
(SD =
1.3e-05s)
p50
4.4e-05s
p95
6.2e-05s
p99
7.1e-05s
Host Metrics
User CPU usage
CPU usage by user space
2.67%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 1.67 KiB/s
<
mean 153.43 KiB/s
(SD = 646.15 KiB/s)
<
p95847.15 KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 1.55 KiB/s
<
mean 22.14 KiB/s
(SD = 23.92 KiB/s)
<
p9559.02 KiB/s
Total bytes received
Total bytes received on primary network interface
count
136.35 MiB
mean
450.40 KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
19.67 MiB
mean
64.98 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 50.57 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.91%
<
mean
4.75%
(SD =
8.59%)
<
p95
8.27%
System
2.08%
CPU percentiles
CPU usage percentiles
p50
3.34%
p95
8.27%
p99
78.58%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
8.52%
<
mean
19.45%
(SD =
10.13%)
<
p95
33.19%
Memory available percentage
Percentage of available memory
p5
66.81%
<
mean
80.55%
(SD =
10.13%)
<
p95
91.48%
Max host memory used
Maximum memory usage percentage across all hosts
max
32.95%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
2.79%
Memory growth rate
Rate of memory growth over time
growth
50.57MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
5.02MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/1hosts
Mount Point
/efi-boot
0/1hosts
Mount Point
/etc/hostname
0/2hosts
Mount Point
/etc/hosts
0/2hosts
Mount Point
/etc/resolv.conf
0/2hosts
Mount Point
/nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.54
5 min
0.35
15 min
0.28
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.692%
(SD =
2.7104%)
<
p95
2.44%
60 second average
0.6926%
300 second average
0.4979%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.0404%
(SD =
0.1141%)
<
p95
0.19%
60 second average
0.0356%
300 second average
0.0348%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.0236%
(SD =
0.0686%)
<
p95
0.18%
60 second average
0.0205%
300 second average
0.0206%
Holochain process CPU usage
CPU usage by Holochain process
p5
0%
<
mean
0.65%
(SD =
0.98%)
<
p95
3.18%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 248.79 KiB
<
mean 263.20 KiB
(SD = 13.71 KiB)
<
p95282.49 KiB
Holochain process threads
Number of threads in Holochain process
p5
1 threads
<
mean
12.2 threads
(SD =
8.33 threads)
<
p95
20 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0 file descriptors
<
mean
47.28 file descriptors
(SD =
34.99 file descriptors)
<
p95
84 file descriptors
Write/Query
Creates an entry, then queries the source chain and performs a simple operation on the entries, then repeats.
Started
Tue, 17 Mar 2026 14:04:27 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
write_query_23194537823
Write timing
The time it takes to complete the zome function call that writes the entry.
mean
0.011831s
(SD =
0.005046s)
p50
0.010695s
p95
0.018549s
p99
0.019494s
Write rate
The number of writes completed per second.
mean
146.93/s
Query timing
The time it takes to complete the
chain_query_count_len zome call that queries the source chain.
mean
0.056404s
(SD =
0.034484s)
p50
0.051307s
p95
0.118086s
p99
0.126907s
Query rate
The number of chain queries completed per second.
mean
146.9/s
Error count
The number of errors accumulated during the run.
0
Host Metrics
User CPU usage
CPU usage by user space
28.85%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 36 B/s
<
mean 150.99 KiB/s
(SD = 806.99 KiB/s)
≤
p952.70 KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 34 B/s
<
mean 4.47 KiB/s
(SD = 22.22 KiB/s)
≤
p95746 B/s
Total bytes received
Total bytes received on primary network interface
count
44.24 MiB
mean
150.99 KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.31 MiB
mean
4.47 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
33.19%
<
mean
35.72%
(SD =
1.08%)
<
p95
36.6%
System
6.87%
CPU percentiles
CPU usage percentiles
p50
36.24%
p95
36.60%
p99
36.66%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
6.09%
<
mean
6.33%
(SD =
0.6%)
<
p95
6.77%
Memory available percentage
Percentage of available memory
p5
93.23%
<
mean
93.67%
(SD =
0.6%)
<
p95
93.91%
Max host memory used
Maximum memory usage percentage across all hosts
max
6.33%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00%
Memory growth rate
Rate of memory growth over time
growth
-4.59MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
2.07MB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.05
5 min
0.48
15 min
0.19
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.2413%
(SD =
0.3595%)
<
p95
0.99%
60 second average
0.2394%
300 second average
0.1400%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.1639%
(SD =
0.5138%)
<
p95
1.01%
60 second average
0.1287%
300 second average
0.0665%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.1271%
(SD =
0.4119%)
<
p95
0.81%
60 second average
0.0974%
300 second average
0.0461%
Holochain process CPU usage
CPU usage by Holochain process
p5
31.93%
<
mean
35.06%
(SD =
1.33%)
<
p95
36.07%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 238.30 KiB
<
mean 250.80 KiB
(SD = 7.07 KiB)
<
p95261.73 KiB
Holochain process threads
Number of threads in Holochain process
p5
13 threads
≤
mean
13 threads
(SD =
0 threads)
≤
p95
13 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
62 file descriptors
<
mean
64.4 file descriptors
(SD =
4.8 file descriptors)
<
p95
74 file descriptors
Write/Read
Creates an entry and reads it back, then repeats.
Started
Tue, 17 Mar 2026 14:17:43 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
write_read_23194537823
Write timing
The time taken to write the entry.
mean
0.028086s
(SD =
0.016193s)
p50
0.022654s
p95
0.058039s
p99
0.080376s
Write rate
The number of writes completed per second.
mean
157.57/s
Read timing
The time taken to read the entry.
mean
0.034584s
(SD =
0.02574s)
p50
0.024783s
p95
0.081045s
p99
0.104323s
Read rate
The number of reads completed per second.
mean
157.57/s
Error count
The number of errors accumulated over the run.
0
Host Metrics
User CPU usage
CPU usage by user space
52.41%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 841 B/s
<
mean 670.23 KiB/s
(SD = 2.09 MiB/s)
<
p952.98 MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 18.02 KiB/s
<
mean 234.53 KiB/s
(SD = 194.10 KiB/s)
<
p95559.21 KiB/s
Total bytes received
Total bytes received on primary network interface
count
189.81 MiB
mean
670.23 KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
66.42 MiB
mean
234.53 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 517.32 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
41.62%
<
mean
68.85%
(SD =
17.01%)
<
p95
84.13%
System
16.44%
CPU percentiles
CPU usage percentiles
p50
80.73%
p95
84.13%
p99
89.09%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1 hosts
mean time
0.55s
Memory used percentage
Percentage of memory used
p5
17.8%
<
mean
21.08%
(SD =
2.28%)
<
p95
23.32%
Memory available percentage
Percentage of available memory
p5
76.68%
<
mean
78.92%
(SD =
2.28%)
<
p95
82.2%
Max host memory used
Maximum memory usage percentage across all hosts
max
21.08%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00%
Memory growth rate
Rate of memory growth over time
growth
517.32MB/s
Disk read throughput
Disk read throughput in MB/s
0.03MB/s
Disk write throughput
Disk write throughput in MB/s
27.55MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname
0/1hosts
Mount Point
/etc/hosts
0/1hosts
Mount Point
/etc/resolv.conf
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.82
5 min
1.60
15 min
0.61
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
4.03%
<
mean
27.689%
(SD =
18.7859%)
<
p95
48.41%
60 second average
21.0133%
300 second average
8.3573%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.59%
<
mean
1.1887%
(SD =
0.4628%)
<
p95
2.18%
60 second average
1.0123%
300 second average
0.4733%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.01%
<
mean
0.478%
(SD =
0.3445%)
<
p95
0.99%
60 second average
0.4530%
300 second average
0.2357%
Holochain process CPU usage
CPU usage by Holochain process
p5
34.63%
<
mean
41.33%
(SD =
3.05%)
<
p95
45.56%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 243.30 KiB
<
mean 275.97 KiB
(SD = 31.96 KiB)
<
p95324.51 KiB
Holochain process threads
Number of threads in Holochain process
p5
13 threads
<
mean
23.37 threads
(SD =
9.75 threads)
<
p95
35 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
60 file descriptors
<
mean
73.17 file descriptors
(SD =
13.17 file descriptors)
<
p95
90 file descriptors
Write validated
Creates an entry, updates it and links the create to the update, then repeats. Each of the three actions is validated by the included hApp.
Started
Tue, 17 Mar 2026 14:31:12 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
write_validated_23194537823
Write timing
The time it takes to complete the zome function call that writes the entry, updates it, and links to the update.
mean
0.039575s
(SD =
0.019087s)
p50
0.036567s
p95
0.077627s
p99
0.08682s
Write rate
The number of write zome function calls that complete per second.
mean
102.79/s
Read timing
The time it takes to complete the zome function call that reads the data.
mean
0.057302s
(SD =
0.018848s)
p50
0.05565s
p95
0.09522s
p99
0.118796s
Read rate
The number of read zome function calls that complete per second.
mean
102.82/s
Error count
The number of errors accumulated over the run.
0
Host Metrics
User CPU usage
CPU usage by user space
42.66%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 23 B/s
<
mean 223 B/s
(SD = 358 B/s)
<
p95662 B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 38 B/s
<
mean 201 B/s
(SD = 138 B/s)
<
p95512 B/s
Total bytes received
Total bytes received on primary network interface
count
63.21 KiB
mean
223 B/s
Total bytes sent
Total bytes sent on primary network interface
count
56.98 KiB
mean
201 B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
39.18%
<
mean
51.95%
(SD =
4.79%)
<
p95
55.54%
System
9.29%
CPU percentiles
CPU usage percentiles
p50
53.20%
p95
55.54%
p99
56.68%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
7.07%
<
mean
7.26%
(SD =
0.14%)
<
p95
7.42%
Memory available percentage
Percentage of available memory
p5
92.58%
<
mean
92.74%
(SD =
0.14%)
<
p95
92.93%
Max host memory used
Maximum memory usage percentage across all hosts
max
7.26%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00%
Memory growth rate
Rate of memory growth over time
growth
-49.94MB/s
Disk read throughput
Disk read throughput in MB/s
0.03MB/s
Disk write throughput
Disk write throughput in MB/s
2.96MB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.81
5 min
0.85
15 min
0.33
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.74%
<
mean
1.7747%
(SD =
0.6068%)
<
p95
2.61%
60 second average
1.5417%
300 second average
0.7467%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.1113%
(SD =
0.2479%)
<
p95
0.49%
60 second average
0.0960%
300 second average
0.0507%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.079%
(SD =
0.2297%)
<
p95
0.44%
60 second average
0.0687%
300 second average
0.0370%
Holochain process CPU usage
CPU usage by Holochain process
p5
37.75%
<
mean
50.97%
(SD =
4.99%)
<
p95
54.71%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 465.90 KiB
≤
mean 465.53 KiB
(SD = 35.05 KiB)
<
p95474.38 KiB
Holochain process threads
Number of threads in Holochain process
p5
13 threads
<
mean
13.73 threads
(SD =
0.68 threads)
<
p95
14 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
64 file descriptors
<
mean
66.4 file descriptors
(SD =
3.26 file descriptors)
<
p95
74 file descriptors
Zero-Arc Create and Read
A zero-arc/full-arc mixed scenario with two types of zero-arc nodes -- ones that create data and ones that read data -- as well as full arc nodes to "relay" the data. The scenario has three roles:
zero_write: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so thatzero_readnodes can retrieve them.zero_read: A zero-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.full: A full-arc conductor that is just here to serve entries to zero arc nodes.
Started
Tue, 17 Mar 2026 17:17:02 UTC
Peer count
9
Peer count at end
25
Behaviours
-
full(1 agent) -
zero_read(1 agent) -
zero_write(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
zero_arc_create_and_read_23194537823
Create rate
The number of timed entries created by the zero-arc write node(s) per second.
Mean
mean
50.6/s
Max
Highest per-partition mean rate
max
74.48/s
Min
Lowest per-partition mean rate
min
26.72/s
Fetch lag timing
For each entry, the time lag between when it was created and when a zero-arc read node fetched it from the network via the
get_timed_entries_network zome function.Mean
mean
30.242569s
(SD =
16.908397s)
Max
Highest per-partition mean latency
max mean
35.22848s
Min
Lowest per-partition mean latency
min mean
25.813193s
Fetch lag rate
The number of entries per second fetched by zero-arc read nodes.
Mean
mean
14.61/s
Max
Highest per-partition mean rate
max
16.78/s
Min
Lowest per-partition mean rate
min
12.64/s
Open connections
The number of currently open connections to other conductors.
full-arc
p5
5
<
mean
6.36
(SD =
0.8)
<
p95
7
zero-arc
p5
0
<
mean
5.35
(SD =
1.73)
<
p95
6
Error count
The number of errors accumulated across all nodes.
0
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.092607s
(SD =
0.596802s)
p50
0.024346s
p95
0.142674s
p99
0.432915s
Request roundtrip duration: 'get_links'
The time spent sending a get_links request and awaiting its response
mean
0.048784s
(SD =
0.051304s)
p50
0.02425s
p95
0.10571s
p99
0.282583s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.768621s
(SD =
1.15637s)
p50
0.285933s
p95
3.179114s
p99
7.506848s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
3.3e-05s
(SD =
2.8e-05s)
p50
3e-05s
p95
5.8e-05s
p99
8.7e-05s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.000357s
(SD =
0.001049s)
p50
0.000232s
p95
0.000875s
p99
0.001966s
Handle incoming request duration: 'get_links'
The time spent handling an incoming get_links request
mean
0.000482s
(SD =
0.000879s)
p50
0.000289s
p95
0.001101s
p99
0.00505s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.701177s
(SD =
1.13443s)
p50
0.252776s
p95
3.093974s
p99
7.428904s
Zero-Arc Create Data
A zero-arc/full-arc mixed scenario where zero-arc nodes create data and full-arc nodes read the data. The scenario has two roles:
zero: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so that full-arc nodes can retrieve them.full: A full-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Tue, 17 Mar 2026 16:45:55 UTC
Peer count
10
Peer count at end
28
Behaviours
-
full(1 agent) -
zero(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
zero_arc_create_data_23194537823
Create rate
The number of timed entries created by the zero-arc node(s) per second.
Mean
mean
129.18/s
Max
Highest per-partition mean rate
max
242.23/s
Min
Lowest per-partition mean rate
min
38.96/s
Sync lag timing
For each entry, the time lag between when it was created and when the full-arc node could read it via the
get_timed_local_entries zome function.Mean
mean
145.642538s
(SD =
34.360689s)
Max
Highest per-partition mean latency
max mean
186.464197s
Min
Lowest per-partition mean latency
min mean
114.110186s
Sync lag rate
The number of entries per second received by full nodes.
Mean
mean
11.54/s
Max
Highest per-partition mean rate
max
18.44/s
Min
Lowest per-partition mean rate
min
7.5/s
Open connections
The number of currently open connections to other conductors.
full-arc
p5
3
<
mean
5.96
(SD =
1.71)
<
p95
8
zero-arc
p5
1
<
mean
5.62
(SD =
1.65)
<
p95
8
Error count
The number of errors accumulated across all nodes.
1
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.033872s
(SD =
0.013812s)
p50
0.029969s
p95
0.053263s
p99
0.061545s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.104211s
(SD =
0.51048s)
p50
0.03602s
p95
0.148093s
p99
1.797324s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
1.2e-05s
(SD =
4.1e-05s)
p50
8e-06s
p95
3.1e-05s
p99
9.1e-05s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.000876s
(SD =
0.003872s)
p50
0.000426s
p95
0.001659s
p99
0.004411s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.077718s
(SD =
0.529411s)
p50
0.006747s
p95
0.111444s
p99
1.768581s
Host Metrics
User CPU usage
CPU usage by user space
16.20%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 1.22 KiB/s
<
mean 138.43 KiB/s
(SD = 613.74 KiB/s)
<
p95414.15 KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 366 B/s
<
mean 50.66 KiB/s
(SD = 87.54 KiB/s)
<
p95225.47 KiB/s
Total bytes received
Total bytes received on primary network interface
count
608.35 MiB
mean
348.02 KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
222.64 MiB
mean
127.37 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 92.1%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 181.60 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Warning Moderate swap usage (16.6% swap used)
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.5%
<
mean
19.76%
(SD =
24.32%)
<
p95
74.12%
System
3.55%
CPU percentiles
CPU usage percentiles
p50
7.31%
p95
74.12%
p99
92.08%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1 hosts
mean time
0.67s
Memory used percentage
Percentage of memory used
p5
9.64%
<
mean
16.55%
(SD =
7.72%)
<
p95
31.83%
Memory available percentage
Percentage of available memory
p5
68.21%
<
mean
83.45%
(SD =
7.72%)
<
p95
90.36%
Max host memory used
Maximum memory usage percentage across all hosts
max
31.94%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
16.55%
Memory growth rate
Rate of memory growth over time
growth
181.60MB/s
Disk read throughput
Disk read throughput in MB/s
0.13MB/s
Disk write throughput
Disk write throughput in MB/s
162.19MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/4hosts
Mount Point
/efi-boot
0/3hosts
Mount Point
/etc/hostname
0/4hosts
Mount Point
/etc/hosts
0/4hosts
Mount Point
/etc/resolv.conf
0/4hosts
Mount Point
/nix/store
0/4hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.37
5 min
0.68
15 min
0.37
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
4.1247%
(SD =
12.1217%)
<
p95
35.6%
60 second average
3.4581%
300 second average
1.5755%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
12.5352%
(SD =
17.5981%)
<
p95
47.34%
60 second average
10.5253%
300 second average
5.3035%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
11.0221%
(SD =
16.6379%)
<
p95
46.03%
60 second average
9.2409%
300 second average
4.6879%
Holochain process CPU usage
CPU usage by Holochain process
p5
4.53%
<
mean
29.94%
(SD =
24.05%)
<
p95
87.92%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 211.89 KiB
<
mean 281.68 KiB
(SD = 63.04 KiB)
<
p95363.85 KiB
Holochain process threads
Number of threads in Holochain process
p5
10 threads
<
mean
27.84 threads
(SD =
11.42 threads)
<
p95
44 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
61 file descriptors
<
mean
73.91 file descriptors
(SD =
15.81 file descriptors)
<
p95
86 file descriptors
Zero-arc Create Data (Validated)
A zero-arc/full-arc mixed scenario where zero-arc nodes create data that gets validated and full-arc nodes read the data. The scenario has two roles:
zero: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so that full-arc nodes can retrieve them.full: A full-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Tue, 17 Mar 2026 17:02:01 UTC
Peer count
10
Peer count at end
28
Behaviours
-
full(1 agent) -
zero(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
zero_arc_create_data_validated_23194537823
Create rate
The number of timed entries created by the zero-arc node(s) per second.
Mean
mean
76.1/s
Max
Highest per-partition mean rate
max
118.08/s
Min
Lowest per-partition mean rate
min
23/s
Sync lag timing
For each entry, the time lag between when it was created and when the full-arc node could read it via the
get_timed_local_entries zome function.Mean
mean
59.91926s
(SD =
26.783048s)
Max
Highest per-partition mean latency
max mean
109.715175s
Min
Lowest per-partition mean latency
min mean
37.03059s
Sync lag rate
The number of entries per second received by full nodes.
Mean
mean
5.25/s
Max
Highest per-partition mean rate
max
9.86/s
Min
Lowest per-partition mean rate
min
1.8/s
Open connections
The number of currently open connections to other conductors.
full-arc
p5
6
<
mean
7.44
(SD =
1.44)
<
p95
9
zero-arc
p5
0
<
mean
5.19
(SD =
2.2)
<
p95
8
App validation workflow duration
The time taken to apply app validation to the data.
mean
0.223115s
(SD =
2.289965s)
p50
0.01711s
p95
0.454405s
p99
2.656934s
System validation workflow duration
The time taken to apply system validation to the data.
mean
0.049969s
(SD =
0.458171s)
p50
0.010368s
p95
0.081699s
p99
0.303055s
Error count
The number of errors accumulated across all nodes.
0
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.028428s
(SD =
0.012312s)
p50
0.030111s
p95
0.042307s
p99
0.077043s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.049322s
(SD =
0.133776s)
p50
0.032785s
p95
0.089003s
p99
0.290474s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
9e-06s
(SD =
3e-05s)
p50
7e-06s
p95
1.5e-05s
p99
4e-05s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.000676s
(SD =
0.00236s)
p50
0.000226s
p95
0.002047s
p99
0.010431s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.020756s
(SD =
0.098986s)
p50
0.009452s
p95
0.038373s
p99
0.234159s
Host Metrics
User CPU usage
CPU usage by user space
38.62%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 1.11 KiB/s
<
mean 250.99 KiB/s
(SD = 821.22 KiB/s)
<
p951.34 MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 1.25 KiB/s
<
mean 62.41 KiB/s
(SD = 58.09 KiB/s)
<
p95167.28 KiB/s
Total bytes received
Total bytes received on primary network interface
count
745.14 MiB
mean
2.33 MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
185.28 MiB
mean
592.88 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 99.2%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 649.06 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (21.3% swap used)
System overload anomaly
System overload anomaly was detected
Detected
Warning 10% of hosts overloaded (load5/ncpus > 1.0)
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
9.37%
<
mean
52.54%
(SD =
32.26%)
<
p95
98.8%
System
13.92%
CPU percentiles
CPU usage percentiles
p50
41.10%
p95
98.80%
p99
99.20%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
5 hosts
mean time
0.55s
Memory used percentage
Percentage of memory used
p5
11.05%
<
mean
23.43%
(SD =
9.57%)
<
p95
42.99%
Memory available percentage
Percentage of available memory
p5
57.01%
<
mean
76.57%
(SD =
9.57%)
<
p95
88.95%
Max host memory used
Maximum memory usage percentage across all hosts
max
42.83%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
21.30%
Memory growth rate
Rate of memory growth over time
growth
649.06MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
110.35MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/5hosts
Mount Point
/boot
0/1hosts
Mount Point
/efi-boot
0/3hosts
Mount Point
/etc/hostname
0/4hosts
Mount Point
/etc/hosts
0/4hosts
Mount Point
/etc/resolv.conf
0/4hosts
Mount Point
/nix/store
0/5hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.52
5 min
1.19
15 min
0.60
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
10.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.14%
<
mean
22.6804%
(SD =
31.2342%)
<
p95
92.17%
60 second average
18.5628%
300 second average
8.5019%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.0102%
(SD =
0.0821%)
≤
p95
0%
60 second average
0.0092%
300 second average
0.0048%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.0032%
(SD =
0.0255%)
≤
p95
0%
60 second average
0.0026%
300 second average
0.0004%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
13.0888%
(SD =
16.3606%)
<
p95
44.95%
60 second average
10.7674%
300 second average
5.7830%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
11.2209%
(SD =
15.3258%)
<
p95
43.16%
60 second average
9.3082%
300 second average
5.0919%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.7%
<
mean
43.41%
(SD =
30.55%)
<
p95
89.44%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 203.51 KiB
<
mean 451.61 KiB
(SD = 105.89 KiB)
<
p95564.19 KiB
Holochain process threads
Number of threads in Holochain process
p5
10 threads
<
mean
22.55 threads
(SD =
9.08 threads)
<
p95
40 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
50 file descriptors
<
mean
73.38 file descriptors
(SD =
14.11 file descriptors)
<
p95
87 file descriptors
Zome Call, Single Value
Calls a zome function that returns a fixed value. This tests the maximum performance of zome calls when the zome function is not calling into Holochain other otherwise doing any work.
Started
Tue, 17 Mar 2026 14:44:28 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
zome_call_single_value_23194537823
Call timing
The time taken for the call to complete.
mean
0.003183s
(SD =
0.013804s)
p50
0.002467s
p95
0.002735s
p99
0.00727s
Call rate
The number of zome calls completed per second.
mean
3125.64/s
Error count
The number of errors accumulated during the run.
0
Host Metrics
User CPU usage
CPU usage by user space
15.84%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5 35 B/s
<
mean 205.28 KiB/s
(SD = 875.07 KiB/s)
<
p951.59 MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5 111 B/s
<
mean 3.82 KiB/s
(SD = 13.36 KiB/s)
<
p9529.29 KiB/s
Total bytes received
Total bytes received on primary network interface
count
62.15 MiB
mean
205.28 KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.16 MiB
mean
3.82 KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 197.23 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
21.52%
<
mean
24.04%
(SD =
3.71%)
<
p95
33.62%
System
8.21%
CPU percentiles
CPU usage percentiles
p50
24.20%
p95
33.62%
p99
36.38%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
14.64%
<
mean
18.05%
(SD =
1.25%)
<
p95
19.35%
Memory available percentage
Percentage of available memory
p5
80.65%
<
mean
81.95%
(SD =
1.25%)
<
p95
85.36%
Max host memory used
Maximum memory usage percentage across all hosts
max
18.05%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.01%
Memory growth rate
Rate of memory growth over time
growth
197.23MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
7.01MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/1hosts
Mount Point
/efi-boot
0/1hosts
Mount Point
/nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.21
5 min
0.65
15 min
0.33
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.1063%
(SD =
0.2316%)
<
p95
0.62%
60 second average
0.1075%
300 second average
0.0575%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
4.64%
<
mean
9.2378%
(SD =
7.2517%)
<
p95
28.07%
60 second average
8.5672%
300 second average
5.7681%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
4.53%
<
mean
8.6713%
(SD =
6.3544%)
<
p95
25.97%
60 second average
7.9744%
300 second average
5.3831%
Holochain process CPU usage
CPU usage by Holochain process
p5
18.55%
<
mean
20.8%
(SD =
2.46%)
<
p95
21.65%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5 229.78 KiB
≤
mean 228.73 KiB
(SD = 17.16 KiB)
<
p95232.98 KiB
Holochain process threads
Number of threads in Holochain process
p5
11 threads
<
mean
11.13 threads
(SD =
0.72 threads)
≤
p95
11 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
46 file descriptors
<
mean
50 file descriptors
(SD =
7.28 file descriptors)
<
p95
64 file descriptors