App Install
Measure app installation speed. This scenario has two roles:
minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.
These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.
Started
Thu, 12 Mar 2026 01:13:26 UTC
Peer count
1
Peer count at end
1
Behaviours
-
large(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
app_install_large_22981335548
First install time
The time from conductor startup to completion of the first app installation attempt.
2.611270663s
Install app timing
The time taken to install an app.
mean
0.773952s
(SD =
0.553593s)
p50
0.450146s
p95
1.789293s
p99
2.497095s
Host Metrics
User CPU usage
CPU usage by user space
11.48%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
7585.2B/s
<
mean
345330.33B/s
(SD =
898423.55B/s)
<
p95
3.6731058e+06B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
3582.9B/s
<
mean
11081.64B/s
(SD =
13134.7B/s)
<
p95
58647.5B/s
Total bytes received
Total bytes received on primary network interface
count
62159459B
mean
345330.33B/s
Total bytes sent
Total bytes sent on primary network interface
count
1994696B
mean
11081.64B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 981.42 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
5.85%
<
mean
13.59%
(SD =
13.4%)
<
p95
68.04%
System
2.10%
CPU percentiles
CPU usage percentiles
p50
11.14%
p95
68.04%
p99
68.04%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
11.34%
<
mean
20.05%
(SD =
3.73%)
<
p95
25.06%
Memory available percentage
Percentage of available memory
p5
74.94%
<
mean
79.95%
(SD =
3.73%)
<
p95
88.66%
Max host memory used
Maximum memory usage percentage across all hosts
max
20.05%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.01%
Memory growth rate
Rate of memory growth over time
growth
981.42MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
3.92MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/1hosts
Mount Point
/efi-boot
0/1hosts
Mount Point
/nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.55
5 min
0.88
15 min
0.64
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.1458%
(SD =
0.2834%)
<
p95
1.23%
60 second average
0.1337%
300 second average
0.0553%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
28.62%
<
mean
38.9432%
(SD =
6.4956%)
<
p95
49.23%
60 second average
29.4279%
300 second average
16.9958%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
22.29%
<
mean
37.4468%
(SD =
7.3738%)
<
p95
48.55%
60 second average
28.1489%
300 second average
16.2647%
Holochain process CPU usage
CPU usage by Holochain process
p5
4.81%
<
mean
12.13%
(SD =
13.37%)
<
p95
65.09%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
62577B
<
mean
703344.06B
(SD =
263177.73B)
<
p95
1.115172e+06B
Holochain process threads
Number of threads in Holochain process
p5
8 threads
<
mean
17.83 threads
(SD =
2.43 threads)
<
p95
19 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
48 file descriptors
<
mean
424.17 file descriptors
(SD =
173.73 file descriptors)
<
p95
618 file descriptors
DHT Sync Lag
Measure lag time between an agent publishing data and other peers being able to see it. This scenario has two roles:
write: A simple job that just creates entries with a timestamp field. Those entries are linked to a known base hash. For each write, the metricws.custom.dht_sync_sent_countis incremented.record_lag: A job that repeatedly queries for links from the known base hash. It keeps track of records that it has seen and when a new record is found, and calculates the time difference between the timestamp of the new record and the current time. That time difference is then recorded as a custom metric calledwt.custom.dht_sync_lag.
After each behaviour loop the metric ws.custom.dht_sync_recv_count is incremented.
Started
Thu, 12 Mar 2026 01:20:09 UTC
Peer count
10
Peer count at end
10
Behaviours
-
record_lag(1 agent) -
write(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
dht_sync_lag_22981335548
Create rate
The average number of created records per agent.
Mean
mean
31.02/s
Max
Highest per-partition mean rate
max
43.41/s
Min
Lowest per-partition mean rate
min
20.44/s
Sync lag timing
The average time between when a record was created and when it is first seen by an agent.
Mean
mean
3.695775128218749e+31s
(SD =
9.670260513274271e+31s)
Max
Highest per-partition mean latency
max mean
5.816552432092011e+31s
Min
Lowest per-partition mean latency
min mean
7.291765005448682e+30s
Sync lag rate
The average number of created records discovered per agent.
Mean
mean
136.21/s
Max
Highest per-partition mean rate
max
231.11/s
Min
Lowest per-partition mean rate
min
37.27/s
Error count
The number of errors encountered during the scenario.
5
Cascade duration
The time taken to execute a cascade query.
mean
0.002699s
(SD =
0.007904s)
p50
0.00098s
p95
0.011858s
p99
0.03978s
WASM usage
The metered usage of a wasm ribosome.
Total
total
76970over 374.283301147s
mean rate
6.7980206238e+08/s
std
1.288263237606e+10/s
p5
0/s
p95
7.9658718881e+08/s
peak
1.36003388786198e+12/s
zome=timed,fn=created_timed_entry
total
0over 359.793082422s
Not enough time data to show a trend.
zome=timed,fn=get_timed_entries_local
total
49761857over 323.516576849s
mean rate
2.3281110334e+08/s
std
4.14116194682e+09/s
p5
0/s
p95
3.8903765372e+08/s
peak
2.8323917941421e+11/s
zome=timed_integrity,fn=entry_defs
total
0over 374.282631352s
Not enough time data to show a trend.
post_commit durationThe time spent executing a post commit.
mean
0.000498s
(SD =
0.000537s)
p50
0.000345s
p95
0.001386s
p99
0.002755s
Publish DHT ops workflow duration
The time spent running the publish workflow.
mean
0.062291s
(SD =
0.209456s)
p50
0.026954s
p95
0.139687s
p99
0.760792s
Integrate DHT ops workflow duration
The time spent running the integration workflow.
mean
0.023702s
(SD =
0.144707s)
p50
0.002411s
p95
0.02333s
p99
0.667847s
Countersigning workflow duration
Duration
mean
0.000955s
(SD =
0.000479s)
p50
0.000828s
p95
0.001965s
p99
0.001965s
App validation workflow duration
The time spent running the app validation workflow.
mean
0.293155s
(SD =
1.439956s)
p50
0.00286s
p95
1.490993s
p99
6.793688s
System validation workflow duration
The time spent running the sys validation workflow.
mean
0.135729s
(SD =
0.749606s)
p50
0.011052s
p95
0.589048s
p99
1.96112s
Validation receipt workflow duration
The time spent running the validation receipt workflow.
mean
4.015559s
(SD =
23.74902s)
p50
0.003735s
p95
8.211965s
p99
170.407906s
Authored DB
The utilization of connections in the authored database connection pool.
Utilisation
p5
0%
<
mean
0.07%
(SD =
0.07%)
<
p95
0.22%
Use time
mean
0.002473s
(SD =
0.007747s)
p50
0.000801s
p95
0.011231s
p99
0.038042s
Conductor DB
The utilization of connections in the conductor database connection pool.
Utilisation
p5
0%
≤
mean
0%
(SD =
0.01%)
≤
p95
0%
Use time
mean
0.000153s
(SD =
0.000326s)
p50
7.1e-05s
p95
0.000458s
p99
0.001568s
DHT DB
The utilization of connections in the DHT database connection pool.
Utilisation
p5
0.11%
<
mean
0.15%
(SD =
0.08%)
<
p95
0.33%
Use time
mean
0.001337s
(SD =
0.005265s)
p50
0.000356s
p95
0.002921s
p99
0.023196s
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.038461s
(SD =
0.085725s)
p50
0.028649s
p95
0.066611s
p99
0.371493s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.926781s
(SD =
1.657877s)
p50
0.449496s
p95
3.081972s
p99
7.855829s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
1.7e-05s
(SD =
5.2e-05s)
p50
1.1e-05s
p95
3e-05s
p99
0.000107s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.000964s
(SD =
0.003904s)
p50
0.000598s
p95
0.002428s
p99
0.00503s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.887759s
(SD =
1.653473s)
p50
0.413026s
p95
3.010079s
p99
7.810612s
Host Metrics
User CPU usage
CPU usage by user space
24.91%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
52366.7B/s
<
mean
463491.03B/s
(SD =
1.43097691e+06B/s)
<
p95
2.0723165e+06B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
21552.4B/s
<
mean
112894.26B/s
(SD =
123221.92B/s)
<
p95
310860.6B/s
Total bytes received
Total bytes received on primary network interface
count
1422917459B
mean
4311871.09B/s
Total bytes sent
Total bytes sent on primary network interface
count
346585364B
mean
1050258.68B/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.2%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 178.05 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
9.43%
<
mean
29.15%
(SD =
19.69%)
<
p95
75.52%
System
4.24%
CPU percentiles
CPU usage percentiles
p50
26.64%
p95
75.52%
p99
98.20%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1 hosts
mean time
0.38s
Memory used percentage
Percentage of memory used
p5
8.87%
<
mean
17.14%
(SD =
5.36%)
<
p95
31.35%
Memory available percentage
Percentage of available memory
p5
68.65%
<
mean
82.86%
(SD =
5.36%)
<
p95
91.13%
Max host memory used
Maximum memory usage percentage across all hosts
max
31.51%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.09%
Memory growth rate
Rate of memory growth over time
growth
178.05MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
142.62MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/5hosts
Mount Point
/boot
0/1hosts
Mount Point
/efi-boot
0/4hosts
Mount Point
/etc/hostname
0/5hosts
Mount Point
/etc/hosts
0/5hosts
Mount Point
/etc/resolv.conf
0/5hosts
Mount Point
/nix/store
0/5hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.20
5 min
1.10
15 min
0.52
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
5.5628%
(SD =
9.1361%)
<
p95
31.85%
60 second average
4.6886%
300 second average
2.5296%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.006%
(SD =
0.0601%)
≤
p95
0%
60 second average
0.0065%
300 second average
0.0031%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.0056%
(SD =
0.0555%)
≤
p95
0%
60 second average
0.0059%
300 second average
0.0026%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.07%
<
mean
24.7849%
(SD =
16.41%)
<
p95
47.21%
60 second average
21.4129%
300 second average
11.4038%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.03%
<
mean
21.2311%
(SD =
14.7633%)
<
p95
41.58%
60 second average
18.3353%
300 second average
9.8598%
Holochain process CPU usage
CPU usage by Holochain process
p5
8.6%
<
mean
26.92%
(SD =
19.07%)
<
p95
71.03%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
242016B
<
mean
278427.47B
(SD =
38821.55B)
<
p95
312882B
Holochain process threads
Number of threads in Holochain process
p5
17 threads
<
mean
30.27 threads
(SD =
9.47 threads)
<
p95
55 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
70 file descriptors
<
mean
77.26 file descriptors
(SD =
14.03 file descriptors)
<
p95
88 file descriptors
First Call
This scenario installs a simple app which implements the init callback, and measures the time elapsed between start of install and calling init. It will uninstall the app it installed so that it can re-install it on the next iteration. This is required to re-run the initialisation callback.
Started
Thu, 12 Mar 2026 00:43:13 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
first_call_22981335548
Zome call timing
The time elapsed between start of install and calling
init.
mean
0.005775s
(SD =
0.001566s)
p50
0.005444s
p95
0.006969s
p99
0.016842s
Host Metrics
User CPU usage
CPU usage by user space
13.52%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
2249.4B/s
<
mean
81255.62B/s
(SD =
378488.45B/s)
<
p95
146359.4B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
965.8B/s
<
mean
9124.12B/s
(SD =
15221.53B/s)
<
p95
50721B/s
Total bytes received
Total bytes received on primary network interface
count
23564131B
mean
81255.62B/s
Total bytes sent
Total bytes sent on primary network interface
count
2645995B
mean
9124.12B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 145.57 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Warning Moderate swap usage (11.5% swap used)
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
17.95%
<
mean
23.71%
(SD =
5.71%)
<
p95
30.74%
System
10.18%
CPU percentiles
CPU usage percentiles
p50
21.11%
p95
30.74%
p99
34.78%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
38.11%
<
mean
41.67%
(SD =
1.3%)
<
p95
42.26%
Memory available percentage
Percentage of available memory
p5
57.74%
<
mean
58.33%
(SD =
1.3%)
<
p95
61.89%
Max host memory used
Maximum memory usage percentage across all hosts
max
41.67%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
11.54%
Memory growth rate
Rate of memory growth over time
growth
145.57MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
8.34MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname
0/1hosts
Mount Point
/etc/hosts
0/1hosts
Mount Point
/etc/resolv.conf
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
5.12
5 min
3.26
15 min
3.19
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
1%
<
mean
8.7387%
(SD =
7.5026%)
<
p95
17.08%
60 second average
6.2647%
300 second average
2.4193%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.0183%
(SD =
0.0545%)
<
p95
0.18%
60 second average
0.0137%
300 second average
0.0013%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.0087%
(SD =
0.0337%)
<
p95
0.06%
60 second average
0.0033%
300 second average
0.0000%
Holochain process CPU usage
CPU usage by Holochain process
p5
7.32%
<
mean
11.43%
(SD =
4.89%)
<
p95
17.94%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
473946B
<
mean
707443.97B
(SD =
118560.01B)
<
p95
740094B
Holochain process threads
Number of threads in Holochain process
p5
21 threads
<
mean
21.03 threads
(SD =
0.18 threads)
≤
p95
21 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
41 file descriptors
<
mean
237.5 file descriptors
(SD =
366.46 file descriptors)
<
p95
1024 file descriptors
Full-Arc Create (Validated) / Zero-Arc Read
A full-arc/zero-arc mixed scenario where full-arc nodes create data that gets validated and zero-arc nodes read the data. The scenario has two roles:
full: A full-arc conductor that creates entries with a timestamp field. Those entries get validated and then retrieved by zero-arc nodes.zero: A zero-arc conductor that reads the entries created by the full-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Thu, 12 Mar 2026 01:51:27 UTC
Peer count
10
Peer count at end
10
Behaviours
-
full(1 agent) -
zero(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
full_arc_create_validated_zero_arc_read_22981335548
Create rate
The number of timed entries created by the full-arc node(s) per second.
Mean
mean
79.68/s
Max
Highest per-partition mean rate
max
156.93/s
Min
Lowest per-partition mean rate
min
15.85/s
Fetch lag timing
For each entry, the time lag between when it was created by a full-arc node and when a zero-arc node fetched it from the network.
Mean
mean
132.786922s
(SD =
46.397513s)
Max
Highest per-partition mean latency
max mean
304.5282s
Min
Lowest per-partition mean latency
min mean
34.075037s
Fetch rate
The number of entries per second fetched by zero-arc nodes.
Mean
mean
40.02/s
Max
Highest per-partition mean rate
max
64/s
Min
Lowest per-partition mean rate
min
0/s
Open connections
The number of currently open connections to other conductors.
full-arc
p5
6
<
mean
7.57
(SD =
1.24)
<
p95
8
zero-arc
p5
4
<
mean
4.22
(SD =
0.84)
<
p95
5
Retrieval errors
Errors encountered by zero-arc nodes when attempting to retrieve entries created by full-arc nodes.
Total
8
Agents affected
2 / 5
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
2
Max
Highest count in any single partition
4
Min
Lowest count in any single partition
0
App validation workflow duration
The time taken to apply app validation to the data.
mean
8.544672s
(SD =
15.377911s)
p50
4.798459s
p95
43.61617s
p99
96.005959s
System validation workflow duration
The time taken to apply system validation to the data.
mean
0.10671s
(SD =
0.725734s)
p50
0.011614s
p95
0.120461s
p99
1.718763s
Error count
The number of errors accumulated across all nodes.
8
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.082273s
(SD =
0.104834s)
p50
0.02995s
p95
0.308459s
p99
0.339539s
Request roundtrip duration: 'get_links'
The time spent sending a get_links request and awaiting its response
mean
0.067546s
(SD =
0.129861s)
p50
0.051566s
p95
0.130116s
p99
0.854665s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.176012s
(SD =
0.515233s)
p50
0.042939s
p95
0.940112s
p99
2.128639s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
2.6e-05s
(SD =
7.4e-05s)
p50
1.9e-05s
p95
4.2e-05s
p99
0.000208s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.000785s
(SD =
0.002642s)
p50
0.000498s
p95
0.002162s
p99
0.004641s
Handle incoming request duration: 'get_links'
The time spent handling an incoming get_links request
mean
0.077236s
(SD =
0.086598s)
p50
0.056002s
p95
0.260494s
p99
0.424852s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.15765s
(SD =
0.513331s)
p50
0.018632s
p95
0.918047s
p99
2.097994s
Local Signals
This scenario is for testing the speed and reliability of local signals. It uses a zome with a function that will emit 10,000 signals. The scenario measures how long it takes to send the signals and how many have been received by the time the zome call ends.
Started
Thu, 12 Mar 2026 00:46:29 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
local_signals_22981335548
Send timing
The time taken to emit a batch of 10,000 signals.
mean
3.708469s
(SD =
2.219703s)
p50
3.097229s
p95
7.574311s
p99
7.574311s
Receive timing
The time taken to receive the completed batch, to the nearest 250ms.
mean
28.863734s
(SD =
3.217501s)
p50
30.001332s
p95
30.001922s
p99
30.001922s
Success ratio
The proportion of signals successfully received in a batch.
min
0.3621000051498413
<
mean
0.5252
(SD =
0.1162)
<
max
0.7366999983787537
Host Metrics
User CPU usage
CPU usage by user space
2.09%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
699.8B/s
<
mean
63421.42B/s
(SD =
331312.08B/s)
≤
p95
1228.5B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
15358.6B/s
<
mean
15756.44B/s
(SD =
903.07B/s)
<
p95
15948.6B/s
Total bytes received
Total bytes received on primary network interface
count
18392213B
mean
63421.42B/s
Total bytes sent
Total bytes sent on primary network interface
count
4569368B
mean
15756.44B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 21.01 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2.33%
<
mean
9.09%
(SD =
10.24%)
<
p95
30.18%
System
7.00%
CPU percentiles
CPU usage percentiles
p50
2.99%
p95
30.18%
p99
44.23%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
16.58%
<
mean
16.73%
(SD =
0.22%)
<
p95
16.95%
Memory available percentage
Percentage of available memory
p5
83.05%
<
mean
83.27%
(SD =
0.22%)
<
p95
83.42%
Max host memory used
Maximum memory usage percentage across all hosts
max
16.73%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00%
Memory growth rate
Rate of memory growth over time
growth
21.01MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
1.27MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname
0/1hosts
Mount Point
/etc/hosts
0/1hosts
Mount Point
/etc/resolv.conf
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.72
5 min
0.66
15 min
0.26
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.51%
<
mean
3.412%
(SD =
3.0613%)
<
p95
10.3%
60 second average
2.6703%
300 second average
1.1603%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.4157%
(SD =
1.3863%)
<
p95
2.7%
60 second average
0.3643%
300 second average
0.2167%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.311%
(SD =
1.0356%)
<
p95
2.02%
60 second average
0.2760%
300 second average
0.1637%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.28%
<
mean
0.6%
(SD =
1.21%)
<
p95
0.62%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
256195B
≤
mean
253996.33B
(SD =
18632.78B)
<
p95
258319B
Holochain process threads
Number of threads in Holochain process
p5
13 threads
<
mean
13.13 threads
(SD =
0.72 threads)
≤
p95
13 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
43 file descriptors
<
mean
48.7 file descriptors
(SD =
7.68 file descriptors)
<
p95
64 file descriptors
Remote Call Rate
Test the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.
Started
Thu, 12 Mar 2026 00:49:44 UTC
Peer count
2
Peer count at end
2
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
remote_call_rate_22981335548
Dispatch timing
The time between sending a remote call and the remote handler being invoked.
Mean
mean
0.002559s
(SD =
0.001231s)
Max
Highest per-partition mean latency
max mean
0.002573s
Min
Lowest per-partition mean latency
min mean
0.002545s
Round-trip timing
The total elapsed time to get a response to the client.
Mean
mean
0.006012s
(SD =
0.00232s)
Max
Highest per-partition mean latency
max mean
0.006013s
Min
Lowest per-partition mean latency
min mean
0.006011s
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.000478s
(SD =
3.1e-05s)
p50
0.000509s
p95
0.000509s
p99
0.000509s
Not enough time data to show a trend.
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.001847s
(SD =
0.00164s)
p50
0.001138s
p95
0.005812s
p99
0.005812s
Request roundtrip duration: 'call_remote'
The time spent sending a call_remote request and awaiting its response
mean
0.00275s
(SD =
0.001293s)
p50
0.002331s
p95
0.004626s
p99
0.005986s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
2e-05s
(SD =
8.4e-05s)
p50
9e-06s
p95
1.9e-05s
p99
0.00034s
Handle incoming request duration: 'call_remote'
The time spent handling an incoming call_remote request
mean
0.00233s
(SD =
0.000993s)
p50
0.002011s
p95
0.003908s
p99
0.005141s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.000182s
(SD =
1.9e-05s)
p50
0.000201s
p95
0.000201s
p99
0.000201s
Not enough time data to show a trend.
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.001471s
(SD =
0.001564s)
p50
0.000821s
p95
0.00523s
p99
0.00523s
Host Metrics
User CPU usage
CPU usage by user space
15.55%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
3677.3B/s
<
mean
81687.34B/s
(SD =
341932.95B/s)
<
p95
233449B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
1020.3B/s
<
mean
35235.94B/s
(SD =
86969.69B/s)
<
p95
332832.2B/s
Total bytes received
Total bytes received on primary network interface
count
23689329B
mean
81687.34B/s
Total bytes sent
Total bytes sent on primary network interface
count
10218424B
mean
35235.94B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 35.91 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Warning Moderate swap usage (11.5% swap used)
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
22.31%
<
mean
26.95%
(SD =
5.09%)
<
p95
33.67%
System
11.40%
CPU percentiles
CPU usage percentiles
p50
23.62%
p95
33.67%
p99
39.74%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
37.27%
<
mean
38.92%
(SD =
0.58%)
<
p95
39.64%
Memory available percentage
Percentage of available memory
p5
60.36%
<
mean
61.08%
(SD =
0.58%)
<
p95
62.73%
Max host memory used
Maximum memory usage percentage across all hosts
max
38.92%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
11.54%
Memory growth rate
Rate of memory growth over time
growth
35.91MB/s
Disk read throughput
Disk read throughput in MB/s
0.02MB/s
Disk write throughput
Disk write throughput in MB/s
12.80MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname
0/1hosts
Mount Point
/etc/hosts
0/1hosts
Mount Point
/etc/resolv.conf
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
8.36
5 min
6.59
15 min
4.71
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.88%
<
mean
13.1657%
(SD =
8.7681%)
<
p95
21.73%
60 second average
13.3283%
300 second average
9.6413%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.0127%
(SD =
0.0407%)
<
p95
0.14%
60 second average
0.0377%
300 second average
0.0350%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0247%
300 second average
0.0260%
Holochain process CPU usage
CPU usage by Holochain process
p5
1.21%
<
mean
9.65%
(SD =
3.24%)
<
p95
12.62%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
28759B
<
mean
224293.47B
(SD =
77174.31B)
<
p95
258514B
Holochain process threads
Number of threads in Holochain process
p5
13 threads
<
mean
17.18 threads
(SD =
1.89 threads)
<
p95
18 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
8 file descriptors
<
mean
48.56 file descriptors
(SD =
16.84 file descriptors)
<
p95
72 file descriptors
Remote Signals
This scenario tests the throughput of remote_signals operations.
Started
Thu, 12 Mar 2026 00:53:00 UTC
Peer count
2
Peer count at end
2
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
remote_signals_22981335548
Round trip time
The time from origin signal dispatch to origin receive of the remote side's response signal.
mean
0.030364s
(SD =
0.028549s)
p50
0.018178s
p95
0.047248s
p99
0.065291s
Timeouts
The number of timeouts waiting for the remote side's response signal (default timeout is 20 seconds).
0
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.002084s
(SD =
0.001372s)
p50
0.0013s
p95
0.005355s
p99
0.005355s
Not enough time data to show a trend.
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
1e-05s
(SD =
2e-06s)
p50
1e-05s
p95
1.2e-05s
p99
1.2e-05s
Not enough time data to show a trend.
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.001531s
(SD =
0.001302s)
p50
0.000762s
p95
0.004545s
p99
0.004545s
Not enough time data to show a trend.
Handle incoming request duration: 'remote_signal'
The time spent handling an incoming remote_signal request
mean
0.004864s
(SD =
0.007448s)
p50
0.004778s
p95
0.006005s
p99
0.006776s
Host Metrics
User CPU usage
CPU usage by user space
5.64%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
22B/s
<
mean
532655.79B/s
(SD =
935951.06B/s)
<
p95
2.2696309e+06B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
138.9B/s
<
mean
10047.04B/s
(SD =
15286.63B/s)
<
p95
38077.1B/s
Total bytes received
Total bytes received on primary network interface
count
154470179B
mean
532655.79B/s
Total bytes sent
Total bytes sent on primary network interface
count
2913643B
mean
10047.04B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.93%
<
mean
6.85%
(SD =
13.11%)
<
p95
49.47%
System
1.21%
CPU percentiles
CPU usage percentiles
p50
2.43%
p95
49.47%
p99
59.29%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
16.85%
<
mean
17.5%
(SD =
0.71%)
<
p95
19.34%
Memory available percentage
Percentage of available memory
p5
80.66%
<
mean
82.5%
(SD =
0.71%)
<
p95
83.15%
Max host memory used
Maximum memory usage percentage across all hosts
max
17.50%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00%
Memory growth rate
Rate of memory growth over time
growth
-128.03MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
3.11MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/1hosts
Mount Point
/efi-boot
0/1hosts
Mount Point
/nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.76
5 min
0.48
15 min
0.20
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
2.654%
(SD =
7.6676%)
<
p95
24.57%
60 second average
2.6413%
300 second average
1.6523%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.69%
<
mean
11.037%
(SD =
11.4961%)
<
p95
33.86%
60 second average
9.9497%
300 second average
6.4353%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.69%
<
mean
9.8523%
(SD =
9.8059%)
<
p95
25.1%
60 second average
8.7850%
300 second average
5.7337%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.53%
<
mean
2.35%
(SD =
6.38%)
<
p95
23.32%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
184048B
<
mean
197338.57B
(SD =
21705.24B)
<
p95
213044B
Holochain process threads
Number of threads in Holochain process
p5
12 threads
≤
mean
11.93 threads
(SD =
1.31 threads)
<
p95
12 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
48 file descriptors
<
mean
53.1 file descriptors
(SD =
9.31 file descriptors)
<
p95
69 file descriptors
Single-write, many-read
Creates an entry in the agent setup, then read one's own record back. This tests the maximum read performance for reading back local data when the chain is short.
Started
Thu, 12 Mar 2026 00:55:56 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
single_write_many_read_22981335548
read call timingThe time it takes to complete the zome call that retrieves the record.
mean
0.004582s
(SD =
0.001934s)
p50
0.004063s
p95
0.007854s
p99
0.008335s
read call rateThe number of read zome calls completed per second.
mean
2182.21/s
Error count
The number of errors collected.
0
Host Metrics
User CPU usage
CPU usage by user space
10.48%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
92.6B/s
<
mean
2.00173676e+06B/s
(SD =
1.47286887e+06B/s)
<
p95
3.9296201e+06B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
281.1B/s
<
mean
33673.06B/s
(SD =
24048.12B/s)
<
p95
65574B/s
Total bytes received
Total bytes received on primary network interface
count
580503661B
mean
2001736.76B/s
Total bytes sent
Total bytes sent on primary network interface
count
9765187B
mean
33673.06B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 117.37 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
14.01%
<
mean
15.84%
(SD =
3.58%)
<
p95
16.54%
System
5.36%
CPU percentiles
CPU usage percentiles
p50
15.42%
p95
16.54%
p99
34.33%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
8.88%
<
mean
9.63%
(SD =
0.43%)
<
p95
10.26%
Memory available percentage
Percentage of available memory
p5
89.74%
<
mean
90.37%
(SD =
0.43%)
<
p95
91.12%
Max host memory used
Maximum memory usage percentage across all hosts
max
9.63%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.02%
Memory growth rate
Rate of memory growth over time
growth
117.37MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
9.82MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/1hosts
Mount Point
/efi-boot
0/1hosts
Mount Point
/nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.90
5 min
0.41
15 min
0.16
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.051%
(SD =
0.1871%)
<
p95
0.36%
60 second average
0.0550%
300 second average
0.0273%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.02%
<
mean
0.133%
(SD =
0.0834%)
<
p95
0.26%
60 second average
0.1123%
300 second average
0.0450%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.1137%
(SD =
0.0867%)
<
p95
0.23%
60 second average
0.0893%
300 second average
0.0270%
Holochain process CPU usage
CPU usage by Holochain process
p5
11.8%
<
mean
12.71%
(SD =
3.35%)
≤
p95
12.32%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
221881B
<
mean
247578.37B
(SD =
10791.13B)
<
p95
254133B
Holochain process threads
Number of threads in Holochain process
p5
15 threads
≤
mean
14.83 threads
(SD =
0.9 threads)
<
p95
15 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
54 file descriptors
<
mean
54.47 file descriptors
(SD =
8.66 file descriptors)
<
p95
62 file descriptors
Two-party countersigning
This scenario tests the performance of countersigning operations. There are two roles: initiate and participate. The participants commit an entry to advertise that they are willing to participate in sessions. They listen for sessions and participate in one at a time.
Started
Thu, 12 Mar 2026 01:38:35 UTC
Peer count
3
Peer count at end
3
Behaviours
-
initiate(1 agent) -
participate(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
two_party_countersigning_22981335548
Session accepted -- timing
The duration of the session from acceptance to completion.
Mean
mean
0.413964s
(SD =
0.347795s)
Max
Highest per-partition mean latency
max mean
0.478927s
Min
Lowest per-partition mean latency
min mean
0.349s
Session accepted -- success rate
The number of accepted sessions that completed per second.
Mean
mean
7.67/s
Max
Highest per-partition mean rate
max
7.91/s
Min
Lowest per-partition mean rate
min
7.42/s
Session accepted -- success ratio
Fraction of accepted sessions that completed successfully (0–1).
1
Session initiated -- timing
The duration of the session from initiation to completion.
Mean
mean
0.632768s
(SD =
0.923026s)
Max
Highest per-partition mean latency
max mean
0.632768s
Min
Lowest per-partition mean latency
min mean
0.632768s
Session initiated -- success rate
The number of initiated sessions that completed per second.
Mean
mean
15/s
Max
Highest per-partition mean rate
max
15/s
Min
Lowest per-partition mean rate
min
15/s
Session initiated -- success ratio
Fraction of initiated sessions that completed successfully (0–1).
1
Session initiated -- failures
Initiated sessions that failed to complete.
Total
6
Agents affected
1 / 1
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
6
Max
Highest count in any single partition
6
Min
Lowest count in any single partition
6
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.036639s
(SD =
0.038427s)
p50
0.004679s
p95
0.083839s
p99
0.087393s
Request roundtrip duration: 'get_agent_activity'
The time spent sending a get_agent_activity request and awaiting its response
mean
0.026605s
(SD =
0.0323s)
p50
0.00888s
p95
0.083557s
p99
0.088733s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.08983s
(SD =
0.182511s)
p50
0.081629s
p95
0.103698s
p99
1.14147s
Request roundtrip duration: 'call_remote'
The time spent sending a call_remote request and awaiting its response
mean
0.053043s
(SD =
0.046279s)
p50
0.084172s
p95
0.095311s
p99
0.181252s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
2.7e-05s
(SD =
1.7e-05s)
p50
2.5e-05s
p95
4.5e-05s
p99
6.9e-05s
Handle incoming request duration: 'call_remote'
The time spent handling an incoming call_remote request
mean
0.010168s
(SD =
0.020331s)
p50
0.008162s
p95
0.012608s
p99
0.024263s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.000901s
(SD =
0.000669s)
p50
0.000786s
p95
0.001623s
p99
0.005208s
Handle incoming request duration: 'get_agent_activity'
The time spent handling an incoming get_agent_activity request
mean
0.006016s
(SD =
0.004899s)
p50
0.00461s
p95
0.015567s
p99
0.02444s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.034959s
(SD =
0.178455s)
p50
0.002977s
p95
0.024402s
p99
1.103367s
Handle incoming request duration: 'publish_counter_sign'
The time spent handling an incoming publish_counter_sign request
mean
0.000141s
(SD =
0.000287s)
p50
0.000127s
p95
0.000193s
p99
0.000316s
Handle incoming request duration: 'countersigning_session_negotiation'
The time spent handling an incoming countersigning_session_negotiation request
mean
6.2e-05s
(SD =
3.2e-05s)
p50
5.7e-05s
p95
8.9e-05s
p99
0.000109s
Host Metrics
User CPU usage
CPU usage by user space
11.02%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
612.6B/s
<
mean
489888.44B/s
(SD =
1.33289707e+06B/s)
<
p95
2.2872887e+06B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
710.5B/s
<
mean
85226.83B/s
(SD =
153205.2B/s)
<
p95
328135.9B/s
Total bytes received
Total bytes received on primary network interface
count
440899595B
mean
1422256.76B/s
Total bytes sent
Total bytes sent on primary network interface
count
76704144B
mean
247432.72B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 622.59 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.15%
<
mean
13.82%
(SD =
12.26%)
<
p95
37.28%
System
2.79%
CPU percentiles
CPU usage percentiles
p50
9.86%
p95
37.28%
p99
63.69%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
14.56%
<
mean
16.94%
(SD =
2.33%)
<
p95
20.66%
Memory available percentage
Percentage of available memory
p5
79.34%
<
mean
83.06%
(SD =
2.33%)
<
p95
85.44%
Max host memory used
Maximum memory usage percentage across all hosts
max
18.35%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.01%
Memory growth rate
Rate of memory growth over time
growth
622.59MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
11.90MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/3hosts
Mount Point
/efi-boot
0/2hosts
Mount Point
/nix/store
0/3hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.26
5 min
0.75
15 min
0.48
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.6633%
(SD =
0.9655%)
<
p95
2.14%
60 second average
0.5351%
300 second average
0.2627%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
1.19%
<
mean
19.0008%
(SD =
19.9291%)
<
p95
56.3%
60 second average
16.6748%
300 second average
11.9951%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
1.11%
<
mean
15.6951%
(SD =
15.5022%)
<
p95
45.63%
60 second average
14.1473%
300 second average
10.7410%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.2%
<
mean
8.62%
(SD =
11.27%)
<
p95
32.19%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
117457B
<
mean
219775.72B
(SD =
60693.52B)
<
p95
282990B
Holochain process threads
Number of threads in Holochain process
p5
11 threads
<
mean
17.18 threads
(SD =
6.56 threads)
<
p95
32 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
43 file descriptors
<
mean
73.03 file descriptors
(SD =
15.18 file descriptors)
<
p95
91 file descriptors
Validation Receipts
Creates an entry, wait for required validation receipts, then repeat. Records the amount of time it took to accumulate the required number of receipts for all DHT operations. This is measured to the nearest 20ms so that we don't keep the agent too busy checking for receipts.
Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.
By default, this scenario will wait for a complete set of validation receipts before committing the next record. If the NO_VALIDATION_COMPLETE environment variable is set, it will instead publish new records on every round, building up an ever-growing list of action hashes to check on.
Started
Thu, 12 Mar 2026 01:23:15 UTC
Peer count
10
Peer count at end
10
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
validation_receipts_22981335548
Receipts complete timing
The amount of time between publishing a record and receiving the required number of validation receipts.
Mean
mean
5.628126s
(SD =
3.586371s)
Max
Highest per-partition mean latency
max mean
6.264283s
Min
Lowest per-partition mean latency
min mean
5.046606s
Receipts complete rate
The number of complete validation receipt sets collected per second.
Mean
mean
1.91/s
Max
Highest per-partition mean rate
max
1.95/s
Min
Lowest per-partition mean rate
min
1.86/s
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.022713s
(SD =
0.042342s)
p50
0.003864s
p95
0.055763s
p99
0.260295s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.099766s
(SD =
0.186559s)
p50
0.035139s
p95
0.273281s
p99
0.842321s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
3.1e-05s
(SD =
7.9e-05s)
p50
2.3e-05s
p95
4.9e-05s
p99
0.000237s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.001496s
(SD =
0.001988s)
p50
0.000993s
p95
0.003924s
p99
0.009451s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.029261s
(SD =
0.151924s)
p50
0.003683s
p95
0.061395s
p99
0.712779s
Host Metrics
User CPU usage
CPU usage by user space
22.52%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
7706.7B/s
<
mean
820880.53B/s
(SD =
909294.44B/s)
<
p95
2.6020548e+06B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
5436.5B/s
<
mean
47372.5B/s
(SD =
22884.72B/s)
<
p95
92763.7B/s
Total bytes received
Total bytes received on primary network interface
count
508945931B
mean
1590456.03B/s
Total bytes sent
Total bytes sent on primary network interface
count
29370950B
mean
91784.22B/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 99.9%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 603.92 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
7.35%
<
mean
26.86%
(SD =
21.4%)
<
p95
99.05%
System
4.34%
CPU percentiles
CPU usage percentiles
p50
22.17%
p95
99.05%
p99
99.93%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
2 hosts
mean time
0.06s
Memory used percentage
Percentage of memory used
p5
11.91%
<
mean
24.53%
(SD =
3.97%)
<
p95
27.16%
Memory available percentage
Percentage of available memory
p5
72.84%
<
mean
75.47%
(SD =
3.97%)
<
p95
88.09%
Max host memory used
Maximum memory usage percentage across all hosts
max
25.87%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00%
Memory growth rate
Rate of memory growth over time
growth
603.92MB/s
Disk read throughput
Disk read throughput in MB/s
0.01MB/s
Disk write throughput
Disk write throughput in MB/s
18.44MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/1hosts
Mount Point
/efi-boot
0/1hosts
Mount Point
/etc/hostname
0/1hosts
Mount Point
/etc/hosts
0/1hosts
Mount Point
/etc/resolv.conf
0/1hosts
Mount Point
/nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.75
5 min
1.94
15 min
0.84
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.51%
<
mean
14.0241%
(SD =
18.9571%)
<
p95
63.5%
60 second average
12.9916%
300 second average
7.1945%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.2028%
(SD =
0.9417%)
<
p95
0.54%
60 second average
0.2653%
300 second average
0.1742%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.1664%
(SD =
0.7837%)
<
p95
0.52%
60 second average
0.2166%
300 second average
0.1419%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
5.7%
<
mean
20.0153%
(SD =
10.3014%)
<
p95
35.55%
60 second average
17.5506%
300 second average
9.8980%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
3.92%
<
mean
15.0097%
(SD =
7.7202%)
<
p95
27.13%
60 second average
13.1148%
300 second average
7.5709%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.54%
<
mean
4.56%
(SD =
4.42%)
<
p95
19.2%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
129467B
<
mean
211636.23B
(SD =
33632.11B)
<
p95
226756B
Holochain process threads
Number of threads in Holochain process
p5
9 threads
<
mean
17.61 threads
(SD =
4.17 threads)
<
p95
22 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
50 file descriptors
<
mean
66.9 file descriptors
(SD =
12.59 file descriptors)
<
p95
78 file descriptors
Write/get_agent_activity
A scenario where write peers write entries, while get_agent_activity peers each query a single write agent's activity with get_agent_activity.
Before a target write peer and the requesting get_agent_activity peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.
Started
Thu, 12 Mar 2026 01:29:00 UTC
Peer count
2
Peer count at end
2
Behaviours
-
get_agent_activity(1 agent) -
write(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
write_get_agent_activity_22981335548
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
14022
Max
Highest chain head value observed for any single write agent.
14022
Write agents observed
1
get_agent_activity_full zome call timingThe time taken to call the zome function that retrieves information on a
write peer's source chain.Mean
mean
0.037799s
(SD =
0.149183s)
Max
Highest per-partition mean latency
max mean
0.037799s
Min
Lowest per-partition mean latency
min mean
0.037799s
Error count
The number of errors accumulated.
0
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.36814s
(SD =
0.100109s)
p50
0.330293s
p95
0.498507s
p99
0.819662s
Request roundtrip duration: 'get_agent_activity'
The time spent sending a get_agent_activity request and awaiting its response
mean
0.63576s
(SD =
0.144732s)
p50
0.616599s
p95
0.806528s
p99
1.21033s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
1.727158s
(SD =
1.462865s)
p50
1.20371s
p95
4.384649s
p99
6.128538s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
8e-05s
(SD =
0.000492s)
p50
1.8e-05s
p95
0.000107s
p99
0.002795s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.000551s
(SD =
0.00022s)
p50
0.000536s
p95
0.000828s
p99
0.001119s
Handle incoming request duration: 'get_agent_activity'
The time spent handling an incoming get_agent_activity request
mean
0.140456s
(SD =
0.032378s)
p50
0.143669s
p95
0.190821s
p99
0.206535s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
1.304636s
(SD =
1.419082s)
p50
0.812567s
p95
3.848378s
p99
5.077064s
Host Metrics
User CPU usage
CPU usage by user space
29.48%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
33202.7B/s
<
mean
870260.94B/s
(SD =
1.08027091e+06B/s)
<
p95
2.5596447e+06B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
38409.1B/s
<
mean
1.01352881e+06B/s
(SD =
745254.24B/s)
<
p95
1.9930768e+06B/s
Total bytes received
Total bytes received on primary network interface
count
1583874907B
mean
1721603.16B/s
Total bytes sent
Total bytes sent on primary network interface
count
1844622440B
mean
2005024.39B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 760.18 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
25.43%
<
mean
39.47%
(SD =
13.74%)
<
p95
72.03%
System
10.00%
CPU percentiles
CPU usage percentiles
p50
36.25%
p95
72.03%
p99
85.40%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1 hosts
mean time
0.07s
Memory used percentage
Percentage of memory used
p5
7.81%
<
mean
14.4%
(SD =
6.74%)
<
p95
24.08%
Memory available percentage
Percentage of available memory
p5
75.92%
<
mean
85.6%
(SD =
6.74%)
<
p95
92.19%
Max host memory used
Maximum memory usage percentage across all hosts
max
20.84%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.05%
Memory growth rate
Rate of memory growth over time
growth
760.18MB/s
Disk read throughput
Disk read throughput in MB/s
0.01MB/s
Disk write throughput
Disk write throughput in MB/s
25.94MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname
0/2hosts
Mount Point
/etc/hosts
0/2hosts
Mount Point
/etc/resolv.conf
0/2hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.87
5 min
2.12
15 min
1.17
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
10.0954%
(SD =
12.6229%)
<
p95
37.35%
60 second average
9.2374%
300 second average
6.6496%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
1.3243%
(SD =
2.8408%)
<
p95
6.14%
60 second average
1.3488%
300 second average
1.1398%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.8515%
(SD =
2.0811%)
<
p95
3.99%
60 second average
0.8864%
300 second average
0.7745%
Holochain process CPU usage
CPU usage by Holochain process
p5
12.4%
<
mean
29.95%
(SD =
11.85%)
<
p95
48.37%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
231064B
<
mean
310185.16B
(SD =
66074.46B)
<
p95
481075B
Holochain process threads
Number of threads in Holochain process
p5
17 threads
<
mean
26.2 threads
(SD =
9.45 threads)
<
p95
38 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
68 file descriptors
<
mean
74.46 file descriptors
(SD =
9.34 file descriptors)
<
p95
85 file descriptors
Write/get_agent_activity with volatile conductors
A scenario where write peers write entries, while get_agent_activity_volatile peers each query a single write agents activity with get_agent_activity but shutdown and restart their conductors at semi-random intervals.
Before a target write peer and the requesting get_agent_activity_volatile peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.
Started
Thu, 12 Mar 2026 01:32:44 UTC
Peer count
20
Peer count at end
20
Behaviours
-
get_agent_activity_volatile(1 agent) -
write(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
write_get_agent_activity_volatile_22981335548
Highest observed
action_seqThe rate at which zero-arc readers observe new chain heads on the writers' chains via
get_agent_activity. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.Mean
mean
47.65/s
Max
Highest per-partition mean rate
max
80.95/s
Min
Lowest per-partition mean rate
min
13.95/s
get_agent_activity_full zome call timingThe time taken to call the zome function that retrieves information on a
write peer's source chain.Mean
mean
0.191645s
(SD =
0.601958s)
Max
Highest per-partition mean latency
max mean
0.530329s
Min
Lowest per-partition mean latency
min mean
0.097692s
Running volatile conductors count
The number of conductors running by
get_agent_activity_volatile peers.
p5
7 conductors
<
mean
10.43 conductors
(SD =
2.19 conductors)
<
p95
13 conductors
Volatile conductor total running duration
The total running duration of a
get_agent_activity_volatile conductor.Mean
mean
364.462746s
(SD =
238.339857s)
Max
Highest per-partition mean latency
max mean
441.055556s
Min
Lowest per-partition mean latency
min mean
236.0625s
Volatile conductor running duration
The duration that a
get_agent_activity_volatile conductor was running before being stopped.Mean
mean
46.261751s
(SD =
34.717149s)
Max
Highest per-partition mean latency
max mean
72.447242s
Min
Lowest per-partition mean latency
min mean
27.374811s
Volatile conductor stopped duration
The duration that a
get_agent_activity_volatile conductor was stopped before being started again.Mean
mean
43.273443s
(SD =
42.490647s)
Max
Highest per-partition mean latency
max mean
78.854571s
Min
Lowest per-partition mean latency
min mean
23.05138s
Reached target arc
Did
get_agent_activity_volatile peer reach their target arc in the moment before they were shutdown.get_agent_activity_volatile_agent:uhCAk3njXkxLdA4ScgMH1HPoGnBSg7MvVN6UsCWpSrk67W7kr3rJr
p5
0
<
mean
0.47
(SD =
0.5)
<
p95
1
get_agent_activity_volatile_agent:uhCAkHCjA-cXZEG9onoF6SpUec5Z1z8DzjH_AU6n3Wq_exk30IwX2
p5
0
<
mean
0.54
(SD =
0.5)
<
p95
1
get_agent_activity_volatile_agent:uhCAkIh0dwKx3IzzF1w4azIiNMAMZTx1pGxLH-yuC7QmcCFDTNJid
p5
0
<
mean
0.58
(SD =
0.49)
<
p95
1
get_agent_activity_volatile_agent:uhCAkIpzItDgetli49r3x4P1p1bI4dTgKUPwzq7TjeB0U58d78cUv
p5
0
<
mean
0.53
(SD =
0.5)
<
p95
1
get_agent_activity_volatile_agent:uhCAkRgYpfGiss6PyY2-ENpi5KgIv9SPQ3DjpJyEsQzqstOMjQ61Y
p5
0
<
mean
0.33
(SD =
0.47)
<
p95
1
get_agent_activity_volatile_agent:uhCAkWPliPW_j8K5tTafbmMfI85emPCl3oILNbyqoChSW7U7FuRdG
p5
0
<
mean
0.58
(SD =
0.49)
<
p95
1
get_agent_activity_volatile_agent:uhCAkaLiC93543hwg4uJvcsaY7SQ4wxW5fYIFSYKh3jjc1eX0av3I
p5
0
<
mean
0.33
(SD =
0.47)
<
p95
1
get_agent_activity_volatile_agent:uhCAkdFTj9g1GzfeoTOThdrJW2UJYde5iIJCH9WDZrLQGYkZUskIj
p5
0
<
mean
0.38
(SD =
0.48)
<
p95
1
get_agent_activity_volatile_agent:uhCAkgfJl7M5VWQXz0boRvtzjfNRv3LDkbQbqzhTpaauC3HdnXh3y
p5
0
<
mean
0.69
(SD =
0.46)
<
p95
1
get_agent_activity_volatile_agent:uhCAkgtdtFCCNuhobZDrZ5FMhZb0SAz6krYXT3LPWym4vPdm4721T
p5
0
<
mean
0.43
(SD =
0.49)
<
p95
1
get_agent_activity_volatile_agent:uhCAkoFiredHrNOW7dHngpY41J7eI0OHxWRPhYHiBzyiWF5goKH7p
p5
0
<
mean
0.6
(SD =
0.49)
<
p95
1
get_agent_activity_volatile_agent:uhCAkudc9_pIcPJPd5zriaFNt4ZBgA7Qt1IlMxfR-7Z8j0ljfgtfs
p5
0
<
mean
0.64
(SD =
0.48)
<
p95
1
get_agent_activity_volatile_agent:uhCAkx2251wsi5sd76unF9C2iUsv_mcIcY0V2_2bqywGEkuf3m9fM
p5
0
<
mean
0.54
(SD =
0.5)
<
p95
1
get_agent_activity_volatile_agent:uhCAkxEqme9RZXaRo2QKtr_sFpMEv3DS0qMuzzLbvoaSZkAavGVbK
p5
0
<
mean
0.39
(SD =
0.49)
<
p95
1
Error count
The number of errors accumulated.
118
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.974801s
(SD =
6.529197s)
p50
0.032291s
p95
1.14722s
p99
60.000705s
Request roundtrip duration: 'get_links'
The time spent sending a get_links request and awaiting its response
mean
4.78201s
(SD =
8.742195s)
p50
0.488659s
p95
28.145739s
p99
28.145739s
Request roundtrip duration: 'get_agent_activity'
The time spent sending a get_agent_activity request and awaiting its response
mean
0.173842s
(SD =
1.425236s)
p50
0.080009s
p95
0.39297s
p99
0.847116s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.861108s
(SD =
4.908058s)
p50
0.220612s
p95
1.950237s
p99
8.38169s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
6.6e-05s
(SD =
0.000207s)
p50
2.6e-05s
p95
0.000245s
p99
0.00058s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.144027s
(SD =
1.344097s)
p50
0.000699s
p95
0.426259s
p99
2.735263s
Handle incoming request duration: 'get_links'
The time spent handling an incoming get_links request
mean
0.001433s
(SD =
0.001244s)
p50
0.001022s
p95
0.004042s
p99
0.005721s
Handle incoming request duration: 'get_agent_activity'
The time spent handling an incoming get_agent_activity request
mean
0.421707s
(SD =
2.898657s)
p50
0.056671s
p95
0.628958s
p99
5.899411s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.257091s
(SD =
1.095001s)
p50
0.017882s
p95
0.988717s
p99
6.104028s
Write/Query
Creates an entry, then queries the source chain and performs a simple operation on the entries, then repeats.
Started
Thu, 12 Mar 2026 01:01:13 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
write_query_22981335548
Write timing
The time it takes to complete the zome function call that writes the entry.
mean
0.088842s
(SD =
0.310494s)
p50
0.010349s
p95
0.510863s
p99
1.818263s
Write rate
The number of writes completed per second.
mean
75.71/s
Query timing
The time it takes to complete the
chain_query_count_len zome call that queries the source chain.
mean
0.038562s
(SD =
0.025165s)
p50
0.036542s
p95
0.071024s
p99
0.087266s
Query rate
The number of chain queries completed per second.
mean
75.68/s
Error count
The number of errors accumulated during the run.
0
Host Metrics
User CPU usage
CPU usage by user space
14.13%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
28.1B/s
<
mean
131179.32B/s
(SD =
619601.09B/s)
<
p95
498632B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
28.2B/s
<
mean
2174.63B/s
(SD =
9943.33B/s)
<
p95
4900B/s
Total bytes received
Total bytes received on primary network interface
count
39353796B
mean
131179.32B/s
Total bytes sent
Total bytes sent on primary network interface
count
652389B
mean
2174.63B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 92.31 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
8.38%
<
mean
17.02%
(SD =
7.1%)
<
p95
28.08%
System
2.88%
CPU percentiles
CPU usage percentiles
p50
15.36%
p95
28.08%
p99
43.20%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
13.07%
<
mean
14.72%
(SD =
0.65%)
<
p95
15.08%
Memory available percentage
Percentage of available memory
p5
84.92%
<
mean
85.28%
(SD =
0.65%)
<
p95
86.93%
Max host memory used
Maximum memory usage percentage across all hosts
max
14.72%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.01%
Memory growth rate
Rate of memory growth over time
growth
92.31MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
6.87MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/1hosts
Mount Point
/efi-boot
0/1hosts
Mount Point
/nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.71
5 min
1.01
15 min
0.45
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.0661%
(SD =
0.1989%)
<
p95
0.38%
60 second average
0.0748%
300 second average
0.0394%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
17.65%
<
mean
31.0065%
(SD =
7.8611%)
<
p95
44.79%
60 second average
30.1584%
300 second average
21.1732%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
17.33%
<
mean
30.0594%
(SD =
7.8117%)
<
p95
43.72%
60 second average
29.1384%
300 second average
20.4474%
Holochain process CPU usage
CPU usage by Holochain process
p5
7.45%
<
mean
15.7%
(SD =
6.96%)
<
p95
26.95%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
238253B
<
mean
239939.13B
(SD =
22814.14B)
<
p95
250437B
Holochain process threads
Number of threads in Holochain process
p5
12 threads
<
mean
13.5 threads
(SD =
0.92 threads)
<
p95
14 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
60 file descriptors
<
mean
61.83 file descriptors
(SD =
3.05 file descriptors)
<
p95
69 file descriptors
Write/Read
Creates an entry and reads it back, then repeats.
Started
Thu, 12 Mar 2026 01:04:27 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
write_read_22981335548
Write timing
The time taken to write the entry.
mean
0.033213s
(SD =
0.017392s)
p50
0.030496s
p95
0.06581s
p99
0.083954s
Write rate
The number of writes completed per second.
mean
130.93/s
Read timing
The time taken to read the entry.
mean
0.03944s
(SD =
0.025019s)
p50
0.035866s
p95
0.085895s
p99
0.103389s
Read rate
The number of reads completed per second.
mean
130.93/s
Error count
The number of errors accumulated over the run.
0
Host Metrics
User CPU usage
CPU usage by user space
47.45%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
222.1B/s
<
mean
349495B/s
(SD =
1.30392125e+06B/s)
<
p95
2.6407605e+06B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
29.4B/s
<
mean
6931.16B/s
(SD =
27402.79B/s)
<
p95
34436.8B/s
Total bytes received
Total bytes received on primary network interface
count
108343449B
mean
349495.00B/s
Total bytes sent
Total bytes sent on primary network interface
count
2148659B
mean
6931.16B/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 97.3%
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
42.93%
<
mean
55.31%
(SD =
9.73%)
<
p95
58.56%
System
7.86%
CPU percentiles
CPU usage percentiles
p50
55.92%
p95
58.56%
p99
97.35%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1 hosts
mean time
0.03s
Memory used percentage
Percentage of memory used
p5
15.7%
<
mean
17.66%
(SD =
0.64%)
<
p95
18.09%
Memory available percentage
Percentage of available memory
p5
81.91%
<
mean
82.34%
(SD =
0.64%)
<
p95
84.3%
Max host memory used
Maximum memory usage percentage across all hosts
max
17.66%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.02%
Memory growth rate
Rate of memory growth over time
growth
-60.03MB/s
Disk read throughput
Disk read throughput in MB/s
0.01MB/s
Disk write throughput
Disk write throughput in MB/s
18.03MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname
0/1hosts
Mount Point
/etc/hosts
0/1hosts
Mount Point
/etc/resolv.conf
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.05
5 min
1.05
15 min
0.55
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
2.34%
<
mean
3.5903%
(SD =
1.9025%)
<
p95
8.09%
60 second average
3.3600%
300 second average
1.9678%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.2672%
(SD =
0.4448%)
<
p95
1.49%
60 second average
0.2778%
300 second average
0.2537%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
0.2113%
(SD =
0.3745%)
<
p95
1.32%
60 second average
0.2172%
300 second average
0.2163%
Holochain process CPU usage
CPU usage by Holochain process
p5
0%
<
mean
46.98%
(SD =
14.14%)
<
p95
52.72%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
189060B
<
mean
238471.8B
(SD =
33457.97B)
<
p95
249772B
Holochain process threads
Number of threads in Holochain process
p5
1 threads
<
mean
12.34 threads
(SD =
2.99 threads)
<
p95
14 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0 file descriptors
<
mean
58.09 file descriptors
(SD =
15.8 file descriptors)
<
p95
70 file descriptors
Write validated
Creates an entry, updates it and links the create to the update, then repeats. Each of the three actions is validated by the included hApp.
Started
Thu, 12 Mar 2026 01:07:40 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
write_validated_22981335548
Write timing
The time it takes to complete the zome function call that writes the entry, updates it, and links to the update.
mean
0.099866s
(SD =
0.226941s)
p50
0.033541s
p95
0.394337s
p99
1.267319s
Write rate
The number of write zome function calls that complete per second.
mean
42.85/s
Read timing
The time it takes to complete the zome function call that reads the data.
mean
0.135163s
(SD =
0.259171s)
p50
0.05681s
p95
0.446588s
p99
1.346386s
Read rate
The number of read zome function calls that complete per second.
mean
42.18/s
Error count
The number of errors accumulated over the run.
0
Host Metrics
User CPU usage
CPU usage by user space
20.55%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
15.1B/s
<
mean
124991.68B/s
(SD =
672029.43B/s)
≤
p95
819.6B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
93.8B/s
<
mean
2727.38B/s
(SD =
11148.41B/s)
≤
p95
1764.4B/s
Total bytes received
Total bytes received on primary network interface
count
37497505B
mean
124991.68B/s
Total bytes sent
Total bytes sent on primary network interface
count
818214B
mean
2727.38B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 46.86 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
14.35%
<
mean
25.1%
(SD =
10.29%)
<
p95
46.5%
System
4.55%
CPU percentiles
CPU usage percentiles
p50
22.92%
p95
46.50%
p99
66.90%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
17.31%
<
mean
18.56%
(SD =
1.25%)
<
p95
19.39%
Memory available percentage
Percentage of available memory
p5
80.61%
<
mean
81.44%
(SD =
1.25%)
<
p95
82.69%
Max host memory used
Maximum memory usage percentage across all hosts
max
18.56%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00%
Memory growth rate
Rate of memory growth over time
growth
46.86MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
11.00MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/1hosts
Mount Point
/efi-boot
0/1hosts
Mount Point
/nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.00
5 min
1.07
15 min
0.53
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.2523%
(SD =
0.3791%)
<
p95
1.03%
60 second average
0.2313%
300 second average
0.1113%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
16.75%
<
mean
26.0855%
(SD =
5.6243%)
<
p95
37.08%
60 second average
22.9042%
300 second average
14.5874%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
15.83%
<
mean
24.4006%
(SD =
5.1239%)
<
p95
32.21%
60 second average
21.3926%
300 second average
13.6597%
Holochain process CPU usage
CPU usage by Holochain process
p5
12.75%
<
mean
23.04%
(SD =
9.47%)
<
p95
32.16%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
475853B
<
mean
476762B
(SD =
44276.8B)
<
p95
489381B
Holochain process threads
Number of threads in Holochain process
p5
13 threads
<
mean
14.83 threads
(SD =
1.69 threads)
<
p95
16 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
62 file descriptors
<
mean
64.37 file descriptors
(SD =
5.49 file descriptors)
<
p95
70 file descriptors
Write Validated must_get_agent_activity
A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.
The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.
This test is similar to Mixed-Arc must_get_agent_activity, but all agents are full-arc.
Started
Thu, 12 Mar 2026 01:35:40 UTC
Peer count
2
Peer count at end
2
Behaviours
-
must_get_agent_activity(1 agent) -
write(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
write_validated_must_get_agent_activity_22981335548
Highest observed
action_seqThe maximum chain length observed per
write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1787
Max
Highest chain head value observed for any single write agent.
1787
Write agents observed
1
Chain batch delay timing
The time between a
write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.Mean
mean
3.711432s
(SD =
4.980996s)
Max
Highest per-partition mean latency
max mean
3.711432s
Min
Lowest per-partition mean latency
min mean
3.711432s
Chain batch delay rate
The rate at which a
must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.Mean
mean
1.92/s
Max
Highest per-partition mean rate
max
1.92/s
Min
Lowest per-partition mean rate
min
1.92/s
create_validated_sample_entry zome call timingThe time taken to complete the zome function call that creates the entry that depends on a
write agent's source chain.Mean
mean
0.51709s
(SD =
1.322229s)
Max
Highest per-partition mean latency
max mean
0.51709s
Min
Lowest per-partition mean latency
min mean
0.51709s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on
must_get_agent_activity calls.Total
73
Agents affected
1 / 1
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
73
Max
Highest count in any single partition
73
Min
Lowest count in any single partition
73
Final error count
The total number of all types of error accumulated over the run by all agents.
4639
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.00197s
(SD =
0.000857s)
p50
0.001676s
p95
0.003774s
p99
0.005245s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.030195s
(SD =
0.305528s)
p50
0.004182s
p95
0.031894s
p99
0.328411s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
1.9e-05s
(SD =
4.6e-05s)
p50
1.3e-05s
p95
3.5e-05s
p99
0.000128s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.000553s
(SD =
0.000436s)
p50
0.00038s
p95
0.00157s
p99
0.002388s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.028563s
(SD =
0.305513s)
p50
0.002356s
p95
0.029753s
p99
0.326785s
Host Metrics
User CPU usage
CPU usage by user space
7.44%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
5399.9B/s
<
mean
356804.04B/s
(SD =
1.3389673e+06B/s)
<
p95
2.0108978e+06B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
5536.6B/s
<
mean
31567.5B/s
(SD =
62637.29B/s)
<
p95
101798.3B/s
Total bytes received
Total bytes received on primary network interface
count
642247271B
mean
713608.08B/s
Total bytes sent
Total bytes sent on primary network interface
count
56821502B
mean
63135.00B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 783.98 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
3.99%
<
mean
10.44%
(SD =
9.18%)
<
p95
24.98%
System
3.00%
CPU percentiles
CPU usage percentiles
p50
6.70%
p95
24.98%
p99
58.65%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
18.21%
<
mean
20.85%
(SD =
3%)
<
p95
27.7%
Memory available percentage
Percentage of available memory
p5
72.3%
<
mean
79.15%
(SD =
3%)
<
p95
81.79%
Max host memory used
Maximum memory usage percentage across all hosts
max
21.21%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00%
Memory growth rate
Rate of memory growth over time
growth
783.98MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
7.85MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/2hosts
Mount Point
/efi-boot
0/2hosts
Mount Point
/nix/store
0/2hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.31
5 min
0.94
15 min
0.55
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.6203%
(SD =
0.9205%)
<
p95
2.93%
60 second average
0.6093%
300 second average
0.3951%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
1.28%
<
mean
18.4728%
(SD =
20.8769%)
<
p95
62.13%
60 second average
17.4734%
300 second average
14.0863%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
1.12%
<
mean
16.2297%
(SD =
18.2551%)
<
p95
55.8%
60 second average
15.3032%
300 second average
12.5389%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.42%
<
mean
5.08%
(SD =
7.21%)
<
p95
17.54%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
111027B
<
mean
341369.53B
(SD =
179669.27B)
<
p95
511616B
Holochain process threads
Number of threads in Holochain process
p5
11 threads
<
mean
19.28 threads
(SD =
6.66 threads)
<
p95
32 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
49 file descriptors
<
mean
73.09 file descriptors
(SD =
15.57 file descriptors)
<
p95
86 file descriptors
Zero-Arc Create and Read
A zero-arc/full-arc mixed scenario with two types of zero-arc nodes -- ones that create data and ones that read data -- as well as full arc nodes to "relay" the data. The scenario has three roles:
zero_write: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so thatzero_readnodes can retrieve them.zero_read: A zero-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.full: A full-arc conductor that is just here to serve entries to zero arc nodes.
Started
Thu, 12 Mar 2026 01:48:05 UTC
Peer count
9
Peer count at end
9
Behaviours
-
full(1 agent) -
zero_read(1 agent) -
zero_write(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
zero_arc_create_and_read_22981335548
Create rate
The number of timed entries created by the zero-arc write node(s) per second.
Mean
mean
77.09/s
Max
Highest per-partition mean rate
max
98.22/s
Min
Lowest per-partition mean rate
min
57/s
Fetch lag timing
For each entry, the time lag between when it was created and when a zero-arc read node fetched it from the network via the
get_timed_entries_network zome function.Mean
mean
9.481492519537781e+30s
(SD =
5.113813810953064e+31s)
Max
Highest per-partition mean latency
max mean
1.7707000993623498e+31s
Min
Lowest per-partition mean latency
min mean
1.499041263968892e+30s
Fetch lag rate
The number of entries per second fetched by zero-arc read nodes.
Mean
mean
41.19/s
Max
Highest per-partition mean rate
max
42.89/s
Min
Lowest per-partition mean rate
min
38.6/s
Open connections
The number of currently open connections to other conductors.
full-arc
p5
2
<
mean
7.05
(SD =
1.64)
<
p95
8
zero-arc
p5
2
<
mean
5.06
(SD =
1.42)
<
p95
7
Error count
The number of errors accumulated across all nodes.
1
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.212376s
(SD =
0.659958s)
p50
0.205574s
p95
0.482735s
p99
0.711458s
Request roundtrip duration: 'get_links'
The time spent sending a get_links request and awaiting its response
mean
0.136944s
(SD =
0.176751s)
p50
0.038581s
p95
0.474587s
p99
0.549085s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.418689s
(SD =
0.672689s)
p50
0.101657s
p95
1.828519s
p99
2.75747s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
4.4e-05s
(SD =
0.000132s)
p50
1.9e-05s
p95
9.3e-05s
p99
0.000768s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.000652s
(SD =
0.001622s)
p50
0.00046s
p95
0.001641s
p99
0.0023s
Handle incoming request duration: 'get_links'
The time spent handling an incoming get_links request
mean
0.001338s
(SD =
0.003947s)
p50
0.000437s
p95
0.004283s
p99
0.023462s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.301118s
(SD =
0.622858s)
p50
0.010637s
p95
1.569389s
p99
2.691555s
Zero-Arc Create Data
A zero-arc/full-arc mixed scenario where zero-arc nodes create data and full-arc nodes read the data. The scenario has two roles:
zero: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so that full-arc nodes can retrieve them.full: A full-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Thu, 12 Mar 2026 01:41:35 UTC
Peer count
10
Peer count at end
10
Behaviours
-
full(1 agent) -
zero(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
zero_arc_create_data_22981335548
Create rate
The number of timed entries created by the zero-arc node(s) per second.
Mean
mean
73.68/s
Max
Highest per-partition mean rate
max
100.69/s
Min
Lowest per-partition mean rate
min
32.08/s
Sync lag timing
For each entry, the time lag between when it was created and when the full-arc node could read it via the
get_timed_local_entries zome function.Mean
mean
1.7624968288711038e+31s
(SD =
5.084563675188384e+31s)
Max
Highest per-partition mean latency
max mean
4.745777817591724e+31s
Min
Lowest per-partition mean latency
min mean
204.516463s
Sync lag rate
The number of entries per second received by full nodes.
Mean
mean
25.43/s
Max
Highest per-partition mean rate
max
62.8/s
Min
Lowest per-partition mean rate
min
3.79/s
Open connections
The number of currently open connections to other conductors.
full-arc
p5
3
<
mean
5.42
(SD =
1.5)
<
p95
8
zero-arc
p5
1
<
mean
4.81
(SD =
1.83)
<
p95
7
Error count
The number of errors accumulated across all nodes.
0
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.053943s
(SD =
0.051772s)
p50
0.088066s
p95
0.106992s
p99
0.109678s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.405263s
(SD =
2.037861s)
p50
0.18606s
p95
1.561709s
p99
3.508516s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
1e-05s
(SD =
2.2e-05s)
p50
8e-06s
p95
1.9e-05s
p99
4.9e-05s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.000385s
(SD =
0.000691s)
p50
0.000242s
p95
0.000894s
p99
0.002648s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.256435s
(SD =
1.363042s)
p50
0.030624s
p95
1.419231s
p99
3.445281s
Host Metrics
User CPU usage
CPU usage by user space
25.56%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
536.6B/s
<
mean
514795.86B/s
(SD =
1.0777201e+06B/s)
<
p95
2.540137e+06B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
1480B/s
<
mean
146954.68B/s
(SD =
263338.77B/s)
<
p95
862141.6B/s
Total bytes received
Total bytes received on primary network interface
count
1590719192B
mean
4678585.86B/s
Total bytes sent
Total bytes sent on primary network interface
count
454089957B
mean
1335558.70B/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 93.8%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 101.98 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Warning Moderate swap usage (19.8% swap used)
System overload anomaly
System overload anomaly was detected
Detected
Warning 10% of hosts overloaded (load5/ncpus > 1.0)
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
4.35%
<
mean
30.86%
(SD =
24.77%)
<
p95
92.02%
System
5.30%
CPU percentiles
CPU usage percentiles
p50
28.40%
p95
92.02%
p99
93.75%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
2 hosts
mean time
0.43s
Memory used percentage
Percentage of memory used
p5
8.49%
<
mean
26.46%
(SD =
22.47%)
<
p95
92.01%
Memory available percentage
Percentage of available memory
p5
7.99%
<
mean
73.54%
(SD =
22.47%)
<
p95
91.51%
Max host memory used
Maximum memory usage percentage across all hosts
max
91.84%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
19.80%
Memory growth rate
Rate of memory growth over time
growth
101.98MB/s
Disk read throughput
Disk read throughput in MB/s
0.08MB/s
Disk write throughput
Disk write throughput in MB/s
136.66MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/3hosts
Mount Point
/efi-boot
0/2hosts
Mount Point
/etc/hostname
0/7hosts
Mount Point
/etc/hosts
0/7hosts
Mount Point
/etc/resolv.conf
0/7hosts
Mount Point
/nix/store
0/3hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.16
5 min
1.92
15 min
1.11
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
10.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
8.6472%
(SD =
16.2926%)
<
p95
54.78%
60 second average
7.4644%
300 second average
3.7966%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.0063%
(SD =
0.0789%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.0031%
(SD =
0.0559%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
30.9639%
(SD =
24.8466%)
<
p95
70.86%
60 second average
28.5802%
300 second average
20.9498%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
25.1142%
(SD =
20.8638%)
<
p95
65.95%
60 second average
23.2344%
300 second average
17.6339%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.84%
<
mean
17.05%
(SD =
12.8%)
<
p95
37.72%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
85889B
<
mean
241098.83B
(SD =
82936.34B)
<
p95
334268B
Holochain process threads
Number of threads in Holochain process
p5
8 threads
<
mean
22.77 threads
(SD =
10.55 threads)
<
p95
36 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
23 file descriptors
<
mean
72.03 file descriptors
(SD =
18.76 file descriptors)
<
p95
89 file descriptors
Zero-arc Create Data (Validated)
A zero-arc/full-arc mixed scenario where zero-arc nodes create data that gets validated and full-arc nodes read the data. The scenario has two roles:
zero: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so that full-arc nodes can retrieve them.full: A full-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Thu, 12 Mar 2026 01:44:49 UTC
Peer count
10
Peer count at end
10
Behaviours
-
full(1 agent) -
zero(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
zero_arc_create_data_validated_22981335548
Create rate
The number of timed entries created by the zero-arc node(s) per second.
Mean
mean
96.53/s
Max
Highest per-partition mean rate
max
179.24/s
Min
Lowest per-partition mean rate
min
23.15/s
Sync lag timing
For each entry, the time lag between when it was created and when the full-arc node could read it via the
get_timed_local_entries zome function.Mean
mean
90.424804s
(SD =
47.278523s)
Max
Highest per-partition mean latency
max mean
128.169057s
Min
Lowest per-partition mean latency
min mean
56.3685s
Sync lag rate
The number of entries per second received by full nodes.
Mean
mean
47.76/s
Max
Highest per-partition mean rate
max
104.33/s
Min
Lowest per-partition mean rate
min
0/s
Open connections
The number of currently open connections to other conductors.
full-arc
p5
0
<
mean
5.69
(SD =
3.31)
<
p95
9
zero-arc
p5
6
<
mean
7.29
(SD =
0.76)
<
p95
8
App validation workflow duration
The time taken to apply app validation to the data.
mean
0.184268s
(SD =
2.453434s)
p50
0.011858s
p95
0.086429s
p99
1.666905s
System validation workflow duration
The time taken to apply system validation to the data.
mean
0.058606s
(SD =
0.762443s)
p50
0.007737s
p95
0.06023s
p99
0.553187s
Error count
The number of errors accumulated across all nodes.
0
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean
0.296869s
(SD =
1.138713s)
p50
0.288858s
p95
0.435568s
p99
0.545248s
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean
0.34702s
(SD =
1.124959s)
p50
0.226131s
p95
0.817988s
p99
2.771291s
Handle incoming response duration
The time spent handling an incoming response message of any type
mean
2.5e-05s
(SD =
0.000177s)
p50
1.1e-05s
p95
4.5e-05s
p99
0.000169s
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean
0.002655s
(SD =
0.008187s)
p50
0.00095s
p95
0.007677s
p99
0.02956s
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean
0.175839s
(SD =
1.092752s)
p50
0.015154s
p95
0.53435s
p99
2.376059s
Host Metrics
User CPU usage
CPU usage by user space
30.48%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
2556.3B/s
<
mean
610343.52B/s
(SD =
1.64041087e+06B/s)
<
p95
2.66096e+06B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
3395.4B/s
<
mean
119287.08B/s
(SD =
110425.72B/s)
<
p95
328158.6B/s
Total bytes received
Total bytes received on primary network interface
count
1873754614B
mean
5204873.93B/s
Total bytes sent
Total bytes sent on primary network interface
count
366211333B
mean
1017253.70B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 702.38 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
11.4%
<
mean
40.38%
(SD =
22.52%)
<
p95
84.03%
System
9.90%
CPU percentiles
CPU usage percentiles
p50
37.73%
p95
84.03%
p99
88.40%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
2 hosts
mean time
0.48s
Memory used percentage
Percentage of memory used
p5
10.75%
<
mean
24.21%
(SD =
10.68%)
<
p95
50.02%
Memory available percentage
Percentage of available memory
p5
49.98%
<
mean
75.79%
(SD =
10.68%)
<
p95
89.25%
Max host memory used
Maximum memory usage percentage across all hosts
max
49.89%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.96%
Memory growth rate
Rate of memory growth over time
growth
702.38MB/s
Disk read throughput
Disk read throughput in MB/s
2.93MB/s
Disk write throughput
Disk write throughput in MB/s
172.45MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/5hosts
Mount Point
/efi-boot
0/4hosts
Mount Point
/etc/hostname
0/5hosts
Mount Point
/etc/hosts
0/5hosts
Mount Point
/etc/resolv.conf
0/5hosts
Mount Point
/nix/store
0/5hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.33
5 min
1.89
15 min
0.99
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.02%
<
mean
5.9917%
(SD =
9.4969%)
<
p95
26.25%
60 second average
5.0301%
300 second average
2.4432%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
24.2007%
(SD =
24.5603%)
<
p95
62.85%
60 second average
21.8502%
300 second average
14.0222%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0%
<
mean
18.9507%
(SD =
19.6982%)
<
p95
53.52%
60 second average
17.1866%
300 second average
11.2803%
Holochain process CPU usage
CPU usage by Holochain process
p5
0%
<
mean
23.98%
(SD =
17.51%)
<
p95
59.14%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
27819B
<
mean
434841.35B
(SD =
169595.84B)
<
p95
586162B
Holochain process threads
Number of threads in Holochain process
p5
1 threads
<
mean
22.96 threads
(SD =
12.62 threads)
<
p95
44 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0 file descriptors
<
mean
65.39 file descriptors
(SD =
29.89 file descriptors)
<
p95
92 file descriptors
Zome Call, Single Value
Calls a zome function that returns a fixed value. This tests the maximum performance of zome calls when the zome function is not calling into Holochain other otherwise doing any work.
Started
Thu, 12 Mar 2026 01:10:42 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
zome_call_single_value_22981335548
Call timing
The time taken for the call to complete.
mean
0.003251s
(SD =
0.017239s)
p50
0.002467s
p95
0.002777s
p99
0.007244s
Call rate
The number of zome calls completed per second.
mean
3065.64/s
Error count
The number of errors accumulated during the run.
0
Host Metrics
User CPU usage
CPU usage by user space
15.95%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
38.5B/s
<
mean
276586.49B/s
(SD =
1.48837211e+06B/s)
≤
p95
1217.4B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
123.3B/s
<
mean
5356.44B/s
(SD =
25116.44B/s)
≤
p95
1749.2B/s
Total bytes received
Total bytes received on primary network interface
count
82975946B
mean
276586.49B/s
Total bytes sent
Total bytes sent on primary network interface
count
1606931B
mean
5356.44B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 75.42 MB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Additional Host Metrics
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
20.01%
<
mean
24.27%
(SD =
5.67%)
<
p95
25.38%
System
8.32%
CPU percentiles
CPU usage percentiles
p50
23.51%
p95
25.38%
p99
53.59%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
p5
16.47%
<
mean
17.48%
(SD =
1.08%)
<
p95
18.64%
Memory available percentage
Percentage of available memory
p5
81.36%
<
mean
82.52%
(SD =
1.08%)
<
p95
83.53%
Max host memory used
Maximum memory usage percentage across all hosts
max
17.48%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.01%
Memory growth rate
Rate of memory growth over time
growth
75.42MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
6.93MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/
0/1hosts
Mount Point
/efi-boot
0/1hosts
Mount Point
/nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.22
5 min
0.66
15 min
0.33
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0%
<
mean
0.0865%
(SD =
0.2327%)
<
p95
0.45%
60 second average
0.0787%
300 second average
0.0406%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0%
≤
mean
0%
(SD =
0%)
≤
p95
0%
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
4.89%
<
mean
11.0245%
(SD =
7.854%)
<
p95
29.35%
60 second average
10.5871%
300 second average
7.9655%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
4.53%
<
mean
10.0726%
(SD =
6.3293%)
<
p95
23.62%
60 second average
9.6697%
300 second average
7.3813%
Holochain process CPU usage
CPU usage by Holochain process
p5
16.61%
<
mean
21.04%
(SD =
5.65%)
<
p95
22%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
255151B
≤
mean
251073.53B
(SD =
36562.03B)
<
p95
259411B
Holochain process threads
Number of threads in Holochain process
p5
11 threads
≤
mean
10.9 threads
(SD =
0.54 threads)
<
p95
11 threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
48 file descriptors
<
mean
52.13 file descriptors
(SD =
8.12 file descriptors)
<
p95
70 file descriptors