App Install

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Thu, 05 Mar 2026 02:27:26 UTC
Peer count
1
Peer count at end
1
Behaviours
  • large (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
app_install_large_22696767866
First install time
The time from conductor startup to completion of the first app installation attempt.
0.532041262s
Install app timing
The time taken to install an app.
mean 0.212539s (SD = 0.005996s)
Host Metrics
User CPU usage
CPU usage by user space
42.67%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 22949.16B/s (SD = 12499.92B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 7157.93B/s (SD = 3150.32B/s)
Total bytes received
Total bytes received on primary network interface
count
2753899B
mean
22949.16B/s
Total bytes sent
Total bytes sent on primary network interface
count
858951B
mean
7157.93B/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 92.3%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 796.15 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 52.14% (SD = 17.03%)
System
9.47%
CPU percentiles
CPU usage percentiles
p50
46.71%
p95
92.33%
p99
92.33%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1 hosts
mean time
0.17s
Memory used percentage
Percentage of memory used
mean 49.38% (SD = 2.97%)
Memory available percentage
Percentage of available memory
mean 50.62% (SD = 2.97%)
Max host memory used
Maximum memory usage percentage across all hosts
max 49.38%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 0.25%
Memory growth rate
Rate of memory growth over time
growth 796.15MB/s
Disk read throughput
Disk read throughput in MB/s
1.93MB/s
Disk write throughput
Disk write throughput in MB/s
12.80MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
0/1hosts
Mount Point /etc/hosts
0/1hosts
Mount Point /etc/resolv.conf
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.45
5 min
0.80
15 min
0.61
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
Holochain process CPU usage
CPU usage by Holochain process
mean 39.51% (SD = 17.22%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 580037.15B (SD = 242072.65B)
Holochain process threads
Number of threads in Holochain process
mean 15.31 threads (SD = 3.69 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 352 file descriptors (SD = 247.93 file descriptors)

App Install

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Thu, 05 Mar 2026 02:29:37 UTC
Peer count
1
Peer count at end
1
Behaviours
  • minimal (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
app_install_minimal_22696767866
First install time
The time from conductor startup to completion of the first app installation attempt.
0.265819747s
Install app timing
The time taken to install an app.
mean 0.049173s (SD = 0.012036s)
Host Metrics
User CPU usage
CPU usage by user space
14.92%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 290657.68B/s (SD = 876094.37B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 35791.23B/s (SD = 18320.81B/s)
Total bytes received
Total bytes received on primary network interface
count
90103880B
mean
290657.68B/s
Total bytes sent
Total bytes sent on primary network interface
count
11095281B
mean
35791.23B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1770.28 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (11.5% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 17.45% (SD = 3.53%)
System
2.54%
CPU percentiles
CPU usage percentiles
p50
17.41%
p95
18.75%
p99
30.08%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
mean 14.74% (SD = 4.03%)
Memory available percentage
Percentage of available memory
mean 85.26% (SD = 4.03%)
Max host memory used
Maximum memory usage percentage across all hosts
max 14.74%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 11.54%
Memory growth rate
Rate of memory growth over time
growth 1770.28MB/s
Disk read throughput
Disk read throughput in MB/s
2.99MB/s
Disk write throughput
Disk write throughput in MB/s
32.29MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1hosts
Mount Point /efi-boot
0/1hosts
Mount Point /nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.21
5 min
0.57
15 min
0.23
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0.0359% (SD = 0.0663%)
60 second average
0.0247%
300 second average
0.0025%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0.0359% (SD = 0.0663%)
60 second average
0.0247%
300 second average
0.0025%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 1.0078% (SD = 0.9275%)
60 second average
0.7594%
300 second average
0.3197%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 0.9503% (SD = 0.876%)
60 second average
0.7281%
300 second average
0.3081%
Holochain process CPU usage
CPU usage by Holochain process
mean 16.63% (SD = 0.71%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 1.75950913e+06B (SD = 485760.63B)
Holochain process threads
Number of threads in Holochain process
mean 22 threads (SD = 0 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 2235.2 file descriptors (SD = 571.45 file descriptors)

DHT Sync Lag

Measure lag time between an agent publishing data and other peers being able to see it. This scenario has two roles:

  • write: A simple job that just creates entries with a timestamp field. Those entries are linked to a known base hash. For each write, the metric ws.custom.dht_sync_sent_count is incremented.
  • record_lag: A job that repeatedly queries for links from the known base hash. It keeps track of records that it has seen and when a new record is found, and calculates the time difference between the timestamp of the new record and the current time. That time difference is then recorded as a custom metric called wt.custom.dht_sync_lag.

After each behaviour loop the metric ws.custom.dht_sync_recv_count is incremented.

Started
Thu, 05 Mar 2026 02:40:17 UTC
Peer count
10
Peer count at end
10
Behaviours
  • record_lag (1 agent)
  • write (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
dht_sync_lag_22696767866
Create rate
The average number of created records per agent.
All agents
mean 70.7/s
  • agent: uhCAkDEk4TiMOh8Autx6s0ZAJiMn1vGVi4D7vO3NOWRJ0kkX5NwdT
mean 88.62/s
  • agent: uhCAkF79yfFh9dXf8AxQGwwt4vns8v9u8ZGu6Ce82FeG-pj0t50I_
mean 105.25/s
  • agent: uhCAkL3e6OU2UzAk85X6nVPcherf7Ig95YtBHmdn8GKLXOa6778hh
mean 99.11/s
  • agent: uhCAkO0BbKdC8knlKNqsdrI7cO-3qo4o9DwQoO3_XvhI1kKAlHBnr
mean 19.96/s
  • agent: uhCAkwnvPF3yN8qXBiTZuPUugdnvPUgbQMSMEX3YI0mzJ9fbyCCZH
mean 40.54/s
Sync lag timing
The average time between when a record was created and when it is first seen by an agent.
All agents
mean 3.547627278186865e+31 (SD = 1.0250996200475766e+32)
  • agent: uhCAkMddWibVEI7N4HgQFfHyhsw9QvrgBvLBElnAP6KtZ6cgLDueF
mean 3.6090554067372254e+31s (SD = 1.0477810395613972e+32s)
  • agent: uhCAkYUfGoH3bNIQnBNEf2Yfr1DVIenXIIydVyLW3ppnBQDhgKvrm
mean 4.51354927288442e+31s (SD = 1.1541923407317493e+32s)
  • agent: uhCAksZzFCb86ZGRIgwJHJf0_yPymberGHiRZjtIOWUItQfTdfcg7
mean 4.148204091988583e+31s (SD = 1.1133214877137194e+32s)
  • agent: uhCAkzb_6Kk7zgYJZiva7N28sol_vTjg2KOuXQo_PEptIaIeE2BkF
mean 1.9197003411372322e+31s (SD = 7.851036121834403e+31s)
Sync lag rate
The average number of created records discovered per agent.
All agents
mean 105.32/s
  • agent: uhCAkMddWibVEI7N4HgQFfHyhsw9QvrgBvLBElnAP6KtZ6cgLDueF
mean 38.84/s
  • agent: uhCAkYUfGoH3bNIQnBNEf2Yfr1DVIenXIIydVyLW3ppnBQDhgKvrm
mean 332.33/s
  • agent: uhCAksZzFCb86ZGRIgwJHJf0_yPymberGHiRZjtIOWUItQfTdfcg7
mean 0/s
  • agent: uhCAkzb_6Kk7zgYJZiva7N28sol_vTjg2KOuXQo_PEptIaIeE2BkF
mean 50.1/s
Error count
The number of errors encountered during the scenario.
6
Cascade duration
The time taken to execute a cascade query.
mean 0.003266s (SD = 0.014299s)
WASM usage
The metered usage of a wasm ribosome.
Total
total 0over 32301.776467559s
Not enough time data to show a trend.
zome=timed,fn=created_timed_entry
total 0over 374.620432014s
Not enough time data to show a trend.
zome=timed,fn=get_timed_entries_local
total 0over 32296.189069315s
Not enough time data to show a trend.
zome=timed_integrity,fn=entry_defs
total 0over 32301.776467559s
Not enough time data to show a trend.
post_commit duration
The time spent executing a post commit.
mean 0.000629s (SD = 0.00076s)
Publish DHT ops workflow duration
The time spent running the publish workflow.
mean 0.093331s (SD = 0.13381s)
Integrate DHT ops workflow duration
The time spent running the integration workflow.
mean 0.017886s (SD = 0.134427s)
Countersigning workflow duration
agent=AgentPubKey(uhCAkDEk4TiMOh8Autx6s0ZAJiMn1vGVi4D7vO3NOWRJ0kkX5NwdT)
mean 0.000799s (SD = 0s)
Not enough time data to show a trend.
agent=AgentPubKey(uhCAkF79yfFh9dXf8AxQGwwt4vns8v9u8ZGu6Ce82FeG-pj0t50I_)
mean 0.002903s (SD = 0s)
Not enough time data to show a trend.
agent=AgentPubKey(uhCAkJlrw-TbQe1cVkEgZhpydyJiyM-Mb_mBW1SdfzYAMHZoqkKMa)
mean 0.0009s (SD = 0s)
Not enough time data to show a trend.
agent=AgentPubKey(uhCAkL3e6OU2UzAk85X6nVPcherf7Ig95YtBHmdn8GKLXOa6778hh)
mean 0.003905s (SD = 0s)
Not enough time data to show a trend.
agent=AgentPubKey(uhCAkMddWibVEI7N4HgQFfHyhsw9QvrgBvLBElnAP6KtZ6cgLDueF)
mean 0.000678s (SD = 0s)
Not enough time data to show a trend.
agent=AgentPubKey(uhCAkO0BbKdC8knlKNqsdrI7cO-3qo4o9DwQoO3_XvhI1kKAlHBnr)
mean 0.001324s (SD = 0s)
Not enough time data to show a trend.
agent=AgentPubKey(uhCAkYUfGoH3bNIQnBNEf2Yfr1DVIenXIIydVyLW3ppnBQDhgKvrm)
mean 0.00088s (SD = 0s)
Not enough time data to show a trend.
agent=AgentPubKey(uhCAksZzFCb86ZGRIgwJHJf0_yPymberGHiRZjtIOWUItQfTdfcg7)
mean 0.005756s (SD = 0s)
Not enough time data to show a trend.
agent=AgentPubKey(uhCAkwnvPF3yN8qXBiTZuPUugdnvPUgbQMSMEX3YI0mzJ9fbyCCZH)
mean 0.001007s (SD = 0s)
Not enough time data to show a trend.
agent=AgentPubKey(uhCAkzb_6Kk7zgYJZiva7N28sol_vTjg2KOuXQo_PEptIaIeE2BkF)
mean 0.000773s (SD = 0s)
Not enough time data to show a trend.
App validation workflow duration
The time spent running the app validation workflow.
mean 0.268647s (SD = 2.053649s)
System validation workflow duration
The time spent running the sys validation workflow.
mean 0.12758s (SD = 0.902638s)
Validation receipt workflow duration
The time spent running the validation receipt workflow.
mean 0.506806s (SD = 6.955312s)
Authored DB
The utilization of connections in the authored database connection pool.
Utilisation for id=\"_0.dna_hash()\"-\"_0.agent_pubkey()\"
p5 0% < mean 0.09% (SD = 0.09%) < p95 0.22%
Use time
mean 0.002603s (SD = 0.012597s)
Conductor DB
The utilization of connections in the conductor database connection pool.
Utilisation
p5 0% mean 0% (SD = 0.01%) p95 0%
Use time
mean 0.000124s (SD = 0.000259s)
DHT DB
The utilization of connections in the DHT database connection pool.
Utilisation
p5 0% < mean 0.16% (SD = 0.12%) < p95 0.33%
Use time
mean 0.0015s (SD = 0.014497s)
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean 0.140033s (SD = 1.517065s)
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean 0.411507s (SD = 0.654722s)
Handle incoming response duration
The time spent handling an incoming response message of any type
mean 2.3e-05s (SD = 7.2e-05s)
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean 0.001729s (SD = 0.003789s)
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean 0.355404s (SD = 0.640597s)
Host Metrics
User CPU usage
CPU usage by user space
33.45%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 171534.91B/s (SD = 394834.94B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 153116.08B/s (SD = 159116.45B/s)
Total bytes received
Total bytes received on primary network interface
count
511174046B
mean
1648948.54B/s
Total bytes sent
Total bytes sent on primary network interface
count
456285909B
mean
1471890.03B/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.8%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 145.07 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (27.9% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 10% of hosts overloaded (load5/ncpus > 1.0)

Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 41.31% (SD = 27.84%)
System
7.86%
CPU percentiles
CPU usage percentiles
p50
29.78%
p95
98.19%
p99
98.80%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
2 hosts
mean time
0.71s
Memory used percentage
Percentage of memory used
mean 21.02% (SD = 11.87%)
Memory available percentage
Percentage of available memory
mean 78.98% (SD = 11.87%)
Max host memory used
Maximum memory usage percentage across all hosts
max 45.82%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 27.87%
Memory growth rate
Rate of memory growth over time
growth 145.07MB/s
Disk read throughput
Disk read throughput in MB/s
2.27MB/s
Disk write throughput
Disk write throughput in MB/s
206.66MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/3hosts
Mount Point /efi-boot
0/2hosts
Mount Point /etc/hostname
0/7hosts
Mount Point /etc/hosts
0/7hosts
Mount Point /etc/resolv.conf
0/7hosts
Mount Point /nix/store
0/3hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.31
5 min
1.72
15 min
0.87
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
10.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 15.7967% (SD = 28.6312%)
60 second average
13.0349%
300 second average
6.1228%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0.0064% (SD = 0.0565%)
60 second average
0.0068%
300 second average
0.0030%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0.0019% (SD = 0.017%)
60 second average
0.0016%
300 second average
0.0001%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 15.1558% (SD = 13.8336%)
60 second average
12.7573%
300 second average
6.3246%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 12.4618% (SD = 11.7466%)
60 second average
10.4893%
300 second average
5.2454%
Holochain process CPU usage
CPU usage by Holochain process
mean 38.47% (SD = 26.31%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 296718B (SD = 45778.51B)
Holochain process threads
Number of threads in Holochain process
mean 31.4 threads (SD = 10.44 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 77.09 file descriptors (SD = 13.56 file descriptors)

First Call

This scenario installs a simple app which implements the init callback, and measures the time elapsed between start of install and calling init. It will uninstall the app it installed so that it can re-install it on the next iteration. This is required to re-run the initialisation callback.

Started
Thu, 05 Mar 2026 00:56:42 UTC
Peer count
1
Peer count at end
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
first_call_22696767866
Zome call timing
The time elapsed between start of install and calling init.
mean 0.025727s (SD = 0.057421s)
Host Metrics
User CPU usage
CPU usage by user space
7.66%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 27854.23B/s (SD = 119946.1B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 3385.83B/s (SD = 6967.68B/s)
Total bytes received
Total bytes received on primary network interface
count
8356269B
mean
27854.23B/s
Total bytes sent
Total bytes sent on primary network interface
count
1015749B
mean
3385.83B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 166.33 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 11.09% (SD = 5.83%)
System
3.43%
CPU percentiles
CPU usage percentiles
p50
9.14%
p95
21.40%
p99
26.75%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
mean 7.39% (SD = 0.58%)
Memory available percentage
Percentage of available memory
mean 92.61% (SD = 0.58%)
Max host memory used
Maximum memory usage percentage across all hosts
max 7.39%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 0.00%
Memory growth rate
Rate of memory growth over time
growth 166.33MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
8.46MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1hosts
Mount Point /efi-boot
0/1hosts
Mount Point /nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.86
5 min
0.90
15 min
0.36
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 22.3294% (SD = 13.2743%)
60 second average
18.7413%
300 second average
9.0710%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 21.9848% (SD = 13.0198%)
60 second average
18.4394%
300 second average
8.9387%
Holochain process CPU usage
CPU usage by Holochain process
mean 7.29% (SD = 3.04%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 498505.93B (SD = 63357.95B)
Holochain process threads
Number of threads in Holochain process
mean 18.83 threads (SD = 0.37 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 168.83 file descriptors (SD = 181.43 file descriptors)

Full-Arc Create (Validated) / Zero-Arc Read

A full-arc/zero-arc mixed scenario where full-arc nodes create data that gets validated and zero-arc nodes read the data. The scenario has two roles:

  • full: A full-arc conductor that creates entries with a timestamp field. Those entries get validated and then retrieved by zero-arc nodes.
  • zero: A zero-arc conductor that reads the entries created by the full-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Thu, 05 Mar 2026 04:00:15 UTC
Peer count
10
Peer count at end
10
Behaviours
  • full (1 agent)
  • zero (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
full_arc_create_validated_zero_arc_read_22696767866
Create rate
The number of timed entries created by the zero-arc node(s) per second.
All agents
mean 47.59/s
  • agent: uhCAk9m9AIScWz-xgQA4737lknZqawtHIXERjE3q_MAqsbASW_kKv
mean 19.74/s
  • agent: uhCAkfN4-fspirVT9aP9rAJ_Q7icisUEY3T7P3PG5KJg9VzP_hTZL
mean 12.67/s
  • agent: uhCAkrZ2gfTpuxI74HposH_YaA0S5L_QFfMwy8-Tx5IJah5a2KZFL
mean 125.25/s
  • agent: uhCAkwpnehL0K-G2G1TKR1jdJOk-4ORHREvhbUlF4mYxmkwxdxrtv
mean 32.68/s
Sync lag timing
For each entry, the time lag between when it was created and when the full-arc node could read it via the get_timed_local_entries zome function.
All agents
mean 60.987282 (SD = 50.823056)
  • agent: uhCAkKx8v5FpTYbjGy2A7KyFRWfFl2kjI0j2CbnfnA2uWRSI2yJLo
mean 21.737532s (SD = 30.970855s)
  • agent: uhCAkMTAeISnXz2hzPfGFhi9G1iouqv_SXVXkx9y7jM4O06zQJobp
mean 48.471708s (SD = 34.145659s)
  • agent: uhCAkP4NQKVXgN7KLCbf8sWgmMKL5mJM9diGD2wpNQbFgB8CJ0T8V
mean 74.214805s (SD = 59.081814s)
  • agent: uhCAkQQyR9AkFRhS9tvhYsWr5yLpeBt9kDlSzdgPIp7pf6T19TRqB
mean 20.578976s (SD = 30.828053s)
  • agent: uhCAkVFLePEqGQ_HFJhHjt1QNP90rPFBjwOY3H4lGYsAvdpZxYiV6
mean 113.886917s (SD = 94.26126s)
  • agent: uhCAkbtmImHiFuNSh9XYbPOq0qwEpOEKN4811fBJ9oe2rjTOb6TNS
mean 87.033756s (SD = 55.650696s)
Sync lag rate
The number of entries per second received by full nodes.
All agents
mean 183.35/s
  • agent: uhCAkKx8v5FpTYbjGy2A7KyFRWfFl2kjI0j2CbnfnA2uWRSI2yJLo
mean 96.85/s
  • agent: uhCAkMTAeISnXz2hzPfGFhi9G1iouqv_SXVXkx9y7jM4O06zQJobp
mean 169.59/s
  • agent: uhCAkP4NQKVXgN7KLCbf8sWgmMKL5mJM9diGD2wpNQbFgB8CJ0T8V
mean 232.92/s
  • agent: uhCAkQQyR9AkFRhS9tvhYsWr5yLpeBt9kDlSzdgPIp7pf6T19TRqB
mean 117.67/s
  • agent: uhCAkVFLePEqGQ_HFJhHjt1QNP90rPFBjwOY3H4lGYsAvdpZxYiV6
mean 266.75/s
  • agent: uhCAkbtmImHiFuNSh9XYbPOq0qwEpOEKN4811fBJ9oe2rjTOb6TNS
mean 216.33/s
Open connections
The number of currently open connections to other conductors.
full-arc
p5 8 < mean 8.8 (SD = 0.91) < p95 9
zero-arc
p5 5 < mean 7.14 (SD = 1.31) < p95 9
Retrieval errors
Statistics on errors encountered by zero-arc nodes when attempting to retrieve entries created by full-arc nodes.
p5 1 mean 1 (SD = 0) p95 1
App validation workflow duration
The time taken to apply app validation to the data.
mean 6.613297s (SD = 23.360218s)
System validation workflow duration
The time taken to apply system validation to the data.
mean 0.210436s (SD = 1.044379s)
Error count
The number of errors accumulated across all nodes.
3
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean 0.042194s (SD = 0.066905s)
Request roundtrip duration: 'get_links'
The time spent sending a get_links request and awaiting its response
mean 0.072505s (SD = 0.092327s)
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean 0.700394s (SD = 0.826864s)
Handle incoming response duration
The time spent handling an incoming response message of any type
mean 3.9e-05s (SD = 0.000162s)
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean 0.000699s (SD = 0.001507s)
Handle incoming request duration: 'get_links'
The time spent handling an incoming get_links request
mean 0.026851s (SD = 0.030025s)
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean 0.634362s (SD = 0.816749s)
Host Metrics
User CPU usage
CPU usage by user space
14.74%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 192914.33B/s (SD = 493386.36B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 137151.57B/s (SD = 201849.44B/s)
Total bytes received
Total bytes received on primary network interface
count
578743004B
mean
1866912.92B/s
Total bytes sent
Total bytes sent on primary network interface
count
411454719B
mean
1327273.29B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 306.29 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (27.0% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 17.97% (SD = 13.03%)
System
3.23%
CPU percentiles
CPU usage percentiles
p50
14.80%
p95
41.99%
p99
64.56%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1 hosts
mean time
0.03s
Memory used percentage
Percentage of memory used
mean 19.21% (SD = 11.25%)
Memory available percentage
Percentage of available memory
mean 80.79% (SD = 11.25%)
Max host memory used
Maximum memory usage percentage across all hosts
max 41.00%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 27.04%
Memory growth rate
Rate of memory growth over time
growth 306.29MB/s
Disk read throughput
Disk read throughput in MB/s
445.56MB/s
Disk write throughput
Disk write throughput in MB/s
78.29MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/4hosts
Mount Point /efi-boot
0/3hosts
Mount Point /etc/hostname
0/6hosts
Mount Point /etc/hosts
0/6hosts
Mount Point /etc/resolv.conf
0/6hosts
Mount Point /nix/store
0/4hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.25
5 min
1.36
15 min
1.05
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 2.2372% (SD = 4.3124%)
60 second average
1.9369%
300 second average
1.0610%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0005%
300 second average
0.0004%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0005%
300 second average
0.0004%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 12.7385% (SD = 12.7767%)
60 second average
11.2600%
300 second average
7.5513%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 11.9026% (SD = 11.9156%)
60 second average
10.5515%
300 second average
7.2043%
Holochain process CPU usage
CPU usage by Holochain process
mean 15.49% (SD = 12.5%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 510639.1B (SD = 73354.69B)
Holochain process threads
Number of threads in Holochain process
mean 19.35 threads (SD = 8.11 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 68.57 file descriptors (SD = 18.02 file descriptors)

Local Signals

This scenario is for testing the speed and reliability of local signals. It uses a zome with a function that will emit 10,000 signals. The scenario measures how long it takes to send the signals and how many have been received by the time the zome call ends.

Started
Thu, 05 Mar 2026 01:06:32 UTC
Peer count
1
Peer count at end
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
local_signals_22696767866
Send timing
The time taken to emit a batch of 10,000 signals.
mean 0.653383s (SD = 0.324307s)
Receive timing
The time taken to receive the completed batch, to the nearest 250ms.
mean 29.558961s (SD = 3.136407s)
Success ratio
The proportion of signals successfully received in a batch.
min 0.8108000159263611 < mean 0.8459 (SD = 0.0344) < max 0.9060999751091005
Host Metrics
User CPU usage
CPU usage by user space
1.19%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 162389.92B/s (SD = 627477.07B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 4961.37B/s (SD = 17755.99B/s)
Total bytes received
Total bytes received on primary network interface
count
51964776B
mean
162389.92B/s
Total bytes sent
Total bytes sent on primary network interface
count
1587638B
mean
4961.37B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 55.19 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 2.23% (SD = 3.96%)
System
1.04%
CPU percentiles
CPU usage percentiles
p50
0.55%
p95
5.56%
p99
22.58%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
mean 6.01% (SD = 0.57%)
Memory available percentage
Percentage of available memory
mean 93.99% (SD = 0.57%)
Max host memory used
Maximum memory usage percentage across all hosts
max 6.01%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 0.00%
Memory growth rate
Rate of memory growth over time
growth 55.19MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
0.75MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
0/1hosts
Mount Point /etc/hosts
0/1hosts
Mount Point /etc/resolv.conf
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.18
5 min
0.08
15 min
0.02
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 0.1636% (SD = 0.1768%)
60 second average
0.1082%
300 second average
0.0279%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 1.8285% (SD = 1.9748%)
60 second average
1.6085%
300 second average
1.2106%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 1.8136% (SD = 1.9678%)
60 second average
1.5973%
300 second average
1.2058%
Holochain process CPU usage
CPU usage by Holochain process
mean 0.83% (SD = 3.71%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 311524.07B (SD = 8250.69B)
Holochain process threads
Number of threads in Holochain process
mean 13.58 threads (SD = 4.07 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 43.42 file descriptors (SD = 16.74 file descriptors)

Mixed Arc get_agent_activity

A mixed-arc scenario that measures the DHT's ability to propagate agent activity and make it available via get_agent_activity calls. The scenario has three roles:

  • zero_write: A zero-arc conductor that creates entries on its source chain.
  • full_write: A full-arc conductor that creates entries on its source chain.
  • zero_read: A zero-arc conductor that picks a random writer and repeatedly calls get_agent_activity to observe new entries appearing on the writer's chain, measuring the lag between creation and discovery.
Started
Thu, 05 Mar 2026 04:10:18 UTC
Peer count
10
Peer count at end
10
Behaviours
  • full_write (1 agent)
  • zero_read (1 agent)
  • zero_write (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
mixed_arc_get_agent_activity_22696767866
Entry created count
The cumulative number of entries created by write agents over the run, partitioned by agent and behaviour.
All agents
mean 1937.375 (SD = 1118.255237)
  • agent: uhCAkQF2LDTyCp5dK_u2h56rV5K-v5USG8pqyeFh2e7uaCqyRMZi9
  • behaviour: zero_write
mean 2130.5s (SD = 1229.756039s)
  • agent: uhCAkfbMwmjHMqW3jGTbRyvzRc9C6_-63bNDWH_5rP_McTojCKNgC
  • behaviour: full_write
mean 582.5s (SD = 336.017733s)
  • agent: uhCAkt21Zt4GjwEhYLmyIULIgKx-Jz9sv-JPWeX2GmKfaQfmwMtxA
  • behaviour: zero_write
mean 4211s (SD = 2430.933291s)
  • agent: uhCAktGeD5M9UFJWz_Lpea_Kc5d24YyHWUatalkrk86_Vtdvu7xJf
  • behaviour: full_write
mean 825.5s (SD = 476.313885s)
Highest observed action_seq
The rate at which zero-arc readers observe new chain heads on the writers' chains via get_agent_activity. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.
All agents
mean 13.84/s
  • get_agent_activity_agent: uhCAk3oAADjxhQFNC1jb1Ig3XMxZ7UkXMMYML1xtB0oNjT29d-ZqD
  • write_agent: uhCAktGeD5M9UFJWz_Lpea_Kc5d24YyHWUatalkrk86_Vtdvu7xJf
mean 14.04/s
  • get_agent_activity_agent: uhCAkGo6k6EsoLU7JsWMRx0Lkfn2oz3vmQDfQ_nUOc4xmDIBb7Wo6
  • write_agent: uhCAktGeD5M9UFJWz_Lpea_Kc5d24YyHWUatalkrk86_Vtdvu7xJf
mean 12.78/s
  • get_agent_activity_agent: uhCAkcbORIfLg1ZwdNnjFamqIb6xUdhyjxeArCf1tYOrnQiCF8Ge7
  • write_agent: uhCAktGeD5M9UFJWz_Lpea_Kc5d24YyHWUatalkrk86_Vtdvu7xJf
mean 13.8/s
  • get_agent_activity_agent: uhCAkrwQrIHFLHvIf81_iboVJjRCnnly94kVwcvsxEtoYDOQplkaE
  • write_agent: uhCAktGeD5M9UFJWz_Lpea_Kc5d24YyHWUatalkrk86_Vtdvu7xJf
mean 14.74/s
Chain head delay timing
The time lag between when a writer creates a new entry and when a reader discovers it via get_agent_activity. This is measured per new action in the chain.
All agents
mean 0.38657 (SD = 1.109454)
  • agent: uhCAk3oAADjxhQFNC1jb1Ig3XMxZ7UkXMMYML1xtB0oNjT29d-ZqD
mean 0.434775s (SD = 1.240565s)
  • agent: uhCAkGo6k6EsoLU7JsWMRx0Lkfn2oz3vmQDfQ_nUOc4xmDIBb7Wo6
mean 0.272035s (SD = 0.663016s)
  • agent: uhCAkcbORIfLg1ZwdNnjFamqIb6xUdhyjxeArCf1tYOrnQiCF8Ge7
mean 0.444494s (SD = 1.30291s)
  • agent: uhCAkrwQrIHFLHvIf81_iboVJjRCnnly94kVwcvsxEtoYDOQplkaE
mean 0.394974s (SD = 1.231326s)
Chain head delay rate
The rate at which readers detect new chain heads appearing on writers' chains.
All agents
mean 13.84/s
  • agent: uhCAk3oAADjxhQFNC1jb1Ig3XMxZ7UkXMMYML1xtB0oNjT29d-ZqD
mean 14.04/s
  • agent: uhCAkGo6k6EsoLU7JsWMRx0Lkfn2oz3vmQDfQ_nUOc4xmDIBb7Wo6
mean 12.78/s
  • agent: uhCAkcbORIfLg1ZwdNnjFamqIb6xUdhyjxeArCf1tYOrnQiCF8Ge7
mean 13.8/s
  • agent: uhCAkrwQrIHFLHvIf81_iboVJjRCnnly94kVwcvsxEtoYDOQplkaE
mean 14.74/s
get_agent_activity_full zome call timing
The time taken to complete the get_agent_activity_full zome call that queries a writer's chain.
All agents
mean 0.094192 (SD = 0.028078)
  • agent: uhCAk3oAADjxhQFNC1jb1Ig3XMxZ7UkXMMYML1xtB0oNjT29d-ZqD
mean 0.05464s (SD = 0.020607s)
  • agent: uhCAkGo6k6EsoLU7JsWMRx0Lkfn2oz3vmQDfQ_nUOc4xmDIBb7Wo6
mean 0.182509s (SD = 0.044941s)
  • agent: uhCAkcbORIfLg1ZwdNnjFamqIb6xUdhyjxeArCf1tYOrnQiCF8Ge7
mean 0.064286s (SD = 0.021895s)
  • agent: uhCAkrwQrIHFLHvIf81_iboVJjRCnnly94kVwcvsxEtoYDOQplkaE
mean 0.075332s (SD = 0.024868s)
Retrieval errors
A running accumulation of errors encountered by read agents when calling get_agent_activity.
  • agent: uhCAk3oAADjxhQFNC1jb1Ig3XMxZ7UkXMMYML1xtB0oNjT29d-ZqD
Not enough time data to show a trend.
  • agent: uhCAkGo6k6EsoLU7JsWMRx0Lkfn2oz3vmQDfQ_nUOc4xmDIBb7Wo6
Not enough time data to show a trend.
  • agent: uhCAkcbORIfLg1ZwdNnjFamqIb6xUdhyjxeArCf1tYOrnQiCF8Ge7
Not enough time data to show a trend.
  • agent: uhCAkrwQrIHFLHvIf81_iboVJjRCnnly94kVwcvsxEtoYDOQplkaE
Not enough time data to show a trend.
Open connections
The number of currently open connections to other conductors, partitioned by agent behaviour.
  • behaviour: full_write
p5 6 < mean 6.82 (SD = 0.68) < p95 7
  • behaviour: zero_read
p5 0 < mean 4.73 (SD = 2.53) < p95 7
  • behaviour: zero_write
p5 6 < mean 6.67 (SD = 0.55) < p95 7
Final error count
The total number of errors accumulated across all agents over the run.
0
Host Metrics
User CPU usage
CPU usage by user space
13.99%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 425554.29B/s (SD = 579487.22B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 392808.11B/s (SD = 741638.44B/s)
Total bytes received
Total bytes received on primary network interface
count
1136229959B
mean
3665257.93B/s
Total bytes sent
Total bytes sent on primary network interface
count
1048797651B
mean
3383218.23B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 317.41 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 17.68% (SD = 12.98%)
System
3.68%
CPU percentiles
CPU usage percentiles
p50
13.09%
p95
43.18%
p99
58.57%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
mean 12.66% (SD = 6.29%)
Memory available percentage
Percentage of available memory
mean 87.34% (SD = 6.29%)
Max host memory used
Maximum memory usage percentage across all hosts
max 28.53%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 0.03%
Memory growth rate
Rate of memory growth over time
growth 317.41MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
67.66MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/3hosts
Mount Point /efi-boot
0/2hosts
Mount Point /etc/hostname
0/6hosts
Mount Point /etc/hosts
0/6hosts
Mount Point /etc/resolv.conf
0/6hosts
Mount Point /nix/store
0/3hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.31
5 min
0.65
15 min
0.34
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 0.9603% (SD = 1.911%)
60 second average
0.7952%
300 second average
0.4845%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 9.5544% (SD = 11.3904%)
60 second average
8.2617%
300 second average
4.3831%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 8.3058% (SD = 9.9826%)
60 second average
7.2490%
300 second average
3.9246%
Holochain process CPU usage
CPU usage by Holochain process
mean 15.6% (SD = 12.75%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 273253.19B (SD = 51083.46B)
Holochain process threads
Number of threads in Holochain process
mean 18.65 threads (SD = 8.05 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 65.55 file descriptors (SD = 16.51 file descriptors)

Mixed Arc must_get_agent_activity

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Write Validated must_get_agent_activity, but some write agents are zero-arc and all must_get_agent_activity agents are zero-arc. This forces the must_get_agent_activity host call to go to the network.

Started
Thu, 05 Mar 2026 04:20:13 UTC
Peer count
10
Peer count at end
10
Behaviours
  • full_write (1 agent)
  • zero_must_get_agent_activity (1 agent)
  • zero_write (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
mixed_arc_must_get_agent_activity_22696767866
Highest observed action_seq
The change in the highest action_seq of a write agent successfully retrieved by a must_get_agent_activity agent. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.
total 550over 1063.452422424s mean rate 12.95/s std 24.79/s p5 0/s p95 85.65/s peak 108.1/s
Chain batch delay timing
The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.
All agents
mean 160.257605 (SD = 6.018354)
  • must_get_agent_activity_agent: uhCAkCu1yBMtbFSo0NNnWNivxY9rl6O9q8bWfroR_NxEDoZK_X_sh
mean 782.620745s (SD = 7.975077s)
  • must_get_agent_activity_agent: uhCAkFy4eibWxTqbWcf-VDkKdEzDA3QyNYky_u7jkFFDzE3udxOOL
mean 10.207872s (SD = 15.534292s)
  • must_get_agent_activity_agent: uhCAkWssJU8QK2aIjlp4PZbtTlAvd4e0sExh5gS3xqSa1fQjbXCAh
mean 1.338333s (SD = 1.575235s)
  • must_get_agent_activity_agent: uhCAklCnVPWE0eOqEnaQ6UgxGexpfGc6xvVsCetlC_MJ9gXT3_0A1
mean 1.088308s (SD = 2.306559s)
  • must_get_agent_activity_agent: uhCAkuM8qN3xmXOhgTF-OTj5r23IGRBuJepnzyxLqvXSCukMQPQ67
mean 6.032769s (SD = 2.700605s)
Chain batch delay rate
The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.
All agents
mean 2.01/s
  • must_get_agent_activity_agent: uhCAkCu1yBMtbFSo0NNnWNivxY9rl6O9q8bWfroR_NxEDoZK_X_sh
mean 1.91/s
  • must_get_agent_activity_agent: uhCAkFy4eibWxTqbWcf-VDkKdEzDA3QyNYky_u7jkFFDzE3udxOOL
mean 2.69/s
  • must_get_agent_activity_agent: uhCAkWssJU8QK2aIjlp4PZbtTlAvd4e0sExh5gS3xqSa1fQjbXCAh
mean 2/s
  • must_get_agent_activity_agent: uhCAklCnVPWE0eOqEnaQ6UgxGexpfGc6xvVsCetlC_MJ9gXT3_0A1
mean 1.67/s
  • must_get_agent_activity_agent: uhCAkuM8qN3xmXOhgTF-OTj5r23IGRBuJepnzyxLqvXSCukMQPQ67
mean 1.8/s
create_validated_sample_entry zome call timing
The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.
All agents
mean 0.103256 (SD = 0.051958)
  • agent: uhCAkCu1yBMtbFSo0NNnWNivxY9rl6O9q8bWfroR_NxEDoZK_X_sh
mean 0.156892s (SD = 0.143731s)
  • agent: uhCAkFy4eibWxTqbWcf-VDkKdEzDA3QyNYky_u7jkFFDzE3udxOOL
mean 0.068789s (SD = 0.021413s)
  • agent: uhCAkWssJU8QK2aIjlp4PZbtTlAvd4e0sExh5gS3xqSa1fQjbXCAh
mean 0.16648s (SD = 0.068625s)
  • agent: uhCAklCnVPWE0eOqEnaQ6UgxGexpfGc6xvVsCetlC_MJ9gXT3_0A1
mean 0.029896s (SD = 0.00835s)
  • agent: uhCAkuM8qN3xmXOhgTF-OTj5r23IGRBuJepnzyxLqvXSCukMQPQ67
mean 0.094222s (SD = 0.017673s)
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.
  • agent: uhCAkCu1yBMtbFSo0NNnWNivxY9rl6O9q8bWfroR_NxEDoZK_X_sh
  • agent: uhCAkFy4eibWxTqbWcf-VDkKdEzDA3QyNYky_u7jkFFDzE3udxOOL
  • agent: uhCAkWssJU8QK2aIjlp4PZbtTlAvd4e0sExh5gS3xqSa1fQjbXCAh
  • agent: uhCAklCnVPWE0eOqEnaQ6UgxGexpfGc6xvVsCetlC_MJ9gXT3_0A1
  • agent: uhCAkuM8qN3xmXOhgTF-OTj5r23IGRBuJepnzyxLqvXSCukMQPQ67
Open connections
The average number of open connections maintained by an agent over the run, broken down by behaviour.
  • behaviour: full_write
p5 7 < mean 8.53 (SD = 0.77) < p95 9
  • behaviour: zero_must_get_agent_activity
p5 3 < mean 4.74 (SD = 1.43) < p95 7
  • behaviour: zero_write
p5 5 < mean 5.94 (SD = 0.64) < p95 7
Final error count
The total number of all types of error accumulated over the run by all agents.
21731
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean 2.820605s (SD = 12.578204s)
Request roundtrip duration: 'get_links'
The time spent sending a get_links request and awaiting its response
mean 0.096424s (SD = 0.788891s)
Request roundtrip duration: 'must_get_agent_activity'
The time spent sending a must_get_agent_activity request and awaiting its response
mean 0.023882s (SD = 0.039589s)
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean 1.828089s (SD = 9.813348s)
Handle incoming response duration
The time spent handling an incoming response message of any type
mean 3.6e-05s (SD = 4.5e-05s)
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean 0.000693s (SD = 0.000446s)
Handle incoming request duration: 'get_links'
The time spent handling an incoming get_links request
mean 0.001157s (SD = 0.001236s)
Handle incoming request duration: 'must_get_agent_activity'
The time spent handling an incoming must_get_agent_activity request
mean 1.913273s (SD = 13.634676s)
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean 0.012875s (SD = 0.029819s)
Host Metrics
User CPU usage
CPU usage by user space
11.15%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 1.13977915e+06B/s (SD = 2.3673554e+06B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 1.13827264e+06B/s (SD = 3.83738509e+06B/s)
Total bytes received
Total bytes received on primary network interface
count
3396541863B
mean
11321806.21B/s
Total bytes sent
Total bytes sent on primary network interface
count
3392052474B
mean
11306841.58B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 556.06 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 15.79% (SD = 15.12%)
System
4.64%
CPU percentiles
CPU usage percentiles
p50
10.48%
p95
42.02%
p99
80.89%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
2 hosts
mean time
0.05s
Memory used percentage
Percentage of memory used
mean 16.9% (SD = 6.59%)
Memory available percentage
Percentage of available memory
mean 83.1% (SD = 6.59%)
Max host memory used
Maximum memory usage percentage across all hosts
max 35.70%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 0.02%
Memory growth rate
Rate of memory growth over time
growth 556.06MB/s
Disk read throughput
Disk read throughput in MB/s
0.03MB/s
Disk write throughput
Disk write throughput in MB/s
19.25MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/3hosts
Mount Point /efi-boot
0/2hosts
Mount Point /etc/hostname
0/7hosts
Mount Point /etc/hosts
0/7hosts
Mount Point /etc/resolv.conf
0/7hosts
Mount Point /nix/store
0/3hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.68
5 min
0.36
15 min
0.24
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 1.003% (SD = 2.1829%)
60 second average
0.7773%
300 second average
0.4311%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0.0008% (SD = 0.0108%)
60 second average
0.0003%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0.0008% (SD = 0.0108%)
60 second average
0.0003%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 1.3212% (SD = 3.2632%)
60 second average
1.2874%
300 second average
1.0409%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 1.2445% (SD = 3.1896%)
60 second average
1.2203%
300 second average
1.0054%
Holochain process CPU usage
CPU usage by Holochain process
mean 13.2% (SD = 14.7%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 496603.08B (SD = 121662.54B)
Holochain process threads
Number of threads in Holochain process
mean 18.74 threads (SD = 5.28 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 74.91 file descriptors (SD = 15.4 file descriptors)

Remote Call Rate

Test the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

Started
Thu, 05 Mar 2026 01:16:44 UTC
Peer count
2
Peer count at end
2
Behaviours
  • default (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
remote_call_rate_22696767866
Dispatch timing
The time between sending a remote call and the remote handler being invoked.
All agents
mean 0.004329 (SD = 0.018151)
  • agent: uhCAkmfI9ambPD3eL-fbRQt0xpwpwCcMb_d5rGX-0L1e0to3WFfCS
mean 0.004279s (SD = 0.016645s)
  • agent: uhCAkyLzANSIX-zQaA3OPGz2niDho7YawvVWyZbYz4LHBm5cce2Eb
mean 0.004379s (SD = 0.019657s)
Round-trip timing
The total elapsed time to get a response to the client.
All agents
mean 0.009578 (SD = 0.029749)
  • agent: uhCAkmfI9ambPD3eL-fbRQt0xpwpwCcMb_d5rGX-0L1e0to3WFfCS
mean 0.009575s (SD = 0.030852s)
  • agent: uhCAkyLzANSIX-zQaA3OPGz2niDho7YawvVWyZbYz4LHBm5cce2Eb
mean 0.00958s (SD = 0.028645s)
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean 0.0025s (SD = 0.001773s)
Request roundtrip duration: 'call_remote'
The time spent sending a call_remote request and awaiting its response
mean 0.0046s (SD = 0.018227s)
Handle incoming response duration
The time spent handling an incoming response message of any type
mean 1.3e-05s (SD = 1.3e-05s)
Handle incoming request duration: 'call_remote'
The time spent handling an incoming call_remote request
mean 0.004087s (SD = 0.018137s)
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean 0.001715s (SD = 0.001795s)
Host Metrics
User CPU usage
CPU usage by user space
26.89%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 151086.57B/s (SD = 370495.24B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 3745.86B/s (SD = 8171.92B/s)
Total bytes received
Total bytes received on primary network interface
count
51369433B
mean
151086.57B/s
Total bytes sent
Total bytes sent on primary network interface
count
1273591B
mean
3745.86B/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.0%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 357.34 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (12.3% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 41.18% (SD = 17.96%)
System
14.29%
CPU percentiles
CPU usage percentiles
p50
45.94%
p95
47.84%
p99
97.97%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1 hosts
mean time
0.03s
Memory used percentage
Percentage of memory used
mean 44.99% (SD = 2.04%)
Memory available percentage
Percentage of available memory
mean 55.01% (SD = 2.04%)
Max host memory used
Maximum memory usage percentage across all hosts
max 44.99%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 12.30%
Memory growth rate
Rate of memory growth over time
growth 357.34MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
6.36MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
0/1hosts
Mount Point /etc/hosts
0/1hosts
Mount Point /etc/resolv.conf
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.28
5 min
1.14
15 min
0.46
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 8.9671% (SD = 9.4376%)
60 second average
7.7963%
300 second average
4.0314%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 7.5317% (SD = 2.8896%)
60 second average
6.7217%
300 second average
4.5309%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 6.8909% (SD = 2.7221%)
60 second average
6.1766%
300 second average
4.2446%
Holochain process CPU usage
CPU usage by Holochain process
mean 17.23% (SD = 8.72%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 201884.53B (SD = 27035.12B)
Holochain process threads
Number of threads in Holochain process
mean 16.74 threads (SD = 6.8 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 44.6 file descriptors (SD = 19.5 file descriptors)

Remote Signals

This scenario tests the throughput of remote_signals operations.

Started
Thu, 05 Mar 2026 01:26:52 UTC
Peer count
2
Peer count at end
2
Behaviours
  • default (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
remote_signals_22696767866
Round trip time
The time from origin signal dispatch to origin receive of the remote side's response signal.
mean 0.016418s (SD = 0.012801s)
Timeouts
The number of timeouts waiting for the remote side's response signal (default timeout is 20 seconds).
0
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean 0.00039s (SD = 0s)
Not enough time data to show a trend.
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean 0.00084s (SD = 0.000566s)
Handle incoming response duration
The time spent handling an incoming response message of any type
mean 5e-06s (SD = 0s)
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean 0.000206s (SD = 0s)
Not enough time data to show a trend.
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean 0.00061s (SD = 0.000513s)
Handle incoming request duration: 'remote_signal'
The time spent handling an incoming remote_signal request
mean 0.003728s (SD = 0.001223s)
Host Metrics
User CPU usage
CPU usage by user space
1.70%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 6387.61B/s (SD = 2733.15B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 4595.94B/s (SD = 5433.42B/s)
Total bytes received
Total bytes received on primary network interface
count
1852406B
mean
6387.61B/s
Total bytes sent
Total bytes sent on primary network interface
count
1332822B
mean
4595.94B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 3.82% (SD = 1.01%)
System
2.12%
CPU percentiles
CPU usage percentiles
p50
3.70%
p95
3.90%
p99
9.00%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
mean 34.85% (SD = 2%)
Memory available percentage
Percentage of available memory
mean 65.15% (SD = 2%)
Max host memory used
Maximum memory usage percentage across all hosts
max 34.85%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 3.94%
Memory growth rate
Rate of memory growth over time
growth -303.53MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
1.28MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
0/1hosts
Mount Point /etc/hosts
0/1hosts
Mount Point /etc/resolv.conf
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.07
5 min
3.55
15 min
4.64
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 1.0013% (SD = 3.2925%)
60 second average
0.9033%
300 second average
0.8360%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 0.0077% (SD = 0.0299%)
60 second average
0.0063%
300 second average
0.0003%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 0.0077% (SD = 0.0299%)
60 second average
0.0063%
300 second average
0.0003%
Holochain process CPU usage
CPU usage by Holochain process
mean 0.48% (SD = 0.86%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 210008.93B (SD = 6125.5B)
Holochain process threads
Number of threads in Holochain process
mean 15.27 threads (SD = 1.44 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 57.73 file descriptors (SD = 9.71 file descriptors)

Single-write, many-read

Creates an entry in the agent setup, then read one's own record back. This tests the maximum read performance for reading back local data when the chain is short.

Started
Thu, 05 Mar 2026 01:37:10 UTC
Peer count
1
Peer count at end
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
single_write_many_read_22696767866
read call timing
The time it takes to complete the zome call that retrieves the record.
mean 0.003916s (SD = 0.022028s)
read call rate (10s)
The number of zome calls made in a 10-second window.
mean 2543.43/10s
Error count
The number of errors collected.
0
Host Metrics
User CPU usage
CPU usage by user space
17.09%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 152724.48B/s (SD = 816209.42B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 4696.4B/s (SD = 23223.62B/s)
Total bytes received
Total bytes received on primary network interface
count
45817344B
mean
152724.48B/s
Total bytes sent
Total bytes sent on primary network interface
count
1408921B
mean
4696.40B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 127.12 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 24.11% (SD = 6.37%)
System
7.01%
CPU percentiles
CPU usage percentiles
p50
23.88%
p95
26.06%
p99
54.06%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
mean 11.19% (SD = 1.04%)
Memory available percentage
Percentage of available memory
mean 88.81% (SD = 1.04%)
Max host memory used
Maximum memory usage percentage across all hosts
max 11.19%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 0.00%
Memory growth rate
Rate of memory growth over time
growth 127.12MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
5.27MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
0/1hosts
Mount Point /etc/hosts
0/1hosts
Mount Point /etc/resolv.conf
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.15
5 min
0.56
15 min
0.23
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 0.0171% (SD = 0.0468%)
60 second average
0.0129%
300 second average
0.0013%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 7.9171% (SD = 4.6247%)
60 second average
6.1077%
300 second average
3.2603%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 7.8035% (SD = 4.5814%)
60 second average
6.0194%
300 second average
3.2148%
Holochain process CPU usage
CPU usage by Holochain process
mean 21.49% (SD = 7.26%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 266257.4B (SD = 33105.35B)
Holochain process threads
Number of threads in Holochain process
mean 12.45 threads (SD = 2.27 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 56.87 file descriptors (SD = 11.28 file descriptors)

Two-party countersigning

This scenario tests the performance of countersigning operations. There are two roles: initiate and participate. The participants commit an entry to advertise that they are willing to participate in sessions. They listen for sessions and participate in one at a time.

Started
Thu, 05 Mar 2026 03:19:38 UTC
Peer count
3
Peer count at end
3
Behaviours
  • initiate (1 agent)
  • participate (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
two_party_countersigning_22696767866
Session accepted -- timing
The duration of the session from acceptance to completion.
All agents
mean 0.409439 (SD = 0.555171)
  • agent: uhCAkOscVFOym2fUP_M1obZ4_tukkadAntl0kf5ntJUGyWD04uQRi
mean 0.36149s (SD = 0.218269s)
  • agent: uhCAkq3zlkU4NhZ4TeR5v2iTbuRzBgHHF9IA21OXSSLS_3Vl_i_BK
mean 0.457387s (SD = 0.892072s)
Session accepted -- success rate
The number of accepted sessions that completed per second.
All agents
mean 10.81/s
  • agent: uhCAkOscVFOym2fUP_M1obZ4_tukkadAntl0kf5ntJUGyWD04uQRi
mean 10.91/s
  • agent: uhCAkq3zlkU4NhZ4TeR5v2iTbuRzBgHHF9IA21OXSSLS_3Vl_i_BK
mean 10.7/s
Session accepted -- failure rate
The number of accepted sessions that failed per second.
All agents
mean -0.68/s
  • agent: uhCAkOscVFOym2fUP_M1obZ4_tukkadAntl0kf5ntJUGyWD04uQRi
mean 0.48/s
  • agent: uhCAkq3zlkU4NhZ4TeR5v2iTbuRzBgHHF9IA21OXSSLS_3Vl_i_BK
mean 5.4/s
Session initiated -- timing
The duration of the session from initiation to completion.
  • agent: uhCAk1jnVCyGbF7QD75klZjjJhQnfd1RbeYUxBTQEnRdhQGw8_13r
mean 0.517992s (SD = 0.871359s)
Session initiated -- success rate
The number of initiated sessions that completed per second.
  • agent: uhCAk1jnVCyGbF7QD75klZjjJhQnfd1RbeYUxBTQEnRdhQGw8_13r
mean 21.61/s
Session initiated -- failure rate
The number of initiated sessions that failed per second.
  • agent: uhCAk1jnVCyGbF7QD75klZjjJhQnfd1RbeYUxBTQEnRdhQGw8_13r
mean 10.68/s
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean 0.027582s (SD = 0.032329s)
Request roundtrip duration: 'get_agent_activity'
The time spent sending a get_agent_activity request and awaiting its response
mean 0.028252s (SD = 0.033024s)
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean 0.075193s (SD = 0.108867s)
Request roundtrip duration: 'call_remote'
The time spent sending a call_remote request and awaiting its response
mean 0.04214s (SD = 0.035103s)
Handle incoming response duration
The time spent handling an incoming response message of any type
mean 1.9e-05s (SD = 1.1e-05s)
Handle incoming request duration: 'call_remote'
The time spent handling an incoming call_remote request
mean 0.00667s (SD = 0.008718s)
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean 0.000516s (SD = 0.000261s)
Handle incoming request duration: 'get_agent_activity'
The time spent handling an incoming get_agent_activity request
mean 0.007283s (SD = 0.00611s)
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean 0.024313s (SD = 0.103977s)
Handle incoming request duration: 'publish_counter_sign'
The time spent handling an incoming publish_counter_sign request
mean 8.4e-05s (SD = 4.9e-05s)
Handle incoming request duration: 'countersigning_session_negotiation'
The time spent handling an incoming countersigning_session_negotiation request
mean 4e-05s (SD = 1.4e-05s)
Host Metrics
User CPU usage
CPU usage by user space
5.47%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 100805.22B/s (SD = 221544.56B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 47823.12B/s (SD = 28888.79B/s)
Total bytes received
Total bytes received on primary network interface
count
92740803B
mean
272767.07B/s
Total bytes sent
Total bytes sent on primary network interface
count
43997268B
mean
129403.73B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 221.95 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (12.3% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 7.05% (SD = 5.86%)
System
1.58%
CPU percentiles
CPU usage percentiles
p50
5.91%
p95
13.52%
p99
31.57%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
mean 22.71% (SD = 15.22%)
Memory available percentage
Percentage of available memory
mean 77.29% (SD = 15.22%)
Max host memory used
Maximum memory usage percentage across all hosts
max 42.62%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 12.30%
Memory growth rate
Rate of memory growth over time
growth 221.95MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
9.75MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/2hosts
Mount Point /efi-boot
0/2hosts
Mount Point /etc/hostname
0/1hosts
Mount Point /etc/hosts
0/1hosts
Mount Point /etc/resolv.conf
0/1hosts
Mount Point /nix/store
0/2hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.51
5 min
0.25
15 min
0.12
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 0.2398% (SD = 0.2721%)
60 second average
0.2103%
300 second average
0.0949%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 6.2418% (SD = 3.1666%)
60 second average
5.6408%
300 second average
3.5301%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 6.0871% (SD = 3.1179%)
60 second average
5.4911%
300 second average
3.4482%
Holochain process CPU usage
CPU usage by Holochain process
mean 5.57% (SD = 5.15%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 246552.77B (SD = 23103.65B)
Holochain process threads
Number of threads in Holochain process
mean 23.97 threads (SD = 10.16 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 69.96 file descriptors (SD = 16.92 file descriptors)

Validation Receipts

Creates an entry, wait for required validation receipts, then repeat. Records the amount of time it took to accumulate the required number of receipts for all DHT operations. This is measured to the nearest 20ms so that we don't keep the agent too busy checking for receipts.

Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

By default, this scenario will wait for a complete set of validation receipts before committing the next record. If the NO_VALIDATION_COMPLETE environment variable is set, it will instead publish new records on every round, building up an ever-growing list of action hashes to check on.

Started
Thu, 05 Mar 2026 02:49:52 UTC
Peer count
10
Peer count at end
10
Behaviours
  • default (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
validation_receipts_22696767866
Receipts complete timing
The amount of time between publishing a record and receiving the required number of validation receipts.
All agents
mean 6.741687 (SD = 9.574396)
  • agent: uhCAkP8efqKedLnKK-o0HkO32LQylWynGZBeHs06EDELLSQeEmtKy
  • op_type: RegisterAgentActivity
mean 5.229841s (SD = 1.400702s)
  • agent: uhCAkP8efqKedLnKK-o0HkO32LQylWynGZBeHs06EDELLSQeEmtKy
  • op_type: StoreEntry
mean 5.229841s (SD = 1.400701s)
  • agent: uhCAkP8efqKedLnKK-o0HkO32LQylWynGZBeHs06EDELLSQeEmtKy
  • op_type: StoreRecord
mean 5.229842s (SD = 1.400702s)
  • agent: uhCAkSE1HErY8wIlOjbO03VUe_xBELXWbKtDpVT8d-S2AQzHP-GDv
  • op_type: RegisterAgentActivity
mean 5.13936s (SD = 0.698915s)
  • agent: uhCAkSE1HErY8wIlOjbO03VUe_xBELXWbKtDpVT8d-S2AQzHP-GDv
  • op_type: StoreEntry
mean 5.139358s (SD = 0.698915s)
  • agent: uhCAkSE1HErY8wIlOjbO03VUe_xBELXWbKtDpVT8d-S2AQzHP-GDv
  • op_type: StoreRecord
mean 5.139357s (SD = 0.698915s)
  • agent: uhCAkVDcPsvgCMmXrh1N1cmdFSmbuTWhiCaRMOTFIL1c3UYX02EMK
  • op_type: RegisterAgentActivity
mean 8.765056s (SD = 20.902055s)
  • agent: uhCAkVDcPsvgCMmXrh1N1cmdFSmbuTWhiCaRMOTFIL1c3UYX02EMK
  • op_type: StoreEntry
mean 8.765055s (SD = 20.902054s)
  • agent: uhCAkVDcPsvgCMmXrh1N1cmdFSmbuTWhiCaRMOTFIL1c3UYX02EMK
  • op_type: StoreRecord
mean 8.765055s (SD = 20.902055s)
  • agent: uhCAkXHohSFg9mMopUpMAQLs65bVogRKnZaS4ZglojednjnGSuQ3q
  • op_type: RegisterAgentActivity
mean 9.348636s (SD = 23.360888s)
  • agent: uhCAkXHohSFg9mMopUpMAQLs65bVogRKnZaS4ZglojednjnGSuQ3q
  • op_type: StoreEntry
mean 9.348637s (SD = 23.360887s)
  • agent: uhCAkXHohSFg9mMopUpMAQLs65bVogRKnZaS4ZglojednjnGSuQ3q
  • op_type: StoreRecord
mean 9.348636s (SD = 23.360888s)
  • agent: uhCAk_Ipzw9lD3VqmpM2KEDjUZhv93lfrGqeVx2NOPW8Y_wHSHWTJ
  • op_type: RegisterAgentActivity
mean 8.764047s (SD = 20.90086s)
  • agent: uhCAk_Ipzw9lD3VqmpM2KEDjUZhv93lfrGqeVx2NOPW8Y_wHSHWTJ
  • op_type: StoreEntry
mean 8.764047s (SD = 20.900861s)
  • agent: uhCAk_Ipzw9lD3VqmpM2KEDjUZhv93lfrGqeVx2NOPW8Y_wHSHWTJ
  • op_type: StoreRecord
mean 8.764046s (SD = 20.900859s)
  • agent: uhCAkaICEwHNnslQ_0hIKuks6fmTyXZzZYzPETZME1-a2ez7UQEkH
  • op_type: RegisterAgentActivity
mean 5.503456s (SD = 2.847546s)
  • agent: uhCAkaICEwHNnslQ_0hIKuks6fmTyXZzZYzPETZME1-a2ez7UQEkH
  • op_type: StoreEntry
mean 5.503456s (SD = 2.847543s)
  • agent: uhCAkaICEwHNnslQ_0hIKuks6fmTyXZzZYzPETZME1-a2ez7UQEkH
  • op_type: StoreRecord
mean 5.503458s (SD = 2.847546s)
  • agent: uhCAkdRWNFnFGkYsszRQ5nCk1_zblMZCmPfOm9yVNRvo2o8qsRv4f
  • op_type: RegisterAgentActivity
mean 5.13827s (SD = 0.69216s)
  • agent: uhCAkdRWNFnFGkYsszRQ5nCk1_zblMZCmPfOm9yVNRvo2o8qsRv4f
  • op_type: StoreEntry
mean 5.138269s (SD = 0.692161s)
  • agent: uhCAkdRWNFnFGkYsszRQ5nCk1_zblMZCmPfOm9yVNRvo2o8qsRv4f
  • op_type: StoreRecord
mean 5.138269s (SD = 0.692162s)
  • agent: uhCAklUVNMBQEJd5ThIohimJ115_ubUk2hsR3h2zMYMFuKYBaxyLU
  • op_type: RegisterAgentActivity
mean 5.237536s (SD = 1.415853s)
  • agent: uhCAklUVNMBQEJd5ThIohimJ115_ubUk2hsR3h2zMYMFuKYBaxyLU
  • op_type: StoreEntry
mean 5.237537s (SD = 1.415851s)
  • agent: uhCAklUVNMBQEJd5ThIohimJ115_ubUk2hsR3h2zMYMFuKYBaxyLU
  • op_type: StoreRecord
mean 5.237537s (SD = 1.415852s)
  • agent: uhCAkwyQ-_SYe6ci9wK3JhLXFKHwY3Xkmn5iNUcywMdNh8o_0AeFs
  • op_type: RegisterAgentActivity
mean 5.241527s (SD = 1.414917s)
  • agent: uhCAkwyQ-_SYe6ci9wK3JhLXFKHwY3Xkmn5iNUcywMdNh8o_0AeFs
  • op_type: StoreEntry
mean 5.241534s (SD = 1.414916s)
  • agent: uhCAkwyQ-_SYe6ci9wK3JhLXFKHwY3Xkmn5iNUcywMdNh8o_0AeFs
  • op_type: StoreRecord
mean 5.24152s (SD = 1.414916s)
  • agent: uhCAkyE_T5CcCBUcKsoLDD1mI4k8r5OsrWjSAQ1id7KPfM_fM_7zn
  • op_type: RegisterAgentActivity
mean 9.049147s (SD = 22.110066s)
  • agent: uhCAkyE_T5CcCBUcKsoLDD1mI4k8r5OsrWjSAQ1id7KPfM_fM_7zn
  • op_type: StoreEntry
mean 9.049146s (SD = 22.110066s)
  • agent: uhCAkyE_T5CcCBUcKsoLDD1mI4k8r5OsrWjSAQ1id7KPfM_fM_7zn
  • op_type: StoreRecord
mean 9.049146s (SD = 22.110065s)
Receipts complete rate
The number of complete validation receipt sets collected per second.
All agents
mean 1.98/s
  • agent: uhCAkP8efqKedLnKK-o0HkO32LQylWynGZBeHs06EDELLSQeEmtKy
  • op_type: RegisterAgentActivity
mean 1.96/s
  • agent: uhCAkP8efqKedLnKK-o0HkO32LQylWynGZBeHs06EDELLSQeEmtKy
  • op_type: StoreEntry
mean 1.96/s
  • agent: uhCAkP8efqKedLnKK-o0HkO32LQylWynGZBeHs06EDELLSQeEmtKy
  • op_type: StoreRecord
mean 1.96/s
  • agent: uhCAkSE1HErY8wIlOjbO03VUe_xBELXWbKtDpVT8d-S2AQzHP-GDv
  • op_type: RegisterAgentActivity
mean 1.96/s
  • agent: uhCAkSE1HErY8wIlOjbO03VUe_xBELXWbKtDpVT8d-S2AQzHP-GDv
  • op_type: StoreEntry
mean 1.96/s
  • agent: uhCAkSE1HErY8wIlOjbO03VUe_xBELXWbKtDpVT8d-S2AQzHP-GDv
  • op_type: StoreRecord
mean 1.96/s
  • agent: uhCAkVDcPsvgCMmXrh1N1cmdFSmbuTWhiCaRMOTFIL1c3UYX02EMK
  • op_type: RegisterAgentActivity
mean 2/s
  • agent: uhCAkVDcPsvgCMmXrh1N1cmdFSmbuTWhiCaRMOTFIL1c3UYX02EMK
  • op_type: StoreEntry
mean 2/s
  • agent: uhCAkVDcPsvgCMmXrh1N1cmdFSmbuTWhiCaRMOTFIL1c3UYX02EMK
  • op_type: StoreRecord
mean 2/s
  • agent: uhCAkXHohSFg9mMopUpMAQLs65bVogRKnZaS4ZglojednjnGSuQ3q
  • op_type: RegisterAgentActivity
mean 2/s
  • agent: uhCAkXHohSFg9mMopUpMAQLs65bVogRKnZaS4ZglojednjnGSuQ3q
  • op_type: StoreEntry
mean 2/s
  • agent: uhCAkXHohSFg9mMopUpMAQLs65bVogRKnZaS4ZglojednjnGSuQ3q
  • op_type: StoreRecord
mean 2/s
  • agent: uhCAk_Ipzw9lD3VqmpM2KEDjUZhv93lfrGqeVx2NOPW8Y_wHSHWTJ
  • op_type: RegisterAgentActivity
mean 2/s
  • agent: uhCAk_Ipzw9lD3VqmpM2KEDjUZhv93lfrGqeVx2NOPW8Y_wHSHWTJ
  • op_type: StoreEntry
mean 2/s
  • agent: uhCAk_Ipzw9lD3VqmpM2KEDjUZhv93lfrGqeVx2NOPW8Y_wHSHWTJ
  • op_type: StoreRecord
mean 2/s
  • agent: uhCAkaICEwHNnslQ_0hIKuks6fmTyXZzZYzPETZME1-a2ez7UQEkH
  • op_type: RegisterAgentActivity
mean 2/s
  • agent: uhCAkaICEwHNnslQ_0hIKuks6fmTyXZzZYzPETZME1-a2ez7UQEkH
  • op_type: StoreEntry
mean 2/s
  • agent: uhCAkaICEwHNnslQ_0hIKuks6fmTyXZzZYzPETZME1-a2ez7UQEkH
  • op_type: StoreRecord
mean 2/s
  • agent: uhCAkdRWNFnFGkYsszRQ5nCk1_zblMZCmPfOm9yVNRvo2o8qsRv4f
  • op_type: RegisterAgentActivity
mean 1.92/s
  • agent: uhCAkdRWNFnFGkYsszRQ5nCk1_zblMZCmPfOm9yVNRvo2o8qsRv4f
  • op_type: StoreEntry
mean 1.92/s
  • agent: uhCAkdRWNFnFGkYsszRQ5nCk1_zblMZCmPfOm9yVNRvo2o8qsRv4f
  • op_type: StoreRecord
mean 1.92/s
  • agent: uhCAklUVNMBQEJd5ThIohimJ115_ubUk2hsR3h2zMYMFuKYBaxyLU
  • op_type: RegisterAgentActivity
mean 1.96/s
  • agent: uhCAklUVNMBQEJd5ThIohimJ115_ubUk2hsR3h2zMYMFuKYBaxyLU
  • op_type: StoreEntry
mean 1.96/s
  • agent: uhCAklUVNMBQEJd5ThIohimJ115_ubUk2hsR3h2zMYMFuKYBaxyLU
  • op_type: StoreRecord
mean 1.96/s
  • agent: uhCAkwyQ-_SYe6ci9wK3JhLXFKHwY3Xkmn5iNUcywMdNh8o_0AeFs
  • op_type: RegisterAgentActivity
mean 1.96/s
  • agent: uhCAkwyQ-_SYe6ci9wK3JhLXFKHwY3Xkmn5iNUcywMdNh8o_0AeFs
  • op_type: StoreEntry
mean 1.96/s
  • agent: uhCAkwyQ-_SYe6ci9wK3JhLXFKHwY3Xkmn5iNUcywMdNh8o_0AeFs
  • op_type: StoreRecord
mean 1.96/s
  • agent: uhCAkyE_T5CcCBUcKsoLDD1mI4k8r5OsrWjSAQ1id7KPfM_fM_7zn
  • op_type: RegisterAgentActivity
mean 2/s
  • agent: uhCAkyE_T5CcCBUcKsoLDD1mI4k8r5OsrWjSAQ1id7KPfM_fM_7zn
  • op_type: StoreEntry
mean 2/s
  • agent: uhCAkyE_T5CcCBUcKsoLDD1mI4k8r5OsrWjSAQ1id7KPfM_fM_7zn
  • op_type: StoreRecord
mean 2/s
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean 0.009719s (SD = 0.01113s)
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean 0.027236s (SD = 0.08839s)
Handle incoming response duration
The time spent handling an incoming response message of any type
mean 1.8e-05s (SD = 5.8e-05s)
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean 0.000795s (SD = 0.00098s)
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean 0.014842s (SD = 0.086908s)
Host Metrics
User CPU usage
CPU usage by user space
12.89%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 29717.47B/s (SD = 9926.08B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 28809.61B/s (SD = 10583.56B/s)
Total bytes received
Total bytes received on primary network interface
count
17533309B
mean
58444.36B/s
Total bytes sent
Total bytes sent on primary network interface
count
16997670B
mean
56658.90B/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 99.2%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 134.69 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 15.94% (SD = 20.9%)
System
3.05%
CPU percentiles
CPU usage percentiles
p50
10.42%
p95
90.12%
p99
99.15%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
2 hosts
mean time
0.05s
Memory used percentage
Percentage of memory used
mean 30.69% (SD = 10.75%)
Memory available percentage
Percentage of available memory
mean 69.31% (SD = 10.75%)
Max host memory used
Maximum memory usage percentage across all hosts
max 41.45%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 0.00%
Memory growth rate
Rate of memory growth over time
growth 134.69MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
14.87MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1hosts
Mount Point /efi-boot
0/1hosts
Mount Point /etc/hostname
0/1hosts
Mount Point /etc/hosts
0/1hosts
Mount Point /etc/resolv.conf
0/1hosts
Mount Point /nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.30
5 min
1.79
15 min
0.79
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 8.4438% (SD = 16.9708%)
60 second average
8.0438%
300 second average
4.6538%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 4.4007% (SD = 5.0047%)
60 second average
3.6633%
300 second average
1.9203%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 3.5515% (SD = 4.1446%)
60 second average
2.9502%
300 second average
1.5959%
Holochain process CPU usage
CPU usage by Holochain process
mean 2.82% (SD = 4.27%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 217527.56B (SD = 27258.11B)
Holochain process threads
Number of threads in Holochain process
mean 17.95 threads (SD = 3.02 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 78.74 file descriptors (SD = 11.12 file descriptors)

Write/Query

Creates an entry, then queries the source chain and performs a simple operation on the entries, then repeats.

Started
Thu, 05 Mar 2026 01:47:25 UTC
Peer count
1
Peer count at end
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
write_query_22696767866
Write timing
The time it takes to complete the zome function call that writes the entry.
mean 0.012785s (SD = 0.006548s)
Write rate
The number of writes completed per second.
mean 141.25/s
Error count
The number of errors accumulated during the run.
0
Host Metrics
User CPU usage
CPU usage by user space
15.01%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 185.49B/s (SD = 250.08B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 673.81B/s (SD = 488.26B/s)
Total bytes received
Total bytes received on primary network interface
count
53793B
mean
185.49B/s
Total bytes sent
Total bytes sent on primary network interface
count
195404B
mean
673.81B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 18.58% (SD = 1.32%)
System
3.57%
CPU percentiles
CPU usage percentiles
p50
18.51%
p95
18.95%
p99
25.24%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
mean 6.38% (SD = 0.19%)
Memory available percentage
Percentage of available memory
mean 93.62% (SD = 0.19%)
Max host memory used
Maximum memory usage percentage across all hosts
max 6.38%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 0.02%
Memory growth rate
Rate of memory growth over time
growth -25.09MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
12.31MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1hosts
Mount Point /efi-boot
0/1hosts
Mount Point /nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.31
5 min
0.64
15 min
0.26
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 0.0033% (SD = 0.0147%)
60 second average
0.0023%
300 second average
0.0000%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 0.0043% (SD = 0.0169%)
60 second average
0.0023%
300 second average
0.0000%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 0.0043% (SD = 0.0169%)
60 second average
0.0023%
300 second average
0.0000%
Holochain process CPU usage
CPU usage by Holochain process
mean 18.09% (SD = 1.25%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 265196.2B (SD = 18045.94B)
Holochain process threads
Number of threads in Holochain process
mean 16.2 threads (SD = 1.08 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 64.27 file descriptors (SD = 3.98 file descriptors)

Write/Read

Creates an entry and reads it back, then repeats.

Started
Thu, 05 Mar 2026 01:57:11 UTC
Peer count
1
Peer count at end
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
write_read_22696767866
Write timing
The time taken to write the entry.
mean 0.065243s (SD = 0.212817s)
Write rate
The number of writes completed per second.
mean 109.71/s
Read timing
The time taken to read the entry.
mean 0.022889s (SD = 0.014738s)
Read rate
The number of reads completed per second.
mean 109.71/s
Error count
The number of errors accumulated over the run.
0
Host Metrics
User CPU usage
CPU usage by user space
22.31%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 255.6B/s (SD = 391.53B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 275.92B/s (SD = 311.82B/s)
Total bytes received
Total bytes received on primary network interface
count
74124B
mean
255.60B/s
Total bytes sent
Total bytes sent on primary network interface
count
80018B
mean
275.92B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 13.08 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 24.8% (SD = 10.24%)
System
2.49%
CPU percentiles
CPU usage percentiles
p50
22.66%
p95
39.88%
p99
56.73%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
mean 10.35% (SD = 0.36%)
Memory available percentage
Percentage of available memory
mean 89.65% (SD = 0.36%)
Max host memory used
Maximum memory usage percentage across all hosts
max 10.35%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 0.00%
Memory growth rate
Rate of memory growth over time
growth 13.08MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
9.56MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
0/1hosts
Mount Point /etc/hosts
0/1hosts
Mount Point /etc/resolv.conf
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.91
5 min
0.91
15 min
0.36
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 0.744% (SD = 0.213%)
60 second average
0.6160%
300 second average
0.2867%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 23.237% (SD = 9.0907%)
60 second average
20.9707%
300 second average
10.6280%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 22.884% (SD = 9.0551%)
60 second average
20.6547%
300 second average
10.4710%
Holochain process CPU usage
CPU usage by Holochain process
mean 24.1% (SD = 10.21%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 265628.73B (SD = 32862.6B)
Holochain process threads
Number of threads in Holochain process
mean 12.9 threads (SD = 1.14 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 63.7 file descriptors (SD = 3.96 file descriptors)

Write validated

Creates an entry, updates it and links the create to the update, then repeats. Each of the three actions is validated by the included hApp.

Started
Thu, 05 Mar 2026 02:07:48 UTC
Peer count
1
Peer count at end
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
write_validated_22696767866
Write timing
The time it takes to complete the zome function call that writes the entry, updates it, and links to the update.
mean 0.093009s (SD = 0.185179s)
Write rate
The number of write zome function calls that complete per second.
mean 44.29/s
Read timing
The time it takes to complete the zome function call that reads the data.
mean 0.131109s (SD = 0.192335s)
Read rate
The number of read zome function calls that complete per second.
mean 44.25/s
Error count
The number of errors accumulated over the run.
0
Host Metrics
User CPU usage
CPU usage by user space
19.73%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 191.97B/s (SD = 198.01B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 662.39B/s (SD = 473.08B/s)
Total bytes received
Total bytes received on primary network interface
count
55672B
mean
191.97B/s
Total bytes sent
Total bytes sent on primary network interface
count
192092B
mean
662.39B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 41.07 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 24.24% (SD = 8.8%)
System
4.51%
CPU percentiles
CPU usage percentiles
p50
23.52%
p95
28.04%
p99
66.17%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
mean 14.03% (SD = 0.55%)
Memory available percentage
Percentage of available memory
mean 85.97% (SD = 0.55%)
Max host memory used
Maximum memory usage percentage across all hosts
max 14.03%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 0.00%
Memory growth rate
Rate of memory growth over time
growth 41.07MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
10.94MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1hosts
Mount Point /efi-boot
0/1hosts
Mount Point /nix/store
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.88
5 min
0.89
15 min
0.36
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 0.0583% (SD = 0.1153%)
60 second average
0.0523%
300 second average
0.0107%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 20.351% (SD = 4.1949%)
60 second average
17.4973%
300 second average
8.8967%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 19.7727% (SD = 4.1605%)
60 second average
17.0087%
300 second average
8.6660%
Holochain process CPU usage
CPU usage by Holochain process
mean 23.22% (SD = 8.85%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 461721.87B (SD = 57643.25B)
Holochain process threads
Number of threads in Holochain process
mean 14.33 threads (SD = 1.64 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 63.57 file descriptors (SD = 5.18 file descriptors)

Write Validated must_get_agent_activity

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Mixed-Arc must_get_agent_activity, but all agents are full-arc.

Started
Thu, 05 Mar 2026 03:10:15 UTC
Peer count
2
Peer count at end
2
Behaviours
  • must_get_agent_activity (1 agent)
  • write (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
write_validated_must_get_agent_activity_22696767866
Highest observed action_seq
The change in the highest action_seq of a write agent successfully retrieved by a must_get_agent_activity agent. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.
total 1826over 875.550782256s mean rate 2.11/s std 0.24/s p5 1.76/s p95 2.53/s peak 2.96/s
Chain batch delay timing
The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.
  • must_get_agent_activity_agent: uhCAkTPy2xg-tVw803Lmr618E3AJ1vqA6xA08WIS6GlGmlb-x5Kee
mean 1.219323s (SD = 0.463519s)
Chain batch delay rate
The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.
  • must_get_agent_activity_agent: uhCAkTPy2xg-tVw803Lmr618E3AJ1vqA6xA08WIS6GlGmlb-x5Kee
mean 1.9/s
create_validated_sample_entry zome call timing
The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.
  • agent: uhCAkTPy2xg-tVw803Lmr618E3AJ1vqA6xA08WIS6GlGmlb-x5Kee
mean 0.075659s (SD = 0.019145s)
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.
  • agent: uhCAkTPy2xg-tVw803Lmr618E3AJ1vqA6xA08WIS6GlGmlb-x5Kee
Final error count
The total number of all types of error accumulated over the run by all agents.
5296
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean 0.154215s (SD = 0.012855s)
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean 0.167027s (SD = 0.036079s)
Handle incoming response duration
The time spent handling an incoming response message of any type
mean 3.2e-05s (SD = 1.5e-05s)
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean 0.000827s (SD = 0.000147s)
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean 0.0171s (SD = 0.032166s)
Host Metrics
User CPU usage
CPU usage by user space
4.64%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 10301.5B/s (SD = 51654.99B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 6551.96B/s (SD = 2093.94B/s)
Total bytes received
Total bytes received on primary network interface
count
18439688B
mean
20488.54B/s
Total bytes sent
Total bytes sent on primary network interface
count
11728005B
mean
13031.12B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 64.82 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 6.86% (SD = 7.2%)
System
2.22%
CPU percentiles
CPU usage percentiles
p50
6.73%
p95
9.26%
p99
64.07%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
mean 11.32% (SD = 3.31%)
Memory available percentage
Percentage of available memory
mean 88.68% (SD = 3.31%)
Max host memory used
Maximum memory usage percentage across all hosts
max 14.57%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 0.00%
Memory growth rate
Rate of memory growth over time
growth 64.82MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
3.04MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/2hosts
Mount Point /efi-boot
0/2hosts
Mount Point /nix/store
0/2hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.28
5 min
0.20
15 min
0.10
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 0.1061% (SD = 0.1423%)
60 second average
0.0988%
300 second average
0.0638%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 1.6059% (SD = 1.6791%)
60 second average
1.5807%
300 second average
1.3799%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 1.4636% (SD = 1.5945%)
60 second average
1.4436%
300 second average
1.2740%
Holochain process CPU usage
CPU usage by Holochain process
mean 5.28% (SD = 6.68%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 517352.64B (SD = 26508.93B)
Holochain process threads
Number of threads in Holochain process
mean 16.42 threads (SD = 3.84 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 68.21 file descriptors (SD = 7.88 file descriptors)

Zero-Arc Create and Read

A zero-arc/full-arc mixed scenario with two types of zero-arc nodes -- ones that create data and ones that read data -- as well as full arc nodes to "relay" the data. The scenario has three roles:

  • zero_write: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so that zero_read nodes can retrieve them.
  • zero_read: A zero-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
  • full: A full-arc conductor that is just here to serve entries to zero arc nodes.
Started
Thu, 05 Mar 2026 03:49:54 UTC
Peer count
9
Peer count at end
9
Behaviours
  • full (1 agent)
  • zero_read (1 agent)
  • zero_write (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
zero_arc_create_and_read_22696767866
Create rate
The number of timed entries created by the zero-arc node(s) per second.
All agents
mean 66.92/s
  • agent: uhCAk9iLdi_9UqdMlox2wjN_G4jAWiwP_4-aNROt4dZfWcLxdCyxh
mean 95.96/s
  • agent: uhCAkK3ZXqXhQOzW0MQ9jRzoF7LgUuw64jKdfT5ivH-PcQqaUJ5t4
mean 64.42/s
  • agent: uhCAkmcP4y6cOGhBo-VMYdDz_lKLT9TN9sWiC4_PU3-z9Rc28JDam
mean 40.37/s
Sync lag timing
For each entry, the time lag between when it was created and when the full-arc node could read it via the get_timed_local_entries zome function.
All agents
mean 18.767319 (SD = 14.772059)
  • agent: uhCAk6WAAvDnf2bTyhHSjdJqKqc6VH1JHw1ZHyQvl0E31MYmY98pS
mean 20.862631s (SD = 18.094271s)
  • agent: uhCAkPeXTYCFvrCEqed4Xfq7KnUxdWSppdSSIJLoynlFhhakdM9RQ
mean 15.407799s (SD = 8.450554s)
  • agent: uhCAkw_Su6JscADBlCuYkyUSJdW0qoiULozGTHsnQfJekT2Z1tUgC
mean 20.031527s (SD = 17.771353s)
Sync lag rate
The number of entries per second received by full nodes.
All agents
mean 43.13/s
  • agent: uhCAk6WAAvDnf2bTyhHSjdJqKqc6VH1JHw1ZHyQvl0E31MYmY98pS
mean 43.13/s
  • agent: uhCAkPeXTYCFvrCEqed4Xfq7KnUxdWSppdSSIJLoynlFhhakdM9RQ
mean 43.13/s
  • agent: uhCAkw_Su6JscADBlCuYkyUSJdW0qoiULozGTHsnQfJekT2Z1tUgC
mean 43.13/s
Open connections
The number of currently open connections to other conductors.
full-arc
p5 6 < mean 6.85 (SD = 1.09) < p95 8
zero-arc
p5 3 < mean 6.44 (SD = 1.24) < p95 8
Error count
The number of errors accumulated across all nodes.
0
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean 0.02403s (SD = 0.01253s)
Request roundtrip duration: 'get_links'
The time spent sending a get_links request and awaiting its response
mean 0.023805s (SD = 0.011977s)
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean 0.344944s (SD = 0.561412s)
Handle incoming response duration
The time spent handling an incoming response message of any type
mean 3e-05s (SD = 1.8e-05s)
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean 0.000495s (SD = 0.000615s)
Handle incoming request duration: 'get_links'
The time spent handling an incoming get_links request
mean 0.000551s (SD = 0.001523s)
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean 0.270529s (SD = 0.553254s)
Host Metrics
User CPU usage
CPU usage by user space
20.39%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 90264.45B/s (SD = 275939.19B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 55198.97B/s (SD = 75173.53B/s)
Total bytes received
Total bytes received on primary network interface
count
243714004B
mean
761606.26B/s
Total bytes sent
Total bytes sent on primary network interface
count
149037219B
mean
465741.31B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 121.22 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 27.7% (SD = 20.99%)
System
7.32%
CPU percentiles
CPU usage percentiles
p50
15.59%
p95
70.84%
p99
71.96%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1 hosts
mean time
0.03s
Memory used percentage
Percentage of memory used
mean 13.9% (SD = 8.75%)
Memory available percentage
Percentage of available memory
mean 86.1% (SD = 8.75%)
Max host memory used
Maximum memory usage percentage across all hosts
max 38.09%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 1.81%
Memory growth rate
Rate of memory growth over time
growth 121.22MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
60.80MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/6hosts
Mount Point /efi-boot
0/6hosts
Mount Point /etc/hostname
0/3hosts
Mount Point /etc/hosts
0/3hosts
Mount Point /etc/resolv.conf
0/3hosts
Mount Point /nix/store
0/6hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.45
5 min
0.88
15 min
0.57
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 6.4288% (SD = 14.3084%)
60 second average
5.2424%
300 second average
3.0266%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 10.4347% (SD = 14.6881%)
60 second average
8.8955%
300 second average
5.4147%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 9.804% (SD = 14.3199%)
60 second average
8.3856%
300 second average
5.1442%
Holochain process CPU usage
CPU usage by Holochain process
mean 18.26% (SD = 12.75%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 246251.14B (SD = 37842.92B)
Holochain process threads
Number of threads in Holochain process
mean 20.55 threads (SD = 10.65 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 67.63 file descriptors (SD = 13.9 file descriptors)

Zero-Arc Create Data

A zero-arc/full-arc mixed scenario where zero-arc nodes create data and full-arc nodes read the data. The scenario has two roles:
  • zero: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so that full-arc nodes can retrieve them.
  • full: A full-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Thu, 05 Mar 2026 03:29:13 UTC
Peer count
10
Peer count at end
10
Behaviours
  • full (1 agent)
  • zero (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
zero_arc_create_data_22696767866
Create rate
The number of timed entries created by the zero-arc node(s) per second.
All agents
mean 120.3/s
  • agent: uhCAkIw_q4EmoGUp8Om_CMFSZXyjBjOHCZRnxeD6R4_5dSeJ0X1ew
mean 85.96/s
  • agent: uhCAkJFHIeqF5u-bt34rcQGO-EYKpYQViz2A0Ufh-bVFNJuGE9RWN
mean 242.27/s
  • agent: uhCAkJdFNTxJPSLuP_tjbiVrJRGf0xefcexJA9ySX2atXQ2u3REQK
mean 163.23/s
  • agent: uhCAkKgK3FOfZqD61FkgYN_Nbmsl8lVn2qhZcUHKAOSyMLCRpk4r0
mean 73.85/s
  • agent: uhCAk_YPbPn6LPLII1Wh80tBJrh79pSNRCjq7QetCI5sR_Dib4a8W
mean 44.35/s
  • agent: uhCAkwNqdGie-z2bDjNoWnVsLnWsF4WtamvA2T5z5ZncYOYgiiLy_
mean 112.12/s
Sync lag timing
For each entry, the time lag between when it was created and when the full-arc node could read it via the get_timed_local_entries zome function.
All agents
mean 127.653233 (SD = 34.517594)
  • agent: uhCAkVOXgFs2FRKN9nECwKlGhF2svRopAMkm3o5HzaDBItsWCQYCX
mean 128.798955s (SD = 31.846995s)
  • agent: uhCAkZQIyufKteCs8Ly4aSEKTM8LxxmlhUxYlKX-EvhbZxnnR9eG0
mean 115.274004s (SD = 35.427592s)
  • agent: uhCAkgL0ndqtSXHW3X0U8_PX0kRBlxQVH4jJk3woJ4KCpAEBQOTqt
mean 140.849916s (SD = 33.795898s)
  • agent: uhCAksBnju-opuSH9MwBYz7nqV7mUEj0N9ROhwFqiOITdrfLGUN4c
mean 125.690057s (SD = 36.999892s)
Sync lag rate
The number of entries per second received by full nodes.
All agents
mean 36.06/s
  • agent: uhCAkVOXgFs2FRKN9nECwKlGhF2svRopAMkm3o5HzaDBItsWCQYCX
mean 60.75/s
  • agent: uhCAkZQIyufKteCs8Ly4aSEKTM8LxxmlhUxYlKX-EvhbZxnnR9eG0
mean 26.5/s
  • agent: uhCAkgL0ndqtSXHW3X0U8_PX0kRBlxQVH4jJk3woJ4KCpAEBQOTqt
mean 29.71/s
  • agent: uhCAksBnju-opuSH9MwBYz7nqV7mUEj0N9ROhwFqiOITdrfLGUN4c
mean 27.29/s
Open connections
The number of currently open connections to other conductors.
full-arc
p5 7 < mean 8.72 (SD = 0.93) < p95 9
zero-arc
p5 5 < mean 6.68 (SD = 1.4) < p95 9
Error count
The number of errors accumulated across all nodes.
0
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean 0.114303s (SD = 0.090206s)
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean 0.1042s (SD = 0.169652s)
Handle incoming response duration
The time spent handling an incoming response message of any type
mean 8e-06s (SD = 1e-05s)
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean 0.000385s (SD = 0.000396s)
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean 0.045444s (SD = 0.169622s)
Host Metrics
User CPU usage
CPU usage by user space
24.65%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 139834.16B/s (SD = 386182.14B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 87801.07B/s (SD = 84453.76B/s)
Total bytes received
Total bytes received on primary network interface
count
427892526B
mean
1296644.02B/s
Total bytes sent
Total bytes sent on primary network interface
count
268671262B
mean
814155.34B/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 93.3%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 166.12 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 10% of hosts overloaded (load5/ncpus > 1.0)

Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 29.33% (SD = 21.54%)
System
4.68%
CPU percentiles
CPU usage percentiles
p50
26.70%
p95
91.42%
p99
93.29%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1 hosts
mean time
0.80s
Memory used percentage
Percentage of memory used
mean 15.68% (SD = 9.56%)
Memory available percentage
Percentage of available memory
mean 84.32% (SD = 9.56%)
Max host memory used
Maximum memory usage percentage across all hosts
max 38.46%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 3.94%
Memory growth rate
Rate of memory growth over time
growth 166.12MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
164.54MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/4hosts
Mount Point /efi-boot
0/3hosts
Mount Point /etc/hostname
0/6hosts
Mount Point /etc/hosts
0/6hosts
Mount Point /etc/resolv.conf
0/6hosts
Mount Point /nix/store
0/4hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.02
5 min
1.72
15 min
1.02
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
10.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 7.5382% (SD = 15.3299%)
60 second average
6.2987%
300 second average
2.9114%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 18.0803% (SD = 14.8848%)
60 second average
14.9410%
300 second average
7.1628%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 15.4901% (SD = 13.8239%)
60 second average
12.7883%
300 second average
6.1862%
Holochain process CPU usage
CPU usage by Holochain process
mean 27.26% (SD = 20.86%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 286757.28B (SD = 46257.01B)
Holochain process threads
Number of threads in Holochain process
mean 28.78 threads (SD = 11.62 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 76.03 file descriptors (SD = 13.32 file descriptors)

Zero-arc Create Data (Validated)

A zero-arc/full-arc mixed scenario where zero-arc nodes create data that gets validated and full-arc nodes read the data. The scenario has two roles:

  • zero: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so that full-arc nodes can retrieve them.
  • full: A full-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Thu, 05 Mar 2026 03:39:29 UTC
Peer count
10
Peer count at end
10
Behaviours
  • full (1 agent)
  • zero (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
zero_arc_create_data_validated_22696767866
Create rate
The number of timed entries created by the zero-arc node(s) per second.
All agents
mean 95.17/s
  • agent: uhCAk-I9IP5DojwRoVZxQW-V5SJGVhDYXXV26_5071DJMZ_YRXeji
mean 78.93/s
  • agent: uhCAkIEaAh_6hMqT8JYckzhVZ7QS6-KvfKJX0cs5f1jYc33-goziY
mean 113.96/s
  • agent: uhCAkVK1Jwpu6gD99Pmgf-PdM88d2wcaFJJ0CZsCxKpte0L0zuv8E
mean 138.44/s
  • agent: uhCAkYYbsB99uYPhQSBU1_dII_W1OeEibbCnuHPEE95octMaL8roH
mean 122.59/s
  • agent: uhCAkyfKg1awO82WrnaYsPvOb_NW9xNwSC8AMFq5LyGy4yZGCEpLF
mean 63.96/s
  • agent: uhCAkyx7nA2MPBpGxsRGS585nGX98-Wa0GKhynDSo3SDEfTgPm03x
mean 53.11/s
Sync lag timing
For each entry, the time lag between when it was created and when the full-arc node could read it via the get_timed_local_entries zome function.
All agents
mean 26.402872 (SD = 10.389498)
  • agent: uhCAkArCHaXyM7Df_-jMNfTeWuedXzuaBPugNeh9bRkZsSlqvQigh
mean 12.556689s (SD = 5.518346s)
  • agent: uhCAkahAwHVUnOpy9dLPBYqI7m_KTWf-tE_70WWUL0Lw4z1gUoRn0
mean 47.384854s (SD = 19.046931s)
  • agent: uhCAkgZ4Bgw0QBGVkZK6hlSdUUmBQBZPMV9HhaKmBMbDWAFfIYWJV
mean 9.974545s (SD = 4.049161s)
  • agent: uhCAkn9GOtvwG2q8Do08X2d2fk8fWjjeb6aispSYepf5UseM2BAmt
mean 35.695398s (SD = 12.943553s)
Sync lag rate
The number of entries per second received by full nodes.
All agents
mean 60.9/s
  • agent: uhCAkArCHaXyM7Df_-jMNfTeWuedXzuaBPugNeh9bRkZsSlqvQigh
mean 48.83/s
  • agent: uhCAkahAwHVUnOpy9dLPBYqI7m_KTWf-tE_70WWUL0Lw4z1gUoRn0
mean 25/s
  • agent: uhCAkgZ4Bgw0QBGVkZK6hlSdUUmBQBZPMV9HhaKmBMbDWAFfIYWJV
mean 55.55/s
  • agent: uhCAkn9GOtvwG2q8Do08X2d2fk8fWjjeb6aispSYepf5UseM2BAmt
mean 114.2/s
Open connections
The number of currently open connections to other conductors.
full-arc
p5 7 < mean 8.37 (SD = 1.18) < p95 9
zero-arc
p5 4 < mean 6.96 (SD = 1.8) < p95 8
App validation workflow duration
The time taken to apply app validation to the data.
mean 0.229254s (SD = 2.248039s)
System validation workflow duration
The time taken to apply system validation to the data.
mean 0.057194s (SD = 0.50116s)
Error count
The number of errors accumulated across all nodes.
0
Request roundtrip duration: 'get'
The time spent sending a get request and awaiting its response
mean 0.060972s (SD = 0.033885s)
Request roundtrip duration: 'send_validation_receipts'
The time spent sending a send_validation_receipts request and awaiting its response
mean 0.191787s (SD = 0.554039s)
Handle incoming response duration
The time spent handling an incoming response message of any type
mean 9e-06s (SD = 2.9e-05s)
Handle incoming request duration: 'get'
The time spent handling an incoming get request
mean 0.002085s (SD = 0.005227s)
Handle incoming request duration: 'send_validation_receipts'
The time spent handling an incoming send_validation_receipts request
mean 0.156322s (SD = 0.937622s)
Host Metrics
User CPU usage
CPU usage by user space
30.90%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 183150.66B/s (SD = 742681.66B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 79721.99B/s (SD = 73546.51B/s)
Total bytes received
Total bytes received on primary network interface
count
549451987B
mean
1665006.02B/s
Total bytes sent
Total bytes sent on primary network interface
count
239165958B
mean
724745.33B/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 99.2%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 315.90 MB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 10% of hosts overloaded (load5/ncpus > 1.0)

Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 41.96% (SD = 25.1%)
System
11.06%
CPU percentiles
CPU usage percentiles
p50
34.94%
p95
98.80%
p99
99.20%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
2 hosts
mean time
0.57s
Memory used percentage
Percentage of memory used
mean 22.08% (SD = 12.62%)
Memory available percentage
Percentage of available memory
mean 77.92% (SD = 12.62%)
Max host memory used
Maximum memory usage percentage across all hosts
max 42.32%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 3.94%
Memory growth rate
Rate of memory growth over time
growth 315.90MB/s
Disk read throughput
Disk read throughput in MB/s
0.01MB/s
Disk write throughput
Disk write throughput in MB/s
140.13MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/5hosts
Mount Point /boot
0/1hosts
Mount Point /efi-boot
0/2hosts
Mount Point /etc/hostname
0/5hosts
Mount Point /etc/hosts
0/5hosts
Mount Point /etc/resolv.conf
0/5hosts
Mount Point /nix/store
0/5hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.11
5 min
1.86
15 min
1.16
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
10.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 14.3566% (SD = 23.2762%)
60 second average
11.6377%
300 second average
5.4987%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 7.7702% (SD = 10.9409%)
60 second average
6.4540%
300 second average
3.2843%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 7.0128% (SD = 10.0571%)
60 second average
5.8744%
300 second average
3.0376%
Holochain process CPU usage
CPU usage by Holochain process
mean 38.95% (SD = 24.25%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 509194.23B (SD = 89363.21B)
Holochain process threads
Number of threads in Holochain process
mean 26.26 threads (SD = 10.59 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 76.97 file descriptors (SD = 14.16 file descriptors)

Zome Call, Single Value

Calls a zome function that returns a fixed value. This tests the maximum performance of zome calls when the zome function is not calling into Holochain other otherwise doing any work.

Started
Thu, 05 Mar 2026 02:17:03 UTC
Peer count
1
Peer count at end
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1-rc.0
Wind Tunnel version
0.6.0
Run ID
zome_call_single_value_22696767866
Call timing
The time taken for the call to complete.
mean 0.001447s (SD = 0.000519s)
Call rate
The number of zome calls completed per second.
mean 6864.28/s
Error count
The number of errors accumulated during the run.
0
Host Metrics
User CPU usage
CPU usage by user space
8.00%
Network receive rate (primary)
Rate of bytes received on primary network interface
mean 5849.63B/s (SD = 5981.02B/s)
Network send rate (primary)
Rate of bytes sent on primary network interface
mean 4119.7B/s (SD = 5737.45B/s)
Total bytes received
Total bytes received on primary network interface
count
1696392B
mean
5849.63B/s
Total bytes sent
Total bytes sent on primary network interface
count
1194712B
mean
4119.70B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
Additional Host Metrics
Hidden by default. Click to toggle visibility.
CPU usage
Total CPU usage and kernel CPU usage
Total
mean 16.3% (SD = 0.09%)
System
8.30%
CPU percentiles
CPU usage percentiles
p50
16.27%
p95
16.43%
p99
16.46%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0 hosts
mean time
0.00s
Memory used percentage
Percentage of memory used
mean 35.65% (SD = 0.78%)
Memory available percentage
Percentage of available memory
mean 64.35% (SD = 0.78%)
Max host memory used
Maximum memory usage percentage across all hosts
max 35.65%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max 3.94%
Memory growth rate
Rate of memory growth over time
growth -85.53MB/s
Disk read throughput
Disk read throughput in MB/s
0.00MB/s
Disk write throughput
Disk write throughput in MB/s
13.17MB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
0/1hosts
Mount Point /etc/hosts
0/1hosts
Mount Point /etc/resolv.conf
0/1hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.32
5 min
0.77
15 min
0.61
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
mean 0.0357% (SD = 0.1303%)
60 second average
0.0210%
300 second average
0.0040%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
mean 0% (SD = 0%)
60 second average
0.0000%
300 second average
0.0000%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 0.0057% (SD = 0.0225%)
60 second average
0.0027%
300 second average
0.0000%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
mean 0.0057% (SD = 0.0225%)
60 second average
0.0027%
300 second average
0.0000%
Holochain process CPU usage
CPU usage by Holochain process
mean 12.77% (SD = 0.02%)
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
mean 309209.33B (SD = 1802.14B)
Holochain process threads
Number of threads in Holochain process
mean 14 threads (SD = 0 threads)
Holochain process file descriptors
Number of file descriptors used by Holochain process
mean 54 file descriptors (SD = 10 file descriptors)