App Install

↑ Back to index

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Thu, 15 Oct 2026 16:38:30 UTC
Duration
300s
Peer count
1
Behaviours
  • minimal (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
app_install_minimal_38767573742_1
First install time
The time from conductor startup to completion of the first app installation attempt.
0.633271529
s
Install app timing
The time taken to install an app.
mean
0.069314
s
SD
0.093194
s
p50
0.049773
s
<
p95
0.081082
s
<
p99
0.650569
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'callback::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 10.001255453s
Not enough time data to show a trend.
WASM usage: 'callback_integrity::genesis_self_check_2'
Metered usage count of the WASM ribosome for this zome function.
total
181984
over 20.002019165s
mean rate
9098.28
/s
std
0.22
/s
p5
9098.06
/s
p95
9098.51
/s
peak
9098.51
/s
WASM call duration: 'callback::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001102
s
SD
0.000417
s
p50
0.000956
s
<
p95
0.00196
s
<
p99
0.00279
s
WASM call duration: 'callback_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001262
s
SD
0.000313
s
p50
0.001305
s
<
p95
0.001926
s
≤
p99
0.001926
s
Post-commit duration
Time spent executing post-commit workflows.
mean
7.6e-05
s
SD
2.9e-05
s
p50
6.9e-05
s
<
p95
0.000176
s
<
p99
0.000192
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
6.54
s
<
mean
16.54
s
SD
8.17
s
<
p95
26.54
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 20.002045799s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001512
s
SD
0.000406
s
p50
0.001541
s
<
p95
0.002368
s
≤
p99
0.002368
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001834
s
SD
0.000494
s
p50
0.00193
s
<
p95
0.002893
s
≤
p99
0.002893
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.006669
s
SD
0.002064
s
p50
0.006704
s
<
p95
0.01098
s
≤
p99
0.01098
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.002705
s
SD
0.001259
s
p50
0.002668
s
<
p95
0.005337
s
≤
p99
0.005337
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001677
s
SD
0.000366
s
p50
0.001846
s
<
p95
0.002449
s
≤
p99
0.002449
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
5.1e-05
s
SD
1.5e-05
s
p50
5.2e-05
s
<
p95
8.3e-05
s
≤
p99
8.3e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001525
s
SD
0.000534
s
p50
0.001604
s
<
p95
0.002435
s
≤
p99
0.002435
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000376
s
SD
0.000296
s
p50
0.00038
s
<
p95
0.001001
s
≤
p99
0.001001
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
61.13
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
43.75
KiB/s
<
mean
50.86
KiB/s
SD
7.10
KiB/s
<
p95
57.96
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
28.78
KiB/s
<
mean
67.90
KiB/s
SD
39.12
KiB/s
<
p95
107.02
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1017.10
KiB
mean
50.86
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.33
MiB
mean
67.90
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 6.40 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 100% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
87.46
%
<
mean
87.88
%
SD
0.42
%
<
p95
88.31
%
System
26.75
%
CPU percentiles
CPU usage percentiles
p50
88.31
%
p95
88.31
%
p99
88.31
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
300.00
s
Memory used percentage
Percentage of memory used
p5
22.77
%
<
mean
29.79
%
SD
6.86
%
<
p95
39.09
%
Memory available percentage
Percentage of available memory
p5
60.91
%
<
mean
70.21
%
SD
6.86
%
<
p95
77.23
%
Max host memory used
Maximum memory usage percentage across all hosts
max
29.79
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
6.40
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
8.46
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.67
5 min
3.00
15 min
2.60
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
100.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
45.98
%
<
mean
51.2767
%
SD
3.829
%
<
p95
54.9
%
60 second average
37.0033
%
300 second average
29.2233
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.51
%
<
mean
2.2367
%
SD
1.4509
%
<
p95
4.06
%
60 second average
3.2067
%
300 second average
2.0833
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.23
%
<
mean
0.5
%
SD
0.1961
%
<
p95
0.69
%
60 second average
1.6100
%
300 second average
1.1267
%
Holochain process CPU usage
CPU usage by Holochain process
p5
39.62
%
<
mean
43.31
%
SD
3.7
%
<
p95
47.01
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
104.67
KiB
<
mean
874.61
KiB
SD
650.34
KiB
<
p95
1.66
MiB
Holochain process threads
Number of threads in Holochain process
p5
25
threads
<
mean
204.33
threads
SD
163.29
threads
<
p95
420
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
65
file descriptors
<
mean
446.33
file descriptors
SD
345.21
file descriptors
<
p95
901
file descriptors

App Install

↑ Back to index

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Thu, 15 Oct 2026 16:36:47 UTC
Duration
300s
Peer count
1
Behaviours
  • large (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
app_install_large_38767573742_1
First install time
The time from conductor startup to completion of the first app installation attempt.
0.105660925
s
Install app timing
The time taken to install an app.
mean
0.05367
s
SD
0.004537
s
p50
0.053799
s
<
p95
0.06188
s
<
p99
0.065642
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'large::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 10.000126297s
Not enough time data to show a trend.
WASM call duration: 'large::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003144
s
SD
0.000299
s
p50
0.003061
s
<
p95
0.004081
s
≤
p99
0.004081
s
Post-commit duration
Time spent executing post-commit workflows.
mean
9.8e-05
s
SD
0.000159
s
p50
6.3e-05
s
<
p95
9.9e-05
s
<
p99
0.000889
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
6.91
s
<
mean
11.91
s
SD
5
s
<
p95
16.91
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 10.000045364s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001025
s
SD
0.000413
s
p50
0.00182
s
≤
p95
0.00182
s
≤
p99
0.00182
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001142
s
SD
5.8e-05
s
p50
0.001254
s
≤
p95
0.001254
s
≤
p99
0.001254
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.004087
s
SD
0.001891
s
p50
0.007726
s
≤
p95
0.007726
s
≤
p99
0.007726
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.002777
s
SD
6e-06
s
p50
0.002788
s
≤
p95
0.002788
s
≤
p99
0.002788
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001912
s
SD
0.000766
s
p50
0.001969
s
≤
p95
0.001969
s
≤
p99
0.001969
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
3.3e-05
s
SD
5e-06
s
p50
4.4e-05
s
≤
p95
4.4e-05
s
≤
p99
4.4e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000984
s
SD
0.000279
s
p50
0.001001
s
<
p95
0.001487
s
≤
p99
0.001487
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000257
s
SD
3.3e-05
s
p50
0.000321
s
≤
p95
0.000321
s
≤
p99
0.000321
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
42.16
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
26.71
KiB/s
<
mean
1.49
MiB/s
SD
2.05
MiB/s
<
p95
4.40
MiB/s
Not enough time data to show a trend.
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
31.75
KiB/s
<
mean
77.77
KiB/s
SD
53.45
KiB/s
<
p95
152.72
KiB/s
Not enough time data to show a trend.
Total bytes received
Total bytes received on primary network interface
count
44.85
MiB
mean
1.49
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.28
MiB
mean
77.77
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 6.74 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
28.12
%
<
mean
52.03
%
SD
19.56
%
<
p95
76.04
%
Not enough time data to show a trend.
System
9.88
%
CPU percentiles
CPU usage percentiles
p50
51.95
%
p95
76.04
%
p99
76.04
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
21.89
%
<
mean
28.21
%
SD
8.28
%
<
p95
42.22
%
Memory available percentage
Percentage of available memory
p5
57.78
%
<
mean
71.79
%
SD
8.28
%
<
p95
78.11
%
Max host memory used
Maximum memory usage percentage across all hosts
max
28.21
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
6.74
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
8.94
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.57
5 min
1.86
15 min
1.16
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
5.09
%
<
mean
8.4425
%
SD
2.8765
%
<
p95
12.25
%
60 second average
17.2700
%
300 second average
21.9000
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.01
%
<
mean
0.5575
%
SD
0.5842
%
<
p95
1.51
%
60 second average
0.5500
%
300 second average
0.8875
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.5525
%
SD
0.5825
%
<
p95
1.5
%
60 second average
0.2450
%
300 second average
0.4550
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
<
mean
39.67
%
SD
29.6
%
<
p95
71.06
%
Not enough time data to show a trend.
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
24.71
KiB
<
mean
581.97
KiB
SD
698.55
KiB
<
p95
1.85
MiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
89.4
threads
SD
117.64
threads
<
p95
313
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
<
mean
200
file descriptors
SD
257.31
file descriptors
<
p95
685
file descriptors

Conductor Startup

↑ Back to index

This scenario measures Holochain conductor startup time when many cells are installed. The agent starts an empty conductor, installs a configurable number of apps without enabling them (disabled cells), restarts the conductor, and then enables cells one by one — timing each enable call and periodically restarting the conductor to measure startup time as the share of enabled cells grows.

Started
Thu, 15 Oct 2026 16:25:42 UTC
Duration
900s
Peer count
30
Behaviours
  • default (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
conductor_startup_38767573742_1
Initial conductor startup timing
Startup time with an empty conductor before any cells are installed.
mean
2.94712
s
SD
2.115486
s
p50
2.152426
s
<
p95
8.629851
s
<
p99
10.591523
s
Disabled-cell conductor startup timing
Startup time after all configured cells are installed but remain disabled.
mean
1.933003
s
SD
0.622955
s
p50
1.53438
s
<
p95
3.395406
s
≤
p99
3.395406
s
Progressive conductor startup timing
Startup time sampled periodically as more installed cells are enabled.
mean
10.748181
s
SD
5.820818
s
p50
9.841634
s
<
p95
21.744322
s
<
p99
25.529628
s
Cell enable timing
Time to enable one previously disabled cell via the admin interface.
mean
0.129673
s
SD
0.070995
s
p50
0.12442
s
<
p95
0.19827
s
<
p99
0.273059
s
Installed cells
Number of cells installed on the conductor during setup.
200
cells
Maximum enabled cells
Highest percentage of installed cells enabled during the run.
100
%
Holochain MetricsClick to toggle visibility.
WASM usage: 'callback_integrity::genesis_self_check_2'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 743.237715776s
Not enough time data to show a trend.
WASM call duration: 'callback_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001948
s
SD
0.00075
s
p50
0.002186
s
<
p95
0.002949
s
<
p99
0.00354
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
0.59
s
<
mean
260.19
s
SD
240.13
s
<
p95
671.39
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 854.763329101s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
4.033581
s
SD
4.799546
s
p50
0.999951
s
<
p95
13.879905
s
<
p99
17.308243
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001539
s
SD
0.004836
s
p50
0.001237
s
<
p95
0.003024
s
<
p99
0.00472
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.009286
s
SD
0.013872
s
p50
0.00172
s
<
p95
0.003683
s
<
p99
0.008408
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.020965
s
SD
0.168878
s
p50
0.001986
s
<
p95
0.005304
s
<
p99
0.952841
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.010564
s
SD
0.083076
s
p50
0.001978
s
<
p95
0.004425
s
<
p99
0.00809
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001206
s
SD
0.002163
s
p50
0.000773
s
<
p95
0.003319
s
<
p99
0.005384
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000107
s
SD
0.000109
s
p50
0.000133
s
<
p95
0.00032
s
<
p99
0.000412
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.009617
s
SD
0.058672
s
p50
0.001678
s
<
p95
0.003523
s
<
p99
0.016453
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00032
s
SD
0.000114
s
p50
0.00036
s
<
p95
0.000566
s
<
p99
0.000735
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.159238
s
SD
0.048566
s
p50
0.152044
s
<
p95
0.216197
s
≤
p99
0.216197
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
20.52
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
5.42
KiB/s
<
mean
147.98
KiB/s
SD
340.93
KiB/s
<
p95
298.34
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
4.08
KiB/s
<
mean
60.06
KiB/s
SD
49.84
KiB/s
<
p95
137.13
KiB/s
Total bytes received
Total bytes received on primary network interface
count
609.33
MiB
mean
701.08
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
225.81
MiB
mean
259.81
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1.02 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (11.2% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 4% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
5.28
%
<
mean
32.29
%
SD
22.83
%
<
p95
72.86
%
System
11.77
%
CPU percentiles
CPU usage percentiles
p50
27.42
%
p95
72.86
%
p99
77.41
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
50.00
s
Memory used percentage
Percentage of memory used
p5
6.98
%
<
mean
16.98
%
SD
6.54
%
<
p95
27.51
%
Memory available percentage
Percentage of available memory
p5
72.49
%
<
mean
83.02
%
SD
6.54
%
<
p95
93.02
%
Max host memory used
Maximum memory usage percentage across all hosts
max
33.84
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
11.17
%
Memory growth rate
Rate of memory growth over time
growth
1.02
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.22
MiB/s
Disk write throughput
Disk write throughput in MiB/s
120.02
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/4
hosts
Mount Point /efi-boot
0/2
hosts
Mount Point /etc/hostname
0/8
hosts
Mount Point /etc/hosts
0/8
hosts
Mount Point /etc/nomad.d/client-meta.json
0/12
hosts
Mount Point /etc/resolv.conf
0/8
hosts
Mount Point /nix/store
0/4
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.08
5 min
1.89
15 min
0.99
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
4.17
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
9.3693
%
SD
13.6627
%
<
p95
42.3
%
60 second average
6.4336
%
300 second average
2.8061
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0002
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0001
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
22.109
%
SD
25.2952
%
<
p95
59.89
%
60 second average
21.9348
%
300 second average
17.6974
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
19.31
%
SD
22.9253
%
<
p95
56.25
%
60 second average
19.3810
%
300 second average
15.8016
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
<
mean
13.07
%
SD
22.26
%
<
p95
64.58
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
52.29
KiB
<
mean
262.20
KiB
SD
136.46
KiB
<
p95
499.82
KiB
Holochain process threads
Number of threads in Holochain process
p5
2
threads
<
mean
357.08
threads
SD
484.83
threads
<
p95
1475
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
8
file descriptors
<
mean
809.62
file descriptors
SD
1067.17
file descriptors
<
p95
3255
file descriptors

DHT Sync Lag

↑ Back to index

Measures the lag time between an agent publishing data and other peers being able to see it. This scenario has two roles:

  • write: Creates entries with a timestamp field, linked to a known base hash so that record_lag agents can discover them.
  • record_lag: Repeatedly queries for links from the known base hash. When a new entry is discovered, it calculates the time difference between the entry's timestamp and the current time, giving the sync lag for that entry.
Started
Thu, 15 Oct 2026 16:40:23 UTC
Duration
1800s
Peer count
30
Peer count at end
27
Behaviours
  • record_lag (1 agent)
  • write (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
dht_sync_lag_38767573742_1
Create rate
The average number of created records per agent.
Mean
mean
22.58
/s
Max
Highest per-partition mean rate
max
35.61
/s
Min
Lowest per-partition mean rate
min
12.75
/s
Sync lag timing
The average time between when a record was created and when it is first seen by an agent.
Mean
mean
293.931359
s
SD
227.722315
s
Max
Highest per-partition mean latency
max mean
799.828293
s
Min
Lowest per-partition mean latency
min mean
2.782075
s
Sync lag rate
The average number of created records discovered per agent.
Mean
mean
12.02
/s
Max
Highest per-partition mean rate
max
42
/s
Min
Lowest per-partition mean rate
min
0
/s
Delivery ratio
The proportion of created entries successfully received by all record_lag agents.
0.0014
Sent count
The total number of entries sent (created) by write agents, by agent.
Total
102602
Agents affected
24 / 24
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
4275
Max
Highest count in any single partition
6761
Min
Lowest count in any single partition
2457
Received count
The total number of entries received by record_lag agents, by agent.
Total
693
Agents affected
5 / 5
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
139
Max
Highest count in any single partition
382
Min
Lowest count in any single partition
1
Error count
The number of errors encountered during the scenario.
6
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000931
s
SD
0.00137
s
p50
0.00063
s
<
p95
0.004405
s
<
p99
0.004793
s
WASM usage: 'timed::created_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
171285340
over 1788.97747742s
mean rate
3.2474684066e+09
/s
std
2.64449792197e+10
/s
p5
1.428807233e+07
/s
p95
1.01485731813e+10
/s
peak
7.4574526164e+11
/s
WASM usage: 'timed::get_timed_entries_local'
Metered usage count of the WASM ribosome for this zome function.
total
8491531547
over 1782.406255975s
mean rate
2.95776221778e+10
/s
std
2.83218705636e+10
/s
p5
4.5199891736e+08
/s
p95
7.7906872639e+10
/s
peak
8.29082984553e+10
/s
WASM usage: 'timed_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
26659182
over 1789.139048008s
mean rate
6.1270852091e+08
/s
std
5.63175954075e+09
/s
p5
3.60005222e+06
/s
p95
1.62338084203e+09
/s
peak
2.00718060885e+11
/s
Zome call duration: 'timed::created_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.009212
s
SD
0.007619
s
p50
0.008439
s
<
p95
0.025352
s
<
p99
0.046551
s
Zome call duration: 'timed::get_timed_entries_local'
Duration of this zome call as measured by Holochain internally.
mean
0.044822
s
SD
0.060722
s
p50
0.041825
s
<
p95
0.170082
s
<
p99
0.180499
s
WASM call duration: 'timed::created_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.008475
s
SD
0.007518
s
p50
0.007668
s
<
p95
0.024536
s
<
p99
0.045641
s
WASM call duration: 'timed::get_timed_entries_local'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.044181
s
SD
0.060665
s
p50
0.041093
s
<
p95
0.169303
s
<
p99
0.179704
s
WASM call duration: 'timed_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001428
s
SD
0.000832
s
p50
0.001376
s
<
p95
0.003334
s
<
p99
0.004828
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.001195
s
SD
0.002336
s
p50
0.00073
s
<
p95
0.006218
s
<
p99
0.01367
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.001175
s
SD
0.002267
s
p50
0.000706
s
<
p95
0.006141
s
<
p99
0.013086
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000914
s
SD
0.001396
s
p50
0.000832
s
<
p95
0.004641
s
<
p99
0.005
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.002286
s
SD
0.003917
s
p50
0.001539
s
<
p95
0.012032
s
<
p99
0.012544
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002287
s
SD
0.001558
s
p50
0.002185
s
<
p95
0.005928
s
<
p99
0.008929
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000189
s
SD
0.000175
s
p50
0.000156
s
<
p95
0.000578
s
<
p99
0.001028
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
88.47
s
<
mean
894.58
s
SD
515.34
s
<
p95
1697.89
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
2227
over 1789.139044985s
mean rate
7.4716499e+06
/s
std
3.0371168841e+08
/s
p5
0
/s
p95
1.30276073e+06
/s
peak
1.52533039648e+10
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
95.922218
s
SD
102.286473
s
p50
2.012917
s
<
p95
129.607312
s
<
p99
627.269697
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.168738
s
SD
0.608886
s
p50
0.264032
s
<
p95
1.654858
s
<
p99
3.464013
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.22051
s
SD
0.416021
s
p50
0.167156
s
<
p95
1.175333
s
<
p99
1.818623
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.504029
s
SD
0.54362
s
p50
0.384034
s
<
p95
1.261211
s
<
p99
3.431163
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
28.588084
s
SD
66.696153
s
p50
46.116084
s
<
p95
209.861037
s
<
p99
264.750221
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
43.215272
s
SD
49.212287
s
p50
0.066546
s
<
p95
134.712055
s
<
p99
214.585591
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001706
s
SD
0.000884
s
p50
0.001596
s
<
p95
0.003597
s
<
p99
0.004445
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.004226
s
SD
0.01219
s
p50
0.001367
s
<
p95
0.042513
s
<
p99
0.057035
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00121
s
SD
0.002347
s
p50
0.000545
s
<
p95
0.007655
s
<
p99
0.011857
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
1.536245
s
SD
27.87175
s
p50
1.948795
s
<
p95
60.00415
s
<
p99
60.049115
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.202059
s
SD
20.789904
s
p50
0.369685
s
<
p95
60.001024
s
<
p99
60.004512
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
66.30
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
216.93
KiB/s
<
mean
788.10
KiB/s
SD
529.15
KiB/s
<
p95
1.50
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
80.59
KiB/s
<
mean
712.52
KiB/s
SD
520.27
KiB/s
<
p95
1.53
MiB/s
Total bytes received
Total bytes received on primary network interface
count
37.62
GiB
mean
21.52
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
34.01
GiB
mean
19.46
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.2%

Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (17.6% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 69% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
37.17
%
<
mean
78.44
%
SD
21.73
%
<
p95
97.54
%
System
12.15
%
CPU percentiles
CPU usage percentiles
p50
87.11
%
p95
97.54
%
p99
98.25
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
25
hosts
mean time
1217.41
s
Memory used percentage
Percentage of memory used
p5
8.01
%
<
mean
19.06
%
SD
8.57
%
<
p95
34.51
%
Memory available percentage
Percentage of available memory
p5
65.49
%
<
mean
80.94
%
SD
8.57
%
<
p95
91.99
%
Max host memory used
Maximum memory usage percentage across all hosts
max
43.24
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
17.59
%
Memory growth rate
Rate of memory growth over time
growth
0.22
MiB/s
Disk read throughput
Disk read throughput in MiB/s
5.53
MiB/s
Disk write throughput
Disk write throughput in MiB/s
176.15
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/7
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/10
hosts
Mount Point /etc/hosts
0/10
hosts
Mount Point /etc/nomad.d/client-meta.json
0/13
hosts
Mount Point /etc/resolv.conf
0/10
hosts
Mount Point /nix/store
0/7
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
6.58
5 min
5.84
15 min
4.15
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
68.97
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.03
%
<
mean
37.863
%
SD
23.7685
%
<
p95
70.94
%
60 second average
36.8868
%
300 second average
32.1781
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
8.2541
%
SD
16.9855
%
<
p95
51.49
%
60 second average
8.2074
%
300 second average
8.3009
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
1.9842
%
SD
5.1126
%
<
p95
14.3
%
60 second average
2.0586
%
300 second average
2.7791
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
<
mean
42.78
%
SD
38.56
%
<
p95
95.46
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
239.62
KiB
<
mean
463.09
KiB
SD
206.07
KiB
<
p95
776.49
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
38.16
threads
SD
32.7
threads
<
p95
81
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
<
mean
78.17
file descriptors
SD
61.47
file descriptors
<
p95
115
file descriptors

First Call

↑ Back to index

This scenario installs a simple app which implements the init callback, and measures the time elapsed between start of install and calling init. It will uninstall the app it installed so that it can re-install it on the next iteration. This is required to re-run the initialisation callback.

Started
Thu, 15 Oct 2026 16:17:36 UTC
Duration
300s
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
first_call_38767573742_1
Zome call timing
The time elapsed between start of install and calling init.
mean
0.011757
s
SD
0.004483
s
p50
0.010799
s
<
p95
0.015807
s
<
p99
0.037447
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 10.000174607s
Not enough time data to show a trend.
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 10.000174607s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
251028
over 10.000174607s
mean rate
25102.36
/s
std
0
/s
p5
25102.36
/s
p95
25102.36
/s
peak
25102.36
/s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004731
s
SD
0.000148
s
p50
0.004775
s
≤
p95
0.004775
s
≤
p99
0.004775
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003993
s
SD
0.000731
s
p50
0.003771
s
<
p95
0.005584
s
<
p99
0.005894
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001337
s
SD
0.000263
s
p50
0.001281
s
<
p95
0.002467
s
≤
p99
0.002467
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001144
s
SD
3.2e-05
s
p50
0.001154
s
≤
p95
0.001154
s
≤
p99
0.001154
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000314
s
SD
2.8e-05
s
p50
0.000333
s
<
p95
0.000349
s
≤
p99
0.000349
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002074
s
SD
7.8e-05
s
p50
0.002098
s
≤
p95
0.002098
s
≤
p99
0.002098
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000103
s
SD
8.8e-05
s
p50
8.6e-05
s
<
p95
0.000184
s
<
p99
0.00063
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
6.95
s
<
mean
11.95
s
SD
5
s
<
p95
16.95
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 10.000054833s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000875
s
SD
4.1e-05
s
p50
0.000945
s
≤
p95
0.000945
s
≤
p99
0.000945
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001316
s
SD
3.6e-05
s
p50
0.001377
s
≤
p95
0.001377
s
≤
p99
0.001377
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.004115
s
SD
0.000242
s
p50
0.004526
s
≤
p95
0.004526
s
≤
p99
0.004526
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.0029
s
SD
0.000718
s
p50
0.004125
s
≤
p95
0.004125
s
≤
p99
0.004125
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001947
s
SD
7e-05
s
p50
0.001968
s
≤
p95
0.001968
s
≤
p99
0.001968
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
3.3e-05
s
SD
0
s
p50
3.3e-05
s
≤
p95
3.3e-05
s
≤
p99
3.3e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001049
s
SD
0.000336
s
p50
0.001541
s
<
p95
0.001632
s
≤
p99
0.001632
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000276
s
SD
7e-06
s
p50
0.000287
s
≤
p95
0.000287
s
≤
p99
0.000287
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
50.11
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
24.59
KiB/s
<
mean
43.79
KiB/s
SD
19.20
KiB/s
<
p95
62.99
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
13.37
KiB/s
<
mean
22.61
KiB/s
SD
9.24
KiB/s
<
p95
31.85
KiB/s
Total bytes received
Total bytes received on primary network interface
count
875.80
KiB
mean
43.79
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
452.17
KiB
mean
22.61
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 6.53 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
51.07
%
<
mean
60.73
%
SD
9.66
%
<
p95
70.39
%
System
10.62
%
CPU percentiles
CPU usage percentiles
p50
70.39
%
p95
70.39
%
p99
70.39
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
19.47
%
<
mean
25.42
%
SD
7.58
%
<
p95
36.11
%
Memory available percentage
Percentage of available memory
p5
63.89
%
<
mean
74.58
%
SD
7.58
%
<
p95
80.53
%
Max host memory used
Maximum memory usage percentage across all hosts
max
25.42
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
6.53
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
8.96
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.44
5 min
0.13
15 min
0.03
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
1.44
%
<
mean
5.4467
%
SD
3.7028
%
<
p95
10.37
%
60 second average
1.4933
%
300 second average
0.3367
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.71
%
SD
0.5029
%
<
p95
1.1
%
60 second average
0.1967
%
300 second average
0.0900
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.46
%
SD
0.3604
%
<
p95
0.88
%
60 second average
0.1467
%
300 second average
0.0767
%
Holochain process CPU usage
CPU usage by Holochain process
p5
48.86
%
<
mean
58.78
%
SD
9.92
%
<
p95
68.7
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
175.51
KiB
<
mean
887.89
KiB
SD
706.27
KiB
<
p95
1.81
MiB
Holochain process threads
Number of threads in Holochain process
p5
5
threads
<
mean
157
threads
SD
151.63
threads
<
p95
364
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
23
file descriptors
<
mean
348.33
file descriptors
SD
322.03
file descriptors
<
p95
787
file descriptors

Full-Arc Create (Validated) / Zero-Arc Read

↑ Back to index

A full-arc/zero-arc mixed scenario where full-arc nodes create data that gets validated and zero-arc nodes read the data. The scenario has two roles:

  • full: A full-arc conductor that creates entries with a timestamp field. Those entries get validated and then retrieved by zero-arc nodes.
  • zero: A zero-arc conductor that reads the entries created by the full-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Thu, 15 Oct 2026 19:45:47 UTC
Duration
900s
Peer count
30
Peer count at end
29
Behaviours
  • full (1 agent)
  • zero (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
full_arc_create_validated_zero_arc_read--high_zero_38767573742_1
Create rate
The number of timed entries created by the full-arc node(s) per second.
Mean
mean
52.55
/s
Max
Highest per-partition mean rate
max
61.42
/s
Min
Lowest per-partition mean rate
min
43.68
/s
Fetch lag timing
For each entry, the time lag between when it was created by a full-arc node and when a zero-arc node fetched it from the network.
Mean
mean
151.936877
s
SD
29.593947
s
Max
Highest per-partition mean latency
max mean
1242.797335
s
Min
Lowest per-partition mean latency
min mean
20.086972
s
Fetch rate
The number of entries per second fetched by zero-arc nodes.
Mean
mean
179.85
/s
Max
Highest per-partition mean rate
max
1534
/s
Min
Lowest per-partition mean rate
min
0
/s
Delivery ratio
The proportion of created entries successfully fetched by all zero-arc nodes.
0.0766
Entry created count
Total number of entries created by full-arc nodes, by agent.
Total
9138
Agents affected
2 / 2
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
4569
Max
Highest count in any single partition
5508
Min
Lowest count in any single partition
3630
Received count
Total number of entries fetched by zero-arc nodes, by agent.
Total
18887
Agents affected
13 / 27
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
700
Max
Highest count in any single partition
3743
Min
Lowest count in any single partition
0
Open connections
The number of currently open connections to other conductors.
full-arc
p5
24
<
mean
27.35
SD
3.16
<
p95
28
zero-arc
p5
0
<
mean
6.68
SD
6.43
<
p95
19
Retrieval errors
Errors encountered by zero-arc nodes when attempting to retrieve entries created by full-arc nodes.
Total
354
Agents affected
27 / 27
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
13
Max
Highest count in any single partition
14
Min
Lowest count in any single partition
3
Error count
The number of errors accumulated across all nodes.
359
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.035915
s
SD
0.196971
s
p50
0.067969
s
<
p95
0.581382
s
<
p99
0.836186
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
11
over 801.184128793s
mean rate
4031.31
/s
std
17583.05
/s
p5
0
/s
p95
54658.07
/s
peak
132787.44
/s
WASM usage: 'timed_and_validated::create_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
228589344
over 880.622682037s
mean rate
9.33912831e+06
/s
std
2.15549593e+06
/s
p5
5.6834228e+06
/s
p95
1.343507032e+07
/s
peak
1.369680538e+07
/s
WASM usage: 'timed_and_validated::get_timed_entries_network'
Metered usage count of the WASM ribosome for this zome function.
total
1562538861
over 887.615150558s
mean rate
1.40793318776e+10
/s
std
3.13731718324e+10
/s
p5
3.436681502e+07
/s
p95
9.7914011745e+10
/s
peak
1.13564797499e+11
/s
WASM usage: 'timed_and_validated_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
8100186
over 887.615150558s
mean rate
2.9625513621e+08
/s
std
9.6622575315e+08
/s
p5
4.65105289e+06
/s
p95
2.70772282441e+09
/s
peak
5.73373377792e+09
/s
WASM usage: 'timed_and_validated_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 887.615150558s
Not enough time data to show a trend.
Zome call duration: 'timed_and_validated::create_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005379
s
SD
0.002248
s
p50
0.00759
s
<
p95
0.008669
s
<
p99
0.011462
s
Zome call duration: 'timed_and_validated::get_timed_entries_network'
Duration of this zome call as measured by Holochain internally.
mean
0.021215
s
SD
0.036414
s
p50
0.015326
s
<
p95
0.12381
s
<
p99
0.157191
s
WASM call duration: 'timed_and_validated::create_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004759
s
SD
0.002096
s
p50
0.006831
s
<
p95
0.007826
s
<
p99
0.010342
s
WASM call duration: 'timed_and_validated::get_timed_entries_network'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.207797
s
SD
0.395542
s
p50
0.14873
s
<
p95
1.188791
s
<
p99
1.716833
s
WASM call duration: 'timed_and_validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000942
s
SD
0.000741
s
p50
0.000894
s
<
p95
0.003148
s
<
p99
0.003272
s
WASM call duration: 'timed_and_validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005579
s
SD
0.001596
s
p50
0.001461
s
<
p95
0.005539
s
<
p99
0.008093
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000338
s
SD
0.00016
s
p50
0.000505
s
<
p95
0.000571
s
<
p99
0.000589
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000309
s
SD
0.000152
s
p50
0.000465
s
<
p95
0.00053
s
<
p99
0.000617
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.034956
s
SD
2.26342
s
p50
0.359226
s
<
p95
3.762707
s
<
p99
4.941187
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.046572
s
SD
0.122637
s
p50
0.020068
s
<
p95
0.326987
s
<
p99
0.587056
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.011279
s
SD
0.004137
s
p50
0.008816
s
<
p95
0.016261
s
<
p99
0.017479
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001471
s
SD
0.001052
s
p50
0.001317
s
<
p95
0.004659
s
<
p99
0.004783
s
Post-commit duration
Time spent executing post-commit workflows.
mean
9.5e-05
s
SD
8e-05
s
p50
0.000114
s
<
p95
0.000269
s
<
p99
0.000469
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.24
s
<
mean
446.02
s
SD
256.21
s
<
p95
846.97
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 887.615161309s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
156.132518
s
SD
42.631449
s
p50
0
s
<
p95
0.009749
s
<
p99
93.38565
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
2.884969
s
SD
1.133416
s
p50
0.001224
s
<
p95
2.960032
s
<
p99
6.101863
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.090931
s
SD
0.070908
s
p50
0.001618
s
<
p95
0.014482
s
<
p99
0.486081
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.111769
s
SD
0.02949
s
p50
0.011992
s
<
p95
0.086698
s
<
p99
0.144297
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
3.431059
s
SD
10.607799
s
p50
0.002837
s
<
p95
1.921162
s
<
p99
73.459406
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
4.400866
s
SD
3.915696
s
p50
0.00224
s
<
p95
0.005716
s
<
p99
25.292643
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000953
s
SD
0.001274
s
p50
8e-05
s
<
p95
0.004067
s
<
p99
0.00635
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.004595
s
SD
0.002424
s
p50
0.001726
s
<
p95
0.007075
s
<
p99
0.01654
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000232
s
SD
0.000101
s
p50
0.00033
s
<
p95
0.000461
s
<
p99
0.000513
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
4.760942
s
SD
29.515989
s
p50
3.542038
s
<
p95
60.0014
s
<
p99
60.001622
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
15.226569
s
SD
24.472992
s
p50
23.518808
s
<
p95
60.001467
s
<
p99
60.001831
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
7.929474
s
SD
37.04216
s
p50
3.830238
s
<
p95
81.307857
s
<
p99
120.788147
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
6.20
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
663
B/s
<
mean
58.41
KiB/s
SD
304.13
KiB/s
<
p95
168.60
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
552
B/s
<
mean
42.04
KiB/s
SD
169.60
KiB/s
<
p95
229.28
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.34
GiB
mean
1.54
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
984.17
MiB
mean
1.11
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (17.6% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.65
%
<
mean
10.76
%
SD
19.36
%
<
p95
56.74
%
System
4.56
%
CPU percentiles
CPU usage percentiles
p50
2.46
%
p95
56.74
%
p99
84.04
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
6
hosts
mean time
75.84
s
Memory used percentage
Percentage of memory used
p5
7.3
%
<
mean
16.94
%
SD
8.56
%
<
p95
32.11
%
Memory available percentage
Percentage of available memory
p5
67.89
%
<
mean
83.06
%
SD
8.56
%
<
p95
92.7
%
Max host memory used
Maximum memory usage percentage across all hosts
max
38.75
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
17.59
%
Memory growth rate
Rate of memory growth over time
growth
0.26
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.02
MiB/s
Disk write throughput
Disk write throughput in MiB/s
31.48
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/7
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/10
hosts
Mount Point /etc/hosts
0/10
hosts
Mount Point /etc/nomad.d/client-meta.json
0/11
hosts
Mount Point /etc/resolv.conf
0/10
hosts
Mount Point /nix/store
0/7
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.65
5 min
0.67
15 min
0.99
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
1.4564
%
SD
6.2197
%
<
p95
6.04
%
60 second average
1.3775
%
300 second average
1.2817
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.6087
%
SD
1.7501
%
<
p95
2.84
%
60 second average
0.6285
%
300 second average
0.6714
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.5713
%
SD
1.6508
%
<
p95
2.8
%
60 second average
0.5908
%
300 second average
0.6196
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.17
%
<
mean
6.53
%
SD
17.68
%
<
p95
52.46
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
353.73
KiB
<
mean
434.38
KiB
SD
77.42
KiB
<
p95
639.35
KiB
Holochain process threads
Number of threads in Holochain process
p5
21
threads
<
mean
28.18
threads
SD
7.7
threads
<
p95
48
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
52
file descriptors
<
mean
60.98
file descriptors
SD
9.83
file descriptors
<
p95
79
file descriptors

Local Signals

↑ Back to index

This scenario is for testing the speed and reliability of local signals. It uses a zome with a function that will emit 10,000 signals. The scenario measures how long it takes to send the signals and how many have been received by the time the zome call ends.

Started
Thu, 15 Oct 2026 16:19:50 UTC
Duration
300s
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
local_signals_38767573742_1
Send timing
The time taken to emit a batch of 10,000 signals.
mean
1.463026
s
SD
1.040398
s
p50
1.398779
s
<
p95
3.97423
s
≤
p99
3.97423
s
Receive timing
The time taken to receive the completed batch, to the nearest 250ms.
mean
27.738398
s
SD
6.788314
s
p50
30.001151
s
<
p95
30.001588
s
≤
p99
30.001588
s
Success ratio
The proportion of signals successfully received in a batch.
min
0.5246999859809875
<
mean
0.595
SD
0.0626
<
max
0.7253999710083008
Holochain MetricsClick to toggle visibility.
WASM usage: 'signal::emit_10k_signals'
Metered usage count of the WASM ribosome for this zome function.
total
248604448
over 280.003398631s
mean rate
887863.57
/s
std
1.40383556e+06
/s
p5
0
/s
p95
3.10754113e+06
/s
peak
3.10754336e+06
/s
Zome call duration: 'signal::emit_10k_signals'
Duration of this zome call as measured by Holochain internally.
mean
0.176594
s
SD
0.021899
s
p50
0.16485
s
<
p95
0.205295
s
≤
p99
0.205295
s
WASM call duration: 'signal::emit_10k_signals'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.175671
s
SD
0.021844
s
p50
0.164009
s
<
p95
0.204326
s
≤
p99
0.204326
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
1.2e-05
s
SD
1e-06
s
p50
1.1e-05
s
<
p95
1.4e-05
s
≤
p99
1.4e-05
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
80000
over 280.003418789s
mean rate
285.71
/s
std
451.75
/s
p5
0
/s
p95
999.99
/s
peak
999.99
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
7.2e-05
s
SD
0
s
p50
7.2e-05
s
≤
p95
7.2e-05
s
≤
p99
7.2e-05
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
16.97
s
<
mean
146.97
s
SD
83.67
s
<
p95
276.97
s
Dropped WebSocket signals
Count of signals dropped from the app WebSocket due to channel overload.
total
3563
over 280.003399s
mean rate
12.72
/s
std
21.5
/s
p5
0
/s
p95
61.3
/s
peak
63.5
/s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.003396473s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000569
s
SD
0
s
p50
0.000569
s
≤
p95
0.000569
s
≤
p99
0.000569
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000785
s
SD
0
s
p50
0.000785
s
≤
p95
0.000785
s
≤
p99
0.000785
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.004768
s
SD
0.000912
s
p50
0.005074
s
<
p95
0.006521
s
≤
p99
0.006521
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001534
s
SD
0
s
p50
0.001534
s
≤
p95
0.001534
s
≤
p99
0.001534
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.003229
s
SD
0
s
p50
0.003229
s
≤
p95
0.003229
s
≤
p99
0.003229
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.00011
s
SD
2.1e-05
s
p50
0.000104
s
<
p95
0.000134
s
≤
p99
0.000134
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000866
s
SD
0.000337
s
p50
0.00133
s
≤
p95
0.00133
s
≤
p99
0.00133
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000212
s
SD
0
s
p50
0.000212
s
≤
p95
0.000212
s
≤
p99
0.000212
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
12.93
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
300
B/s
<
mean
438.72
KiB/s
SD
1.53
MiB/s
<
p95
6.04
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
34
B/s
<
mean
18.15
KiB/s
SD
25.73
KiB/s
<
p95
97.52
KiB/s
Total bytes received
Total bytes received on primary network interface
count
124.25
MiB
mean
438.72
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
5.14
MiB
mean
18.15
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.6%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 3.14 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2.74
%
<
mean
20.67
%
SD
20.11
%
<
p95
54.51
%
System
7.73
%
CPU percentiles
CPU usage percentiles
p50
14.26
%
p95
54.51
%
p99
98.60
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
10.34
s
Memory used percentage
Percentage of memory used
p5
15.82
%
<
mean
20.18
%
SD
3.89
%
<
p95
26.54
%
Memory available percentage
Percentage of available memory
p5
73.46
%
<
mean
79.82
%
SD
3.89
%
<
p95
84.18
%
Max host memory used
Maximum memory usage percentage across all hosts
max
20.18
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
3.14
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
3.37
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.20
5 min
0.64
15 min
0.26
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.29
%
<
mean
9.7373
%
SD
13.8894
%
<
p95
35.92
%
60 second average
7.2573
%
300 second average
3.0083
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0283
%
300 second average
0.0813
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0253
%
300 second average
0.0730
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.471
%
SD
0.489
%
<
p95
1.4
%
60 second average
0.6037
%
300 second average
0.6033
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.3447
%
SD
0.4325
%
<
p95
1.38
%
60 second average
0.4980
%
300 second average
0.5203
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.35
%
<
mean
5.88
%
SD
8.24
%
<
p95
21.67
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
102.30
KiB
<
mean
219.50
KiB
SD
41.42
KiB
<
p95
248.68
KiB
Holochain process threads
Number of threads in Holochain process
p5
20
threads
<
mean
24.43
threads
SD
4.46
threads
<
p95
28
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
61
file descriptors
<
mean
67.13
file descriptors
SD
9.47
file descriptors
<
p95
74
file descriptors

Mixed Arc get_agent_activity

↑ Back to index

A mixed-arc scenario that measures the DHT's ability to propagate agent activity and make it available via get_agent_activity calls. The scenario has three roles:

  • zero_write: A zero-arc conductor that creates entries on its source chain.
  • full_write: A full-arc conductor that creates entries on its source chain.
  • zero_read: A zero-arc conductor that picks a random writer and repeatedly calls get_agent_activity to observe new entries appearing on the writer's chain, measuring the lag between creation and discovery.
Started
Thu, 15 Oct 2026 20:01:11 UTC
Duration
900s
Peer count
30
Peer count at end
29
Behaviours
  • full_write (1 agent)
  • zero_read (1 agent)
  • zero_write (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
mixed_arc_get_agent_activity_38767573742_1
Entry created count
The total number of entries created by write agents over the run, partitioned by agent and behaviour.
Total
128807
Agents affected
20 / 20
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
6440
Max
Highest count in any single partition
11364
Min
Lowest count in any single partition
2733
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
3593.67
Max
Highest chain head value observed for any single write agent.
4110
Write agents observed
3
Chain head delay timing
The time lag between when a writer creates a new entry and when a reader discovers it via get_agent_activity. This is measured per new action in the chain.
Mean
mean
0.034358
s
SD
0.405128
s
Max
Highest per-partition mean latency
max mean
0.143418
s
Min
Lowest per-partition mean latency
min mean
0.001989
s
Chain head delay rate
The rate at which readers detect new chain heads appearing on writers' chains.
Mean
mean
36.68
/s
Max
Highest per-partition mean rate
max
53.71
/s
Min
Lowest per-partition mean rate
min
9.8
/s
get_agent_activity_full zome call timing
The time taken to complete the get_agent_activity_full zome call that queries a writer's chain.
Mean
mean
0.136104
s
SD
0.410104
s
Max
Highest per-partition mean latency
max mean
0.293726
s
Min
Lowest per-partition mean latency
min mean
0.065383
s
Retrieval errors
A running accumulation of errors encountered by read agents when calling get_agent_activity.
Total
24
Agents affected
6 / 9
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
3
Max
Highest count in any single partition
11
Min
Lowest count in any single partition
0
Open connections
The number of currently open connections to other conductors, partitioned by agent behaviour.
  • behaviour: full_write
p5
25
<
mean
27.16
SD
2.73
<
p95
28
  • behaviour: zero_read
p5
10
<
mean
14.74
SD
3.29
<
p95
19
  • behaviour: zero_write
p5
0
<
mean
15.82
SD
6.14
<
p95
24
Final error count
The total number of errors accumulated across all agents over the run.
26
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.08207
s
SD
0.446667
s
p50
0.111592
s
<
p95
1.380176
s
≤
p99
1.380176
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 786.234563463s
Not enough time data to show a trend.
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.006153
s
SD
0.002259
s
p50
0.005479
s
<
p95
0.010261
s
≤
p99
0.010261
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.003722
s
SD
0.000952
s
p50
0.003933
s
<
p95
0.005308
s
<
p99
0.005465
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.082774
s
SD
0.453426
s
p50
0.073339
s
<
p95
1.141932
s
<
p99
1.88929
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.015956
s
SD
0.422558
s
p50
0.319599
s
<
p95
1.385824
s
≤
p99
1.385824
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005098
s
SD
0.002012
s
p50
0.004507
s
<
p95
0.008838
s
≤
p99
0.008838
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003088
s
SD
0.00085
s
p50
0.003235
s
<
p95
0.004542
s
<
p99
0.004845
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.088113
s
SD
0.451788
s
p50
0.087767
s
<
p95
1.140673
s
<
p99
1.88805
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.015308
s
SD
0.422454
s
p50
0.318055
s
<
p95
1.384725
s
≤
p99
1.384725
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001047
s
SD
0.000398
s
p50
0.001141
s
<
p95
0.001802
s
<
p99
0.002347
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
4.3e-05
s
SD
2.8e-05
s
p50
3.6e-05
s
<
p95
0.000117
s
≤
p99
0.000117
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000349
s
SD
0.000132
s
p50
0.000362
s
<
p95
0.0006
s
<
p99
0.000623
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000495
s
SD
0.000215
s
p50
0.000452
s
<
p95
0.000936
s
≤
p99
0.000936
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.085203
s
SD
0.451834
s
p50
0.083814
s
<
p95
1.138242
s
<
p99
1.884758
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.011946
s
SD
0.42215
s
p50
0.311883
s
<
p95
1.380246
s
≤
p99
1.380246
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
6e-06
s
SD
5e-06
s
p50
1.1e-05
s
<
p95
2.1e-05
s
≤
p99
2.1e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001639
s
SD
0.000832
s
p50
0.002014
s
<
p95
0.003855
s
<
p99
0.004038
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000115
s
SD
5e-05
s
p50
0.000126
s
<
p95
0.000238
s
<
p99
0.000249
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.23
s
<
mean
446.18
s
SD
256.32
s
<
p95
847
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 888.73880603s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
66.650035
s
SD
75.456653
s
p50
0
s
<
p95
74.319403
s
<
p99
452.467403
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.016087
s
SD
0.129323
s
p50
0.001551
s
<
p95
0.42147
s
<
p99
0.530255
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.030828
s
SD
0.250822
s
p50
0.001552
s
<
p95
0.876653
s
<
p99
1.079269
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.118864
s
SD
0.073192
s
p50
0.060325
s
<
p95
0.210705
s
<
p99
0.26524
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
2.638
s
SD
23.023177
s
p50
0.003235
s
<
p95
71.766356
s
<
p99
79.426372
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
11.407022
s
SD
18.441626
s
p50
0.002093
s
<
p95
56.115782
s
<
p99
76.789571
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.003421
s
SD
0.002041
s
p50
0.001884
s
<
p95
0.006136
s
<
p99
0.009893
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.004598
s
SD
0.005479
s
p50
0.001251
s
<
p95
0.016631
s
<
p99
0.029109
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000325
s
SD
0.00011
s
p50
0.000301
s
<
p95
0.000546
s
<
p99
0.00057
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
22.569389
s
SD
28.797735
s
p50
3.670235
s
<
p95
60.002477
s
<
p99
60.002628
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.181799
s
SD
0.389823
s
p50
0.269659
s
<
p95
1.377042
s
≤
p99
1.377042
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.096082
s
SD
27.591805
s
p50
0.106622
s
<
p95
60.001183
s
<
p99
60.001301
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.532923
s
SD
24.874858
s
p50
1.30237
s
<
p95
60.002458
s
<
p99
73.567918
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
37.72
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.94
KiB/s
<
mean
269.26
KiB/s
SD
262.15
KiB/s
<
p95
754.49
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
1.66
KiB/s
<
mean
265.04
KiB/s
SD
443.97
KiB/s
<
p95
994.10
KiB/s
Total bytes received
Total bytes received on primary network interface
count
6.17
GiB
mean
7.10
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
6.07
GiB
mean
6.99
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 97.0%

Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (17.6% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 25% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.3
%
<
mean
47.92
%
SD
36.04
%
<
p95
94.45
%
System
10.21
%
CPU percentiles
CPU usage percentiles
p50
62.60
%
p95
94.45
%
p99
96.97
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
14
hosts
mean time
511.40
s
Memory used percentage
Percentage of memory used
p5
6.01
%
<
mean
15.63
%
SD
8.09
%
<
p95
31.78
%
Memory available percentage
Percentage of available memory
p5
68.74
%
<
mean
84.37
%
SD
8.09
%
<
p95
93.99
%
Max host memory used
Maximum memory usage percentage across all hosts
max
36.49
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
17.59
%
Memory growth rate
Rate of memory growth over time
growth
0.36
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.04
MiB/s
Disk write throughput
Disk write throughput in MiB/s
77.90
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/7
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/10
hosts
Mount Point /etc/hosts
0/10
hosts
Mount Point /etc/nomad.d/client-meta.json
0/11
hosts
Mount Point /etc/resolv.conf
0/10
hosts
Mount Point /nix/store
0/7
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.42
5 min
2.65
15 min
1.80
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
25.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
16.7648
%
SD
20.8528
%
<
p95
57.64
%
60 second average
15.8831
%
300 second average
12.1194
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
4.2535
%
SD
9.2651
%
<
p95
26.47
%
60 second average
4.0334
%
300 second average
3.0896
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.9882
%
SD
2.3865
%
<
p95
5.85
%
60 second average
0.9700
%
300 second average
0.8592
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.51
%
<
mean
44.16
%
SD
35.34
%
<
p95
93.28
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
226.47
KiB
<
mean
322.70
KiB
SD
100.62
KiB
<
p95
489.00
KiB
Holochain process threads
Number of threads in Holochain process
p5
24
threads
<
mean
33.96
threads
SD
10.55
threads
<
p95
40
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
59
file descriptors
<
mean
74.01
file descriptors
SD
14.26
file descriptors
<
p95
84
file descriptors

Mixed Arc must_get_agent_activity

↑ Back to index

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Write Validated must_get_agent_activity, but some write agents are zero-arc and all must_get_agent_activity agents are zero-arc. This forces the must_get_agent_activity host call to go to the network.

Started
Thu, 15 Oct 2026 20:16:51 UTC
Duration
900s
Peer count
30
Peer count at end
29
Behaviours
  • full_write (1 agent)
  • zero_must_get_agent_activity (1 agent)
  • zero_write (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
mixed_arc_must_get_agent_activity_38767573742_1
Highest observed action_seq
The maximum chain length observed per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1431.33
Max
Highest chain head value observed for any single write agent.
1765
Write agents observed
3
Chain batch delay timing
The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.
Mean
mean
144.218161
s
SD
126.547279
s
Max
Highest per-partition mean latency
max mean
297.25042
s
Min
Lowest per-partition mean latency
min mean
2.3988
s
Chain batch delay rate
The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.
Mean
mean
1.71
/s
Max
Highest per-partition mean rate
max
3.83
/s
Min
Lowest per-partition mean rate
min
1.15
/s
create_validated_sample_entry zome call timing
The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.
Mean
mean
4.135247
s
SD
5.56241
s
Max
Highest per-partition mean latency
max mean
7.721462
s
Min
Lowest per-partition mean latency
min mean
0.355306
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.
Total
17098
Agents affected
9 / 9
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
1900
Max
Highest count in any single partition
7259
Min
Lowest count in any single partition
228
Open connections
The average number of open connections maintained by an agent over the run, broken down by behaviour.
  • behaviour: full_write
p5
0
<
mean
24.93
SD
8.19
<
p95
28
  • behaviour: zero_must_get_agent_activity
p5
8
<
mean
12.84
SD
3.37
<
p95
20
  • behaviour: zero_write
p5
8
<
mean
14.11
SD
3.74
<
p95
23
Final error count
The total number of all types of error accumulated over the run by all agents.
21756
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.065429
s
SD
0.514718
s
p50
0.072816
s
<
p95
1.513462
s
<
p99
2.039939
s
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.006794
s
SD
0.002787
s
p50
0.00633
s
<
p95
0.012184
s
≤
p99
0.012184
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.064297
s
SD
0.039216
s
p50
0.040286
s
<
p95
0.129884
s
<
p99
0.228722
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006408
s
SD
0.002952
s
p50
0.007975
s
<
p95
0.011764
s
<
p99
0.01177
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.936772
s
SD
0.936943
s
p50
0.682399
s
<
p95
3.00735
s
<
p99
3.59551
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.008352
s
SD
0.171833
s
p50
0.0123
s
<
p95
0.487319
s
≤
p99
0.487319
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005703
s
SD
0.002362
s
p50
0.005183
s
<
p95
0.010077
s
≤
p99
0.010077
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.063459
s
SD
0.039056
s
p50
0.03958
s
<
p95
0.12862
s
<
p99
0.227527
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005361
s
SD
0.002527
s
p50
0.006527
s
<
p95
0.009865
s
<
p99
0.009871
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.39111
s
SD
0.626655
s
p50
0.444021
s
<
p95
1.957625
s
<
p99
2.282752
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.007751
s
SD
0.17182
s
p50
0.011767
s
<
p95
0.486465
s
≤
p99
0.486465
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001246
s
SD
0.000777
s
p50
0.001154
s
<
p95
0.003202
s
<
p99
0.003388
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.016724
s
SD
0.115985
s
p50
0.004372
s
<
p95
0.370572
s
<
p99
0.508826
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.1e-05
s
SD
2.4e-05
s
p50
2.4e-05
s
<
p95
0.000107
s
<
p99
0.000116
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000429
s
SD
0.000222
s
p50
0.000429
s
<
p95
0.000858
s
<
p99
0.000997
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000438
s
SD
0.000204
s
p50
0.000444
s
<
p95
0.000867
s
<
p99
0.001072
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.140717
s
SD
0.560661
s
p50
0.261286
s
<
p95
1.834629
s
<
p99
2.190957
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.055665
s
SD
0.455094
s
p50
0.061858
s
<
p95
1.364267
s
<
p99
1.608622
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.025769
s
SD
0.025115
s
p50
0.00987
s
<
p95
0.069141
s
<
p99
0.133857
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
6e-06
s
SD
6e-06
s
p50
8e-06
s
<
p95
2.1e-05
s
≤
p99
2.1e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00193
s
SD
0.001232
s
p50
0.002253
s
<
p95
0.004858
s
<
p99
0.005031
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000141
s
SD
9.3e-05
s
p50
0.000105
s
<
p95
0.000388
s
<
p99
0.000426
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.22
s
<
mean
446.52
s
SD
256.52
s
<
p95
847.1
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
21067
over 889.277538002s
mean rate
371319.55
/s
std
4.55593553e+06
/s
p5
0
/s
p95
326903.25
/s
peak
1.6291336985e+08
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
160.922581
s
SD
75.427375
s
p50
0
s
<
p95
223.226446
s
<
p99
300.168771
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
2.525611
s
SD
1.397426
s
p50
0.001548
s
<
p95
3.993776
s
<
p99
5.444041
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.174253
s
SD
0.176521
s
p50
0.001145
s
<
p95
0.51948
s
<
p99
0.719721
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.116079
s
SD
0.15659
s
p50
0.014041
s
<
p95
0.416499
s
<
p99
0.823783
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
14.578937
s
SD
11.684292
s
p50
0.003634
s
<
p95
32.996395
s
<
p99
45.710607
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
17.04344
s
SD
18.482082
s
p50
0.002838
s
<
p95
42.452183
s
<
p99
87.072688
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002747
s
SD
0.001886
s
p50
0.000218
s
<
p95
0.005724
s
<
p99
0.006805
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002828
s
SD
0.004114
s
p50
0.001692
s
<
p95
0.011267
s
<
p99
0.023349
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000378
s
SD
0.00018
s
p50
0.000385
s
<
p95
0.0007
s
<
p99
0.000778
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
5.173469
s
SD
29.716051
s
p50
1.539912
s
<
p95
60.001794
s
<
p99
60.001842
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.173427
s
SD
20.158235
s
p50
0.308868
s
<
p95
60.001125
s
<
p99
60.001158
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
0.167688
s
SD
26.658667
s
p50
0.644111
s
<
p95
60.001648
s
<
p99
60.001666
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.55122
s
SD
6.696107
s
p50
0.650421
s
<
p95
17.552555
s
<
p99
20.066977
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
18.60
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.98
KiB/s
<
mean
92.03
KiB/s
SD
438.16
KiB/s
<
p95
159.06
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
1.34
KiB/s
<
mean
47.96
KiB/s
SD
47.55
KiB/s
<
p95
123.53
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.11
GiB
mean
2.43
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.10
GiB
mean
1.26
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.8%

Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (17.6% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 14% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.63
%
<
mean
25.21
%
SD
32.81
%
<
p95
97.45
%
System
6.61
%
CPU percentiles
CPU usage percentiles
p50
6.90
%
p95
97.45
%
p99
98.75
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
7
hosts
mean time
534.51
s
Memory used percentage
Percentage of memory used
p5
8.1
%
<
mean
17.28
%
SD
8.62
%
<
p95
34.38
%
Memory available percentage
Percentage of available memory
p5
65.62
%
<
mean
82.72
%
SD
8.62
%
<
p95
91.9
%
Max host memory used
Maximum memory usage percentage across all hosts
max
39.96
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
17.59
%
Memory growth rate
Rate of memory growth over time
growth
0.26
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.22
MiB/s
Disk write throughput
Disk write throughput in MiB/s
67.13
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/7
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/10
hosts
Mount Point /etc/hosts
0/10
hosts
Mount Point /etc/nomad.d/client-meta.json
0/11
hosts
Mount Point /etc/resolv.conf
0/10
hosts
Mount Point /nix/store
0/7
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.48
5 min
1.94
15 min
2.08
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
14.29
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
8.9419
%
SD
19.9944
%
<
p95
65.86
%
60 second average
8.9929
%
300 second average
10.2281
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
1.4418
%
SD
4.0407
%
<
p95
7.61
%
60 second average
1.6442
%
300 second average
2.3541
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.8683
%
SD
2.7371
%
<
p95
4.09
%
60 second average
0.9702
%
300 second average
1.0532
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.45
%
<
mean
21.21
%
SD
31.61
%
<
p95
95.33
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
349.67
KiB
<
mean
441.90
KiB
SD
84.28
KiB
<
p95
618.67
KiB
Holochain process threads
Number of threads in Holochain process
p5
26
threads
<
mean
33.35
threads
SD
7.31
threads
<
p95
51
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
61
file descriptors
<
mean
71.53
file descriptors
SD
10.05
file descriptors
<
p95
93
file descriptors

Remote Call Rate

↑ Back to index

Test the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

Started
Thu, 15 Oct 2026 16:21:41 UTC
Duration
900s
Peer count
10
Behaviours
  • default (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
remote_call_rate_38767573742_1
Dispatch timing
The time between sending a remote call and the remote handler being invoked.
Mean
mean
0.07829
s
SD
0.142656
s
Max
Highest per-partition mean latency
max mean
0.096842
s
Min
Lowest per-partition mean latency
min mean
0.050103
s
Round-trip timing
The total elapsed time to get a response to the client.
Mean
mean
0.17534
s
SD
0.299913
s
Max
Highest per-partition mean latency
max mean
0.201743
s
Min
Lowest per-partition mean latency
min mean
0.154279
s
Error count
The total number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_call::call_echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
141498084
over 887.729208623s
mean rate
5.951929306e+07
/s
std
8.184292789e+07
/s
p5
581860.27
/s
p95
2.475173161e+08
/s
peak
3.6057411594e+08
/s
WASM usage: 'remote_call::echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
34247787
over 887.729208623s
mean rate
1.15518916e+06
/s
std
1.84578522e+06
/s
p5
13484.25
/s
p95
6.18855708e+06
/s
peak
8.71592424e+06
/s
WASM usage: 'remote_call::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 887.729208623s
Not enough time data to show a trend.
Zome call duration: 'remote_call::call_echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.124327
s
SD
0.036618
s
p50
0.105407
s
<
p95
0.182784
s
<
p99
0.197244
s
Zome call duration: 'remote_call::echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.003188
s
SD
0.000619
s
p50
0.003217
s
<
p95
0.004323
s
<
p99
0.004865
s
WASM call duration: 'remote_call::call_echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.12322
s
SD
0.036621
s
p50
0.104403
s
<
p95
0.181923
s
<
p99
0.19593
s
WASM call duration: 'remote_call::echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002132
s
SD
0.000447
s
p50
0.002122
s
<
p95
0.002977
s
<
p99
0.003352
s
WASM call duration: 'remote_call::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002139
s
SD
0.000616
s
p50
0.00235
s
<
p95
0.002794
s
≤
p99
0.002794
s
Host function call duration: '__hc__call_1'
Duration of this host function call invoked from within WASM.
mean
0.120737
s
SD
0.036508
s
p50
0.101989
s
<
p95
0.179937
s
<
p99
0.192421
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000374
s
SD
0.000132
s
p50
0.000373
s
<
p95
0.000706
s
≤
p99
0.000706
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
1e-05
s
SD
3e-06
s
p50
1e-05
s
<
p95
1.5e-05
s
≤
p99
1.5e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00027
s
SD
5.7e-05
s
p50
0.000213
s
<
p95
0.000322
s
<
p99
0.000353
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000124
s
SD
4.3e-05
s
p50
0.000113
s
<
p95
0.000206
s
≤
p99
0.000206
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.54
s
<
mean
444.56
s
SD
255.49
s
<
p95
846.11
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
87
over 887.729210735s
mean rate
6.31
/s
std
31.54
/s
p5
0
/s
p95
24.65
/s
peak
258.44
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
1.088149
s
SD
0.953835
s
p50
0.620644
s
<
p95
2.958735
s
<
p99
3.676482
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.002474
s
SD
0.000609
s
p50
0.002503
s
<
p95
0.003626
s
<
p99
0.004219
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.081185
s
SD
0.025596
s
p50
0.081175
s
<
p95
0.141255
s
<
p99
0.146287
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.005394
s
SD
0.001702
s
p50
0.005191
s
<
p95
0.008038
s
<
p99
0.011499
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.178845
s
SD
0.317368
s
p50
0.018779
s
<
p95
0.840804
s
<
p99
1.019937
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.105644
s
SD
0.069968
s
p50
0.07323
s
<
p95
0.224157
s
<
p99
0.24901
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000141
s
SD
3e-05
s
p50
0.00014
s
<
p95
0.000197
s
<
p99
0.000214
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001082
s
SD
0.000381
s
p50
0.001095
s
<
p95
0.002101
s
≤
p99
0.002101
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000418
s
SD
7.9e-05
s
p50
0.000428
s
<
p95
0.000572
s
<
p99
0.000634
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.090424
s
SD
0.040609
s
p50
0.087311
s
<
p95
0.150373
s
<
p99
0.166485
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.090434
s
SD
0.053345
s
p50
0.090234
s
<
p95
0.170606
s
≤
p99
0.170606
s
P2P request roundtrip: 'call_remote'
Time spent sending a call_remote request and awaiting its response.
mean
0.120199
s
SD
0.036488
s
p50
0.10152
s
<
p95
0.179497
s
<
p99
0.191777
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
13.11
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
6.84
KiB/s
<
mean
181.66
KiB/s
SD
887.80
KiB/s
<
p95
274.06
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
5.58
KiB/s
<
mean
22.98
KiB/s
SD
31.36
KiB/s
<
p95
105.80
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.54
GiB
mean
1.77
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
199.69
MiB
mean
229.75
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1.40 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 10% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
4.69
%
<
mean
19.42
%
SD
22.52
%
<
p95
72.59
%
System
6.31
%
CPU percentiles
CPU usage percentiles
p50
7.97
%
p95
72.59
%
p99
78.93
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
20.22
s
Memory used percentage
Percentage of memory used
p5
4.72
%
<
mean
16.4
%
SD
7.71
%
<
p95
27.34
%
Memory available percentage
Percentage of available memory
p5
72.67
%
<
mean
83.6
%
SD
7.71
%
<
p95
95.28
%
Max host memory used
Maximum memory usage percentage across all hosts
max
25.95
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1.40
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
20.50
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/5
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/nomad.d/client-meta.json
0/5
hosts
Mount Point /nix/store
0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.32
5 min
1.65
15 min
0.84
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
10.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
5.7739
%
SD
11.4763
%
<
p95
32.4
%
60 second average
5.5119
%
300 second average
4.0116
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0005
%
300 second average
0.0016
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0003
%
300 second average
0.0013
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
21.6592
%
SD
24.9746
%
<
p95
58.53
%
60 second average
20.3656
%
300 second average
14.2636
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
19.61
%
SD
22.8358
%
<
p95
54
%
60 second average
18.4258
%
300 second average
12.9369
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
<
mean
9.57
%
SD
19.51
%
<
p95
62.84
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
91.68
KiB
<
mean
231.98
KiB
SD
89.12
KiB
<
p95
411.28
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
89.02
threads
SD
256.33
threads
<
p95
423
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
<
mean
207.07
file descriptors
SD
564.27
file descriptors
<
p95
960
file descriptors

Remote Signals

↑ Back to index

This scenario tests the throughput of remote_signals operations.

Started
Thu, 15 Oct 2026 16:23:33 UTC
Duration
900s
Peer count
10
Behaviours
  • default (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
remote_signals_38767573742_1
Round trip time
The time from origin signal dispatch to origin receive of the remote side's response signal.
mean
0.155889
s
SD
0.38836
s
p50
0.118849
s
<
p95
0.22623
s
<
p99
2.223832
s
Timeout rate
The proportion of remote signal round-trips that timed out.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_signal::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 876.255034952s
Not enough time data to show a trend.
WASM usage: 'remote_signal::recv_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
30774364
over 876.255034952s
mean rate
1.12442399353e+09
/s
std
7.4131152513e+09
/s
p5
0
/s
p95
3.88740458015e+09
/s
peak
1.02053231939e+11
/s
WASM usage: 'remote_signal::signal_request'
Metered usage count of the WASM ribosome for this zome function.
total
13131158
over 876.255034952s
mean rate
7.043679413e+08
/s
std
5.75303565713e+09
/s
p5
0
/s
p95
2.28933064922e+09
/s
peak
8.98104639684e+10
/s
Zome call duration: 'remote_signal::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.00297
s
SD
0.000599
s
p50
0.002811
s
<
p95
0.004209
s
<
p99
0.00424
s
Zome call duration: 'remote_signal::signal_request'
Duration of this zome call as measured by Holochain internally.
mean
0.002913
s
SD
0.000573
s
p50
0.002765
s
<
p95
0.004065
s
<
p99
0.004106
s
WASM call duration: 'remote_signal::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003026
s
SD
0.001284
s
p50
0.002684
s
<
p95
0.006787
s
≤
p99
0.006787
s
WASM call duration: 'remote_signal::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001997
s
SD
0.000387
s
p50
0.001847
s
<
p95
0.002791
s
<
p99
0.002836
s
WASM call duration: 'remote_signal::signal_request'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001949
s
SD
0.00036
s
p50
0.00182
s
<
p95
0.002672
s
<
p99
0.002705
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000398
s
SD
3.2e-05
s
p50
0.000395
s
<
p95
0.000467
s
≤
p99
0.000467
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
6.7e-05
s
SD
2e-05
s
p50
6.5e-05
s
<
p95
9.8e-05
s
<
p99
0.0001
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
7.7e-05
s
SD
3.8e-05
s
p50
5.8e-05
s
<
p95
0.000146
s
<
p99
0.000153
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
5e-06
s
SD
2e-06
s
p50
5e-06
s
<
p95
9e-06
s
≤
p99
9e-06
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000222
s
SD
3.6e-05
s
p50
0.000227
s
<
p95
0.000279
s
≤
p99
0.000279
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
1710
over 876.255037582s
mean rate
77924.23
/s
std
842296.3
/s
p5
0
/s
p95
104787.02
/s
peak
1.801801802e+07
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
1711
over 876.255042672s
mean rate
87473.39
/s
std
832172.86
/s
p5
0
/s
p95
132304.88
/s
peak
1.6e+07
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000167
s
SD
2.3e-05
s
p50
0.00016
s
<
p95
0.000223
s
≤
p99
0.000223
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
44.96
s
<
mean
442.84
s
SD
255.79
s
<
p95
842.62
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
117
over 886.255221351s
mean rate
3000.41
/s
std
46665.69
/s
p5
0
/s
p95
97.21
/s
peak
1.26984127e+06
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
1.892241
s
SD
1.464181
s
p50
1.244803
s
<
p95
5.216968
s
<
p99
5.794338
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.002751
s
SD
0.000571
s
p50
0.00273
s
<
p95
0.003586
s
<
p99
0.00446
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.126105
s
SD
0.029516
s
p50
0.128554
s
<
p95
0.16965
s
<
p99
0.211227
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.006971
s
SD
0.002365
s
p50
0.006749
s
<
p95
0.011932
s
<
p99
0.014974
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.162012
s
SD
0.159625
s
p50
0.154054
s
<
p95
0.399539
s
<
p99
0.641677
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.114621
s
SD
0.056253
s
p50
0.123285
s
<
p95
0.19788
s
<
p99
0.237294
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000129
s
SD
2.5e-05
s
p50
0.000126
s
<
p95
0.000184
s
<
p99
0.00021
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001228
s
SD
0.00065
s
p50
0.001447
s
<
p95
0.003351
s
≤
p99
0.003351
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000508
s
SD
9.7e-05
s
p50
0.000471
s
<
p95
0.000697
s
<
p99
0.000707
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.032014
s
SD
0.017346
s
p50
0.035695
s
<
p95
0.060835
s
≤
p99
0.060835
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.080685
s
SD
0.031504
s
p50
0.070519
s
<
p95
0.12226
s
≤
p99
0.12226
s
P2P received remote signals
Count of remote signals received.
total
1711
over 876.255101199s
mean rate
35965.13
/s
std
253942.18
/s
p5
0
/s
p95
72768.73
/s
peak
3.72439479e+06
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
18.30
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
5.84
KiB/s
<
mean
157.01
KiB/s
SD
819.51
KiB/s
<
p95
228.26
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
5.11
KiB/s
<
mean
22.68
KiB/s
SD
29.02
KiB/s
<
p95
97.23
KiB/s
Total bytes received
Total bytes received on primary network interface
count
680.79
MiB
mean
783.29
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
98.33
MiB
mean
113.13
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 20% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
5.91
%
<
mean
27.02
%
SD
27.47
%
<
p95
76.99
%
System
8.72
%
CPU percentiles
CPU usage percentiles
p50
10.74
%
p95
76.99
%
p99
79.28
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
20.22
s
Memory used percentage
Percentage of memory used
p5
18.36
%
<
mean
23.17
%
SD
3.01
%
<
p95
27.68
%
Memory available percentage
Percentage of available memory
p5
72.32
%
<
mean
76.83
%
SD
3.01
%
<
p95
81.64
%
Max host memory used
Maximum memory usage percentage across all hosts
max
26.33
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
0.51
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
10.97
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/3
hosts
Mount Point /efi-boot
0/3
hosts
Mount Point /etc/nomad.d/client-meta.json
0/2
hosts
Mount Point /nix/store
0/3
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.24
5 min
2.51
15 min
1.35
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
20.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.09
%
<
mean
10.419
%
SD
14.8554
%
<
p95
41.2
%
60 second average
10.1839
%
300 second average
7.8453
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0013
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0010
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.02
%
<
mean
29.5635
%
SD
24.5315
%
<
p95
57.7
%
60 second average
28.4128
%
300 second average
21.1014
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
26.7962
%
SD
22.7041
%
<
p95
53.09
%
60 second average
25.6783
%
300 second average
19.0392
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
<
mean
14.95
%
SD
25.52
%
<
p95
68.05
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
24.71
KiB
<
mean
249.33
KiB
SD
141.52
KiB
<
p95
491.35
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
87.66
threads
SD
236.91
threads
<
p95
265
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
<
mean
209.37
file descriptors
SD
519.36
file descriptors
<
p95
686
file descriptors

Single-write, many-read

↑ Back to index

Creates an entry in the agent setup, then read one's own record back. This tests the maximum read performance for reading back local data when the chain is short.

Started
Thu, 15 Oct 2026 16:27:33 UTC
Duration
300s
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
single_write_many_read_38767573742_1
read call timing
The time it takes to complete the zome call that retrieves the record.
mean
0.012807
s
SD
0.149533
s
p50
0.003145
s
<
p95
0.004644
s
<
p99
0.009513
s
read call rate
The number of read zome calls completed per second.
mean
772.08
/s
Error count
The number of errors collected.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000255
s
SD
2e-06
s
p50
0.000255
s
<
p95
0.000256
s
<
p99
0.000263
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 200.00183438s
Not enough time data to show a trend.
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
502635240
over 200.00183438s
mean rate
2.5131539e+06
/s
std
567028.53
/s
p5
1.72754543e+06
/s
p95
3.60242539e+06
/s
peak
3.60242539e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 200.00183438s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
4404
over 220.004821483s
mean rate
20.02
/s
std
91.73
/s
p5
0
/s
p95
0
/s
peak
440.4
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006516
s
SD
0
s
p50
0.006516
s
≤
p95
0.006516
s
≤
p99
0.006516
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.001785
s
SD
8e-06
s
p50
0.001784
s
<
p95
0.00179
s
<
p99
0.001817
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005243
s
SD
0
s
p50
0.005243
s
≤
p95
0.005243
s
≤
p99
0.005243
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001237
s
SD
7e-06
s
p50
0.001236
s
<
p95
0.00124
s
<
p99
0.001266
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002537
s
SD
0
s
p50
0.002537
s
≤
p95
0.002537
s
≤
p99
0.002537
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002075
s
SD
6.6e-05
s
p50
0.002065
s
<
p95
0.002299
s
≤
p99
0.002299
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000518
s
SD
3.3e-05
s
p50
0.000551
s
≤
p95
0.000551
s
≤
p99
0.000551
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000287
s
SD
2e-06
s
p50
0.000286
s
<
p95
0.000287
s
<
p99
0.000295
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002714
s
SD
0
s
p50
0.002714
s
≤
p95
0.002714
s
≤
p99
0.002714
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000146
s
SD
0
s
p50
0.000146
s
≤
p95
0.000146
s
≤
p99
0.000146
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
14.76
s
<
mean
114.76
s
SD
66.33
s
<
p95
214.76
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 210.001869911s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001355
s
SD
0
s
p50
0.001355
s
≤
p95
0.001355
s
≤
p99
0.001355
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001505
s
SD
0.000137
s
p50
0.001497
s
≤
p95
0.001497
s
<
p99
0.002154
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.004427
s
SD
0.000943
s
p50
0.004252
s
<
p95
0.005323
s
<
p99
0.008121
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.004204
s
SD
0
s
p50
0.004204
s
≤
p95
0.004204
s
≤
p99
0.004204
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.00327
s
SD
0
s
p50
0.00327
s
≤
p95
0.00327
s
≤
p99
0.00327
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
4.9e-05
s
SD
1e-06
s
p50
4.9e-05
s
≤
p95
4.9e-05
s
<
p99
5.2e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001526
s
SD
0.000414
s
p50
0.001756
s
<
p95
0.002136
s
≤
p99
0.002136
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000481
s
SD
1e-05
s
p50
0.00048
s
≤
p95
0.00048
s
<
p99
0.000526
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
8.69
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
5.96
KiB/s
<
mean
7.37
KiB/s
SD
1.09
KiB/s
<
p95
9.40
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
4.79
KiB/s
<
mean
6.12
KiB/s
SD
1.18
KiB/s
<
p95
8.02
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.94
MiB
mean
7.37
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.61
MiB
mean
6.12
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
6.33
%
<
mean
13.94
%
SD
6.59
%
<
p95
17.19
%
System
5.25
%
CPU percentiles
CPU usage percentiles
p50
13.95
%
p95
17.19
%
p99
44.09
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
16.2
%
<
mean
19.56
%
SD
1.41
%
<
p95
20.64
%
Memory available percentage
Percentage of available memory
p5
79.36
%
<
mean
80.44
%
SD
1.41
%
<
p95
83.8
%
Max host memory used
Maximum memory usage percentage across all hosts
max
19.56
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
0.96
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
3.96
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /efi-boot
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.61
5 min
2.77
15 min
1.25
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.2
%
<
mean
0.6539
%
SD
0.2452
%
<
p95
0.92
%
60 second average
0.6243
%
300 second average
0.3039
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
50.65
%
<
mean
56.9136
%
SD
5.434
%
<
p95
68.34
%
60 second average
56.5386
%
300 second average
38.5739
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
43.08
%
<
mean
50.0775
%
SD
6.4706
%
<
p95
63.27
%
60 second average
50.2414
%
300 second average
34.9957
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.3
%
<
mean
7.51
%
SD
6.8
%
<
p95
10.9
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
1.46
KiB
<
mean
190.79
KiB
SD
86.43
KiB
<
p95
278.89
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
22.18
threads
SD
12.07
threads
<
p95
46
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
<
mean
54.32
file descriptors
SD
30.15
file descriptors
<
p95
122
file descriptors

Unyt Proposal

↑ Back to index

This scenario tests the performance of the Unyt negotiated transaction flow. Agents create proposals, exchange counter-proposals, commit to agreed terms, and finalize or reject transactions. There are three roles: initiate (progenitor), propose (proposer agents), and respond (responder agents).

Started
Thu, 15 Oct 2026 20:32:28 UTC
Duration
900s
Peer count
30
Peer count at end
29
Behaviours
  • initiate (1 agent)
  • propose (1 agent)
  • respond (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
unyt_proposal_38767573742_1
Global definition propagation time
Time (seconds since session start) at which each agent first detects network initialization.
mean
27.428571
s
SD
27.514189
s
p50
24
s
<
p95
90
s
<
p99
101
s
Proposal round-trip time (rejected)
Duration from proposal creation to rejection/reclaim, per agent.
Mean
mean
271.599181
s
SD
115.492309
s
Max
Highest per-partition mean latency
max mean
496.82877
s
Min
Lowest per-partition mean latency
min mean
95.969385
s
Negotiation rounds
Number of counter-proposal rounds before a proposal reaches commitment. Lower values indicate faster convergence.
mean
0
SD
0
p50
0
≤
p95
0
≤
p99
0
Sync lag — proposals
Delay between proposal publish and first observation by the counterparty.
Mean
mean
255.460727
s
SD
165.885262
s
Max
Highest per-partition mean latency
max mean
432.584765
s
Min
Lowest per-partition mean latency
min mean
149.592252
s
Sync lag — commitments
Delay between commitment publish and first observation by the counterparty.
Mean
mean
220.305266
s
SD
46.597588
s
Max
Highest per-partition mean latency
max mean
335.701895
s
Min
Lowest per-partition mean latency
min mean
163.072775
s
Sync lag — rejects
Delay between reject publish and first observation by the counterparty.
Mean
mean
222.959159
s
SD
104.72355
s
Max
Highest per-partition mean latency
max mean
350.768169
s
Min
Lowest per-partition mean latency
min mean
84.989407
s
Zome call — create_proposal
Duration of create_proposal zome calls per agent.
Mean
mean
2.059319
s
SD
1.664392
s
Max
Highest per-partition mean latency
max mean
4.443367
s
Min
Lowest per-partition mean latency
min mean
1.193556
s
Zome call — create_counter_proposal
Duration of create_counter_proposal zome calls per agent.
Mean
mean
4.070049
s
SD
0.63754
s
Max
Highest per-partition mean latency
max mean
8.145175
s
Min
Lowest per-partition mean latency
min mean
0.184862
s
Zome call — create_commit_to_proposal
Duration of create_commit_to_proposal zome calls per agent.
Mean
mean
3.650815
s
SD
1.190243
s
Max
Highest per-partition mean latency
max mean
9.002581
s
Min
Lowest per-partition mean latency
min mean
0.733037
s
Zome call — create_accept
Duration of create_accept zome calls per agent.
Mean
mean
4.253998
s
SD
0.78239
s
Max
Highest per-partition mean latency
max mean
4.782866
s
Min
Lowest per-partition mean latency
min mean
3.72513
s
Zome call — create_reject_proposal
Duration of create_reject_proposal zome calls per agent.
Mean
mean
1.220983
s
SD
0.731739
s
Max
Highest per-partition mean latency
max mean
2.948373
s
Min
Lowest per-partition mean latency
min mean
0.299778
s
Zome call — create_reclaim_balance
Duration of create_reclaim_balance zome calls per agent.
Mean
mean
2.293443
s
SD
1.267889
s
Max
Highest per-partition mean latency
max mean
3.175121
s
Min
Lowest per-partition mean latency
min mean
1.453237
s
Zome call — get_actionable_transactions
Duration of get_actionable_transactions zome calls per agent. Called every iteration.
Mean
mean
0.129473
s
SD
0.159264
s
Max
Highest per-partition mean latency
max mean
0.35314
s
Min
Lowest per-partition mean latency
min mean
0.065293
s
Zome call errors
Total number of zome call errors observed during the run.
2033
Completed transaction accepts
Completed transaction accepts at teardown.
sum
7
mean
0.24
min
0
max
6
n
29
Completed transaction spends
Completed transaction spends at teardown.
sum
158
mean
5.45
min
0
max
18
n
29
Completed transaction RAVEs
Completed transaction RAVEs at teardown.
sum
152
mean
5.24
min
0
max
18
n
29
Actionable transaction proposals
Remaining actionable transaction proposals at teardown. Non-zero sum indicates unresolved negotiations.
sum
80
mean
2.76
min
0
max
14
n
29
Actionable transaction commitments
Remaining actionable transaction commitments at teardown. Non-zero sum indicates unresolved negotiations.
sum
4
mean
0.14
min
0
max
2
n
29
Actionable transaction accepts
Remaining actionable transaction accepts at teardown. Non-zero sum indicates unresolved negotiations.
sum
0
mean
0
min
0
max
0
n
29
Actionable transaction rejects
Remaining actionable transaction rejects at teardown. Non-zero sum indicates unresolved negotiations.
sum
16
mean
0.55
min
0
max
4
n
29
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.002705
s
SD
0.002222
s
p50
0.002104
s
<
p95
0.007146
s
<
p99
0.010698
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
30
over 659.813792781s
mean rate
38887.33
/s
std
262798.35
/s
p5
0
/s
p95
247507.65
/s
peak
6.0335222e+06
/s
WASM usage: 'transactor::create_accept'
Metered usage count of the WASM ribosome for this zome function.
total
314198777
over 580.004697358s
mean rate
1.880930456e+07
/s
std
1.437868194e+07
/s
p5
0
/s
p95
3.259897194e+07
/s
peak
3.259912315e+07
/s
WASM usage: 'transactor::create_code_template'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 760.006164322s
Not enough time data to show a trend.
WASM usage: 'transactor::create_commit_to_proposal'
Metered usage count of the WASM ribosome for this zome function.
total
486249572
over 719.580211324s
mean rate
2.98676060248e+10
/s
std
1.18208626251e+11
/s
p5
1.946362567e+07
/s
p95
2.72642493026e+11
/s
peak
2.35144626139e+12
/s
WASM usage: 'transactor::create_counter_proposal'
Metered usage count of the WASM ribosome for this zome function.
total
77560783
over 710.100913138s
mean rate
1.40624568935e+09
/s
std
5.6754036233e+09
/s
p5
1.13719157e+06
/s
p95
7.53041114405e+09
/s
peak
6.44470798026e+10
/s
WASM usage: 'transactor::create_proposal'
Metered usage count of the WASM ribosome for this zome function.
total
8018337154
over 720.005605731s
mean rate
2.07922298372e+11
/s
std
7.43118226876e+11
/s
p5
1.2263788203e+08
/s
p95
2.5231290214e+12
/s
peak
6.25335032298e+12
/s
WASM usage: 'transactor::create_reclaim_balance'
Metered usage count of the WASM ribosome for this zome function.
total
247661947
over 709.588742995s
mean rate
2.90569430333e+09
/s
std
1.25967758272e+10
/s
p5
4.53610436e+06
/s
p95
5.96627855807e+09
/s
peak
1.54684848795e+11
/s
WASM usage: 'transactor::create_reject_proposal'
Metered usage count of the WASM ribosome for this zome function.
total
523316348
over 721.977145468s
mean rate
3.42899987122e+10
/s
std
1.39046194404e+11
/s
p5
4.252304712e+07
/s
p95
2.08297620434e+11
/s
peak
2.24515393328e+12
/s
WASM usage: 'transactor::create_smart_agreement'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 720.011556753s
Not enough time data to show a trend.
WASM usage: 'transactor::get_actionable_transactions'
Metered usage count of the WASM ribosome for this zome function.
total
120368592
over 729.05392107s
mean rate
2.04285413969e+10
/s
std
9.23167190548e+10
/s
p5
3.239947005e+07
/s
p95
6.10027319253e+10
/s
peak
1.13110197154e+12
/s
WASM usage: 'transactor::get_code_templates_lib'
Metered usage count of the WASM ribosome for this zome function.
total
41315392
over 729.05392107s
mean rate
1.22930877877e+09
/s
std
6.2165082674e+09
/s
p5
0
/s
p95
7.50221314072e+09
/s
peak
1.5046041958e+11
/s
WASM usage: 'transactor::get_current_global_definition'
Metered usage count of the WASM ribosome for this zome function.
total
4636492
over 760.006164322s
mean rate
1.6840492929e+08
/s
std
2.67044289125e+09
/s
p5
419871.87
/s
p95
4.4052222445e+08
/s
peak
8.86640474294e+10
/s
WASM usage: 'transactor::get_history'
Metered usage count of the WASM ribosome for this zome function.
total
153946216
over 729.05392107s
mean rate
4.09004564046e+10
/s
std
1.69689033142e+11
/s
p5
4.526743499e+07
/s
p95
1.13987367975e+11
/s
peak
2.01551696608e+12
/s
WASM usage: 'transactor::get_ledger'
Metered usage count of the WASM ribosome for this zome function.
total
140487957
over 729.05392107s
mean rate
2.17397516469e+10
/s
std
1.0604362231e+11
/s
p5
3.086926831e+07
/s
p95
7.99967409672e+10
/s
peak
1.36041955544e+12
/s
WASM usage: 'transactor::get_my_current_applied_credit_limit'
Metered usage count of the WASM ribosome for this zome function.
total
157845746
over 729.05392107s
mean rate
3.93858706004e+10
/s
std
1.54061771007e+11
/s
p5
4.721877252e+07
/s
p95
1.1664198262e+11
/s
peak
1.83905723103e+12
/s
WASM usage: 'transactor::get_smart_agreements_for_code_template'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 729.05392107s
Not enough time data to show a trend.
WASM usage: 'transactor::get_status'
Metered usage count of the WASM ribosome for this zome function.
total
1136832431
over 702.872715947s
mean rate
4.84888785605e+11
/s
std
2.1199314353e+12
/s
p5
1.4287185572e+08
/s
p95
2.58868661436e+12
/s
peak
2.14619710576e+13
/s
WASM usage: 'transactor::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 880.008287144s
Not enough time data to show a trend.
WASM usage: 'transactor::initialize_global_definition'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 720.011556753s
Not enough time data to show a trend.
WASM usage: 'transactor::post_commit'
Metered usage count of the WASM ribosome for this zome function.
total
4801259003
over 880.008287144s
mean rate
1.20888434611e+11
/s
std
6.30325443733e+11
/s
p5
631.13
/s
p95
7.37557938082e+11
/s
peak
1.6387416971e+13
/s
WASM usage: 'transactor::recv_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
2094683715
over 727.745034463s
mean rate
6.1946275806e+09
/s
std
1.93674164482e+10
/s
p5
2.016335346e+07
/s
p95
3.90156685565e+10
/s
peak
1.9794929102e+11
/s
WASM usage: 'transactor_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
1019856590
over 884.749847597s
mean rate
2.57231832184e+10
/s
std
1.33814878631e+11
/s
p5
42268.32
/s
p95
1.20468180775e+11
/s
peak
2.88863555438e+12
/s
WASM usage: 'transactor_integrity::genesis_self_check_2'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 884.749847597s
Not enough time data to show a trend.
WASM usage: 'transactor_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
233959127541
over 880.102616586s
mean rate
5.14830340582e+12
/s
std
4.59928341999e+13
/s
p5
4.16885374e+06
/s
p95
1.02594132264e+13
/s
peak
1.45332505559e+15
/s
Zome call duration: 'transactor::create_accept'
Duration of this zome call as measured by Holochain internally.
mean
0.258501
s
SD
0.12875
s
p50
0.250363
s
<
p95
0.481988
s
≤
p99
0.481988
s
Zome call duration: 'transactor::create_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.015471
s
SD
0.006966
s
p50
0.013294
s
<
p95
0.028922
s
<
p99
0.032615
s
Zome call duration: 'transactor::create_commit_to_proposal'
Duration of this zome call as measured by Holochain internally.
mean
0.232173
s
SD
0.126109
s
p50
0.230913
s
<
p95
0.457685
s
<
p99
0.82216
s
Zome call duration: 'transactor::create_counter_proposal'
Duration of this zome call as measured by Holochain internally.
mean
0.221455
s
SD
0.105699
s
p50
0.232013
s
<
p95
0.454944
s
≤
p99
0.454944
s
Zome call duration: 'transactor::create_proposal'
Duration of this zome call as measured by Holochain internally.
mean
0.193318
s
SD
0.09868
s
p50
0.174858
s
<
p95
0.458313
s
<
p99
0.597968
s
Zome call duration: 'transactor::create_reclaim_balance'
Duration of this zome call as measured by Holochain internally.
mean
0.135409
s
SD
0.036536
s
p50
0.114418
s
<
p95
0.180458
s
<
p99
0.202668
s
Zome call duration: 'transactor::create_reject_proposal'
Duration of this zome call as measured by Holochain internally.
mean
0.103454
s
SD
0.0659
s
p50
0.105553
s
<
p95
0.206018
s
<
p99
0.496636
s
Zome call duration: 'transactor::create_smart_agreement'
Duration of this zome call as measured by Holochain internally.
mean
0.012554
s
SD
0
s
p50
0.012554
s
≤
p95
0.012554
s
≤
p99
0.012554
s
Zome call duration: 'transactor::get_actionable_transactions'
Duration of this zome call as measured by Holochain internally.
mean
0.05531
s
SD
0.022693
s
p50
0.044805
s
<
p95
0.097336
s
<
p99
0.115027
s
Zome call duration: 'transactor::get_code_templates_lib'
Duration of this zome call as measured by Holochain internally.
mean
0.046946
s
SD
0.026257
s
p50
0.037058
s
<
p95
0.079761
s
<
p99
0.158897
s
Zome call duration: 'transactor::get_current_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.012369
s
SD
0.006258
s
p50
0.008933
s
<
p95
0.022403
s
<
p99
0.032108
s
Zome call duration: 'transactor::get_history'
Duration of this zome call as measured by Holochain internally.
mean
0.118968
s
SD
0.05061
s
p50
0.09884
s
<
p95
0.207573
s
<
p99
0.302343
s
Zome call duration: 'transactor::get_ledger'
Duration of this zome call as measured by Holochain internally.
mean
0.046185
s
SD
0.027171
s
p50
0.050129
s
<
p95
0.108946
s
<
p99
0.175366
s
Zome call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of this zome call as measured by Holochain internally.
mean
0.040811
s
SD
0.019314
s
p50
0.037117
s
<
p95
0.065203
s
<
p99
0.130344
s
Zome call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.010967
s
SD
0.003754
s
p50
0.00757
s
<
p95
0.016007
s
<
p99
0.021515
s
Zome call duration: 'transactor::get_status'
Duration of this zome call as measured by Holochain internally.
mean
0.790456
s
SD
1.262212
s
p50
1.051222
s
<
p95
3.875475
s
<
p99
6.875873
s
Zome call duration: 'transactor::initialize_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.044888
s
SD
0
s
p50
0.044888
s
≤
p95
0.044888
s
≤
p99
0.044888
s
Zome call duration: 'transactor::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.012429
s
SD
0.005866
s
p50
0.011874
s
<
p95
0.020702
s
<
p99
0.037863
s
WASM call duration: 'transactor::create_accept'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.257189
s
SD
0.128805
s
p50
0.249045
s
<
p95
0.480775
s
≤
p99
0.480775
s
WASM call duration: 'transactor::create_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.013948
s
SD
0.006313
s
p50
0.012115
s
<
p95
0.026211
s
<
p99
0.029508
s
WASM call duration: 'transactor::create_commit_to_proposal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.230956
s
SD
0.125837
s
p50
0.229818
s
<
p95
0.456205
s
<
p99
0.820323
s
WASM call duration: 'transactor::create_counter_proposal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.220247
s
SD
0.105411
s
p50
0.230087
s
<
p95
0.453795
s
≤
p99
0.453795
s
WASM call duration: 'transactor::create_proposal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.191747
s
SD
0.098243
s
p50
0.173617
s
<
p95
0.455417
s
<
p99
0.594723
s
WASM call duration: 'transactor::create_reclaim_balance'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.134208
s
SD
0.036475
s
p50
0.113088
s
<
p95
0.179291
s
<
p99
0.2014
s
WASM call duration: 'transactor::create_reject_proposal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.102215
s
SD
0.065698
s
p50
0.103869
s
<
p95
0.20459
s
<
p99
0.494825
s
WASM call duration: 'transactor::create_smart_agreement'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.011149
s
SD
0
s
p50
0.011149
s
≤
p95
0.011149
s
≤
p99
0.011149
s
WASM call duration: 'transactor::get_actionable_transactions'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.054007
s
SD
0.022614
s
p50
0.043442
s
<
p95
0.096132
s
<
p99
0.113836
s
WASM call duration: 'transactor::get_code_templates_lib'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.045583
s
SD
0.026017
s
p50
0.035939
s
<
p95
0.077937
s
<
p99
0.156405
s
WASM call duration: 'transactor::get_current_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.008002
s
SD
0.005109
s
p50
0.008484
s
<
p95
0.014356
s
<
p99
0.030541
s
WASM call duration: 'transactor::get_history'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.117714
s
SD
0.050381
s
p50
0.097752
s
<
p95
0.206282
s
<
p99
0.299454
s
WASM call duration: 'transactor::get_ledger'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.04492
s
SD
0.026821
s
p50
0.048899
s
<
p95
0.107432
s
<
p99
0.172091
s
WASM call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.039525
s
SD
0.018926
s
p50
0.03578
s
<
p95
0.063558
s
<
p99
0.127273
s
WASM call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.009393
s
SD
0.003534
s
p50
0.006487
s
<
p95
0.013853
s
<
p99
0.020109
s
WASM call duration: 'transactor::get_status'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.789289
s
SD
1.262212
s
p50
1.049497
s
<
p95
3.874667
s
<
p99
6.875145
s
WASM call duration: 'transactor::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.019961
s
SD
0.007771
s
p50
0.017813
s
<
p95
0.035607
s
<
p99
0.047364
s
WASM call duration: 'transactor::initialize_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.043799
s
SD
0
s
p50
0.043799
s
≤
p95
0.043799
s
≤
p99
0.043799
s
WASM call duration: 'transactor::post_commit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.045043
s
SD
0.023416
s
p50
0.032537
s
<
p95
0.069243
s
<
p99
0.12981
s
WASM call duration: 'transactor::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.011013
s
SD
0.005449
s
p50
0.010369
s
<
p95
0.01912
s
<
p99
0.034602
s
WASM call duration: 'transactor_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00142
s
SD
0.000628
s
p50
0.001579
s
<
p95
0.003023
s
<
p99
0.003994
s
WASM call duration: 'transactor_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001562
s
SD
0.000707
s
p50
0.001363
s
<
p95
0.003111
s
<
p99
0.00335
s
WASM call duration: 'transactor_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.019799
s
SD
0.076228
s
p50
0.01527
s
<
p95
0.227441
s
<
p99
0.319121
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
1.4e-05
s
SD
2.4e-05
s
p50
1.2e-05
s
<
p95
2e-05
s
<
p99
8.7e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000463
s
SD
0.000317
s
p50
0.000308
s
<
p95
0.001023
s
<
p99
0.001918
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000445
s
SD
0.000266
s
p50
0.000331
s
<
p95
0.000876
s
<
p99
0.001488
s
Host function call duration: '__hc__delete_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000767
s
SD
0.000672
s
p50
0.000664
s
<
p95
0.001827
s
<
p99
0.004402
s
Host function call duration: '__hc__dna_info_2'
Duration of this host function call invoked from within WASM.
mean
6e-06
s
SD
7e-06
s
p50
3e-06
s
<
p95
8e-06
s
<
p99
2.9e-05
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
5.1e-05
s
SD
4.5e-05
s
p50
3.4e-05
s
<
p95
0.000141
s
<
p99
0.000233
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000754
s
SD
0.00043
s
p50
0.000482
s
<
p95
0.001451
s
<
p99
0.002158
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.042532
s
SD
0.295183
s
p50
0.027698
s
<
p95
0.772071
s
<
p99
1.564327
s
Host function call duration: '__hc__get_details_1'
Duration of this host function call invoked from within WASM.
mean
0.003905
s
SD
0.002609
s
p50
0.002749
s
<
p95
0.007655
s
<
p99
0.01436
s
Host function call duration: '__hc__get_init_properties_1'
Duration of this host function call invoked from within WASM.
mean
0.001301
s
SD
0.001552
s
p50
0.000785
s
<
p95
0.006481
s
<
p99
0.006575
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.001562
s
SD
0.000975
s
p50
0.001049
s
<
p95
0.003284
s
<
p99
0.004763
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.010739
s
SD
0.005259
s
p50
0.009181
s
<
p95
0.017909
s
<
p99
0.029327
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.0022
s
SD
0.002267
s
p50
0.002777
s
<
p95
0.008571
s
<
p99
0.011064
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.012122
s
SD
0.009822
s
p50
0.010864
s
<
p95
0.029476
s
<
p99
0.048489
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
5.7e-05
s
SD
3.4e-05
s
p50
3.7e-05
s
<
p95
0.000129
s
<
p99
0.000172
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
4e-06
s
SD
3e-06
s
p50
5e-06
s
<
p95
1.1e-05
s
<
p99
1.6e-05
s
Host function call duration: '__hc__trace_1'
Duration of this host function call invoked from within WASM.
mean
5.8e-05
s
SD
8.1e-05
s
p50
6.2e-05
s
<
p95
0.000146
s
<
p99
0.0005
s
Host function call duration: '__hc__update_1'
Duration of this host function call invoked from within WASM.
mean
0.00334
s
SD
0
s
p50
0.00334
s
≤
p95
0.00334
s
≤
p99
0.00334
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002489
s
SD
0.00141
s
p50
0.002718
s
<
p95
0.005902
s
<
p99
0.008078
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
192
over 727.745263355s
mean rate
636.98
/s
std
2305.8
/s
p5
1.28
/s
p95
3161.29
/s
peak
41247.53
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
286
over 721.440432984s
mean rate
8969.28
/s
std
36225.4
/s
p5
13.01
/s
p95
58027.52
/s
peak
748691.31
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.046619
s
SD
0.023764
s
p50
0.033885
s
<
p95
0.071084
s
<
p99
0.13348
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.16
s
<
mean
446.79
s
SD
256.63
s
<
p95
847.17
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
7004
over 884.749799543s
mean rate
69621.42
/s
std
433738.18
/s
p5
19.27
/s
p95
343447.87
/s
peak
1.325972735e+07
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
100.150627
s
SD
53.791986
s
p50
61.41427
s
<
p95
164.014719
s
<
p99
196.355676
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
4.82561
s
SD
5.643281
s
p50
4.23448
s
<
p95
14.717553
s
<
p99
26.475748
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.015367
s
SD
0.033981
s
p50
0.015813
s
<
p95
0.103732
s
<
p99
0.156724
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.054707
s
SD
0.032587
s
p50
0.034965
s
<
p95
0.097469
s
<
p99
0.172499
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.195335
s
SD
2.482595
s
p50
0.30249
s
<
p95
4.546381
s
<
p99
12.702375
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
6.041344
s
SD
7.852093
s
p50
3.459948
s
<
p95
15.417421
s
<
p99
41.438469
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000956
s
SD
0.000646
s
p50
0.000729
s
<
p95
0.00242
s
<
p99
0.002988
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.005276
s
SD
0.006427
s
p50
0.001382
s
<
p95
0.021141
s
<
p99
0.031401
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000389
s
SD
0.000157
s
p50
0.000402
s
<
p95
0.000623
s
<
p99
0.001104
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
1.035635
s
SD
29.486392
s
p50
0.949169
s
<
p95
60.001406
s
<
p99
60.002053
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.067956
s
SD
0.597376
s
p50
0.026591
s
<
p95
1.529091
s
<
p99
3.205577
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.32581
s
SD
20.835418
s
p50
0.422217
s
<
p95
60.001008
s
<
p99
60.0019
s
P2P received remote signals
Count of remote signals received.
total
192
over 727.745376028s
mean rate
944.42
/s
std
5294.73
/s
p5
1.28
/s
p95
3343.89
/s
peak
143217.38
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
40.17
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
4.17
KiB/s
<
mean
111.25
KiB/s
SD
343.07
KiB/s
<
p95
163.53
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
3.07
KiB/s
<
mean
80.92
KiB/s
SD
63.91
KiB/s
<
p95
192.68
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.54
GiB
mean
2.93
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.85
GiB
mean
2.13
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.1%

Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (17.6% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 18% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2.56
%
<
mean
52.4
%
SD
27.7
%
<
p95
95.55
%
System
12.23
%
CPU percentiles
CPU usage percentiles
p50
59.38
%
p95
95.55
%
p99
98.09
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
25
hosts
mean time
143.24
s
Memory used percentage
Percentage of memory used
p5
12.3
%
<
mean
25.05
%
SD
10.44
%
<
p95
43.79
%
Memory available percentage
Percentage of available memory
p5
56.21
%
<
mean
74.95
%
SD
10.44
%
<
p95
87.7
%
Max host memory used
Maximum memory usage percentage across all hosts
max
50.35
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
17.59
%
Memory growth rate
Rate of memory growth over time
growth
0.46
MiB/s
Disk read throughput
Disk read throughput in MiB/s
1.28
MiB/s
Disk write throughput
Disk write throughput in MiB/s
77.18
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/7
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/10
hosts
Mount Point /etc/hosts
0/10
hosts
Mount Point /etc/nomad.d/client-meta.json
0/11
hosts
Mount Point /etc/resolv.conf
0/10
hosts
Mount Point /nix/store
0/7
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.36
5 min
2.74
15 min
2.29
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
17.86
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
17.659
%
SD
20.0173
%
<
p95
66.38
%
60 second average
16.8916
%
300 second average
14.2648
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
5.3477
%
SD
10.3454
%
<
p95
28.41
%
60 second average
5.0753
%
300 second average
3.8981
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
2.1309
%
SD
4.2214
%
<
p95
11.03
%
60 second average
2.0647
%
300 second average
1.6756
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.98
%
<
mean
49.16
%
SD
27.8
%
<
p95
94.19
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
994.23
KiB
<
mean
1.10
MiB
SD
178.58
KiB
<
p95
1.28
MiB
Holochain process threads
Number of threads in Holochain process
p5
29
threads
<
mean
39.13
threads
SD
11.42
threads
<
p95
54
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
69
file descriptors
<
mean
79.99
file descriptors
SD
13.42
file descriptors
<
p95
95
file descriptors

Unyt Swap

↑ Back to index

This scenario exercises Unyt's bridging flow, converting an external blockchain token (HOT) into Unyt's internal wrapped credit (wHOT), and the follow-on wHOT → HF swap. The roles are: initiate (progenitor that bootstraps the network and lane), bridge_agent (oracle + bridging agent that drives deposits), bridge (depositor that collects the deposit RAVE to receive wHOT, then swaps that wHOT for HF), and swap_agent (HoloFuel counterparty that accepts swap commitments).

Started
Thu, 15 Oct 2026 20:48:09 UTC
Duration
900s
Peer count
30
Peer count at end
29
Behaviours
  • bridge_agent (1 agent)
  • initiate (1 agent)
  • swap_agent (1 agent)
  • user (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
unyt_swap_38767573742_1
Zome call — create_parked_link
Duration of the bridge agent's oracle step recording a proof of deposit, per agent.
Mean
mean
0.174068
s
SD
0.124816
s
Max
Highest per-partition mean latency
max mean
0.174068
s
Min
Lowest per-partition mean latency
min mean
0.174068
s
Zome call — create_parked_spend
Duration of the bridging agent's step parking the spend on the bridging agreement, per agent.
Mean
mean
6.240748
s
SD
5.896773
s
Max
Highest per-partition mean latency
max mean
6.240748
s
Min
Lowest per-partition mean latency
min mean
6.240748
s
Zome call — execute_rave
Duration of the bridging agent's step executing the credit-limit and bridging agreements into a deposit RAVE, per agent.
Mean
mean
3.724067
s
SD
4.672815
s
Max
Highest per-partition mean latency
max mean
3.724067
s
Min
Lowest per-partition mean latency
min mean
3.724067
s
Zome call — get_incoming_raves
Duration of the bridge's poll for incoming deposit RAVEs, per agent. Called every iteration.
Mean
mean
0.013735
s
SD
0.034029
s
Max
Highest per-partition mean latency
max mean
0.022127
s
Min
Lowest per-partition mean latency
min mean
0.006004
s
Zome call — create_collect_from_rave
Duration of the bridge's collect step receiving wHOT, per agent.
Mean
mean
1.002263
s
SD
0.379549
s
Max
Highest per-partition mean latency
max mean
2.386722
s
Min
Lowest per-partition mean latency
min mean
0.334747
s
Zome call — create_commitment
Duration of the bridge's commitment (wHOT -> HF), per agent.
Mean
mean
0.218316
s
SD
0.030594
s
Max
Highest per-partition mean latency
max mean
0.498064
s
Min
Lowest per-partition mean latency
min mean
0.096603
s
Zome call — create_accept
Duration of the swap agent accepting a commitment, per agent.
Mean
mean
0.493898
s
SD
0.185603
s
Max
Highest per-partition mean latency
max mean
0.493898
s
Min
Lowest per-partition mean latency
min mean
0.493898
s
Zome call — create_receipt_for_accept
Duration of the bridge finalizing an accepted commitment, per agent.
Mean
mean
0.190966
s
SD
0.017901
s
Max
Highest per-partition mean latency
max mean
0.351921
s
Min
Lowest per-partition mean latency
min mean
0.094814
s
Swap completion time
End-to-end time from the bridge creating a commitment to finalizing the accept with a receipt (wall-clock, includes propagation and poll gap), per agent.
Mean
mean
28.234156
s
SD
10.283543
s
Max
Highest per-partition mean latency
max mean
43.767509
s
Min
Lowest per-partition mean latency
min mean
15.152181
s
Zome call errors
Total number of zome call errors observed during the run.
2392
Proof-of-deposit links completed
Proof-of-deposit parked links the bridge agent completed across the run (deposit volume offered), as a per-agent counter.
Total
26
Agents affected
1 / 1
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
26
Max
Highest count in any single partition
26
Min
Lowest count in any single partition
26
Proof-of-deposit links failed
Proof-of-deposit parked links that failed across the run (deposit volume offered), as a per-agent counter.
Total
1
Agents affected
1 / 1
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
1
Max
Highest count in any single partition
1
Min
Lowest count in any single partition
1
Deposit RAVEs collected
Deposit RAVEs the bridge collected — completed HOT → wHOT conversions, as a per-agent counter.
Total
43
Agents affected
24 / 26
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
2
Max
Highest count in any single partition
2
Min
Lowest count in any single partition
0
Completed transaction RAVEs
Total RAVE agreement executions across all agents at teardown.
sum
193
mean
6.66
min
0
max
151
n
29
Swap commitments created
Swap commitments the bridge created (wHOT → HF offered), as a per-agent counter.
Total
19
Agents affected
19 / 24
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
1
Max
Highest count in any single partition
1
Min
Lowest count in any single partition
0
Commitments accepted
Swap commitments the swap agent accepted across the run, as a per-agent counter.
Total
42
Agents affected
1 / 1
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
42
Max
Highest count in any single partition
42
Min
Lowest count in any single partition
42
Swap receipts created
Receipts the bridge created for accepted commitments (completed wHOT → HF), as a per-agent counter.
Total
42
Agents affected
23 / 26
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
2
Max
Highest count in any single partition
2
Min
Lowest count in any single partition
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.001009
s
SD
0.002074
s
p50
0.000881
s
<
p95
0.003475
s
<
p99
0.009333
s
Zome call duration: 'transactor::create_accept'
Duration of this zome call as measured by Holochain internally.
mean
0.100732
s
SD
0.005766
s
p50
0.100129
s
<
p95
0.104652
s
<
p99
0.105055
s
Zome call duration: 'transactor::create_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.017931
s
SD
0.00858
s
p50
0.016276
s
<
p95
0.034343
s
<
p99
0.039165
s
Zome call duration: 'transactor::create_collect_from_rave'
Duration of this zome call as measured by Holochain internally.
mean
0.067758
s
SD
0.129389
s
p50
0.109377
s
<
p95
0.491863
s
<
p99
0.633436
s
Zome call duration: 'transactor::create_commitment'
Duration of this zome call as measured by Holochain internally.
mean
0.096139
s
SD
0.030645
s
p50
0.095083
s
<
p95
0.167738
s
<
p99
0.205602
s
Zome call duration: 'transactor::create_parked_link'
Duration of this zome call as measured by Holochain internally.
mean
0.036736
s
SD
0.006381
s
p50
0.035665
s
<
p95
0.042212
s
≤
p99
0.042212
s
Zome call duration: 'transactor::create_parked_spend'
Duration of this zome call as measured by Holochain internally.
mean
0.417741
s
SD
0.117848
s
p50
0.353443
s
<
p95
0.507131
s
<
p99
0.514757
s
Zome call duration: 'transactor::create_receipt_for_accept'
Duration of this zome call as measured by Holochain internally.
mean
0.061289
s
SD
0.016801
s
p50
0.063254
s
<
p95
0.098741
s
<
p99
0.121909
s
Zome call duration: 'transactor::create_smart_agreement'
Duration of this zome call as measured by Holochain internally.
mean
0.015786
s
SD
0
s
p50
0.015786
s
≤
p95
0.015786
s
≤
p99
0.015786
s
Zome call duration: 'transactor::execute_rave'
Duration of this zome call as measured by Holochain internally.
mean
0.197107
s
SD
0.04755
s
p50
0.192971
s
<
p95
0.264038
s
<
p99
0.264981
s
Zome call duration: 'transactor::get_actionable_transactions'
Duration of this zome call as measured by Holochain internally.
mean
0.013774
s
SD
0.005053
s
p50
0.014391
s
<
p95
0.025726
s
<
p99
0.030602
s
Zome call duration: 'transactor::get_all_lane'
Duration of this zome call as measured by Holochain internally.
mean
0.011201
s
SD
0.009985
s
p50
0.011195
s
<
p95
0.020044
s
<
p99
0.065961
s
Zome call duration: 'transactor::get_code_templates_lib'
Duration of this zome call as measured by Holochain internally.
mean
0.041343
s
SD
0.046431
s
p50
0.02692
s
<
p95
0.055332
s
<
p99
0.290197
s
Zome call duration: 'transactor::get_current_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.017884
s
SD
0.010243
s
p50
0.013679
s
<
p95
0.027719
s
<
p99
0.060331
s
Zome call duration: 'transactor::get_incoming_raves'
Duration of this zome call as measured by Holochain internally.
mean
0.005895
s
SD
0.001998
s
p50
0.006029
s
<
p95
0.010187
s
<
p99
0.013728
s
Zome call duration: 'transactor::get_ledger'
Duration of this zome call as measured by Holochain internally.
mean
0.029755
s
SD
0.010552
s
p50
0.029736
s
<
p95
0.053101
s
<
p99
0.073245
s
Zome call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.007289
s
SD
0.003549
s
p50
0.006692
s
<
p95
0.014451
s
<
p99
0.02013
s
Zome call duration: 'transactor::initialize_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.022243
s
SD
0
s
p50
0.022243
s
≤
p95
0.022243
s
≤
p99
0.022243
s
Zome call duration: 'transactor::initialize_lane'
Duration of this zome call as measured by Holochain internally.
mean
0.033805
s
SD
0
s
p50
0.033805
s
≤
p95
0.033805
s
≤
p99
0.033805
s
Zome call duration: 'transactor::progenitor_init_alpha_env'
Duration of this zome call as measured by Holochain internally.
mean
0.005939
s
SD
0
s
p50
0.005939
s
≤
p95
0.005939
s
≤
p99
0.005939
s
Zome call duration: 'transactor::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.01311
s
SD
0.005242
s
p50
0.011802
s
<
p95
0.022904
s
<
p99
0.029436
s
WASM call duration: 'transactor::create_accept'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.099884
s
SD
0.005772
s
p50
0.099284
s
<
p95
0.10381
s
<
p99
0.104213
s
WASM call duration: 'transactor::create_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.016013
s
SD
0.007848
s
p50
0.014546
s
<
p95
0.03067
s
<
p99
0.035133
s
WASM call duration: 'transactor::create_collect_from_rave'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.066683
s
SD
0.129256
s
p50
0.108187
s
<
p95
0.490167
s
<
p99
0.631931
s
WASM call duration: 'transactor::create_commitment'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.094856
s
SD
0.030346
s
p50
0.09373
s
<
p95
0.166015
s
<
p99
0.203688
s
WASM call duration: 'transactor::create_parked_link'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.034824
s
SD
0.006305
s
p50
0.033795
s
<
p95
0.040188
s
≤
p99
0.040188
s
WASM call duration: 'transactor::create_parked_spend'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.416074
s
SD
0.117795
s
p50
0.351809
s
<
p95
0.505432
s
<
p99
0.513065
s
WASM call duration: 'transactor::create_receipt_for_accept'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.060132
s
SD
0.016585
s
p50
0.062158
s
<
p95
0.096963
s
<
p99
0.120264
s
WASM call duration: 'transactor::create_smart_agreement'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.01448
s
SD
0
s
p50
0.01448
s
≤
p95
0.01448
s
≤
p99
0.01448
s
WASM call duration: 'transactor::execute_rave'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.195351
s
SD
0.04753
s
p50
0.191199
s
<
p95
0.26228
s
<
p99
0.263227
s
WASM call duration: 'transactor::get_actionable_transactions'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.012675
s
SD
0.004686
s
p50
0.0132
s
<
p95
0.02383
s
<
p99
0.028174
s
WASM call duration: 'transactor::get_all_lane'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.009749
s
SD
0.009917
s
p50
0.00997
s
<
p95
0.017854
s
<
p99
0.064803
s
WASM call duration: 'transactor::get_code_templates_lib'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.039811
s
SD
0.046337
s
p50
0.025057
s
<
p95
0.053695
s
<
p99
0.289001
s
WASM call duration: 'transactor::get_current_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.009694
s
SD
0.00412
s
p50
0.008852
s
<
p95
0.01616
s
<
p99
0.022047
s
WASM call duration: 'transactor::get_incoming_raves'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004742
s
SD
0.001666
s
p50
0.004864
s
<
p95
0.008403
s
<
p99
0.010885
s
WASM call duration: 'transactor::get_ledger'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.028587
s
SD
0.010186
s
p50
0.028583
s
<
p95
0.051161
s
<
p99
0.070419
s
WASM call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006019
s
SD
0.002981
s
p50
0.005493
s
<
p95
0.012076
s
<
p99
0.016675
s
WASM call duration: 'transactor::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.021343
s
SD
0.00926
s
p50
0.018194
s
<
p95
0.046837
s
<
p99
0.047196
s
WASM call duration: 'transactor::initialize_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.021078
s
SD
0
s
p50
0.021078
s
≤
p95
0.021078
s
≤
p99
0.021078
s
WASM call duration: 'transactor::initialize_lane'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.032639
s
SD
0
s
p50
0.032639
s
≤
p95
0.032639
s
≤
p99
0.032639
s
WASM call duration: 'transactor::post_commit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.038691
s
SD
0.011394
s
p50
0.015296
s
<
p95
0.03406
s
<
p99
0.0716
s
WASM call duration: 'transactor::progenitor_init_alpha_env'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00488
s
SD
0
s
p50
0.00488
s
≤
p95
0.00488
s
≤
p99
0.00488
s
WASM call duration: 'transactor::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.01178
s
SD
0.00501
s
p50
0.010392
s
<
p95
0.021359
s
<
p99
0.027489
s
WASM call duration: 'transactor_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001349
s
SD
0.000803
s
p50
0.001445
s
<
p95
0.003353
s
<
p99
0.004686
s
WASM call duration: 'transactor_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00149
s
SD
0.000613
s
p50
0.001308
s
<
p95
0.002754
s
<
p99
0.003159
s
WASM call duration: 'transactor_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.025896
s
SD
0.029624
s
p50
0.018452
s
<
p95
0.056335
s
<
p99
0.156745
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
1.1e-05
s
SD
8e-06
s
p50
1.1e-05
s
<
p95
2.4e-05
s
<
p99
3.3e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000291
s
SD
0.000161
s
p50
0.000268
s
<
p95
0.000657
s
<
p99
0.000866
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000418
s
SD
0.000267
s
p50
0.000301
s
<
p95
0.000956
s
<
p99
0.00166
s
Host function call duration: '__hc__delete_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000511
s
SD
0.000297
s
p50
0.000442
s
<
p95
0.001041
s
<
p99
0.001807
s
Host function call duration: '__hc__dna_info_2'
Duration of this host function call invoked from within WASM.
mean
6e-06
s
SD
1.6e-05
s
p50
3e-06
s
<
p95
8e-06
s
<
p99
3.8e-05
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
8.6e-05
s
SD
4.6e-05
s
p50
3.8e-05
s
<
p95
0.000158
s
<
p99
0.000233
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000266
s
SD
0.000259
s
p50
0.000253
s
<
p95
0.000892
s
<
p99
0.001807
s
Host function call duration: '__hc__get_details_1'
Duration of this host function call invoked from within WASM.
mean
0.00125
s
SD
0.003891
s
p50
0.001301
s
<
p95
0.004
s
<
p99
0.023768
s
Host function call duration: '__hc__get_init_properties_1'
Duration of this host function call invoked from within WASM.
mean
0.001968
s
SD
0.005242
s
p50
0.00076
s
<
p95
0.003336
s
<
p99
0.028949
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000426
s
SD
0.000563
s
p50
0.000494
s
<
p95
0.001694
s
<
p99
0.003516
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.003379
s
SD
0.002802
s
p50
0.003503
s
<
p95
0.009353
s
<
p99
0.018578
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.001125
s
SD
0.001465
s
p50
0.001221
s
<
p95
0.004405
s
<
p99
0.009392
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.001445
s
SD
0.001969
s
p50
0.001599
s
<
p95
0.004277
s
<
p99
0.012766
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
4.5e-05
s
SD
5.2e-05
s
p50
2.2e-05
s
<
p95
0.000159
s
<
p99
0.000297
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
5e-06
s
SD
7e-06
s
p50
5e-06
s
<
p95
1.1e-05
s
<
p99
1.7e-05
s
Host function call duration: '__hc__trace_1'
Duration of this host function call invoked from within WASM.
mean
5.6e-05
s
SD
0.000391
s
p50
6.1e-05
s
<
p95
0.000139
s
<
p99
0.001114
s
Host function call duration: '__hc__update_1'
Duration of this host function call invoked from within WASM.
mean
0.001026
s
SD
0
s
p50
0.001026
s
≤
p95
0.001026
s
≤
p99
0.001026
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002313
s
SD
0.001401
s
p50
0.002523
s
<
p95
0.006061
s
<
p99
0.007679
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.040254
s
SD
0.011619
s
p50
0.016489
s
<
p95
0.0356
s
<
p99
0.073346
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.95
s
<
mean
444.26
s
SD
255.53
s
<
p95
844.08
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
4056
over 882.074153307s
mean rate
3044.44
/s
std
8695.38
/s
p5
0
/s
p95
16452.06
/s
peak
100608.75
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
18.818914
s
SD
14.652957
s
p50
12.777031
s
<
p95
36.949796
s
<
p99
88.060448
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
2.117159
s
SD
2.126315
s
p50
1.887773
s
<
p95
5.496856
s
<
p99
12.528366
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.00816
s
SD
0.028143
s
p50
0.009734
s
<
p95
0.0751
s
<
p99
0.132894
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.019575
s
SD
0.008668
s
p50
0.010768
s
<
p95
0.026778
s
<
p99
0.047721
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.327557
s
SD
2.774433
s
p50
0.44054
s
<
p95
7.988953
s
<
p99
11.582758
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
3.614623
s
SD
7.455744
s
p50
2.631221
s
<
p95
21.11709
s
<
p99
30.269095
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.00025
s
SD
0.000107
s
p50
0.000245
s
<
p95
0.000519
s
<
p99
0.000578
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.004461
s
SD
0.005799
s
p50
0.001216
s
<
p95
0.016356
s
<
p99
0.031414
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000285
s
SD
0.000115
s
p50
0.000286
s
<
p95
0.000537
s
<
p99
0.000618
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.131947
s
SD
28.318753
s
p50
0.109864
s
<
p95
60.001428
s
<
p99
60.001661
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.236207
s
SD
0.120318
s
p50
0.175721
s
<
p95
0.445387
s
<
p99
0.48557
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
23.50
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
4.35
KiB/s
<
mean
58.71
KiB/s
SD
447.13
KiB/s
<
p95
60.05
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
3.57
KiB/s
<
mean
18.72
KiB/s
SD
29.12
KiB/s
<
p95
54.27
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.34
GiB
mean
1.54
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
436.88
MiB
mean
502.66
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 99.3%

Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (17.6% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 18% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2.62
%
<
mean
36.39
%
SD
24.26
%
<
p95
87.28
%
System
12.89
%
CPU percentiles
CPU usage percentiles
p50
32.55
%
p95
87.28
%
p99
99.30
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
25
hosts
mean time
62.04
s
Memory used percentage
Percentage of memory used
p5
12.66
%
<
mean
25.77
%
SD
10.89
%
<
p95
43.12
%
Memory available percentage
Percentage of available memory
p5
56.88
%
<
mean
74.23
%
SD
10.89
%
<
p95
87.34
%
Max host memory used
Maximum memory usage percentage across all hosts
max
53.61
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
17.59
%
Memory growth rate
Rate of memory growth over time
growth
0.38
MiB/s
Disk read throughput
Disk read throughput in MiB/s
1.26
MiB/s
Disk write throughput
Disk write throughput in MiB/s
79.09
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/7
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/10
hosts
Mount Point /etc/hosts
0/10
hosts
Mount Point /etc/nomad.d/client-meta.json
0/11
hosts
Mount Point /etc/resolv.conf
0/10
hosts
Mount Point /nix/store
0/7
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.25
5 min
2.72
15 min
2.75
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
17.86
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
9.2858
%
SD
17.2802
%
<
p95
51.53
%
60 second average
9.8957
%
300 second average
12.7596
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0007
%
SD
0.0107
%
≤
p95
0
%
60 second average
0.0005
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0005
%
SD
0.0078
%
≤
p95
0
%
60 second average
0.0004
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
3.659
%
SD
8.7021
%
<
p95
26.19
%
60 second average
3.8693
%
300 second average
4.4496
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
2.7747
%
SD
6.5535
%
<
p95
18.07
%
60 second average
2.7756
%
300 second average
2.5773
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.95
%
<
mean
31.01
%
SD
22.32
%
<
p95
76.04
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
856.05
KiB
<
mean
1.07
MiB
SD
213.68
KiB
<
p95
1.26
MiB
Holochain process threads
Number of threads in Holochain process
p5
29
threads
<
mean
38.01
threads
SD
10.86
threads
<
p95
54
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
69
file descriptors
<
mean
78.7
file descriptors
SD
13.06
file descriptors
<
p95
95
file descriptors

Validation Receipts

↑ Back to index

Creates an entry, wait for required validation receipts, then repeat. Records the amount of time it took to accumulate the required number of receipts for all DHT operations. This is measured to the nearest 20ms so that we don't keep the agent too busy checking for receipts.

Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

By default, this scenario will wait for a complete set of validation receipts before committing the next record. If the NO_VALIDATION_COMPLETE environment variable is set, it will instead publish new records on every round, building up an ever-growing list of action hashes to check on.

Started
Thu, 15 Oct 2026 16:42:27 UTC
Duration
900s
Peer count
20
Behaviours
  • default (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
validation_receipts_38767573742_1
Receipts complete timing
The amount of time between publishing a record and receiving the required number of validation receipts.
Mean
mean
5.325203
s
SD
0.941416
s
Max
Highest per-partition mean latency
max mean
5.676754
s
Min
Lowest per-partition mean latency
min mean
5.166189
s
Receipts complete rate
The number of complete validation receipt sets collected per second.
Mean
mean
1.84
/s
Max
Highest per-partition mean rate
max
1.9
/s
Min
Lowest per-partition mean rate
min
1.74
/s
Error count
The total number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
5284570
over 888.212767641s
mean rate
9.88970023e+06
/s
std
3.525412105e+07
/s
p5
0
/s
p95
2.305999337e+07
/s
peak
2.2378131646e+08
/s
WASM usage: 'crud::get_sample_entry_validation_receipts'
Metered usage count of the WASM ribosome for this zome function.
total
16889216
over 888.212767641s
mean rate
3.207050194e+07
/s
std
9.41220623e+07
/s
p5
0
/s
p95
2.6034678993e+08
/s
peak
7.5981857199e+08
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 888.212767641s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
682620
over 888.212767641s
mean rate
1.27526061e+06
/s
std
4.54452334e+06
/s
p5
0
/s
p95
2.97871211e+06
/s
peak
2.890634474e+07
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005969
s
SD
0.002033
s
p50
0.005069
s
<
p95
0.009988
s
<
p99
0.010375
s
Zome call duration: 'crud::get_sample_entry_validation_receipts'
Duration of this zome call as measured by Holochain internally.
mean
0.021702
s
SD
0.01454
s
p50
0.008017
s
<
p95
0.040695
s
<
p99
0.060126
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005115
s
SD
0.001914
s
p50
0.004411
s
<
p95
0.009531
s
≤
p99
0.009531
s
WASM call duration: 'crud::get_sample_entry_validation_receipts'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.020754
s
SD
0.014267
s
p50
0.007039
s
<
p95
0.039411
s
<
p99
0.058576
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001853
s
SD
0.000798
s
p50
0.00154
s
<
p95
0.003566
s
<
p99
0.00359
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001723
s
SD
0.000643
s
p50
0.001396
s
<
p95
0.003127
s
≤
p99
0.003127
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000542
s
SD
0.000258
s
p50
0.000376
s
<
p95
0.00111
s
<
p99
0.001134
s
Host function call duration: '__hc__get_validation_receipts_1'
Duration of this host function call invoked from within WASM.
mean
0.018768
s
SD
0.013569
s
p50
0.005241
s
<
p95
0.036411
s
<
p99
0.054426
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002757
s
SD
0.001412
s
p50
0.002353
s
<
p95
0.007235
s
≤
p99
0.007235
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000231
s
SD
8.9e-05
s
p50
0.000175
s
<
p95
0.000321
s
<
p99
0.000356
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.65
s
<
mean
443.52
s
SD
255.4
s
<
p95
841.95
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
5487
over 888.212748248s
mean rate
2538.82
/s
std
17297.18
/s
p5
0
/s
p95
3995.19
/s
peak
241806.11
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
1.430681
s
SD
1.93461
s
p50
1.342935
s
<
p95
5.687193
s
<
p99
9.782107
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.004
s
SD
0.009788
s
p50
0.001824
s
<
p95
0.024538
s
<
p99
0.044614
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.031472
s
SD
0.026043
s
p50
0.041345
s
<
p95
0.074854
s
<
p99
0.134742
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.046125
s
SD
0.024258
s
p50
0.013247
s
<
p95
0.077144
s
<
p99
0.088413
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.037691
s
SD
1.067228
s
p50
0.043226
s
<
p95
0.779093
s
<
p99
7.386499
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
1.020404
s
SD
7.137436
s
p50
2.13309
s
<
p95
19.71812
s
<
p99
29.265992
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000707
s
SD
0.000415
s
p50
0.000393
s
<
p95
0.001467
s
<
p99
0.00177
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.006146
s
SD
0.008925
s
p50
0.001363
s
<
p95
0.029476
s
<
p99
0.032565
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000279
s
SD
0.000111
s
p50
0.000251
s
<
p95
0.000518
s
<
p99
0.000606
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.138039
s
SD
11.865063
s
p50
0.068588
s
<
p95
0.278267
s
<
p99
60.001441
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.146917
s
SD
0.040369
s
p50
0.12663
s
<
p95
0.213113
s
<
p99
0.220871
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
64.38
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
0
B/s
<
mean
732.95
KiB/s
SD
419.02
KiB/s
<
p95
1.48
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
0
B/s
<
mean
616.98
KiB/s
SD
487.69
KiB/s
<
p95
1.39
MiB/s
Total bytes received
Total bytes received on primary network interface
count
11.77
GiB
mean
13.54
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
9.91
GiB
mean
11.40
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.0%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1.10 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 65% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
18.56
%
<
mean
75.32
%
SD
23.07
%
<
p95
97.35
%
System
10.94
%
CPU percentiles
CPU usage percentiles
p50
79.87
%
p95
97.35
%
p99
97.95
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
16
hosts
mean time
561.58
s
Memory used percentage
Percentage of memory used
p5
7.02
%
<
mean
17.37
%
SD
8.14
%
<
p95
44.15
%
Memory available percentage
Percentage of available memory
p5
55.85
%
<
mean
82.63
%
SD
8.14
%
<
p95
92.98
%
Max host memory used
Maximum memory usage percentage across all hosts
max
45.76
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
8.61
%
Memory growth rate
Rate of memory growth over time
growth
1.10
MiB/s
Disk read throughput
Disk read throughput in MiB/s
2.55
MiB/s
Disk write throughput
Disk write throughput in MiB/s
129.73
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/7
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/4
hosts
Mount Point /etc/hosts
0/4
hosts
Mount Point /etc/nomad.d/client-meta.json
0/10
hosts
Mount Point /etc/resolv.conf
0/4
hosts
Mount Point /nix/store
0/7
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
6.94
5 min
5.59
15 min
3.45
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
65.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
37.1516
%
SD
24.2167
%
<
p95
72.1
%
60 second average
36.1857
%
300 second average
28.4104
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
12.1994
%
SD
21.3198
%
<
p95
59.58
%
60 second average
11.8842
%
300 second average
11.2514
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
3.0704
%
SD
6.1691
%
<
p95
17.52
%
60 second average
3.1425
%
300 second average
4.4407
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.24
%
<
mean
5.75
%
SD
6.81
%
<
p95
14.68
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
232.66
KiB
<
mean
280.40
KiB
SD
59.47
KiB
<
p95
412.34
KiB
Holochain process threads
Number of threads in Holochain process
p5
28
threads
<
mean
39.44
threads
SD
19.04
threads
<
p95
75
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
67
file descriptors
<
mean
80.15
file descriptors
SD
16.37
file descriptors
<
p95
112
file descriptors

Write/get_agent_activity

↑ Back to index

A scenario where write peers write entries, while get_agent_activity peers each query a single write agent's activity with get_agent_activity.

Before a target write peer and the requesting get_agent_activity peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started
Thu, 15 Oct 2026 17:10:49 UTC
Duration
900s
Peer count
30
Peer count at end
27
Behaviours
  • get_agent_activity (1 agent)
  • write (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
write_get_agent_activity_38767573742_1
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
2430
Max
Highest chain head value observed for any single write agent.
2836
Write agents observed
6
get_agent_activity_full zome call timing
The time taken to call the zome function that retrieves information on a write peer's source chain.
Mean
mean
0.181011
s
SD
0.112071
s
Max
Highest per-partition mean latency
max mean
0.292665
s
Min
Lowest per-partition mean latency
min mean
0.073183
s
Error count
The number of errors accumulated.
54
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.044492
s
SD
0.142611
s
p50
0.016962
s
<
p95
0.451107
s
<
p99
0.530627
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 110.000969823s
Not enough time data to show a trend.
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.005726
s
SD
0.00175
s
p50
0.005714
s
<
p95
0.00821
s
≤
p99
0.00821
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006329
s
SD
0.002454
s
p50
0.006273
s
<
p95
0.013139
s
<
p99
0.013228
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.087282
s
SD
0.125665
s
p50
0.099477
s
<
p95
0.334749
s
<
p99
0.610681
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.002931
s
SD
0.148264
s
p50
0.00343
s
<
p95
0.533014
s
≤
p99
0.533014
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004854
s
SD
0.001528
s
p50
0.00486
s
<
p95
0.007065
s
≤
p99
0.007065
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005469
s
SD
0.002277
s
p50
0.005574
s
<
p95
0.01178
s
<
p99
0.011875
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.086818
s
SD
0.125662
s
p50
0.098939
s
<
p95
0.334161
s
<
p99
0.610088
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002433
s
SD
0.148168
s
p50
0.002916
s
<
p95
0.532433
s
≤
p99
0.532433
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001122
s
SD
0.000673
s
p50
0.001088
s
<
p95
0.002398
s
<
p99
0.00378
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.6e-05
s
SD
1.3e-05
s
p50
3.6e-05
s
<
p95
6.3e-05
s
≤
p99
6.3e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000834
s
SD
0.000531
s
p50
0.000803
s
<
p95
0.002238
s
<
p99
0.002319
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000441
s
SD
0.000131
s
p50
0.00047
s
<
p95
0.000654
s
≤
p99
0.000654
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.085403
s
SD
0.125484
s
p50
0.097742
s
<
p95
0.331417
s
<
p99
0.607849
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000241
s
SD
0.147972
s
p50
0.000283
s
<
p95
0.530663
s
≤
p99
0.530663
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
4e-06
s
SD
1.3e-05
s
p50
5e-06
s
<
p95
6.4e-05
s
≤
p99
6.4e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001739
s
SD
0.001108
s
p50
0.001791
s
<
p95
0.003864
s
<
p99
0.006509
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000223
s
SD
0.00011
s
p50
0.000113
s
<
p95
0.000331
s
<
p99
0.000605
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.98
s
<
mean
443.34
s
SD
255.15
s
<
p95
841.94
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
16974
over 889.343537557s
mean rate
230601.9
/s
std
3.33396032e+06
/s
p5
123.24
/s
p95
437726.7
/s
peak
1.2049403414e+08
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
271.859902
s
SD
187.894331
s
p50
45.155746
s
<
p95
517.402135
s
<
p99
609.274012
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.019993
s
SD
0.131368
s
p50
0.039211
s
<
p95
0.354251
s
<
p99
0.800313
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.432141
s
SD
0.415679
s
p50
0.993005
s
<
p95
1.168225
s
<
p99
1.302281
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.157315
s
SD
0.156762
s
p50
0.032703
s
<
p95
0.281719
s
<
p99
1.022867
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
2.730447
s
SD
21.865909
s
p50
4.548146
s
<
p95
63.179384
s
<
p99
107.028723
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
16.117537
s
SD
20.903681
s
p50
3.233027
s
<
p95
68.710618
s
<
p99
86.048909
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.00291
s
SD
0.00138
s
p50
0.002492
s
<
p95
0.004864
s
<
p99
0.006922
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003243
s
SD
0.004966
s
p50
0.001294
s
<
p95
0.016975
s
<
p99
0.024822
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000473
s
SD
0.000397
s
p50
0.000283
s
<
p95
0.001097
s
<
p99
0.002183
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
1.597259
s
SD
27.41228
s
p50
0.114668
s
<
p95
60.001652
s
<
p99
60.002281
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.021697
s
SD
0.143985
s
p50
0.264955
s
<
p95
0.447959
s
≤
p99
0.447959
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.064151
s
SD
29.338539
s
p50
0.120577
s
<
p95
60.001565
s
<
p99
60.001717
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.179771
s
SD
0.128742
s
p50
0.192469
s
<
p95
0.413005
s
<
p99
0.575293
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
48.90
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
77.69
KiB/s
<
mean
384.62
KiB/s
SD
398.13
KiB/s
<
p95
709.02
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
39.02
KiB/s
<
mean
355.58
KiB/s
SD
265.61
KiB/s
<
p95
797.64
KiB/s
Total bytes received
Total bytes received on primary network interface
count
9.07
GiB
mean
10.43
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
8.38
GiB
mean
9.64
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.5%

Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (17.6% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 52% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
15.09
%
<
mean
58.27
%
SD
28.36
%
<
p95
98.3
%
System
9.37
%
CPU percentiles
CPU usage percentiles
p50
56.33
%
p95
98.30
%
p99
98.55
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
17
hosts
mean time
441.90
s
Memory used percentage
Percentage of memory used
p5
6.46
%
<
mean
16.02
%
SD
8.03
%
<
p95
31.44
%
Memory available percentage
Percentage of available memory
p5
68.56
%
<
mean
83.98
%
SD
8.03
%
<
p95
93.54
%
Max host memory used
Maximum memory usage percentage across all hosts
max
36.84
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
17.59
%
Memory growth rate
Rate of memory growth over time
growth
0.99
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.18
MiB/s
Disk write throughput
Disk write throughput in MiB/s
122.34
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/7
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/10
hosts
Mount Point /etc/hosts
0/10
hosts
Mount Point /etc/nomad.d/client-meta.json
0/13
hosts
Mount Point /etc/resolv.conf
0/10
hosts
Mount Point /nix/store
0/7
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.30
5 min
4.83
15 min
5.21
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
51.72
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
24.8574
%
SD
30.5919
%
<
p95
87.61
%
60 second average
24.9544
%
300 second average
27.7014
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0001
%
SD
0.0029
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0001
%
SD
0.0029
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
6.2569
%
SD
12.1042
%
<
p95
33.49
%
60 second average
6.4200
%
300 second average
6.7070
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
2.1785
%
SD
6.4284
%
<
p95
12.14
%
60 second average
2.3356
%
300 second average
2.3000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
11.86
%
<
mean
55.24
%
SD
27.23
%
<
p95
96.75
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
267.54
KiB
<
mean
372.58
KiB
SD
135.36
KiB
<
p95
600.64
KiB
Holochain process threads
Number of threads in Holochain process
p5
29
threads
<
mean
40.35
threads
SD
22.01
threads
<
p95
80
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
71
file descriptors
<
mean
83.6
file descriptors
SD
23.18
file descriptors
<
p95
121
file descriptors

Write/get_agent_activity with volatile conductors

↑ Back to index

A scenario where write peers write entries, while get_agent_activity_volatile peers each query a single write agents activity with get_agent_activity but shutdown and restart their conductors at semi-random intervals.

Before a target write peer and the requesting get_agent_activity_volatile peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started
Thu, 15 Oct 2026 17:26:27 UTC
Duration
1800s
Peer count
30
Peer count at end
24
Behaviours
  • get_agent_activity_volatile (1 agent)
  • write (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
write_get_agent_activity_volatile_38767573742_1
Highest observed action_seq
The rate at which zero-arc readers observe new chain heads on the writers' chains via get_agent_activity. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.
Mean
mean
32.92
/s
Max
Highest per-partition mean rate
max
90.83
/s
Min
Lowest per-partition mean rate
min
12.89
/s
get_agent_activity_full zome call timing
The time taken to call the zome function that retrieves information on a write peer's source chain.
Mean
mean
0.279377
s
SD
1.046169
s
Max
Highest per-partition mean latency
max mean
0.561215
s
Min
Lowest per-partition mean latency
min mean
0.084843
s
Running volatile conductors count
The number of conductors running by get_agent_activity_volatile peers.
p5
11
conductors
<
mean
14.43
conductors
SD
2.17
conductors
<
p95
17
conductors
Volatile conductor total running duration
The total running duration of a get_agent_activity_volatile conductor.
Mean
mean
709.415074
s
SD
459.603376
s
Max
Highest per-partition mean latency
max mean
986.736842
s
Min
Lowest per-partition mean latency
min mean
472.035714
s
Volatile conductor running duration
The duration that a get_agent_activity_volatile conductor was running before being stopped.
Mean
mean
47.056733
s
SD
33.37881
s
Max
Highest per-partition mean latency
max mean
83.074261
s
Min
Lowest per-partition mean latency
min mean
26.813598
s
Volatile conductor stopped duration
The duration that a get_agent_activity_volatile conductor was stopped before being started again.
Mean
mean
44.647037
s
SD
41.618828
s
Max
Highest per-partition mean latency
max mean
78.957393
s
Min
Lowest per-partition mean latency
min mean
25.902143
s
Reached target arc
Did get_agent_activity_volatile peer reach their target arc in the moment before they were shutdown.
  • get_agent_activity_volatile_agent: uhCAk8C4ZOTU439M-174D2WWyJGc57zrpJGQ-kXqUe8Apq5__x2KY
p5
0
<
mean
0.11
SD
0.31
<
p95
1
  • get_agent_activity_volatile_agent: uhCAk8Mxrtm8yGSwVYgXF0RlImKUF7uKEfSmv0cXWbLhCtmlyqGZ7
p5
0
<
mean
0.12
SD
0.32
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkIXOczkfqYXrd6CHHO_kvm9tzIpFZ7mTio-RzC5juiv_NNYqQ
p5
0
<
mean
0.11
SD
0.31
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkKdAox6NUW5o1Vl6VrMenztH-fcG0O2-a3jMZ3zZjglAktj-K
p5
0
<
mean
0.13
SD
0.34
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkQ-KBpl_7q8pPOmslfxv_9wX2-8k1pm5jHSTa1XUOL-X5rOl-
p5
0
<
mean
0.07
SD
0.25
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkQ_fR66uKvpZ4MIrtVrWCLkunoByrahWr83ron74q87lIBcRs
p5
0
<
mean
0.13
SD
0.34
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkQmhREkP9OmBYNn1zaHGiaCaPbxYXtJ-U_PJJgXN8-pjl9Yr1
p5
0
<
mean
0.23
SD
0.42
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkVm_39OznpVcm_n67ZUZoIjD8QDjbTTkrqDEyznS5jc5NON2V
p5
0
<
mean
0.1
SD
0.3
<
p95
1
  • get_agent_activity_volatile_agent: uhCAk_K3EnSZHVic4yFJLagLd2-LaCBRRHRJ0NotfAy0XhaeUKq7C
p5
0
<
mean
0.08
SD
0.27
<
p95
1
  • get_agent_activity_volatile_agent: uhCAke9itRkImFPCfKXFDc7b7JGZX6CohqXU42F16JQp_vc-xAft9
p5
0
<
mean
0.19
SD
0.39
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkev20HSSUQKCdkRPKu8dUEYSGj1HOldKiolJOJ22AIkQ-DXhp
p5
0
<
mean
0.28
SD
0.45
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkgakqvSWtX5RapnRplPrvhnvlGzGtR1sx5eqkdL-qTPju8J3P
p5
0
<
mean
0.21
SD
0.41
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkjjw2TrPUinuTjiAsWn1lA4had1m3yfslQIg1HNApFFiZDUqr
p5
0
<
mean
0.08
SD
0.28
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkmGFZVnNG3xA15iF_RoRX4k4yhp7owdLn9ELZMyAJjHXnw1nS
p5
0
<
mean
0.19
SD
0.4
<
p95
1
  • get_agent_activity_volatile_agent: uhCAks1Olp2RJEL-Yk84CGguMTyMNX7PD4IpRqils8lq7iLpXUk2T
p5
0
<
mean
0.07
SD
0.25
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkt4dGv3LYQG3HhT7fi1qbg_fEU8Z3MrfhQPsQP4Y3BML9ysEF
p5
0
<
mean
0.06
SD
0.23
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkw60KEgjRL2fBBK6RiuMEP1UffslTmYFFnQsLz9sZ6AtMUFaS
p5
0
<
mean
0.09
SD
0.29
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkwLsYrDF9hvIBMeV9XWKW8kAEVNquYQAldQcTcyYD1Dyb7x4P
p5
0
<
mean
0.21
SD
0.41
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkzEhD7ODtmEVd_vDE4RNv0vzxgAHqrsUz3LUwWWw_IlW-BZvq
p5
0
<
mean
0.2
SD
0.4
<
p95
1
Error count
The number of errors accumulated.
187
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.136424
s
SD
23.596601
s
p50
0.501712
s
<
p95
12.615385
s
<
p99
153.650891
s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.005862
s
SD
0.002211
s
p50
0.00534
s
<
p95
0.009516
s
≤
p99
0.009516
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004435
s
SD
0.000853
s
p50
0.004362
s
<
p95
0.006125
s
<
p99
0.007933
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.229895
s
SD
3.230467
s
p50
0.515844
s
<
p95
2.193014
s
<
p99
29.211526
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.003047
s
SD
0.302749
s
p50
0.003444
s
<
p95
1.006824
s
<
p99
1.153031
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004873
s
SD
0.00185
s
p50
0.004605
s
<
p95
0.00819
s
≤
p99
0.00819
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003716
s
SD
0.000775
s
p50
0.003636
s
<
p95
0.005356
s
<
p99
0.0066
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.33248
s
SD
24.164516
s
p50
0.526409
s
<
p95
29.123116
s
<
p99
153.652536
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002557
s
SD
0.261345
s
p50
0.002848
s
<
p95
0.840613
s
<
p99
0.990379
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001219
s
SD
0.000285
s
p50
0.001206
s
<
p95
0.001808
s
<
p99
0.0022
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.2e-05
s
SD
1.4e-05
s
p50
3e-05
s
<
p95
6.4e-05
s
≤
p99
6.4e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000443
s
SD
0.000136
s
p50
0.0004
s
<
p95
0.000715
s
<
p99
0.000757
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000434
s
SD
0.000145
s
p50
0.000404
s
<
p95
0.000716
s
≤
p99
0.000716
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.329611
s
SD
24.165041
s
p50
0.524804
s
<
p95
29.11996
s
<
p99
153.6514
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000359
s
SD
0.261414
s
p50
0.000277
s
<
p95
0.83761
s
<
p99
0.987916
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
5e-06
s
SD
3e-06
s
p50
7e-06
s
<
p95
1e-05
s
<
p99
1.1e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001937
s
SD
0.000741
s
p50
0.001981
s
<
p95
0.004459
s
≤
p99
0.004459
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000136
s
SD
4.2e-05
s
p50
0.000128
s
<
p95
0.00025
s
<
p99
0.000267
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
4.04
s
<
mean
363.15
s
SD
520.55
s
<
p95
1548
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
305.895674
s
SD
299.946043
s
p50
75.213879
s
<
p95
882.384007
s
<
p99
1321.440691
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.051441
s
SD
0.279384
s
p50
0.009487
s
<
p95
0.377682
s
<
p99
1.660195
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.160381
s
SD
0.231577
s
p50
0.016913
s
<
p95
0.721882
s
<
p99
1.012337
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.268734
s
SD
0.435003
s
p50
0.100412
s
<
p95
1.608386
s
<
p99
2.125144
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
10.033988
s
SD
41.664872
s
p50
17.551811
s
<
p95
120.100132
s
<
p99
143.1654
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
87.010845
s
SD
89.688438
s
p50
3.098659
s
<
p95
238.995467
s
<
p99
287.275619
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.005335
s
SD
0.002352
s
p50
0.001823
s
<
p95
0.007862
s
<
p99
0.010385
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.006813
s
SD
0.064313
s
p50
0.001015
s
<
p95
0.031719
s
<
p99
0.176395
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000383
s
SD
0.000217
s
p50
0.000381
s
<
p95
0.000803
s
<
p99
0.001335
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
7.757823
s
SD
27.749
s
p50
1.308825
s
<
p95
60.001483
s
<
p99
60.002171
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.297315
s
SD
0.208491
s
p50
0.322773
s
<
p95
0.822936
s
≤
p99
0.822936
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.49766
s
SD
19.705915
s
p50
0.56337
s
<
p95
60.001306
s
<
p99
60.001995
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.499711
s
SD
18.105274
s
p50
0.688042
s
<
p95
51.041494
s
<
p99
60.001379
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
24.54
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.23
KiB/s
<
mean
102.00
KiB/s
SD
217.20
KiB/s
<
p95
286.55
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
1.60
KiB/s
<
mean
89.72
KiB/s
SD
152.85
KiB/s
<
p95
431.32
KiB/s
Total bytes received
Total bytes received on primary network interface
count
4.68
GiB
mean
2.68
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
4.12
GiB
mean
2.36
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.5%

Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (17.6% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 21% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.86
%
<
mean
30.97
%
SD
33.36
%
<
p95
97
%
System
6.43
%
CPU percentiles
CPU usage percentiles
p50
14.97
%
p95
97.00
%
p99
98.55
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
9
hosts
mean time
764.81
s
Memory used percentage
Percentage of memory used
p5
5.36
%
<
mean
14.9
%
SD
7.76
%
<
p95
29.81
%
Memory available percentage
Percentage of available memory
p5
70.19
%
<
mean
85.1
%
SD
7.76
%
<
p95
94.64
%
Max host memory used
Maximum memory usage percentage across all hosts
max
33.19
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
17.59
%
Memory growth rate
Rate of memory growth over time
growth
0.15
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
39.15
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/7
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/9
hosts
Mount Point /etc/hosts
0/9
hosts
Mount Point /etc/nomad.d/client-meta.json
0/12
hosts
Mount Point /etc/resolv.conf
0/9
hosts
Mount Point /nix/store
0/7
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.04
5 min
2.39
15 min
3.26
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
21.43
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
11.0196
%
SD
23.1251
%
<
p95
79.88
%
60 second average
11.2837
%
300 second average
13.3659
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
3.3562
%
SD
10.3977
%
<
p95
33.88
%
60 second average
3.5326
%
300 second average
4.0356
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
2.3342
%
SD
7.7877
%
<
p95
23.46
%
60 second average
2.4343
%
300 second average
2.4838
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
<
mean
26.75
%
SD
35.05
%
<
p95
96.47
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
59.55
KiB
<
mean
214.42
KiB
SD
123.23
KiB
<
p95
414.56
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
28.21
threads
SD
10.37
threads
<
p95
42
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
<
mean
69.86
file descriptors
SD
21.65
file descriptors
<
p95
95
file descriptors

Write/Query

↑ Back to index

Creates an entry, then queries the source chain and performs a simple operation on the entries, then repeats.

Started
Thu, 15 Oct 2026 16:29:26 UTC
Duration
300s
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
write_query_38767573742_1
Write timing
The time it takes to complete the zome function call that writes the entry.
mean
0.032206
s
SD
0.015672
s
p50
0.032164
s
<
p95
0.053906
s
<
p99
0.060897
s
Write rate
The number of writes completed per second.
mean
94.14
/s
Query timing
The time it takes to complete the chain_query_count_len zome call that queries the source chain.
mean
0.071361
s
SD
0.03927
s
p50
0.068548
s
<
p95
0.132112
s
<
p99
0.14769
s
Query rate
The number of chain queries completed per second.
mean
94.14
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::chain_query_count_len'
Metered usage count of the WASM ribosome for this zome function.
total
83767323774
over 280.009042733s
mean rate
2.9915907619e+08
/s
std
3.2240927e+07
/s
p5
2.3746855384e+08
/s
p95
3.2143932682e+08
/s
peak
3.2481547786e+08
/s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
91610578
over 280.009042733s
mean rate
327171.52
/s
std
199462.52
/s
p5
180696.82
/s
p95
726197.96
/s
peak
1.12850778e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.009042733s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
23667096
over 280.009042733s
mean rate
84522.99
/s
std
51469.27
/s
p5
46682.04
/s
p95
187609.31
/s
peak
291103.47
/s
Zome call duration: 'crud::chain_query_count_len'
Duration of this zome call as measured by Holochain internally.
mean
0.028707
s
SD
0.00909
s
p50
0.026244
s
<
p95
0.037245
s
<
p99
0.038004
s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.003324
s
SD
2.2e-05
s
p50
0.003328
s
<
p95
0.003346
s
<
p99
0.00335
s
WASM call duration: 'crud::chain_query_count_len'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.028083
s
SD
0.009059
s
p50
0.025626
s
<
p95
0.036595
s
<
p99
0.037352
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00279
s
SD
1.9e-05
s
p50
0.002796
s
<
p95
0.002822
s
≤
p99
0.002822
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002548
s
SD
0
s
p50
0.002548
s
≤
p95
0.002548
s
≤
p99
0.002548
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000999
s
SD
9e-06
s
p50
0.001
s
<
p95
0.001002
s
≤
p99
0.001002
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000261
s
SD
7.7e-05
s
p50
0.000413
s
≤
p95
0.000413
s
≤
p99
0.000413
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.010959
s
SD
0.003647
s
p50
0.010084
s
<
p95
0.014244
s
<
p99
0.014517
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001505
s
SD
4.5e-05
s
p50
0.001476
s
<
p95
0.001574
s
<
p99
0.00158
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000112
s
SD
4e-06
s
p50
0.000112
s
<
p95
0.000115
s
≤
p99
0.000115
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
16.79
s
<
mean
146.79
s
SD
83.67
s
<
p95
276.79
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.009048613s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001887
s
SD
0
s
p50
0.001887
s
≤
p95
0.001887
s
≤
p99
0.001887
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001696
s
SD
0.000144
s
p50
0.001697
s
<
p95
0.001747
s
<
p99
0.001755
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.025072
s
SD
0.008104
s
p50
0.023105
s
<
p95
0.032204
s
<
p99
0.032812
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.00266
s
SD
0
s
p50
0.00266
s
≤
p95
0.00266
s
≤
p99
0.00266
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001541
s
SD
0
s
p50
0.001541
s
≤
p95
0.001541
s
≤
p99
0.001541
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002326
s
SD
0.00078
s
p50
0.002162
s
<
p95
0.002994
s
<
p99
0.003048
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001086
s
SD
0.000199
s
p50
0.00142
s
≤
p95
0.00142
s
≤
p99
0.00142
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000232
s
SD
2e-06
s
p50
0.000232
s
<
p95
0.000234
s
<
p99
0.000237
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
54.12
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
10.61
KiB/s
<
mean
13.55
KiB/s
SD
2.38
KiB/s
<
p95
19.65
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
9.64
KiB/s
<
mean
14.43
KiB/s
SD
2.90
KiB/s
<
p95
19.10
KiB/s
Total bytes received
Total bytes received on primary network interface
count
3.84
MiB
mean
13.55
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
4.09
MiB
mean
14.43
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 100% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
66.17
%
<
mean
70.55
%
SD
2.41
%
<
p95
73.24
%
System
16.43
%
CPU percentiles
CPU usage percentiles
p50
70.86
%
p95
73.24
%
p99
76.98
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
27.23
%
<
mean
27.57
%
SD
0.19
%
<
p95
27.89
%
Memory available percentage
Percentage of available memory
p5
72.11
%
<
mean
72.43
%
SD
0.19
%
<
p95
72.77
%
Max host memory used
Maximum memory usage percentage across all hosts
max
27.57
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
0.08
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
2.22
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.74
5 min
5.07
15 min
2.78
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
100.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
14.71
%
<
mean
25.856
%
SD
4.4704
%
<
p95
30.2
%
60 second average
27.3237
%
300 second average
24.1817
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.557
%
SD
1.1154
%
<
p95
2.16
%
60 second average
0.7493
%
300 second average
0.9247
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.2327
%
SD
0.4302
%
<
p95
1.34
%
60 second average
0.3780
%
300 second average
0.5483
%
Holochain process CPU usage
CPU usage by Holochain process
p5
56.62
%
<
mean
61.44
%
SD
2.26
%
<
p95
63.54
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
244.13
KiB
<
mean
262.36
KiB
SD
8.92
KiB
<
p95
272.57
KiB
Holochain process threads
Number of threads in Holochain process
p5
24
threads
≤
mean
23.77
threads
SD
3.57
threads
<
p95
26
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
65
file descriptors
≤
mean
64.6
file descriptors
SD
7.98
file descriptors
<
p95
70
file descriptors

Write/Read

↑ Back to index

Creates an entry and reads it back, then repeats.

Started
Thu, 15 Oct 2026 16:31:08 UTC
Duration
300s
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
write_read_38767573742_1
Write timing
The time taken to write the entry.
mean
0.038572
s
SD
0.019806
s
p50
0.036844
s
<
p95
0.069364
s
<
p99
0.077879
s
Write rate
The number of writes completed per second.
mean
122.07
/s
Read timing
The time taken to read the entry.
mean
0.041076
s
SD
0.020815
s
p50
0.041114
s
<
p95
0.072749
s
<
p99
0.083801
s
Read rate
The number of reads completed per second.
mean
122.07
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000611
s
SD
7.1e-05
s
p50
0.00061
s
<
p95
0.000662
s
<
p99
0.000666
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
116499198
over 270.007583591s
mean rate
431466.96
/s
std
250009.93
/s
p5
248884.69
/s
p95
896665.62
/s
peak
1.42851074e+06
/s
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
114697331
over 270.007583591s
mean rate
424793.55
/s
std
245408.26
/s
p5
245096.01
/s
p95
886373.5
/s
peak
1.40056328e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 270.007583591s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
15048468
over 270.007583591s
mean rate
55733.57
/s
std
32294.36
/s
p5
32149.01
/s
p95
115824.35
/s
peak
184524
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.003203
s
SD
3.4e-05
s
p50
0.003201
s
<
p95
0.003214
s
<
p99
0.003216
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.002294
s
SD
0.000113
s
p50
0.00229
s
<
p95
0.002374
s
<
p99
0.002379
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00268
s
SD
2.5e-05
s
p50
0.002679
s
<
p95
0.002687
s
<
p99
0.002688
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00176
s
SD
0.000103
s
p50
0.001756
s
<
p95
0.001834
s
<
p99
0.001839
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002509
s
SD
0
s
p50
0.002509
s
≤
p95
0.002509
s
≤
p99
0.002509
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000924
s
SD
7e-06
s
p50
0.000924
s
<
p95
0.000926
s
≤
p99
0.000926
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000251
s
SD
0.000123
s
p50
0.000495
s
≤
p95
0.000495
s
≤
p99
0.000495
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000643
s
SD
7.2e-05
s
p50
0.000642
s
<
p95
0.000695
s
<
p99
0.000699
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001398
s
SD
1.4e-05
s
p50
0.001398
s
<
p95
0.001404
s
≤
p99
0.001404
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000107
s
SD
7e-06
s
p50
0.000106
s
<
p95
0.00011
s
<
p99
0.000112
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
16.86
s
<
mean
141.86
s
SD
80.78
s
<
p95
266.86
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 270.007584396s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000449
s
SD
0
s
p50
0.000449
s
≤
p95
0.000449
s
≤
p99
0.000449
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.0018
s
SD
0.000148
s
p50
0.001822
s
<
p95
0.001832
s
<
p99
0.001833
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.03042
s
SD
0.009996
s
p50
0.028661
s
<
p95
0.039059
s
<
p99
0.039835
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001347
s
SD
0
s
p50
0.001347
s
≤
p95
0.001347
s
≤
p99
0.001347
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.00052
s
SD
0
s
p50
0.00052
s
≤
p95
0.00052
s
≤
p99
0.00052
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002407
s
SD
0.000821
s
p50
0.002261
s
<
p95
0.003116
s
<
p99
0.003177
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001075
s
SD
0.000134
s
p50
0.000807
s
<
p95
0.001102
s
<
p99
0.001103
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000222
s
SD
2e-06
s
p50
0.000222
s
<
p95
0.000224
s
<
p99
0.000225
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
60.23
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
12.68
KiB/s
<
mean
202.72
KiB/s
SD
982.87
KiB/s
≤
p95
22.99
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
11.45
KiB/s
<
mean
19.06
KiB/s
SD
27.03
KiB/s
≤
p95
18.67
KiB/s
Total bytes received
Total bytes received on primary network interface
count
57.41
MiB
mean
202.72
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
5.40
MiB
mean
19.06
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
65.94
%
<
mean
74.02
%
SD
10.43
%
<
p95
79.18
%
System
13.80
%
CPU percentiles
CPU usage percentiles
p50
77.17
%
p95
79.18
%
p99
79.32
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
24.98
%
<
mean
25.38
%
SD
0.9
%
<
p95
26.65
%
Memory available percentage
Percentage of available memory
p5
73.35
%
<
mean
74.62
%
SD
0.9
%
<
p95
75.02
%
Max host memory used
Maximum memory usage percentage across all hosts
max
25.38
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-0.04
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
2.16
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.12
5 min
1.65
15 min
0.90
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
7.17
%
<
mean
28.6807
%
SD
6.8967
%
<
p95
34.12
%
60 second average
25.3677
%
300 second average
20.1780
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.8783
%
SD
1.27
%
<
p95
4.38
%
60 second average
0.8420
%
300 second average
1.2197
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.3043
%
SD
0.4736
%
<
p95
1.1
%
60 second average
0.3830
%
300 second average
0.7707
%
Holochain process CPU usage
CPU usage by Holochain process
p5
58.62
%
<
mean
66.85
%
SD
13.1
%
<
p95
72.84
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
259.30
KiB
<
mean
271.99
KiB
SD
15.41
KiB
<
p95
281.96
KiB
Holochain process threads
Number of threads in Holochain process
p5
5
threads
<
mean
21.57
threads
SD
5.03
threads
<
p95
24
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
23
file descriptors
<
mean
59.57
file descriptors
SD
13.28
file descriptors
<
p95
66
file descriptors

Write validated

↑ Back to index

Creates an entry, updates it and links the create to the update, then repeats. Each of the three actions is validated by the included hApp.

Started
Thu, 15 Oct 2026 16:33:03 UTC
Duration
300s
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
write_validated_38767573742_1
Write timing
The time it takes to complete the zome function call that writes the entry, updates it, and links to the update.
mean
0.115293
s
SD
0.395286
s
p50
0.047589
s
<
p95
0.270855
s
<
p99
1.826584
s
Write rate
The number of write zome function calls that complete per second.
mean
30.78
/s
Read timing
The time it takes to complete the zome function call that reads the data.
mean
0.18647
s
SD
0.614523
s
p50
0.076761
s
<
p95
0.651123
s
<
p99
3.219699
s
Read rate
The number of read zome function calls that complete per second.
mean
30.81
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.003219
s
SD
0.001028
s
p50
0.002945
s
<
p95
0.004463
s
<
p99
0.004665
s
WASM usage: 'validated::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
24552460
over 240.00202027s
mean rate
102301.09
/s
std
37618.87
/s
p5
56403.86
/s
p95
155940.81
/s
peak
192435.44
/s
WASM usage: 'validated::update_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
29032420
over 240.00202027s
mean rate
120967.44
/s
std
44338.59
/s
p5
66695.25
/s
p95
184394.52
/s
peak
227548.14
/s
WASM usage: 'validated_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
53112612
over 250.002077185s
mean rate
212448.79
/s
std
119736.42
/s
p5
106099.57
/s
p95
363767.59
/s
peak
690986.07
/s
WASM usage: 'validated_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
430875886
over 240.00202027s
mean rate
1.79530161e+06
/s
std
658880.67
/s
p5
989388.84
/s
p95
2.735381e+06
/s
peak
3.39527637e+06
/s
Zome call duration: 'validated::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.003162
s
SD
4.5e-05
s
p50
0.003159
s
<
p95
0.003187
s
<
p99
0.003194
s
Zome call duration: 'validated::update_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.007028
s
SD
0.001117
s
p50
0.006673
s
<
p95
0.008007
s
<
p99
0.008126
s
WASM call duration: 'validated::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002575
s
SD
4e-05
s
p50
0.002572
s
<
p95
0.002598
s
<
p99
0.002603
s
WASM call duration: 'validated::update_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006445
s
SD
0.001112
s
p50
0.00609
s
<
p95
0.007421
s
<
p99
0.00754
s
WASM call duration: 'validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000813
s
SD
0.000225
s
p50
0.000813
s
<
p95
0.000817
s
<
p99
0.00198
s
WASM call duration: 'validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002868
s
SD
0.000171
s
p50
0.002818
s
<
p95
0.003032
s
<
p99
0.003048
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000242
s
SD
3e-06
s
p50
0.000242
s
<
p95
0.000243
s
<
p99
0.000244
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000256
s
SD
3e-06
s
p50
0.000255
s
<
p95
0.000258
s
≤
p99
0.000258
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.003052
s
SD
0.000903
s
p50
0.002762
s
<
p95
0.003926
s
<
p99
0.003985
s
Host function call duration: '__hc__update_1'
Duration of this host function call invoked from within WASM.
mean
0.00386
s
SD
0.00109
s
p50
0.003518
s
<
p95
0.004822
s
<
p99
0.004935
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001287
s
SD
2.7e-05
s
p50
0.001303
s
<
p95
0.001354
s
<
p99
0.00136
s
Post-commit duration
Time spent executing post-commit workflows.
mean
9.4e-05
s
SD
2e-06
s
p50
9.4e-05
s
<
p95
9.5e-05
s
≤
p99
9.5e-05
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
13.34
s
<
mean
133.34
s
SD
77.89
s
<
p95
253.34
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 250.002048493s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001383
s
SD
0
s
p50
0.001383
s
≤
p95
0.001383
s
≤
p99
0.001383
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000717
s
SD
0.00022
s
p50
0.000714
s
<
p95
0.000754
s
<
p99
0.001774
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.066463
s
SD
0.014056
s
p50
0.065968
s
<
p95
0.072997
s
<
p99
0.073378
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.003169
s
SD
0
s
p50
0.003169
s
≤
p95
0.003169
s
≤
p99
0.003169
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001313
s
SD
0
s
p50
0.001313
s
≤
p95
0.001313
s
≤
p99
0.001313
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001768
s
SD
0.000676
s
p50
0.001585
s
<
p95
0.002327
s
<
p99
0.002379
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.030873
s
SD
0.013891
s
p50
0.001917
s
<
p95
0.035371
s
<
p99
0.036852
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000203
s
SD
0.000108
s
p50
0.000203
s
<
p95
0.000204
s
<
p99
0.000763
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
17.74
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
765
B/s
<
mean
6.74
KiB/s
SD
3.95
KiB/s
<
p95
12.14
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
632
B/s
<
mean
7.67
KiB/s
SD
6.13
KiB/s
<
p95
15.19
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.78
MiB
mean
6.74
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.02
MiB
mean
7.67
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
17.37
%
<
mean
24.28
%
SD
8.15
%
<
p95
33.65
%
System
6.54
%
CPU percentiles
CPU usage percentiles
p50
21.23
%
p95
33.65
%
p99
57.90
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
21.57
%
<
mean
25.15
%
SD
2
%
<
p95
26.81
%
Memory available percentage
Percentage of available memory
p5
73.19
%
<
mean
74.85
%
SD
2
%
<
p95
78.43
%
Max host memory used
Maximum memory usage percentage across all hosts
max
25.15
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-0.19
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
4.14
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /efi-boot
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.91
5 min
3.75
15 min
2.02
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.45
%
<
mean
1.31
%
SD
0.6081
%
<
p95
2.27
%
60 second average
1.2800
%
300 second average
0.6736
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0239
%
SD
0.0858
%
<
p95
0.16
%
60 second average
0.0150
%
300 second average
0.0021
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0154
%
SD
0.0562
%
<
p95
0.1
%
60 second average
0.0089
%
300 second average
0.0007
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
42.98
%
<
mean
51.3696
%
SD
5.9504
%
<
p95
64.45
%
60 second average
51.5186
%
300 second average
46.1461
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
32.47
%
<
mean
41.7482
%
SD
6.9536
%
<
p95
55.59
%
60 second average
42.7604
%
300 second average
40.8021
%
Holochain process CPU usage
CPU usage by Holochain process
p5
12.47
%
<
mean
18.78
%
SD
8.08
%
<
p95
27.46
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
1.47
KiB
<
mean
368.52
KiB
SD
152.79
KiB
<
p95
445.73
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
23.61
threads
SD
11.68
threads
<
p95
29
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
7
file descriptors
<
mean
56.61
file descriptors
SD
29.68
file descriptors
<
p95
67
file descriptors

Write Validated must_get_agent_activity

↑ Back to index

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Mixed-Arc must_get_agent_activity, but all agents are full-arc.

Started
Thu, 15 Oct 2026 17:57:02 UTC
Duration
900s
Peer count
30
Peer count at end
28
Behaviours
  • must_get_agent_activity (1 agent)
  • write (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
write_validated_must_get_agent_activity_38767573742_1
Highest observed action_seq
The maximum chain length observed per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1512
Max
Highest chain head value observed for any single write agent.
1809
Write agents observed
7
Chain batch delay timing
The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.
Mean
mean
166.254375
s
SD
52.76182
s
Max
Highest per-partition mean latency
max mean
1026.448613
s
Min
Lowest per-partition mean latency
min mean
5.358202
s
Chain batch delay rate
The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.
Mean
mean
2.9
/s
Max
Highest per-partition mean rate
max
4.17
/s
Min
Lowest per-partition mean rate
min
1.87
/s
create_validated_sample_entry zome call timing
The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.
Mean
mean
0.283606
s
SD
0.345993
s
Max
Highest per-partition mean latency
max mean
0.949603
s
Min
Lowest per-partition mean latency
min mean
0.088939
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.
Total
3436
Agents affected
19 / 19
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
181
Max
Highest count in any single partition
729
Min
Lowest count in any single partition
5
Final error count
The total number of all types of error accumulated over the run by all agents.
70546
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.015255
s
SD
0.072338
s
p50
0.000731
s
<
p95
0.041463
s
<
p99
0.587993
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 20.00012157s
Not enough time data to show a trend.
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.005768
s
SD
0.002349
s
p50
0.005312
s
<
p95
0.01043
s
≤
p99
0.01043
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.058039
s
SD
0.014557
s
p50
0.055886
s
<
p95
0.076599
s
<
p99
0.083063
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004525
s
SD
0.001883
s
p50
0.004509
s
<
p95
0.010038
s
<
p99
0.010759
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.004682
s
SD
0.002042
s
p50
0.004654
s
<
p95
0.009969
s
<
p99
0.01129
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.008985
s
SD
0.130821
s
p50
0.006431
s
<
p95
0.590385
s
≤
p99
0.590385
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004866
s
SD
0.002059
s
p50
0.004755
s
<
p95
0.008873
s
≤
p99
0.008873
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.057249
s
SD
0.014465
s
p50
0.055056
s
<
p95
0.075818
s
<
p99
0.082194
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003763
s
SD
0.001688
s
p50
0.00372
s
<
p95
0.008441
s
<
p99
0.009637
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00392
s
SD
0.001623
s
p50
0.00384
s
<
p95
0.00796
s
<
p99
0.009277
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.008051
s
SD
0.130906
s
p50
0.005286
s
<
p95
0.589815
s
≤
p99
0.589815
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001035
s
SD
0.000383
s
p50
0.001001
s
<
p95
0.001999
s
<
p99
0.002401
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.007523
s
SD
0.007349
s
p50
0.006806
s
<
p95
0.019955
s
<
p99
0.03808
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.1e-05
s
SD
1.1e-05
s
p50
2.1e-05
s
<
p95
5.5e-05
s
≤
p99
5.5e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000411
s
SD
0.00018
s
p50
0.000405
s
<
p95
0.000692
s
<
p99
0.001144
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000453
s
SD
0.00019
s
p50
0.000473
s
<
p95
0.00092
s
≤
p99
0.00092
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000551
s
SD
0.094813
s
p50
0.000538
s
<
p95
0.04149
s
<
p99
0.588024
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.017426
s
SD
0.012738
s
p50
0.016737
s
<
p95
0.043296
s
<
p99
0.059812
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.019253
s
SD
0.008165
s
p50
0.014854
s
<
p95
0.029379
s
<
p99
0.033375
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
7e-06
s
SD
2e-06
s
p50
7e-06
s
<
p95
1.3e-05
s
≤
p99
1.3e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001629
s
SD
0.000852
s
p50
0.001871
s
<
p95
0.003814
s
<
p99
0.004866
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000143
s
SD
7.8e-05
s
p50
0.000124
s
<
p95
0.000267
s
<
p99
0.000455
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.2
s
<
mean
446.51
s
SD
256.41
s
<
p95
847.02
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
40658
over 887.641334608s
mean rate
22060.44
/s
std
30133.65
/s
p5
406.52
/s
p95
78852.66
/s
peak
197998.8
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
25.003255
s
SD
15.846631
s
p50
20.058008
s
<
p95
51.578387
s
<
p99
77.711714
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
1.267537
s
SD
1.312469
s
p50
1.802574
s
<
p95
4.005472
s
<
p99
7.340219
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.087091
s
SD
0.13797
s
p50
0.094258
s
<
p95
0.398696
s
<
p99
0.807938
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.134038
s
SD
0.082853
s
p50
0.078947
s
<
p95
0.25742
s
<
p99
0.355526
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.506659
s
SD
3.311647
s
p50
0.750864
s
<
p95
9.199083
s
<
p99
13.996281
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
16.811667
s
SD
30.68355
s
p50
1.178892
s
<
p95
85.474824
s
<
p99
116.545612
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002643
s
SD
0.001479
s
p50
0.002129
s
<
p95
0.004613
s
<
p99
0.007233
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00764
s
SD
0.005073
s
p50
0.001699
s
<
p95
0.018757
s
<
p99
0.021995
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000346
s
SD
0.00011
s
p50
0.000364
s
<
p95
0.000562
s
<
p99
0.000668
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.92287
s
SD
28.564974
s
p50
0.235267
s
<
p95
60.001526
s
<
p99
60.001651
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.318571
s
SD
0.189478
s
p50
0.24653
s
<
p95
0.497123
s
≤
p99
0.497123
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
0.415402
s
SD
0.387651
s
p50
0.803052
s
≤
p95
0.803052
s
≤
p99
0.803052
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.495932
s
SD
25.875734
s
p50
1.371404
s
<
p95
60.001303
s
<
p99
60.001492
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
38.18
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
44.41
KiB/s
<
mean
86.26
KiB/s
SD
228.04
KiB/s
<
p95
118.52
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
17.46
KiB/s
<
mean
72.51
KiB/s
SD
57.73
KiB/s
<
p95
177.61
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.98
GiB
mean
2.27
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.66
GiB
mean
1.91
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.0%

Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (17.6% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 18% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
11.08
%
<
mean
48.41
%
SD
24.14
%
<
p95
90.64
%
System
10.23
%
CPU percentiles
CPU usage percentiles
p50
50.86
%
p95
90.64
%
p99
98.04
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
11
hosts
mean time
234.42
s
Memory used percentage
Percentage of memory used
p5
7.63
%
<
mean
18.15
%
SD
8.65
%
<
p95
34.55
%
Memory available percentage
Percentage of available memory
p5
65.45
%
<
mean
81.85
%
SD
8.65
%
<
p95
92.37
%
Max host memory used
Maximum memory usage percentage across all hosts
max
40.51
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
17.59
%
Memory growth rate
Rate of memory growth over time
growth
0.25
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
78.08
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/7
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/9
hosts
Mount Point /etc/hosts
0/9
hosts
Mount Point /etc/nomad.d/client-meta.json
0/12
hosts
Mount Point /etc/resolv.conf
0/9
hosts
Mount Point /nix/store
0/7
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.67
5 min
2.39
15 min
2.42
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
17.86
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
10.8938
%
SD
15.1779
%
<
p95
43.13
%
60 second average
10.6628
%
300 second average
10.4291
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
5.2013
%
SD
10.3336
%
<
p95
28.37
%
60 second average
5.0844
%
300 second average
4.4263
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
2.5596
%
SD
5.5595
%
<
p95
14.18
%
60 second average
2.5566
%
300 second average
2.3293
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
<
mean
40.26
%
SD
24.05
%
<
p95
86.28
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
379.47
KiB
<
mean
478.32
KiB
SD
89.18
KiB
<
p95
631.92
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
38.39
threads
SD
14.52
threads
<
p95
55
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
<
mean
78.37
file descriptors
SD
23.43
file descriptors
<
p95
101
file descriptors

Zero-Arc Create and Read

↑ Back to index

A zero-arc/full-arc mixed scenario with two types of zero-arc nodes -- ones that create data and ones that read data -- as well as full arc nodes to "relay" the data. The scenario has three roles:

  • zero_write: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so that zero_read nodes can retrieve them.
  • zero_read: A zero-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
  • full: A full-arc conductor that is just here to serve entries to zero arc nodes.
Started
Thu, 15 Oct 2026 19:14:43 UTC
Duration
900s
Peer count
30
Peer count at end
28
Behaviours
  • full (1 agent)
  • zero_read (1 agent)
  • zero_write (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
zero_arc_create_and_read_38767573742_1
Create rate
The number of timed entries created by the zero-arc write node(s) per second.
Mean
mean
66.84
/s
Max
Highest per-partition mean rate
max
107.63
/s
Min
Lowest per-partition mean rate
min
51.13
/s
Fetch lag timing
For each entry, the time lag between when it was created and when a zero-arc read node fetched it from the network via the get_timed_entries_network zome function.
Mean
mean
91.967722
s
SD
35.576563
s
Max
Highest per-partition mean latency
max mean
241.668387
s
Min
Lowest per-partition mean latency
min mean
3.859439
s
Fetch lag rate
The number of entries per second fetched by zero-arc read nodes.
Mean
mean
184.73
/s
Max
Highest per-partition mean rate
max
682
/s
Min
Lowest per-partition mean rate
min
0
/s
Delivery ratio
The proportion of created entries successfully fetched by all zero-arc read nodes.
0.0087
Entry created count
Total number of entries created by zero-arc write nodes, by agent.
Total
67174
Agents affected
11 / 11
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
6107
Max
Highest count in any single partition
9697
Min
Lowest count in any single partition
4553
Received count
Total number of entries fetched by zero-arc read nodes, by agent.
Total
6456
Agents affected
11 / 11
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
587
Max
Highest count in any single partition
2186
Min
Lowest count in any single partition
1
Open connections
The number of currently open connections to other conductors.
full-arc
p5
0
<
mean
17.07
SD
10.83
<
p95
28
zero-arc
p5
4
<
mean
7.67
SD
3.75
<
p95
15
Error count
The number of errors accumulated across all nodes.
151
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.014903
s
SD
1.963665
s
p50
0.158434
s
<
p95
5.727325
s
<
p99
8.749645
s
WASM usage: 'timed::created_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
274459110
over 878.091668754s
mean rate
3.7028004669e+08
/s
std
5.8925139729e+08
/s
p5
585244.62
/s
p95
1.90761362115e+09
/s
peak
2.1879229135e+09
/s
WASM usage: 'timed::get_timed_entries_network'
Metered usage count of the WASM ribosome for this zome function.
total
6741093
over 877.135115892s
mean rate
1.24908871264e+10
/s
std
2.85984341082e+10
/s
p5
1.594429961e+07
/s
p95
9.42090968976e+10
/s
peak
9.48413226803e+10
/s
WASM usage: 'timed_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
45434118
over 888.745439731s
mean rate
2.0851505581e+08
/s
std
4.6710640654e+08
/s
p5
0
/s
p95
1.15740540947e+09
/s
peak
2.79258443899e+09
/s
Zome call duration: 'timed::created_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004588
s
SD
0.000947
s
p50
0.004811
s
<
p95
0.006233
s
<
p99
0.006447
s
Zome call duration: 'timed::get_timed_entries_network'
Duration of this zome call as measured by Holochain internally.
mean
1.313105
s
SD
9.259022
s
p50
3.492126
s
<
p95
22.16695
s
<
p99
41.880251
s
WASM call duration: 'timed::created_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004042
s
SD
0.000838
s
p50
0.004217
s
<
p95
0.00539
s
<
p99
0.005583
s
WASM call duration: 'timed::get_timed_entries_network'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
1.312355
s
SD
9.259007
s
p50
3.491251
s
<
p95
22.166476
s
<
p99
41.879403
s
WASM call duration: 'timed_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000852
s
SD
0.000685
s
p50
0.000922
s
<
p95
0.002843
s
<
p99
0.003123
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000245
s
SD
6.5e-05
s
p50
0.000253
s
<
p95
0.000365
s
<
p99
0.00038
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000244
s
SD
7.1e-05
s
p50
0.00027
s
<
p95
0.000365
s
<
p99
0.000379
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.013214
s
SD
1.940576
s
p50
0.143706
s
<
p95
5.587768
s
<
p99
8.816942
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.536758
s
SD
5.454736
s
p50
0.615533
s
<
p95
16.547817
s
<
p99
24.442597
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001293
s
SD
0.001014
s
p50
0.001443
s
<
p95
0.004103
s
<
p99
0.004441
s
Post-commit duration
Time spent executing post-commit workflows.
mean
9.2e-05
s
SD
9.6e-05
s
p50
0.000101
s
<
p95
0.000417
s
<
p99
0.00043
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.7
s
<
mean
442.88
s
SD
254.61
s
<
p95
838.15
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 888.745340121s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
30.705552
s
SD
20.281236
s
p50
0
s
<
p95
17.460584
s
<
p99
127.443442
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.063749
s
SD
0.053523
s
p50
0.001171
s
<
p95
0.169838
s
<
p99
0.243441
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.028051
s
SD
0.349168
s
p50
0.001071
s
<
p95
1.113713
s
<
p99
1.172165
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.09452
s
SD
0.049801
s
p50
0.015215
s
<
p95
0.140488
s
<
p99
0.1834
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
9.339146
s
SD
8.675623
s
p50
0.002248
s
<
p95
20.780641
s
<
p99
44.344312
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
6.716873
s
SD
8.202385
s
p50
0.002157
s
<
p95
1.119848
s
<
p99
46.68447
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001179
s
SD
0.001231
s
p50
0.000699
s
<
p95
0.003649
s
<
p99
0.004286
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003133
s
SD
0.007165
s
p50
0.001284
s
<
p95
0.020528
s
<
p99
0.037902
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000227
s
SD
9.8e-05
s
p50
0.000218
s
<
p95
0.000416
s
<
p99
0.000448
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.541038
s
SD
28.804597
s
p50
4.504649
s
<
p95
60.00152
s
<
p99
60.001579
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.21983
s
SD
28.275447
s
p50
1.995607
s
<
p95
60.0014
s
<
p99
60.001753
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.033608
s
SD
1.28428
s
p50
0.095599
s
<
p95
2.60611
s
≤
p99
2.60611
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
23.14
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1006
B/s
<
mean
108.19
KiB/s
SD
217.75
KiB/s
<
p95
465.54
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
791
B/s
<
mean
101.95
KiB/s
SD
242.69
KiB/s
<
p95
330.18
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.47
GiB
mean
2.84
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.32
GiB
mean
2.67
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 94.2%

Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (17.6% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 14% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.08
%
<
mean
30.82
%
SD
28.18
%
<
p95
85.08
%
System
7.68
%
CPU percentiles
CPU usage percentiles
p50
28.51
%
p95
85.08
%
p99
94.20
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
4
hosts
mean time
417.13
s
Memory used percentage
Percentage of memory used
p5
6
%
<
mean
15.46
%
SD
8.19
%
<
p95
31.1
%
Memory available percentage
Percentage of available memory
p5
68.9
%
<
mean
84.54
%
SD
8.19
%
<
p95
94
%
Max host memory used
Maximum memory usage percentage across all hosts
max
36.12
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
17.59
%
Memory growth rate
Rate of memory growth over time
growth
0.41
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.56
MiB/s
Disk write throughput
Disk write throughput in MiB/s
87.45
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/7
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/10
hosts
Mount Point /etc/hosts
0/10
hosts
Mount Point /etc/nomad.d/client-meta.json
0/12
hosts
Mount Point /etc/resolv.conf
0/10
hosts
Mount Point /nix/store
0/7
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.99
5 min
2.14
15 min
2.32
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
14.29
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
5.8627
%
SD
12.1566
%
<
p95
34.71
%
60 second average
5.9032
%
300 second average
6.5245
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
4.4076
%
SD
9.6392
%
<
p95
25.51
%
60 second average
4.4472
%
300 second average
4.3600
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
3.3113
%
SD
8.1992
%
<
p95
21.44
%
60 second average
3.3791
%
300 second average
3.4443
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.23
%
<
mean
26.22
%
SD
26.93
%
<
p95
76.89
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
229.18
KiB
<
mean
310.86
KiB
SD
84.91
KiB
<
p95
461.06
KiB
Holochain process threads
Number of threads in Holochain process
p5
24
threads
<
mean
36.03
threads
SD
13.14
threads
<
p95
71
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
56
file descriptors
<
mean
71.94
file descriptors
SD
12.51
file descriptors
<
p95
91
file descriptors

Zero-Arc Create Data

↑ Back to index
A zero-arc/full-arc mixed scenario where zero-arc nodes create data and full-arc nodes read the data. The scenario has two roles:
  • zero: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so that full-arc nodes can retrieve them.
  • full: A full-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Thu, 15 Oct 2026 18:28:06 UTC
Duration
900s
Peer count
30
Peer count at end
29
Behaviours
  • full (1 agent)
  • zero (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
zero_arc_create_data--high_zero_38767573742_1
Create rate
The number of timed entries created by the zero-arc node(s) per second.
Mean
mean
66.98
/s
Max
Highest per-partition mean rate
max
87.09
/s
Min
Lowest per-partition mean rate
min
49.61
/s
Sync lag timing
For each entry, the time lag between when it was created and when the full-arc node could read it via the get_timed_local_entries zome function.
Mean
mean
28.706526
s
SD
3.225336
s
Max
Highest per-partition mean latency
max mean
28.706526
s
Min
Lowest per-partition mean latency
min mean
28.706526
s
Sync lag rate
The number of entries per second received by full nodes.
Mean
mean
0
/s
Max
Highest per-partition mean rate
max
0
/s
Min
Lowest per-partition mean rate
min
0
/s
Delivery ratio
The proportion of created entries successfully received by all full-arc nodes.
0.0022
Entry created count
Total number of entries created by zero-arc nodes, by agent.
Total
166449
Agents affected
27 / 27
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
6165
Max
Highest count in any single partition
8071
Min
Lowest count in any single partition
4555
Received count
Total number of entries received by full-arc nodes, by agent.
Total
723
Agents affected
1 / 2
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
362
Max
Highest count in any single partition
723
Min
Lowest count in any single partition
0
Open connections
The number of currently open connections to other conductors.
full-arc
p5
4
<
mean
19.81
SD
6.7
<
p95
27
zero-arc
p5
1
<
mean
8
SD
4.95
<
p95
17
Error count
The number of errors accumulated across all nodes.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.00029
s
SD
6.8e-05
s
p50
0.000308
s
<
p95
0.00044
s
<
p99
0.000444
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
12
over 785.452040055s
mean rate
0.97
/s
std
0.65
/s
p5
0
/s
p95
2.21
/s
peak
2.21
/s
WASM usage: 'timed::created_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
294392620
over 873.030223376s
mean rate
1.9979886777e+09
/s
std
4.01800875349e+09
/s
p5
9.08767263e+06
/s
p95
1.19843830306e+10
/s
peak
1.74215117062e+10
/s
WASM usage: 'timed::get_timed_entries_local'
Metered usage count of the WASM ribosome for this zome function.
total
293094978
over 885.45259109s
mean rate
6.84854755693e+09
/s
std
4.04117481187e+09
/s
p5
1.9343450377e+08
/s
p95
1.2827357566e+10
/s
peak
1.33619321731e+10
/s
WASM usage: 'timed_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
41374396
over 887.420918762s
mean rate
2.8556807808e+08
/s
std
6.0311652244e+08
/s
p5
856104.61
/s
p95
1.82219371437e+09
/s
peak
2.74376064543e+09
/s
Zome call duration: 'timed::created_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004678
s
SD
0.000941
s
p50
0.004748
s
<
p95
0.00585
s
<
p99
0.008239
s
Zome call duration: 'timed::get_timed_entries_local'
Duration of this zome call as measured by Holochain internally.
mean
0.02758
s
SD
0.024882
s
p50
0.005855
s
<
p95
0.07138
s
<
p99
0.075049
s
WASM call duration: 'timed::created_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004114
s
SD
0.000842
s
p50
0.004171
s
<
p95
0.005179
s
<
p99
0.007283
s
WASM call duration: 'timed::get_timed_entries_local'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.026844
s
SD
0.02503
s
p50
0.004887
s
<
p95
0.070817
s
<
p99
0.074484
s
WASM call duration: 'timed_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000873
s
SD
0.000221
s
p50
0.000867
s
<
p95
0.001459
s
<
p99
0.001538
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000246
s
SD
5e-05
s
p50
0.000249
s
<
p95
0.000324
s
<
p99
0.000427
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000245
s
SD
5.5e-05
s
p50
0.000262
s
<
p95
0.000305
s
<
p99
0.000437
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000278
s
SD
2.7e-05
s
p50
0.000279
s
<
p95
0.000319
s
<
p99
0.000432
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.001932
s
SD
0.00176
s
p50
0.000486
s
<
p95
0.00525
s
<
p99
0.005596
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001335
s
SD
0.000323
s
p50
0.001314
s
<
p95
0.002266
s
<
p99
0.002561
s
Post-commit duration
Time spent executing post-commit workflows.
mean
8.6e-05
s
SD
4.3e-05
s
p50
9.3e-05
s
<
p95
0.000178
s
<
p99
0.000254
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.01
s
<
mean
443.97
s
SD
255.33
s
<
p95
838.47
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 887.420980006s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.987932
s
SD
4.630958
s
p50
0
s
≤
p95
0
s
<
p99
25.550677
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.077319
s
SD
0.144701
s
p50
0.001313
s
<
p95
0.115584
s
<
p99
0.888598
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.006628
s
SD
0.256148
s
p50
0.000774
s
<
p95
0.966872
s
<
p99
1.215074
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.09353
s
SD
0.047031
s
p50
0.076818
s
<
p95
0.168423
s
<
p99
0.196193
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
10.736448
s
SD
13.312204
s
p50
0.002845
s
<
p95
15.109138
s
<
p99
88.352626
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.63883
s
SD
0.582932
s
p50
0.001907
s
<
p95
0.006267
s
<
p99
3.201306
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002495
s
SD
0.001898
s
p50
0.004401
s
<
p95
0.006721
s
<
p99
0.008619
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.005219
s
SD
0.008144
s
p50
0.001351
s
<
p95
0.026254
s
<
p99
0.038862
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000197
s
SD
6.7e-05
s
p50
0.000203
s
<
p95
0.000336
s
<
p99
0.000471
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
45.203783
s
SD
20.363775
s
p50
28.630771
s
<
p95
60.00103
s
≤
p99
60.00103
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
27.495239
s
SD
23.273916
s
p50
15.647892
s
<
p95
60.001032
s
<
p99
60.001065
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
34.24
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
899
B/s
<
mean
52.67
KiB/s
SD
277.10
KiB/s
<
p95
58.94
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
797
B/s
<
mean
46.93
KiB/s
SD
58.22
KiB/s
<
p95
154.37
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.20
GiB
mean
1.38
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.07
GiB
mean
1.23
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (17.6% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 4% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
16.57
%
<
mean
44.42
%
SD
20.05
%
<
p95
80.57
%
System
10.18
%
CPU percentiles
CPU usage percentiles
p50
37.17
%
p95
80.57
%
p99
89.81
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
5
hosts
mean time
291.24
s
Memory used percentage
Percentage of memory used
p5
6.52
%
<
mean
15.86
%
SD
8.32
%
<
p95
31.45
%
Memory available percentage
Percentage of available memory
p5
68.55
%
<
mean
84.14
%
SD
8.32
%
<
p95
93.48
%
Max host memory used
Maximum memory usage percentage across all hosts
max
37.46
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
17.59
%
Memory growth rate
Rate of memory growth over time
growth
0.25
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.02
MiB/s
Disk write throughput
Disk write throughput in MiB/s
83.38
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/7
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/10
hosts
Mount Point /etc/hosts
0/10
hosts
Mount Point /etc/nomad.d/client-meta.json
0/11
hosts
Mount Point /etc/resolv.conf
0/10
hosts
Mount Point /nix/store
0/7
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.30
5 min
2.26
15 min
2.31
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
3.57
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
4.5403
%
SD
8.033
%
<
p95
27.46
%
60 second average
4.5647
%
300 second average
4.7877
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
4.8856
%
SD
9.7622
%
<
p95
26.69
%
60 second average
4.9581
%
300 second average
4.8718
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
4.2358
%
SD
8.7509
%
<
p95
22.93
%
60 second average
4.3189
%
300 second average
4.2378
%
Holochain process CPU usage
CPU usage by Holochain process
p5
14.62
%
<
mean
40.85
%
SD
18.92
%
<
p95
77.34
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
246.73
KiB
<
mean
340.20
KiB
SD
70.95
KiB
<
p95
485.84
KiB
Holochain process threads
Number of threads in Holochain process
p5
29
threads
<
mean
34.79
threads
SD
6.54
threads
<
p95
52
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
67
file descriptors
<
mean
75.26
file descriptors
SD
9.76
file descriptors
<
p95
87
file descriptors

Zero-arc Create Data (Validated)

↑ Back to index

A zero-arc/full-arc mixed scenario where zero-arc nodes create data that gets validated and full-arc nodes read the data. The scenario has two roles:

  • zero: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so that full-arc nodes can retrieve them.
  • full: A full-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Thu, 15 Oct 2026 18:59:10 UTC
Duration
900s
Peer count
30
Peer count at end
28
Behaviours
  • full (1 agent)
  • zero (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
zero_arc_create_data_validated--high_zero_38767573742_1
Create rate
The number of timed entries created by the zero-arc node(s) per second.
Mean
mean
62.95
/s
Max
Highest per-partition mean rate
max
92.95
/s
Min
Lowest per-partition mean rate
min
46.28
/s
Sync lag timing
For each entry, the time lag between when it was created and when the full-arc node could read it via the get_timed_local_entries zome function.
Mean
mean
0.550395
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0.550395
s
Min
Lowest per-partition mean latency
min mean
0.550395
s
Not enough time data to show a trend.
Sync lag rate
The number of entries per second received by full nodes.
Mean
mean
0
/s
Max
Highest per-partition mean rate
max
0
/s
Min
Lowest per-partition mean rate
min
0
/s
Not enough time data to show a trend.
Delivery ratio
The proportion of created entries successfully received by all full-arc nodes.
0
Entry created count
Total number of entries created by zero-arc nodes, by agent.
Total
151091
Agents affected
27 / 27
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
5596
Max
Highest count in any single partition
8362
Min
Lowest count in any single partition
4090
Received count
Total number of entries received by full-arc nodes, by agent.
Total
1
Agents affected
1 / 2
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
1
Max
Highest count in any single partition
1
Min
Lowest count in any single partition
0
Open connections
The number of currently open connections to other conductors.
full-arc
p5
9
<
mean
22.76
SD
5.49
<
p95
28
zero-arc
p5
2
<
mean
8.69
SD
5.19
<
p95
19
Error count
The number of errors accumulated across all nodes.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.003905
s
SD
0.003814
s
p50
0.006883
s
<
p95
0.012684
s
<
p99
0.016139
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
39
over 785.27359834s
mean rate
4.91
/s
std
5.56
/s
p5
0
/s
p95
14.32
/s
peak
14.53
/s
WASM usage: 'timed_and_validated::create_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
499429152
over 864.389950789s
mean rate
3.1674399056e+08
/s
std
3.2299654822e+08
/s
p5
8.14305653e+06
/s
p95
1.13632971147e+09
/s
peak
1.5126777911e+09
/s
WASM usage: 'timed_and_validated::get_timed_entries_local'
Metered usage count of the WASM ribosome for this zome function.
total
670697912
over 885.276281961s
mean rate
3.930667232e+07
/s
std
1.595627093e+07
/s
p5
5.83558098e+06
/s
p95
5.877793196e+07
/s
peak
6.001705953e+07
/s
WASM usage: 'timed_and_validated_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
295699140
over 890.006795079s
mean rate
3.0178233329e+08
/s
std
3.967885012e+08
/s
p5
675102.78
/s
p95
1.30613606038e+09
/s
peak
1.94627757576e+09
/s
WASM usage: 'timed_and_validated_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
2313661813
over 890.006795079s
mean rate
2.8793787211e+09
/s
std
4.47227934585e+09
/s
p5
103705.2
/s
p95
1.29775784359e+10
/s
peak
3.177118537e+10
/s
Zome call duration: 'timed_and_validated::create_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004746
s
SD
0.001438
s
p50
0.004762
s
<
p95
0.007811
s
<
p99
0.010571
s
Zome call duration: 'timed_and_validated::get_timed_entries_local'
Duration of this zome call as measured by Holochain internally.
mean
0.006261
s
SD
0.000828
s
p50
0.006572
s
<
p95
0.007356
s
<
p99
0.010041
s
WASM call duration: 'timed_and_validated::create_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004186
s
SD
0.0013
s
p50
0.004177
s
<
p95
0.006982
s
<
p99
0.009518
s
WASM call duration: 'timed_and_validated::get_timed_entries_local'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005438
s
SD
0.000737
s
p50
0.005716
s
<
p95
0.006254
s
<
p99
0.008492
s
WASM call duration: 'timed_and_validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000938
s
SD
0.00036
s
p50
0.000819
s
<
p95
0.001575
s
<
p99
0.002504
s
WASM call duration: 'timed_and_validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004043
s
SD
0.001232
s
p50
0.003589
s
<
p95
0.005694
s
<
p99
0.00742
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.00025
s
SD
7.5e-05
s
p50
0.000246
s
<
p95
0.000414
s
<
p99
0.000518
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000248
s
SD
8.4e-05
s
p50
0.000265
s
<
p95
0.000406
s
<
p99
0.000573
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000899
s
SD
7e-05
s
p50
0.000896
s
<
p95
0.000947
s
<
p99
0.000953
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000443
s
SD
5.5e-05
s
p50
0.00041
s
<
p95
0.000517
s
<
p99
0.00052
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.00424
s
SD
0.003554
s
p50
0.007232
s
<
p95
0.01288
s
<
p99
0.016274
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001465
s
SD
0.000538
s
p50
0.001291
s
<
p95
0.002622
s
<
p99
0.003438
s
Post-commit duration
Time spent executing post-commit workflows.
mean
9.2e-05
s
SD
6.5e-05
s
p50
9.5e-05
s
<
p95
0.00026
s
<
p99
0.0003
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.7
s
<
mean
443.04
s
SD
254.85
s
<
p95
838.18
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 890.006685991s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.000123
s
SD
0.136186
s
p50
0
s
≤
p95
0
s
<
p99
0.73646
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
4.053463
s
SD
1.245006
s
p50
0.001224
s
<
p95
3.033922
s
<
p99
6.805107
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.009155
s
SD
0.263072
s
p50
0.000771
s
<
p95
1.042196
s
<
p99
1.134298
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.078018
s
SD
0.03462
s
p50
0.065529
s
<
p95
0.117902
s
<
p99
0.13204
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
12.382482
s
SD
16.231504
s
p50
0.002554
s
<
p95
10.317433
s
<
p99
125.93355
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.066386
s
SD
0.092566
s
p50
0.002577
s
<
p95
0.005223
s
<
p99
0.503843
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.003154
s
SD
0.001655
s
p50
0.003487
s
<
p95
0.005787
s
<
p99
0.006933
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.004387
s
SD
0.00703
s
p50
0.001341
s
<
p95
0.023169
s
<
p99
0.034714
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000198
s
SD
8.4e-05
s
p50
0.000201
s
<
p95
0.000411
s
<
p99
0.000452
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.084337
s
SD
29.928806
s
p50
0.052411
s
<
p95
60.001354
s
≤
p99
60.001354
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
1.000651
s
SD
0
s
p50
1.000651
s
≤
p95
1.000651
s
≤
p99
1.000651
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
36.54
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
2.43
KiB/s
<
mean
97.35
KiB/s
SD
442.47
KiB/s
<
p95
624.16
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
2.02
KiB/s
<
mean
61.80
KiB/s
SD
59.44
KiB/s
<
p95
200.63
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.23
GiB
mean
2.54
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.42
GiB
mean
1.61
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Warning Moderate swap usage (17.6% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 25% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
10.05
%
<
mean
47.02
%
SD
23.8
%
<
p95
86.93
%
System
10.47
%
CPU percentiles
CPU usage percentiles
p50
48.78
%
p95
86.93
%
p99
89.10
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
6
hosts
mean time
651.46
s
Memory used percentage
Percentage of memory used
p5
7.69
%
<
mean
17.84
%
SD
8.8
%
<
p95
34.35
%
Memory available percentage
Percentage of available memory
p5
65.65
%
<
mean
82.16
%
SD
8.8
%
<
p95
92.31
%
Max host memory used
Maximum memory usage percentage across all hosts
max
39.50
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
17.59
%
Memory growth rate
Rate of memory growth over time
growth
0.26
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.05
MiB/s
Disk write throughput
Disk write throughput in MiB/s
93.96
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/7
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/10
hosts
Mount Point /etc/hosts
0/10
hosts
Mount Point /etc/nomad.d/client-meta.json
0/12
hosts
Mount Point /etc/resolv.conf
0/10
hosts
Mount Point /nix/store
0/7
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.55
5 min
2.58
15 min
2.53
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
25.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
8.1479
%
SD
12.0175
%
<
p95
35.11
%
60 second average
8.1352
%
300 second average
8.3574
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
3.9442
%
SD
9.0129
%
<
p95
24.14
%
60 second average
4.0271
%
300 second average
4.0430
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
3.4835
%
SD
8.2259
%
<
p95
20.87
%
60 second average
3.5443
%
300 second average
3.4851
%
Holochain process CPU usage
CPU usage by Holochain process
p5
6.64
%
<
mean
43.51
%
SD
23.34
%
<
p95
86.24
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
387.08
KiB
<
mean
498.62
KiB
SD
119.26
KiB
<
p95
721.92
KiB
Holochain process threads
Number of threads in Holochain process
p5
31
threads
<
mean
36.43
threads
SD
11.07
threads
<
p95
54
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
65
file descriptors
<
mean
73.57
file descriptors
SD
10.15
file descriptors
<
p95
83
file descriptors

Zome Call, Single Value

↑ Back to index

Calls a zome function that returns a fixed value. This tests the maximum performance of zome calls when the zome function is not calling into Holochain other otherwise doing any work.

Started
Thu, 15 Oct 2026 16:34:50 UTC
Duration
300s
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0
Wind Tunnel version
0.7.0
Run ID
zome_call_single_value_38767573742_1
Call timing
The time taken for the call to complete.
mean
0.00318
s
SD
0.006099
s
p50
0.002815
s
<
p95
0.004644
s
<
p99
0.007019
s
Call rate
The number of zome calls completed per second.
mean
3112.96
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'return_single_value::get_value'
Metered usage count of the WASM ribosome for this zome function.
total
357632600
over 280.001724387s
mean rate
1.27725148e+06
/s
std
140023.23
/s
p5
1.03018837e+06
/s
p95
1.40629668e+06
/s
peak
1.41245527e+06
/s
Zome call duration: 'return_single_value::get_value'
Duration of this zome call as measured by Holochain internally.
mean
0.001366
s
SD
1.1e-05
s
p50
0.00137
s
<
p95
0.001387
s
<
p99
0.001388
s
WASM call duration: 'return_single_value::get_value'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000894
s
SD
1e-05
s
p50
0.000896
s
<
p95
0.000912
s
<
p99
0.000913
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000146
s
SD
0
s
p50
0.000146
s
≤
p95
0.000146
s
≤
p99
0.000146
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
16.87
s
<
mean
146.87
s
SD
83.67
s
<
p95
276.87
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001727781s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000833
s
SD
0
s
p50
0.000833
s
≤
p95
0.000833
s
≤
p99
0.000833
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0
s
SD
0
s
p50
0
s
≤
p95
0
s
≤
p99
0
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001629
s
SD
0
s
p50
0.001629
s
≤
p95
0.001629
s
≤
p99
0.001629
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.003288
s
SD
0.000662
s
p50
0.003518
s
<
p95
0.004554
s
≤
p99
0.004554
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.002348
s
SD
0
s
p50
0.002348
s
≤
p95
0.002348
s
≤
p99
0.002348
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.00266
s
SD
0
s
p50
0.00266
s
≤
p95
0.00266
s
≤
p99
0.00266
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
4.5e-05
s
SD
1e-06
s
p50
4.5e-05
s
<
p95
4.6e-05
s
≤
p99
4.6e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001183
s
SD
8e-05
s
p50
0.001213
s
<
p95
0.001303
s
≤
p99
0.001303
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000323
s
SD
0
s
p50
0.000323
s
≤
p95
0.000323
s
≤
p99
0.000323
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
38.10
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
902
B/s
<
mean
227.82
KiB/s
SD
1.12
MiB/s
≤
p95
58.37
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
154
B/s
<
mean
19.98
KiB/s
SD
30.80
KiB/s
<
p95
107.01
KiB/s
Total bytes received
Total bytes received on primary network interface
count
64.52
MiB
mean
227.82
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
5.66
MiB
mean
19.98
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 100% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
55.06
%
<
mean
61.74
%
SD
9.03
%
<
p95
87.51
%
System
23.64
%
CPU percentiles
CPU usage percentiles
p50
59.60
%
p95
87.51
%
p99
88.29
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
31.03
s
Memory used percentage
Percentage of memory used
p5
15.93
%
<
mean
24.2
%
SD
4.59
%
<
p95
27.89
%
Memory available percentage
Percentage of available memory
p5
72.11
%
<
mean
75.8
%
SD
4.59
%
<
p95
84.07
%
Max host memory used
Maximum memory usage percentage across all hosts
max
24.20
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-2.24
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
3.05
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.33
5 min
3.17
15 min
2.61
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
100.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
23
%
<
mean
32.4147
%
SD
7.8279
%
<
p95
52.95
%
60 second average
30.3550
%
300 second average
26.9347
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.51
%
<
mean
4.127
%
SD
4.6377
%
<
p95
12.64
%
60 second average
3.1770
%
300 second average
1.7547
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.23
%
<
mean
2.271
%
SD
2.4158
%
<
p95
8.16
%
60 second average
1.6980
%
300 second average
0.9280
%
Holochain process CPU usage
CPU usage by Holochain process
p5
39.55
%
<
mean
46.85
%
SD
3.46
%
<
p95
50.18
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
104.67
KiB
<
mean
258.83
KiB
SD
287.15
KiB
<
p95
815.18
KiB
Holochain process threads
Number of threads in Holochain process
p5
21
threads
<
mean
38.97
threads
SD
74.28
threads
<
p95
168
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
59
file descriptors
<
mean
96.55
file descriptors
SD
157.33
file descriptors
<
p95
374
file descriptors