App Install
↑ Back to indexMeasure app installation speed. This scenario has two roles:
minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.
These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.
Started
Thu, 30 Jul 2026 03:30:07 UTC
Peer count
1
Behaviours
-
minimal(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
app_install_minimal_30510613785_1
First install time
The time from conductor startup to completion of the first app installation attempt.
0.118202709
s
Install app timing
The time taken to install an app.
mean
0.023272
s
SD
0.006006
s
p50
0.021896
s
p95
0.032562
s
p99
0.056309
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'callback::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 0s
Not enough time data to show a trend.
WASM usage: 'callback_integrity::genesis_self_check_2'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 0s
Not enough time data to show a trend.
WASM call duration: 'callback::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000636
s
SD
3.5e-05
s
p50
0.000636
s
p95
0.000665
s
p99
0.000791
s
Not enough time data to show a trend.
WASM call duration: 'callback_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000612
s
SD
0
s
p50
0.000612
s
p95
0.000612
s
p99
0.000612
s
Not enough time data to show a trend.
Post-commit duration
Time spent executing post-commit workflows.
mean
4.3e-05
s
SD
1.6e-05
s
p50
3.9e-05
s
p95
7.5e-05
s
p99
0.000108
s
Not enough time data to show a trend.
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
8.57
s
mean
8.57
s
SD
0
s
p95
8.57
s
Not enough time data to show a trend.
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 0s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Not enough time data to show a trend.
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Not enough time data to show a trend.
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000816
s
SD
0
s
p50
0.000816
s
p95
0.000816
s
p99
0.000816
s
Not enough time data to show a trend.
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002392
s
SD
0
s
p50
0.002392
s
p95
0.002392
s
p99
0.002392
s
Not enough time data to show a trend.
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000771
s
SD
0
s
p50
0.000771
s
p95
0.000771
s
p99
0.000771
s
Not enough time data to show a trend.
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.003124
s
SD
0
s
p50
0.003124
s
p95
0.003124
s
p99
0.003124
s
Not enough time data to show a trend.
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.002325
s
SD
0
s
p50
0.002325
s
p95
0.002325
s
p99
0.002325
s
Not enough time data to show a trend.
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001332
s
SD
0
s
p50
0.001332
s
p95
0.001332
s
p99
0.001332
s
Not enough time data to show a trend.
DHT DB connection use time
Time spent holding DHT database connections.
mean
5.1e-05
s
SD
0
s
p50
5.1e-05
s
p95
5.1e-05
s
p99
5.1e-05
s
Not enough time data to show a trend.
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000706
s
SD
0.000103
s
p50
0.000855
s
p95
0.000855
s
p99
0.000855
s
Not enough time data to show a trend.
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00016
s
SD
0
s
p50
0.00016
s
p95
0.00016
s
p99
0.00016
s
Not enough time data to show a trend.
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
12.25
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
89.66
KiB/s
mean
89.66
KiB/s
SD
0
B/s
p95
89.66
KiB/s
Not enough time data to show a trend.
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
41.21
KiB/s
mean
41.21
KiB/s
SD
0
B/s
p95
41.21
KiB/s
Not enough time data to show a trend.
Total bytes received
Total bytes received on primary network interface
count
896.61
KiB
mean
89.66
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
412.12
KiB
mean
41.21
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 2797.39 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
19.4
%
mean
19.4
%
SD
0
%
p95
19.4
%
Not enough time data to show a trend.
System
7.15
%
CPU percentiles
CPU usage percentiles
p50
19.40
%
p95
19.40
%
p99
19.40
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
26.01
%
mean
34.88
%
SD
8.87
%
p95
43.76
%
Not enough time data to show a trend.
Memory available percentage
Percentage of available memory
p5
56.24
%
mean
65.12
%
SD
8.87
%
p95
73.99
%
Not enough time data to show a trend.
Max host memory used
Maximum memory usage percentage across all hosts
max
34.88
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
2797.39
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.01
MiB/s
Disk write throughput
Disk write throughput in MiB/s
13.19
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/nomad.d/client-meta.json0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.77
5 min
1.12
15 min
0.79
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.18
%
mean
0.645
%
SD
0.465
%
p95
1.11
%
Not enough time data to show a trend.
60 second average
0.2350
%
300 second average
0.2950
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
Not enough time data to show a trend.
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
Not enough time data to show a trend.
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
Not enough time data to show a trend.
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
Not enough time data to show a trend.
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
17.49
%
mean
17.49
%
SD
0
%
p95
17.49
%
Not enough time data to show a trend.
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
187.05
KiB
mean
900.22
KiB
SD
713.17
KiB
p95
1.58
MiB
Not enough time data to show a trend.
Holochain process threads
Number of threads in Holochain process
p5
43
threads
mean
191.5
threads
SD
148.5
threads
p95
340
threads
Not enough time data to show a trend.
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
69
file descriptors
mean
391
file descriptors
SD
322
file descriptors
p95
713
file descriptors
Not enough time data to show a trend.
App Install
↑ Back to indexMeasure app installation speed. This scenario has two roles:
minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.
These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.
Started
Thu, 30 Jul 2026 03:28:33 UTC
Peer count
1
Behaviours
-
large(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
app_install_large_30510613785_1
First install time
The time from conductor startup to completion of the first app installation attempt.
0.052758592
s
Install app timing
The time taken to install an app.
mean
0.028296
s
SD
0.001771
s
p50
0.028234
s
p95
0.031412
s
p99
0.036046
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'large::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 0s
Not enough time data to show a trend.
WASM call duration: 'large::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001741
s
SD
6.4e-05
s
p50
0.001735
s
p95
0.001851
s
p99
0.001961
s
Not enough time data to show a trend.
Post-commit duration
Time spent executing post-commit workflows.
mean
5.4e-05
s
SD
1.7e-05
s
p50
5e-05
s
p95
8.5e-05
s
p99
0.000111
s
Not enough time data to show a trend.
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
8.56
s
mean
8.56
s
SD
0
s
p95
8.56
s
Not enough time data to show a trend.
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 0s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Not enough time data to show a trend.
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Not enough time data to show a trend.
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001243
s
SD
0
s
p50
0.001243
s
p95
0.001243
s
p99
0.001243
s
Not enough time data to show a trend.
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002033
s
SD
0
s
p50
0.002033
s
p95
0.002033
s
p99
0.002033
s
Not enough time data to show a trend.
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000805
s
SD
0
s
p50
0.000805
s
p95
0.000805
s
p99
0.000805
s
Not enough time data to show a trend.
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.003299
s
SD
0
s
p50
0.003299
s
p95
0.003299
s
p99
0.003299
s
Not enough time data to show a trend.
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.002313
s
SD
0
s
p50
0.002313
s
p95
0.002313
s
p99
0.002313
s
Not enough time data to show a trend.
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001152
s
SD
0
s
p50
0.001152
s
p95
0.001152
s
p99
0.001152
s
Not enough time data to show a trend.
DHT DB connection use time
Time spent holding DHT database connections.
mean
5.4e-05
s
SD
0
s
p50
5.4e-05
s
p95
5.4e-05
s
p99
5.4e-05
s
Not enough time data to show a trend.
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000734
s
SD
0.000123
s
p50
0.000913
s
p95
0.000913
s
p99
0.000913
s
Not enough time data to show a trend.
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000167
s
SD
0
s
p50
0.000167
s
p95
0.000167
s
p99
0.000167
s
Not enough time data to show a trend.
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
7.19
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
72.68
KiB/s
mean
72.68
KiB/s
SD
0
B/s
p95
72.68
KiB/s
Not enough time data to show a trend.
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
43.84
KiB/s
mean
43.84
KiB/s
SD
0
B/s
p95
43.84
KiB/s
Not enough time data to show a trend.
Total bytes received
Total bytes received on primary network interface
count
726.78
KiB
mean
72.68
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
438.43
KiB
mean
43.84
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
13.87
%
mean
13.87
%
SD
0
%
p95
13.87
%
Not enough time data to show a trend.
System
6.68
%
CPU percentiles
CPU usage percentiles
p50
13.87
%
p95
13.87
%
p99
13.87
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
25.55
%
mean
30.05
%
SD
4.5
%
p95
34.55
%
Not enough time data to show a trend.
Memory available percentage
Percentage of available memory
p5
65.45
%
mean
69.95
%
SD
4.5
%
p95
74.45
%
Not enough time data to show a trend.
Max host memory used
Maximum memory usage percentage across all hosts
max
30.05
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-1418.50
MiB/s
Disk read throughput
Disk read throughput in MiB/s
14.02
MiB/s
Disk write throughput
Disk write throughput in MiB/s
17.84
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/nomad.d/client-meta.json0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.93
5 min
1.24
15 min
0.79
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.59
%
mean
0.76
%
SD
0.17
%
p95
0.93
%
Not enough time data to show a trend.
60 second average
0.2500
%
300 second average
0.3350
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
Not enough time data to show a trend.
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
Not enough time data to show a trend.
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
Not enough time data to show a trend.
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
Not enough time data to show a trend.
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.24
%
mean
0.24
%
SD
0
%
p95
0.24
%
Not enough time data to show a trend.
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
237.79
KiB
mean
507.35
KiB
SD
269.55
KiB
p95
776.90
KiB
Not enough time data to show a trend.
Holochain process threads
Number of threads in Holochain process
p5
35
threads
mean
80.5
threads
SD
45.5
threads
p95
126
threads
Not enough time data to show a trend.
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
65
file descriptors
mean
165
file descriptors
SD
100
file descriptors
p95
265
file descriptors
Not enough time data to show a trend.
DHT Sync Lag
↑ Back to indexMeasures the lag time between an agent publishing data and other peers being able to see it. This scenario has two roles:
write: Creates entries with a timestamp field, linked to a known base hash so thatrecord_lagagents can discover them.record_lag: Repeatedly queries for links from the known base hash. When a new entry is discovered, it calculates the time difference between the entry's timestamp and the current time, giving the sync lag for that entry.
Started
Thu, 30 Jul 2026 03:31:48 UTC
Peer count
30
Peer count at end
27
Behaviours
-
record_lag(1 agent) -
write(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
dht_sync_lag_30510613785_1
Create rate
The average number of created records per agent.
Mean
mean
22.83
/s
Max
Highest per-partition mean rate
max
43.72
/s
Min
Lowest per-partition mean rate
min
9.53
/s
Sync lag timing
The average time between when a record was created and when it is first seen by an agent.
Mean
mean
1.85457858735e+30
s
SD
1.3944074093300002e+31
s
Max
Highest per-partition mean latency
max mean
8.44230287258e+30
s
Min
Lowest per-partition mean latency
min mean
367.616579
s
Sync lag rate
The average number of created records discovered per agent.
Mean
mean
139.12
/s
Max
Highest per-partition mean rate
max
626
/s
Min
Lowest per-partition mean rate
min
0
/s
Delivery ratio
The proportion of created entries successfully received by all record_lag agents.
0.0261
Sent count
The total number of entries sent (created) by write agents, by agent.
Total
93404
Agents affected
22 / 22
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
4246
Max
Highest count in any single partition
7832
Min
Lowest count in any single partition
1775
Received count
The total number of entries received by record_lag agents, by agent.
Total
12175
Agents affected
5 / 5
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
2435
Max
Highest count in any single partition
6555
Min
Lowest count in any single partition
2
Error count
The number of errors encountered during the scenario.
26
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000431
s
SD
0.001056
s
p50
0.000373
s
p95
0.003434
s
p99
0.004045
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
2
over 2667.576124016s
mean rate
91.14
/s
std
154.48
/s
p5
0
/s
p95
472.53
/s
peak
538.57
/s
WASM usage: 'timed::created_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
532096530
over 38372.537592841s
mean rate
3.27098653383e+09
/s
std
2.05375118909e+10
/s
p5
156939.53
/s
p95
9.54393647306e+09
/s
peak
4.47350070468e+11
/s
WASM usage: 'timed::get_timed_entries_local'
Metered usage count of the WASM ribosome for this zome function.
total
125406018796
over 1787.067052898s
mean rate
6.51600917001e+10
/s
std
6.10723130205e+10
/s
p5
5.302031635e+08
/s
p95
2.05888481079e+11
/s
peak
2.40996580911e+11
/s
WASM usage: 'timed_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
67749024
over 38372.537592841s
mean rate
4.3813204383e+08
/s
std
2.44555874425e+09
/s
p5
20851.05
/s
p95
1.47596194396e+09
/s
peak
5.69587075875e+10
/s
Zome call duration: 'timed::created_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.01204
s
SD
0.017727
s
p50
0.008604
s
p95
0.048995
s
p99
0.087294
s
Zome call duration: 'timed::get_timed_entries_local'
Duration of this zome call as measured by Holochain internally.
mean
0.069705
s
SD
0.213975
s
p50
0.023594
s
p95
0.677985
s
p99
0.817201
s
WASM call duration: 'timed::created_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.011197
s
SD
0.01733
s
p50
0.007738
s
p95
0.046523
s
p99
0.085487
s
WASM call duration: 'timed::get_timed_entries_local'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.069152
s
SD
0.21386
s
p50
0.022875
s
p95
0.677061
s
p99
0.816215
s
WASM call duration: 'timed_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001588
s
SD
0.00158
s
p50
0.001454
s
p95
0.004606
s
p99
0.008764
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.001979
s
SD
0.005115
s
p50
0.000703
s
p95
0.013356
s
p99
0.024057
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.001896
s
SD
0.004809
s
p50
0.000696
s
p95
0.01262
s
p99
0.022862
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000426
s
SD
0.001061
s
p50
0.000497
s
p95
0.003433
s
p99
0.004034
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.002873
s
SD
0.007815
s
p50
0.001419
s
p95
0.025996
s
p99
0.03145
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002596
s
SD
0.002891
s
p50
0.002255
s
p95
0.00942
s
p99
0.015384
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000303
s
SD
0.000669
s
p50
0.000135
s
p95
0.002294
s
p99
0.003077
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
88.58
s
mean
900.89
s
SD
518.89
s
p95
1707.96
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
115.251738
s
SD
146.703905
s
p50
0.239152
s
p95
232.685333
s
p99
775.619955
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.04052
s
SD
0.409013
s
p50
0.114993
s
p95
1.124141
s
p99
1.671161
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.004144
s
SD
0.002853
s
p50
0.003542
s
p95
0.008528
s
p99
0.015984
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.276736
s
SD
0.583254
s
p50
0.454122
s
p95
1.545304
s
p99
2.187805
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.378806
s
SD
0.362483
s
p50
0.279388
s
p95
1.111554
s
p99
1.651227
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
6.140017
s
SD
46.890311
s
p50
12.316114
s
p95
150.947065
s
p99
199.289368
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
27.196827
s
SD
88.761767
s
p50
0.111461
s
p95
154.801161
s
p99
437.969741
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001655
s
SD
0.002444
s
p50
0.001961
s
p95
0.007806
s
p99
0.012657
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.004508
s
SD
0.013569
s
p50
0.001579
s
p95
0.044742
s
p99
0.05783
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.001566
s
SD
0.004286
s
p50
0.000493
s
p95
0.011561
s
p99
0.021189
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
4.521993
s
SD
28.104754
s
p50
2.40004
s
p95
60.020837
s
p99
60.032202
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.752256
s
SD
23.002609
s
p50
3.728649
s
p95
60.001396
s
p99
60.008244
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
61.02
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
81
B/s
mean
462.83
KiB/s
SD
504.31
KiB/s
p95
898.45
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
43
B/s
mean
402.81
KiB/s
SD
353.35
KiB/s
p95
1.05
MiB/s
Total bytes received
Total bytes received on primary network interface
count
21.41
GiB
mean
12.04
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
18.63
GiB
mean
10.48
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.5%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 497.02 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (83.1% swap used)
System overload anomaly
System overload anomaly was detected
Detected
Warning 70% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
22.22
%
mean
73.11
%
SD
26.58
%
p95
97.8
%
System
12.09
%
CPU percentiles
CPU usage percentiles
p50
85.44
%
p95
97.80
%
p99
98.55
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
20
hosts
mean time
0.77
s
Memory used percentage
Percentage of memory used
p5
11.68
%
mean
18.92
%
SD
9
%
p95
40.22
%
Memory available percentage
Percentage of available memory
p5
59.78
%
mean
81.08
%
SD
9
%
p95
88.32
%
Max host memory used
Maximum memory usage percentage across all hosts
max
52.03
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
83.07
%
Memory growth rate
Rate of memory growth over time
growth
497.02
MiB/s
Disk read throughput
Disk read throughput in MiB/s
6.10
MiB/s
Disk write throughput
Disk write throughput in MiB/s
184.01
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/5
hosts
Mount Point
/efi-boot0/4
hosts
Mount Point
/etc/hostname0/8
hosts
Mount Point
/etc/hosts0/8
hosts
Mount Point
/etc/nomad.d/client-meta.json0/15
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/8
hosts
Mount Point
/nix/store0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
5.81
5 min
5.10
15 min
3.53
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
70.37
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
35.5002
%
SD
26.5476
%
p95
74.7
%
60 second average
34.5043
%
300 second average
30.0266
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0.0002
%
SD
0.0146
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0.0002
%
SD
0.0146
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
11.3853
%
SD
17.7185
%
p95
51.19
%
60 second average
11.0933
%
300 second average
9.6389
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
4.4424
%
SD
7.8416
%
p95
21.17
%
60 second average
4.3296
%
300 second average
3.7995
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.15
%
mean
41.61
%
SD
36.16
%
p95
95.08
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
228.17
KiB
mean
400.86
KiB
SD
175.90
KiB
p95
674.94
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
mean
38.28
threads
SD
22.13
threads
p95
65
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
7
file descriptors
mean
80.33
file descriptors
SD
27.33
file descriptors
p95
108
file descriptors
First Call
↑ Back to indexThis scenario installs a simple app which implements the init callback, and measures the time elapsed between start of install and calling init. It will uninstall the app it installed so that it can re-install it on the next iteration. This is required to re-run the initialisation callback.
Started
Thu, 30 Jul 2026 03:14:18 UTC
Peer count
1
Behaviours
-
default(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
first_call_30510613785_1
Zome call timing
The time elapsed between start of install and calling
init.mean
0.006429
s
SD
0.000716
s
p50
0.006393
s
p95
0.007749
s
p99
0.008543
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 0s
Not enough time data to show a trend.
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 0s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 0s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.002276
s
SD
0
s
p50
0.002276
s
p95
0.002276
s
p99
0.002276
s
Not enough time data to show a trend.
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001895
s
SD
0.000163
s
p50
0.001871
s
p95
0.002214
s
p99
0.002289
s
Not enough time data to show a trend.
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000984
s
SD
0.000149
s
p50
0.000947
s
p95
0.001114
s
p99
0.00164
s
Not enough time data to show a trend.
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000634
s
SD
0
s
p50
0.000634
s
p95
0.000634
s
p99
0.000634
s
Not enough time data to show a trend.
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000199
s
SD
2.7e-05
s
p50
0.000226
s
p95
0.000226
s
p99
0.000226
s
Not enough time data to show a trend.
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000949
s
SD
0
s
p50
0.000949
s
p95
0.000949
s
p99
0.000949
s
Not enough time data to show a trend.
Post-commit duration
Time spent executing post-commit workflows.
mean
4e-05
s
SD
1.1e-05
s
p50
3.8e-05
s
p95
5.9e-05
s
p99
8e-05
s
Not enough time data to show a trend.
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
8.39
s
mean
8.39
s
SD
0
s
p95
8.39
s
Not enough time data to show a trend.
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 0s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Not enough time data to show a trend.
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Not enough time data to show a trend.
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001005
s
SD
0
s
p50
0.001005
s
p95
0.001005
s
p99
0.001005
s
Not enough time data to show a trend.
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001969
s
SD
0
s
p50
0.001969
s
p95
0.001969
s
p99
0.001969
s
Not enough time data to show a trend.
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000762
s
SD
0
s
p50
0.000762
s
p95
0.000762
s
p99
0.000762
s
Not enough time data to show a trend.
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.002831
s
SD
0
s
p50
0.002831
s
p95
0.002831
s
p99
0.002831
s
Not enough time data to show a trend.
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.002057
s
SD
0
s
p50
0.002057
s
p95
0.002057
s
p99
0.002057
s
Not enough time data to show a trend.
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001314
s
SD
0
s
p50
0.001314
s
p95
0.001314
s
p99
0.001314
s
Not enough time data to show a trend.
DHT DB connection use time
Time spent holding DHT database connections.
mean
5.4e-05
s
SD
0
s
p50
5.4e-05
s
p95
5.4e-05
s
p99
5.4e-05
s
Not enough time data to show a trend.
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000663
s
SD
8.8e-05
s
p50
0.000801
s
p95
0.000801
s
p99
0.000801
s
Not enough time data to show a trend.
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000156
s
SD
0
s
p50
0.000156
s
p95
0.000156
s
p99
0.000156
s
Not enough time data to show a trend.
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
12.24
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.68
MiB/s
mean
1.68
MiB/s
SD
0
B/s
p95
1.68
MiB/s
Not enough time data to show a trend.
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
45.63
KiB/s
mean
45.63
KiB/s
SD
0
B/s
p95
45.63
KiB/s
Not enough time data to show a trend.
Total bytes received
Total bytes received on primary network interface
count
16.82
MiB
mean
1.68
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
456.26
KiB
mean
45.63
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 2726.16 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
17.63
%
mean
17.63
%
SD
0
%
p95
17.63
%
Not enough time data to show a trend.
System
5.39
%
CPU percentiles
CPU usage percentiles
p50
17.63
%
p95
17.63
%
p99
17.63
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
10.76
%
mean
19.41
%
SD
8.65
%
p95
28.05
%
Not enough time data to show a trend.
Memory available percentage
Percentage of available memory
p5
71.95
%
mean
80.59
%
SD
8.65
%
p95
89.24
%
Not enough time data to show a trend.
Max host memory used
Maximum memory usage percentage across all hosts
max
19.41
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
2726.16
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.01
MiB/s
Disk write throughput
Disk write throughput in MiB/s
9.59
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/nomad.d/client-meta.json0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.12
5 min
0.03
15 min
0.01
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0.19
%
SD
0.19
%
p95
0.38
%
Not enough time data to show a trend.
60 second average
0.0450
%
300 second average
0.0050
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
Not enough time data to show a trend.
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
Not enough time data to show a trend.
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
Not enough time data to show a trend.
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
Not enough time data to show a trend.
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
mean
0
%
SD
0
%
p95
0
%
Not enough time data to show a trend.
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
1.21
MiB
mean
1.21
MiB
SD
0
B
p95
1.21
MiB
Not enough time data to show a trend.
Holochain process threads
Number of threads in Holochain process
p5
239
threads
mean
239
threads
SD
0
threads
p95
239
threads
Not enough time data to show a trend.
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
503
file descriptors
mean
503
file descriptors
SD
0
file descriptors
p95
503
file descriptors
Not enough time data to show a trend.
Full-Arc Create (Validated) / Zero-Arc Read
↑ Back to indexA full-arc/zero-arc mixed scenario where full-arc nodes create data that gets validated and zero-arc nodes read the data. The scenario has two roles:
full: A full-arc conductor that creates entries with a timestamp field. Those entries get validated and then retrieved by zero-arc nodes.zero: A zero-arc conductor that reads the entries created by the full-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Thu, 30 Jul 2026 06:37:53 UTC
Peer count
30
Peer count at end
27
Behaviours
-
full(1 agent) -
zero(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
full_arc_create_validated_zero_arc_read--high_zero_30510613785_1
Create rate
The number of timed entries created by the full-arc node(s) per second.
Mean
mean
34.79
/s
Max
Highest per-partition mean rate
max
47.65
/s
Min
Lowest per-partition mean rate
min
21.93
/s
Fetch lag timing
For each entry, the time lag between when it was created by a full-arc node and when a zero-arc node fetched it from the network.
Mean
mean
180.596506
s
SD
67.407133
s
Max
Highest per-partition mean latency
max mean
1204.293372
s
Min
Lowest per-partition mean latency
min mean
6.339205
s
Fetch rate
The number of entries per second fetched by zero-arc nodes.
Mean
mean
166.27
/s
Max
Highest per-partition mean rate
max
488.09
/s
Min
Lowest per-partition mean rate
min
0
/s
Delivery ratio
The proportion of created entries successfully fetched by all zero-arc nodes.
0.1903
Entry created count
Total number of entries created by full-arc nodes, by agent.
Total
6458
Agents affected
2 / 2
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
3229
Max
Highest count in any single partition
4495
Min
Lowest count in any single partition
1963
Received count
Total number of entries fetched by zero-arc nodes, by agent.
Total
30723
Agents affected
11 / 25
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
1229
Max
Highest count in any single partition
6072
Min
Lowest count in any single partition
0
Open connections
The number of currently open connections to other conductors.
full-arc
p5
24
mean
23.72
SD
2.03
p95
24
zero-arc
p5
0
mean
4.47
SD
6.19
p95
16
Retrieval errors
Errors encountered by zero-arc nodes when attempting to retrieve entries created by full-arc nodes.
Total
294
Agents affected
23 / 25
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
12
Max
Highest count in any single partition
14
Min
Lowest count in any single partition
0
Error count
The number of errors accumulated across all nodes.
300
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.007897
s
SD
0.17863
s
p50
0.050027
s
p95
0.207808
s
p99
0.40816
s
WASM usage: 'timed_and_validated::create_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
122738028
over 885.374017277s
mean rate
2.925007746e+07
/s
std
8.0024854e+06
/s
p5
1.231794632e+07
/s
p95
3.786486019e+07
/s
peak
3.854476701e+07
/s
WASM usage: 'timed_and_validated::get_timed_entries_network'
Metered usage count of the WASM ribosome for this zome function.
total
3985182192
over 37461.030683997s
mean rate
1.77329165121e+10
/s
std
3.7611548395e+10
/s
p5
2.40787623e+06
/s
p95
1.28321394803e+11
/s
peak
1.9054130605e+11
/s
WASM usage: 'timed_and_validated_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
415308106
over 37461.43196924s
mean rate
1.71671398867e+09
/s
std
2.82519854155e+10
/s
p5
0
/s
p95
1.43216919655e+09
/s
peak
7.94169873077e+11
/s
WASM usage: 'timed_and_validated_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37461.030683997s
Not enough time data to show a trend.
Zome call duration: 'timed_and_validated::create_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.007594
s
SD
0.004728
s
p50
0.006772
s
p95
0.015184
s
p99
0.015309
s
Zome call duration: 'timed_and_validated::get_timed_entries_network'
Duration of this zome call as measured by Holochain internally.
mean
0.046445
s
SD
56.999988
s
p50
0.41228
s
p95
157.877046
s
p99
162.052987
s
WASM call duration: 'timed_and_validated::create_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006968
s
SD
0.004615
s
p50
0.006154
s
p95
0.014407
s
p99
0.014531
s
WASM call duration: 'timed_and_validated::get_timed_entries_network'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.158804
s
SD
56.781666
s
p50
1.400031
s
p95
147.769311
s
p99
160.073929
s
WASM call duration: 'timed_and_validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001081
s
SD
0.000724
s
p50
0.001073
s
p95
0.003091
s
p99
0.003155
s
WASM call duration: 'timed_and_validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.009782
s
SD
0.003653
s
p50
0.000987
s
p95
0.011384
s
p99
0.021235
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000629
s
SD
0.00055
s
p50
0.000449
s
p95
0.001517
s
p99
0.001525
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000543
s
SD
0.000434
s
p50
0.000464
s
p95
0.001239
s
p99
0.001253
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.007974
s
SD
0.24875
s
p50
0.072203
s
p95
0.223971
s
p99
0.491751
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.00493
s
SD
1.360695
s
p50
0.073817
s
p95
4.15473
s
p99
6.521511
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.023651
s
SD
0.013734
s
p50
0.018056
s
p95
0.042572
s
p99
0.043326
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001776
s
SD
0.001195
s
p50
0.001636
s
p95
0.004631
s
p99
0.004727
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000127
s
SD
0.000167
s
p50
0.000104
s
p95
0.000388
s
p99
0.000919
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.93
s
mean
446.95
s
SD
256.92
s
p95
846.98
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 37461.431913452s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
140.949679
s
SD
35.779946
s
p50
0
s
p95
65.482367
s
p99
238.621678
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
6.45885
s
SD
4.232566
s
p50
0.001646
s
p95
5.130558
s
p99
26.291251
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.004136
s
SD
0.003221
s
p50
0.002858
s
p95
0.01313
s
p99
0.016442
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.066822
s
SD
0.050937
s
p50
0.001475
s
p95
0.00864
s
p99
0.294549
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.168232
s
SD
0.052195
s
p50
0.018974
s
p95
0.109309
s
p99
0.321062
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
18.895957
s
SD
16.016181
s
p50
0.003267
s
p95
46.773193
s
p99
90.412127
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
6.96316
s
SD
6.572375
s
p50
0.002878
s
p95
13.856321
s
p99
37.912421
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.00067
s
SD
0.002257
s
p50
0.000123
s
p95
0.006018
s
p99
0.011846
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.006095
s
SD
0.005379
s
p50
0.001883
s
p95
0.013944
s
p99
0.029242
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000352
s
SD
0.000186
s
p50
0.00034
s
p95
0.000593
s
p99
0.001162
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.944482
s
SD
29.85836
s
p50
0.262631
s
p95
60.001467
s
p99
60.002092
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.311468
s
SD
7.923721
s
p50
0.585734
s
p95
3.085412
s
p99
60.000781
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
1.08889
s
SD
7.782294
s
p50
1.063477
s
p95
1.802034
s
p99
60.001225
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
10.20
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
77
B/s
mean
65.60
KiB/s
SD
178.66
KiB/s
p95
288.96
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
50
B/s
mean
63.03
KiB/s
SD
317.23
KiB/s
p95
271.22
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.51
GiB
mean
1.72
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.45
GiB
mean
1.65
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.6%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 117.17 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (82.4% swap used)
System overload anomaly
System overload anomaly was detected
Detected
Warning 4% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.51
%
mean
15.54
%
SD
24.91
%
p95
88.86
%
System
5.35
%
CPU percentiles
CPU usage percentiles
p50
4.31
%
p95
88.86
%
p99
98.60
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
6
hosts
mean time
0.29
s
Memory used percentage
Percentage of memory used
p5
12.34
%
mean
17.53
%
SD
8.94
%
p95
37.26
%
Memory available percentage
Percentage of available memory
p5
62.74
%
mean
82.47
%
SD
8.94
%
p95
87.66
%
Max host memory used
Maximum memory usage percentage across all hosts
max
52.11
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
82.42
%
Memory growth rate
Rate of memory growth over time
growth
117.17
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.11
MiB/s
Disk write throughput
Disk write throughput in MiB/s
38.66
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/5
hosts
Mount Point
/efi-boot0/4
hosts
Mount Point
/etc/hostname0/8
hosts
Mount Point
/etc/hosts0/8
hosts
Mount Point
/etc/nomad.d/client-meta.json0/15
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/8
hosts
Mount Point
/nix/store0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.19
5 min
1.27
15 min
1.42
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
3.70
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
5.0639
%
SD
18.1563
%
p95
36.57
%
60 second average
4.9346
%
300 second average
4.7669
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
3.519
%
SD
8.6102
%
p95
27.61
%
60 second average
3.6597
%
300 second average
3.9382
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
3.4154
%
SD
8.466
%
p95
26.95
%
60 second average
3.5051
%
300 second average
3.5266
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.02
%
mean
11.05
%
SD
23.87
%
p95
87.88
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
362.95
KiB
mean
463.88
KiB
SD
105.48
KiB
p95
696.59
KiB
Holochain process threads
Number of threads in Holochain process
p5
16
threads
mean
29.46
threads
SD
13.4
threads
p95
53
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
44
file descriptors
mean
61.52
file descriptors
SD
15.4
file descriptors
p95
81
file descriptors
Local Signals
↑ Back to indexThis scenario is for testing the speed and reliability of local signals. It uses a zome with a function that will emit 10,000 signals. The scenario measures how long it takes to send the signals and how many have been received by the time the zome call ends.
Started
Thu, 30 Jul 2026 03:15:45 UTC
Peer count
1
Behaviours
-
default(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
local_signals_30510613785_1
Send timing
The time taken to emit a batch of 10,000 signals.
mean
2.075599
s
SD
1.05062
s
p50
2.510569
s
p95
3.498666
s
p99
3.498666
s
Receive timing
The time taken to receive the completed batch, to the nearest 250ms.
mean
27.670368
s
SD
6.9932
s
p50
30.001437
s
p95
30.002094
s
p99
30.002094
s
Success ratio
The proportion of signals successfully received in a batch.
min
0.8172000050544739
mean
0.8754
SD
0.0515
max
0.9868999719619752
Holochain MetricsClick to toggle visibility.
WASM usage: 'signal::emit_10k_signals'
Metered usage count of the WASM ribosome for this zome function.
total
277609437
over 280.002398323s
mean rate
991453.26
/s
std
1.44054819e+06
/s
p5
0
/s
p95
3.08452755e+06
/s
peak
3.08452946e+06
/s
Zome call duration: 'signal::emit_10k_signals'
Duration of this zome call as measured by Holochain internally.
mean
0.046261
s
SD
0.000426
s
p50
0.046284
s
p95
0.046684
s
p99
0.046684
s
WASM call duration: 'signal::emit_10k_signals'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.045789
s
SD
0.000437
s
p50
0.045833
s
p95
0.046261
s
p99
0.046261
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
3e-06
s
SD
0
s
p50
3e-06
s
p95
3e-06
s
p99
3e-06
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
90000
over 280.002378333s
mean rate
321.43
/s
std
467.02
/s
p5
0
/s
p95
999.99
/s
peak
999.99
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
7e-05
s
SD
0
s
p50
7e-05
s
p95
7e-05
s
p99
7e-05
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.44
s
mean
148.44
s
SD
83.67
s
p95
278.44
s
Dropped WebSocket signals
Count of signals dropped from the app WebSocket due to channel overload.
total
733
over 280.002409892s
mean rate
2.62
/s
std
5.12
/s
p5
0
/s
p95
8.8
/s
peak
24.6
/s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.002423746s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.002076
s
SD
0
s
p50
0.002076
s
p95
0.002076
s
p99
0.002076
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.004202
s
SD
0
s
p50
0.004202
s
p95
0.004202
s
p99
0.004202
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001702
s
SD
0
s
p50
0.001702
s
p95
0.001702
s
p99
0.001702
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.004914
s
SD
0.001144
s
p50
0.005201
s
p95
0.007187
s
p99
0.007187
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001461
s
SD
0
s
p50
0.001461
s
p95
0.001461
s
p99
0.001461
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.00335
s
SD
0
s
p50
0.00335
s
p95
0.00335
s
p99
0.00335
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
8.2e-05
s
SD
3e-06
s
p50
8.3e-05
s
p95
8.3e-05
s
p99
8.3e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000794
s
SD
0.000183
s
p50
0.001045
s
p95
0.001045
s
p99
0.001045
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000166
s
SD
0
s
p50
0.000166
s
p95
0.000166
s
p99
0.000166
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
1.61
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
364
B/s
mean
443.13
KiB/s
SD
1.53
MiB/s
p95
6.03
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
152
B/s
mean
18.69
KiB/s
SD
27.45
KiB/s
p95
105.38
KiB/s
Total bytes received
Total bytes received on primary network interface
count
125.50
MiB
mean
443.13
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
5.29
MiB
mean
18.69
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 1399.94 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.18
%
mean
4.23
%
SD
4.65
%
p95
12.36
%
System
2.63
%
CPU percentiles
CPU usage percentiles
p50
2.27
%
p95
12.36
%
p99
19.15
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
13.59
%
mean
20.89
%
SD
5.52
%
p95
28.79
%
Memory available percentage
Percentage of available memory
p5
71.21
%
mean
79.11
%
SD
5.52
%
p95
86.41
%
Max host memory used
Maximum memory usage percentage across all hosts
max
20.89
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1399.94
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
3.16
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/nomad.d/client-meta.json0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.18
5 min
0.51
15 min
0.19
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.04
%
mean
0.846
%
SD
1.2216
%
p95
3.23
%
60 second average
0.6353
%
300 second average
0.2590
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.07
%
mean
0.42
%
SD
0.33
%
p95
0.95
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
230.10
KiB
mean
242.66
KiB
SD
9.96
KiB
p95
256.86
KiB
Holochain process threads
Number of threads in Holochain process
p5
31
threads
mean
37.57
threads
SD
6.03
threads
p95
48
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
59
file descriptors
mean
70.63
file descriptors
SD
10.98
file descriptors
p95
90
file descriptors
Mixed Arc get_agent_activity
↑ Back to index
A mixed-arc scenario that measures the DHT's ability to propagate agent activity and make it available via get_agent_activity calls. The scenario has three roles:
zero_write: A zero-arc conductor that creates entries on its source chain.full_write: A full-arc conductor that creates entries on its source chain.zero_read: A zero-arc conductor that picks a random writer and repeatedly callsget_agent_activityto observe new entries appearing on the writer's chain, measuring the lag between creation and discovery.
Started
Thu, 30 Jul 2026 06:53:28 UTC
Peer count
30
Peer count at end
25
Behaviours
-
full_write(1 agent) -
zero_read(1 agent) -
zero_write(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
mixed_arc_get_agent_activity_30510613785_1
Entry created count
The total number of entries created by write agents over the run, partitioned by agent and behaviour.
Total
98335
Agents affected
18 / 18
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
5463
Max
Highest count in any single partition
13393
Min
Lowest count in any single partition
1596
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1844.4
Max
Highest chain head value observed for any single write agent.
2752
Write agents observed
5
Chain head delay timing
The time lag between when a writer creates a new entry and when a reader discovers it via
get_agent_activity. This is measured per new action in the chain.Mean
mean
0.028158
s
SD
0.110286
s
Max
Highest per-partition mean latency
max mean
0.084495
s
Min
Lowest per-partition mean latency
min mean
0.000601
s
Chain head delay rate
The rate at which readers detect new chain heads appearing on writers' chains.
Mean
mean
23.52
/s
Max
Highest per-partition mean rate
max
30.83
/s
Min
Lowest per-partition mean rate
min
5.43
/s
get_agent_activity_full zome call timingThe time taken to complete the
get_agent_activity_full zome call that queries a writer's chain.Mean
mean
0.102583
s
SD
0.085427
s
Max
Highest per-partition mean latency
max mean
0.252335
s
Min
Lowest per-partition mean latency
min mean
0.01321
s
Retrieval errors
A running accumulation of errors encountered by read agents when calling
get_agent_activity.Total
1
Agents affected
1 / 7
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
0
Max
Highest count in any single partition
1
Min
Lowest count in any single partition
0
Open connections
The number of currently open connections to other conductors, partitioned by agent behaviour.
behaviour:full_write
p5
24
mean
23.9
SD
0.94
p95
24
behaviour:zero_read
p5
0
mean
16.39
SD
6.5
p95
24
behaviour:zero_write
p5
14
mean
17.46
SD
2.28
p95
21
Final error count
The total number of errors accumulated across all agents over the run.
7
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.037584
s
SD
0.071702
s
p50
0.05587
s
p95
0.206524
s
p99
0.225603
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 1723.292448086s
Not enough time data to show a trend.
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.006513
s
SD
0.004343
s
p50
0.005211
s
p95
0.017306
s
p99
0.017306
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005019
s
SD
0.006594
s
p50
0.0053
s
p95
0.020417
s
p99
0.03095
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.039622
s
SD
0.060567
s
p50
0.052442
s
p95
0.213289
s
p99
0.237867
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.01081
s
SD
0.077981
s
p50
0.135094
s
p95
0.211959
s
p99
0.211959
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005673
s
SD
0.004209
s
p50
0.004311
s
p95
0.016735
s
p99
0.016735
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004414
s
SD
0.006377
s
p50
0.00452
s
p95
0.019099
s
p99
0.029412
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.039424
s
SD
0.060031
s
p50
0.051522
s
p95
0.211295
s
p99
0.235868
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.010504
s
SD
0.077961
s
p50
0.134184
s
p95
0.210951
s
p99
0.210951
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001306
s
SD
0.0012
s
p50
0.001586
s
p95
0.003736
s
p99
0.006903
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.2e-05
s
SD
1.2e-05
s
p50
1.7e-05
s
p95
4.9e-05
s
p99
4.9e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.001022
s
SD
0.002864
s
p50
0.00072
s
p95
0.008211
s
p99
0.011731
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000906
s
SD
0.001127
s
p50
0.000437
s
p95
0.004431
s
p99
0.004431
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.037912
s
SD
0.059017
s
p50
0.049771
s
p95
0.206635
s
p99
0.231355
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.00915
s
SD
0.077894
s
p50
0.131012
s
p95
0.206598
s
p99
0.206598
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
3e-06
s
SD
5e-06
s
p50
1e-05
s
p95
2e-05
s
p99
2e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002115
s
SD
0.002316
s
p50
0.002164
s
p95
0.007827
s
p99
0.011885
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000209
s
SD
0.000448
s
p50
0.000129
s
p95
0.00119
s
p99
0.002298
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.97
s
mean
447.49
s
SD
257.37
s
p95
847.75
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 37461.382472248s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
20.197949
s
SD
19.449204
s
p50
0
s
p95
48.37415
s
p99
104.186475
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.087831
s
SD
0.121442
s
p50
0.001921
s
p95
0.28877
s
p99
0.586059
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.004367
s
SD
0.002638
s
p50
0.00356
s
p95
0.011759
s
p99
0.012347
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.066198
s
SD
0.299729
s
p50
0.002004
s
p95
0.868083
s
p99
1.223301
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.085676
s
SD
0.072254
s
p50
0.048202
s
p95
0.218298
s
p99
0.254825
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
9.421626
s
SD
14.654917
s
p50
0.006463
s
p95
36.841239
s
p99
79.248463
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
8.659258
s
SD
21.318374
s
p50
0.003045
s
p95
1.069409
s
p99
116.138814
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002613
s
SD
0.001791
s
p50
0.001398
s
p95
0.005366
s
p99
0.006518
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003645
s
SD
0.004164
s
p50
0.001312
s
p95
0.005178
s
p99
0.027255
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000963
s
SD
0.002417
s
p50
0.000398
s
p95
0.006932
s
p99
0.011155
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
9.707438
s
SD
29.803282
s
p50
0.666032
s
p95
60.007022
s
p99
60.007061
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.100095
s
SD
0.067313
s
p50
0.127948
s
p95
0.204013
s
p99
0.204013
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.061493
s
SD
17.134801
s
p50
0.063368
s
p95
60.001148
s
p99
60.001148
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.122345
s
SD
1.152711
s
p50
0.137964
s
p95
5.017285
s
p99
5.017861
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
41.42
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
79
B/s
mean
329.32
KiB/s
SD
365.99
KiB/s
p95
828.23
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
49
B/s
mean
305.23
KiB/s
SD
281.77
KiB/s
p95
769.36
KiB/s
Total bytes received
Total bytes received on primary network interface
count
7.58
GiB
mean
8.63
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
7.03
GiB
mean
8.00
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.3%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 285.19 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (82.4% swap used)
System overload anomaly
System overload anomaly was detected
Detected
Warning 37% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.08
%
mean
50.8
%
SD
39.28
%
p95
98.15
%
System
9.37
%
CPU percentiles
CPU usage percentiles
p50
59.56
%
p95
98.15
%
p99
98.30
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
11
hosts
mean time
0.88
s
Memory used percentage
Percentage of memory used
p5
10.68
%
mean
15.78
%
SD
9.05
%
p95
34.33
%
Memory available percentage
Percentage of available memory
p5
65.67
%
mean
84.22
%
SD
9.05
%
p95
89.32
%
Max host memory used
Maximum memory usage percentage across all hosts
max
51.78
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
82.42
%
Memory growth rate
Rate of memory growth over time
growth
285.19
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.02
MiB/s
Disk write throughput
Disk write throughput in MiB/s
92.29
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/5
hosts
Mount Point
/efi-boot0/4
hosts
Mount Point
/etc/hostname0/8
hosts
Mount Point
/etc/hosts0/8
hosts
Mount Point
/etc/nomad.d/client-meta.json0/15
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/8
hosts
Mount Point
/nix/store0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.59
5 min
2.94
15 min
2.19
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
37.04
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
28.5192
%
SD
32.3387
%
p95
83.52
%
60 second average
27.1237
%
300 second average
21.3024
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
4.017
%
SD
8.4704
%
p95
25
%
60 second average
3.9866
%
300 second average
3.7680
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
1.9663
%
SD
5.998
%
p95
8.73
%
60 second average
2.0561
%
300 second average
2.3252
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.25
%
mean
46.03
%
SD
38.62
%
p95
96.13
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
222.69
KiB
mean
318.96
KiB
SD
100.85
KiB
p95
545.88
KiB
Holochain process threads
Number of threads in Holochain process
p5
23
threads
mean
34.36
threads
SD
14.28
threads
p95
66
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
57
file descriptors
mean
72.41
file descriptors
SD
19.51
file descriptors
p95
89
file descriptors
Mixed Arc must_get_agent_activity
↑ Back to index
A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.
The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.
This test is similar to Write Validated must_get_agent_activity, but some write agents are zero-arc and all must_get_agent_activity agents are zero-arc. This forces the must_get_agent_activity host call to go to the network.
Started
Thu, 30 Jul 2026 07:09:09 UTC
Peer count
30
Peer count at end
25
Behaviours
-
full_write(1 agent) -
zero_must_get_agent_activity(1 agent) -
zero_write(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
mixed_arc_must_get_agent_activity_30510613785_1
Highest observed
action_seqThe maximum chain length observed per
write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1420.33
Max
Highest chain head value observed for any single write agent.
1798
Write agents observed
3
Chain batch delay timing
The time between a
write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.Mean
mean
216.546097
s
SD
32.138967
s
Max
Highest per-partition mean latency
max mean
1014.962219
s
Min
Lowest per-partition mean latency
min mean
9.820374
s
Chain batch delay rate
The rate at which a
must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.Mean
mean
2.64
/s
Max
Highest per-partition mean rate
max
5
/s
Min
Lowest per-partition mean rate
min
1.92
/s
create_validated_sample_entry zome call timingThe time taken to complete the zome function call that creates the entry that depends on a
write agent's source chain.Mean
mean
0.295648
s
SD
0.194119
s
Max
Highest per-partition mean latency
max mean
0.463771
s
Min
Lowest per-partition mean latency
min mean
0.162179
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on
must_get_agent_activity calls.Total
52746
Agents affected
7 / 7
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
7535
Max
Highest count in any single partition
34108
Min
Lowest count in any single partition
592
Open connections
The average number of open connections maintained by an agent over the run, broken down by behaviour.
behaviour:full_write
p5
24
mean
23.89
SD
1.12
p95
24
behaviour:zero_must_get_agent_activity
p5
0
mean
12.19
SD
5.37
p95
19
behaviour:zero_write
p5
10
mean
15.71
SD
3.46
p95
21
Final error count
The total number of all types of error accumulated over the run by all agents.
60423
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.045591
s
SD
0.099091
s
p50
0.095288
s
p95
0.283286
s
p99
0.349609
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 1801.378610577s
Not enough time data to show a trend.
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.006435
s
SD
0.003303
s
p50
0.006544
s
p95
0.012794
s
p99
0.012794
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.072231
s
SD
0.067375
s
p50
0.043702
s
p95
0.187666
s
p99
0.412558
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.003456
s
SD
0.002896
s
p50
0.006226
s
p95
0.009447
s
p99
0.009632
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.110154
s
SD
0.061313
s
p50
0.073173
s
p95
0.225157
s
p99
0.231034
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.185118
s
SD
0.090472
s
p50
0.167637
s
p95
0.288603
s
p99
0.288603
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005409
s
SD
0.002867
s
p50
0.005462
s
p95
0.010833
s
p99
0.010833
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.071306
s
SD
0.066894
s
p50
0.0429
s
p95
0.186412
s
p99
0.409514
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002827
s
SD
0.002449
s
p50
0.00523
s
p95
0.007977
s
p99
0.008113
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.224339
s
SD
0.074959
s
p50
0.175662
s
p95
0.35256
s
p99
0.367337
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.184132
s
SD
0.090576
s
p50
0.166267
s
p95
0.287611
s
p99
0.287611
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001087
s
SD
0.000749
s
p50
0.001019
s
p95
0.002946
s
p99
0.003211
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00919
s
SD
0.018156
s
p50
0.00338
s
p95
0.045559
s
p99
0.089769
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.3e-05
s
SD
1.7e-05
s
p50
2e-05
s
p95
5.3e-05
s
p99
9.6e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000328
s
SD
0.000351
s
p50
0.000365
s
p95
0.000763
s
p99
0.001987
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000476
s
SD
0.000453
s
p50
0.000384
s
p95
0.002059
s
p99
0.002315
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.219443
s
SD
0.086645
s
p50
0.164593
s
p95
0.325218
s
p99
0.357545
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.032052
s
SD
0.06611
s
p50
0.026127
s
p95
0.215457
s
p99
0.279953
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.031231
s
SD
0.044064
s
p50
0.011929
s
p95
0.089743
s
p99
0.266313
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1.2e-05
s
SD
2e-06
s
p50
1.1e-05
s
p95
1.6e-05
s
p99
1.6e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00176
s
SD
0.00138
s
p50
0.001994
s
p95
0.005226
s
p99
0.006642
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000144
s
SD
0.000145
s
p50
0.0001
s
p95
0.000355
s
p99
0.000888
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.94
s
mean
449.09
s
SD
258.12
s
p95
848.58
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 37460.869294181s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
96.626271
s
SD
55.432896
s
p50
0
s
p95
154.006333
s
p99
233.205422
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
2.254747
s
SD
1.254264
s
p50
0.002789
s
p95
3.601344
s
p99
4.236879
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.00455
s
SD
0.004724
s
p50
0.003644
s
p95
0.010888
s
p99
0.02708
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.301371
s
SD
0.289857
s
p50
0.001445
s
p95
0.536722
s
p99
1.610316
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.125796
s
SD
0.166614
s
p50
0.018941
s
p95
0.49504
s
p99
0.821034
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
8.839734
s
SD
12.785547
s
p50
0.004534
s
p95
39.006182
s
p99
67.887025
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
21.935877
s
SD
18.730078
s
p50
0.003194
s
p95
45.853959
s
p99
57.202099
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002315
s
SD
0.001897
s
p50
0.000228
s
p95
0.00528
s
p99
0.008439
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00432
s
SD
0.005836
s
p50
0.001739
s
p95
0.019162
s
p99
0.02875
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000313
s
SD
0.000317
s
p50
0.000303
s
p95
0.000646
s
p99
0.001758
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
1.503881
s
SD
29.181459
s
p50
0.105482
s
p95
60.001357
s
p99
60.001428
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.111003
s
SD
21.762492
s
p50
0.126499
s
p95
60.001857
s
p99
60.002095
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
0.090257
s
SD
28.224841
s
p50
0.123398
s
p95
60.001531
s
p99
60.001805
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.133904
s
SD
2.508878
s
p50
0.184115
s
p95
5.467214
s
p99
5.749262
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
19.01
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
84
B/s
mean
111.03
KiB/s
SD
427.79
KiB/s
p95
220.60
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
42
B/s
mean
71.95
KiB/s
SD
108.34
KiB/s
p95
167.84
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.56
GiB
mean
2.89
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.66
GiB
mean
1.87
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.2%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 546.58 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (82.4% swap used)
System overload anomaly
System overload anomaly was detected
Detected
Warning 19% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.06
%
mean
26.2
%
SD
29.6
%
p95
91.96
%
System
7.19
%
CPU percentiles
CPU usage percentiles
p50
9.57
%
p95
91.96
%
p99
98.15
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
7
hosts
mean time
0.37
s
Memory used percentage
Percentage of memory used
p5
11.74
%
mean
17.35
%
SD
9
%
p95
36.96
%
Memory available percentage
Percentage of available memory
p5
63.04
%
mean
82.65
%
SD
9
%
p95
88.26
%
Max host memory used
Maximum memory usage percentage across all hosts
max
52.66
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
82.42
%
Memory growth rate
Rate of memory growth over time
growth
546.58
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.11
MiB/s
Disk write throughput
Disk write throughput in MiB/s
69.62
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/5
hosts
Mount Point
/efi-boot0/4
hosts
Mount Point
/etc/hostname0/8
hosts
Mount Point
/etc/hosts0/8
hosts
Mount Point
/etc/nomad.d/client-meta.json0/15
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/8
hosts
Mount Point
/nix/store0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.60
5 min
2.06
15 min
2.28
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
18.52
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
6.8492
%
SD
16.7497
%
p95
50.05
%
60 second average
7.4692
%
300 second average
12.1865
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
4.1618
%
SD
10.0064
%
p95
30.06
%
60 second average
4.0889
%
300 second average
3.9567
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
3.114
%
SD
7.3062
%
p95
21.11
%
60 second average
3.0315
%
300 second average
2.6885
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.24
%
mean
18.91
%
SD
27.13
%
p95
84.79
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
334.77
KiB
mean
440.76
KiB
SD
151.27
KiB
p95
665.20
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
mean
35.08
threads
SD
23.48
threads
p95
52
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
42
file descriptors
mean
72.56
file descriptors
SD
28.56
file descriptors
p95
95
file descriptors
Remote Call Rate
↑ Back to indexTest the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.
Started
Thu, 30 Jul 2026 03:17:09 UTC
Peer count
10
Peer count at end
9
Behaviours
-
default(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
remote_call_rate_30510613785_1
Dispatch timing
The time between sending a remote call and the remote handler being invoked.
Mean
mean
0.046337
s
SD
0.115447
s
Max
Highest per-partition mean latency
max mean
0.09049
s
Min
Lowest per-partition mean latency
min mean
-0.180978
s
Round-trip timing
The total elapsed time to get a response to the client.
Mean
mean
0.112422
s
SD
0.103599
s
Max
Highest per-partition mean latency
max mean
0.153102
s
Min
Lowest per-partition mean latency
min mean
0.051666
s
Error count
The total number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_call::call_echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
187353354
over 894.367392862s
mean rate
9.6169520341e+08
/s
std
1.96095549684e+09
/s
p5
794644.12
/s
p95
6.13613033509e+09
/s
peak
7.65521096987e+09
/s
WASM usage: 'remote_call::echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
53513315
over 894.367392862s
mean rate
1.0844895e+06
/s
std
1.53492039e+06
/s
p5
34770.34
/s
p95
4.669393e+06
/s
peak
6.2450155e+06
/s
WASM usage: 'remote_call::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 894.367392862s
Not enough time data to show a trend.
Zome call duration: 'remote_call::call_echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.111982
s
SD
0.065911
s
p50
0.157135
s
p95
0.208531
s
p99
0.336016
s
Zome call duration: 'remote_call::echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.002977
s
SD
0.001273
s
p50
0.002797
s
p95
0.004604
s
p99
0.005044
s
WASM call duration: 'remote_call::call_echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.111068
s
SD
0.065796
s
p50
0.155558
s
p95
0.207576
s
p99
0.335651
s
WASM call duration: 'remote_call::echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001968
s
SD
0.000814
s
p50
0.00191
s
p95
0.003048
s
p99
0.003055
s
WASM call duration: 'remote_call::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002255
s
SD
0.001021
s
p50
0.002169
s
p95
0.003749
s
p99
0.003749
s
Host function call duration: '__hc__call_1'
Duration of this host function call invoked from within WASM.
mean
0.109041
s
SD
0.065535
s
p50
0.153312
s
p95
0.204639
s
p99
0.334801
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000405
s
SD
0.000182
s
p50
0.000348
s
p95
0.000703
s
p99
0.000703
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
9e-06
s
SD
6e-06
s
p50
8e-06
s
p95
2.6e-05
s
p99
2.7e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000218
s
SD
0.000105
s
p50
0.000232
s
p95
0.000439
s
p99
0.000526
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.00014
s
SD
0.000118
s
p50
9.1e-05
s
p95
0.000452
s
p99
0.000452
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.96
s
mean
446.45
s
SD
256.6
s
p95
846.97
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
71
over 894.367310183s
mean rate
3.1
/s
std
19.95
/s
p5
0
/s
p95
5.64
/s
peak
246.03
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.908241
s
SD
0.905313
s
p50
0.672183
s
p95
3.322775
s
p99
3.695264
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.002424
s
SD
0.001731
s
p50
0.002452
s
p95
0.006327
s
p99
0.007682
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.004695
s
SD
0.002735
s
p50
0.004745
s
p95
0.008911
s
p99
0.008911
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.077048
s
SD
0.037586
s
p50
0.08975
s
p95
0.144362
s
p99
0.144362
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.006762
s
SD
0.004351
s
p50
0.006035
s
p95
0.015275
s
p99
0.019649
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.035743
s
SD
0.059628
s
p50
0.017263
s
p95
0.185425
s
p99
0.233281
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.142368
s
SD
0.062905
s
p50
0.15701
s
p95
0.215872
s
p99
0.238244
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000125
s
SD
7.2e-05
s
p50
0.000125
s
p95
0.000275
s
p99
0.000381
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001031
s
SD
0.000733
s
p50
0.001024
s
p95
0.003352
s
p99
0.003352
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000358
s
SD
0.000205
s
p50
0.000391
s
p95
0.000761
s
p99
0.000921
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.089405
s
SD
0.059955
s
p50
0.074294
s
p95
0.22611
s
p99
0.22611
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.145981
s
SD
0.073792
s
p50
0.18604
s
p95
0.259625
s
p99
0.259625
s
P2P request roundtrip: 'call_remote'
Time spent sending a call_remote request and awaiting its response.
mean
0.108581
s
SD
0.065473
s
p50
0.152941
s
p95
0.203889
s
p99
0.334594
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
9.80
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
11.33
KiB/s
mean
203.27
KiB/s
SD
1014.60
KiB/s
p95
73.15
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
9.01
KiB/s
mean
20.88
KiB/s
SD
36.31
KiB/s
p95
54.93
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.56
GiB
mean
1.77
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
163.76
MiB
mean
186.32
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 2763.25 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (83.1% swap used)
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2.21
%
mean
15.23
%
SD
13.35
%
p95
26.83
%
System
5.43
%
CPU percentiles
CPU usage percentiles
p50
12.40
%
p95
26.83
%
p99
84.72
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
5
hosts
mean time
0.03
s
Memory used percentage
Percentage of memory used
p5
10.99
%
mean
22.36
%
SD
14.23
%
p95
54.08
%
Memory available percentage
Percentage of available memory
p5
45.92
%
mean
77.64
%
SD
14.23
%
p95
89.01
%
Max host memory used
Maximum memory usage percentage across all hosts
max
53.42
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
83.11
%
Memory growth rate
Rate of memory growth over time
growth
2763.25
MiB/s
Disk read throughput
Disk read throughput in MiB/s
1.11
MiB/s
Disk write throughput
Disk write throughput in MiB/s
42.57
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname0/3
hosts
Mount Point
/etc/hosts0/3
hosts
Mount Point
/etc/nomad.d/client-meta.json0/7
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/3
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.97
5 min
0.74
15 min
0.44
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
3.9656
%
SD
6.4019
%
p95
7.76
%
60 second average
3.4982
%
300 second average
2.6180
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0.1365
%
SD
0.4634
%
p95
0.82
%
60 second average
0.1239
%
300 second average
0.0913
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0.1119
%
SD
0.388
%
p95
0.56
%
60 second average
0.1049
%
300 second average
0.0774
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
mean
6.23
%
SD
9.07
%
p95
18.51
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
191.45
KiB
mean
241.85
KiB
SD
110.22
KiB
p95
422.96
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
mean
32.24
threads
SD
23.33
threads
p95
82
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
mean
63.14
file descriptors
SD
34.37
file descriptors
p95
78
file descriptors
Remote Signals
↑ Back to indexThis scenario tests the throughput of remote_signals operations.
Started
Thu, 30 Jul 2026 03:18:42 UTC
Peer count
10
Peer count at end
10
Behaviours
-
default(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
remote_signals_30510613785_1
Round trip time
The time from origin signal dispatch to origin receive of the remote side's response signal.
mean
0.146275
s
SD
0.8064
s
p50
0.058509
s
p95
0.232918
s
p99
0.366502
s
Timeout rate
The proportion of remote signal round-trips that timed out.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_signal::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 891.914348254s
Not enough time data to show a trend.
WASM usage: 'remote_signal::recv_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
31490010
over 891.914348254s
mean rate
2.5143071964e+08
/s
std
1.07238860681e+09
/s
p5
0
/s
p95
1.18904202573e+09
/s
peak
1.71597954123e+10
/s
WASM usage: 'remote_signal::signal_request'
Metered usage count of the WASM ribosome for this zome function.
total
13352336
over 891.914348254s
mean rate
1.670430063e+07
/s
std
8.062032941e+07
/s
p5
0
/s
p95
8.852929901e+07
/s
peak
1.81702877275e+09
/s
Zome call duration: 'remote_signal::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.002611
s
SD
0.001486
s
p50
0.002661
s
p95
0.004829
s
p99
0.00551
s
Zome call duration: 'remote_signal::signal_request'
Duration of this zome call as measured by Holochain internally.
mean
0.002509
s
SD
0.001367
s
p50
0.002489
s
p95
0.004635
s
p99
0.004883
s
WASM call duration: 'remote_signal::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002645
s
SD
0.001453
s
p50
0.002603
s
p95
0.004787
s
p99
0.004787
s
WASM call duration: 'remote_signal::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001697
s
SD
0.000913
s
p50
0.001859
s
p95
0.002807
s
p99
0.003371
s
WASM call duration: 'remote_signal::signal_request'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001606
s
SD
0.000804
s
p50
0.001683
s
p95
0.002641
s
p99
0.002808
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000471
s
SD
0.000276
s
p50
0.000376
s
p95
0.000798
s
p99
0.000798
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
5.5e-05
s
SD
2.9e-05
s
p50
6.2e-05
s
p95
8.9e-05
s
p99
0.0001
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
5.7e-05
s
SD
3.7e-05
s
p50
5.9e-05
s
p95
0.000102
s
p99
0.000134
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
5e-06
s
SD
4e-06
s
p50
5e-06
s
p95
1.1e-05
s
p99
2e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000322
s
SD
0.000296
s
p50
0.000186
s
p95
0.001075
s
p99
0.001075
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
1732
over 891.914343996s
mean rate
26717.93
/s
std
199711.65
/s
p5
0
/s
p95
46273.45
/s
peak
2.91885581e+06
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
1733
over 891.914339266s
mean rate
36810.46
/s
std
325288.26
/s
p5
0
/s
p95
36059.43
/s
peak
4.83091787e+06
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000169
s
SD
0.000165
s
p50
0.00011
s
p95
0.000526
s
p99
0.000526
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.42
s
mean
450.54
s
SD
259.24
s
p95
854.98
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
67
over 891.914301305s
mean rate
6491.37
/s
std
92601.38
/s
p5
0
/s
p95
0.25
/s
peak
1.98388097e+06
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
1.137653
s
SD
1.2467
s
p50
0.752307
s
p95
4.660649
s
p99
4.824144
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.004534
s
SD
0.004906
s
p50
0.003501
s
p95
0.01381
s
p99
0.016251
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.005239
s
SD
0.003332
s
p50
0.002986
s
p95
0.010994
s
p99
0.010994
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.075622
s
SD
0.064108
s
p50
0.078157
s
p95
0.245629
s
p99
0.252343
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.007841
s
SD
0.00708
s
p50
0.007562
s
p95
0.023076
s
p99
0.029964
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.028767
s
SD
0.061726
s
p50
0.014424
s
p95
0.206982
s
p99
0.22533
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.125227
s
SD
0.06835
s
p50
0.129883
s
p95
0.268785
s
p99
0.285926
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000139
s
SD
0.00012
s
p50
0.000153
s
p95
0.000357
s
p99
0.000644
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001776
s
SD
0.001721
s
p50
0.001823
s
p95
0.005384
s
p99
0.005384
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000504
s
SD
0.000647
s
p50
0.000522
s
p95
0.001336
s
p99
0.002554
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.043391
s
SD
0.021796
s
p50
0.046362
s
p95
0.07441
s
p99
0.089443
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.093838
s
SD
0.045738
s
p50
0.117969
s
p95
0.159648
s
p99
0.185712
s
P2P received remote signals
Count of remote signals received.
total
1734
over 891.914404235s
mean rate
8754.71
/s
std
32785.12
/s
p5
0
/s
p95
43605.28
/s
peak
550842.79
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
15.59
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
16.09
KiB/s
mean
324.33
KiB/s
SD
1.19
MiB/s
p95
944.02
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
13.43
KiB/s
mean
58.30
KiB/s
SD
113.96
KiB/s
p95
301.89
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.38
GiB
mean
1.58
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
253.37
MiB
mean
291.52
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 97.7%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 1197.22 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (83.1% swap used)
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2.12
%
mean
22.93
%
SD
22.32
%
p95
91.81
%
System
7.34
%
CPU percentiles
CPU usage percentiles
p50
19.60
%
p95
91.81
%
p99
97.73
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
3
hosts
mean time
0.13
s
Memory used percentage
Percentage of memory used
p5
18.56
%
mean
31.83
%
SD
13.54
%
p95
54.81
%
Memory available percentage
Percentage of available memory
p5
45.19
%
mean
68.17
%
SD
13.54
%
p95
81.44
%
Max host memory used
Maximum memory usage percentage across all hosts
max
53.65
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
83.10
%
Memory growth rate
Rate of memory growth over time
growth
1197.22
MiB/s
Disk read throughput
Disk read throughput in MiB/s
1.29
MiB/s
Disk write throughput
Disk write throughput in MiB/s
47.90
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname0/3
hosts
Mount Point
/etc/hosts0/3
hosts
Mount Point
/etc/nomad.d/client-meta.json0/3
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/3
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.80
5 min
1.31
15 min
0.80
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
8.5585
%
SD
17.8646
%
p95
68.06
%
60 second average
6.8216
%
300 second average
4.3154
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0.1021
%
SD
0.278
%
p95
0.69
%
60 second average
0.1044
%
300 second average
0.0794
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0.0504
%
SD
0.1494
%
p95
0.36
%
60 second average
0.0659
%
300 second average
0.0570
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
mean
7.36
%
SD
17.11
%
p95
38.44
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
112.61
KiB
mean
265.94
KiB
SD
150.98
KiB
p95
450.31
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
mean
36.18
threads
SD
32.71
threads
p95
84
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
mean
56.89
file descriptors
SD
46.93
file descriptors
p95
87
file descriptors
Single-write, many-read
↑ Back to indexCreates an entry in the agent setup, then read one's own record back. This tests the maximum read performance for reading back local data when the chain is short.
Started
Thu, 30 Jul 2026 03:20:44 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
single_write_many_read_30510613785_1
read call timingThe time it takes to complete the zome call that retrieves the record.
mean
0.001644
s
SD
0.000538
s
p50
0.00156
s
p95
0.001952
s
p99
0.002461
s
read call rateThe number of read zome calls completed per second.
mean
6054.21
/s
Error count
The number of errors collected.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
9e-05
s
SD
2e-06
s
p50
8.8e-05
s
p95
9.3e-05
s
p99
9.4e-05
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.001697197s
Not enough time data to show a trend.
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
5645982183
over 280.001697197s
mean rate
2.016409946e+07
/s
std
1.12662366e+06
/s
p5
1.856399982e+07
/s
p95
2.13585383e+07
/s
peak
2.140515521e+07
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.001697197s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.001697197s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.001894
s
SD
0
s
p50
0.001894
s
p95
0.001894
s
p99
0.001894
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.000938
s
SD
7e-06
s
p50
0.000932
s
p95
0.000949
s
p99
0.000952
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00155
s
SD
0
s
p50
0.00155
s
p95
0.00155
s
p99
0.00155
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000706
s
SD
4e-06
s
p50
0.000704
s
p95
0.000713
s
p99
0.000713
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000989
s
SD
0
s
p50
0.000989
s
p95
0.000989
s
p99
0.000989
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000584
s
SD
0
s
p50
0.000584
s
p95
0.000584
s
p99
0.000584
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000125
s
SD
2.1e-05
s
p50
0.000147
s
p95
0.000147
s
p99
0.000147
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
9.8e-05
s
SD
3e-06
s
p50
9.6e-05
s
p95
0.000103
s
p99
0.000104
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000824
s
SD
0
s
p50
0.000824
s
p95
0.000824
s
p99
0.000824
s
Post-commit duration
Time spent executing post-commit workflows.
mean
3e-05
s
SD
0
s
p50
3e-05
s
p95
3e-05
s
p99
3e-05
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.61
s
mean
148.61
s
SD
83.67
s
p95
278.61
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001694291s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000989
s
SD
0
s
p50
0.000989
s
p95
0.000989
s
p99
0.000989
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002015
s
SD
0
s
p50
0.002015
s
p95
0.002015
s
p99
0.002015
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000653
s
SD
0
s
p50
0.000653
s
p95
0.000653
s
p99
0.000653
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001367
s
SD
0.000236
s
p50
0.001414
s
p95
0.001822
s
p99
0.001822
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001131
s
SD
0
s
p50
0.001131
s
p95
0.001131
s
p99
0.001131
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000174
s
SD
0
s
p50
0.000174
s
p95
0.000174
s
p99
0.000174
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
1.8e-05
s
SD
0
s
p50
1.7e-05
s
p95
1.8e-05
s
p99
1.9e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.0004
s
SD
0.000122
s
p50
0.000579
s
p95
0.000579
s
p99
0.000579
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000118
s
SD
0
s
p50
0.000118
s
p95
0.000118
s
p99
0.000118
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
5.09
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
17.63
KiB/s
mean
449.81
KiB/s
SD
1.54
MiB/s
p95
6.08
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
23.02
KiB/s
mean
31.17
KiB/s
SD
21.35
KiB/s
p95
108.11
KiB/s
Total bytes received
Total bytes received on primary network interface
count
127.39
MiB
mean
449.81
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
8.83
MiB
mean
31.17
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 1657.41 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (83.1% swap used)
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
5.46
%
mean
8.11
%
SD
3.26
%
p95
15.96
%
System
3.02
%
CPU percentiles
CPU usage percentiles
p50
6.03
%
p95
15.96
%
p99
16.45
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
52.58
%
mean
53.31
%
SD
0.92
%
p95
55.45
%
Memory available percentage
Percentage of available memory
p5
44.55
%
mean
46.69
%
SD
0.92
%
p95
47.42
%
Max host memory used
Maximum memory usage percentage across all hosts
max
53.31
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
83.11
%
Memory growth rate
Rate of memory growth over time
growth
1657.41
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.10
MiB/s
Disk write throughput
Disk write throughput in MiB/s
31.49
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname0/1
hosts
Mount Point
/etc/hosts0/1
hosts
Mount Point
/etc/nomad.d/client-meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.40
5 min
1.36
15 min
1.01
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0.0417
%
SD
0.1078
%
p95
0.19
%
60 second average
0.0173
%
300 second average
0.0067
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
3.64
%
mean
4.26
%
SD
0.88
%
p95
5.72
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
426.26
KiB
mean
460.94
KiB
SD
95.18
KiB
p95
810.95
KiB
Holochain process threads
Number of threads in Holochain process
p5
80
threads
mean
81.23
threads
SD
1.2
threads
p95
83
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
57
file descriptors
mean
59.83
file descriptors
SD
2.82
file descriptors
p95
64
file descriptors
Validation Receipts
↑ Back to indexCreates an entry, wait for required validation receipts, then repeat. Records the amount of time it took to accumulate the required number of receipts for all DHT operations. This is measured to the nearest 20ms so that we don't keep the agent too busy checking for receipts.
Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.
By default, this scenario will wait for a complete set of validation receipts before committing the next record. If the NO_VALIDATION_COMPLETE environment variable is set, it will instead publish new records on every round, building up an ever-growing list of action hashes to check on.
Started
Thu, 30 Jul 2026 03:33:25 UTC
Peer count
20
Peer count at end
20
Behaviours
-
default(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
validation_receipts_30510613785_1
Receipts complete timing
The amount of time between publishing a record and receiving the required number of validation receipts.
Mean
mean
7.030926
s
SD
3.105412
s
Max
Highest per-partition mean latency
max mean
9.767928
s
Min
Lowest per-partition mean latency
min mean
6.060645
s
Receipts complete rate
The number of complete validation receipt sets collected per second.
Mean
mean
1.4
/s
Max
Highest per-partition mean rate
max
1.55
/s
Min
Lowest per-partition mean rate
min
1.25
/s
Error count
The total number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37472.197811547s
Not enough time data to show a trend.
WASM usage: 'crud::get_sample_entry_validation_receipts'
Metered usage count of the WASM ribosome for this zome function.
total
988760
over 37472.197811547s
mean rate
6.6204095e+06
/s
std
1.340860023e+07
/s
p5
1300.99
/s
p95
4.084581384e+07
/s
peak
6.790609257e+07
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37472.197811547s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37472.197811547s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.00643
s
SD
0.003782
s
p50
0.005103
s
p95
0.013064
s
p99
0.021382
s
Zome call duration: 'crud::get_sample_entry_validation_receipts'
Duration of this zome call as measured by Holochain internally.
mean
0.020958
s
SD
0.0165
s
p50
0.013459
s
p95
0.041696
s
p99
0.101317
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005504
s
SD
0.003221
s
p50
0.004374
s
p95
0.010696
s
p99
0.018114
s
WASM call duration: 'crud::get_sample_entry_validation_receipts'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.019928
s
SD
0.015964
s
p50
0.012542
s
p95
0.040238
s
p99
0.097564
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002283
s
SD
0.001182
s
p50
0.001971
s
p95
0.003499
s
p99
0.006521
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001822
s
SD
0.000975
s
p50
0.001471
s
p95
0.002987
s
p99
0.005747
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000633
s
SD
0.000605
s
p50
0.000459
s
p95
0.001982
s
p99
0.00301
s
Host function call duration: '__hc__get_validation_receipts_1'
Duration of this host function call invoked from within WASM.
mean
0.017771
s
SD
0.015112
s
p50
0.010555
s
p95
0.035888
s
p99
0.091982
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002985
s
SD
0.001779
s
p50
0.002346
s
p95
0.005856
s
p99
0.009981
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000286
s
SD
0.000288
s
p50
0.000193
s
p95
0.000569
s
p99
0.001623
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.43
s
mean
450.23
s
SD
259.38
s
p95
856.23
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
1.249754
s
SD
1.223729
s
p50
1.15761
s
p95
3.859216
s
p99
7.139217
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.004379
s
SD
0.007485
s
p50
0.002192
s
p95
0.023418
s
p99
0.033403
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.007677
s
SD
0.006521
s
p50
0.005689
s
p95
0.026822
s
p99
0.026822
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.038578
s
SD
0.039369
s
p50
0.041954
s
p95
0.132043
s
p99
0.201109
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.0443
s
SD
0.031239
s
p50
0.024749
s
p95
0.090328
s
p99
0.184727
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.035223
s
SD
0.651666
s
p50
0.033543
s
p95
0.330957
s
p99
3.599812
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
1.724649
s
SD
10.93501
s
p50
2.638899
s
p95
33.394911
s
p99
47.667261
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000855
s
SD
0.000687
s
p50
0.000518
s
p95
0.001817
s
p99
0.004283
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.007512
s
SD
0.009333
s
p50
0.001973
s
p95
0.031964
s
p99
0.035773
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000332
s
SD
0.000577
s
p50
0.000292
s
p95
0.00131
s
p99
0.001448
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.076173
s
SD
0.049581
s
p50
0.067314
s
p95
0.163871
s
p99
0.163871
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.153249
s
SD
0.04493
s
p50
0.148451
s
p95
0.213996
s
p99
0.227742
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
64.34
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
23
B/s
mean
442.77
KiB/s
SD
224.38
KiB/s
p95
802.39
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
21
B/s
mean
384.02
KiB/s
SD
321.81
KiB/s
p95
1000.70
KiB/s
Total bytes received
Total bytes received on primary network interface
count
7.60
GiB
mean
8.46
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
6.60
GiB
mean
7.34
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.2%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 284.88 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (83.1% swap used)
System overload anomaly
System overload anomaly was detected
Detected
Warning 85% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
26.04
%
mean
78.38
%
SD
24.19
%
p95
97.8
%
System
14.04
%
CPU percentiles
CPU usage percentiles
p50
89.01
%
p95
97.80
%
p99
98.20
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
17
hosts
mean time
0.77
s
Memory used percentage
Percentage of memory used
p5
15.8
%
mean
21.4
%
SD
8.63
%
p95
45.95
%
Memory available percentage
Percentage of available memory
p5
54.05
%
mean
78.6
%
SD
8.63
%
p95
84.2
%
Max host memory used
Maximum memory usage percentage across all hosts
max
52.17
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
83.08
%
Memory growth rate
Rate of memory growth over time
growth
284.88
MiB/s
Disk read throughput
Disk read throughput in MiB/s
3.71
MiB/s
Disk write throughput
Disk write throughput in MiB/s
143.33
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/5
hosts
Mount Point
/efi-boot0/4
hosts
Mount Point
/etc/hostname0/5
hosts
Mount Point
/etc/hosts0/5
hosts
Mount Point
/etc/nomad.d/client-meta.json0/11
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/5
hosts
Mount Point
/nix/store0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
6.72
5 min
5.28
15 min
3.08
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
85.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.01
%
mean
44.5012
%
SD
25.0788
%
p95
78.43
%
60 second average
43.6133
%
300 second average
34.1367
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
13.9333
%
SD
20.9718
%
p95
59.87
%
60 second average
13.4010
%
300 second average
10.1225
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
4.493
%
SD
7.5291
%
p95
21.03
%
60 second average
4.3579
%
300 second average
3.3684
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.07
%
mean
5.07
%
SD
7.16
%
p95
11.59
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
221.66
KiB
mean
253.06
KiB
SD
69.36
KiB
p95
433.62
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
mean
34.3
threads
SD
22.96
threads
p95
45
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
mean
74.25
file descriptors
SD
28.12
file descriptors
p95
88
file descriptors
Write/get_agent_activity
↑ Back to index
A scenario where write peers write entries, while get_agent_activity peers each query a single write agent's activity with get_agent_activity.
Before a target write peer and the requesting get_agent_activity peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.
Started
Thu, 30 Jul 2026 04:02:16 UTC
Peer count
30
Peer count at end
27
Behaviours
-
get_agent_activity(1 agent) -
write(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
write_get_agent_activity_30510613785_1
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
2323.25
Max
Highest chain head value observed for any single write agent.
3363
Write agents observed
4
get_agent_activity_full zome call timingThe time taken to call the zome function that retrieves information on a
write peer's source chain.Mean
mean
0.166335
s
SD
0.118605
s
Max
Highest per-partition mean latency
max mean
0.375294
s
Min
Lowest per-partition mean latency
min mean
0.063453
s
Error count
The number of errors accumulated.
11
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.013014
s
SD
0.22435
s
p50
0.00423
s
p95
0.951032
s
p99
0.952021
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
8
over 774.76004259s
mean rate
8.19
/s
std
15.18
/s
p5
0
/s
p95
54.34
/s
peak
76.95
/s
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 910.543283797s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
150663971
over 910.543283797s
mean rate
7.733976565e+07
/s
std
1.0217396085e+08
/s
p5
3.20036471e+06
/s
p95
3.0708225042e+08
/s
peak
3.4078388476e+08
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
445524687
over 1888.692924777s
mean rate
8.0308011541e+10
/s
std
3.61581956074e+11
/s
p5
205758.08
/s
p95
2.22079400963e+11
/s
peak
3.74197605896e+12
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
5536931840
over 37461.139973877s
mean rate
9.15424822047e+09
/s
std
8.09302675842e+10
/s
p5
0
/s
p95
4.99363337043e+09
/s
peak
1.63487445711e+12
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
392992862
over 37461.601608187s
mean rate
6.2942374604e+08
/s
std
5.44526221454e+09
/s
p5
0
/s
p95
4.1675526038e+08
/s
peak
1.16077851964e+11
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.006023
s
SD
0.001555
s
p50
0.006288
s
p95
0.00784
s
p99
0.00784
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006347
s
SD
0.003465
s
p50
0.005963
s
p95
0.015803
s
p99
0.015989
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.028544
s
SD
0.066293
s
p50
0.024597
s
p95
0.225952
s
p99
0.261451
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.003042
s
SD
0.293432
s
p50
0.004118
s
p95
0.956034
s
p99
0.956034
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005003
s
SD
0.001327
s
p50
0.005362
s
p95
0.006728
s
p99
0.006728
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005451
s
SD
0.003255
s
p50
0.005041
s
p95
0.014307
s
p99
0.01449
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.028932
s
SD
0.068413
s
p50
0.024129
s
p95
0.225189
s
p99
0.260719
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002486
s
SD
0.293449
s
p50
0.003559
s
p95
0.955339
s
p99
0.955339
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000987
s
SD
0.000756
s
p50
0.001208
s
p95
0.002475
s
p99
0.004491
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.1e-05
s
SD
4e-06
s
p50
2.3e-05
s
p95
2.6e-05
s
p99
2.6e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000865
s
SD
0.000837
s
p50
0.000671
s
p95
0.003047
s
p99
0.003081
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000623
s
SD
0.000387
s
p50
0.000543
s
p95
0.001493
s
p99
0.001493
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.027561
s
SD
0.068269
s
p50
0.022253
s
p95
0.223671
s
p99
0.25939
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000244
s
SD
0.293745
s
p50
0.000265
s
p95
0.952064
s
p99
0.952064
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
7e-06
s
SD
5e-06
s
p50
8e-06
s
p95
2e-05
s
p99
2.1e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00152
s
SD
0.001246
s
p50
0.00193
s
p95
0.004119
s
p99
0.007664
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000226
s
SD
0.000155
s
p50
0.000132
s
p95
0.000581
s
p99
0.00074
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.96
s
mean
447.15
s
SD
257.14
s
p95
847.34
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 37461.601638177s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
201.475958
s
SD
157.805219
s
p50
38.363089
s
p95
449.535595
s
p99
556.02902
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.031264
s
SD
0.149113
s
p50
0.090054
s
p95
0.430111
s
p99
0.856194
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.004397
s
SD
0.002959
s
p50
0.003172
s
p95
0.011234
s
p99
0.012941
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.262069
s
SD
0.559171
s
p50
0.791001
s
p95
1.378134
s
p99
2.271526
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.158052
s
SD
0.136265
s
p50
0.047074
s
p95
0.422055
s
p99
0.720938
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
4.330688
s
SD
20.108786
s
p50
10.575119
s
p95
62.577097
s
p99
70.713715
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
31.013548
s
SD
37.428412
s
p50
2.179687
s
p95
112.786706
s
p99
133.901281
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.003022
s
SD
0.001723
s
p50
0.002681
s
p95
0.005836
s
p99
0.007435
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003963
s
SD
0.004865
s
p50
0.001231
s
p95
0.017226
s
p99
0.022325
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.0005
s
SD
0.000496
s
p50
0.000297
s
p95
0.001143
s
p99
0.002685
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
5.330781
s
SD
29.539379
s
p50
1.16707
s
p95
60.00228
s
p99
60.020891
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.328675
s
SD
0.339107
s
p50
0.834249
s
p95
0.841591
s
p99
0.841591
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.031019
s
SD
16.35262
s
p50
0.025146
s
p95
60.001486
s
p99
60.002293
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.272884
s
SD
4.557532
s
p50
0.588835
s
p95
8.385603
s
p99
23.781196
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
51.30
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
63
B/s
mean
397.27
KiB/s
SD
343.35
KiB/s
p95
822.69
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
35
B/s
mean
362.40
KiB/s
SD
306.27
KiB/s
p95
813.33
KiB/s
Total bytes received
Total bytes received on primary network interface
count
9.17
GiB
mean
10.32
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
8.37
GiB
mean
9.42
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.4%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 682.86 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (83.0% swap used)
System overload anomaly
System overload anomaly was detected
Detected
Warning 70% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
8.35
%
mean
61.53
%
SD
30.44
%
p95
97.95
%
System
10.23
%
CPU percentiles
CPU usage percentiles
p50
72.59
%
p95
97.95
%
p99
98.40
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
17
hosts
mean time
0.65
s
Memory used percentage
Percentage of memory used
p5
11.07
%
mean
16.01
%
SD
8.95
%
p95
35.81
%
Memory available percentage
Percentage of available memory
p5
64.19
%
mean
83.99
%
SD
8.95
%
p95
88.93
%
Max host memory used
Maximum memory usage percentage across all hosts
max
51.65
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
83.05
%
Memory growth rate
Rate of memory growth over time
growth
682.86
MiB/s
Disk read throughput
Disk read throughput in MiB/s
1.38
MiB/s
Disk write throughput
Disk write throughput in MiB/s
108.66
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/5
hosts
Mount Point
/efi-boot0/4
hosts
Mount Point
/etc/hostname0/8
hosts
Mount Point
/etc/hosts0/8
hosts
Mount Point
/etc/nomad.d/client-meta.json0/15
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/8
hosts
Mount Point
/nix/store0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.33
5 min
4.64
15 min
4.75
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
70.37
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
25.9485
%
SD
27.3175
%
p95
86.77
%
60 second average
26.0624
%
300 second average
28.0126
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
9.2516
%
SD
14.3226
%
p95
37.56
%
60 second average
9.3773
%
300 second average
9.7160
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
4.7958
%
SD
9.2083
%
p95
25.8
%
60 second average
4.9165
%
300 second average
4.7220
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.28
%
mean
54.77
%
SD
31.29
%
p95
95.32
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
230.06
KiB
mean
354.29
KiB
SD
132.82
KiB
p95
512.31
KiB
Holochain process threads
Number of threads in Holochain process
p5
19
threads
mean
37.9
threads
SD
23.98
threads
p95
66
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
51
file descriptors
mean
79.4
file descriptors
SD
28.99
file descriptors
p95
109
file descriptors
Write/get_agent_activity with volatile conductors
↑ Back to index
A scenario where write peers write entries, while get_agent_activity_volatile peers each query a single write agents activity with get_agent_activity but shutdown and restart their conductors at semi-random intervals.
Before a target write peer and the requesting get_agent_activity_volatile peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.
Started
Thu, 30 Jul 2026 04:17:58 UTC
Peer count
30
Peer count at end
25
Behaviours
-
get_agent_activity_volatile(1 agent) -
write(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
write_get_agent_activity_volatile_30510613785_1
Highest observed
action_seqThe rate at which zero-arc readers observe new chain heads on the writers' chains via
get_agent_activity. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.Mean
mean
62.25
/s
Max
Highest per-partition mean rate
max
284.38
/s
Min
Lowest per-partition mean rate
min
15.79
/s
get_agent_activity_full zome call timingThe time taken to call the zome function that retrieves information on a
write peer's source chain.Mean
mean
0.177266
s
SD
0.202087
s
Max
Highest per-partition mean latency
max mean
0.438185
s
Min
Lowest per-partition mean latency
min mean
0.023683
s
Running volatile conductors count
The number of conductors running by
get_agent_activity_volatile peers.p5
9
conductors
mean
12.29
conductors
SD
2.13
conductors
p95
15
conductors
Volatile conductor total running duration
The total running duration of a
get_agent_activity_volatile conductor.Mean
mean
736.310542
s
SD
396.550686
s
Max
Highest per-partition mean latency
max mean
903.75
s
Min
Lowest per-partition mean latency
min mean
629.6
s
Volatile conductor running duration
The duration that a
get_agent_activity_volatile conductor was running before being stopped.Mean
mean
42.249493
s
SD
21.44836
s
Max
Highest per-partition mean latency
max mean
142.41789
s
Min
Lowest per-partition mean latency
min mean
23.954564
s
Volatile conductor stopped duration
The duration that a
get_agent_activity_volatile conductor was stopped before being started again.Mean
mean
21.535647
s
SD
22.157761
s
Max
Highest per-partition mean latency
max mean
30.447283
s
Min
Lowest per-partition mean latency
min mean
9.185048
s
Reached target arc
Did
get_agent_activity_volatile peer reach their target arc in the moment before they were shutdown.get_agent_activity_volatile_agent:uhCAk-raDouTf_eSJ60vwvBQJLp6kDs087Ui9Slh_feDO3T4YzI8T
p5
0
mean
0.28
SD
0.45
p95
1
get_agent_activity_volatile_agent:uhCAk8x-Hcfx26dRUA7xZvL9E2OYppvMQFEYe1ZVIbgXeeJJRcZD-
p5
0
mean
0.03
SD
0.17
p95
0
get_agent_activity_volatile_agent:uhCAk9O8mbfw9cUcxi6l1v6nLE48weWyiXIi5xy_i2PmHzCs-PLf2
p5
0
mean
0.22
SD
0.42
p95
1
get_agent_activity_volatile_agent:uhCAkBKKCwjhRZToY1E5bpV1gjyBH92hNXscKQTd5qD88Jhxi5gXC
p5
0
mean
0.28
SD
0.45
p95
1
get_agent_activity_volatile_agent:uhCAkBNvpijyyCy55-rJm7zmgYPGKxiDs7Oo8UZZdndAI1rkjECm5
p5
0
mean
0.38
SD
0.48
p95
1
get_agent_activity_volatile_agent:uhCAkBu8pLC9b_WPFVa3uy6eaMGlhZ6keB8iEgqeF6bYGqhaNKHWM
p5
0
mean
0.21
SD
0.41
p95
1
get_agent_activity_volatile_agent:uhCAkCqZv6q3HpW6PjxiQLfTfkBgK8pbOK0rDJgUQydJ_MmUEqGle
p5
0
mean
0
SD
0
p95
0
get_agent_activity_volatile_agent:uhCAkFBj6uOVlmwLnhiE3TLtn3YFrtDXZ6e3s9qe863Kv-mhYk56Y
p5
0
mean
0.28
SD
0.45
p95
1
get_agent_activity_volatile_agent:uhCAkGwO0jdGwXTGUVP-c9z5lPINmVlv97Zixa5R9mk6SaKXlpQUg
p5
0
mean
0.18
SD
0.38
p95
1
get_agent_activity_volatile_agent:uhCAkJX75WAoGD-PTy5w99re_UDltS7S-ABJjktjT42QAMqR2PGe2
p5
0
mean
0.26
SD
0.44
p95
1
get_agent_activity_volatile_agent:uhCAkLIx3gearQ823uqWQl7ksQDfiGS--w-SJIHoM2p554pnD-IGK
p5
0
mean
0.23
SD
0.42
p95
1
get_agent_activity_volatile_agent:uhCAkNU4gfrcDUlqADUjwge3hFVNxEBGfszDiuaY3RwX0ArvaW4Jg
p5
0
mean
0.41
SD
0.49
p95
1
get_agent_activity_volatile_agent:uhCAkNWi6fyhpS67tOuP6pah4LqBw12mZY6L7Hgyvfd7bBKP_MtO9
p5
0
mean
0.26
SD
0.44
p95
1
get_agent_activity_volatile_agent:uhCAkScaKpJX_NkoaGqmyobIu5eFFEKevnAjKpDK-BLaHTrrAfHQw
p5
0
mean
0.3
SD
0.46
p95
1
get_agent_activity_volatile_agent:uhCAkY5i7gfliq6BH44jZeb_IvxHNB8P3XC4dugglF9i0aAQW88F5
p5
0
mean
0.25
SD
0.43
p95
1
get_agent_activity_volatile_agent:uhCAkdzIzv-Pqk_edlOFAETJcrGGrGVAWrc9FEH5RLR8hwPGPiovm
p5
0
mean
0
SD
0
p95
0
get_agent_activity_volatile_agent:uhCAkmTadlulFc_kl9zZb7f6qL-4kd2fAfeo98XTlmeaU_lecL7Ze
p5
0
mean
0.29
SD
0.46
p95
1
get_agent_activity_volatile_agent:uhCAksBrrq7BjOJoK1GEFvpxY-X5EgRof0Rv5Go8w8VwrFzxEPauu
p5
0
mean
0.26
SD
0.44
p95
1
get_agent_activity_volatile_agent:uhCAkzLXD81Hx6GZm8gWEcGYaxz6mlnXf5TZ72gq1RfKP7XM9dyo2
p5
0
mean
0.32
SD
0.47
p95
1
Error count
The number of errors accumulated.
184
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.065796
s
SD
2.420546
s
p50
0.210079
s
p95
0.674485
s
p99
1.412479
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
5
over 1690.060328542s
mean rate
0.49
/s
std
1.2
/s
p5
0
/s
p95
1.11
/s
peak
8.09
/s
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 1815.267809556s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
184557121
over 1815.267809556s
mean rate
2.839620376e+07
/s
std
2.104806447e+07
/s
p5
2.45016925e+06
/s
p95
7.454926984e+07
/s
peak
7.884222184e+07
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
10723704
over 2802.046835363s
mean rate
4.3037252653e+08
/s
std
4.39361123529e+09
/s
p5
845748.09
/s
p95
1.39555058652e+09
/s
peak
1.41501540618e+11
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
133019520
over 38236.929841443s
mean rate
6.401033145e+07
/s
std
2.1357523608e+08
/s
p5
0
/s
p95
3.7915126728e+08
/s
peak
1.25016529283e+09
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
9441532
over 38236.929841443s
mean rate
3.61681354e+06
/s
std
4.53775821e+06
/s
p5
140186.34
/s
p95
9.32133305e+06
/s
peak
8.874848472e+07
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.005923
s
SD
0.003012
s
p50
0.004869
s
p95
0.012967
s
p99
0.012967
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005551
s
SD
0.003613
s
p50
0.005432
s
p95
0.013966
s
p99
0.014256
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.09054
s
SD
0.25888
s
p50
0.228206
s
p95
0.695385
s
p99
1.417478
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.003058
s
SD
0.236382
s
p50
0.002996
s
p95
0.466785
s
p99
1.365624
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004637
s
SD
0.002052
s
p50
0.004152
s
p95
0.00889
s
p99
0.00889
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00468
s
SD
0.002958
s
p50
0.004586
s
p95
0.011033
s
p99
0.011452
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.090356
s
SD
2.474074
s
p50
0.222539
s
p95
0.68535
s
p99
1.413449
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002461
s
SD
0.236338
s
p50
0.002357
s
p95
0.46627
s
p99
1.364676
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001536
s
SD
0.000863
s
p50
0.001514
s
p95
0.003372
s
p99
0.003842
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.2e-05
s
SD
1.2e-05
s
p50
1.9e-05
s
p95
5.1e-05
s
p99
5.1e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000573
s
SD
0.000507
s
p50
0.000554
s
p95
0.001715
s
p99
0.001951
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000461
s
SD
0.000267
s
p50
0.000385
s
p95
0.001093
s
p99
0.001093
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.087956
s
SD
2.47401
s
p50
0.219055
s
p95
0.679124
s
p99
1.412535
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000324
s
SD
0.236259
s
p50
0.0002
s
p95
0.464788
s
p99
1.361471
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
5e-06
s
SD
2e-06
s
p50
5e-06
s
p95
1e-05
s
p99
1.1e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002494
s
SD
0.001491
s
p50
0.002253
s
p95
0.005994
s
p99
0.006561
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000174
s
SD
0.000194
s
p50
0.000157
s
p95
0.000627
s
p99
0.000786
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
4.48
s
mean
342.7
s
SD
520.15
s
p95
1547.95
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
170.2657
s
SD
264.513819
s
p50
31.515906
s
p95
908.084347
s
p99
1117.839352
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.018677
s
SD
0.209829
s
p50
0.006403
s
p95
0.670195
s
p99
0.814027
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.006468
s
SD
0.004671
s
p50
0.004948
s
p95
0.01696
s
p99
0.023201
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.266221
s
SD
0.392776
s
p50
0.009974
s
p95
1.157779
s
p99
1.551618
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.221627
s
SD
0.146723
s
p50
0.085163
s
p95
0.482508
s
p99
0.657412
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
2.625745
s
SD
39.989468
s
p50
10.724193
s
p95
101.04746
s
p99
136.880234
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
72.083481
s
SD
54.906294
s
p50
59.653261
s
p95
144.320644
s
p99
219.90264
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.008943
s
SD
0.004468
s
p50
0.0011
s
p95
0.013555
s
p99
0.019772
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.008067
s
SD
0.084803
s
p50
0.001078
s
p95
0.032651
s
p99
0.135945
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000464
s
SD
0.000471
s
p50
0.000449
s
p95
0.001605
s
p99
0.001923
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
6.350638
s
SD
27.466135
s
p50
0.465289
s
p95
60.011084
s
p99
60.019538
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.436047
s
SD
0.325678
s
p50
0.29249
s
p95
1.358608
s
p99
1.358608
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.105726
s
SD
3.462863
s
p50
0.222306
s
p95
0.683197
s
p99
1.412016
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.24873
s
SD
21.414633
s
p50
0.301185
s
p95
60.00142
s
p99
60.002644
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
24.78
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
96
B/s
mean
215.09
KiB/s
SD
366.69
KiB/s
p95
783.24
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
146
B/s
mean
204.86
KiB/s
SD
423.77
KiB/s
p95
858.24
KiB/s
Total bytes received
Total bytes received on primary network interface
count
9.96
GiB
mean
5.46
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
9.49
GiB
mean
5.20
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.8%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 1017.99 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (82.9% swap used)
System overload anomaly
System overload anomaly was detected
Detected
Warning 26% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.03
%
mean
32.07
%
SD
35.31
%
p95
97.85
%
System
7.28
%
CPU percentiles
CPU usage percentiles
p50
14.55
%
p95
97.85
%
p99
98.75
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
9
hosts
mean time
0.61
s
Memory used percentage
Percentage of memory used
p5
9
%
mean
14.69
%
SD
9.21
%
p95
36.03
%
Memory available percentage
Percentage of available memory
p5
63.97
%
mean
85.31
%
SD
9.21
%
p95
91
%
Max host memory used
Maximum memory usage percentage across all hosts
max
51.91
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
82.94
%
Memory growth rate
Rate of memory growth over time
growth
1017.99
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.82
MiB/s
Disk write throughput
Disk write throughput in MiB/s
40.62
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/5
hosts
Mount Point
/efi-boot0/4
hosts
Mount Point
/etc/hostname0/8
hosts
Mount Point
/etc/hosts0/8
hosts
Mount Point
/etc/nomad.d/client-meta.json0/15
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/8
hosts
Mount Point
/nix/store0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.76
5 min
2.94
15 min
3.42
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
25.93
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
14.1886
%
SD
27.4428
%
p95
82.68
%
60 second average
14.2639
%
300 second average
15.5452
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
3.4637
%
SD
8.6228
%
p95
27.74
%
60 second average
3.7153
%
300 second average
4.6398
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
1.8256
%
SD
5.0754
%
p95
12.74
%
60 second average
2.0214
%
300 second average
2.5725
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
mean
23.44
%
SD
33.5
%
p95
95.13
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
47.13
KiB
mean
226.34
KiB
SD
212.22
KiB
p95
429.71
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
mean
29.75
threads
SD
25.69
threads
p95
50
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
mean
68.81
file descriptors
SD
36.31
file descriptors
p95
104
file descriptors
Write/Query
↑ Back to indexCreates an entry, then queries the source chain and performs a simple operation on the entries, then repeats.
Started
Thu, 30 Jul 2026 03:22:21 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
write_query_30510613785_1
Write timing
The time it takes to complete the zome function call that writes the entry.
mean
0.025986
s
SD
0.012133
s
p50
0.025823
s
p95
0.044187
s
p99
0.046917
s
Write rate
The number of writes completed per second.
mean
112.14
/s
Query timing
The time it takes to complete the
chain_query_count_len zome call that queries the source chain.mean
0.056457
s
SD
0.031684
s
p50
0.054317
s
p95
0.107302
s
p99
0.114526
s
Query rate
The number of chain queries completed per second.
mean
112.14
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::chain_query_count_len'
Metered usage count of the WASM ribosome for this zome function.
total
136651962208
over 280.00250716s
mean rate
4.880383509e+08
/s
std
2.317896806e+07
/s
p5
4.369492631e+08
/s
p95
5.0453052131e+08
/s
peak
5.075104893e+08
/s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
111748868
over 280.00250716s
mean rate
399099.57
/s
std
202334.37
/s
p5
236238.09
/s
p95
833992.79
/s
peak
1.12034663e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.00250716s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
27486088
over 280.00250716s
mean rate
98163.73
/s
std
49745.63
/s
p5
58105.83
/s
p95
205131.38
/s
peak
275563.83
/s
Zome call duration: 'crud::chain_query_count_len'
Duration of this zome call as measured by Holochain internally.
mean
0.024304
s
SD
0.007465
s
p50
0.022591
s
p95
0.031706
s
p99
0.032333
s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.002181
s
SD
4e-05
s
p50
0.002181
s
p95
0.002199
s
p99
0.0022
s
WASM call duration: 'crud::chain_query_count_len'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.0239
s
SD
0.007434
s
p50
0.02219
s
p95
0.031278
s
p99
0.031904
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001817
s
SD
2.6e-05
s
p50
0.001817
s
p95
0.001828
s
p99
0.001828
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00102
s
SD
0
s
p50
0.00102
s
p95
0.00102
s
p99
0.00102
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000626
s
SD
6e-06
s
p50
0.000626
s
p95
0.000629
s
p99
0.000629
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.00018
s
SD
1.7e-05
s
p50
0.000214
s
p95
0.000214
s
p99
0.000214
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.013236
s
SD
0.004269
s
p50
0.012343
s
p95
0.01734
s
p99
0.017665
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000903
s
SD
1.3e-05
s
p50
0.000904
s
p95
0.00091
s
p99
0.00091
s
Post-commit duration
Time spent executing post-commit workflows.
mean
3.5e-05
s
SD
1e-06
s
p50
3.5e-05
s
p95
3.5e-05
s
p99
3.5e-05
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.43
s
mean
148.43
s
SD
83.67
s
p95
278.43
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.002507935s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000808
s
SD
0
s
p50
0.000808
s
p95
0.000808
s
p99
0.000808
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.006882
s
SD
0
s
p50
0.006882
s
p95
0.006882
s
p99
0.006882
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000487
s
SD
4.1e-05
s
p50
0.000484
s
p95
0.000515
s
p99
0.000518
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.011837
s
SD
0.003536
s
p50
0.011191
s
p95
0.015112
s
p99
0.015363
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001813
s
SD
0
s
p50
0.001813
s
p95
0.001813
s
p99
0.001813
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000573
s
SD
0
s
p50
0.000573
s
p95
0.000573
s
p99
0.000573
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001798
s
SD
0.000567
s
p50
0.001692
s
p95
0.002324
s
p99
0.002364
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.0005
s
SD
9.7e-05
s
p50
0.00068
s
p95
0.00068
s
p99
0.00068
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000158
s
SD
2e-06
s
p50
0.000158
s
p95
0.000158
s
p99
0.000158
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
12.99
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
16.28
KiB/s
mean
18.75
KiB/s
SD
1.97
KiB/s
p95
21.44
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
13.70
KiB/s
mean
15.24
KiB/s
SD
1009
B/s
p95
17.45
KiB/s
Total bytes received
Total bytes received on primary network interface
count
5.31
MiB
mean
18.75
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
4.32
MiB
mean
15.24
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 43.48 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
20.07
%
mean
20.31
%
SD
0.14
%
p95
20.47
%
System
7.33
%
CPU percentiles
CPU usage percentiles
p50
20.33
%
p95
20.47
%
p99
20.65
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
26.61
%
mean
27.11
%
SD
0.34
%
p95
27.77
%
Memory available percentage
Percentage of available memory
p5
72.23
%
mean
72.89
%
SD
0.34
%
p95
73.39
%
Max host memory used
Maximum memory usage percentage across all hosts
max
27.11
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
43.48
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
1.71
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/nomad.d/client-meta.json0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.50
5 min
1.17
15 min
0.61
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.01
%
mean
0.431
%
SD
0.319
%
p95
0.99
%
60 second average
0.4607
%
300 second average
0.5060
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
18.33
%
mean
18.61
%
SD
0.18
%
p95
18.89
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
274.87
KiB
mean
301.64
KiB
SD
13.49
KiB
p95
320.31
KiB
Holochain process threads
Number of threads in Holochain process
p5
34
threads
mean
34.4
threads
SD
0.8
threads
p95
36
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
61
file descriptors
mean
62.07
file descriptors
SD
1.98
file descriptors
p95
66
file descriptors
Write/Read
↑ Back to indexCreates an entry and reads it back, then repeats.
Started
Thu, 30 Jul 2026 03:23:55 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
write_read_30510613785_1
Write timing
The time taken to write the entry.
mean
0.026187
s
SD
0.014381
s
p50
0.025136
s
p95
0.050278
s
p99
0.066611
s
Write rate
The number of writes completed per second.
mean
179.21
/s
Read timing
The time taken to read the entry.
mean
0.028757
s
SD
0.016612
s
p50
0.028034
s
p95
0.05553
s
p99
0.072742
s
Read rate
The number of reads completed per second.
mean
179.17
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000162
s
SD
6e-06
s
p50
0.000161
s
p95
0.000168
s
p99
0.000168
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
167086392
over 280.00165279s
mean rate
596733.59
/s
std
286332.61
/s
p5
350780.35
/s
p95
1.23846375e+06
/s
peak
1.53555558e+06
/s
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
155738484
over 280.00165279s
mean rate
556205.59
/s
std
266559.52
/s
p5
326956.61
/s
p95
1.15768801e+06
/s
peak
1.42792987e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.00165279s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
20548536
over 280.00165279s
mean rate
73387.2
/s
std
35213.62
/s
p5
43139.5
/s
p95
152308.14
/s
peak
188844.94
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.00193
s
SD
5.4e-05
s
p50
0.001921
s
p95
0.001976
s
p99
0.001979
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.001172
s
SD
4e-05
s
p50
0.001165
s
p95
0.001204
s
p99
0.001207
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001608
s
SD
3.9e-05
s
p50
0.001602
s
p95
0.001641
s
p99
0.001643
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000852
s
SD
2.4e-05
s
p50
0.000848
s
p95
0.000872
s
p99
0.000873
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000852
s
SD
0
s
p50
0.000852
s
p95
0.000852
s
p99
0.000852
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000575
s
SD
9e-06
s
p50
0.000574
s
p95
0.000583
s
p99
0.000583
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000129
s
SD
1.4e-05
s
p50
0.000154
s
p95
0.000154
s
p99
0.000154
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.00018
s
SD
7e-06
s
p50
0.000178
s
p95
0.000186
s
p99
0.000187
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000814
s
SD
1.6e-05
s
p50
0.000811
s
p95
0.000829
s
p99
0.00083
s
Post-commit duration
Time spent executing post-commit workflows.
mean
2.7e-05
s
SD
1e-06
s
p50
2.7e-05
s
p95
2.8e-05
s
p99
2.8e-05
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.59
s
mean
148.59
s
SD
83.67
s
p95
278.59
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001633284s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000812
s
SD
0
s
p50
0.000812
s
p95
0.000812
s
p99
0.000812
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002292
s
SD
0
s
p50
0.002292
s
p95
0.002292
s
p99
0.002292
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000215
s
SD
3.1e-05
s
p50
0.000207
s
p95
0.000248
s
p99
0.000251
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.016358
s
SD
0.005279
s
p50
0.015307
s
p95
0.021372
s
p99
0.021792
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.002037
s
SD
0
s
p50
0.002037
s
p95
0.002037
s
p99
0.002037
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000717
s
SD
0
s
p50
0.000717
s
p95
0.000717
s
p99
0.000717
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001655
s
SD
0.000522
s
p50
0.001547
s
p95
0.002151
s
p99
0.002191
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000332
s
SD
8.9e-05
s
p50
0.0005
s
p95
0.0005
s
p99
0.0005
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000113
s
SD
5e-06
s
p50
0.000113
s
p95
0.000116
s
p99
0.000116
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
10.30
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
18.14
KiB/s
mean
450.38
KiB/s
SD
1.54
MiB/s
p95
6.07
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
23.02
KiB/s
mean
39.57
KiB/s
SD
35.97
KiB/s
p95
118.52
KiB/s
Total bytes received
Total bytes received on primary network interface
count
127.55
MiB
mean
450.38
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
11.21
MiB
mean
39.57
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 1111.78 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (83.1% swap used)
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
10.81
%
mean
14.65
%
SD
2.65
%
p95
17.87
%
System
4.34
%
CPU percentiles
CPU usage percentiles
p50
13.93
%
p95
17.87
%
p99
18.10
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
54.08
%
mean
55.01
%
SD
0.63
%
p95
55.85
%
Memory available percentage
Percentage of available memory
p5
44.15
%
mean
44.99
%
SD
0.63
%
p95
45.92
%
Max host memory used
Maximum memory usage percentage across all hosts
max
55.01
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
83.10
%
Memory growth rate
Rate of memory growth over time
growth
1111.78
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.40
MiB/s
Disk write throughput
Disk write throughput in MiB/s
31.94
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname0/1
hosts
Mount Point
/etc/hosts0/1
hosts
Mount Point
/etc/nomad.d/client-meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.49
5 min
2.67
15 min
1.58
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0.0503
%
SD
0.1138
%
p95
0.29
%
60 second average
0.0283
%
300 second average
0.0027
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
3.59
%
mean
4.8
%
SD
0.91
%
p95
5.72
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
26.70
KiB
mean
527.71
KiB
SD
229.08
KiB
p95
850.42
KiB
Holochain process threads
Number of threads in Holochain process
p5
17
threads
mean
77.69
threads
SD
15.83
threads
p95
83
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
8
file descriptors
mean
57.78
file descriptors
SD
13.1
file descriptors
p95
64
file descriptors
Write validated
↑ Back to indexCreates an entry, updates it and links the create to the update, then repeats. Each of the three actions is validated by the included hApp.
Started
Thu, 30 Jul 2026 03:25:23 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
write_validated_30510613785_1
Write timing
The time it takes to complete the zome function call that writes the entry, updates it, and links to the update.
mean
0.049049
s
SD
0.024255
s
p50
0.048107
s
p95
0.086989
s
p99
0.106336
s
Write rate
The number of write zome function calls that complete per second.
mean
81.69
/s
Read timing
The time it takes to complete the zome function call that reads the data.
mean
0.074231
s
SD
0.032073
s
p50
0.075067
s
p95
0.122122
s
p99
0.139318
s
Read rate
The number of read zome function calls that complete per second.
mean
81.69
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.003666
s
SD
0.001194
s
p50
0.003385
s
p95
0.004792
s
p99
0.004889
s
WASM usage: 'validated::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
74555352
over 280.001439294s
mean rate
266268.01
/s
std
118631.87
/s
p5
165066.18
/s
p95
536465.22
/s
peak
653399.84
/s
WASM usage: 'validated::update_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
87804000
over 280.001439294s
mean rate
313584.41
/s
std
139582.98
/s
p5
194398.82
/s
p95
631796.25
/s
peak
769510.41
/s
WASM usage: 'validated_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
131914138
over 280.001439294s
mean rate
471119.96
/s
std
209780.27
/s
p5
290311.04
/s
p95
949160.77
/s
peak
1.15648624e+06
/s
WASM usage: 'validated_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
1310160187
over 280.001439294s
mean rate
4.67912406e+06
/s
std
2.08402691e+06
/s
p5
2.8864175e+06
/s
p95
9.42646244e+06
/s
peak
1.14927549e+07
/s
Zome call duration: 'validated::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.002103
s
SD
3.9e-05
s
p50
0.002098
s
p95
0.002139
s
p99
0.002139
s
Zome call duration: 'validated::update_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005919
s
SD
0.00121
s
p50
0.005599
s
p95
0.007081
s
p99
0.007178
s
WASM call duration: 'validated::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001747
s
SD
2.7e-05
s
p50
0.001743
s
p95
0.001773
s
p99
0.001774
s
WASM call duration: 'validated::update_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005564
s
SD
0.0012
s
p50
0.005244
s
p95
0.006718
s
p99
0.006815
s
WASM call duration: 'validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000577
s
SD
1e-06
s
p50
0.000577
s
p95
0.000578
s
p99
0.000578
s
WASM call duration: 'validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002182
s
SD
0.000221
s
p50
0.002129
s
p95
0.002377
s
p99
0.00239
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000141
s
SD
3e-06
s
p50
0.000141
s
p95
0.000145
s
p99
0.000145
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000119
s
SD
9e-06
s
p50
0.000119
s
p95
0.000137
s
p99
0.000163
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.003683
s
SD
0.001205
s
p50
0.003395
s
p95
0.004757
s
p99
0.00483
s
Host function call duration: '__hc__update_1'
Duration of this host function call invoked from within WASM.
mean
0.003814
s
SD
0.001191
s
p50
0.003496
s
p95
0.004959
s
p99
0.005057
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000825
s
SD
4.2e-05
s
p50
0.00089
s
p95
0.000914
s
p99
0.000915
s
Post-commit duration
Time spent executing post-commit workflows.
mean
3.2e-05
s
SD
1e-06
s
p50
3.2e-05
s
p95
3.3e-05
s
p99
3.3e-05
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.51
s
mean
148.51
s
SD
83.67
s
p95
278.51
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001434445s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000901
s
SD
0
s
p50
0.000901
s
p95
0.000901
s
p99
0.000901
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002342
s
SD
0
s
p50
0.002342
s
p95
0.002342
s
p99
0.002342
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000297
s
SD
5.3e-05
s
p50
0.000288
s
p95
0.000343
s
p99
0.000347
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.026221
s
SD
0.008965
s
p50
0.023922
s
p95
0.034872
s
p99
0.035641
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.002701
s
SD
0
s
p50
0.002701
s
p95
0.002701
s
p99
0.002701
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.002201
s
SD
0
s
p50
0.002201
s
p95
0.002201
s
p99
0.002201
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002304
s
SD
0.000795
s
p50
0.002107
s
p95
0.003076
s
p99
0.00315
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00054
s
SD
2.9e-05
s
p50
0.000534
s
p95
0.00056
s
p99
0.000576
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000115
s
SD
2e-06
s
p50
0.000115
s
p95
0.000117
s
p99
0.000125
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
10.52
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
18.14
KiB/s
mean
235.05
KiB/s
SD
1.10
MiB/s
p95
28.99
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
23.15
KiB/s
mean
37.70
KiB/s
SD
33.79
KiB/s
p95
118.52
KiB/s
Total bytes received
Total bytes received on primary network interface
count
66.57
MiB
mean
235.05
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
10.68
MiB
mean
37.70
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (83.1% swap used)
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
11.48
%
mean
14.92
%
SD
2.35
%
p95
17.86
%
System
4.41
%
CPU percentiles
CPU usage percentiles
p50
15.00
%
p95
17.86
%
p99
18.08
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
54.7
%
mean
55.23
%
SD
0.41
%
p95
55.85
%
Memory available percentage
Percentage of available memory
p5
44.15
%
mean
44.77
%
SD
0.41
%
p95
45.3
%
Max host memory used
Maximum memory usage percentage across all hosts
max
55.23
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
83.10
%
Memory growth rate
Rate of memory growth over time
growth
-112.76
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.34
MiB/s
Disk write throughput
Disk write throughput in MiB/s
30.88
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname0/1
hosts
Mount Point
/etc/hosts0/1
hosts
Mount Point
/etc/nomad.d/client-meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.80
5 min
3.25
15 min
1.88
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0.0417
%
SD
0.112
%
p95
0.29
%
60 second average
0.0250
%
300 second average
0.0027
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
3.59
%
mean
4.19
%
SD
0.85
%
p95
5.66
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
26.70
KiB
mean
517.16
KiB
SD
233.47
KiB
p95
850.42
KiB
Holochain process threads
Number of threads in Holochain process
p5
17
threads
mean
77.06
threads
SD
15.68
threads
p95
83
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
8
file descriptors
mean
56.34
file descriptors
SD
12.77
file descriptors
p95
64
file descriptors
Write Validated must_get_agent_activity
↑ Back to index
A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.
The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.
This test is similar to Mixed-Arc must_get_agent_activity, but all agents are full-arc.
Started
Thu, 30 Jul 2026 04:48:38 UTC
Peer count
30
Peer count at end
27
Behaviours
-
must_get_agent_activity(1 agent) -
write(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
write_validated_must_get_agent_activity_30510613785_1
Highest observed
action_seqThe maximum chain length observed per
write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1593.71
Max
Highest chain head value observed for any single write agent.
1842
Write agents observed
7
Chain batch delay timing
The time between a
write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.Mean
mean
-54.867555
s
SD
48.103074
s
Max
Highest per-partition mean latency
max mean
313.847636
s
Min
Lowest per-partition mean latency
min mean
-996.076189
s
Chain batch delay rate
The rate at which a
must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.Mean
mean
2.5
/s
Max
Highest per-partition mean rate
max
3.79
/s
Min
Lowest per-partition mean rate
min
1.94
/s
create_validated_sample_entry zome call timingThe time taken to complete the zome function call that creates the entry that depends on a
write agent's source chain.Mean
mean
0.206001
s
SD
0.196261
s
Max
Highest per-partition mean latency
max mean
0.475331
s
Min
Lowest per-partition mean latency
min mean
0.025361
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on
must_get_agent_activity calls.Total
2632
Agents affected
16 / 16
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
165
Max
Highest count in any single partition
462
Min
Lowest count in any single partition
13
Final error count
The total number of all types of error accumulated over the run by all agents.
63031
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.017174
s
SD
0.016043
s
p50
0.00094
s
p95
0.039176
s
p99
0.070824
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
1
over 800.013855087s
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.004608
s
SD
0.000873
s
p50
0.004242
s
p95
0.00621
s
p99
0.00621
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.057134
s
SD
0.014907
s
p50
0.047189
s
p95
0.083703
s
p99
0.095449
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004518
s
SD
0.002541
s
p50
0.004588
s
p95
0.011655
s
p99
0.013271
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.004983
s
SD
0.002844
s
p50
0.005071
s
p95
0.012424
s
p99
0.014319
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.007393
s
SD
0.006442
s
p50
0.00628
s
p95
0.028727
s
p99
0.028727
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003815
s
SD
0.00074
s
p50
0.003662
s
p95
0.00513
s
p99
0.00513
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.05633
s
SD
0.014946
s
p50
0.046421
s
p95
0.082988
s
p99
0.094694
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003775
s
SD
0.002097
s
p50
0.00377
s
p95
0.009331
s
p99
0.010645
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004401
s
SD
0.002448
s
p50
0.004421
s
p95
0.010104
s
p99
0.012275
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006317
s
SD
0.006299
s
p50
0.005164
s
p95
0.028132
s
p99
0.028132
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001056
s
SD
0.000471
s
p50
0.001049
s
p95
0.002109
s
p99
0.002747
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.008811
s
SD
0.008689
s
p50
0.007093
s
p95
0.024132
s
p99
0.049483
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.1e-05
s
SD
9e-06
s
p50
1.9e-05
s
p95
4.9e-05
s
p99
4.9e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000391
s
SD
0.000231
s
p50
0.000374
s
p95
0.000885
s
p99
0.001353
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000414
s
SD
9.8e-05
s
p50
0.000384
s
p95
0.000561
s
p99
0.000709
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000665
s
SD
0.004829
s
p50
0.000564
s
p95
0.013362
s
p99
0.025918
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.019748
s
SD
0.019319
s
p50
0.016804
s
p95
0.050045
s
p99
0.112472
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.020064
s
SD
0.009976
s
p50
0.013231
s
p95
0.031783
s
p99
0.043676
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1e-05
s
SD
6e-06
s
p50
7e-06
s
p95
2.5e-05
s
p99
2.5e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001698
s
SD
0.001053
s
p50
0.001912
s
p95
0.004612
s
p99
0.005811
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000146
s
SD
0.000132
s
p50
0.000109
s
p95
0.0004
s
p99
0.000749
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.96
s
mean
449.22
s
SD
258.22
s
p95
848.58
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 37472.831169572s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
13.086044
s
SD
15.609494
s
p50
8.211499
s
p95
36.759177
s
p99
117.747417
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.807754
s
SD
1.705829
s
p50
1.231386
s
p95
4.251707
s
p99
10.140831
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.004003
s
SD
0.002144
s
p50
0.00374
s
p95
0.005215
s
p99
0.013874
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.037809
s
SD
0.130633
s
p50
0.039629
s
p95
0.187639
s
p99
0.885151
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.115653
s
SD
0.077298
s
p50
0.065405
s
p95
0.247164
s
p99
0.385551
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.145647
s
SD
2.142539
s
p50
0.172236
s
p95
4.590941
s
p99
12.028048
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
19.018909
s
SD
27.385294
s
p50
10.613747
s
p95
69.069802
s
p99
120.736595
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.003034
s
SD
0.002117
s
p50
0.002171
s
p95
0.005186
s
p99
0.012155
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00673
s
SD
0.00481
s
p50
0.001664
s
p95
0.016937
s
p99
0.021292
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000328
s
SD
0.00018
s
p50
0.000329
s
p95
0.000561
s
p99
0.001188
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.456686
s
SD
19.940117
s
p50
0.085541
s
p95
60.001529
s
p99
60.001704
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.241695
s
SD
0.134536
s
p50
0.221717
s
p95
0.356715
s
p99
0.356715
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
0.310727
s
SD
0
s
p50
0.310727
s
p95
0.310727
s
p99
0.310727
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.188251
s
SD
2.157729
s
p50
0.215167
s
p95
5.25148
s
p99
5.279652
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
35.84
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
79
B/s
mean
105.02
KiB/s
SD
463.83
KiB/s
p95
113.26
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
43
B/s
mean
55.76
KiB/s
SD
53.15
KiB/s
p95
167.05
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.42
GiB
mean
2.73
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.29
GiB
mean
1.45
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 97.7%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 174.52 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (82.9% swap used)
System overload anomaly
System overload anomaly was detected
Detected
Warning 30% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.71
%
mean
45.3
%
SD
29
%
p95
91.62
%
System
9.46
%
CPU percentiles
CPU usage percentiles
p50
46.99
%
p95
91.62
%
p99
97.65
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
10
hosts
mean time
0.39
s
Memory used percentage
Percentage of memory used
p5
12.5
%
mean
17.72
%
SD
9.02
%
p95
37.44
%
Memory available percentage
Percentage of available memory
p5
62.56
%
mean
82.28
%
SD
9.02
%
p95
87.5
%
Max host memory used
Maximum memory usage percentage across all hosts
max
52.27
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
82.91
%
Memory growth rate
Rate of memory growth over time
growth
174.52
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.77
MiB/s
Disk write throughput
Disk write throughput in MiB/s
68.93
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/5
hosts
Mount Point
/efi-boot0/4
hosts
Mount Point
/etc/hostname0/8
hosts
Mount Point
/etc/hosts0/8
hosts
Mount Point
/etc/nomad.d/client-meta.json0/15
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/8
hosts
Mount Point
/nix/store0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.53
5 min
2.61
15 min
2.88
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
29.63
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
11.7929
%
SD
16.3798
%
p95
50.45
%
60 second average
11.7190
%
300 second average
12.6299
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
6.6627
%
SD
12.2214
%
p95
33.95
%
60 second average
6.4775
%
300 second average
5.5074
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
4.1465
%
SD
8.2122
%
p95
24.53
%
60 second average
4.0779
%
300 second average
3.3904
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.02
%
mean
37.92
%
SD
28.51
%
p95
89.35
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
343.55
KiB
mean
440.50
KiB
SD
115.01
KiB
p95
599.81
KiB
Holochain process threads
Number of threads in Holochain process
p5
16
threads
mean
38.19
threads
SD
20.32
threads
p95
64
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
42
file descriptors
mean
76.28
file descriptors
SD
25.13
file descriptors
p95
101
file descriptors
Zero-Arc Create and Read
↑ Back to indexA zero-arc/full-arc mixed scenario with two types of zero-arc nodes -- ones that create data and ones that read data -- as well as full arc nodes to "relay" the data. The scenario has three roles:
zero_write: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so thatzero_readnodes can retrieve them.zero_read: A zero-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.full: A full-arc conductor that is just here to serve entries to zero arc nodes.
Started
Thu, 30 Jul 2026 06:06:39 UTC
Peer count
30
Peer count at end
27
Behaviours
-
full(1 agent) -
zero_read(1 agent) -
zero_write(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
zero_arc_create_and_read_30510613785_1
Create rate
The number of timed entries created by the zero-arc write node(s) per second.
Mean
mean
61.97
/s
Max
Highest per-partition mean rate
max
102.81
/s
Min
Lowest per-partition mean rate
min
47.1
/s
Fetch lag timing
For each entry, the time lag between when it was created and when a zero-arc read node fetched it from the network via the
get_timed_entries_network zome function.Mean
mean
206.988509
s
SD
1.661987
s
Max
Highest per-partition mean latency
max mean
287.784924
s
Min
Lowest per-partition mean latency
min mean
99.191437
s
Fetch lag rate
The number of entries per second fetched by zero-arc read nodes.
Mean
mean
2
/s
Max
Highest per-partition mean rate
max
13
/s
Min
Lowest per-partition mean rate
min
0
/s
Delivery ratio
The proportion of created entries successfully fetched by all zero-arc read nodes.
0.0088
Entry created count
Total number of entries created by zero-arc write nodes, by agent.
Total
56983
Agents affected
10 / 10
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
5698
Max
Highest count in any single partition
9597
Min
Lowest count in any single partition
4345
Received count
Total number of entries fetched by zero-arc read nodes, by agent.
Total
5544
Agents affected
11 / 11
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
504
Max
Highest count in any single partition
504
Min
Lowest count in any single partition
504
Open connections
The number of currently open connections to other conductors.
full-arc
p5
0
mean
7.32
SD
11
p95
24
zero-arc
p5
4
mean
12.29
SD
5.56
p95
23
Error count
The number of errors accumulated across all nodes.
63
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.002454
s
SD
0.093567
s
p50
0.003468
s
p95
0.250661
s
p99
0.399685
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 750.00826217s
Not enough time data to show a trend.
WASM usage: 'timed::created_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
285427005
over 1885.259470235s
mean rate
3.0378231516e+08
/s
std
4.6601271725e+08
/s
p5
238820.92
/s
p95
1.51738136693e+09
/s
peak
1.72455336349e+09
/s
WASM usage: 'timed::get_timed_entries_network'
Metered usage count of the WASM ribosome for this zome function.
total
19502208016
over 878.372558217s
mean rate
6.55966718527e+10
/s
std
1.5932106011e+11
/s
p5
663344.05
/s
p95
4.97990575957e+11
/s
peak
7.80026752736e+11
/s
WASM usage: 'timed_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37461.952111332s
Not enough time data to show a trend.
Zome call duration: 'timed::created_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005137
s
SD
0.00151
s
p50
0.005054
s
p95
0.009202
s
p99
0.009602
s
Zome call duration: 'timed::get_timed_entries_network'
Duration of this zome call as measured by Holochain internally.
mean
0.948769
s
SD
1.100204
s
p50
0.958615
s
p95
3.685466
s
p99
5.950651
s
WASM call duration: 'timed::created_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004563
s
SD
0.001381
s
p50
0.004488
s
p95
0.008296
s
p99
0.008685
s
WASM call duration: 'timed::get_timed_entries_network'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.94801
s
SD
1.099983
s
p50
0.95815
s
p95
3.68329
s
p99
5.948537
s
WASM call duration: 'timed_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000965
s
SD
0.000485
s
p50
0.000952
s
p95
0.002223
s
p99
0.002513
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000271
s
SD
0.0001
s
p50
0.000265
s
p95
0.000533
s
p99
0.000558
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000271
s
SD
9.7e-05
s
p50
0.000281
s
p95
0.000511
s
p99
0.000549
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.001434
s
SD
0.090262
s
p50
0.002133
s
p95
0.237454
s
p99
0.423015
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.403615
s
SD
0.173338
s
p50
0.338034
s
p95
0.659789
s
p99
0.954361
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001446
s
SD
0.00081
s
p50
0.001451
s
p95
0.003729
s
p99
0.003932
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000102
s
SD
0.000162
s
p50
9.5e-05
s
p95
0.000275
s
p99
0.000928
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.95
s
mean
447.96
s
SD
257.47
s
p95
847.87
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 37461.952176501s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
2.212984
s
SD
5.53438
s
p50
0
s
p95
0.866262
s
p99
30.007062
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.065116
s
SD
0.044956
s
p50
0.001795
s
p95
0.138444
s
p99
0.178471
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.00521
s
SD
0.005592
s
p50
0.003369
s
p95
0.013143
s
p99
0.031008
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.033143
s
SD
0.34431
s
p50
0.001244
s
p95
1.106769
s
p99
1.225976
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.097839
s
SD
0.046757
s
p50
0.011659
s
p95
0.138737
s
p99
0.167052
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
8.978355
s
SD
6.353005
s
p50
0.003783
s
p95
15.639904
s
p99
21.415161
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
1.106867
s
SD
2.78171
s
p50
0.002287
s
p95
0.010505
s
p99
15.524056
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000833
s
SD
0.001218
s
p50
0.000481
s
p95
0.003408
s
p99
0.004256
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003285
s
SD
0.007945
s
p50
0.001485
s
p95
0.0223
s
p99
0.040303
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00026
s
SD
0.00029
s
p50
0.000279
s
p95
0.001244
s
p99
0.00134
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.301731
s
SD
29.880101
s
p50
0.208567
s
p95
60.007249
s
p99
60.008474
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.193372
s
SD
28.354637
s
p50
0.186293
s
p95
60.001462
s
p99
60.001621
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.040721
s
SD
0.00506
s
p50
0.039142
s
p95
0.040778
s
p99
0.040778
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
30.56
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
77
B/s
mean
217.33
KiB/s
SD
453.69
KiB/s
p95
670.33
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
43
B/s
mean
184.28
KiB/s
SD
516.19
KiB/s
p95
357.19
KiB/s
Total bytes received
Total bytes received on primary network interface
count
5.01
GiB
mean
5.70
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
4.25
GiB
mean
4.83
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 96.6%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 413.67 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (82.5% swap used)
System overload anomaly
System overload anomaly was detected
Detected
Warning 19% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.2
%
mean
39.88
%
SD
31.94
%
p95
95.99
%
System
9.32
%
CPU percentiles
CPU usage percentiles
p50
34.83
%
p95
95.99
%
p99
96.59
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
7
hosts
mean time
0.67
s
Memory used percentage
Percentage of memory used
p5
10.61
%
mean
15.42
%
SD
8.95
%
p95
34.5
%
Memory available percentage
Percentage of available memory
p5
65.5
%
mean
84.58
%
SD
8.95
%
p95
89.39
%
Max host memory used
Maximum memory usage percentage across all hosts
max
51.85
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
82.46
%
Memory growth rate
Rate of memory growth over time
growth
413.67
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.02
MiB/s
Disk write throughput
Disk write throughput in MiB/s
72.19
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/5
hosts
Mount Point
/efi-boot0/4
hosts
Mount Point
/etc/hostname0/8
hosts
Mount Point
/etc/hosts0/8
hosts
Mount Point
/etc/nomad.d/client-meta.json0/15
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/8
hosts
Mount Point
/nix/store0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.03
5 min
1.60
15 min
1.56
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
18.52
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
11.2936
%
SD
17.2069
%
p95
51.83
%
60 second average
10.7565
%
300 second average
8.3753
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
3.9338
%
SD
8.5672
%
p95
24.74
%
60 second average
3.7458
%
300 second average
3.0749
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
3.0836
%
SD
7.2164
%
p95
20.34
%
60 second average
2.9637
%
300 second average
2.5224
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.18
%
mean
33.52
%
SD
30.98
%
p95
92.39
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
220.89
KiB
mean
289.85
KiB
SD
82.47
KiB
p95
396.14
KiB
Holochain process threads
Number of threads in Holochain process
p5
21
threads
mean
32.3
threads
SD
13.27
threads
p95
50
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
52
file descriptors
mean
68.98
file descriptors
SD
18.24
file descriptors
p95
87
file descriptors
Zero-Arc Create Data
↑ Back to index
A zero-arc/full-arc mixed scenario where zero-arc nodes create data and full-arc nodes read the data. The scenario has two roles:
zero: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so that full-arc nodes can retrieve them.full: A full-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Thu, 30 Jul 2026 05:19:57 UTC
Peer count
30
Peer count at end
25
Behaviours
-
full(1 agent) -
zero(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
zero_arc_create_data--high_zero_30510613785_1
Create rate
The number of timed entries created by the zero-arc node(s) per second.
Mean
mean
66.23
/s
Max
Highest per-partition mean rate
max
105.72
/s
Min
Lowest per-partition mean rate
min
32.28
/s
Sync lag timing
For each entry, the time lag between when it was created and when the full-arc node could read it via the
get_timed_local_entries zome function.Mean
mean
310.034962
s
SD
260.589871
s
Max
Highest per-partition mean latency
max mean
310.034962
s
Min
Lowest per-partition mean latency
min mean
310.034962
s
Sync lag rate
The number of entries per second received by full nodes.
Mean
mean
115.88
/s
Max
Highest per-partition mean rate
max
115.88
/s
Min
Lowest per-partition mean rate
min
115.88
/s
Delivery ratio
The proportion of created entries successfully received by all full-arc nodes.
0.0076
Entry created count
Total number of entries created by zero-arc nodes, by agent.
Total
136070
Agents affected
23 / 23
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
5916
Max
Highest count in any single partition
9440
Min
Lowest count in any single partition
2856
Received count
Total number of entries received by full-arc nodes, by agent.
Total
2058
Agents affected
1 / 2
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
1029
Max
Highest count in any single partition
2058
Min
Lowest count in any single partition
0
Open connections
The number of currently open connections to other conductors.
full-arc
p5
12
mean
21.08
SD
4.34
p95
24
zero-arc
p5
2
mean
7.56
SD
4.58
p95
16
Error count
The number of errors accumulated across all nodes.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000347
s
SD
8e-05
s
p50
0.000365
s
p95
0.000505
s
p99
0.000537
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
50
over 800.006918656s
mean rate
11.29
/s
std
6.25
/s
p5
0.88
/s
p95
20.75
/s
peak
20.76
/s
WASM usage: 'timed::created_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
307876320
over 1854.45956639s
mean rate
3.5279575668e+08
/s
std
3.9492818045e+08
/s
p5
313877.52
/s
p95
1.16624052459e+09
/s
peak
1.7794640504e+09
/s
WASM usage: 'timed::get_timed_entries_local'
Metered usage count of the WASM ribosome for this zome function.
total
60955971459
over 882.286725134s
mean rate
1.32602242417e+10
/s
std
8.23704726018e+09
/s
p5
3.5641789393e+08
/s
p95
2.54621558864e+10
/s
peak
2.67934833449e+10
/s
WASM usage: 'timed_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37461.008208427s
Not enough time data to show a trend.
Zome call duration: 'timed::created_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004905
s
SD
0.002345
s
p50
0.004867
s
p95
0.008837
s
p99
0.01515
s
Zome call duration: 'timed::get_timed_entries_local'
Duration of this zome call as measured by Holochain internally.
mean
0.047585
s
SD
0.075841
s
p50
0.008481
s
p95
0.214935
s
p99
0.229557
s
WASM call duration: 'timed::created_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004331
s
SD
0.002022
s
p50
0.004291
s
p95
0.007936
s
p99
0.013021
s
WASM call duration: 'timed::get_timed_entries_local'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.046954
s
SD
0.075784
s
p50
0.007856
s
p95
0.214193
s
p99
0.228809
s
WASM call duration: 'timed_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000939
s
SD
0.000453
s
p50
0.000979
s
p95
0.00222
s
p99
0.002433
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000266
s
SD
0.00014
s
p50
0.000259
s
p95
0.000495
s
p99
0.000885
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000263
s
SD
0.000149
s
p50
0.000275
s
p95
0.00049
s
p99
0.00092
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000351
s
SD
4.1e-05
s
p50
0.000346
s
p95
0.000462
s
p99
0.000532
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.002009
s
SD
0.00283
s
p50
0.000536
s
p95
0.008077
s
p99
0.008583
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001445
s
SD
0.000757
s
p50
0.001352
s
p95
0.003923
s
p99
0.004302
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.0001
s
SD
8.5e-05
s
p50
9.5e-05
s
p95
0.000272
s
p99
0.000488
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.96
s
mean
448.62
s
SD
258
s
p95
848.5
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 37461.008144364s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
3.591777
s
SD
7.738022
s
p50
0
s
p95
0.005886
s
p99
43.983443
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.071821
s
SD
0.097678
s
p50
0.001478
s
p95
0.136905
s
p99
0.178849
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.004124
s
SD
0.002478
s
p50
0.003551
s
p95
0.009373
s
p99
0.012622
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.00579
s
SD
0.217108
s
p50
0.000844
s
p95
0.516304
s
p99
1.14669
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.091835
s
SD
0.046977
s
p50
0.072312
s
p95
0.146718
s
p99
0.216589
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
12.353926
s
SD
8.583558
s
p50
0.003084
s
p95
18.143091
s
p99
45.08802
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
5.961982
s
SD
10.034535
s
p50
0.003086
s
p95
0.017024
s
p99
98.113555
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002228
s
SD
0.001804
s
p50
0.003256
s
p95
0.005734
s
p99
0.009016
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.006912
s
SD
0.009423
s
p50
0.00144
s
p95
0.031599
s
p99
0.042779
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000214
s
SD
0.000119
s
p50
0.000221
s
p95
0.000451
s
p99
0.000733
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
13.521014
s
SD
29.905993
s
p50
0.182312
s
p95
60.003087
s
p99
60.003087
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.112249
s
SD
0.004984
s
p50
0.112583
s
p95
0.114508
s
p99
0.114582
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
40.75
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
68
B/s
mean
148.86
KiB/s
SD
473.37
KiB/s
p95
801.79
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
51
B/s
mean
118.71
KiB/s
SD
127.96
KiB/s
p95
263.94
KiB/s
Total bytes received
Total bytes received on primary network interface
count
3.44
GiB
mean
3.83
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.74
GiB
mean
3.05
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 97.8%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 382.90 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (82.9% swap used)
System overload anomaly
System overload anomaly was detected
Detected
Warning 33% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.03
%
mean
50.53
%
SD
29.73
%
p95
95.2
%
System
9.78
%
CPU percentiles
CPU usage percentiles
p50
55.64
%
p95
95.20
%
p99
97.75
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
10
hosts
mean time
0.57
s
Memory used percentage
Percentage of memory used
p5
10.82
%
mean
15.77
%
SD
8.9
%
p95
35.04
%
Memory available percentage
Percentage of available memory
p5
64.96
%
mean
84.23
%
SD
8.9
%
p95
89.18
%
Max host memory used
Maximum memory usage percentage across all hosts
max
51.42
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
82.86
%
Memory growth rate
Rate of memory growth over time
growth
382.90
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.09
MiB/s
Disk write throughput
Disk write throughput in MiB/s
79.01
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/5
hosts
Mount Point
/efi-boot0/4
hosts
Mount Point
/etc/hostname0/8
hosts
Mount Point
/etc/hosts0/8
hosts
Mount Point
/etc/nomad.d/client-meta.json0/15
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/8
hosts
Mount Point
/nix/store0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.65
5 min
2.72
15 min
2.80
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
33.33
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
11.616
%
SD
15.472
%
p95
40.74
%
60 second average
11.5806
%
300 second average
12.1521
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
5.7892
%
SD
10.2578
%
p95
27.34
%
60 second average
5.8772
%
300 second average
5.8929
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
4.4399
%
SD
8.5136
%
p95
22.53
%
60 second average
4.5362
%
300 second average
4.4650
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.25
%
mean
44.25
%
SD
29.72
%
p95
93.68
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
224.09
KiB
mean
324.52
KiB
SD
84.99
KiB
p95
471.48
KiB
Holochain process threads
Number of threads in Holochain process
p5
21
threads
mean
33.95
threads
SD
12.75
threads
p95
46
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
60
file descriptors
mean
71.56
file descriptors
SD
16.96
file descriptors
p95
83
file descriptors
Zome Call, Single Value
↑ Back to indexCalls a zome function that returns a fixed value. This tests the maximum performance of zome calls when the zome function is not calling into Holochain other otherwise doing any work.
Started
Thu, 30 Jul 2026 03:27:03 UTC
Peer count
1
Peer count at end
1
Behaviours
-
default(1 agent)
Holochain version
0.7.0-rc.1
Wind Tunnel version
0.7.0
Run ID
zome_call_single_value_30510613785_1
Call timing
The time taken for the call to complete.
mean
0.001529
s
SD
0.00052
s
p50
0.001465
s
p95
0.001807
s
p99
0.002432
s
Call rate
The number of zome calls completed per second.
mean
6522.97
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'return_single_value::get_value'
Metered usage count of the WASM ribosome for this zome function.
total
731198218
over 280.001613832s
mean rate
2.61140716e+06
/s
std
156109.81
/s
p5
2.43636716e+06
/s
p95
2.85615503e+06
/s
peak
2.87214735e+06
/s
Zome call duration: 'return_single_value::get_value'
Duration of this zome call as measured by Holochain internally.
mean
0.00084
s
SD
1.1e-05
s
p50
0.000848
s
p95
0.000857
s
p99
0.000858
s
WASM call duration: 'return_single_value::get_value'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000583
s
SD
6e-06
s
p50
0.000588
s
p95
0.000593
s
p99
0.000594
s
Post-commit duration
Time spent executing post-commit workflows.
mean
5.5e-05
s
SD
0
s
p50
5.5e-05
s
p95
5.5e-05
s
p99
5.5e-05
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.54
s
mean
148.54
s
SD
83.67
s
p95
278.54
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001605186s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001145
s
SD
0
s
p50
0.001145
s
p95
0.001145
s
p99
0.001145
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001523
s
SD
0
s
p50
0.001523
s
p95
0.001523
s
p99
0.001523
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000594
s
SD
0
s
p50
0.000594
s
p95
0.000594
s
p99
0.000594
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001679
s
SD
0.000322
s
p50
0.001796
s
p95
0.002293
s
p99
0.002293
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.002498
s
SD
0
s
p50
0.002498
s
p95
0.002498
s
p99
0.002498
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.002444
s
SD
0
s
p50
0.002444
s
p95
0.002444
s
p99
0.002444
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
2e-05
s
SD
1e-06
s
p50
2e-05
s
p95
2e-05
s
p99
2.1e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000567
s
SD
0.000101
s
p50
0.000705
s
p95
0.000705
s
p99
0.000705
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000154
s
SD
0
s
p50
0.000154
s
p95
0.000154
s
p99
0.000154
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
8.33
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
18.27
KiB/s
mean
248.30
KiB/s
SD
1.11
MiB/s
p95
388.46
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
23.59
KiB/s
mean
34.65
KiB/s
SD
28.59
KiB/s
p95
109.03
KiB/s
Total bytes received
Total bytes received on primary network interface
count
70.32
MiB
mean
248.30
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
9.81
MiB
mean
34.65
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected
Critical Heavy swap usage (83.1% swap used)
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
5.39
%
mean
12.34
%
SD
4.7
%
p95
17.87
%
System
4.00
%
CPU percentiles
CPU usage percentiles
p50
12.20
%
p95
17.87
%
p99
18.10
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
52.98
%
mean
54.71
%
SD
0.98
%
p95
55.85
%
Memory available percentage
Percentage of available memory
p5
44.15
%
mean
45.29
%
SD
0.98
%
p95
47.02
%
Max host memory used
Maximum memory usage percentage across all hosts
max
54.71
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
83.10
%
Memory growth rate
Rate of memory growth over time
growth
-1849.68
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.16
MiB/s
Disk write throughput
Disk write throughput in MiB/s
34.94
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname0/1
hosts
Mount Point
/etc/hosts0/1
hosts
Mount Point
/etc/nomad.d/client-meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.50
5 min
3.61
15 min
2.16
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0.017
%
SD
0.0556
%
p95
0.1
%
60 second average
0.0113
%
300 second average
0.0007
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
3.59
%
mean
3.71
%
SD
0.57
%
p95
3.62
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
400.51
KiB
mean
403.68
KiB
SD
23.86
KiB
p95
409.09
KiB
Holochain process threads
Number of threads in Holochain process
p5
80
threads
mean
79.47
threads
SD
8.81
threads
p95
82
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
57
file descriptors
mean
58.17
file descriptors
SD
9.15
file descriptors
p95
63
file descriptors