App Install

↑ Back to index

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Thu, 23 Jul 2026 03:52:45 UTC
Peer count
1
Peer count at end
1
Behaviours
  • large (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
app_install_large_29977387554_1
First install time
The time from conductor startup to completion of the first app installation attempt.
0.168805882
s
Install app timing
The time taken to install an app.
mean
0.05983
s
SD
0.005959
s
p50
0.059455
s
<
p95
0.069593
s
<
p99
0.071845
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'large::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 281.390170627s
Not enough time data to show a trend.
WASM call duration: 'large::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004286
s
SD
0.001437
s
p50
0.00387
s
<
p95
0.007884
s
<
p99
0.009348
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.025179
s
SD
0.00426
s
p50
0.024464
s
<
p95
0.033675
s
<
p99
0.035466
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
16.82
s
<
mean
147.05
s
SD
83.97
s
<
p95
278.21
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 281.38994472s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001095
s
SD
1.3e-05
s
p50
0.001097
s
p95
0.001097
s
<
p99
0.001101
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.003391
s
SD
0.000629
s
p50
0.003385
s
p95
0.003385
s
<
p99
0.006829
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.00226
s
SD
9.4e-05
s
p50
0.002261
s
p95
0.002261
s
<
p99
0.002763
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.003583
s
SD
0.000226
s
p50
0.003583
s
p95
0.003583
s
<
p99
0.004815
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001905
s
SD
2.2e-05
s
p50
0.001905
s
p95
0.001905
s
<
p99
0.001922
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001031
s
SD
8.3e-05
s
p50
0.001033
s
p95
0.001033
s
p99
0.001033
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000331
s
SD
0.000164
s
p50
0.0003
s
<
p95
0.000614
s
<
p99
0.001033
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000421
s
SD
0.000108
s
p50
0.00039
s
<
p95
0.000627
s
<
p99
0.000771
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000402
s
SD
1.6e-05
s
p50
0.000402
s
p95
0.000402
s
<
p99
0.000419
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
67.31
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
5.39
KiB/s
<
mean
680.00
KiB/s
SD
1.12
MiB/s
<
p95
3.38
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
4.80
KiB/s
<
mean
150.60
KiB/s
SD
214.98
KiB/s
<
p95
613.34
KiB/s
Total bytes received
Total bytes received on primary network interface
count
199.22
MiB
mean
680.00
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
44.12
MiB
mean
150.60
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 95.8%

Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 100% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
82.46
%
<
mean
91.18
%
SD
4.15
%
<
p95
95.57
%
System
23.88
%
CPU percentiles
CPU usage percentiles
p50
92.42
%
p95
95.57
%
p99
95.75
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.97
s
Memory used percentage
Percentage of memory used
p5
17.99
%
<
mean
21
%
SD
1.85
%
<
p95
23.8
%
Memory available percentage
Percentage of available memory
p5
76.2
%
<
mean
79
%
SD
1.85
%
<
p95
82.01
%
Max host memory used
Maximum memory usage percentage across all hosts
max
21.00
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-235.44
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
7.38
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
11.59
5 min
6.49
15 min
2.93
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
100.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
50.48
%
<
mean
71.6313
%
SD
11.1924
%
<
p95
86.11
%
60 second average
65.4445
%
300 second average
39.3368
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.1381
%
SD
0.2775
%
<
p95
1.08
%
60 second average
0.1106
%
300 second average
0.0858
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0042
%
300 second average
0.0019
%
Holochain process CPU usage
CPU usage by Holochain process
p5
20.38
%
<
mean
25.43
%
SD
3.47
%
<
p95
28.66
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
1.72
KiB
<
mean
368.95
KiB
SD
222.79
KiB
<
p95
715.80
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
167.81
threads
SD
188.12
threads
<
p95
467
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
7
file descriptors
<
mean
418.31
file descriptors
SD
474.93
file descriptors
<
p95
1162
file descriptors

App Install

↑ Back to index

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Thu, 23 Jul 2026 03:54:25 UTC
Peer count
1
Peer count at end
1
Behaviours
  • minimal (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
app_install_minimal_29977387554_1
First install time
The time from conductor startup to completion of the first app installation attempt.
0.4092167
s
Install app timing
The time taken to install an app.
mean
0.075672
s
SD
0.02794
s
p50
0.06668
s
<
p95
0.136782
s
<
p99
0.178811
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'callback::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.826349553s
Not enough time data to show a trend.
WASM usage: 'callback_integrity::genesis_self_check_2'
Metered usage count of the WASM ribosome for this zome function.
total
245835
over 280.826349553s
mean rate
877.94
/s
std
3349.46
/s
p5
0
/s
p95
8194.39
/s
peak
16387.9
/s
WASM call duration: 'callback::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001376
s
SD
0.000691
s
p50
0.001113
s
<
p95
0.002342
s
<
p99
0.004315
s
WASM call duration: 'callback_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001396
s
SD
3.1e-05
s
p50
0.001396
s
p95
0.001396
s
p99
0.001396
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.006545
s
SD
0.004381
s
p50
0.005799
s
<
p95
0.011672
s
<
p99
0.032287
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
16.04
s
<
mean
146.51
s
SD
83.98
s
<
p95
276.86
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.826499553s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001586
s
SD
0.000394
s
p50
0.001585
s
p95
0.001585
s
<
p99
0.00374
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.005181
s
SD
0.000198
s
p50
0.005184
s
p95
0.005184
s
p99
0.005184
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.003135
s
SD
0.000265
s
p50
0.003134
s
p95
0.003134
s
<
p99
0.00458
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.004987
s
SD
0.000472
s
p50
0.004991
s
p95
0.004991
s
<
p99
0.007546
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.002329
s
SD
8.6e-05
s
p50
0.002329
s
p95
0.002329
s
p99
0.002329
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.002907
s
SD
0.000268
s
p50
0.002934
s
p95
0.002934
s
p99
0.002934
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000504
s
SD
0.000486
s
p50
0.000351
s
<
p95
0.001828
s
<
p99
0.002689
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000453
s
SD
0.000158
s
p50
0.000467
s
<
p95
0.000749
s
<
p99
0.001167
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000508
s
SD
1.4e-05
s
p50
0.000508
s
p95
0.000508
s
<
p99
0.000512
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
68.89
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
5.39
KiB/s
<
mean
963.29
KiB/s
SD
1.39
MiB/s
<
p95
3.37
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
4.80
KiB/s
<
mean
439.36
KiB/s
SD
400.41
KiB/s
<
p95
1.13
MiB/s
Total bytes received
Total bytes received on primary network interface
count
282.21
MiB
mean
963.29
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
128.72
MiB
mean
439.36
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 96.7%

Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 100% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
87.22
%
<
mean
92.47
%
SD
2.78
%
<
p95
95.77
%
System
23.58
%
CPU percentiles
CPU usage percentiles
p50
93.01
%
p95
95.77
%
p99
96.72
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
1.00
s
Memory used percentage
Percentage of memory used
p5
13.76
%
<
mean
19.31
%
SD
2.94
%
<
p95
23.06
%
Memory available percentage
Percentage of available memory
p5
76.94
%
<
mean
80.69
%
SD
2.94
%
<
p95
86.24
%
Max host memory used
Maximum memory usage percentage across all hosts
max
19.31
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-1298.02
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
9.08
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
14.07
5 min
8.79
15 min
4.12
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
100.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
66.77
%
<
mean
76.6552
%
SD
6.2025
%
<
p95
86.11
%
60 second average
73.9245
%
300 second average
49.8471
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.1429
%
SD
0.2193
%
<
p95
0.52
%
60 second average
0.1152
%
300 second average
0.0858
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
1.48
%
<
mean
25.87
%
SD
12.26
%
<
p95
48
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
19.00
KiB
<
mean
311.46
KiB
SD
209.86
KiB
<
p95
635.46
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
90.8
threads
SD
147.34
threads
<
p95
467
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
7
file descriptors
<
mean
220.98
file descriptors
SD
370.45
file descriptors
<
p95
1162
file descriptors

DHT Sync Lag

↑ Back to index

Measures the lag time between an agent publishing data and other peers being able to see it. This scenario has two roles:

  • write: Creates entries with a timestamp field, linked to a known base hash so that record_lag agents can discover them.
  • record_lag: Repeatedly queries for links from the known base hash. When a new entry is discovered, it calculates the time difference between the entry's timestamp and the current time, giving the sync lag for that entry.
Started
Thu, 23 Jul 2026 03:56:24 UTC
Peer count
30
Peer count at end
26
Behaviours
  • record_lag (1 agent)
  • write (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
dht_sync_lag_29977387554_1
Create rate
The average number of created records per agent.
Mean
mean
46.57
/s
Max
Highest per-partition mean rate
max
132.07
/s
Min
Lowest per-partition mean rate
min
8.72
/s
Sync lag timing
The average time between when a record was created and when it is first seen by an agent.
Mean
mean
810.140388
s
SD
384.200435
s
Max
Highest per-partition mean latency
max mean
1155.372583
s
Min
Lowest per-partition mean latency
min mean
454.801392
s
Sync lag rate
The average number of created records discovered per agent.
Mean
mean
157.27
/s
Max
Highest per-partition mean rate
max
294.06
/s
Min
Lowest per-partition mean rate
min
22.83
/s
Delivery ratio
The proportion of created entries successfully received by all record_lag agents.
0.0168
Sent count
The total number of entries sent (created) by write agents, by agent.
Total
177533
Agents affected
24 / 24
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
7397
Max
Highest count in any single partition
23810
Min
Lowest count in any single partition
1354
Received count
The total number of entries received by record_lag agents, by agent.
Total
11902
Agents affected
4 / 4
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
2976
Max
Highest count in any single partition
5008
Min
Lowest count in any single partition
912
Error count
The number of errors encountered during the scenario.
7680
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000361
s
SD
0.0016
s
p50
0.000272
s
<
p95
0.004869
s
<
p99
0.005021
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
3
over 2568.274896736s
WASM usage: 'timed::created_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
461523060
over 38372.673308608s
mean rate
3.84381697825e+09
/s
std
1.31496427082e+10
/s
p5
97882.94
/s
p95
1.55045595748e+10
/s
peak
2.23556874704e+11
/s
WASM usage: 'timed::get_timed_entries_local'
Metered usage count of the WASM ribosome for this zome function.
total
384567735792
over 2792.51518652s
mean rate
1.60635578776e+10
/s
std
1.90328486787e+10
/s
p5
2.0931724085e+08
/s
p95
5.85262545229e+10
/s
peak
6.7002274243e+10
/s
WASM usage: 'timed_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
52234656
over 38372.673308608s
mean rate
4.1318805066e+08
/s
std
1.38407171595e+09
/s
p5
13847.84
/s
p95
1.5574933034e+09
/s
peak
2.53019132925e+10
/s
Zome call duration: 'timed::created_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.04965
s
SD
0.048165
s
p50
0.041381
s
<
p95
0.160311
s
<
p99
0.214118
s
Zome call duration: 'timed::get_timed_entries_local'
Duration of this zome call as measured by Holochain internally.
mean
0.177097
s
SD
0.106692
s
p50
0.148921
s
<
p95
0.367666
s
<
p99
0.428129
s
WASM call duration: 'timed::created_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.035896
s
SD
0.037354
s
p50
0.030612
s
<
p95
0.124827
s
<
p99
0.161769
s
WASM call duration: 'timed::get_timed_entries_local'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.172531
s
SD
0.105751
s
p50
0.145548
s
<
p95
0.362678
s
<
p99
0.421643
s
WASM call duration: 'timed_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001539
s
SD
0.001571
s
p50
0.001674
s
<
p95
0.004845
s
<
p99
0.007975
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.002139
s
SD
0.005429
s
p50
0.001185
s
<
p95
0.014855
s
<
p99
0.022402
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.002182
s
SD
0.005481
s
p50
0.001253
s
<
p95
0.014929
s
<
p99
0.021946
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000373
s
SD
0.001623
s
p50
0.000389
s
<
p95
0.004922
s
<
p99
0.005082
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.006676
s
SD
0.003869
s
p50
0.005497
s
<
p95
0.013726
s
<
p99
0.014846
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.014288
s
SD
0.012784
s
p50
0.011049
s
<
p95
0.04051
s
<
p99
0.061951
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.013302
s
SD
0.014276
s
p50
0.015765
s
<
p95
0.051401
s
<
p99
0.072815
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
95.18
s
<
mean
903.63
s
SD
520.47
s
<
p95
1716.55
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
78.201478
s
SD
99.711589
s
p50
9.977603
s
<
p95
308.30793
s
<
p99
414.077326
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
1.437464
s
SD
10.777345
s
p50
2.472983
s
<
p95
32.506204
s
<
p99
58.764858
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002104
s
SD
0.002418
s
p50
0.001192
s
<
p95
0.006084
s
<
p99
0.01235
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.165912
s
SD
0.391085
s
p50
0.159641
s
<
p95
1.258122
s
<
p99
1.589839
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.403892
s
SD
7.875213
s
p50
0.287255
s
<
p95
11.192518
s
<
p99
38.267558
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
6.227328
s
SD
40.758224
s
p50
16.940397
s
<
p95
135.346387
s
<
p99
177.085018
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
44.919474
s
SD
60.06574
s
p50
0.070957
s
<
p95
166.985878
s
<
p99
306.979511
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.006828
s
SD
0.00407
s
p50
0.003861
s
<
p95
0.012305
s
<
p99
0.015204
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003741
s
SD
0.019818
s
p50
0.001375
s
<
p95
0.053325
s
<
p99
0.109413
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.002129
s
SD
0.004747
s
p50
0.00084
s
<
p95
0.012142
s
<
p99
0.01972
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.686302
s
SD
29.281015
s
p50
0.293625
s
<
p95
60.032196
s
<
p99
60.048506
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.530319
s
SD
4.645299
s
p50
0.988901
s
<
p95
10.25109
s
<
p99
12.067393
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
53.51
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
91
B/s
<
mean
661.06
KiB/s
SD
580.59
KiB/s
<
p95
1.37
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
56
B/s
<
mean
597.78
KiB/s
SD
777.46
KiB/s
<
p95
1.87
MiB/s
Total bytes received
Total bytes received on primary network interface
count
31.85
GiB
mean
17.92
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
28.80
GiB
mean
16.20
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.8%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 766.55 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (74.1% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 71% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
11.66
%
<
mean
64.81
%
SD
29.58
%
<
p95
97.5
%
System
11.30
%
CPU percentiles
CPU usage percentiles
p50
77.37
%
p95
97.50
%
p99
98.80
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
16
hosts
mean time
0.82
s
Memory used percentage
Percentage of memory used
p5
10.75
%
<
mean
20.01
%
SD
8.59
%
<
p95
41.04
%
Memory available percentage
Percentage of available memory
p5
58.98
%
<
mean
79.99
%
SD
8.59
%
<
p95
89.25
%
Max host memory used
Maximum memory usage percentage across all hosts
max
47.02
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
74.07
%
Memory growth rate
Rate of memory growth over time
growth
766.55
MiB/s
Disk read throughput
Disk read throughput in MiB/s
8.56
MiB/s
Disk write throughput
Disk write throughput in MiB/s
331.46
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/5
hosts
Mount Point /efi-boot
0/4
hosts
Mount Point /etc/hostname
0/8
hosts
Mount Point /etc/hosts
0/8
hosts
Mount Point /etc/nomad.d/client-meta.json
0/16
hosts
Mount Point /etc/nomad.d/meta.json
0/1
hosts
Mount Point /etc/resolv.conf
0/8
hosts
Mount Point /nix/store
0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
5.25
5 min
4.65
15 min
3.26
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
71.43
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.07
%
<
mean
29.3004
%
SD
24.939
%
<
p95
71.03
%
60 second average
28.6093
%
300 second average
25.3597
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
15.1766
%
SD
23.0391
%
<
p95
64.9
%
60 second average
14.7996
%
300 second average
12.8207
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
9.8642
%
SD
17.9017
%
<
p95
48.7
%
60 second average
9.6249
%
300 second average
8.3542
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.16
%
<
mean
35.44
%
SD
35.1
%
<
p95
93.54
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
246.86
KiB
<
mean
531.60
KiB
SD
312.00
KiB
<
p95
1.06
MiB
Holochain process threads
Number of threads in Holochain process
p5
9
threads
<
mean
44.38
threads
SD
21.59
threads
<
p95
74
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
12
file descriptors
<
mean
96.41
file descriptors
SD
28.93
file descriptors
<
p95
131
file descriptors

First Call

↑ Back to index

This scenario installs a simple app which implements the init callback, and measures the time elapsed between start of install and calling init. It will uninstall the app it installed so that it can re-install it on the next iteration. This is required to re-run the initialisation callback.

Started
Thu, 23 Jul 2026 03:36:26 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
first_call_29977387554_1
Zome call timing
The time elapsed between start of install and calling init.
mean
0.019064
s
SD
0.002477
s
p50
0.020042
s
<
p95
0.021898
s
<
p99
0.022694
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.002277167s
Not enough time data to show a trend.
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.002277167s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
144088
over 280.002277167s
mean rate
514.59
/s
std
2673.91
/s
p5
0
/s
p95
0
/s
peak
14408.65
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.014363
s
SD
0.000112
s
p50
0.014378
s
p95
0.014378
s
p99
0.014378
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.007039
s
SD
0.002557
s
p50
0.008622
s
<
p95
0.009031
s
<
p99
0.009389
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000865
s
SD
7.8e-05
s
p50
0.000846
s
<
p95
0.000969
s
<
p99
0.001295
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000603
s
SD
0
s
p50
0.000603
s
p95
0.000603
s
p99
0.000603
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000177
s
SD
1e-06
s
p50
0.000176
s
<
p95
0.000177
s
p99
0.000177
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.006147
s
SD
0.000155
s
p50
0.006167
s
p95
0.006167
s
p99
0.006167
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.005822
s
SD
0.00136
s
p50
0.006605
s
<
p95
0.007027
s
<
p99
0.007079
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.59
s
<
mean
148.59
s
SD
83.67
s
<
p95
278.59
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.00215553s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001029
s
SD
1.5e-05
s
p50
0.001027
s
p95
0.001027
s
<
p99
0.001108
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000832
s
SD
2e-05
s
p50
0.000835
s
p95
0.000835
s
p99
0.000835
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000872
s
SD
2e-06
s
p50
0.000871
s
p95
0.000871
s
<
p99
0.00088
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.00163
s
SD
6e-06
s
p50
0.001631
s
p95
0.001631
s
p99
0.001631
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001676
s
SD
2.5e-05
s
p50
0.001672
s
p95
0.001672
s
<
p99
0.001811
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001146
s
SD
1.9e-05
s
p50
0.001143
s
p95
0.001143
s
<
p99
0.001246
s
Authored DB connection use time
Time spent holding authored database connections.
mean
9.4e-05
s
SD
1.5e-05
s
p50
9.2e-05
s
<
p95
0.000117
s
<
p99
0.000162
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000199
s
SD
2.5e-05
s
p50
0.000221
s
<
p95
0.000264
s
<
p99
0.000271
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000147
s
SD
1e-06
s
p50
0.000148
s
p95
0.000148
s
p99
0.000148
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
8.78
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
256
B/s
<
mean
464.47
KiB/s
SD
1.64
MiB/s
<
p95
6.46
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
18
B/s
<
mean
11.00
KiB/s
SD
25.33
KiB/s
<
p95
90.39
KiB/s
Total bytes received
Total bytes received on primary network interface
count
131.54
MiB
mean
464.47
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
3.12
MiB
mean
11.00
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1042.44 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
18.99
%
<
mean
20.48
%
SD
2.53
%
<
p95
27.03
%
System
11.71
%
CPU percentiles
CPU usage percentiles
p50
19.36
%
p95
27.03
%
p99
27.64
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
16.31
%
<
mean
20.79
%
SD
4.1
%
<
p95
27.29
%
Memory available percentage
Percentage of available memory
p5
72.71
%
<
mean
79.21
%
SD
4.1
%
<
p95
83.69
%
Max host memory used
Maximum memory usage percentage across all hosts
max
20.79
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1042.44
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
6.62
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.85
5 min
1.28
15 min
0.50
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
1.08
%
<
mean
6.092
%
SD
1.7401
%
<
p95
8.2
%
60 second average
4.9260
%
300 second average
2.2287
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.05
%
<
mean
5.09
%
SD
5.73
%
<
p95
12.76
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
253.70
KiB
<
mean
335.04
KiB
SD
98.51
KiB
<
p95
469.38
KiB
Holochain process threads
Number of threads in Holochain process
p5
30
threads
<
mean
115.57
threads
SD
153.33
threads
<
p95
432
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
47
file descriptors
<
mean
272.83
file descriptors
SD
386.4
file descriptors
<
p95
1067
file descriptors

Local Signals

↑ Back to index

This scenario is for testing the speed and reliability of local signals. It uses a zome with a function that will emit 10,000 signals. The scenario measures how long it takes to send the signals and how many have been received by the time the zome call ends.

Started
Thu, 23 Jul 2026 03:38:23 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
local_signals_29977387554_1
Send timing
The time taken to emit a batch of 10,000 signals.
mean
1.890196
s
SD
0.951152
s
p50
2.121212
s
<
p95
3.36615
s
p99
3.36615
s
Receive timing
The time taken to receive the completed batch, to the nearest 250ms.
mean
27.878571
s
SD
6.367667
s
p50
30.001178
s
<
p95
30.001731
s
p99
30.001731
s
Success ratio
The proportion of signals successfully received in a batch.
min
0.6383000016212463
<
mean
0.8128
SD
0.1023
<
max
0.94650000333786
Holochain MetricsClick to toggle visibility.
WASM usage: 'signal::emit_10k_signals'
Metered usage count of the WASM ribosome for this zome function.
total
301963473
over 280.002639627s
mean rate
1.07843229e+06
/s
std
1.56692579e+06
/s
p5
0
/s
p95
3.35512808e+06
/s
peak
3.35513069e+06
/s
Zome call duration: 'signal::emit_10k_signals'
Duration of this zome call as measured by Holochain internally.
mean
0.087441
s
SD
0.001546
s
p50
0.087733
s
<
p95
0.091847
s
p99
0.091847
s
WASM call duration: 'signal::emit_10k_signals'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.084006
s
SD
0.000878
s
p50
0.084134
s
<
p95
0.085034
s
<
p99
0.08547
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
7e-06
s
SD
0
s
p50
7e-06
s
p95
7e-06
s
p99
7e-06
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
90000
over 280.002640206s
mean rate
321.43
/s
std
467.02
/s
p5
0
/s
p95
999.99
/s
peak
999.99
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.010693
s
SD
0
s
p50
0.010693
s
p95
0.010693
s
p99
0.010693
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.66
s
<
mean
148.66
s
SD
83.67
s
<
p95
278.66
s
Dropped WebSocket signals
Count of signals dropped from the app WebSocket due to channel overload.
total
876
over 280.002630032s
mean rate
3.13
/s
std
7.61
/s
p5
0
/s
p95
18
/s
peak
37.3
/s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.002630615s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000509
s
SD
0
s
p50
0.000509
s
p95
0.000509
s
p99
0.000509
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000707
s
SD
0
s
p50
0.000707
s
p95
0.000707
s
p99
0.000707
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001045
s
SD
0
s
p50
0.001045
s
p95
0.001045
s
p99
0.001045
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.002252
s
SD
0.000299
s
p50
0.002322
s
<
p95
0.002804
s
p99
0.002804
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.006607
s
SD
0
s
p50
0.006607
s
p95
0.006607
s
p99
0.006607
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.00614
s
SD
0
s
p50
0.00614
s
p95
0.00614
s
p99
0.00614
s
Authored DB connection use time
Time spent holding authored database connections.
mean
9.5e-05
s
SD
5e-06
s
p50
9.4e-05
s
<
p95
9.8e-05
s
<
p99
0.000117
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
4.9e-05
s
SD
8.6e-05
s
p50
0.000217
s
p95
0.000217
s
p99
0.000217
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00015
s
SD
0
s
p50
0.00015
s
p95
0.00015
s
p99
0.00015
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
6.11
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
357
B/s
<
mean
239.16
KiB/s
SD
1.18
MiB/s
p95
32.64
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
51
B/s
<
mean
33.32
KiB/s
SD
54.71
KiB/s
<
p95
170.57
KiB/s
Total bytes received
Total bytes received on primary network interface
count
67.73
MiB
mean
239.16
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
9.44
MiB
mean
33.32
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2.39
%
<
mean
15.05
%
SD
7.97
%
<
p95
25.45
%
System
8.94
%
CPU percentiles
CPU usage percentiles
p50
19.15
%
p95
25.45
%
p99
27.04
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
19.9
%
<
mean
22.69
%
SD
2.47
%
<
p95
27.28
%
Memory available percentage
Percentage of available memory
p5
72.72
%
<
mean
77.31
%
SD
2.47
%
<
p95
80.1
%
Max host memory used
Maximum memory usage percentage across all hosts
max
22.69
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-97.23
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
6.31
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.32
5 min
2.01
15 min
0.87
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.15
%
<
mean
4.7923
%
SD
2.8739
%
<
p95
8.2
%
60 second average
5.2963
%
300 second average
3.3760
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.05
%
<
mean
0.78
%
SD
0.6
%
<
p95
1.59
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
24.78
KiB
<
mean
244.93
KiB
SD
81.56
KiB
<
p95
288.92
KiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
<
mean
39.97
threads
SD
12.41
threads
<
p95
51
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
8
file descriptors
<
mean
77.24
file descriptors
SD
29.44
file descriptors
<
p95
105
file descriptors

Remote Call Rate

↑ Back to index

Test the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

Started
Thu, 23 Jul 2026 03:40:11 UTC
Peer count
10
Peer count at end
9
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
remote_call_rate_29977387554_1
Dispatch timing
The time between sending a remote call and the remote handler being invoked.
Mean
mean
0.049171
s
SD
0.166686
s
Max
Highest per-partition mean latency
max mean
0.1167
s
Min
Lowest per-partition mean latency
min mean
-0.395042
s
Round-trip timing
The total elapsed time to get a response to the client.
Mean
mean
0.125768
s
SD
0.106033
s
Max
Highest per-partition mean latency
max mean
0.15988
s
Min
Lowest per-partition mean latency
min mean
0.061769
s
Error count
The total number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_call::call_echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
246531740
over 896.302137814s
mean rate
9.4863842725e+08
/s
std
2.30854074211e+09
/s
p5
711621.59
/s
p95
7.3359726964e+09
/s
peak
1.15098800309e+10
/s
WASM usage: 'remote_call::echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
52111836
over 896.302137814s
mean rate
7.92975654e+06
/s
std
1.687343253e+07
/s
p5
70150.79
/s
p95
5.331796773e+07
/s
peak
7.716777848e+07
/s
WASM usage: 'remote_call::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 896.302137814s
Not enough time data to show a trend.
Zome call duration: 'remote_call::call_echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.124451
s
SD
0.076834
s
p50
0.159886
s
<
p95
0.207712
s
<
p99
0.392079
s
Zome call duration: 'remote_call::echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.00599
s
SD
0.003964
s
p50
0.005385
s
<
p95
0.012882
s
<
p99
0.016767
s
WASM call duration: 'remote_call::call_echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.121091
s
SD
0.075879
s
p50
0.155726
s
<
p95
0.20433
s
<
p99
0.382961
s
WASM call duration: 'remote_call::echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002016
s
SD
0.000777
s
p50
0.001919
s
<
p95
0.003116
s
<
p99
0.003126
s
WASM call duration: 'remote_call::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.021525
s
SD
0.01887
s
p50
0.019187
s
<
p95
0.068553
s
p99
0.068553
s
Host function call duration: '__hc__call_1'
Duration of this host function call invoked from within WASM.
mean
0.116282
s
SD
0.075452
s
p50
0.145677
s
<
p95
0.199444
s
<
p99
0.374386
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000378
s
SD
0.000251
s
p50
0.000277
s
<
p95
0.000938
s
p99
0.000938
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
2.2e-05
s
SD
1.2e-05
s
p50
2.3e-05
s
<
p95
3.7e-05
s
<
p99
5.9e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002922
s
SD
0.015207
s
p50
0.003814
s
<
p95
0.037169
s
<
p99
0.065164
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.013783
s
SD
0.014922
s
p50
0.005098
s
<
p95
0.047622
s
p99
0.047622
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.02
s
<
mean
447.15
s
SD
256.93
s
<
p95
847.03
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
80
over 896.301908225s
mean rate
9.02
/s
std
59.52
/s
p5
0
/s
p95
10.46
/s
peak
979.9
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
2.138885
s
SD
1.522362
s
p50
1.903933
s
<
p95
6.146172
s
<
p99
6.94007
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.104771
s
SD
0.278649
s
p50
0.078134
s
<
p95
0.625294
s
<
p99
2.056475
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.004113
s
SD
0.004511
s
p50
0.002063
s
<
p95
0.014801
s
p99
0.014801
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.048073
s
SD
0.023213
s
p50
0.046015
s
<
p95
0.085842
s
<
p99
0.093023
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.005411
s
SD
0.004395
s
p50
0.003994
s
<
p95
0.01626
s
p99
0.01626
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.207935
s
SD
0.250021
s
p50
0.182614
s
<
p95
0.574807
s
<
p99
1.315762
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.207786
s
SD
0.157061
s
p50
0.192636
s
<
p95
0.517973
s
<
p99
0.739426
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000228
s
SD
0.000131
s
p50
0.000226
s
<
p95
0.000473
s
<
p99
0.000589
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000136
s
SD
0.000791
s
p50
0.000343
s
<
p95
0.001835
s
<
p99
0.004034
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000383
s
SD
0.000216
s
p50
0.000406
s
<
p95
0.000886
s
<
p99
0.001061
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.079544
s
SD
0.036502
s
p50
0.100841
s
<
p95
0.121599
s
p99
0.121599
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.127412
s
SD
0.066873
s
p50
0.177123
s
<
p95
0.234156
s
p99
0.234156
s
P2P request roundtrip: 'call_remote'
Time spent sending a call_remote request and awaiting its response.
mean
0.115762
s
SD
0.075419
s
p50
0.145
s
<
p95
0.198908
s
<
p99
0.37371
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
12.98
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
10.77
KiB/s
<
mean
108.30
KiB/s
SD
697.51
KiB/s
p95
26.73
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
8.89
KiB/s
<
mean
17.27
KiB/s
SD
18.36
KiB/s
<
p95
31.97
KiB/s
Total bytes received
Total bytes received on primary network interface
count
945.54
MiB
mean
1.04
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
150.79
MiB
mean
169.68
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 92.9%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 2626.18 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (72.8% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.79
%
<
mean
18.16
%
SD
18.14
%
<
p95
71.8
%
System
5.19
%
CPU percentiles
CPU usage percentiles
p50
14.06
%
p95
71.80
%
p99
92.88
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
4
hosts
mean time
0.09
s
Memory used percentage
Percentage of memory used
p5
9.73
%
<
mean
20.56
%
SD
12.6
%
<
p95
46.58
%
Memory available percentage
Percentage of available memory
p5
53.42
%
<
mean
79.44
%
SD
12.6
%
<
p95
90.27
%
Max host memory used
Maximum memory usage percentage across all hosts
max
46.38
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
72.80
%
Memory growth rate
Rate of memory growth over time
growth
2626.18
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.67
MiB/s
Disk write throughput
Disk write throughput in MiB/s
21.22
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
0/3
hosts
Mount Point /etc/hosts
0/3
hosts
Mount Point /etc/nomad.d/client-meta.json
0/8
hosts
Mount Point /etc/nomad.d/meta.json
0/1
hosts
Mount Point /etc/resolv.conf
0/3
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.96
5 min
0.74
15 min
0.43
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
5.616
%
SD
11.2272
%
<
p95
22.06
%
60 second average
5.1407
%
300 second average
3.5534
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0935
%
SD
0.5273
%
<
p95
0.36
%
60 second average
0.0973
%
300 second average
0.0723
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0702
%
SD
0.4328
%
<
p95
0.29
%
60 second average
0.0723
%
300 second average
0.0517
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.05
%
<
mean
7.71
%
SD
8.67
%
<
p95
23.46
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
208.22
KiB
<
mean
271.18
KiB
SD
93.44
KiB
<
p95
478.75
KiB
Holochain process threads
Number of threads in Holochain process
p5
32
threads
<
mean
46.83
threads
SD
41.6
threads
<
p95
96
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
72
file descriptors
<
mean
98.77
file descriptors
SD
96
file descriptors
<
p95
106
file descriptors

Remote Signals

↑ Back to index

This scenario tests the throughput of remote_signals operations.

Started
Thu, 23 Jul 2026 03:42:02 UTC
Peer count
10
Peer count at end
10
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
remote_signals_29977387554_1
Round trip time
The time from origin signal dispatch to origin receive of the remote side's response signal.
mean
0.215822
s
SD
1.167942
s
p50
0.094447
s
<
p95
0.266851
s
<
p99
1.518638
s
Timeouts
The number of timeouts waiting for the remote side's response signal (default timeout is 20 seconds).
total
1
over 4.616695264s
mean rate
0.86
/s
std
1.51
/s
p5
0
/s
p95
4.14
/s
peak
4.14
/s
Not enough time data to show a trend.
Timeout rate
The proportion of remote signal round-trips that timed out.
0.0001
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_signal::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 895.494190286s
Not enough time data to show a trend.
WASM usage: 'remote_signal::recv_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
36336196
over 890.387903875s
mean rate
5.055079161e+07
/s
std
2.3413977323e+08
/s
p5
0
/s
p95
2.3971163228e+08
/s
peak
4.15020110608e+09
/s
WASM usage: 'remote_signal::signal_request'
Metered usage count of the WASM ribosome for this zome function.
total
15182700
over 895.494190286s
mean rate
4.74541221e+06
/s
std
4.870294687e+07
/s
p5
0
/s
p95
1.46256267e+07
/s
peak
1.19490249858e+09
/s
Zome call duration: 'remote_signal::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.010753
s
SD
0.024091
s
p50
0.008161
s
<
p95
0.048991
s
<
p99
0.131726
s
Zome call duration: 'remote_signal::signal_request'
Duration of this zome call as measured by Holochain internally.
mean
0.008385
s
SD
0.010808
s
p50
0.007477
s
<
p95
0.027359
s
<
p99
0.064012
s
WASM call duration: 'remote_signal::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.064238
s
SD
0.076318
s
p50
0.029629
s
<
p95
0.220145
s
p99
0.220145
s
WASM call duration: 'remote_signal::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002107
s
SD
0.001078
s
p50
0.002199
s
<
p95
0.003502
s
<
p99
0.005798
s
WASM call duration: 'remote_signal::signal_request'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001921
s
SD
0.00071
s
p50
0.002014
s
<
p95
0.002755
s
<
p99
0.002857
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000715
s
SD
0.000815
s
p50
0.000291
s
<
p95
0.002694
s
p99
0.002694
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
8.8e-05
s
SD
4.1e-05
s
p50
9.7e-05
s
<
p95
0.000136
s
<
p99
0.00016
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
9.9e-05
s
SD
4.7e-05
s
p50
0.000114
s
<
p95
0.000154
s
<
p99
0.000165
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
2e-05
s
SD
6.1e-05
s
p50
1.3e-05
s
<
p95
8.9e-05
s
<
p99
0.000306
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.057738
s
SD
0.068015
s
p50
0.027902
s
<
p95
0.193561
s
p99
0.193561
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
1713
over 890.38796818s
mean rate
1688.89
/s
std
6682.13
/s
p5
0
/s
p95
8628.05
/s
peak
129898.25
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
1713
over 895.494222828s
mean rate
1592.61
/s
std
6000.25
/s
p5
0
/s
p95
8045.07
/s
peak
78920.37
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.12213
s
SD
0.199098
s
p50
0.01151
s
<
p95
0.692898
s
p99
0.692898
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
45.58
s
<
mean
450.22
s
SD
259.25
s
<
p95
855.01
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
103
over 895.494125003s
mean rate
4436.6
/s
std
39641.31
/s
p5
0
/s
p95
4801.05
/s
peak
716039.28
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
5.294295
s
SD
3.955567
s
p50
3.168003
s
<
p95
12.862986
s
<
p99
14.92813
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.331359
s
SD
0.941064
s
p50
0.267458
s
<
p95
1.521421
s
<
p99
5.127269
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.004773
s
SD
0.004125
s
p50
0.004174
s
<
p95
0.014567
s
p99
0.014567
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.038628
s
SD
0.017318
s
p50
0.034112
s
<
p95
0.06802
s
p99
0.06802
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.013056
s
SD
0.016166
s
p50
0.00739
s
<
p95
0.057616
s
p99
0.057616
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.52724
s
SD
0.483108
s
p50
0.46473
s
<
p95
1.808436
s
<
p99
1.981025
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.201362
s
SD
0.121644
s
p50
0.203592
s
<
p95
0.45993
s
<
p99
0.551825
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000325
s
SD
0.000328
s
p50
0.000253
s
<
p95
0.000901
s
<
p99
0.001934
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000158
s
SD
0.001922
s
p50
0.000493
s
<
p95
0.004399
s
<
p99
0.009401
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000592
s
SD
0.000529
s
p50
0.000551
s
<
p95
0.001477
s
<
p99
0.002812
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.049605
s
SD
0.010532
s
p50
0.049443
s
<
p95
0.060602
s
<
p99
0.070164
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.104979
s
SD
0.042422
s
p50
0.133955
s
<
p95
0.165777
s
p99
0.165777
s
P2P received remote signals
Count of remote signals received.
total
1713
over 890.387849035s
mean rate
6682.82
/s
std
46195.92
/s
p5
0
/s
p95
12202.79
/s
peak
731172.31
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
19.64
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
8.59
KiB/s
<
mean
189.23
KiB/s
SD
847.19
KiB/s
<
p95
646.32
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
12.36
KiB/s
<
mean
49.39
KiB/s
SD
246.03
KiB/s
<
p95
99.32
KiB/s
Total bytes received
Total bytes received on primary network interface
count
824.21
MiB
mean
937.76
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
215.13
MiB
mean
244.77
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 97.3%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 2622.74 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (72.8% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.62
%
<
mean
26.73
%
SD
26.49
%
<
p95
90.73
%
System
7.09
%
CPU percentiles
CPU usage percentiles
p50
21.71
%
p95
90.73
%
p99
97.35
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
4
hosts
mean time
0.14
s
Memory used percentage
Percentage of memory used
p5
9.58
%
<
mean
28.61
%
SD
13.42
%
<
p95
46.65
%
Memory available percentage
Percentage of available memory
p5
53.35
%
<
mean
71.39
%
SD
13.42
%
<
p95
90.42
%
Max host memory used
Maximum memory usage percentage across all hosts
max
46.54
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
72.80
%
Memory growth rate
Rate of memory growth over time
growth
2622.74
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.83
MiB/s
Disk write throughput
Disk write throughput in MiB/s
22.71
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
0/3
hosts
Mount Point /etc/hosts
0/3
hosts
Mount Point /etc/nomad.d/client-meta.json
0/3
hosts
Mount Point /etc/nomad.d/meta.json
0/1
hosts
Mount Point /etc/resolv.conf
0/3
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.60
5 min
1.07
15 min
0.61
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
12.5215
%
SD
20.7317
%
<
p95
67.18
%
60 second average
10.9145
%
300 second average
7.1025
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.001
%
SD
0.0134
%
p95
0
%
60 second average
0.0011
%
300 second average
0.0001
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0006
%
SD
0.0089
%
p95
0
%
60 second average
0.0006
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.1017
%
SD
0.3286
%
<
p95
0.52
%
60 second average
0.0998
%
300 second average
0.0958
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0539
%
SD
0.2061
%
<
p95
0.3
%
60 second average
0.0593
%
300 second average
0.0598
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.04
%
<
mean
7.07
%
SD
14.01
%
<
p95
35.21
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
150.63
KiB
<
mean
302.55
KiB
SD
126.39
KiB
<
p95
479.06
KiB
Holochain process threads
Number of threads in Holochain process
p5
21
threads
<
mean
59.89
threads
SD
65.71
threads
<
p95
96
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
44
file descriptors
<
mean
117.19
file descriptors
SD
159.69
file descriptors
p95
111
file descriptors

Single-write, many-read

↑ Back to index

Creates an entry in the agent setup, then read one's own record back. This tests the maximum read performance for reading back local data when the chain is short.

Started
Thu, 23 Jul 2026 03:44:17 UTC
Peer count
1
Peer count at end
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
single_write_many_read_29977387554_1
read call timing
The time it takes to complete the zome call that retrieves the record.
mean
0.003553
s
SD
0.000737
s
p50
0.003346
s
<
p95
0.004949
s
<
p99
0.006266
s
read call rate
The number of read zome calls completed per second.
mean
2779.79
/s
Error count
The number of errors collected.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.00032
s
SD
2e-05
s
p50
0.000314
s
<
p95
0.000334
s
<
p99
0.000335
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.003148604s
Not enough time data to show a trend.
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
3722778700
over 280.003148604s
mean rate
1.329549187e+07
/s
std
1.47280006e+06
/s
p5
1.164395784e+07
/s
p95
1.546624969e+07
/s
peak
1.547107955e+07
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.003148604s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.003148604s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.013466
s
SD
0
s
p50
0.013466
s
p95
0.013466
s
p99
0.013466
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.002298
s
SD
0.000127
s
p50
0.002255
s
<
p95
0.0024
s
<
p99
0.002405
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003131
s
SD
0
s
p50
0.003131
s
p95
0.003131
s
p99
0.003131
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001042
s
SD
3.9e-05
s
p50
0.00103
s
<
p95
0.001071
s
<
p99
0.001072
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000997
s
SD
0
s
p50
0.000997
s
p95
0.000997
s
p99
0.000997
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000604
s
SD
0
s
p50
0.000604
s
p95
0.000604
s
p99
0.000604
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000183
s
SD
3e-05
s
p50
0.000213
s
p95
0.000213
s
p99
0.000213
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000347
s
SD
2.2e-05
s
p50
0.00034
s
<
p95
0.000362
s
<
p99
0.000363
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002265
s
SD
0
s
p50
0.002265
s
p95
0.002265
s
p99
0.002265
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.004534
s
SD
0
s
p50
0.004534
s
p95
0.004534
s
p99
0.004534
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.59
s
<
mean
148.59
s
SD
83.67
s
<
p95
278.59
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.003151483s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000824
s
SD
0
s
p50
0.000824
s
p95
0.000824
s
p99
0.000824
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000868
s
SD
0
s
p50
0.000868
s
p95
0.000868
s
p99
0.000868
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001215
s
SD
0
s
p50
0.001215
s
p95
0.001215
s
p99
0.001215
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.002485
s
SD
0.000283
s
p50
0.002546
s
<
p95
0.002998
s
p99
0.002998
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.007596
s
SD
0
s
p50
0.007596
s
p95
0.007596
s
p99
0.007596
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.007642
s
SD
0
s
p50
0.007642
s
p95
0.007642
s
p99
0.007642
s
Authored DB connection use time
Time spent holding authored database connections.
mean
6.2e-05
s
SD
3e-06
s
p50
6.1e-05
s
<
p95
6.5e-05
s
p99
6.5e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
3.4e-05
s
SD
5.8e-05
s
p50
0.00015
s
p95
0.00015
s
p99
0.00015
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000149
s
SD
0
s
p50
0.000149
s
p95
0.000149
s
p99
0.000149
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
17.28
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
11.06
KiB/s
<
mean
240.99
KiB/s
SD
1.18
MiB/s
p95
17.14
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
9.37
KiB/s
<
mean
13.40
KiB/s
SD
15.63
KiB/s
<
p95
13.70
KiB/s
Total bytes received
Total bytes received on primary network interface
count
68.25
MiB
mean
240.99
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
3.79
MiB
mean
13.40
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 774.44 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
14.87
%
<
mean
26.03
%
SD
7.73
%
<
p95
32.03
%
System
8.76
%
CPU percentiles
CPU usage percentiles
p50
31.52
%
p95
32.03
%
p99
32.06
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
19.87
%
<
mean
24.89
%
SD
3.33
%
<
p95
28.11
%
Memory available percentage
Percentage of available memory
p5
71.89
%
<
mean
75.11
%
SD
3.33
%
<
p95
80.13
%
Max host memory used
Maximum memory usage percentage across all hosts
max
24.89
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
774.44
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
3.86
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.27
5 min
2.08
15 min
1.26
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.8
%
<
mean
2.942
%
SD
1.6359
%
<
p95
4.97
%
60 second average
2.4793
%
300 second average
2.6450
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
12.97
%
<
mean
15.59
%
SD
1.99
%
<
p95
17.42
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
289.48
KiB
<
mean
319.20
KiB
SD
23.31
KiB
<
p95
351.10
KiB
Holochain process threads
Number of threads in Holochain process
p5
36
threads
<
mean
36.5
threads
SD
4.67
threads
<
p95
39
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
67
file descriptors
<
mean
70.77
file descriptors
SD
9.19
file descriptors
<
p95
75
file descriptors

Validation Receipts

↑ Back to index

Creates an entry, wait for required validation receipts, then repeat. Records the amount of time it took to accumulate the required number of receipts for all DHT operations. This is measured to the nearest 20ms so that we don't keep the agent too busy checking for receipts.

Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

By default, this scenario will wait for a complete set of validation receipts before committing the next record. If the NO_VALIDATION_COMPLETE environment variable is set, it will instead publish new records on every round, building up an ever-growing list of action hashes to check on.

Started
Thu, 23 Jul 2026 03:58:29 UTC
Peer count
20
Peer count at end
18
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
validation_receipts_29977387554_1
Receipts complete timing
The amount of time between publishing a record and receiving the required number of validation receipts.
Mean
mean
16.368801
s
SD
10.970531
s
Max
Highest per-partition mean latency
max mean
24.078463
s
Min
Lowest per-partition mean latency
min mean
11.482053
s
Receipts complete rate
The number of complete validation receipt sets collected per second.
Mean
mean
1.14
/s
Max
Highest per-partition mean rate
max
1.27
/s
Min
Lowest per-partition mean rate
min
1
/s
Error count
The total number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
1568430
over 960.327229222s
mean rate
5.46232206e+06
/s
std
1.080691173e+07
/s
p5
0
/s
p95
3.267380974e+07
/s
peak
5.06315701e+07
/s
WASM usage: 'crud::get_sample_entry_validation_receipts'
Metered usage count of the WASM ribosome for this zome function.
total
14386553
over 960.327229222s
mean rate
2.290211178e+07
/s
std
5.7957904e+07
/s
p5
30494.09
/s
p95
1.8719703557e+08
/s
peak
3.0046355111e+08
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 960.327229222s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
171976
over 960.327229222s
mean rate
588740.09
/s
std
1.17483077e+06
/s
p5
0
/s
p95
3.58263429e+06
/s
peak
5.55167582e+06
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.023204
s
SD
0.021236
s
p50
0.01827
s
<
p95
0.077049
s
<
p99
0.127929
s
Zome call duration: 'crud::get_sample_entry_validation_receipts'
Duration of this zome call as measured by Holochain internally.
mean
0.017767
s
SD
0.015888
s
p50
0.014285
s
<
p95
0.061786
s
<
p99
0.071012
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.01351
s
SD
0.012834
s
p50
0.01004
s
<
p95
0.048306
s
<
p99
0.077729
s
WASM call duration: 'crud::get_sample_entry_validation_receipts'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.010465
s
SD
0.007846
s
p50
0.00676
s
<
p95
0.025011
s
<
p99
0.041015
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003855
s
SD
0.002753
s
p50
0.003327
s
<
p95
0.012166
s
p99
0.012166
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001767
s
SD
0.000897
s
p50
0.001352
s
<
p95
0.003448
s
<
p99
0.004897
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000714
s
SD
0.001898
s
p50
0.000555
s
<
p95
0.005358
s
<
p99
0.010995
s
Host function call duration: '__hc__get_validation_receipts_1'
Duration of this host function call invoked from within WASM.
mean
0.008422
s
SD
0.007032
s
p50
0.005058
s
<
p95
0.021927
s
<
p99
0.035724
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.010746
s
SD
0.011479
s
p50
0.007494
s
<
p95
0.039666
s
<
p99
0.069358
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.009637
s
SD
0.013004
s
p50
0.007708
s
<
p95
0.035098
s
<
p99
0.061314
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.36
s
<
mean
450.14
s
SD
259.24
s
<
p95
855.58
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
2501
over 960.327223468s
mean rate
1167.89
/s
std
3803.21
/s
p5
9.16
/s
p95
8769.98
/s
peak
42560.73
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
2.345146
s
SD
1.452912
s
p50
1.883178
s
<
p95
5.382013
s
<
p99
6.440683
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.037547
s
SD
0.470199
s
p50
0.014481
s
<
p95
0.801059
s
<
p99
2.843056
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.004576
s
SD
0.005168
s
p50
0.002664
s
<
p95
0.01631
s
<
p99
0.020242
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.054722
s
SD
0.069157
s
p50
0.046007
s
<
p95
0.23066
s
<
p99
0.278712
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.032316
s
SD
0.036619
s
p50
0.015322
s
<
p95
0.096684
s
<
p99
0.175799
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.117081
s
SD
0.300002
s
p50
0.100983
s
<
p95
0.843739
s
<
p99
1.223277
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
2.845208
s
SD
14.668304
s
p50
4.017813
s
<
p95
45.22233
s
<
p99
62.868879
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000432
s
SD
0.000328
s
p50
0.00033
s
<
p95
0.001486
s
<
p99
0.001619
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002578
s
SD
0.021012
s
p50
0.000345
s
<
p95
0.047135
s
<
p99
0.1053
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000329
s
SD
0.000315
s
p50
0.000297
s
<
p95
0.00131
s
<
p99
0.001449
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.063532
s
SD
0.043868
s
p50
0.067252
s
<
p95
0.138479
s
<
p99
0.142859
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.324141
s
SD
4.280795
s
p50
0.344592
s
<
p95
10.132355
s
<
p99
10.270916
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
57.22
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
127.72
KiB/s
<
mean
718.69
KiB/s
SD
561.07
KiB/s
<
p95
1.38
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
35.53
KiB/s
<
mean
567.11
KiB/s
SD
724.98
KiB/s
<
p95
1.53
MiB/s
Total bytes received
Total bytes received on primary network interface
count
12.44
GiB
mean
13.41
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
9.82
GiB
mean
10.58
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.8%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 635.28 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (73.1% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 90% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
21.25
%
<
mean
70.72
%
SD
26.88
%
<
p95
97.56
%
System
13.50
%
CPU percentiles
CPU usage percentiles
p50
82.71
%
p95
97.56
%
p99
98.80
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
14
hosts
mean time
0.79
s
Memory used percentage
Percentage of memory used
p5
14.54
%
<
mean
22.46
%
SD
7.89
%
<
p95
42.36
%
Memory available percentage
Percentage of available memory
p5
57.64
%
<
mean
77.54
%
SD
7.89
%
<
p95
85.46
%
Max host memory used
Maximum memory usage percentage across all hosts
max
47.29
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
73.06
%
Memory growth rate
Rate of memory growth over time
growth
635.28
MiB/s
Disk read throughput
Disk read throughput in MiB/s
4.23
MiB/s
Disk write throughput
Disk write throughput in MiB/s
267.08
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/5
hosts
Mount Point /efi-boot
0/4
hosts
Mount Point /etc/hostname
0/4
hosts
Mount Point /etc/hosts
0/4
hosts
Mount Point /etc/nomad.d/client-meta.json
0/12
hosts
Mount Point /etc/nomad.d/meta.json
0/1
hosts
Mount Point /etc/resolv.conf
0/4
hosts
Mount Point /nix/store
0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
6.05
5 min
5.05
15 min
3.07
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
90.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.94
%
<
mean
37.062
%
SD
23.8006
%
<
p95
73.17
%
60 second average
37.0766
%
300 second average
31.0694
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
17.4998
%
SD
25.2597
%
<
p95
68.66
%
60 second average
17.1469
%
300 second average
13.5356
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
9.845
%
SD
17.1483
%
<
p95
45.99
%
60 second average
9.6702
%
300 second average
7.7180
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.16
%
<
mean
3.14
%
SD
6.81
%
<
p95
7.34
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
239.91
KiB
<
mean
277.06
KiB
SD
82.37
KiB
<
p95
514.11
KiB
Holochain process threads
Number of threads in Holochain process
p5
36
threads
<
mean
42.62
threads
SD
19.35
threads
<
p95
50
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
88
file descriptors
<
mean
94.44
file descriptors
SD
20.02
file descriptors
<
p95
104
file descriptors

Write/get_agent_activity

↑ Back to index

A scenario where write peers write entries, while get_agent_activity peers each query a single write agent's activity with get_agent_activity.

Before a target write peer and the requesting get_agent_activity peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started
Thu, 23 Jul 2026 04:27:11 UTC
Peer count
30
Peer count at end
26
Behaviours
  • get_agent_activity (1 agent)
  • write (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
write_get_agent_activity_29977387554_1
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
6146.5
Max
Highest chain head value observed for any single write agent.
11244
Write agents observed
6
get_agent_activity_full zome call timing
The time taken to call the zome function that retrieves information on a write peer's source chain.
Mean
mean
0.100454
s
SD
0.152975
s
Max
Highest per-partition mean latency
max mean
0.332268
s
Min
Lowest per-partition mean latency
min mean
0.030559
s
Error count
The number of errors accumulated.
21
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.021641
s
SD
0.148992
s
p50
0.012304
s
<
p95
0.391139
s
<
p99
0.857489
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
1
over 814.345483762s
mean rate
0.89
/s
std
2.53
/s
p5
0
/s
p95
4.39
/s
peak
17.75
/s
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 33091.412997549s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
194169780
over 33091.412997549s
mean rate
2.0344011371e+08
/s
std
3.1586617735e+08
/s
p5
173099.98
/s
p95
8.4585089519e+08
/s
peak
1.01188383246e+09
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
882814954
over 1887.165283782s
mean rate
1.72849036845e+10
/s
std
3.69035414819e+10
/s
p5
722922.35
/s
p95
1.31287392766e+11
/s
peak
1.68076335178e+11
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
4411860187
over 37471.420626921s
mean rate
8.8880982703e+08
/s
std
1.21271319896e+09
/s
p5
0
/s
p95
2.90918762223e+09
/s
peak
8.99278176626e+09
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
293581372
over 37471.58853344s
mean rate
6.006668296e+07
/s
std
8.114491452e+07
/s
p5
0
/s
p95
1.8630184902e+08
/s
peak
1.14552558021e+09
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.052259
s
SD
0.047982
s
p50
0.037979
s
<
p95
0.165735
s
p99
0.165735
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.044756
s
SD
0.057657
s
p50
0.041465
s
<
p95
0.21672
s
<
p99
0.253017
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.039283
s
SD
0.076312
s
p50
0.036606
s
<
p95
0.238197
s
<
p99
0.31572
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.009548
s
SD
0.200389
s
p50
0.008154
s
<
p95
0.412381
s
<
p99
0.881607
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.01733
s
SD
0.013359
s
p50
0.017583
s
<
p95
0.037622
s
p99
0.037622
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.02467
s
SD
0.031605
s
p50
0.022428
s
<
p95
0.117239
s
<
p99
0.13398
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.03374
s
SD
0.064723
s
p50
0.031816
s
<
p95
0.220896
s
<
p99
0.249011
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006363
s
SD
0.196215
s
p50
0.005687
s
<
p95
0.397132
s
<
p99
0.862341
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001116
s
SD
0.000647
s
p50
0.000873
s
<
p95
0.002464
s
<
p99
0.003691
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.3e-05
s
SD
2.5e-05
s
p50
2.6e-05
s
<
p95
9.3e-05
s
p99
9.3e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.001153
s
SD
0.001721
s
p50
0.000721
s
<
p95
0.005254
s
<
p99
0.00615
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.00075
s
SD
0.000659
s
p50
0.000535
s
<
p95
0.002244
s
p99
0.002244
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.031913
s
SD
0.063923
s
p50
0.029786
s
<
p95
0.218996
s
<
p99
0.241518
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000369
s
SD
0.196804
s
p50
0.000327
s
<
p95
0.391199
s
<
p99
0.857534
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1.3e-05
s
SD
9e-06
s
p50
1.5e-05
s
<
p95
3.6e-05
s
p99
3.6e-05
s
Host function call duration: '__hc__trace_1'
Duration of this host function call invoked from within WASM.
mean
0.000135
s
SD
0.000127
s
p50
8e-05
s
<
p95
0.000569
s
p99
0.000569
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.009598
s
SD
0.017036
s
p50
0.004191
s
<
p95
0.033952
s
<
p99
0.107311
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.017819
s
SD
0.026603
s
p50
0.02097
s
<
p95
0.087643
s
<
p99
0.107424
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.01
s
<
mean
452.73
s
SD
260.25
s
<
p95
857.74
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 37471.588495818s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
131.279929
s
SD
101.758209
s
p50
76.659567
s
<
p95
330.535343
s
<
p99
423.304618
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.705635
s
SD
5.965372
s
p50
2.059419
s
<
p95
19.532692
s
<
p99
23.575992
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001905
s
SD
0.002478
s
p50
0.001298
s
<
p95
0.003376
s
<
p99
0.014239
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.115076
s
SD
0.373665
s
p50
0.361954
s
<
p95
1.091715
s
<
p99
1.106626
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.227793
s
SD
0.355235
s
p50
0.033833
s
<
p95
0.686639
s
<
p99
1.473328
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
4.324744
s
SD
27.209448
s
p50
13.779701
s
<
p95
76.199957
s
<
p99
101.449879
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
22.492462
s
SD
51.096997
s
p50
0.045561
s
<
p95
90.73011
s
<
p99
271.552051
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000744
s
SD
0.001487
s
p50
0.000236
s
<
p95
0.004437
s
<
p99
0.006945
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002577
s
SD
0.009334
s
p50
0.000609
s
<
p95
0.028728
s
<
p99
0.04016
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000746
s
SD
0.000987
s
p50
0.000344
s
<
p95
0.003344
s
<
p99
0.005142
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
3.072416
s
SD
29.888893
s
p50
0.239737
s
<
p95
60.00384
s
<
p99
60.022014
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.452275
s
SD
0.355512
s
p50
0.284343
s
<
p95
0.987891
s
p99
0.987891
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.041712
s
SD
25.910928
s
p50
0.06254
s
<
p95
60.001593
s
<
p99
60.003593
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.351179
s
SD
0.339541
s
p50
0.332337
s
<
p95
0.884725
s
<
p99
1.691654
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
46.11
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
98
B/s
<
mean
749.60
KiB/s
SD
686.68
KiB/s
<
p95
1.99
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
58
B/s
<
mean
732.64
KiB/s
SD
785.29
KiB/s
<
p95
2.56
MiB/s
Total bytes received
Total bytes received on primary network interface
count
18.04
GiB
mean
20.08
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
17.63
GiB
mean
19.62
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.3%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1137.08 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (73.2% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 64% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
9.97
%
<
mean
58.48
%
SD
31.06
%
<
p95
97.8
%
System
12.37
%
CPU percentiles
CPU usage percentiles
p50
59.37
%
p95
97.80
%
p99
98.30
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
15
hosts
mean time
0.72
s
Memory used percentage
Percentage of memory used
p5
7.33
%
<
mean
15.81
%
SD
8.32
%
<
p95
35.87
%
Memory available percentage
Percentage of available memory
p5
64.13
%
<
mean
84.19
%
SD
8.32
%
<
p95
92.67
%
Max host memory used
Maximum memory usage percentage across all hosts
max
46.76
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
73.23
%
Memory growth rate
Rate of memory growth over time
growth
1137.08
MiB/s
Disk read throughput
Disk read throughput in MiB/s
1.78
MiB/s
Disk write throughput
Disk write throughput in MiB/s
207.44
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/5
hosts
Mount Point /efi-boot
0/4
hosts
Mount Point /etc/hostname
0/8
hosts
Mount Point /etc/hosts
0/8
hosts
Mount Point /etc/nomad.d/client-meta.json
0/16
hosts
Mount Point /etc/nomad.d/meta.json
0/1
hosts
Mount Point /etc/resolv.conf
0/8
hosts
Mount Point /nix/store
0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
5.73
5 min
5.42
15 min
4.90
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
64.29
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
27.6538
%
SD
29.1477
%
<
p95
94.72
%
60 second average
27.2297
%
300 second average
26.7850
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0003
%
SD
0.0079
%
p95
0
%
60 second average
0.0010
%
300 second average
0.0009
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0002
%
SD
0.0043
%
p95
0
%
60 second average
0.0009
%
300 second average
0.0009
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
12.5083
%
SD
18.5945
%
<
p95
48.77
%
60 second average
12.4892
%
300 second average
12.9767
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
8.5781
%
SD
14.2344
%
<
p95
37.42
%
60 second average
8.5784
%
300 second average
8.8080
%
Holochain process CPU usage
CPU usage by Holochain process
p5
8.88
%
<
mean
54.29
%
SD
30.12
%
<
p95
95.39
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
251.00
KiB
<
mean
429.10
KiB
SD
226.20
KiB
<
p95
658.21
KiB
Holochain process threads
Number of threads in Holochain process
p5
27
threads
<
mean
46
threads
SD
23.05
threads
<
p95
73
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
70
file descriptors
<
mean
100.11
file descriptors
SD
26.41
file descriptors
<
p95
127
file descriptors

Write/get_agent_activity with volatile conductors

↑ Back to index

A scenario where write peers write entries, while get_agent_activity_volatile peers each query a single write agents activity with get_agent_activity but shutdown and restart their conductors at semi-random intervals.

Before a target write peer and the requesting get_agent_activity_volatile peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started
Thu, 23 Jul 2026 04:43:07 UTC
Peer count
30
Peer count at end
24
Behaviours
  • get_agent_activity_volatile (1 agent)
  • write (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
write_get_agent_activity_volatile_29977387554_1
Highest observed action_seq
The rate at which zero-arc readers observe new chain heads on the writers' chains via get_agent_activity. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.
Mean
mean
34.42
/s
Max
Highest per-partition mean rate
max
87.46
/s
Min
Lowest per-partition mean rate
min
15.89
/s
get_agent_activity_full zome call timing
The time taken to call the zome function that retrieves information on a write peer's source chain.
Mean
mean
0.24425
s
SD
0.247533
s
Max
Highest per-partition mean latency
max mean
0.437957
s
Min
Lowest per-partition mean latency
min mean
0.081034
s
Running volatile conductors count
The number of conductors running by get_agent_activity_volatile peers.
p5
9
conductors
<
mean
12.13
conductors
SD
2.18
conductors
<
p95
16
conductors
Volatile conductor total running duration
The total running duration of a get_agent_activity_volatile conductor.
Mean
mean
830.190203
s
SD
396.975604
s
Max
Highest per-partition mean latency
max mean
1566.051282
s
Min
Lowest per-partition mean latency
min mean
553.459459
s
Volatile conductor running duration
The duration that a get_agent_activity_volatile conductor was running before being stopped.
Mean
mean
44.38756
s
SD
27.481451
s
Max
Highest per-partition mean latency
max mean
141.497126
s
Min
Lowest per-partition mean latency
min mean
22.309461
s
Volatile conductor stopped duration
The duration that a get_agent_activity_volatile conductor was stopped before being started again.
Mean
mean
22.496626
s
SD
27.623799
s
Max
Highest per-partition mean latency
max mean
35.945599
s
Min
Lowest per-partition mean latency
min mean
7.730077
s
Reached target arc
Did get_agent_activity_volatile peer reach their target arc in the moment before they were shutdown.
  • get_agent_activity_volatile_agent: uhCAk0ibjtb6ifm2arb-QTCuoj2FmkE-PgpP0Os8RfTbwPYN6uVwT
p5
0
<
mean
0.1
SD
0.3
<
p95
1
  • get_agent_activity_volatile_agent: uhCAk8McQ1bSugra71kOSk2yXfGI9RWxtGsHsgBvu9kY7y0xT9aoR
p5
0
<
mean
0.07
SD
0.26
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkBQr4MxRzm98_iZLo09L7ky4PFFNuwRkK1uGQ7i1NOQLmk7fw
p5
0
<
mean
0.02
SD
0.15
p95
0
  • get_agent_activity_volatile_agent: uhCAkCWwsc-TwY3xUiX0x4IfRFhn5enmH1pHUoaCdD4RdVErozaeJ
p5
0
<
mean
0.02
SD
0.15
p95
0
  • get_agent_activity_volatile_agent: uhCAkFxiKQycnjmXJmbrc6c5LZRE0cbXJUKCREIHsNABi_RiqTHif
p5
0
<
mean
0.1
SD
0.3
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkHHuepxWY9F-1WGBKeB2Vrz3e4wU1fKV9fIq7xEeDdbRVR0a-
p5
0
<
mean
0.05
SD
0.22
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkI2cO2mhazqeTnGCjILhruDuRVWDutkhtH1RabxFg_P27ARW2
p5
0
<
mean
0.07
SD
0.25
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkIGBKGoZD5gY7UOjygz3SIkG1Fag4SPERJF26XZH2k_zb1k6s
p5
0
<
mean
0.07
SD
0.25
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkKAGz4wQSrM2BL8aCGYTXbQ-wPaQsikWYu_9bLGXKZBtr6UiM
p5
0
mean
0
SD
0
p95
0
  • get_agent_activity_volatile_agent: uhCAkMIlYiI2LLkH2JaNhZZjg4U_gTQm9REixjT9lbnBBLlBC4Fjo
p5
0
<
mean
0.05
SD
0.22
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkWhLhb8m6axsdxp4ldmufZ_TubBDgoHVn75yu8L0EuxKqLKDc
p5
0
<
mean
0.08
SD
0.26
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkWwABspndqBoDBojHb14EDSmy8jdsclpvyD5dFgDFZd6UuBVS
p5
0
<
mean
0.08
SD
0.28
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkXHAM7n52cybuYHS5pGetj0SzNMenrcMKIYEOw_OaLIU_0Dny
p5
0
mean
0
SD
0
p95
0
  • get_agent_activity_volatile_agent: uhCAkmDgtekuWXkS8JYyq824tT27iSUn6kLi5TgxwRjrCsJNkdAjd
p5
0
<
mean
0.02
SD
0.15
p95
0
  • get_agent_activity_volatile_agent: uhCAkrBGNjFVZE66olXJ9FogWt6xpr9AFiuAnnyxBEiwaukJofIIv
p5
0
<
mean
0.03
SD
0.16
p95
0
  • get_agent_activity_volatile_agent: uhCAkrNjxrXIJy26NrJOQzhvhpNvOTIVaeuR8UtD6YV5tgZksujcQ
p5
0
<
mean
0.07
SD
0.25
<
p95
1
  • get_agent_activity_volatile_agent: uhCAksZLg1OtWglrKbXeJzAkwMf1lVZ6CUv4R7m6qtpZv46oqI1bU
p5
0
<
mean
0.03
SD
0.17
p95
0
  • get_agent_activity_volatile_agent: uhCAkuvCU9EUSXeRJbvTgDLbAmiP6WrYJ3KFil03MF2gXQUUR8thz
p5
0
<
mean
0.08
SD
0.27
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkzEIosFyrSa9IUaYMfv7Ps21gHixUnO1FUfg-J13bY3jogami
p5
0
<
mean
0.08
SD
0.27
<
p95
1
Error count
The number of errors accumulated.
116
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.093855
s
SD
0.714952
s
p50
0.353431
s
<
p95
0.72926
s
<
p99
1.151748
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
4
over 2707.46112839s
mean rate
0.07
/s
std
0.18
/s
p5
0
/s
p95
0.54
/s
peak
0.54
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.06821
s
SD
0.081798
s
p50
0.025342
s
<
p95
0.268611
s
p99
0.268611
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.097376
s
SD
0.078896
s
p50
0.08418
s
<
p95
0.272052
s
<
p99
0.291096
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.151312
s
SD
0.218561
s
p50
0.37562
s
<
p95
0.736603
s
<
p99
0.97528
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.007865
s
SD
0.417269
s
p50
0.009045
s
<
p95
1.231808
s
p99
1.231808
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.032742
s
SD
0.043074
s
p50
0.017154
s
<
p95
0.140255
s
p99
0.140255
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.052648
s
SD
0.042312
s
p50
0.046155
s
<
p95
0.144284
s
<
p99
0.153199
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.148599
s
SD
0.727279
s
p50
0.36184
s
<
p95
0.72179
s
<
p99
1.084055
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005152
s
SD
0.401239
s
p50
0.005537
s
<
p95
1.179295
s
p99
1.179295
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002221
s
SD
0.001156
s
p50
0.002248
s
<
p95
0.004801
s
<
p99
0.004987
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000177
s
SD
0.000338
s
p50
2.7e-05
s
<
p95
0.001059
s
p99
0.001059
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.001409
s
SD
0.001014
s
p50
0.001251
s
<
p95
0.003447
s
<
p99
0.003523
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000529
s
SD
0.000313
s
p50
0.000395
s
<
p95
0.001107
s
p99
0.001107
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.146363
s
SD
0.72719
s
p50
0.359675
s
<
p95
0.716111
s
<
p99
1.080796
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000561
s
SD
0.395062
s
p50
0.000326
s
<
p95
1.151796
s
p99
1.151796
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
9e-06
s
SD
5e-06
s
p50
9e-06
s
<
p95
2.2e-05
s
p99
2.2e-05
s
Host function call duration: '__hc__trace_1'
Duration of this host function call invoked from within WASM.
mean
0.000289
s
SD
0
s
p50
0.000289
s
p95
0.000289
s
p99
0.000289
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.047873
s
SD
0.041567
s
p50
0.021677
s
<
p95
0.133384
s
<
p99
0.145115
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.040218
s
SD
0.034215
s
p50
0.032141
s
<
p95
0.112826
s
<
p99
0.12707
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
5.14
s
<
mean
361.51
s
SD
531.29
s
<
p95
1578.52
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
84.692707
s
SD
54.286155
s
p50
1.712736
s
<
p95
122.226466
s
<
p99
316.971601
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
1.139597
s
SD
4.786479
s
p50
0.031277
s
<
p95
15.158795
s
<
p99
15.310353
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.003125
s
SD
0.004632
s
p50
0.002025
s
<
p95
0.008807
s
<
p99
0.012501
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.109042
s
SD
0.085685
s
p50
0.011207
s
<
p95
0.218011
s
<
p99
0.395056
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.309811
s
SD
0.205583
s
p50
0.059837
s
<
p95
0.603643
s
<
p99
1.043699
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
6.47382
s
SD
36.41938
s
p50
1.783826
s
<
p95
40.072112
s
<
p99
250.898621
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
30.899867
s
SD
77.44802
s
p50
0.156939
s
<
p95
238.864712
s
<
p99
243.590617
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.004393
s
SD
0.00239
s
p50
0.000277
s
<
p95
0.006981
s
<
p99
0.009664
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003559
s
SD
0.039609
s
p50
0.000723
s
<
p95
0.022014
s
<
p99
0.153002
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.001147
s
SD
0.000721
s
p50
0.000579
s
<
p95
0.002671
s
<
p99
0.002914
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
6.432646
s
SD
28.732649
s
p50
0.328413
s
<
p95
60.002762
s
<
p99
60.004402
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.284428
s
SD
0.221632
s
p50
0.201448
s
<
p95
0.904022
s
p99
0.904022
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.152372
s
SD
6.215834
s
p50
0.359975
s
<
p95
0.735335
s
<
p99
60.000805
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.493752
s
SD
27.17661
s
p50
0.375602
s
<
p95
60.002443
s
<
p99
60.003231
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
25.04
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
132
B/s
<
mean
140.20
KiB/s
SD
319.49
KiB/s
<
p95
384.66
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
144
B/s
<
mean
122.41
KiB/s
SD
210.54
KiB/s
<
p95
590.09
KiB/s
Total bytes received
Total bytes received on primary network interface
count
6.53
GiB
mean
3.58
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
5.70
GiB
mean
3.12
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 99.0%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 473.35 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (71.7% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 26% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.9
%
<
mean
31.4
%
SD
38.28
%
<
p95
98.5
%
System
6.36
%
CPU percentiles
CPU usage percentiles
p50
9.42
%
p95
98.50
%
p99
98.95
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
7
hosts
mean time
0.89
s
Memory used percentage
Percentage of memory used
p5
6.28
%
<
mean
14.27
%
SD
8.35
%
<
p95
36.4
%
Memory available percentage
Percentage of available memory
p5
63.6
%
<
mean
85.73
%
SD
8.35
%
<
p95
93.72
%
Max host memory used
Maximum memory usage percentage across all hosts
max
44.52
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
71.73
%
Memory growth rate
Rate of memory growth over time
growth
473.35
MiB/s
Disk read throughput
Disk read throughput in MiB/s
1.31
MiB/s
Disk write throughput
Disk write throughput in MiB/s
76.49
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/5
hosts
Mount Point /efi-boot
0/4
hosts
Mount Point /etc/hostname
0/8
hosts
Mount Point /etc/hosts
0/8
hosts
Mount Point /etc/nomad.d/client-meta.json
0/15
hosts
Mount Point /etc/nomad.d/meta.json
0/1
hosts
Mount Point /etc/resolv.conf
0/8
hosts
Mount Point /nix/store
0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.02
5 min
3.36
15 min
3.91
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
25.93
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
18.5964
%
SD
35.1755
%
<
p95
97.09
%
60 second average
18.5718
%
300 second average
19.3844
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
5.1514
%
SD
12.291
%
<
p95
41.51
%
60 second average
5.3364
%
300 second average
6.5964
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
3.9935
%
SD
11.0195
%
<
p95
36.82
%
60 second average
4.1398
%
300 second average
4.9955
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
<
mean
27.84
%
SD
38.05
%
<
p95
97.22
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
51.21
KiB
<
mean
231.58
KiB
SD
161.15
KiB
<
p95
549.16
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
30.6
threads
SD
14.62
threads
<
p95
51
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
<
mean
78.09
file descriptors
SD
28.93
file descriptors
<
p95
108
file descriptors

Write/Query

↑ Back to index

Creates an entry, then queries the source chain and performs a simple operation on the entries, then repeats.

Started
Thu, 23 Jul 2026 03:46:02 UTC
Peer count
1
Peer count at end
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
write_query_29977387554_1
Write timing
The time it takes to complete the zome function call that writes the entry.
mean
0.014596
s
SD
0.004593
s
p50
0.012371
s
<
p95
0.024493
s
<
p99
0.025955
s
Write rate
The number of writes completed per second.
mean
157.14
/s
Query timing
The time it takes to complete the chain_query_count_len zome call that queries the source chain.
mean
0.04712
s
SD
0.025414
s
p50
0.045172
s
<
p95
0.084566
s
<
p99
0.090586
s
Query rate
The number of chain queries completed per second.
mean
157.14
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::chain_query_count_len'
Metered usage count of the WASM ribosome for this zome function.
total
388466128402
over 280.002765072s
mean rate
1.38736530957e+09
/s
std
1.6326547064e+08
/s
p5
1.0462365179e+09
/s
p95
1.56327086529e+09
/s
peak
1.61384013661e+09
/s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
184481280
over 280.002765072s
mean rate
658855.79
/s
std
315273.96
/s
p5
415419.56
/s
p95
1.37342529e+06
/s
peak
1.64896958e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.002765072s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
40460840
over 280.002765072s
mean rate
144501.7
/s
std
69181.32
/s
p5
91100.26
/s
p95
301188.05
/s
peak
362078.89
/s
Zome call duration: 'crud::chain_query_count_len'
Duration of this zome call as measured by Holochain internally.
mean
0.031313
s
SD
0.009873
s
p50
0.028492
s
<
p95
0.040926
s
<
p99
0.041688
s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006707
s
SD
0.000887
s
p50
0.006714
s
<
p95
0.007553
s
<
p99
0.007594
s
WASM call duration: 'crud::chain_query_count_len'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.027704
s
SD
0.008966
s
p50
0.025332
s
<
p95
0.036229
s
<
p99
0.036919
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003527
s
SD
0.000173
s
p50
0.003443
s
<
p95
0.003815
s
<
p99
0.003835
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001086
s
SD
0
s
p50
0.001086
s
p95
0.001086
s
p99
0.001086
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000667
s
SD
7e-06
s
p50
0.000667
s
<
p95
0.00067
s
<
p99
0.000671
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.00022
s
SD
4.5e-05
s
p50
0.000311
s
p95
0.000311
s
p99
0.000311
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.007954
s
SD
0.002802
s
p50
0.007303
s
<
p95
0.010611
s
<
p99
0.010845
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002659
s
SD
0.00021
s
p50
0.00263
s
<
p95
0.002865
s
<
p99
0.002879
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.001628
s
SD
4.3e-05
s
p50
0.00162
s
<
p95
0.001678
s
<
p99
0.00168
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.35
s
<
mean
148.35
s
SD
83.67
s
<
p95
278.35
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.002769086s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001303
s
SD
0
s
p50
0.001303
s
p95
0.001303
s
p99
0.001303
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001054
s
SD
0
s
p50
0.001054
s
p95
0.001054
s
p99
0.001054
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001112
s
SD
4.5e-05
s
p50
0.001115
s
<
p95
0.001137
s
<
p99
0.00114
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.017397
s
SD
0.005485
s
p50
0.016255
s
<
p95
0.022271
s
<
p99
0.022677
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001604
s
SD
0
s
p50
0.001604
s
p95
0.001604
s
p99
0.001604
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001839
s
SD
0
s
p50
0.001839
s
p95
0.001839
s
p99
0.001839
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000997
s
SD
0.000319
s
p50
0.000926
s
<
p95
0.001291
s
<
p99
0.001316
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000326
s
SD
6.2e-05
s
p50
0.000353
s
<
p95
0.000401
s
<
p99
0.000402
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000183
s
SD
2e-06
s
p50
0.000183
s
<
p95
0.000185
s
<
p99
0.000187
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
18.99
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
11.15
KiB/s
<
mean
13.20
KiB/s
SD
1.76
KiB/s
<
p95
17.12
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
9.45
KiB/s
<
mean
14.31
KiB/s
SD
14.32
KiB/s
<
p95
60.72
KiB/s
Total bytes received
Total bytes received on primary network interface
count
3.74
MiB
mean
13.20
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
4.05
MiB
mean
14.31
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
18.75
%
<
mean
27.23
%
SD
5.99
%
<
p95
32.03
%
System
8.24
%
CPU percentiles
CPU usage percentiles
p50
31.52
%
p95
32.03
%
p99
32.06
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
21.73
%
<
mean
25.47
%
SD
2.57
%
<
p95
28.11
%
Memory available percentage
Percentage of available memory
p5
71.89
%
<
mean
74.53
%
SD
2.57
%
<
p95
78.27
%
Max host memory used
Maximum memory usage percentage across all hosts
max
25.47
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-552.05
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
3.72
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.59
5 min
2.26
15 min
1.43
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.16
%
<
mean
2.9187
%
SD
1.7627
%
<
p95
4.97
%
60 second average
2.9000
%
300 second average
2.7590
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
16.29
%
<
mean
17.14
%
SD
0.42
%
<
p95
17.69
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
306.65
KiB
<
mean
332.15
KiB
SD
57.78
KiB
<
p95
357.87
KiB
Holochain process threads
Number of threads in Holochain process
p5
37
threads
<
mean
37.52
threads
SD
4.88
threads
<
p95
39
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
72
file descriptors
mean
71.52
file descriptors
SD
11.65
file descriptors
<
p95
75
file descriptors

Write/Read

↑ Back to index

Creates an entry and reads it back, then repeats.

Started
Thu, 23 Jul 2026 03:47:45 UTC
Peer count
1
Peer count at end
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
write_read_29977387554_1
Write timing
The time taken to write the entry.
mean
0.033901
s
SD
0.021796
s
p50
0.028889
s
<
p95
0.077552
s
<
p99
0.100521
s
Write rate
The number of writes completed per second.
mean
169.79
/s
Read timing
The time taken to read the entry.
mean
0.023722
s
SD
0.017114
s
p50
0.020915
s
<
p95
0.056481
s
<
p99
0.069711
s
Read rate
The number of reads completed per second.
mean
169.79
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000688
s
SD
0.000122
s
p50
0.000658
s
<
p95
0.000823
s
<
p99
0.000834
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
204913260
over 290.009701918s
mean rate
706582.12
/s
std
467936.25
/s
p5
351829.04
/s
p95
1.82275054e+06
/s
peak
2.06438605e+06
/s
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
233187326
over 290.009701918s
mean rate
804076.74
/s
std
532176.81
/s
p5
395557.84
/s
p95
2.07425485e+06
/s
peak
2.34923139e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 290.009701918s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
22468432
over 290.009701918s
mean rate
77475.67
/s
std
51304.59
/s
p5
38577.53
/s
p95
199861.87
/s
peak
226356.84
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.013365
s
SD
0.003557
s
p50
0.012679
s
<
p95
0.017181
s
<
p99
0.017454
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.009754
s
SD
0.002881
s
p50
0.009429
s
<
p95
0.012461
s
<
p99
0.012645
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00593
s
SD
0.000954
s
p50
0.005528
s
<
p95
0.007265
s
<
p99
0.007361
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00185
s
SD
0.000219
s
p50
0.001782
s
<
p95
0.002112
s
<
p99
0.002138
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001251
s
SD
0
s
p50
0.001251
s
p95
0.001251
s
p99
0.001251
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000915
s
SD
7.2e-05
s
p50
0.000884
s
<
p95
0.001012
s
<
p99
0.001021
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000334
s
SD
3.7e-05
s
p50
0.000281
s
<
p95
0.00039
s
<
p99
0.000399
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000744
s
SD
0.000127
s
p50
0.000712
s
<
p95
0.000883
s
<
p99
0.000896
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.004504
s
SD
0.000822
s
p50
0.004155
s
<
p95
0.005661
s
<
p99
0.005745
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.003195
s
SD
0.000561
s
p50
0.003009
s
<
p95
0.003873
s
<
p99
0.003973
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.92
s
<
mean
152.92
s
SD
86.56
s
<
p95
287.93
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 290.009703069s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000532
s
SD
0
s
p50
0.000532
s
p95
0.000532
s
p99
0.000532
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000501
s
SD
0
s
p50
0.000501
s
p95
0.000501
s
p99
0.000501
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001872
s
SD
0.000304
s
p50
0.0018
s
<
p95
0.002213
s
<
p99
0.002235
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.035562
s
SD
0.013632
s
p50
0.032224
s
<
p95
0.050308
s
<
p99
0.051661
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.002726
s
SD
0
s
p50
0.002726
s
p95
0.002726
s
p99
0.002726
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.002072
s
SD
0
s
p50
0.002072
s
p95
0.002072
s
p99
0.002072
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000976
s
SD
0.000357
s
p50
0.000863
s
<
p95
0.001391
s
<
p99
0.001431
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000559
s
SD
0.000127
s
p50
0.000564
s
<
p95
0.000717
s
<
p99
0.000723
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00029
s
SD
4.2e-05
s
p50
0.000275
s
<
p95
0.000348
s
<
p99
0.00035
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
57.92
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
17.14
KiB/s
<
mean
684.53
KiB/s
SD
1.45
MiB/s
<
p95
4.79
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
14.85
KiB/s
<
mean
34.31
KiB/s
SD
38.51
KiB/s
<
p95
142.40
KiB/s
Total bytes received
Total bytes received on primary network interface
count
200.55
MiB
mean
684.53
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
10.05
MiB
mean
34.31
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 91.4%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1248.74 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
45.63
%
<
mean
70.16
%
SD
14.77
%
<
p95
86.73
%
System
12.23
%
CPU percentiles
CPU usage percentiles
p50
74.23
%
p95
86.73
%
p99
91.40
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.33
s
Memory used percentage
Percentage of memory used
p5
11.74
%
<
mean
14.99
%
SD
2.43
%
<
p95
17.92
%
Memory available percentage
Percentage of available memory
p5
82.08
%
<
mean
85.01
%
SD
2.43
%
<
p95
88.26
%
Max host memory used
Maximum memory usage percentage across all hosts
max
14.99
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1248.74
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
5.76
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.19
5 min
1.59
15 min
0.69
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
4.57
%
<
mean
27.0577
%
SD
17.3347
%
<
p95
48.44
%
60 second average
19.9568
%
300 second average
8.3326
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.1387
%
SD
0.21
%
<
p95
0.69
%
60 second average
0.1465
%
300 second average
0.0555
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0584
%
SD
0.1184
%
<
p95
0.34
%
60 second average
0.0565
%
300 second average
0.0145
%
Holochain process CPU usage
CPU usage by Holochain process
p5
15.91
%
<
mean
27.96
%
SD
12.41
%
<
p95
45.7
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
1.63
KiB
<
mean
259.10
KiB
SD
124.08
KiB
<
p95
433.11
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
27.58
threads
SD
10.82
threads
<
p95
35
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
6
file descriptors
<
mean
67
file descriptors
SD
25.08
file descriptors
<
p95
83
file descriptors

Write validated

↑ Back to index

Creates an entry, updates it and links the create to the update, then repeats. Each of the three actions is validated by the included hApp.

Started
Thu, 23 Jul 2026 03:49:26 UTC
Peer count
1
Peer count at end
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
write_validated_29977387554_1
Write timing
The time it takes to complete the zome function call that writes the entry, updates it, and links to the update.
mean
0.089083
s
SD
0.042556
s
p50
0.079052
s
<
p95
0.174772
s
<
p99
0.220749
s
Write rate
The number of write zome function calls that complete per second.
mean
37.18
/s
Read timing
The time it takes to complete the zome function call that reads the data.
mean
0.177322
s
SD
0.06903
s
p50
0.179529
s
<
p95
0.302949
s
<
p99
0.369601
s
Read rate
The number of read zome function calls that complete per second.
mean
37.21
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.004729
s
SD
0.001971
s
p50
0.004246
s
<
p95
0.007886
s
<
p99
0.008202
s
WASM usage: 'validated::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
44473872
over 290.016819743s
mean rate
153349.61
/s
std
59660.39
/s
p5
90069.77
/s
p95
253901.1
/s
peak
257994.82
/s
WASM usage: 'validated::update_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
52061555
over 290.016819743s
mean rate
179512.53
/s
std
69982.04
/s
p5
105561.64
/s
p95
302289.65
/s
peak
302290.79
/s
WASM usage: 'validated_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
70085830
over 290.016819743s
mean rate
241661.73
/s
std
94182.04
/s
p5
141986.71
/s
p95
403831.66
/s
peak
405216.17
/s
WASM usage: 'validated_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
881369802
over 290.016819743s
mean rate
3.03903584e+06
/s
std
1.18400558e+06
/s
p5
1.78559178e+06
/s
p95
5.08191464e+06
/s
peak
5.0899617e+06
/s
Zome call duration: 'validated::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.019055
s
SD
0.005545
s
p50
0.016958
s
<
p95
0.024481
s
<
p99
0.042668
s
Zome call duration: 'validated::update_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.030238
s
SD
0.00743
s
p50
0.028845
s
<
p95
0.038242
s
<
p99
0.043151
s
WASM call duration: 'validated::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.01107
s
SD
0.003007
s
p50
0.010818
s
<
p95
0.012508
s
<
p99
0.02634
s
WASM call duration: 'validated::update_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.017331
s
SD
0.003784
s
p50
0.016651
s
<
p95
0.020873
s
<
p99
0.027218
s
WASM call duration: 'validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001122
s
SD
8.9e-05
s
p50
0.001105
s
<
p95
0.001203
s
<
p99
0.001211
s
WASM call duration: 'validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.008995
s
SD
0.001253
s
p50
0.008529
s
<
p95
0.010335
s
<
p99
0.010453
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000528
s
SD
8.7e-05
s
p50
0.000513
s
<
p95
0.000593
s
<
p99
0.000618
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000545
s
SD
7.2e-05
s
p50
0.000525
s
<
p95
0.000597
s
<
p99
0.000598
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.004062
s
SD
0.001337
s
p50
0.003521
s
<
p95
0.005563
s
<
p99
0.005675
s
Host function call duration: '__hc__update_1'
Duration of this host function call invoked from within WASM.
mean
0.006685
s
SD
0.002194
s
p50
0.006057
s
<
p95
0.008618
s
<
p99
0.008779
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.006727
s
SD
0.00288
s
p50
0.007671
s
<
p95
0.009964
s
<
p99
0.024797
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.005917
s
SD
0.002473
s
p50
0.005338
s
<
p95
0.007795
s
<
p99
0.018177
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.68
s
<
mean
152.69
s
SD
86.56
s
<
p95
287.69
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 290.016839723s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001094
s
SD
0
s
p50
0.001094
s
p95
0.001094
s
p99
0.001094
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002593
s
SD
0
s
p50
0.002593
s
p95
0.002593
s
p99
0.002593
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.003401
s
SD
0.000506
s
p50
0.003284
s
<
p95
0.003845
s
<
p99
0.003874
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.040779
s
SD
0.016627
s
p50
0.03471
s
<
p95
0.058207
s
<
p99
0.059929
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.00289
s
SD
0
s
p50
0.00289
s
p95
0.00289
s
p99
0.00289
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.010971
s
SD
0
s
p50
0.010971
s
p95
0.010971
s
p99
0.010971
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.001136
s
SD
0.000407
s
p50
0.00093
s
<
p95
0.001598
s
<
p99
0.001649
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000737
s
SD
0.000336
s
p50
0.000643
s
<
p95
0.000851
s
<
p99
0.000854
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000391
s
SD
5.2e-05
s
p50
0.00038
s
<
p95
0.000437
s
<
p99
0.000445
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
66.11
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
17.13
KiB/s
<
mean
720.04
KiB/s
SD
1.52
MiB/s
<
p95
4.79
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
14.73
KiB/s
<
mean
36.77
KiB/s
SD
40.13
KiB/s
<
p95
142.41
KiB/s
Total bytes received
Total bytes received on primary network interface
count
210.95
MiB
mean
720.04
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
10.77
MiB
mean
36.77
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 91.4%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1429.99 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
71.99
%
<
mean
82.57
%
SD
6.52
%
<
p95
91.1
%
System
16.46
%
CPU percentiles
CPU usage percentiles
p50
84.42
%
p95
91.10
%
p99
91.41
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.63
s
Memory used percentage
Percentage of memory used
p5
15.21
%
<
mean
18.07
%
SD
2.79
%
<
p95
22.89
%
Memory available percentage
Percentage of available memory
p5
77.11
%
<
mean
81.93
%
SD
2.79
%
<
p95
84.79
%
Max host memory used
Maximum memory usage percentage across all hosts
max
18.07
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1429.99
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
6.60
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
5.14
5 min
2.66
15 min
1.16
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
19.35
%
<
mean
44.6439
%
SD
15.2555
%
<
p95
66.32
%
60 second average
35.8187
%
300 second average
16.8481
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.1655
%
SD
0.2644
%
<
p95
0.74
%
60 second average
0.1781
%
300 second average
0.0842
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0419
%
SD
0.1068
%
<
p95
0.3
%
60 second average
0.0490
%
300 second average
0.0145
%
Holochain process CPU usage
CPU usage by Holochain process
p5
15.95
%
<
mean
23.18
%
SD
5.91
%
<
p95
34.99
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
1.69
KiB
<
mean
329.85
KiB
SD
203.56
KiB
<
p95
715.80
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
90.32
threads
SD
143.99
threads
<
p95
441
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
<
mean
226.11
file descriptors
SD
365.21
file descriptors
<
p95
1111
file descriptors

Write Validated must_get_agent_activity

↑ Back to index

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Mixed-Arc must_get_agent_activity, but all agents are full-arc.

Started
Thu, 23 Jul 2026 05:13:50 UTC
Peer count
30
Peer count at end
26
Behaviours
  • must_get_agent_activity (1 agent)
  • write (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
write_validated_must_get_agent_activity_29977387554_1
Highest observed action_seq
The maximum chain length observed per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1484.5
Max
Highest chain head value observed for any single write agent.
1831
Write agents observed
6
Chain batch delay timing
The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.
Mean
mean
215.555689
s
SD
86.255151
s
Max
Highest per-partition mean latency
max mean
1019.198457
s
Min
Lowest per-partition mean latency
min mean
8.96875
s
Chain batch delay rate
The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.
Mean
mean
2.37
/s
Max
Highest per-partition mean rate
max
5
/s
Min
Lowest per-partition mean rate
min
1.33
/s
create_validated_sample_entry zome call timing
The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.
Mean
mean
0.791861
s
SD
0.847829
s
Max
Highest per-partition mean latency
max mean
2.662677
s
Min
Lowest per-partition mean latency
min mean
0.059079
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.
Total
3534
Agents affected
14 / 14
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
252
Max
Highest count in any single partition
763
Min
Lowest count in any single partition
31
Final error count
The total number of all types of error accumulated over the run by all agents.
55483
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.014571
s
SD
0.061784
s
p50
0.000999
s
<
p95
0.088679
s
<
p99
0.44371
s
WASM usage: 'validated_must_get_agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 905.793941695s
Not enough time data to show a trend.
WASM usage: 'validated_must_get_agent_activity::create_sample_entries_batch'
Metered usage count of the WASM ribosome for this zome function.
total
4580077254
over 905.793941695s
mean rate
6.7732699779e+08
/s
std
1.30796640852e+09
/s
p5
387.05
/s
p95
3.89153569302e+09
/s
peak
6.52581222502e+09
/s
WASM usage: 'validated_must_get_agent_activity::create_validated_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
42554194
over 1891.866646143s
mean rate
6.276281565e+07
/s
std
1.1420811562e+08
/s
p5
48118.8
/s
p95
3.7359291103e+08
/s
peak
5.171765806e+08
/s
WASM usage: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Metered usage count of the WASM ribosome for this zome function.
total
9290336
over 1891.866646143s
mean rate
1.40280282394e+09
/s
std
4.63738497585e+09
/s
p5
0
/s
p95
9.44201594302e+09
/s
peak
3.41050681182e+10
/s
WASM usage: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
58062004
over 37472.132591555s
mean rate
1.13218606e+07
/s
std
5.515650234e+07
/s
p5
69860.17
/s
p95
3.853158276e+07
/s
peak
8.8355629363e+08
/s
WASM usage: 'validated_must_get_agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
4746808
over 37472.132591555s
mean rate
1.15273650523e+09
/s
std
3.05818147459e+09
/s
p5
5711.33
/s
p95
5.50277227289e+09
/s
peak
2.58391118492e+10
/s
WASM usage: 'validated_must_get_agent_activity_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37472.132591555s
Not enough time data to show a trend.
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.049896
s
SD
0.012881
s
p50
0.053811
s
<
p95
0.063973
s
p99
0.063973
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.221965
s
SD
0.083346
s
p50
0.211975
s
<
p95
0.341638
s
<
p99
0.391799
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.039366
s
SD
0.055154
s
p50
0.025496
s
<
p95
0.144964
s
<
p99
0.286579
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.055026
s
SD
0.058756
s
p50
0.044554
s
<
p95
0.173401
s
<
p99
0.244744
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.021684
s
SD
0.102767
s
p50
0.052635
s
<
p95
0.490507
s
p99
0.490507
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.027196
s
SD
0.009575
s
p50
0.02504
s
<
p95
0.043645
s
p99
0.043645
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.19926
s
SD
0.079037
s
p50
0.191041
s
<
p95
0.312329
s
<
p99
0.358876
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.022609
s
SD
0.030469
s
p50
0.013975
s
<
p95
0.082687
s
<
p99
0.164257
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.020354
s
SD
0.035692
s
p50
0.017884
s
<
p95
0.164466
s
<
p99
0.1673
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.01338
s
SD
0.100413
s
p50
0.025548
s
<
p95
0.466921
s
p99
0.466921
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001086
s
SD
0.000474
s
p50
0.001124
s
<
p95
0.002151
s
<
p99
0.002747
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.010663
s
SD
0.013383
s
p50
0.009271
s
<
p95
0.033428
s
<
p99
0.085605
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.1e-05
s
SD
7e-06
s
p50
2.7e-05
s
<
p95
4.1e-05
s
<
p99
5.4e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000483
s
SD
0.000275
s
p50
0.000442
s
<
p95
0.00085
s
<
p99
0.001821
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000507
s
SD
0.000267
s
p50
0.000369
s
<
p95
0.001227
s
p99
0.001227
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.001038
s
SD
0.077012
s
p50
0.000538
s
<
p95
0.152107
s
<
p99
0.443759
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.019051
s
SD
0.024137
s
p50
0.01551
s
<
p95
0.066084
s
<
p99
0.13155
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.008149
s
SD
0.003991
s
p50
0.005532
s
<
p95
0.013499
s
<
p99
0.015299
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1.4e-05
s
SD
7e-06
s
p50
1.2e-05
s
<
p95
1.8e-05
s
<
p99
3.9e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.006785
s
SD
0.017212
s
p50
0.011543
s
<
p95
0.041565
s
<
p99
0.077792
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.021562
s
SD
0.029307
s
p50
0.018631
s
<
p95
0.077482
s
<
p99
0.15799
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.01
s
<
mean
453.12
s
SD
260.37
s
<
p95
857.92
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
20.971185
s
SD
19.012186
s
p50
12.424856
s
<
p95
61.520608
s
<
p99
82.53301
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
1.281378
s
SD
10.466248
s
p50
3.866976
s
<
p95
21.258516
s
<
p99
51.033236
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002389
s
SD
0.003566
s
p50
0.001244
s
<
p95
0.008051
s
<
p99
0.018625
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.01605
s
SD
0.041735
s
p50
0.017654
s
<
p95
0.113774
s
<
p99
0.213155
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.101254
s
SD
0.063139
s
p50
0.054815
s
<
p95
0.196219
s
<
p99
0.261373
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.252356
s
SD
3.307755
s
p50
0.357687
s
<
p95
8.190348
s
<
p99
17.954059
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
31.164041
s
SD
33.89357
s
p50
28.108144
s
<
p95
86.441339
s
<
p99
152.116221
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000381
s
SD
0.000213
s
p50
0.00027
s
<
p95
0.000752
s
<
p99
0.000912
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001796
s
SD
0.014136
s
p50
0.000368
s
<
p95
0.018722
s
<
p99
0.092249
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000369
s
SD
0.000222
s
p50
0.000347
s
<
p95
0.00062
s
<
p99
0.001344
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.570953
s
SD
28.062497
s
p50
0.109452
s
<
p95
60.002204
s
<
p99
60.003568
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.112875
s
SD
0.091031
s
p50
0.092652
s
<
p95
0.273674
s
p99
0.273674
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
0.157434
s
SD
0.022835
s
p50
0.138436
s
<
p95
0.182025
s
p99
0.182025
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.162575
s
SD
29.27405
s
p50
0.215627
s
<
p95
60.002001
s
<
p99
60.005055
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
29.04
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
87
B/s
<
mean
86.54
KiB/s
SD
319.03
KiB/s
<
p95
134.63
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
50
B/s
<
mean
65.11
KiB/s
SD
66.84
KiB/s
<
p95
196.92
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.98
GiB
mean
1.12
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.47
GiB
mean
846.84
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 96.5%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 243.52 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (71.5% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 23% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.48
%
<
mean
37.45
%
SD
29.47
%
<
p95
91.89
%
System
8.41
%
CPU percentiles
CPU usage percentiles
p50
24.09
%
p95
91.89
%
p99
96.54
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
8
hosts
mean time
0.39
s
Memory used percentage
Percentage of memory used
p5
8.29
%
<
mean
17.95
%
SD
8.63
%
<
p95
37.74
%
Memory available percentage
Percentage of available memory
p5
62.26
%
<
mean
82.05
%
SD
8.63
%
<
p95
91.71
%
Max host memory used
Maximum memory usage percentage across all hosts
max
46.77
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
71.54
%
Memory growth rate
Rate of memory growth over time
growth
243.52
MiB/s
Disk read throughput
Disk read throughput in MiB/s
2.29
MiB/s
Disk write throughput
Disk write throughput in MiB/s
153.94
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/5
hosts
Mount Point /efi-boot
0/4
hosts
Mount Point /etc/hostname
0/8
hosts
Mount Point /etc/hosts
0/8
hosts
Mount Point /etc/nomad.d/client-meta.json
0/14
hosts
Mount Point /etc/nomad.d/meta.json
0/1
hosts
Mount Point /etc/resolv.conf
0/8
hosts
Mount Point /nix/store
0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.58
5 min
2.68
15 min
2.95
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
23.08
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
10.6593
%
SD
17.2772
%
<
p95
55.49
%
60 second average
10.8188
%
300 second average
12.5641
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
9.0986
%
SD
17.1068
%
<
p95
47.52
%
60 second average
8.8039
%
300 second average
7.3183
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
7.6516
%
SD
14.9244
%
<
p95
41.81
%
60 second average
7.3876
%
300 second average
6.0356
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.62
%
<
mean
32.58
%
SD
27.55
%
<
p95
89.39
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
281.49
KiB
<
mean
517.83
KiB
SD
164.12
KiB
<
p95
778.91
KiB
Holochain process threads
Number of threads in Holochain process
p5
26
threads
<
mean
45.14
threads
SD
20.61
threads
<
p95
76
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
64
file descriptors
<
mean
95.34
file descriptors
SD
24.43
file descriptors
<
p95
129
file descriptors

Zome Call, Single Value

↑ Back to index

Calls a zome function that returns a fixed value. This tests the maximum performance of zome calls when the zome function is not calling into Holochain other otherwise doing any work.

Started
Thu, 23 Jul 2026 03:51:04 UTC
Peer count
1
Peer count at end
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
zome_call_single_value_29977387554_1
Call timing
The time taken for the call to complete.
mean
0.009
s
SD
0.011379
s
p50
0.00739
s
<
p95
0.015775
s
<
p99
0.026828
s
Call rate
The number of zome calls completed per second.
mean
1106.38
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'return_single_value::get_value'
Metered usage count of the WASM ribosome for this zome function.
total
131668776
over 280.045274628s
mean rate
470194.38
/s
std
57653.15
/s
p5
371683.67
/s
p95
559223.98
/s
peak
562191.44
/s
Zome call duration: 'return_single_value::get_value'
Duration of this zome call as measured by Holochain internally.
mean
0.004937
s
SD
0.000718
s
p50
0.00489
s
<
p95
0.005174
s
<
p99
0.008721
s
WASM call duration: 'return_single_value::get_value'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001253
s
SD
2.5e-05
s
p50
0.00124
s
<
p95
0.001277
s
<
p99
0.001281
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.02407
s
SD
0
s
p50
0.02407
s
p95
0.02407
s
p99
0.02407
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.08
s
<
mean
147.09
s
SD
83.68
s
<
p95
277.12
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.045290743s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001259
s
SD
0
s
p50
0.001259
s
p95
0.001259
s
p99
0.001259
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.00144
s
SD
0
s
p50
0.00144
s
p95
0.00144
s
p99
0.00144
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.00284
s
SD
0
s
p50
0.00284
s
p95
0.00284
s
p99
0.00284
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.003036
s
SD
0.000241
s
p50
0.003199
s
<
p95
0.00336
s
p99
0.00336
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001552
s
SD
0
s
p50
0.001552
s
p95
0.001552
s
p99
0.001552
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.002676
s
SD
0
s
p50
0.002676
s
p95
0.002676
s
p99
0.002676
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000232
s
SD
7e-06
s
p50
0.000229
s
<
p95
0.00024
s
<
p99
0.000242
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000125
s
SD
0.00013
s
p50
0.00039
s
p95
0.00039
s
p99
0.00039
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.0005
s
SD
0
s
p50
0.0005
s
p95
0.0005
s
p99
0.0005
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
67.78
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
5.39
KiB/s
<
mean
512.25
KiB/s
SD
1.21
MiB/s
<
p95
4.14
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
4.80
KiB/s
<
mean
32.79
KiB/s
SD
33.66
KiB/s
<
p95
125.12
KiB/s
Total bytes received
Total bytes received on primary network interface
count
150.07
MiB
mean
512.25
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
9.61
MiB
mean
32.79
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 94.6%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1000.63 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 100% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
82.62
%
<
mean
88.53
%
SD
4.25
%
<
p95
94.38
%
System
20.75
%
CPU percentiles
CPU usage percentiles
p50
89.36
%
p95
94.38
%
p99
94.62
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.97
s
Memory used percentage
Percentage of memory used
p5
17.36
%
<
mean
20.22
%
SD
2.33
%
<
p95
23.8
%
Memory available percentage
Percentage of available memory
p5
76.2
%
<
mean
79.78
%
SD
2.33
%
<
p95
82.64
%
Max host memory used
Maximum memory usage percentage across all hosts
max
20.22
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1000.63
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
6.79
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/nomad.d/client-meta.json
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
8.14
5 min
4.30
15 min
1.90
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
100.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
47.12
%
<
mean
60.8942
%
SD
13.3901
%
<
p95
81.63
%
60 second average
52.6161
%
300 second average
27.9029
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.1165
%
SD
0.2374
%
<
p95
0.74
%
60 second average
0.1426
%
300 second average
0.0913
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0116
%
SD
0.0443
%
<
p95
0.08
%
60 second average
0.0239
%
300 second average
0.0090
%
Holochain process CPU usage
CPU usage by Holochain process
p5
15.9
%
<
mean
22.33
%
SD
4.77
%
<
p95
27.5
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
15.32
KiB
<
mean
374.50
KiB
SD
232.80
KiB
<
p95
715.80
KiB
Holochain process threads
Number of threads in Holochain process
p5
7
threads
<
mean
171.2
threads
SD
189.55
threads
<
p95
467
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
7
file descriptors
<
mean
427.69
file descriptors
SD
477.78
file descriptors
<
p95
1162
file descriptors