App Install

↑ Back to index

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Thu, 25 Jun 2026 01:29:21 UTC
Peer count
1
Behaviours
  • large (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
app_install_large_28140184351_1
First install time
The time from conductor startup to completion of the first app installation attempt.
0.126072069
s
Install app timing
The time taken to install an app.
mean
0.043249
s
SD
0.00884
s
p50
0.039919
s
<
p95
0.064963
s
<
p99
0.06984
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'large::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 50.001152142s
Not enough time data to show a trend.
WASM call duration: 'large::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002555
s
SD
8.5e-05
s
p50
0.002536
s
<
p95
0.002723
s
<
p99
0.002931
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000116
s
SD
6.3e-05
s
p50
9.2e-05
s
<
p95
0.000233
s
<
p99
0.000363
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
8.51
s
<
mean
33.51
s
SD
17.08
s
<
p95
58.51
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
3201
over 50.001403536s
mean rate
64.02
/s
std
0.94
/s
p5
62.7
/s
p95
64.9
/s
peak
64.9
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.000788
s
SD
0.000493
s
p50
0.000828
s
<
p95
0.002086
s
≤
p99
0.002086
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000513
s
SD
1.9e-05
s
p50
0.000523
s
<
p95
0.000539
s
≤
p99
0.000539
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000976
s
SD
2.8e-05
s
p50
0.00097
s
<
p95
0.001001
s
≤
p99
0.001001
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.012936
s
SD
0.00019
s
p50
0.012913
s
<
p95
0.013071
s
≤
p99
0.013071
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.000943
s
SD
2.9e-05
s
p50
0.00094
s
<
p95
0.000952
s
≤
p99
0.000952
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000635
s
SD
2.8e-05
s
p50
0.000636
s
<
p95
0.000708
s
≤
p99
0.000708
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000266
s
SD
5e-06
s
p50
0.000266
s
<
p95
0.000269
s
≤
p99
0.000269
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000142
s
SD
2.9e-05
s
p50
0.000134
s
<
p95
0.000195
s
<
p99
0.00024
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
3.2e-05
s
SD
0
s
p50
3.2e-05
s
≤
p95
3.2e-05
s
≤
p99
3.2e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
8.4e-05
s
SD
2e-06
s
p50
8.6e-05
s
<
p95
8.9e-05
s
≤
p99
8.9e-05
s
Cache DB connection use time
Time spent holding cache database connections.
mean
6.5e-05
s
SD
4e-06
s
p50
6.5e-05
s
<
p95
7.6e-05
s
≤
p99
7.6e-05
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
5.6e-05
s
SD
0
s
p50
5.6e-05
s
≤
p95
5.6e-05
s
≤
p99
5.6e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
6.7e-05
s
SD
3e-06
s
p50
6.7e-05
s
<
p95
7.3e-05
s
≤
p99
7.3e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000265
s
SD
7.9e-05
s
p50
0.000263
s
<
p95
0.000339
s
<
p99
0.000407
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00022
s
SD
3e-06
s
p50
0.000219
s
<
p95
0.000223
s
≤
p99
0.000223
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
32.10
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
205.97
KiB/s
<
mean
215.24
KiB/s
SD
5.86
KiB/s
<
p95
223.23
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
74.16
KiB/s
<
mean
75.01
KiB/s
SD
769
B/s
<
p95
76.07
KiB/s
Total bytes received
Total bytes received on primary network interface
count
10.51
MiB
mean
215.24
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
3.66
MiB
mean
75.01
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1594.17 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
38.4
%
<
mean
38.71
%
SD
0.18
%
<
p95
38.89
%
System
6.61
%
CPU percentiles
CPU usage percentiles
p50
38.72
%
p95
38.89
%
p99
38.89
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
10.5
%
<
mean
13.85
%
SD
2.9
%
<
p95
18.51
%
Memory available percentage
Percentage of available memory
p5
81.49
%
<
mean
86.15
%
SD
2.9
%
<
p95
89.5
%
Max host memory used
Maximum memory usage percentage across all hosts
max
13.85
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1594.17
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.02
MiB/s
Disk write throughput
Disk write throughput in MiB/s
12.24
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.37
5 min
0.71
15 min
0.38
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
2.99
%
<
mean
3.2283
%
SD
0.2039
%
<
p95
3.54
%
60 second average
1.5317
%
300 second average
0.4083
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.07
%
SD
0.1005
%
<
p95
0.24
%
60 second average
0.0150
%
300 second average
0.0017
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.04
%
SD
0.0663
%
<
p95
0.18
%
60 second average
0.0083
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
34.26
%
<
mean
34.78
%
SD
0.31
%
<
p95
35.09
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
417.82
KiB
<
mean
1.14
MiB
SD
512.24
KiB
<
p95
1.88
MiB
Holochain process threads
Number of threads in Holochain process
p5
19
threads
<
mean
22.17
threads
SD
3.44
threads
<
p95
27
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
193
file descriptors
<
mean
1312.83
file descriptors
SD
757.54
file descriptors
<
p95
2406
file descriptors

App Install

↑ Back to index

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Thu, 25 Jun 2026 01:31:16 UTC
Peer count
1
Behaviours
  • minimal (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
app_install_minimal_28140184351_1
First install time
The time from conductor startup to completion of the first app installation attempt.
0.346064701
s
Install app timing
The time taken to install an app.
mean
0.065311
s
SD
0.014249
s
p50
0.059201
s
<
p95
0.091822
s
<
p99
0.11936
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'callback::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 130.00449776s
Not enough time data to show a trend.
WASM usage: 'callback_integrity::genesis_self_check_2'
Metered usage count of the WASM ribosome for this zome function.
total
2846223
over 130.00449776s
mean rate
21893.22
/s
std
5246.04
/s
p5
11472.56
/s
p95
25675.64
/s
peak
25675.64
/s
WASM call duration: 'callback::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00085
s
SD
0.000212
s
p50
0.000786
s
<
p95
0.001147
s
<
p99
0.001725
s
WASM call duration: 'callback_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001086
s
SD
0.0001
s
p50
0.001104
s
<
p95
0.001118
s
≤
p99
0.001118
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000214
s
SD
0.000162
s
p50
0.000171
s
<
p95
0.000386
s
<
p99
0.000674
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
6.66
s
<
mean
71.66
s
SD
40.31
s
<
p95
136.66
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
5731
over 130.002092161s
mean rate
44.08
/s
std
10.64
/s
p5
23.1
/s
p95
52.1
/s
peak
52.1
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.001355
s
SD
0.001027
s
p50
0.001346
s
<
p95
0.005338
s
≤
p99
0.005338
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.0007
s
SD
4.3e-05
s
p50
0.000676
s
<
p95
0.000784
s
≤
p99
0.000784
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001641
s
SD
5.3e-05
s
p50
0.001617
s
<
p95
0.001751
s
≤
p99
0.001751
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.017672
s
SD
0.001316
s
p50
0.01666
s
<
p95
0.020892
s
≤
p99
0.020892
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001733
s
SD
9.8e-05
s
p50
0.001687
s
<
p95
0.001907
s
≤
p99
0.001907
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001008
s
SD
5.4e-05
s
p50
0.001
s
<
p95
0.001059
s
≤
p99
0.001059
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000444
s
SD
1.6e-05
s
p50
0.000436
s
<
p95
0.000483
s
≤
p99
0.000483
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000252
s
SD
7.6e-05
s
p50
0.000235
s
<
p95
0.000377
s
<
p99
0.000565
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
4.6e-05
s
SD
3e-06
s
p50
4.4e-05
s
<
p95
5.2e-05
s
≤
p99
5.2e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
8.7e-05
s
SD
1.1e-05
s
p50
8.4e-05
s
<
p95
0.000125
s
≤
p99
0.000125
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000104
s
SD
1.3e-05
s
p50
0.0001
s
<
p95
0.000121
s
≤
p99
0.000121
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
9.8e-05
s
SD
0
s
p50
9.8e-05
s
≤
p95
9.8e-05
s
≤
p99
9.8e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000164
s
SD
1.2e-05
s
p50
0.000157
s
<
p95
0.000184
s
≤
p99
0.000184
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000368
s
SD
0.000109
s
p50
0.000482
s
<
p95
0.000667
s
<
p99
0.000804
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000407
s
SD
2.9e-05
s
p50
0.000407
s
<
p95
0.000432
s
≤
p99
0.000432
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
38.39
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
101.26
KiB/s
<
mean
812.18
KiB/s
SD
1.63
MiB/s
<
p95
6.55
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
57.07
KiB/s
<
mean
191.97
KiB/s
SD
233.98
KiB/s
<
p95
770.02
KiB/s
Total bytes received
Total bytes received on primary network interface
count
111.04
MiB
mean
812.18
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
26.25
MiB
mean
191.97
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 2037.65 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
33.67
%
<
mean
46.86
%
SD
19.91
%
<
p95
83.45
%
System
8.46
%
CPU percentiles
CPU usage percentiles
p50
35.88
%
p95
83.45
%
p99
83.45
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.21
s
Memory used percentage
Percentage of memory used
p5
24.91
%
<
mean
34.95
%
SD
7.94
%
<
p95
47.83
%
Memory available percentage
Percentage of available memory
p5
52.17
%
<
mean
65.05
%
SD
7.94
%
<
p95
75.09
%
Max host memory used
Maximum memory usage percentage across all hosts
max
34.95
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
2037.65
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.10
MiB/s
Disk write throughput
Disk write throughput in MiB/s
10.62
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.63
5 min
0.80
15 min
0.43
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
1.21
%
<
mean
12.3587
%
SD
17.2726
%
<
p95
55.14
%
60 second average
5.5913
%
300 second average
2.0853
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
29.21
%
<
mean
37.81
%
SD
11.74
%
<
p95
61.25
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
20.86
KiB
<
mean
704.76
KiB
SD
541.59
KiB
<
p95
1.68
MiB
Holochain process threads
Number of threads in Holochain process
p5
7
threads
<
mean
18.53
threads
SD
8.4
threads
<
p95
43
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
8
file descriptors
<
mean
893.53
file descriptors
SD
878.91
file descriptors
<
p95
2113
file descriptors

DHT Sync Lag

↑ Back to index

Measures the lag time between an agent publishing data and other peers being able to see it. This scenario has two roles:

  • write: Creates entries with a timestamp field, linked to a known base hash so that record_lag agents can discover them.
  • record_lag: Repeatedly queries for links from the known base hash. When a new entry is discovered, it calculates the time difference between the entry's timestamp and the current time, giving the sync lag for that entry.
Started
Thu, 25 Jun 2026 01:33:04 UTC
Peer count
30
Behaviours
  • record_lag (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
dht_sync_lag_28140184351_1
Create rate
The average number of created records per agent.
Mean
mean
40.22
/s
Max
Highest per-partition mean rate
max
76.9
/s
Min
Lowest per-partition mean rate
min
10.5
/s
Sync lag timing
The average time between when a record was created and when it is first seen by an agent.
Mean
mean
56.961997
s
SD
21.790682
s
Max
Highest per-partition mean latency
max mean
89.398936
s
Min
Lowest per-partition mean latency
min mean
42.988528
s
Sync lag rate
The average number of created records discovered per agent.
Mean
mean
193.8
/s
Max
Highest per-partition mean rate
max
456.5
/s
Min
Lowest per-partition mean rate
min
0
/s
Delivery ratio
The proportion of created entries successfully received by all record_lag agents.
0.0081
Sent count
The total number of entries sent (created) by write agents, by agent.
Total
167429
Agents affected
23 / 23
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
7280
Max
Highest count in any single partition
14005
Min
Lowest count in any single partition
1847
Received count
The total number of entries received by record_lag agents, by agent.
Total
6818
Agents affected
5 / 5
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
1364
Max
Highest count in any single partition
1420
Min
Lowest count in any single partition
1233
Error count
The number of errors encountered during the scenario.
163
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.234386
s
SD
0.133146
s
p50
0.157548
s
<
p95
0.420718
s
<
p99
0.484838
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 1530.015178326s
Not enough time data to show a trend.
WASM usage: 'timed::created_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
545752872
over 38369.926371073s
mean rate
2.98335253574e+09
/s
std
1.99192870255e+10
/s
p5
114412.21
/s
p95
8.92286395906e+09
/s
peak
5.63319031431e+11
/s
WASM usage: 'timed::get_timed_entries_local'
Metered usage count of the WASM ribosome for this zome function.
total
527680729
over 1796.791486727s
mean rate
1.493403576e+08
/s
std
1.1053615388e+08
/s
p5
2.526364048e+07
/s
p95
4.6022359441e+08
/s
peak
4.6428875104e+08
/s
WASM usage: 'timed_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
62782216
over 38370.866910065s
mean rate
7.2857905798e+08
/s
std
4.33181867231e+09
/s
p5
13847.9
/s
p95
1.48900536722e+09
/s
peak
6.36356675906e+10
/s
Zome call duration: 'timed::created_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.016137
s
SD
0.024054
s
p50
0.009743
s
<
p95
0.071803
s
<
p99
0.125471
s
Zome call duration: 'timed::get_timed_entries_local'
Duration of this zome call as measured by Holochain internally.
mean
0.663531
s
SD
1.008943
s
p50
0.612882
s
<
p95
2.804446
s
<
p99
5.340465
s
WASM call duration: 'timed::created_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.015062
s
SD
0.023465
s
p50
0.00881
s
<
p95
0.069688
s
<
p99
0.122023
s
WASM call duration: 'timed::get_timed_entries_local'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.662667
s
SD
1.008695
s
p50
0.611934
s
<
p95
2.80245
s
<
p99
5.338463
s
WASM call duration: 'timed_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001553
s
SD
0.000991
s
p50
0.001484
s
<
p95
0.003585
s
<
p99
0.005721
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.003579
s
SD
0.008952
s
p50
0.001058
s
<
p95
0.024472
s
<
p99
0.045857
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.003453
s
SD
0.008725
s
p50
0.001016
s
<
p95
0.024068
s
<
p99
0.044285
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.243121
s
SD
0.135256
s
p50
0.164358
s
<
p95
0.432223
s
<
p99
0.494299
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.013107
s
SD
0.016022
s
p50
0.011893
s
<
p95
0.05102
s
<
p99
0.063895
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.003106
s
SD
0.002506
s
p50
0.00267
s
<
p95
0.008602
s
<
p99
0.013131
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.00071
s
SD
0.000899
s
p50
0.000496
s
<
p95
0.002785
s
<
p99
0.004316
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
96.12
s
<
mean
909.87
s
SD
523.93
s
<
p95
1727.63
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
41471
over 38370.866902346s
mean rate
692930.34
/s
std
3.21126269e+06
/s
p5
9.7
/s
p95
2.28930859e+06
/s
peak
6.861032331e+07
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
40.086623
s
SD
27.106359
s
p50
15.978396
s
<
p95
83.885229
s
<
p99
111.064869
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.635456
s
SD
0.28098
s
p50
1.553504
s
<
p95
2.150142
s
<
p99
2.199765
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.446522
s
SD
16.516224
s
p50
2.999221
s
<
p95
52.611955
s
<
p99
68.171028
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001321
s
SD
0.00122
s
p50
0.000736
s
<
p95
0.00427
s
<
p99
0.004923
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.019912
s
SD
0.45055
s
p50
0.024351
s
<
p95
0.300575
s
<
p99
2.814685
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.21522
s
SD
0.143125
s
p50
0.148681
s
<
p95
0.414104
s
<
p99
0.669501
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.983754
s
SD
14.462369
s
p50
2.986925
s
<
p95
42.955637
s
<
p99
54.440921
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.725854
s
SD
23.597911
s
p50
1.693559
s
<
p95
40.5946
s
<
p99
120.816791
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.023527
s
SD
0.029588
s
p50
0.008625
s
<
p95
0.097086
s
<
p99
0.128558
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000992
s
SD
0.003323
s
p50
0.000543
s
<
p95
0.008996
s
<
p99
0.015725
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000291
s
SD
0.000184
s
p50
0.000305
s
<
p95
0.000704
s
<
p99
0.00098
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.011688
s
SD
0.012792
s
p50
0.000229
s
<
p95
0.039086
s
<
p99
0.054334
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.00012
s
SD
6.4e-05
s
p50
0.000103
s
<
p95
0.000267
s
<
p99
0.000337
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000168
s
SD
0.000177
s
p50
0.000163
s
<
p95
0.000598
s
<
p99
0.000973
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.004713
s
SD
0.012219
s
p50
0.001727
s
<
p95
0.032092
s
<
p99
0.048185
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00353
s
SD
0.008976
s
p50
0.000765
s
<
p95
0.025417
s
<
p99
0.043059
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.227251
s
SD
29.259885
s
p50
0.155294
s
<
p95
60.025832
s
<
p99
60.078572
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.282716
s
SD
6.149632
s
p50
0.293499
s
<
p95
10.144751
s
<
p99
26.985421
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
54.45
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.54
KiB/s
<
mean
1.02
MiB/s
SD
640.71
KiB/s
<
p95
2.02
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
188
B/s
<
mean
1.35
MiB/s
SD
1.15
MiB/s
<
p95
3.62
MiB/s
Total bytes received
Total bytes received on primary network interface
count
50.81
GiB
mean
27.82
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
67.12
GiB
mean
36.75
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 97.3%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 665.14 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 68% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
10.72
%
<
mean
65.6
%
SD
25.7
%
<
p95
96.44
%
System
11.15
%
CPU percentiles
CPU usage percentiles
p50
72.02
%
p95
96.44
%
p99
97.30
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
21
hosts
mean time
0.48
s
Memory used percentage
Percentage of memory used
p5
7.2
%
<
mean
14.99
%
SD
13.46
%
<
p95
37.42
%
Memory available percentage
Percentage of available memory
p5
62.58
%
<
mean
85.01
%
SD
13.46
%
<
p95
92.8
%
Max host memory used
Maximum memory usage percentage across all hosts
max
78.43
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.01
%
Memory growth rate
Rate of memory growth over time
growth
665.14
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.87
MiB/s
Disk write throughput
Disk write throughput in MiB/s
318.86
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/11
hosts
Mount Point /efi-boot
0/7
hosts
Mount Point /etc/hostname
0/5
hosts
Mount Point /etc/hosts
0/5
hosts
Mount Point /etc/resolv.conf
0/5
hosts
Mount Point /nix/store
0/11
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
5.48
5 min
4.76
15 min
3.27
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
67.86
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
29.9429
%
SD
22.2332
%
<
p95
70
%
60 second average
29.1487
%
300 second average
25.2668
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
13.2315
%
SD
17.942
%
<
p95
46.33
%
60 second average
12.8917
%
300 second average
11.2401
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
8.5431
%
SD
14.3522
%
<
p95
41.84
%
60 second average
8.3350
%
300 second average
7.3474
%
Holochain process CPU usage
CPU usage by Holochain process
p5
9.67
%
<
mean
59.26
%
SD
26.04
%
<
p95
94.91
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
244.55
KiB
<
mean
502.11
KiB
SD
166.32
KiB
<
p95
772.09
KiB
Holochain process threads
Number of threads in Holochain process
p5
17
threads
<
mean
45.33
threads
SD
15.76
threads
<
p95
75
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
65
file descriptors
<
mean
87.12
file descriptors
SD
16.05
file descriptors
<
p95
116
file descriptors

First Call

↑ Back to index

This scenario installs a simple app which implements the init callback, and measures the time elapsed between start of install and calling init. It will uninstall the app it installed so that it can re-install it on the next iteration. This is required to re-run the initialisation callback.

Started
Thu, 25 Jun 2026 01:13:15 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
first_call_28140184351_1
Zome call timing
The time elapsed between start of install and calling init.
mean
0.016416
s
SD
0.007722
s
p50
0.011862
s
<
p95
0.027418
s
<
p99
0.030429
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.005785937s
Not enough time data to show a trend.
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.005785937s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
3867136
over 280.005785937s
mean rate
13810.71
/s
std
19247.84
/s
p5
0
/s
p95
42285.82
/s
peak
42295.41
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006438
s
SD
0.000115
s
p50
0.006446
s
<
p95
0.006504
s
<
p99
0.006539
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005389
s
SD
0.00262
s
p50
0.003783
s
<
p95
0.00916
s
<
p99
0.009887
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000979
s
SD
0.000162
s
p50
0.000958
s
<
p95
0.001072
s
<
p99
0.001211
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001414
s
SD
1.6e-05
s
p50
0.001414
s
<
p95
0.001424
s
<
p99
0.001428
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000315
s
SD
0.000131
s
p50
0.00042
s
<
p95
0.000449
s
<
p99
0.000451
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002864
s
SD
5.6e-05
s
p50
0.002868
s
<
p95
0.00289
s
<
p99
0.002912
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000163
s
SD
5.4e-05
s
p50
0.000148
s
<
p95
0.000251
s
<
p99
0.000329
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.54
s
<
mean
148.54
s
SD
83.67
s
<
p95
278.54
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
6650
over 280.010745649s
mean rate
23.75
/s
std
33.1
/s
p5
0
/s
p95
72.26
/s
peak
72.29
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.00106
s
SD
0.000176
s
p50
0.001047
s
<
p95
0.001362
s
<
p99
0.001973
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000326
s
SD
3e-06
s
p50
0.000325
s
<
p95
0.000336
s
<
p99
0.00034
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000672
s
SD
6e-06
s
p50
0.00067
s
<
p95
0.000684
s
<
p99
0.000692
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.011901
s
SD
3.9e-05
s
p50
0.011902
s
<
p95
0.011911
s
<
p99
0.011917
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001
s
SD
1.1e-05
s
p50
0.001
s
<
p95
0.001003
s
≤
p99
0.001003
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000425
s
SD
2e-06
s
p50
0.000424
s
<
p95
0.000429
s
≤
p99
0.000429
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000219
s
SD
2e-06
s
p50
0.000219
s
<
p95
0.00022
s
≤
p99
0.00022
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000176
s
SD
4.1e-05
s
p50
0.000154
s
<
p95
0.000238
s
<
p99
0.000268
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
4.1e-05
s
SD
0
s
p50
4.1e-05
s
≤
p95
4.1e-05
s
≤
p99
4.1e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000193
s
SD
2.2e-05
s
p50
0.000187
s
<
p95
0.000198
s
≤
p99
0.000198
s
Cache DB connection use time
Time spent holding cache database connections.
mean
7.6e-05
s
SD
0
s
p50
7.6e-05
s
≤
p95
7.6e-05
s
≤
p99
7.6e-05
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
9.7e-05
s
SD
0
s
p50
9.7e-05
s
≤
p95
9.7e-05
s
≤
p99
9.7e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
7.4e-05
s
SD
1e-06
s
p50
7.4e-05
s
≤
p95
7.4e-05
s
≤
p99
7.4e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000662
s
SD
0.000106
s
p50
0.000397
s
<
p95
0.000593
s
<
p99
0.000815
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000235
s
SD
3e-06
s
p50
0.000235
s
<
p95
0.000236
s
≤
p99
0.000236
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
13.78
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
181
B/s
<
mean
46.26
KiB/s
SD
63.43
KiB/s
<
p95
138.49
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
39
B/s
<
mean
18.47
KiB/s
SD
25.13
KiB/s
<
p95
54.27
KiB/s
Total bytes received
Total bytes received on primary network interface
count
13.10
MiB
mean
46.26
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
5.23
MiB
mean
18.47
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1272.86 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
17.74
%
<
mean
18.64
%
SD
1.26
%
<
p95
19.98
%
System
4.87
%
CPU percentiles
CPU usage percentiles
p50
18.14
%
p95
19.98
%
p99
24.31
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
7.79
%
<
mean
14.72
%
SD
3.06
%
<
p95
16.75
%
Memory available percentage
Percentage of available memory
p5
83.25
%
<
mean
85.28
%
SD
3.06
%
<
p95
92.21
%
Max host memory used
Maximum memory usage percentage across all hosts
max
14.72
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1272.86
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
30.18
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /efi-boot
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.27
5 min
0.61
15 min
0.25
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.02
%
<
mean
0.334
%
SD
0.2334
%
<
p95
0.7
%
60 second average
0.2550
%
300 second average
0.0930
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.316
%
SD
0.2335
%
<
p95
0.7
%
60 second average
0.2363
%
300 second average
0.0860
%
Holochain process CPU usage
CPU usage by Holochain process
p5
12.72
%
<
mean
14.82
%
SD
2.82
%
<
p95
18.43
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
435.94
KiB
<
mean
1.56
MiB
SD
496.38
KiB
<
p95
1.86
MiB
Holochain process threads
Number of threads in Holochain process
p5
23
threads
<
mean
23.03
threads
SD
0.18
threads
≤
p95
23
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
49
file descriptors
<
mean
740.13
file descriptors
SD
825.45
file descriptors
<
p95
2145
file descriptors

Full-Arc Create (Validated) / Zero-Arc Read

↑ Back to index

A full-arc/zero-arc mixed scenario where full-arc nodes create data that gets validated and zero-arc nodes read the data. The scenario has two roles:

  • full: A full-arc conductor that creates entries with a timestamp field. Those entries get validated and then retrieved by zero-arc nodes.
  • zero: A zero-arc conductor that reads the entries created by the full-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Thu, 25 Jun 2026 04:57:09 UTC
Peer count
30
Peer count at end
27
Behaviours
  • full (1 agent)
  • zero (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
full_arc_create_validated_zero_arc_read--high_zero_28140184351_1
Create rate
The number of timed entries created by the full-arc node(s) per second.
Mean
mean
55.75
/s
Max
Highest per-partition mean rate
max
105.48
/s
Min
Lowest per-partition mean rate
min
6.01
/s
Fetch lag timing
For each entry, the time lag between when it was created by a full-arc node and when a zero-arc node fetched it from the network.
Mean
mean
238.050931
s
SD
82.182466
s
Max
Highest per-partition mean latency
max mean
1270.518735
s
Min
Lowest per-partition mean latency
min mean
45.728588
s
Fetch rate
The number of entries per second fetched by zero-arc nodes.
Mean
mean
5.18
/s
Max
Highest per-partition mean rate
max
11.33
/s
Min
Lowest per-partition mean rate
min
0
/s
Delivery ratio
The proportion of created entries successfully fetched by all zero-arc nodes.
0.1126
Entry created count
Total number of entries created by full-arc nodes, by agent.
Total
9983
Agents affected
2 / 2
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
4992
Max
Highest count in any single partition
9389
Min
Lowest count in any single partition
594
Received count
Total number of entries fetched by zero-arc nodes, by agent.
Total
29218
Agents affected
22 / 26
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
1124
Max
Highest count in any single partition
1496
Min
Lowest count in any single partition
0
Open connections
The number of currently open connections to other conductors.
full-arc
p5
25
≤
mean
24.55
SD
2.54
<
p95
25
zero-arc
p5
0
<
mean
10.3
SD
6.87
<
p95
20
Retrieval errors
Errors encountered by zero-arc nodes when attempting to retrieve entries created by full-arc nodes.
Total
169
Agents affected
24 / 26
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
7
Max
Highest count in any single partition
14
Min
Lowest count in any single partition
0
Error count
The number of errors accumulated across all nodes.
169
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000884
s
SD
0.000454
s
p50
0.00091
s
<
p95
0.001973
s
<
p99
0.002453
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
92
over 813.134386167s
mean rate
13.43
/s
std
32.97
/s
p5
0
/s
p95
92.74
/s
peak
209.22
/s
WASM usage: 'timed_and_validated::create_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
47921742
over 906.382177316s
mean rate
1.2555960809e+08
/s
std
5.543055662e+07
/s
p5
2.616573338e+07
/s
p95
2.0101641646e+08
/s
peak
2.0699101691e+08
/s
WASM usage: 'timed_and_validated::get_timed_entries_network'
Metered usage count of the WASM ribosome for this zome function.
total
8109585000
over 37470.773225868s
mean rate
4.85262366284e+10
/s
std
1.04155010888e+11
/s
p5
7.42495068e+06
/s
p95
2.63594520549e+11
/s
peak
6.17341337985e+11
/s
WASM usage: 'timed_and_validated_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
755251690
over 37470.773225868s
mean rate
1.2232139847e+08
/s
std
3.404218834e+08
/s
p5
3226.98
/s
p95
5.5435233231e+08
/s
peak
2.1024564942e+09
/s
WASM usage: 'timed_and_validated_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37470.773225868s
Not enough time data to show a trend.
Zome call duration: 'timed_and_validated::create_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005651
s
SD
0.003186
s
p50
0.006424
s
<
p95
0.012084
s
<
p99
0.012146
s
Zome call duration: 'timed_and_validated::get_timed_entries_network'
Duration of this zome call as measured by Holochain internally.
mean
0.051421
s
SD
0.164088
s
p50
0.092367
s
<
p95
0.362697
s
<
p99
0.588885
s
WASM call duration: 'timed_and_validated::create_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004971
s
SD
0.002812
s
p50
0.005602
s
<
p95
0.010669
s
<
p99
0.010728
s
WASM call duration: 'timed_and_validated::get_timed_entries_network'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.05627
s
SD
0.201774
s
p50
0.105109
s
<
p95
0.469374
s
<
p99
0.678805
s
WASM call duration: 'timed_and_validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000965
s
SD
0.000549
s
p50
0.001377
s
<
p95
0.002312
s
<
p99
0.003263
s
WASM call duration: 'timed_and_validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003046
s
SD
0.001152
s
p50
0.000821
s
<
p95
0.004728
s
<
p99
0.005178
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000286
s
SD
0.000211
s
p50
0.00032
s
<
p95
0.000713
s
<
p99
0.000719
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000286
s
SD
0.0002
s
p50
0.000338
s
<
p95
0.00071
s
<
p99
0.000715
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.005897
s
SD
0.094132
s
p50
0.009675
s
<
p95
0.268683
s
<
p99
0.402005
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.003894
s
SD
0.014169
s
p50
0.004377
s
<
p95
0.046665
s
<
p99
0.056961
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.000945
s
SD
0.000479
s
p50
0.000895
s
<
p95
0.002451
s
<
p99
0.002522
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001597
s
SD
0.000851
s
p50
0.00224
s
<
p95
0.00356
s
<
p99
0.005182
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000305
s
SD
0.000147
s
p50
0.00016
s
<
p95
0.000584
s
<
p99
0.000663
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.75
s
<
mean
450.38
s
SD
258.58
s
<
p95
855.77
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 37470.773079043s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
10.114565
s
SD
15.440575
s
p50
0.095993
s
<
p95
0.500025
s
<
p99
106.18104
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.113911
s
SD
0.083083
s
p50
1
s
<
p95
1.069652
s
<
p99
1.51478
s
App validation workflow duration
Time spent running the app validation workflow.
mean
1.562251
s
SD
5.157046
s
p50
0.00087
s
<
p95
1.249713
s
<
p99
32.455105
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001298
s
SD
0.001515
s
p50
0.000768
s
<
p95
0.004199
s
<
p99
0.007669
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.012777
s
SD
0.020217
s
p50
0.000698
s
<
p95
0.003552
s
<
p99
0.130884
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.088279
s
SD
0.017459
s
p50
0.001888
s
<
p95
0.022843
s
<
p99
0.11454
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.438527
s
SD
3.316865
s
p50
0.001006
s
<
p95
0.033481
s
<
p99
6.548625
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.446345
s
SD
0.290154
s
p50
0.00064
s
<
p95
0.244819
s
<
p99
1.933367
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000789
s
SD
0.001451
s
p50
0.000761
s
<
p95
0.001706
s
<
p99
0.009971
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000851
s
SD
0.000397
s
p50
0.000826
s
<
p95
0.001532
s
<
p99
0.001999
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
9.6e-05
s
SD
7.5e-05
s
p50
0.000137
s
<
p95
0.000323
s
<
p99
0.000441
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000834
s
SD
0.000445
s
p50
0.000844
s
<
p95
0.001818
s
<
p99
0.002264
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000123
s
SD
0.000136
s
p50
8.9e-05
s
<
p95
0.000236
s
<
p99
0.000802
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.00012
s
SD
4.7e-05
s
p50
0.000135
s
<
p95
0.00023
s
<
p99
0.000329
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001687
s
SD
0.157732
s
p50
0.000289
s
<
p95
0.387761
s
<
p99
1.007818
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000224
s
SD
0.000247
s
p50
0.000412
s
<
p95
0.00115
s
<
p99
0.001203
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.381283
s
SD
29.564191
s
p50
0.159383
s
<
p95
60.001669
s
<
p99
60.00281
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.233213
s
SD
19.355069
s
p50
0.280772
s
<
p95
60.001602
s
<
p99
60.001937
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
1.965659
s
SD
2.216778
s
p50
2.457222
s
<
p95
3.754912
s
<
p99
10.606321
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
13.09
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
967
B/s
<
mean
380.02
KiB/s
SD
577.22
KiB/s
<
p95
1.34
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
382
B/s
<
mean
590.81
KiB/s
SD
2.85
MiB/s
<
p95
2.26
MiB/s
Total bytes received
Total bytes received on primary network interface
count
9.09
GiB
mean
10.22
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
14.13
GiB
mean
15.89
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 192.79 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/6 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.95
%
<
mean
16.46
%
SD
15.73
%
<
p95
54.56
%
System
3.37
%
CPU percentiles
CPU usage percentiles
p50
12.37
%
p95
54.56
%
p99
64.01
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
6
hosts
mean time
0.01
s
Memory used percentage
Percentage of memory used
p5
7.57
%
<
mean
16.11
%
SD
13.88
%
<
p95
37.94
%
Memory available percentage
Percentage of available memory
p5
62.06
%
<
mean
83.89
%
SD
13.88
%
<
p95
92.43
%
Max host memory used
Maximum memory usage percentage across all hosts
max
78.62
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.17
%
Memory growth rate
Rate of memory growth over time
growth
192.79
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.03
MiB/s
Disk write throughput
Disk write throughput in MiB/s
39.16
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/11
hosts
Mount Point /efi-boot
0/7
hosts
Mount Point /etc/hostname
1/6
hosts
Mount Point /etc/hosts
1/6
hosts
Mount Point /etc/resolv.conf
1/6
hosts
Mount Point /nix/store
0/11
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.84
5 min
0.85
15 min
0.94
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.7432
%
SD
1.9148
%
<
p95
5.31
%
60 second average
0.8052
%
300 second average
1.3817
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
3.6408
%
SD
8.804
%
<
p95
20.46
%
60 second average
3.7807
%
300 second average
4.2918
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
3.3212
%
SD
7.7514
%
<
p95
20.15
%
60 second average
3.4661
%
300 second average
3.9789
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.22
%
<
mean
13.82
%
SD
14.28
%
<
p95
42.62
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
410.54
KiB
<
mean
501.71
KiB
SD
67.32
KiB
<
p95
600.40
KiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
<
mean
16.31
threads
SD
4.97
threads
<
p95
32
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
54
file descriptors
<
mean
62.5
file descriptors
SD
9.17
file descriptors
<
p95
81
file descriptors

Local Signals

↑ Back to index

This scenario is for testing the speed and reliability of local signals. It uses a zome with a function that will emit 10,000 signals. The scenario measures how long it takes to send the signals and how many have been received by the time the zome call ends.

Started
Thu, 25 Jun 2026 01:15:03 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
local_signals_28140184351_1
Send timing
The time taken to emit a batch of 10,000 signals.
mean
2.1273
s
SD
1.13037
s
p50
2.160301
s
<
p95
3.776516
s
≤
p99
3.776516
s
Receive timing
The time taken to receive the completed batch, to the nearest 250ms.
mean
27.313643
s
SD
8.062617
s
p50
30.001203
s
<
p95
30.001715
s
≤
p99
30.001715
s
Success ratio
The proportion of signals successfully received in a batch.
min
0.6395000219345093
<
mean
0.8798
SD
0.094
<
max
0.9962000250816344
Holochain MetricsClick to toggle visibility.
WASM usage: 'signal::emit_10k_signals'
Metered usage count of the WASM ribosome for this zome function.
total
268411976
over 280.002191521s
mean rate
958603.53
/s
std
1.51568526e+06
/s
p5
0
/s
p95
3.35512453e+06
/s
peak
3.35513526e+06
/s
Zome call duration: 'signal::emit_10k_signals'
Duration of this zome call as measured by Holochain internally.
mean
0.224421
s
SD
0.004511
s
p50
0.224029
s
<
p95
0.230245
s
≤
p99
0.230245
s
WASM call duration: 'signal::emit_10k_signals'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.223145
s
SD
0.004542
s
p50
0.222831
s
<
p95
0.228914
s
≤
p99
0.228914
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
1.7e-05
s
SD
0
s
p50
1.7e-05
s
≤
p95
1.7e-05
s
≤
p99
1.7e-05
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
80000
over 280.00218765s
mean rate
285.71
/s
std
451.75
/s
p5
0
/s
p95
999.99
/s
peak
1000
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000126
s
SD
0
s
p50
0.000126
s
≤
p95
0.000126
s
≤
p99
0.000126
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.22
s
<
mean
148.22
s
SD
83.67
s
<
p95
278.22
s
Dropped WebSocket signals
Count of signals dropped from the app WebSocket due to channel overload.
total
1676
over 280.002191891s
mean rate
5.99
/s
std
12.59
/s
p5
0
/s
p95
29.7
/s
peak
53.1
/s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.002201962s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.081089
s
SD
0
s
p50
0.081089
s
≤
p95
0.081089
s
≤
p99
0.081089
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001011
s
SD
0
s
p50
0.001011
s
≤
p95
0.001011
s
≤
p99
0.001011
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.00392
s
SD
0
s
p50
0.00392
s
≤
p95
0.00392
s
≤
p99
0.00392
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.002343
s
SD
0
s
p50
0.002343
s
≤
p95
0.002343
s
≤
p99
0.002343
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001633
s
SD
0.000132
s
p50
0.001704
s
<
p95
0.001835
s
≤
p99
0.001835
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.00325
s
SD
0
s
p50
0.00325
s
≤
p95
0.00325
s
≤
p99
0.00325
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001214
s
SD
0
s
p50
0.001214
s
≤
p95
0.001214
s
≤
p99
0.001214
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000193
s
SD
1.7e-05
s
p50
0.000189
s
<
p95
0.000241
s
≤
p99
0.000241
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
5.1e-05
s
SD
0
s
p50
5.1e-05
s
≤
p95
5.1e-05
s
≤
p99
5.1e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000238
s
SD
3e-05
s
p50
0.000238
s
<
p95
0.000306
s
<
p99
0.000322
s
Cache DB connection use time
Time spent holding cache database connections.
mean
6.3e-05
s
SD
0
s
p50
6.3e-05
s
≤
p95
6.3e-05
s
≤
p99
6.3e-05
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8e-05
s
SD
0
s
p50
8e-05
s
≤
p95
8e-05
s
≤
p99
8e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.00012
s
SD
2.5e-05
s
p50
0.000104
s
<
p95
0.00014
s
<
p99
0.000143
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00011
s
SD
0.009749
s
p50
0.000187
s
<
p95
0.02471
s
≤
p99
0.02471
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000286
s
SD
0
s
p50
0.000286
s
≤
p95
0.000286
s
≤
p99
0.000286
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
3.70
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
991
B/s
<
mean
240.58
KiB/s
SD
1.17
MiB/s
≤
p95
26.45
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
71
B/s
<
mean
20.40
KiB/s
SD
23.93
KiB/s
<
p95
29.42
KiB/s
Total bytes received
Total bytes received on primary network interface
count
68.13
MiB
mean
240.58
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
5.78
MiB
mean
20.40
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 645.96 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
34.88
%
<
mean
40.35
%
SD
6.4
%
<
p95
50.76
%
System
36.65
%
CPU percentiles
CPU usage percentiles
p50
37.45
%
p95
50.76
%
p99
63.76
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
11.4
%
<
mean
15.57
%
SD
3.02
%
<
p95
20.25
%
Memory available percentage
Percentage of available memory
p5
79.75
%
<
mean
84.43
%
SD
3.02
%
<
p95
88.6
%
Max host memory used
Maximum memory usage percentage across all hosts
max
15.57
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
645.96
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.04
MiB/s
Disk write throughput
Disk write throughput in MiB/s
1.78
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.61
5 min
1.97
15 min
1.58
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
1.09
%
<
mean
5.172
%
SD
3.4382
%
<
p95
10.89
%
60 second average
4.1913
%
300 second average
1.8913
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0357
%
SD
0.1303
%
<
p95
0.25
%
60 second average
0.0377
%
300 second average
0.0127
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.025
%
SD
0.0927
%
<
p95
0.18
%
60 second average
0.0247
%
300 second average
0.0060
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.07
%
<
mean
2.09
%
SD
2.69
%
<
p95
2.62
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
177.13
KiB
<
mean
235.77
KiB
SD
24.92
KiB
<
p95
263.65
KiB
Holochain process threads
Number of threads in Holochain process
p5
14
threads
<
mean
16.6
threads
SD
1.87
threads
<
p95
18
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
45
file descriptors
<
mean
60.13
file descriptors
SD
11.47
file descriptors
<
p95
82
file descriptors

Mixed Arc get_agent_activity

↑ Back to index

A mixed-arc scenario that measures the DHT's ability to propagate agent activity and make it available via get_agent_activity calls. The scenario has three roles:

  • zero_write: A zero-arc conductor that creates entries on its source chain.
  • full_write: A full-arc conductor that creates entries on its source chain.
  • zero_read: A zero-arc conductor that picks a random writer and repeatedly calls get_agent_activity to observe new entries appearing on the writer's chain, measuring the lag between creation and discovery.
Started
Thu, 25 Jun 2026 05:12:55 UTC
Peer count
30
Peer count at end
25
Behaviours
  • full_write (1 agent)
  • zero_read (1 agent)
  • zero_write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
mixed_arc_get_agent_activity_28140184351_1
Entry created count
The total number of entries created by write agents over the run, partitioned by agent and behaviour.
Total
212292
Agents affected
18 / 18
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
11794
Max
Highest count in any single partition
32917
Min
Lowest count in any single partition
1578
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
10639.5
Max
Highest chain head value observed for any single write agent.
11196
Write agents observed
2
Chain head delay timing
The time lag between when a writer creates a new entry and when a reader discovers it via get_agent_activity. This is measured per new action in the chain.
Mean
mean
0.011242
s
SD
0.185645
s
Max
Highest per-partition mean latency
max mean
0.058331
s
Min
Lowest per-partition mean latency
min mean
0.002306
s
Chain head delay rate
The rate at which readers detect new chain heads appearing on writers' chains.
Mean
mean
46.03
/s
Max
Highest per-partition mean rate
max
63.66
/s
Min
Lowest per-partition mean rate
min
10.25
/s
get_agent_activity_full zome call timing
The time taken to complete the get_agent_activity_full zome call that queries a writer's chain.
Mean
mean
0.244401
s
SD
0.263214
s
Max
Highest per-partition mean latency
max mean
0.80339
s
Min
Lowest per-partition mean latency
min mean
0.122112
s
Retrieval errors
A running accumulation of errors encountered by read agents when calling get_agent_activity.
Total
18
Agents affected
7 / 8
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
2
Max
Highest count in any single partition
6
Min
Lowest count in any single partition
0
Open connections
The number of currently open connections to other conductors, partitioned by agent behaviour.
  • behaviour: full_write
p5
21
<
mean
24.51
SD
1.96
<
p95
25
  • behaviour: zero_read
p5
11
<
mean
16.29
SD
3.68
<
p95
24
  • behaviour: zero_write
p5
0
<
mean
15.41
SD
6.51
<
p95
23
Final error count
The total number of errors accumulated across all agents over the run.
19
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.00053
s
SD
0.000177
s
p50
0.000674
s
<
p95
0.000867
s
≤
p99
0.000867
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 800.089038154s
Not enough time data to show a trend.
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.008478
s
SD
0.003738
s
p50
0.008203
s
<
p95
0.018442
s
≤
p99
0.018442
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004998
s
SD
0.003564
s
p50
0.005801
s
<
p95
0.017905
s
<
p99
0.018982
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.13856
s
SD
0.160976
s
p50
0.115971
s
<
p95
0.638015
s
<
p99
0.759153
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.027936
s
SD
0.113678
s
p50
0.039735
s
<
p95
0.375763
s
≤
p99
0.375763
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00707
s
SD
0.003183
s
p50
0.006929
s
<
p95
0.016072
s
≤
p99
0.016072
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004148
s
SD
0.00301
s
p50
0.004786
s
<
p95
0.015006
s
<
p99
0.015892
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.15809
s
SD
0.162307
s
p50
0.141529
s
<
p95
0.637045
s
<
p99
0.818274
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.026911
s
SD
0.113806
s
p50
0.038014
s
<
p95
0.375224
s
≤
p99
0.375224
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001227
s
SD
0.000654
s
p50
0.001352
s
<
p95
0.00285
s
<
p99
0.003331
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
6.7e-05
s
SD
9.7e-05
s
p50
4e-05
s
<
p95
0.00046
s
≤
p99
0.00046
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000509
s
SD
0.000649
s
p50
0.000539
s
<
p95
0.002654
s
<
p99
0.003216
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000576
s
SD
0.000204
s
p50
0.000567
s
<
p95
0.000979
s
≤
p99
0.000979
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.152524
s
SD
0.162658
s
p50
0.136038
s
<
p95
0.633789
s
<
p99
0.814779
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.021919
s
SD
0.114418
s
p50
0.031038
s
<
p95
0.372829
s
≤
p99
0.372829
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1.3e-05
s
SD
6e-06
s
p50
1.5e-05
s
<
p95
2.7e-05
s
≤
p99
2.7e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002269
s
SD
0.00188
s
p50
0.002858
s
<
p95
0.005487
s
<
p99
0.011156
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000354
s
SD
0.000367
s
p50
0.000244
s
<
p95
0.000764
s
<
p99
0.002045
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.79
s
<
mean
451.79
s
SD
259.48
s
<
p95
857.59
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 37469.909140044s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
21.477769
s
SD
10.006653
s
p50
0.122157
s
<
p95
30.069194
s
<
p99
35.422698
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.591153
s
SD
0.286925
s
p50
1
s
<
p95
1.654193
s
<
p99
1.707474
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.055317
s
SD
1.404026
s
p50
0.000641
s
<
p95
0.444669
s
<
p99
7.188773
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000968
s
SD
0.000739
s
p50
0.000757
s
<
p95
0.002154
s
<
p99
0.004036
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.012278
s
SD
0.015203
s
p50
0.000632
s
<
p95
0.043718
s
<
p99
0.055334
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.084518
s
SD
5.019536
s
p50
0.042351
s
<
p95
14.017904
s
<
p99
29.70651
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.105502
s
SD
1.036035
s
p50
0.001609
s
<
p95
0.405569
s
<
p99
2.331364
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
1.287796
s
SD
11.025748
s
p50
0.001043
s
<
p95
18.334999
s
<
p99
65.350751
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.002847
s
SD
0.002853
s
p50
0.000733
s
<
p95
0.008051
s
<
p99
0.013844
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002201
s
SD
0.001969
s
p50
0.000181
s
<
p95
0.005317
s
<
p99
0.00954
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000242
s
SD
0.000238
s
p50
0.000226
s
<
p95
0.000704
s
<
p99
0.001318
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.00022
s
SD
0.000247
s
p50
0.000241
s
<
p95
0.000741
s
<
p99
0.001352
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000169
s
SD
0.00025
s
p50
9e-05
s
<
p95
0.000431
s
<
p99
0.001383
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000192
s
SD
0.000143
s
p50
0.000168
s
<
p95
0.000366
s
<
p99
0.000801
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003284
s
SD
0.0123
s
p50
0.000552
s
<
p95
0.026166
s
<
p99
0.06657
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000488
s
SD
0.000388
s
p50
0.000389
s
<
p95
0.000948
s
<
p99
0.002314
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
2.947013
s
SD
29.664087
s
p50
0.137874
s
<
p95
60.001695
s
<
p99
60.001865
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.087149
s
SD
0.083908
s
p50
0.088478
s
<
p95
0.293499
s
≤
p99
0.293499
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.193769
s
SD
28.092468
s
p50
0.175058
s
<
p95
60.001743
s
<
p99
60.001863
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.159707
s
SD
0.473218
s
p50
0.152952
s
<
p95
0.374694
s
<
p99
0.421036
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
26.73
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.25
KiB/s
<
mean
535.98
KiB/s
SD
571.70
KiB/s
<
p95
1.58
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
204
B/s
<
mean
712.99
KiB/s
SD
1.11
MiB/s
<
p95
3.18
MiB/s
Total bytes received
Total bytes received on primary network interface
count
12.88
GiB
mean
14.18
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
17.13
GiB
mean
18.87
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 95.5%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 569.38 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/6 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 14% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.88
%
<
mean
33.71
%
SD
33.83
%
<
p95
93.67
%
System
6.99
%
CPU percentiles
CPU usage percentiles
p50
25.35
%
p95
93.67
%
p99
95.50
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
8
hosts
mean time
0.64
s
Memory used percentage
Percentage of memory used
p5
6.09
%
<
mean
14.1
%
SD
13.98
%
<
p95
33.61
%
Memory available percentage
Percentage of available memory
p5
66.39
%
<
mean
85.9
%
SD
13.98
%
<
p95
93.91
%
Max host memory used
Maximum memory usage percentage across all hosts
max
78.02
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.17
%
Memory growth rate
Rate of memory growth over time
growth
569.38
MiB/s
Disk read throughput
Disk read throughput in MiB/s
1.58
MiB/s
Disk write throughput
Disk write throughput in MiB/s
151.58
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/11
hosts
Mount Point /efi-boot
0/7
hosts
Mount Point /etc/hostname
1/6
hosts
Mount Point /etc/hosts
1/6
hosts
Mount Point /etc/resolv.conf
1/6
hosts
Mount Point /nix/store
0/11
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.83
5 min
2.26
15 min
1.60
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
14.29
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
13.809
%
SD
20.4875
%
<
p95
57.7
%
60 second average
12.9373
%
300 second average
9.7317
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
10.7738
%
SD
17.1415
%
<
p95
45.73
%
60 second average
10.4031
%
300 second average
8.5523
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
9.0102
%
SD
15.3548
%
<
p95
44.86
%
60 second average
8.7338
%
300 second average
7.2801
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.18
%
<
mean
30.41
%
SD
31.81
%
<
p95
91.94
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
214.52
KiB
<
mean
308.05
KiB
SD
113.91
KiB
<
p95
503.50
KiB
Holochain process threads
Number of threads in Holochain process
p5
11
threads
<
mean
23.62
threads
SD
13
threads
<
p95
50
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
47
file descriptors
<
mean
66.34
file descriptors
SD
16.74
file descriptors
<
p95
100
file descriptors

Mixed Arc must_get_agent_activity

↑ Back to index

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Write Validated must_get_agent_activity, but some write agents are zero-arc and all must_get_agent_activity agents are zero-arc. This forces the must_get_agent_activity host call to go to the network.

Started
Thu, 25 Jun 2026 05:28:45 UTC
Peer count
30
Peer count at end
25
Behaviours
  • full_write (1 agent)
  • zero_must_get_agent_activity (1 agent)
  • zero_write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
mixed_arc_must_get_agent_activity_28140184351_1
Highest observed action_seq
The maximum chain length observed per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1847.5
Max
Highest chain head value observed for any single write agent.
1886
Write agents observed
2
Chain batch delay timing
The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.
Mean
mean
119.028914
s
SD
12.16662
s
Max
Highest per-partition mean latency
max mean
1011.48425
s
Min
Lowest per-partition mean latency
min mean
3.697646
s
Chain batch delay rate
The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.
Mean
mean
2.19
/s
Max
Highest per-partition mean rate
max
2.83
/s
Min
Lowest per-partition mean rate
min
1.88
/s
create_validated_sample_entry zome call timing
The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.
Mean
mean
0.324148
s
SD
0.269867
s
Max
Highest per-partition mean latency
max mean
0.614462
s
Min
Lowest per-partition mean latency
min mean
0.196656
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.
Total
4405
Agents affected
9 / 9
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
489
Max
Highest count in any single partition
679
Min
Lowest count in any single partition
129
Open connections
The average number of open connections maintained by an agent over the run, broken down by behaviour.
  • behaviour: full_write
p5
23
<
mean
24.6
SD
1.4
<
p95
25
  • behaviour: zero_must_get_agent_activity
p5
0
<
mean
12.54
SD
5.69
<
p95
20
  • behaviour: zero_write
p5
10
<
mean
14.95
SD
3.43
<
p95
20
Final error count
The total number of all types of error accumulated over the run by all agents.
28252
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000883
s
SD
0.000307
s
p50
0.000685
s
<
p95
0.001275
s
<
p99
0.001352
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 390.004650075s
Not enough time data to show a trend.
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.008642
s
SD
0.002871
s
p50
0.00876
s
<
p95
0.013106
s
≤
p99
0.013106
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.072598
s
SD
0.017792
s
p50
0.063442
s
<
p95
0.10537
s
<
p99
0.127704
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.007654
s
SD
0.002061
s
p50
0.007913
s
<
p95
0.010973
s
<
p99
0.011002
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.102701
s
SD
0.04559
s
p50
0.116115
s
<
p95
0.155824
s
<
p99
0.178351
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.024212
s
SD
0.070586
s
p50
0.061609
s
<
p95
0.222937
s
≤
p99
0.222937
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.007233
s
SD
0.002386
s
p50
0.007347
s
<
p95
0.010857
s
≤
p99
0.010857
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.071252
s
SD
0.017544
s
p50
0.062232
s
<
p95
0.103355
s
<
p99
0.125418
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006357
s
SD
0.001784
s
p50
0.00662
s
<
p95
0.009233
s
<
p99
0.009258
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.136455
s
SD
0.065757
s
p50
0.135637
s
<
p95
0.289293
s
<
p99
0.330896
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.02328
s
SD
0.070619
s
p50
0.060642
s
<
p95
0.222021
s
≤
p99
0.222021
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001457
s
SD
0.000658
s
p50
0.00162
s
<
p95
0.002906
s
<
p99
0.003316
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.007051
s
SD
0.024639
s
p50
0.00414
s
<
p95
0.069148
s
<
p99
0.111288
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.6e-05
s
SD
1.3e-05
s
p50
3.9e-05
s
<
p95
6.9e-05
s
<
p99
7.4e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000538
s
SD
0.000135
s
p50
0.000514
s
<
p95
0.000841
s
<
p99
0.00093
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000527
s
SD
0.00018
s
p50
0.000537
s
<
p95
0.000992
s
<
p99
0.001031
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.122187
s
SD
0.074724
s
p50
0.121164
s
<
p95
0.241034
s
<
p99
0.317092
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.167048
s
SD
0.066783
s
p50
0.127258
s
<
p95
0.317355
s
<
p99
0.329493
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.008553
s
SD
0.004147
s
p50
0.006235
s
<
p95
0.013931
s
<
p99
0.020905
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1.1e-05
s
SD
3e-06
s
p50
1.1e-05
s
<
p95
1.6e-05
s
≤
p99
1.6e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00248
s
SD
0.001081
s
p50
0.002959
s
<
p95
0.005266
s
<
p99
0.005516
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000302
s
SD
0.000211
s
p50
0.000197
s
<
p95
0.000748
s
<
p99
0.001075
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
48.16
s
<
mean
453.31
s
SD
260.26
s
<
p95
858.51
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
4
over 37469.123414017s
mean rate
65055.32
/s
std
230169.34
/s
p5
0
/s
p95
474175.51
/s
peak
1.73114586e+06
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
22.846128
s
SD
26.048088
s
p50
0.098663
s
<
p95
75.033665
s
<
p99
127.459749
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.838747
s
SD
0.368099
s
p50
1
s
<
p95
1.867501
s
<
p99
1.873127
s
App validation workflow duration
Time spent running the app validation workflow.
mean
1.209387
s
SD
17.535444
s
p50
0.000627
s
<
p95
38.639933
s
<
p99
99.234382
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000914
s
SD
0.000586
s
p50
0.000631
s
<
p95
0.002212
s
<
p99
0.002565
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.01675
s
SD
0.009848
s
p50
0.000291
s
<
p95
0.032654
s
<
p99
0.040023
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.019599
s
SD
0.025506
s
p50
0.013292
s
<
p95
0.063817
s
<
p99
0.124951
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.228359
s
SD
0.124105
s
p50
0.001351
s
<
p95
0.277741
s
<
p99
0.356037
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
10.738215
s
SD
8.17751
s
p50
0.000605
s
<
p95
25.184742
s
<
p99
35.870705
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000426
s
SD
0.000226
s
p50
0.000374
s
<
p95
0.00089
s
<
p99
0.001249
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000928
s
SD
0.000494
s
p50
0.000273
s
<
p95
0.001341
s
<
p99
0.002945
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000203
s
SD
6.2e-05
s
p50
0.000182
s
<
p95
0.000288
s
<
p99
0.000508
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000373
s
SD
0.000306
s
p50
0.000194
s
<
p95
0.001004
s
<
p99
0.00117
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
9.9e-05
s
SD
4.9e-05
s
p50
8.4e-05
s
<
p95
0.000251
s
<
p99
0.000262
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000137
s
SD
6.6e-05
s
p50
0.000131
s
<
p95
0.000224
s
<
p99
0.000372
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002524
s
SD
0.182415
s
p50
0.000351
s
<
p95
0.39884
s
<
p99
1.087676
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000323
s
SD
0.00012
s
p50
0.00041
s
<
p95
0.00061
s
<
p99
0.000738
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.098875
s
SD
14.353104
s
p50
0.107952
s
<
p95
60.001056
s
<
p99
60.001221
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.093816
s
SD
16.860405
s
p50
0.108487
s
<
p95
60.00125
s
<
p99
60.001372
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
0.169038
s
SD
17.063327
s
p50
0.128839
s
<
p95
60.000997
s
<
p99
60.001571
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.742472
s
SD
0.687081
s
p50
0.611271
s
<
p95
1.045656
s
<
p99
1.272325
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
7.17
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.11
KiB/s
<
mean
94.35
KiB/s
SD
258.35
KiB/s
<
p95
295.59
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
378
B/s
<
mean
118.81
KiB/s
SD
296.29
KiB/s
<
p95
712.15
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.27
GiB
mean
2.53
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.86
GiB
mean
3.19
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 205.68 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/5 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 4% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.97
%
<
mean
10.82
%
SD
15.91
%
<
p95
43.28
%
System
3.65
%
CPU percentiles
CPU usage percentiles
p50
3.84
%
p95
43.28
%
p99
78.29
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
6
hosts
mean time
0.04
s
Memory used percentage
Percentage of memory used
p5
7.57
%
<
mean
12.5
%
SD
5.43
%
<
p95
17.33
%
Memory available percentage
Percentage of available memory
p5
82.67
%
<
mean
87.5
%
SD
5.43
%
<
p95
92.43
%
Max host memory used
Maximum memory usage percentage across all hosts
max
34.32
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.17
%
Memory growth rate
Rate of memory growth over time
growth
205.68
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
57.16
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/13
hosts
Mount Point /efi-boot
0/8
hosts
Mount Point /etc/hostname
1/5
hosts
Mount Point /etc/hosts
1/5
hosts
Mount Point /etc/resolv.conf
1/5
hosts
Mount Point /nix/store
0/13
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.78
5 min
1.21
15 min
1.46
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
3.57
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
2.3803
%
SD
7.6537
%
<
p95
14
%
60 second average
2.6917
%
300 second average
4.5953
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
4.9798
%
SD
11.7634
%
<
p95
38.17
%
60 second average
5.2460
%
300 second average
6.5771
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
4.5993
%
SD
10.9239
%
<
p95
35.24
%
60 second average
4.8104
%
300 second average
5.8059
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.18
%
<
mean
8.24
%
SD
14.57
%
<
p95
40.13
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
438.37
KiB
<
mean
499.59
KiB
SD
60.99
KiB
<
p95
588.33
KiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
<
mean
20.21
threads
SD
9.59
threads
<
p95
37
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
45
file descriptors
<
mean
67.5
file descriptors
SD
14.4
file descriptors
<
p95
104
file descriptors

Remote Call Rate

↑ Back to index

Test the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

Started
Thu, 25 Jun 2026 01:16:41 UTC
Peer count
10
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
remote_call_rate_28140184351_1
Dispatch timing
The time between sending a remote call and the remote handler being invoked.
Mean
mean
0.046775
s
SD
0.060792
s
Max
Highest per-partition mean latency
max mean
0.089122
s
Min
Lowest per-partition mean latency
min mean
0.030945
s
Round-trip timing
The total elapsed time to get a response to the client.
Mean
mean
0.093342
s
SD
0.080704
s
Max
Highest per-partition mean latency
max mean
0.178871
s
Min
Lowest per-partition mean latency
min mean
0.066636
s
Error count
The total number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_call::call_echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
355920060
over 896.64589292s
mean rate
2.634241015e+07
/s
std
4.213750076e+07
/s
p5
1.23476075e+06
/s
p95
1.2654815642e+08
/s
peak
1.9520711585e+08
/s
WASM usage: 'remote_call::echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
70130772
over 897.89560085s
mean rate
2.71428956e+06
/s
std
5.8945703e+06
/s
p5
10649.13
/s
p95
1.876611116e+07
/s
peak
2.505183746e+07
/s
WASM usage: 'remote_call::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 897.89560085s
Not enough time data to show a trend.
Zome call duration: 'remote_call::call_echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.091201
s
SD
0.030596
s
p50
0.091188
s
<
p95
0.172869
s
<
p99
0.174807
s
Zome call duration: 'remote_call::echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.003223
s
SD
0.001108
s
p50
0.002763
s
<
p95
0.005332
s
<
p99
0.005627
s
WASM call duration: 'remote_call::call_echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.089983
s
SD
0.030632
s
p50
0.090099
s
<
p95
0.171869
s
<
p99
0.173808
s
WASM call duration: 'remote_call::echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002079
s
SD
0.000702
s
p50
0.001817
s
<
p95
0.003387
s
<
p99
0.003586
s
WASM call duration: 'remote_call::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001886
s
SD
0.000397
s
p50
0.00189
s
<
p95
0.002766
s
≤
p99
0.002766
s
Host function call duration: '__hc__call_1'
Duration of this host function call invoked from within WASM.
mean
0.087445
s
SD
0.03062
s
p50
0.087742
s
<
p95
0.169611
s
<
p99
0.17156
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000287
s
SD
8.8e-05
s
p50
0.000243
s
<
p95
0.000451
s
≤
p99
0.000451
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
1.8e-05
s
SD
8e-06
s
p50
1.8e-05
s
<
p95
3.6e-05
s
<
p99
4e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000394
s
SD
0.00019
s
p50
0.000336
s
<
p95
0.000936
s
≤
p99
0.000936
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000233
s
SD
6.5e-05
s
p50
0.000222
s
<
p95
0.000326
s
≤
p99
0.000326
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.64
s
<
mean
449.35
s
SD
257.89
s
<
p95
848.36
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
71
over 897.89552022s
mean rate
7.92
/s
std
39.25
/s
p5
0
/s
p95
45.57
/s
peak
335.38
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
2.725352
s
SD
0.759359
s
p50
2.661921
s
<
p95
3.583237
s
<
p99
4.640696
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.952002
s
SD
0.030071
s
p50
1.949495
s
<
p95
1.974359
s
≤
p99
1.974359
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.178912
s
SD
0.24182
s
p50
0.37659
s
<
p95
0.65036
s
<
p99
1.39731
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001464
s
SD
0.000884
s
p50
0.001135
s
<
p95
0.003141
s
≤
p99
0.003141
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.002337
s
SD
0.002102
s
p50
0.00157
s
<
p95
0.007286
s
<
p99
0.008166
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.002018
s
SD
0.000761
s
p50
0.001883
s
<
p95
0.003544
s
<
p99
0.003617
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.597848
s
SD
0.384115
s
p50
0.633672
s
<
p95
1.311813
s
<
p99
1.725685
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.380854
s
SD
0.44015
s
p50
0.2453
s
<
p95
1.284216
s
<
p99
2.304236
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.00023
s
SD
7.5e-05
s
p50
0.000192
s
<
p95
0.000387
s
<
p99
0.000406
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000104
s
SD
3.1e-05
s
p50
9.5e-05
s
<
p95
0.00018
s
<
p99
0.000201
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000209
s
SD
7.3e-05
s
p50
0.000175
s
<
p95
0.000351
s
<
p99
0.00037
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000307
s
SD
0.000162
s
p50
0.000222
s
<
p95
0.000593
s
<
p99
0.000799
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000149
s
SD
8e-05
s
p50
0.000108
s
<
p95
0.000351
s
≤
p99
0.000351
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000196
s
SD
6.8e-05
s
p50
0.000172
s
<
p95
0.000341
s
<
p99
0.000356
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000383
s
SD
0.009029
s
p50
0.000574
s
<
p95
0.02717
s
<
p99
0.029269
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000413
s
SD
0.000132
s
p50
0.000355
s
<
p95
0.000654
s
<
p99
0.000722
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.061505
s
SD
0.042028
s
p50
0.051724
s
<
p95
0.137015
s
<
p99
0.14653
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.091569
s
SD
0.030936
s
p50
0.08548
s
<
p95
0.161416
s
<
p99
0.183009
s
P2P request roundtrip: 'call_remote'
Time spent sending a call_remote request and awaiting its response.
mean
0.086887
s
SD
0.030639
s
p50
0.087194
s
<
p95
0.169147
s
<
p99
0.171097
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
6.16
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
16.49
KiB/s
<
mean
71.72
KiB/s
SD
515.32
KiB/s
≤
p95
35.07
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
20.41
KiB/s
<
mean
26.39
KiB/s
SD
10.47
KiB/s
<
p95
34.23
KiB/s
Total bytes received
Total bytes received on primary network interface
count
562.43
MiB
mean
639.93
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
206.92
MiB
mean
235.42
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 376.69 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
4.8
%
<
mean
12.83
%
SD
12.71
%
<
p95
39.94
%
System
6.67
%
CPU percentiles
CPU usage percentiles
p50
7.24
%
p95
39.94
%
p99
50.12
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.01
s
Memory used percentage
Percentage of memory used
p5
5.62
%
<
mean
14.2
%
SD
6.6
%
<
p95
29.42
%
Memory available percentage
Percentage of available memory
p5
70.58
%
<
mean
85.8
%
SD
6.6
%
<
p95
94.38
%
Max host memory used
Maximum memory usage percentage across all hosts
max
29.36
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
376.69
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.16
MiB/s
Disk write throughput
Disk write throughput in MiB/s
8.16
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/3
hosts
Mount Point /efi-boot
0/2
hosts
Mount Point /nix/store
0/3
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.65
5 min
0.54
15 min
0.36
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
1.169
%
SD
2.7962
%
<
p95
3.35
%
60 second average
1.1445
%
300 second average
0.9222
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.7674
%
SD
1.7635
%
<
p95
3.45
%
60 second average
0.7198
%
300 second average
0.5667
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.7117
%
SD
1.6422
%
<
p95
3.14
%
60 second average
0.6671
%
300 second average
0.5241
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.7
%
<
mean
5.74
%
SD
7.48
%
<
p95
30.68
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
165.54
KiB
<
mean
214.47
KiB
SD
97.11
KiB
<
p95
235.48
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
17.67
threads
SD
3.38
threads
<
p95
23
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
49
file descriptors
<
mean
66.37
file descriptors
SD
127.3
file descriptors
<
p95
81
file descriptors

Remote Signals

↑ Back to index

This scenario tests the throughput of remote_signals operations.

Started
Thu, 25 Jun 2026 01:18:34 UTC
Peer count
10
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
remote_signals_28140184351_1
Round trip time
The time from origin signal dispatch to origin receive of the remote side's response signal.
mean
0.105278
s
SD
0.163545
s
p50
0.114957
s
<
p95
0.212028
s
<
p99
0.218336
s
Timeout rate
The proportion of remote signal round-trips that timed out.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_signal::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 891.866693237s
Not enough time data to show a trend.
WASM usage: 'remote_signal::recv_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
36932422
over 891.866693237s
mean rate
3.9626937572e+08
/s
std
2.26914166616e+09
/s
p5
0
/s
p95
1.12608372554e+09
/s
peak
4.14518686297e+10
/s
WASM usage: 'remote_signal::signal_request'
Metered usage count of the WASM ribosome for this zome function.
total
15592653
over 891.866693237s
mean rate
5.8525764099e+08
/s
std
9.64762267372e+09
/s
p5
0
/s
p95
4.798196882e+07
/s
peak
2.2050617284e+11
/s
Zome call duration: 'remote_signal::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.003433
s
SD
0.000731
s
p50
0.002989
s
<
p95
0.004475
s
<
p99
0.004502
s
Zome call duration: 'remote_signal::signal_request'
Duration of this zome call as measured by Holochain internally.
mean
0.003423
s
SD
0.000745
s
p50
0.002932
s
<
p95
0.004566
s
<
p99
0.004626
s
WASM call duration: 'remote_signal::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001792
s
SD
0.000356
s
p50
0.001637
s
<
p95
0.002444
s
≤
p99
0.002444
s
WASM call duration: 'remote_signal::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002236
s
SD
0.000461
s
p50
0.001952
s
<
p95
0.002852
s
<
p99
0.00287
s
WASM call duration: 'remote_signal::signal_request'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00221
s
SD
0.00046
s
p50
0.001992
s
<
p95
0.00282
s
<
p99
0.002855
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000313
s
SD
0.000172
s
p50
0.000255
s
<
p95
0.000808
s
≤
p99
0.000808
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
7e-05
s
SD
2e-05
s
p50
6.1e-05
s
<
p95
0.000102
s
<
p99
0.000103
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
7.6e-05
s
SD
2.7e-05
s
p50
6.8e-05
s
<
p95
0.000128
s
<
p99
0.000146
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
1.3e-05
s
SD
3e-06
s
p50
1.4e-05
s
<
p95
1.9e-05
s
≤
p99
1.9e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000339
s
SD
0.000318
s
p50
0.000195
s
<
p95
0.001245
s
≤
p99
0.001245
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
1739
over 891.866853155s
mean rate
62991.83
/s
std
288646.71
/s
p5
0
/s
p95
305756.97
/s
peak
4.54890068e+06
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
1738
over 891.866851348s
mean rate
40616.96
/s
std
371727.6
/s
p5
0
/s
p95
84388.19
/s
peak
8.40336134e+06
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000275
s
SD
0.000118
s
p50
0.000268
s
<
p95
0.000477
s
≤
p99
0.000477
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.68
s
<
mean
451.44
s
SD
259.51
s
<
p95
856.69
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
123
over 898.200107608s
mean rate
34291.2
/s
std
430147.05
/s
p5
0
/s
p95
22522.05
/s
peak
1.155555556e+07
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
3.482021
s
SD
1.825907
s
p50
3.946897
s
<
p95
6.010497
s
<
p99
8.055425
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.959656
s
SD
0.093919
s
p50
1.961538
s
<
p95
1.984615
s
≤
p99
1.984615
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.332416
s
SD
0.41321
s
p50
0.435841
s
<
p95
1.552001
s
<
p99
1.668987
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001804
s
SD
0.001184
s
p50
0.001841
s
<
p95
0.004982
s
≤
p99
0.004982
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.002059
s
SD
0.001585
s
p50
0.001289
s
<
p95
0.005864
s
<
p99
0.009665
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.002178
s
SD
0.000994
s
p50
0.002007
s
<
p95
0.004356
s
≤
p99
0.004356
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.598473
s
SD
0.6995
s
p50
0.499002
s
<
p95
2.052304
s
<
p99
3.832135
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.337505
s
SD
0.151712
s
p50
0.33863
s
<
p95
0.616552
s
<
p99
0.754955
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000232
s
SD
6.4e-05
s
p50
0.000198
s
<
p95
0.000344
s
<
p99
0.000346
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000119
s
SD
3.3e-05
s
p50
0.000116
s
<
p95
0.000201
s
<
p99
0.000251
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000211
s
SD
7.8e-05
s
p50
0.000186
s
<
p95
0.000323
s
<
p99
0.000444
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000325
s
SD
0.000206
s
p50
0.000271
s
<
p95
0.000837
s
<
p99
0.001067
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000118
s
SD
4.7e-05
s
p50
0.000102
s
<
p95
0.000218
s
≤
p99
0.000218
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000213
s
SD
5.6e-05
s
p50
0.000199
s
<
p95
0.00032
s
<
p99
0.000386
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000251
s
SD
0.012252
s
p50
0.000609
s
<
p95
0.032349
s
<
p99
0.05324
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000574
s
SD
0.000152
s
p50
0.000492
s
<
p95
0.000825
s
<
p99
0.000833
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.077632
s
SD
0.023776
s
p50
0.079024
s
<
p95
0.113784
s
<
p99
0.11865
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.083747
s
SD
0.015058
s
p50
0.080635
s
<
p95
0.110084
s
<
p99
0.127909
s
P2P received remote signals
Count of remote signals received.
total
1741
over 891.866858519s
mean rate
46577.66
/s
std
733788.61
/s
p5
0
/s
p95
76923.08
/s
peak
1.769911504e+07
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
7.68
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
4.31
KiB/s
<
mean
158.36
KiB/s
SD
794.91
KiB/s
<
p95
185.03
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
4.37
KiB/s
<
mean
46.14
KiB/s
SD
178.75
KiB/s
<
p95
79.41
KiB/s
Total bytes received
Total bytes received on primary network interface
count
692.84
MiB
mean
788.30
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
201.87
MiB
mean
229.69
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 884.75 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.83
%
<
mean
10.77
%
SD
14.99
%
<
p95
36.09
%
System
3.08
%
CPU percentiles
CPU usage percentiles
p50
6.37
%
p95
36.09
%
p99
83.46
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
3
hosts
mean time
0.03
s
Memory used percentage
Percentage of memory used
p5
6.67
%
<
mean
14.5
%
SD
5.8
%
<
p95
20.22
%
Memory available percentage
Percentage of available memory
p5
79.78
%
<
mean
85.5
%
SD
5.8
%
<
p95
93.33
%
Max host memory used
Maximum memory usage percentage across all hosts
max
22.19
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
884.75
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.03
MiB/s
Disk write throughput
Disk write throughput in MiB/s
7.33
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/2
hosts
Mount Point /efi-boot
0/2
hosts
Mount Point /nix/store
0/2
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.51
5 min
0.38
15 min
0.22
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
2.0004
%
SD
7.4335
%
<
p95
8.99
%
60 second average
1.4438
%
300 second average
1.1052
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
1.7127
%
SD
3.5312
%
<
p95
9.6
%
60 second average
1.5560
%
300 second average
1.3056
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
1.5336
%
SD
3.0527
%
<
p95
8.89
%
60 second average
1.4330
%
300 second average
1.2111
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.57
%
<
mean
4.76
%
SD
11.54
%
<
p95
30.45
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
165.44
KiB
<
mean
208.06
KiB
SD
145.99
KiB
<
p95
234.78
KiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
<
mean
15.77
threads
SD
4.16
threads
<
p95
21
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
46
file descriptors
<
mean
85.93
file descriptors
SD
231.79
file descriptors
<
p95
90
file descriptors

Single-write, many-read

↑ Back to index

Creates an entry in the agent setup, then read one's own record back. This tests the maximum read performance for reading back local data when the chain is short.

Started
Thu, 25 Jun 2026 01:20:18 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
single_write_many_read_28140184351_1
read call timing
The time it takes to complete the zome call that retrieves the record.
mean
0.004072
s
SD
0.025141
s
p50
0.003108
s
<
p95
0.004083
s
<
p99
0.006475
s
read call rate
The number of read zome calls completed per second.
mean
2444.39
/s
Error count
The number of errors collected.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000358
s
SD
2e-06
s
p50
0.000358
s
<
p95
0.000359
s
≤
p99
0.000359
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.001806449s
Not enough time data to show a trend.
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
3247354592
over 280.001806449s
mean rate
1.159761958e+07
/s
std
1.0756297e+06
/s
p5
9.3658372e+06
/s
p95
1.291988552e+07
/s
peak
1.297252088e+07
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.001806449s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.001806449s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.003477
s
SD
0
s
p50
0.003477
s
≤
p95
0.003477
s
≤
p99
0.003477
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.001942
s
SD
1.5e-05
s
p50
0.001941
s
<
p95
0.001945
s
≤
p99
0.001945
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002896
s
SD
0
s
p50
0.002896
s
≤
p95
0.002896
s
≤
p99
0.002896
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00136
s
SD
9e-06
s
p50
0.00136
s
<
p95
0.001362
s
≤
p99
0.001362
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001203
s
SD
0
s
p50
0.001203
s
≤
p95
0.001203
s
≤
p99
0.001203
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001017
s
SD
0
s
p50
0.001017
s
≤
p95
0.001017
s
≤
p99
0.001017
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000286
s
SD
1.1e-05
s
p50
0.000298
s
≤
p95
0.000298
s
≤
p99
0.000298
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.0004
s
SD
2e-06
s
p50
0.0004
s
≤
p95
0.0004
s
≤
p99
0.0004
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001516
s
SD
0
s
p50
0.001516
s
≤
p95
0.001516
s
≤
p99
0.001516
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000455
s
SD
0
s
p50
0.000455
s
≤
p95
0.000455
s
≤
p99
0.000455
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.02
s
<
mean
147.02
s
SD
83.67
s
<
p95
277.03
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001791127s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.055953
s
SD
0
s
p50
0.055953
s
≤
p95
0.055953
s
≤
p99
0.055953
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000536
s
SD
0
s
p50
0.000536
s
≤
p95
0.000536
s
≤
p99
0.000536
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000618
s
SD
0
s
p50
0.000618
s
≤
p95
0.000618
s
≤
p99
0.000618
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000643
s
SD
0
s
p50
0.000643
s
≤
p95
0.000643
s
≤
p99
0.000643
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001
s
SD
7.8e-05
s
p50
0.00102
s
<
p95
0.00114
s
≤
p99
0.00114
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001577
s
SD
0
s
p50
0.001577
s
≤
p95
0.001577
s
≤
p99
0.001577
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000566
s
SD
0
s
p50
0.000566
s
≤
p95
0.000566
s
≤
p99
0.000566
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.00014
s
SD
0
s
p50
0.00014
s
<
p95
0.000141
s
≤
p99
0.000141
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000305
s
SD
4.3e-05
s
p50
0.000305
s
<
p95
0.000311
s
≤
p99
0.000311
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
8.1e-05
s
SD
0
s
p50
8.1e-05
s
≤
p95
8.1e-05
s
≤
p99
8.1e-05
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000315
s
SD
2e-06
s
p50
0.000315
s
≤
p95
0.000315
s
≤
p99
0.000315
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.1e-05
s
SD
0
s
p50
8.1e-05
s
≤
p95
8.1e-05
s
≤
p99
8.1e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
8.1e-05
s
SD
5e-06
s
p50
8.1e-05
s
<
p95
8.5e-05
s
<
p99
8.6e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00099
s
SD
0.009405
s
p50
0.000487
s
<
p95
0.023935
s
≤
p99
0.023935
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000403
s
SD
0
s
p50
0.000403
s
≤
p95
0.000403
s
≤
p99
0.000403
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
16.61
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
6.29
KiB/s
<
mean
8.04
KiB/s
SD
2.17
KiB/s
<
p95
15.28
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
7.61
KiB/s
<
mean
9.55
KiB/s
SD
3.14
KiB/s
<
p95
19.99
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.28
MiB
mean
8.04
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.70
MiB
mean
9.55
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
20.97
%
<
mean
24.61
%
SD
3.79
%
<
p95
26.32
%
System
8.00
%
CPU percentiles
CPU usage percentiles
p50
24.68
%
p95
26.32
%
p99
42.10
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
17.06
%
<
mean
17.73
%
SD
0.4
%
<
p95
18.42
%
Memory available percentage
Percentage of available memory
p5
81.58
%
<
mean
82.27
%
SD
0.4
%
<
p95
82.94
%
Max host memory used
Maximum memory usage percentage across all hosts
max
17.73
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-23.67
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
4.96
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /efi-boot
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.59
5 min
0.98
15 min
0.42
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.1
%
<
mean
0.1657
%
SD
0.1439
%
<
p95
0.48
%
60 second average
0.8100
%
300 second average
1.4323
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
4.34
%
<
mean
9.3167
%
SD
4.0652
%
<
p95
16.32
%
60 second average
8.8017
%
300 second average
5.1843
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
4.07
%
<
mean
8.7797
%
SD
3.8102
%
<
p95
15.71
%
60 second average
8.2757
%
300 second average
4.8723
%
Holochain process CPU usage
CPU usage by Holochain process
p5
16.45
%
<
mean
19.81
%
SD
3.89
%
<
p95
21.36
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
156.57
KiB
<
mean
223.98
KiB
SD
42.87
KiB
<
p95
234.77
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
≤
mean
12.74
threads
SD
2.26
threads
<
p95
13
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
55
file descriptors
<
mean
55.29
file descriptors
SD
9.3
file descriptors
<
p95
64
file descriptors

Unyt Chain Transaction

↑ Back to index

Tests Unyt chain transaction system performance with credit ledger and smart agreement primitives. The scenario has three roles:

  • initiate: Progenitor agent that initializes the network with system templates, global configuration, and foundational smart agreements
  • spend: Transaction agents that accept incoming commitments and create spend transactions distributed among participants
  • smart_agreements: Smart agreement agents that collect RAVEs, execute agreements, and create parked link spending transactions
Started
Thu, 25 Jun 2026 05:44:36 UTC
Peer count
30
Peer count at end
28
Behaviours
  • initiate (1 agent)
  • smart_agreements (1 agent)
  • spend (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
unyt_chain_transaction_28140184351_1
Global definition propagation time
Time from session start until each agent detected the global_definition propagation. Shows aggregate statistics across agents.
Mean
mean
55.72
s
SD
0
s
Max
Highest per-partition mean latency
max mean
107
s
Min
Lowest per-partition mean latency
min mean
22
s
Sync lag: Commitment transactions
Time between commitment creation and discovery by the receiving agent (seconds). Shows aggregate statistics across agents.
Mean
mean
414.194953
s
SD
51.751894
s
Max
Highest per-partition mean latency
max mean
1250.005291
s
Min
Lowest per-partition mean latency
min mean
35.620083
s
Sync lag: RAVE transactions
Time between RAVE creation and discovery by smart_agreements agents (seconds). Shows aggregate statistics across agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Sync lag: Grouped parked requests
Time between grouped_parked request creation and discovery (seconds). Shows aggregate statistics across agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Final ledger balance
Final ledger balance across all agents at teardown (base unyt units). Sum should be stable across runs; deviation indicates value was created or destroyed.
sum
-11363811173308
mean
-4.05850399047e+11
min
-805390192667
max
0
n
28
Final ledger fees
Final ledger fees owed across all agents at teardown (base unyt units).
sum
1055656368
mean
3.770201314e+07
min
0
max
77853733
n
28
Actionable transaction commitments
Remaining actionable transaction commitments at teardown. Non-zero sum indicates work left unfinished.
sum
25
mean
0.89
min
0
max
7
n
28
Actionable transaction accepts
Remaining actionable transaction accepts at teardown. Non-zero sum indicates work left unfinished.
sum
0
mean
0
min
0
max
0
n
28
Completed transaction accepts
Completed transaction accepts at teardown.
sum
13
mean
0.46
min
0
max
3
n
28
Completed transaction spends
Completed transaction spends at teardown.
sum
2145
mean
76.61
min
0
max
140
n
28
Completed transaction RAVEs
Completed transaction RAVEs at teardown.
sum
2145
mean
76.61
min
0
max
140
n
28
Parked spends
Parked spend counts at teardown. These are pending link-spending transactions.
sum
2120
mean
75.71
min
0
max
139
n
28
Check agent exists: Duration
Duration of the check_agent_exists loop per behaviour iteration (seconds).
mean
0.106591
s
SD
0.09961
s
p50
0.104111
s
<
p95
0.323651
s
<
p99
0.427613
s
Check agent exists: Total calls
Total check_agent_exists calls made across all agents and iterations.
sum
792
mean
16.85
min
0
max
24
n
47
Check agent exists: Failed calls
Total check_agent_exists calls that failed across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
47
Check agent exists: Missing agents
Total check_agent_exists calls that reported a missing agent across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
47
UI action list refresh: Duration
Duration of the UI action list refresh per behaviour iteration (seconds).
mean
0.176596
s
SD
0.330979
s
p50
0.063085
s
<
p95
1.036839
s
<
p99
1.709558
s
UI action list refresh: Failed calls
Total UI action list refresh calls that failed across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
47
UI routine refresh: Duration
Duration of the full UI routine refresh per behaviour iteration (seconds), including check_agent_exists, action list refresh, and transaction detail refresh.
mean
79.640907
s
SD
128.052961
s
p50
19.135529
s
<
p95
411.880421
s
<
p99
459.594803
s
UI routine refresh: Watchlist count
Watchlist size (number of transactions being tracked) per behaviour iteration. Indicates how many transactions agents are actively monitoring.
sum
1465
mean
31.17
min
0
max
116
n
47
UI transaction detail item refresh: Duration
Duration of refreshing a single transaction detail item per behaviour iteration (seconds).
mean
2.540662
s
SD
3.485968
s
p50
1.183617
s
<
p95
9.632657
s
<
p99
17.266953
s
UI transaction detail item refresh: Primary transaction total calls
Total primary transaction fetches made during per-item detail refresh across all agents and iterations.
sum
2930
mean
2
min
2
max
2
n
1465
UI transaction detail item refresh: Primary transaction failed calls
Total primary transaction fetches that failed during per-item detail refresh across all agents and iterations.
sum
6
mean
0
min
0
max
1
n
1465
UI transaction detail item refresh: Related transaction total calls
Total related transaction fetches made during per-item detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
1465
UI transaction detail item refresh: Related transaction failed calls
Total related transaction fetches that failed during per-item detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
1465
UI transaction detail refresh: Duration
Duration of refreshing all watched transaction details per behaviour iteration (seconds).
mean
112.790429
s
SD
139.843395
s
p50
41.752394
s
<
p95
421.4009
s
<
p99
459.034322
s
UI transaction detail refresh: Transactions processed
Total number of transactions processed during the detail refresh across all agents and iterations.
sum
1465
mean
44.39
min
20
max
116
n
33
UI transaction detail refresh: Primary transaction total calls
Total primary transaction fetches made during the full detail refresh across all agents and iterations.
sum
2930
mean
88.79
min
40
max
232
n
33
UI transaction detail refresh: Primary transaction failed calls
Total primary transaction fetches that failed during the full detail refresh across all agents and iterations.
sum
6
mean
0.18
min
0
max
1
n
33
UI transaction detail refresh: Related transaction total calls
Total related transaction fetches made during the full detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
33
UI transaction detail refresh: Related transaction failed calls
Total related transaction fetches that failed during the full detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
33
Error count
The total number of errors accumulated across all agents over the run.
1683
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.033771
s
SD
0.019507
s
p50
0.004557
s
<
p95
0.029246
s
<
p99
0.119837
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
67
over 2908.377045725s
mean rate
94.12
/s
std
341.69
/s
p5
0
/s
p95
401.94
/s
peak
2311.87
/s
Zome call duration: 'transactor::check_agent_exists'
Duration of this zome call as measured by Holochain internally.
mean
0.003329
s
SD
0.001074
s
p50
0.002739
s
<
p95
0.00485
s
<
p99
0.008864
s
Zome call duration: 'transactor::create_accept'
Duration of this zome call as measured by Holochain internally.
mean
0.323075
s
SD
0.129695
s
p50
0.396133
s
<
p95
0.473548
s
≤
p99
0.473548
s
Zome call duration: 'transactor::create_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.0251
s
SD
0.007568
s
p50
0.024619
s
<
p95
0.035314
s
≤
p99
0.035314
s
Zome call duration: 'transactor::create_commitment'
Duration of this zome call as measured by Holochain internally.
mean
0.347089
s
SD
0.328474
s
p50
0.314728
s
<
p95
0.88084
s
<
p99
2.048663
s
Zome call duration: 'transactor::create_smart_agreement'
Duration of this zome call as measured by Holochain internally.
mean
0.044108
s
SD
0
s
p50
0.044108
s
≤
p95
0.044108
s
≤
p99
0.044108
s
Zome call duration: 'transactor::get_actionable_transactions'
Duration of this zome call as measured by Holochain internally.
mean
0.105378
s
SD
0.137268
s
p50
0.060949
s
<
p95
0.348168
s
<
p99
0.737966
s
Zome call duration: 'transactor::get_all_notification_links'
Duration of this zome call as measured by Holochain internally.
mean
0.019863
s
SD
0.024307
s
p50
0.015117
s
<
p95
0.062772
s
<
p99
0.126023
s
Zome call duration: 'transactor::get_code_templates_lib'
Duration of this zome call as measured by Holochain internally.
mean
0.059301
s
SD
0.082164
s
p50
0.035662
s
<
p95
0.249659
s
<
p99
0.360267
s
Zome call duration: 'transactor::get_current_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.046999
s
SD
0.093049
s
p50
0.025545
s
<
p95
0.239523
s
<
p99
0.392809
s
Zome call duration: 'transactor::get_global_units_details'
Duration of this zome call as measured by Holochain internally.
mean
0.039168
s
SD
0.058077
s
p50
0.018026
s
<
p95
0.14791
s
<
p99
0.326998
s
Zome call duration: 'transactor::get_history'
Duration of this zome call as measured by Holochain internally.
mean
0.103396
s
SD
0.201602
s
p50
0.089273
s
<
p95
0.118078
s
<
p99
0.511562
s
Zome call duration: 'transactor::get_incoming_raves'
Duration of this zome call as measured by Holochain internally.
mean
0.025959
s
SD
0.031599
s
p50
0.017475
s
<
p95
0.091257
s
<
p99
0.155125
s
Zome call duration: 'transactor::get_ledger'
Duration of this zome call as measured by Holochain internally.
mean
0.060221
s
SD
0.023986
s
p50
0.039287
s
<
p95
0.098484
s
<
p99
0.164061
s
Zome call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of this zome call as measured by Holochain internally.
mean
0.095854
s
SD
0.188611
s
p50
0.073552
s
<
p95
0.481669
s
<
p99
0.913459
s
Zome call duration: 'transactor::get_requests_to_execute_agreements'
Duration of this zome call as measured by Holochain internally.
mean
0.025167
s
SD
0.02875
s
p50
0.016489
s
<
p95
0.074992
s
<
p99
0.159641
s
Zome call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.074576
s
SD
0.079838
s
p50
0.011886
s
<
p95
0.217514
s
<
p99
0.385317
s
Zome call duration: 'transactor::get_sorted_requests_to_spend'
Duration of this zome call as measured by Holochain internally.
mean
0.023992
s
SD
0.03241
s
p50
0.013658
s
<
p95
0.085816
s
<
p99
0.153157
s
Zome call duration: 'transactor::get_status'
Duration of this zome call as measured by Holochain internally.
mean
5.198249
s
SD
3.315457
s
p50
4.56461
s
<
p95
10.751237
s
<
p99
12.154358
s
Zome call duration: 'transactor::get_transaction'
Duration of this zome call as measured by Holochain internally.
mean
0.014508
s
SD
0.003072
s
p50
0.013869
s
<
p95
0.019834
s
<
p99
0.020132
s
Zome call duration: 'transactor::initialize_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.085482
s
SD
0
s
p50
0.085482
s
≤
p95
0.085482
s
≤
p99
0.085482
s
Zome call duration: 'transactor::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.018334
s
SD
0.005682
s
p50
0.01
s
<
p95
0.024856
s
<
p99
0.026566
s
Zome call duration: 'transactor::whoami'
Duration of this zome call as measured by Holochain internally.
mean
0.003886
s
SD
0.001325
s
p50
0.003354
s
<
p95
0.006397
s
≤
p99
0.006397
s
WASM call duration: 'transactor::check_agent_exists'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002034
s
SD
0.000682
s
p50
0.001647
s
<
p95
0.00321
s
<
p99
0.005424
s
WASM call duration: 'transactor::create_accept'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.607311
s
SD
0.686879
s
p50
0.339915
s
<
p95
0.472336
s
<
p99
1.58814
s
WASM call duration: 'transactor::create_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.022492
s
SD
0.006994
s
p50
0.022311
s
<
p95
0.031895
s
≤
p99
0.031895
s
WASM call duration: 'transactor::create_commitment'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.358713
s
SD
0.357114
s
p50
0.313263
s
<
p95
0.930036
s
<
p99
2.046967
s
WASM call duration: 'transactor::create_smart_agreement'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.040858
s
SD
0
s
p50
0.040858
s
≤
p95
0.040858
s
≤
p99
0.040858
s
WASM call duration: 'transactor::get_actionable_transactions'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.103553
s
SD
0.137011
s
p50
0.059609
s
<
p95
0.345904
s
<
p99
0.736147
s
WASM call duration: 'transactor::get_all_notification_links'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.01849
s
SD
0.023996
s
p50
0.014051
s
<
p95
0.060752
s
<
p99
0.122726
s
WASM call duration: 'transactor::get_code_templates_lib'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.057888
s
SD
0.081925
s
p50
0.034531
s
<
p95
0.247504
s
<
p99
0.358413
s
WASM call duration: 'transactor::get_current_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.031916
s
SD
0.063491
s
p50
0.01512
s
<
p95
0.163309
s
<
p99
0.264114
s
WASM call duration: 'transactor::get_global_units_details'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.037752
s
SD
0.05788
s
p50
0.017024
s
<
p95
0.145856
s
<
p99
0.323834
s
WASM call duration: 'transactor::get_history'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.102027
s
SD
0.201573
s
p50
0.088154
s
<
p95
0.116328
s
<
p99
0.510074
s
WASM call duration: 'transactor::get_incoming_raves'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.024448
s
SD
0.031333
s
p50
0.015875
s
<
p95
0.089221
s
<
p99
0.153427
s
WASM call duration: 'transactor::get_ledger'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.058366
s
SD
0.023528
s
p50
0.037721
s
<
p95
0.095262
s
<
p99
0.161129
s
WASM call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.094488
s
SD
0.188389
s
p50
0.071774
s
<
p95
0.480011
s
<
p99
0.910304
s
WASM call duration: 'transactor::get_requests_to_execute_agreements'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.02373
s
SD
0.028459
s
p50
0.01544
s
<
p95
0.072173
s
<
p99
0.156414
s
WASM call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.072401
s
SD
0.079389
s
p50
0.010093
s
<
p95
0.21557
s
<
p99
0.381854
s
WASM call duration: 'transactor::get_sorted_requests_to_spend'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.022648
s
SD
0.032119
s
p50
0.012635
s
<
p95
0.083768
s
<
p99
0.151165
s
WASM call duration: 'transactor::get_status'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
5.19699
s
SD
3.315524
s
p50
4.563517
s
<
p95
10.750105
s
<
p99
12.15318
s
WASM call duration: 'transactor::get_transaction'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.013263
s
SD
0.002897
s
p50
0.012644
s
<
p95
0.018109
s
<
p99
0.018426
s
WASM call duration: 'transactor::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.022573
s
SD
0.011802
s
p50
0.017243
s
<
p95
0.044929
s
<
p99
0.054424
s
WASM call duration: 'transactor::initialize_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.08339
s
SD
0
s
p50
0.08339
s
≤
p95
0.08339
s
≤
p99
0.08339
s
WASM call duration: 'transactor::post_commit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.066063
s
SD
0.03961
s
p50
0.052708
s
<
p95
0.115792
s
<
p99
0.174049
s
WASM call duration: 'transactor::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.016097
s
SD
0.005063
s
p50
0.008717
s
<
p95
0.021879
s
<
p99
0.023459
s
WASM call duration: 'transactor::whoami'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002192
s
SD
0.00079
s
p50
0.001853
s
<
p95
0.003662
s
<
p99
0.004311
s
WASM call duration: 'transactor_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001292
s
SD
0.00054
s
p50
0.001332
s
<
p95
0.002783
s
<
p99
0.003099
s
WASM call duration: 'transactor_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00188
s
SD
0.000844
s
p50
0.001467
s
<
p95
0.003624
s
≤
p99
0.003624
s
WASM call duration: 'transactor_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.044512
s
SD
0.080182
s
p50
0.040245
s
<
p95
0.140912
s
<
p99
0.36967
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.1e-05
s
SD
1.7e-05
s
p50
2.2e-05
s
<
p95
4.5e-05
s
<
p99
6.9e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000343
s
SD
0.0004
s
p50
0.000327
s
<
p95
0.000897
s
<
p99
0.002865
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.00042
s
SD
0.000355
s
p50
0.000335
s
<
p95
0.0008
s
<
p99
0.002321
s
Host function call duration: '__hc__delete_link_1'
Duration of this host function call invoked from within WASM.
mean
0.007343
s
SD
0.008715
s
p50
0.009962
s
<
p95
0.024504
s
≤
p99
0.024504
s
Host function call duration: '__hc__dna_info_2'
Duration of this host function call invoked from within WASM.
mean
1e-05
s
SD
5e-06
s
p50
7e-06
s
<
p95
1.5e-05
s
<
p99
2.6e-05
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
0.000109
s
SD
4.9e-05
s
p50
4.9e-05
s
<
p95
0.000167
s
<
p99
0.000226
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
1.020847
s
SD
0.734361
s
p50
0.243645
s
<
p95
2.139242
s
<
p99
2.502308
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.088428
s
SD
0.380617
s
p50
0.090132
s
<
p95
0.133632
s
<
p99
0.376887
s
Host function call duration: '__hc__get_details_1'
Duration of this host function call invoked from within WASM.
mean
0.003128
s
SD
0.026323
s
p50
0.000455
s
<
p95
0.039242
s
<
p99
0.13809
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.01903
s
SD
0.03408
s
p50
0.009807
s
<
p95
0.101541
s
<
p99
0.148097
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.049079
s
SD
0.0237
s
p50
0.033228
s
<
p95
0.074578
s
<
p99
0.087664
s
Host function call duration: '__hc__must_get_entry_1'
Duration of this host function call invoked from within WASM.
mean
0.000438
s
SD
0.000179
s
p50
0.000447
s
<
p95
0.000733
s
<
p99
0.001262
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.004215
s
SD
0.023215
s
p50
0.005294
s
<
p95
0.025753
s
<
p99
0.088149
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.001618
s
SD
0.001691
s
p50
0.001089
s
<
p95
0.005663
s
<
p99
0.008188
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
5.3e-05
s
SD
2.2e-05
s
p50
4.7e-05
s
<
p95
9e-05
s
<
p99
0.00011
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
7e-06
s
SD
4e-06
s
p50
7e-06
s
<
p95
1.5e-05
s
<
p99
2.4e-05
s
Host function call duration: '__hc__trace_1'
Duration of this host function call invoked from within WASM.
mean
5.1e-05
s
SD
6.8e-05
s
p50
5.9e-05
s
<
p95
0.000114
s
<
p99
0.000186
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002449
s
SD
0.001575
s
p50
0.00295
s
<
p95
0.006935
s
<
p99
0.007902
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
37
over 3001.237774633s
mean rate
725.94
/s
std
2246.1
/s
p5
0
/s
p95
6446.57
/s
peak
16936.08
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
279
over 3000.127622176s
mean rate
460.31
/s
std
1543.88
/s
p5
0
/s
p95
1492.49
/s
peak
12288.3
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.068013
s
SD
0.039957
s
p50
0.054162
s
<
p95
0.117841
s
<
p99
0.177166
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
77.2
s
<
mean
954.53
s
SD
774.02
s
<
p95
2568.18
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
18
over 37458.856162799s
mean rate
29416.15
/s
std
110697.09
/s
p5
0
/s
p95
83454.5
/s
peak
719781.3
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
159.541112
s
SD
107.853623
s
p50
56.040294
s
<
p95
411.166637
s
<
p99
415.060019
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.945825
s
SD
0.315294
s
p50
1.960509
s
<
p95
2.050526
s
<
p99
3.080868
s
App validation workflow duration
Time spent running the app validation workflow.
mean
13.831556
s
SD
32.049701
s
p50
7.530705
s
<
p95
57.428948
s
<
p99
168.687622
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001183
s
SD
0.00139
s
p50
0.000664
s
<
p95
0.004251
s
<
p99
0.007752
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.007669
s
SD
0.027958
s
p50
0.002468
s
<
p95
0.095768
s
<
p99
0.096165
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.016707
s
SD
0.011399
s
p50
0.011246
s
<
p95
0.039115
s
<
p99
0.057113
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.234591
s
SD
1.507305
s
p50
0.247693
s
<
p95
4.831063
s
<
p99
7.266717
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
6.671678
s
SD
8.457186
s
p50
3.936099
s
<
p95
23.766008
s
<
p99
39.918071
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.015202
s
SD
0.009672
s
p50
0.005705
s
<
p95
0.027757
s
<
p99
0.036154
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.009718
s
SD
0.006279
s
p50
0.003764
s
<
p95
0.017973
s
<
p99
0.023546
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000208
s
SD
0.000121
s
p50
0.000175
s
<
p95
0.000465
s
<
p99
0.000672
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.015041
s
SD
0.009535
s
p50
0.005583
s
<
p95
0.027474
s
<
p99
0.035664
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000165
s
SD
0.000415
s
p50
8.7e-05
s
<
p95
0.000217
s
<
p99
0.002837
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000173
s
SD
0.000138
s
p50
0.000157
s
<
p95
0.000471
s
<
p99
0.000794
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002208
s
SD
0.278111
s
p50
0.000446
s
<
p95
0.833673
s
<
p99
1.374352
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000252
s
SD
0.000176
s
p50
0.000284
s
<
p95
0.00056
s
<
p99
0.00106
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.258466
s
SD
24.142816
s
p50
0.134643
s
<
p95
60.001559
s
<
p99
60.00181
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.097266
s
SD
0.047434
s
p50
0.087088
s
<
p95
0.177161
s
<
p99
0.211042
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.091014
s
SD
0.383921
s
p50
0.089699
s
<
p95
0.133342
s
<
p99
0.376469
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
1.57806
s
SD
0.601007
s
p50
1.797872
s
≤
p95
1.797872
s
≤
p99
1.797872
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.483269
s
SD
19.923582
s
p50
0.497261
s
<
p95
60.000752
s
<
p99
60.001327
s
P2P received remote signals
Count of remote signals received.
total
37
over 3001.237272813s
mean rate
758.35
/s
std
2254.23
/s
p5
0
/s
p95
6477.15
/s
peak
17128.9
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
27.87
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
4.13
KiB/s
<
mean
106.42
KiB/s
SD
481.52
KiB/s
<
p95
205.50
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
3.96
KiB/s
<
mean
87.41
KiB/s
SD
104.73
KiB/s
<
p95
274.28
KiB/s
Total bytes received
Total bytes received on primary network interface
count
4.12
GiB
mean
1.31
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
3.38
GiB
mean
1.08
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 95.7%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1363.07 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 14% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.03
%
<
mean
33.9
%
SD
23.98
%
<
p95
86.03
%
System
6.03
%
CPU percentiles
CPU usage percentiles
p50
30.86
%
p95
86.03
%
p99
95.66
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
26
hosts
mean time
0.12
s
Memory used percentage
Percentage of memory used
p5
12.22
%
<
mean
21.57
%
SD
13.97
%
<
p95
40.29
%
Memory available percentage
Percentage of available memory
p5
59.71
%
<
mean
78.43
%
SD
13.97
%
<
p95
87.78
%
Max host memory used
Maximum memory usage percentage across all hosts
max
81.84
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.01
%
Memory growth rate
Rate of memory growth over time
growth
1363.07
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.08
MiB/s
Disk write throughput
Disk write throughput in MiB/s
115.05
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/12
hosts
Mount Point /efi-boot
0/7
hosts
Mount Point /etc/hostname
0/6
hosts
Mount Point /etc/hosts
0/6
hosts
Mount Point /etc/resolv.conf
0/6
hosts
Mount Point /nix/store
0/12
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.11
5 min
1.84
15 min
1.60
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
14.29
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
5.2173
%
SD
11.7041
%
<
p95
35.85
%
60 second average
5.0165
%
300 second average
4.2359
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0003
%
SD
0.0112
%
≤
p95
0
%
60 second average
0.0003
%
300 second average
0.0001
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0003
%
SD
0.0112
%
≤
p95
0
%
60 second average
0.0003
%
300 second average
0.0001
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
7.3871
%
SD
13.7179
%
<
p95
39.35
%
60 second average
7.2257
%
300 second average
6.4036
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
6.315
%
SD
11.8493
%
<
p95
33.88
%
60 second average
6.1983
%
300 second average
5.5621
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.3
%
<
mean
24.05
%
SD
24.01
%
<
p95
81.52
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
849.39
KiB
<
mean
1.13
MiB
SD
203.29
KiB
<
p95
1.36
MiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
<
mean
36.82
threads
SD
17.71
threads
<
p95
66
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
51
file descriptors
<
mean
89.1
file descriptors
SD
23.68
file descriptors
<
p95
135
file descriptors

Unyt Chain Transaction Zero Arc

↑ Back to index

Tests Unyt chain transaction system performance where some agents operate with a 0-arc DHT configuration. Measures data propagation between zero-arc and full-arc nodes. The scenario has five roles:

  • initiate: Progenitor agent that initializes the network with system templates, global configuration, and foundational smart agreements
  • zero_spend: Zero-arc transaction agents that accept commitments and create spend transactions
  • zero_smart_agreements: Zero-arc agents that collect RAVEs and execute smart agreements
  • full_observer: Full-arc observer agents that passively monitor data propagation
  • zero_observer: Zero-arc observer agents that passively monitor data propagation for comparison
Started
Thu, 25 Jun 2026 05:46:30 UTC
Peer count
7
Peer count at end
7
Behaviours
  • full_observer (1 agent)
  • initiate (1 agent)
  • zero_observer (1 agent)
  • zero_smart_agreements (1 agent)
  • zero_spend (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
unyt_chain_transaction_zero_arc_28140184351_1
Global definition propagation time
Time from session start until each agent detected the global_definition propagation. Shows aggregate statistics across arc types and agents.
Mean
mean
0.333333
s
SD
0
s
Max
Highest per-partition mean latency
max mean
2
s
Min
Lowest per-partition mean latency
min mean
0
s
Sync lag: Commitment transactions
Time between commitment creation and discovery by the receiving agent (seconds). Shows aggregate statistics across arc types and agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Sync lag: RAVE transactions
Time between RAVE creation and discovery by smart_agreements agents (seconds). Shows aggregate statistics across arc types and agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Sync lag: Grouped parked requests
Time between grouped_parked request creation and discovery (seconds). Shows aggregate statistics across arc types and agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Final ledger balance
Final ledger balance across all agents at teardown (base unyt units), partitioned by agent.
sum
-2897039360755
mean
-4.13862765822e+11
min
-992768915341
max
0
n
7
Final ledger fees
Final ledger fees owed across all agents at teardown (base unyt units).
sum
274584079
mean
3.9226297e+07
min
0
max
202614969
n
7
Actionable transaction proposals
Remaining actionable transaction proposals at teardown. Non-zero sum indicates work left unfinished.
sum
0
mean
0
min
0
max
0
n
7
Actionable transaction commitments
Remaining actionable transaction commitments at teardown. Non-zero sum indicates work left unfinished.
sum
0
mean
0
min
0
max
0
n
7
Actionable transaction accepts
Remaining actionable transaction accepts at teardown. Non-zero sum indicates work left unfinished.
sum
0
mean
0
min
0
max
0
n
7
Actionable transaction rejects
Remaining actionable transaction rejects at teardown. Non-zero sum indicates work left unfinished.
sum
0
mean
0
min
0
max
0
n
7
Completed transaction accepts
Completed transaction accepts at teardown.
sum
0
mean
0
min
0
max
0
n
7
Completed transaction spends
Completed transaction spends at teardown.
sum
99
mean
14.14
min
0
max
51
n
7
Completed transaction RAVEs
Completed transaction RAVEs at teardown.
sum
99
mean
14.14
min
0
max
51
n
7
Parked spends
Parked spend counts at teardown. These are pending link-spending transactions.
sum
95
mean
13.57
min
0
max
50
n
7
Code template discovery count
Cumulative count of unique code templates discovered by observer agents over the run. Shows aggregate statistics across arc types and agents.
Total
0
Agents affected
0 / 0
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
0
Max
Highest count in any single partition
0
Min
Lowest count in any single partition
0
Not enough time data to show a trend.
Check agent exists: Duration
Duration of the check_agent_exists loop per behaviour iteration (seconds).
mean
0.011069
s
SD
0.026898
s
p50
0.00403
s
<
p95
0.114546
s
<
p99
0.124758
s
Check agent exists: Total calls
Total check_agent_exists calls made across all agents and iterations.
sum
31
mean
0.89
min
0
max
1
n
35
Check agent exists: Failed calls
Total check_agent_exists calls that failed across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
35
Check agent exists: Missing agents
Total check_agent_exists calls that reported a missing agent across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
35
UI action list refresh: Duration
Duration of the UI action list refresh per behaviour iteration (seconds).
mean
0.819547
s
SD
0.0909
s
p50
0.790194
s
<
p95
0.98081
s
<
p99
1.259147
s
UI action list refresh: Failed calls
Total UI action list refresh calls that failed across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
35
UI routine refresh: Duration
Duration of the full UI routine refresh per behaviour iteration (seconds), including check_agent_exists, action list refresh, and transaction detail refresh.
mean
8.606369
s
SD
10.945183
s
p50
6.90917
s
<
p95
14.043784
s
<
p99
69.087846
s
UI routine refresh: Watchlist count
Watchlist size (number of transactions being tracked) per behaviour iteration. Indicates how many transactions agents are actively monitoring.
sum
247
mean
7.06
min
0
max
14
n
35
UI transaction detail item refresh: Duration
Duration of refreshing a single transaction detail item per behaviour iteration (seconds).
mean
0.957228
s
SD
3.772582
s
p50
0.704399
s
<
p95
0.854541
s
<
p99
0.9074
s
UI transaction detail item refresh: Primary transaction total calls
Total primary transaction fetches made during per-item detail refresh across all agents and iterations.
sum
494
mean
2
min
2
max
2
n
247
UI transaction detail item refresh: Primary transaction failed calls
Total primary transaction fetches that failed during per-item detail refresh across all agents and iterations.
sum
2
mean
0.01
min
0
max
1
n
247
UI transaction detail item refresh: Related transaction total calls
Total related transaction fetches made during per-item detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
247
UI transaction detail item refresh: Related transaction failed calls
Total related transaction fetches that failed during per-item detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
247
UI transaction detail refresh: Duration
Duration of refreshing all watched transaction details per behaviour iteration (seconds).
mean
7.627026
s
SD
11.378743
s
p50
5.726525
s
<
p95
11.88825
s
<
p99
67.815962
s
UI transaction detail refresh: Transactions processed
Total number of transactions processed during the detail refresh across all agents and iterations.
sum
247
mean
7.97
min
1
max
14
n
31
UI transaction detail refresh: Primary transaction total calls
Total primary transaction fetches made during the full detail refresh across all agents and iterations.
sum
494
mean
15.94
min
2
max
28
n
31
UI transaction detail refresh: Primary transaction failed calls
Total primary transaction fetches that failed during the full detail refresh across all agents and iterations.
sum
2
mean
0.06
min
0
max
2
n
31
UI transaction detail refresh: Related transaction total calls
Total related transaction fetches made during the full detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
31
UI transaction detail refresh: Related transaction failed calls
Total related transaction fetches that failed during the full detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
31
Error count
The total number of errors accumulated across all agents over the run.
20
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000451
s
SD
0.000324
s
p50
0.000521
s
<
p95
0.001226
s
<
p99
0.002218
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 733.880730286s
Not enough time data to show a trend.
Zome call duration: 'transactor::check_agent_exists'
Duration of this zome call as measured by Holochain internally.
mean
0.014417
s
SD
0.018114
s
p50
0.01367
s
<
p95
0.058597
s
<
p99
0.120867
s
Zome call duration: 'transactor::create_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.01925
s
SD
0.009488
s
p50
0.015008
s
<
p95
0.04038
s
≤
p99
0.04038
s
Zome call duration: 'transactor::create_commitment'
Duration of this zome call as measured by Holochain internally.
mean
1.304309
s
SD
0.81967
s
p50
2.129286
s
<
p95
2.27269
s
<
p99
2.285913
s
Zome call duration: 'transactor::create_smart_agreement'
Duration of this zome call as measured by Holochain internally.
mean
0.009278
s
SD
0
s
p50
0.009278
s
≤
p95
0.009278
s
≤
p99
0.009278
s
Zome call duration: 'transactor::get_actionable_transactions'
Duration of this zome call as measured by Holochain internally.
mean
0.279785
s
SD
0.169942
s
p50
0.452725
s
<
p95
0.472268
s
<
p99
0.479481
s
Zome call duration: 'transactor::get_all_notification_links'
Duration of this zome call as measured by Holochain internally.
mean
0.11328
s
SD
0.00298
s
p50
0.114204
s
<
p95
0.119998
s
<
p99
0.12439
s
Zome call duration: 'transactor::get_code_templates_lib'
Duration of this zome call as measured by Holochain internally.
mean
0.448778
s
SD
1.239793
s
p50
0.228287
s
<
p95
3.45599
s
<
p99
5.527622
s
Zome call duration: 'transactor::get_current_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.107979
s
SD
0.106589
s
p50
0.235393
s
<
p95
0.27493
s
≤
p99
0.27493
s
Zome call duration: 'transactor::get_global_units_details'
Duration of this zome call as measured by Holochain internally.
mean
0.32529
s
SD
0.005414
s
p50
0.327483
s
<
p95
0.336376
s
<
p99
0.343012
s
Zome call duration: 'transactor::get_history'
Duration of this zome call as measured by Holochain internally.
mean
0.527193
s
SD
0.127972
s
p50
0.534403
s
<
p95
0.628266
s
≤
p99
0.628266
s
Zome call duration: 'transactor::get_incoming_raves'
Duration of this zome call as measured by Holochain internally.
mean
0.070415
s
SD
0.044548
s
p50
0.115079
s
<
p95
0.122774
s
<
p99
0.12372
s
Zome call duration: 'transactor::get_ledger'
Duration of this zome call as measured by Holochain internally.
mean
0.042966
s
SD
0.011183
s
p50
0.041366
s
<
p95
0.064889
s
<
p99
0.089062
s
Zome call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of this zome call as measured by Holochain internally.
mean
0.562613
s
SD
0.407562
s
p50
0.981414
s
<
p95
1.018573
s
<
p99
1.01877
s
Zome call duration: 'transactor::get_requests_to_execute_agreements'
Duration of this zome call as measured by Holochain internally.
mean
0.069238
s
SD
0.044006
s
p50
0.114674
s
<
p95
0.119083
s
<
p99
0.125037
s
Zome call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.040451
s
SD
0.112149
s
p50
0.223335
s
<
p95
0.250173
s
≤
p99
0.250173
s
Zome call duration: 'transactor::get_sorted_requests_to_spend'
Duration of this zome call as measured by Holochain internally.
mean
0.115291
s
SD
0.004797
s
p50
0.114333
s
<
p95
0.125456
s
<
p99
0.125769
s
Zome call duration: 'transactor::get_status'
Duration of this zome call as measured by Holochain internally.
mean
0.599101
s
SD
0.036964
s
p50
0.607153
s
<
p95
0.681854
s
<
p99
0.779187
s
Zome call duration: 'transactor::get_transaction'
Duration of this zome call as measured by Holochain internally.
mean
0.11648
s
SD
0.004452
s
p50
0.117664
s
<
p95
0.122356
s
<
p99
0.135012
s
Zome call duration: 'transactor::initialize_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.023101
s
SD
0
s
p50
0.023101
s
≤
p95
0.023101
s
≤
p99
0.023101
s
Zome call duration: 'transactor::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.016279
s
SD
0.006559
s
p50
0.021316
s
<
p95
0.025644
s
<
p99
0.026744
s
Zome call duration: 'transactor::whoami'
Duration of this zome call as measured by Holochain internally.
mean
0.003522
s
SD
0.000913
s
p50
0.003618
s
<
p95
0.005459
s
<
p99
0.007236
s
WASM call duration: 'transactor::check_agent_exists'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.013134
s
SD
0.017822
s
p50
0.012508
s
<
p95
0.056527
s
<
p99
0.118067
s
WASM call duration: 'transactor::create_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.017215
s
SD
0.008349
s
p50
0.013603
s
<
p95
0.035677
s
≤
p99
0.035677
s
WASM call duration: 'transactor::create_commitment'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
1.302905
s
SD
0.819628
s
p50
2.128043
s
<
p95
2.271158
s
<
p99
2.284242
s
WASM call duration: 'transactor::create_smart_agreement'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.008199
s
SD
0
s
p50
0.008199
s
≤
p95
0.008199
s
≤
p99
0.008199
s
WASM call duration: 'transactor::get_actionable_transactions'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.278042
s
SD
0.170016
s
p50
0.451308
s
<
p95
0.470136
s
<
p99
0.476486
s
WASM call duration: 'transactor::get_all_notification_links'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.111745
s
SD
0.002618
s
p50
0.11245
s
<
p95
0.117641
s
<
p99
0.121051
s
WASM call duration: 'transactor::get_code_templates_lib'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.446704
s
SD
1.239918
s
p50
0.226817
s
<
p95
3.454693
s
<
p99
5.526338
s
WASM call duration: 'transactor::get_current_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.103793
s
SD
0.106626
s
p50
0.233236
s
<
p95
0.270735
s
≤
p99
0.270735
s
WASM call duration: 'transactor::get_global_units_details'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.323817
s
SD
0.005156
s
p50
0.325777
s
<
p95
0.334274
s
<
p99
0.34017
s
WASM call duration: 'transactor::get_history'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.525735
s
SD
0.128129
s
p50
0.532631
s
<
p95
0.626708
s
≤
p99
0.626708
s
WASM call duration: 'transactor::get_incoming_raves'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.068786
s
SD
0.044672
s
p50
0.113435
s
<
p95
0.120827
s
<
p99
0.122345
s
WASM call duration: 'transactor::get_ledger'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.041396
s
SD
0.01115
s
p50
0.039722
s
<
p95
0.063549
s
<
p99
0.087249
s
WASM call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.561111
s
SD
0.407407
s
p50
0.980137
s
<
p95
1.016057
s
<
p99
1.016295
s
WASM call duration: 'transactor::get_requests_to_execute_agreements'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.067625
s
SD
0.044059
s
p50
0.113193
s
<
p95
0.11719
s
<
p99
0.122198
s
WASM call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.038991
s
SD
0.111352
s
p50
0.221228
s
<
p95
0.245082
s
≤
p99
0.245082
s
WASM call duration: 'transactor::get_sorted_requests_to_spend'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.113851
s
SD
0.004592
s
p50
0.112569
s
<
p95
0.123882
s
<
p99
0.124286
s
WASM call duration: 'transactor::get_status'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.603105
s
SD
0.042291
s
p50
0.605944
s
<
p95
0.686521
s
<
p99
0.840233
s
WASM call duration: 'transactor::get_transaction'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.115322
s
SD
0.004184
s
p50
0.116444
s
<
p95
0.120954
s
<
p99
0.132468
s
WASM call duration: 'transactor::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.017894
s
SD
0.00564
s
p50
0.016104
s
<
p95
0.031716
s
≤
p99
0.031716
s
WASM call duration: 'transactor::initialize_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.022091
s
SD
0
s
p50
0.022091
s
≤
p95
0.022091
s
≤
p99
0.022091
s
WASM call duration: 'transactor::post_commit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.110714
s
SD
0.087524
s
p50
0.037048
s
<
p95
0.218173
s
<
p99
0.225883
s
WASM call duration: 'transactor::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.014371
s
SD
0.005932
s
p50
0.01891
s
<
p95
0.022943
s
<
p99
0.023946
s
WASM call duration: 'transactor::whoami'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002057
s
SD
0.000612
s
p50
0.002182
s
<
p95
0.003377
s
<
p99
0.004473
s
WASM call duration: 'transactor_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001657
s
SD
0.000561
s
p50
0.001784
s
<
p95
0.002889
s
<
p99
0.003695
s
WASM call duration: 'transactor_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001936
s
SD
0.000963
s
p50
0.00138
s
<
p95
0.003932
s
≤
p99
0.003932
s
WASM call duration: 'transactor_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.72249
s
SD
0.629064
s
p50
0.008939
s
<
p95
1.731062
s
<
p99
1.875444
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.7e-05
s
SD
1e-05
s
p50
2.6e-05
s
<
p95
4.6e-05
s
<
p99
5.4e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000363
s
SD
0.000165
s
p50
0.000273
s
<
p95
0.000878
s
<
p99
0.000936
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000365
s
SD
0.000191
s
p50
0.000278
s
<
p95
0.000987
s
≤
p99
0.000987
s
Host function call duration: '__hc__dna_info_2'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
8e-06
s
p50
8e-06
s
<
p95
3.2e-05
s
<
p99
3.4e-05
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
5.9e-05
s
SD
1.8e-05
s
p50
7.1e-05
s
<
p95
8.5e-05
s
<
p99
8.7e-05
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000513
s
SD
0.00321
s
p50
0.000513
s
<
p95
0.003815
s
<
p99
0.021988
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.105921
s
SD
0.005654
s
p50
0.105176
s
<
p95
0.107207
s
<
p99
0.151498
s
Host function call duration: '__hc__get_details_1'
Duration of this host function call invoked from within WASM.
mean
0.151792
s
SD
0.528779
s
p50
0.002721
s
<
p95
0.124499
s
<
p99
3.310109
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.048573
s
SD
0.050795
s
p50
0.106289
s
<
p95
0.115212
s
<
p99
0.11668
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.001156
s
SD
0.000269
s
p50
0.000926
s
<
p95
0.001601
s
<
p99
0.001729
s
Host function call duration: '__hc__must_get_entry_1'
Duration of this host function call invoked from within WASM.
mean
0.011187
s
SD
0.01719
s
p50
0.010531
s
<
p95
0.053658
s
<
p99
0.1119
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.038042
s
SD
0.046187
s
p50
0.10571
s
<
p95
0.11105
s
<
p99
0.119667
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.000579
s
SD
0.00058
s
p50
0.000449
s
<
p95
0.00261
s
≤
p99
0.00261
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
7.9e-05
s
SD
5e-05
s
p50
5.5e-05
s
<
p95
0.000166
s
<
p99
0.000177
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
1e-05
s
SD
1e-05
s
p50
1.2e-05
s
<
p95
4.5e-05
s
≤
p99
4.5e-05
s
Host function call duration: '__hc__trace_1'
Duration of this host function call invoked from within WASM.
mean
6.3e-05
s
SD
2.8e-05
s
p50
6.4e-05
s
<
p95
0.000132
s
<
p99
0.000146
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00294
s
SD
0.001535
s
p50
0.0033
s
<
p95
0.007111
s
<
p99
0.008629
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
97
over 840.008224696s
mean rate
0.93
/s
std
0.15
/s
p5
0.8
/s
p95
1.21
/s
peak
1.21
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
46
over 903.88232334s
mean rate
76.9
/s
std
137.1
/s
p5
0
/s
p95
309.08
/s
peak
570.3
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.112475
s
SD
0.087371
s
p50
0.038611
s
<
p95
0.221182
s
<
p99
0.22909
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
48.34
s
<
mean
463.5
s
SD
266.53
s
<
p95
877.66
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 962.12231614s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
4.903158
s
SD
3.636372
s
p50
0.118201
s
<
p95
11.440943
s
≤
p99
11.440943
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.543925
s
SD
0.307235
s
p50
1
s
<
p95
1.897059
s
≤
p99
1.897059
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.918593
s
SD
1.635674
s
p50
0.001555
s
<
p95
6.331429
s
≤
p99
6.331429
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001555
s
SD
0.001063
s
p50
0.000858
s
<
p95
0.003383
s
≤
p99
0.003383
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000805
s
SD
0.000325
s
p50
0.000702
s
<
p95
0.001546
s
≤
p99
0.001546
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.007103
s
SD
0.010889
s
p50
0.005053
s
<
p95
0.016534
s
<
p99
0.070592
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.324533
s
SD
0.17219
s
p50
0.000768
s
<
p95
0.580487
s
≤
p99
0.580487
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.083492
s
SD
0.075767
s
p50
0.000823
s
<
p95
0.285583
s
≤
p99
0.285583
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000356
s
SD
0.00014
s
p50
0.000337
s
<
p95
0.000586
s
<
p99
0.000815
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000247
s
SD
8.8e-05
s
p50
0.000242
s
<
p95
0.000397
s
<
p99
0.00041
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000144
s
SD
4.5e-05
s
p50
0.000143
s
<
p95
0.000229
s
<
p99
0.000272
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.00039
s
SD
0.000224
s
p50
0.000393
s
<
p95
0.00089
s
<
p99
0.001132
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000119
s
SD
4.3e-05
s
p50
0.0001
s
<
p95
0.0002
s
≤
p99
0.0002
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000119
s
SD
5.1e-05
s
p50
0.000136
s
<
p95
0.000236
s
<
p99
0.000305
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00034
s
SD
0.254989
s
p50
0.000233
s
<
p95
0.389765
s
<
p99
1.472036
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000313
s
SD
7.7e-05
s
p50
0.000319
s
<
p95
0.000466
s
<
p99
0.000475
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.046687
s
SD
14.275617
s
p50
0.105869
s
<
p95
60.000897
s
<
p99
60.001269
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.070397
s
SD
0.04024
s
p50
0.105465
s
<
p95
0.110134
s
<
p99
0.110437
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.106342
s
SD
6.210666
s
p50
0.104754
s
<
p95
0.106734
s
<
p99
60.001057
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.116466
s
SD
0.070231
s
p50
0.150377
s
<
p95
0.15597
s
≤
p99
0.15597
s
P2P received remote signals
Count of remote signals received.
total
97
over 840.008194347s
mean rate
0.93
/s
std
0.15
/s
p5
0.8
/s
p95
1.21
/s
peak
1.21
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
32.66
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
12.06
KiB/s
<
mean
110.23
KiB/s
SD
71.96
KiB/s
<
p95
234.50
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
11.99
KiB/s
<
mean
149.09
KiB/s
SD
118.65
KiB/s
<
p95
338.67
KiB/s
Total bytes received
Total bytes received on primary network interface
count
690.04
MiB
mean
736.05
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
933.26
MiB
mean
995.48
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.9%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 35.78 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 14% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2.77
%
<
mean
43.22
%
SD
26.67
%
<
p95
87.18
%
System
10.56
%
CPU percentiles
CPU usage percentiles
p50
40.95
%
p95
87.18
%
p99
98.87
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
7
hosts
mean time
0.10
s
Memory used percentage
Percentage of memory used
p5
19.42
%
<
mean
31.69
%
SD
8.64
%
<
p95
39.8
%
Memory available percentage
Percentage of available memory
p5
60.2
%
<
mean
68.31
%
SD
8.64
%
<
p95
80.58
%
Max host memory used
Maximum memory usage percentage across all hosts
max
38.85
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
35.78
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
26.02
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/3
hosts
Mount Point /efi-boot
0/1
hosts
Mount Point /nix/store
0/3
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.65
5 min
2.26
15 min
1.88
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
14.29
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
9.4985
%
SD
12.9706
%
<
p95
37.04
%
60 second average
9.4607
%
300 second average
8.1972
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
8.6372
%
SD
15.1183
%
<
p95
40.63
%
60 second average
8.5923
%
300 second average
7.5733
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
6.9685
%
SD
12.4826
%
<
p95
33.78
%
60 second average
6.9276
%
300 second average
6.2187
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.22
%
<
mean
4.22
%
SD
14.57
%
<
p95
8.31
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
923.13
KiB
<
mean
1.00
MiB
SD
177.46
KiB
<
p95
1.22
MiB
Holochain process threads
Number of threads in Holochain process
p5
11
threads
<
mean
14.8
threads
SD
3.26
threads
<
p95
20
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
50
file descriptors
<
mean
67.2
file descriptors
SD
10.27
file descriptors
<
p95
78
file descriptors

Validation Receipts

↑ Back to index

Creates an entry, wait for required validation receipts, then repeat. Records the amount of time it took to accumulate the required number of receipts for all DHT operations. This is measured to the nearest 20ms so that we don't keep the agent too busy checking for receipts.

Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

By default, this scenario will wait for a complete set of validation receipts before committing the next record. If the NO_VALIDATION_COMPLETE environment variable is set, it will instead publish new records on every round, building up an ever-growing list of action hashes to check on.

Started
Thu, 25 Jun 2026 02:03:33 UTC
Peer count
20
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
validation_receipts_28140184351_1
Receipts complete timing
The amount of time between publishing a record and receiving the required number of validation receipts.
Mean
mean
6.491943
s
SD
5.201657
s
Max
Highest per-partition mean latency
max mean
27.118512
s
Min
Lowest per-partition mean latency
min mean
5.212757
s
Receipts complete rate
The number of complete validation receipt sets collected per second.
Mean
mean
1.83
/s
Max
Highest per-partition mean rate
max
1.93
/s
Min
Lowest per-partition mean rate
min
1.43
/s
Error count
The total number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37470.228873577s
Not enough time data to show a trend.
WASM usage: 'crud::get_sample_entry_validation_receipts'
Metered usage count of the WASM ribosome for this zome function.
total
1086147
over 37470.228873577s
mean rate
1.22395785e+06
/s
std
2.39658343e+06
/s
p5
1419.78
/s
p95
7.00097161e+06
/s
peak
1.374883273e+07
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37470.228873577s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37470.228873577s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005781
s
SD
0.001929
s
p50
0.00544
s
<
p95
0.011234
s
<
p99
0.012301
s
Zome call duration: 'crud::get_sample_entry_validation_receipts'
Duration of this zome call as measured by Holochain internally.
mean
0.014523
s
SD
0.006289
s
p50
0.01102
s
<
p95
0.021588
s
<
p99
0.036891
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004804
s
SD
0.001609
s
p50
0.004529
s
<
p95
0.009295
s
<
p99
0.010137
s
WASM call duration: 'crud::get_sample_entry_validation_receipts'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.013333
s
SD
0.006111
s
p50
0.009765
s
<
p95
0.020352
s
<
p99
0.034426
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001628
s
SD
0.000771
s
p50
0.001364
s
<
p95
0.004195
s
≤
p99
0.004195
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001619
s
SD
0.000545
s
p50
0.001462
s
<
p95
0.003019
s
<
p99
0.003347
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000411
s
SD
0.000379
s
p50
0.000355
s
<
p95
0.000882
s
<
p99
0.002577
s
Host function call duration: '__hc__get_validation_receipts_1'
Duration of this host function call invoked from within WASM.
mean
0.011086
s
SD
0.005854
s
p50
0.007491
s
<
p95
0.017929
s
<
p99
0.03011
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002554
s
SD
0.000829
s
p50
0.002411
s
<
p95
0.004829
s
<
p99
0.005272
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000416
s
SD
0.000209
s
p50
0.000378
s
<
p95
0.000979
s
<
p99
0.001028
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
48.34
s
<
mean
457.27
s
SD
262.91
s
<
p95
868
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.832979
s
SD
1.489404
s
p50
0.71735
s
<
p95
4.364924
s
<
p99
7.001862
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.949508
s
SD
0.224729
s
p50
1.947293
s
<
p95
1.97651
s
<
p99
1.990299
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.007849
s
SD
0.207935
s
p50
0.004301
s
<
p95
0.037279
s
<
p99
0.936261
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001862
s
SD
0.001538
s
p50
0.001309
s
<
p95
0.006484
s
≤
p99
0.006484
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.002794
s
SD
0.003116
s
p50
0.001113
s
<
p95
0.009605
s
<
p99
0.011546
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.004215
s
SD
0.002077
s
p50
0.003169
s
<
p95
0.008744
s
<
p99
0.01095
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.026111
s
SD
0.838525
s
p50
0.028035
s
<
p95
0.331957
s
<
p99
5.104451
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.467425
s
SD
11.150781
s
p50
0.500694
s
<
p95
34.269903
s
<
p99
58.088102
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000268
s
SD
7.9e-05
s
p50
0.000237
s
<
p95
0.000411
s
<
p99
0.000549
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000603
s
SD
0.000249
s
p50
0.000495
s
<
p95
0.000873
s
<
p99
0.001319
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000226
s
SD
0.000142
s
p50
0.0002
s
<
p95
0.000436
s
<
p99
0.000801
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000195
s
SD
0.000144
s
p50
0.000166
s
<
p95
0.000354
s
<
p99
0.000614
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
9.1e-05
s
SD
2.4e-05
s
p50
8.7e-05
s
<
p95
0.000169
s
≤
p99
0.000169
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000173
s
SD
5.9e-05
s
p50
0.00017
s
<
p95
0.000312
s
<
p99
0.000329
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001596
s
SD
0.00982
s
p50
0.00048
s
<
p95
0.027299
s
<
p99
0.02878
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000364
s
SD
0.000117
s
p50
0.000348
s
<
p95
0.000639
s
<
p99
0.000661
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.088589
s
SD
0.03141
s
p50
0.087572
s
<
p95
0.148396
s
<
p99
0.151203
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.171203
s
SD
0.83716
s
p50
0.158392
s
<
p95
0.243226
s
<
p99
0.256852
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
5.38
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.61
KiB/s
<
mean
31.90
KiB/s
SD
156.32
KiB/s
<
p95
55.97
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
991
B/s
<
mean
35.44
KiB/s
SD
19.72
KiB/s
<
p95
75.29
KiB/s
Total bytes received
Total bytes received on primary network interface
count
539.27
MiB
mean
600.24
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
599.01
MiB
mean
666.72
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 76.41 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 5% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.6
%
<
mean
6.86
%
SD
7.57
%
<
p95
14.05
%
System
1.47
%
CPU percentiles
CPU usage percentiles
p50
5.32
%
p95
14.05
%
p99
45.99
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
3
hosts
mean time
0.01
s
Memory used percentage
Percentage of memory used
p5
5.97
%
<
mean
10.37
%
SD
5.52
%
<
p95
30.05
%
Memory available percentage
Percentage of available memory
p5
69.95
%
<
mean
89.63
%
SD
5.52
%
<
p95
94.03
%
Max host memory used
Maximum memory usage percentage across all hosts
max
30.44
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.01
%
Memory growth rate
Rate of memory growth over time
growth
76.41
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.02
MiB/s
Disk write throughput
Disk write throughput in MiB/s
33.38
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/6
hosts
Mount Point /efi-boot
0/3
hosts
Mount Point /etc/hostname
0/3
hosts
Mount Point /etc/hosts
0/3
hosts
Mount Point /etc/resolv.conf
0/3
hosts
Mount Point /nix/store
0/6
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.75
5 min
1.97
15 min
3.15
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
5.26
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.9802
%
SD
3.316
%
<
p95
3.78
%
60 second average
2.4679
%
300 second average
10.0178
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0001
%
SD
0.0033
%
≤
p95
0
%
60 second average
0.0009
%
300 second average
0.0005
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
6.5955
%
SD
11.9167
%
<
p95
33.53
%
60 second average
7.1363
%
300 second average
8.6290
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
6.428
%
SD
11.6425
%
<
p95
32.7
%
60 second average
6.7618
%
300 second average
7.0933
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.22
%
<
mean
5.41
%
SD
5.2
%
<
p95
11.51
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
226.46
KiB
<
mean
250.59
KiB
SD
27.19
KiB
<
p95
279.53
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
26.69
threads
SD
7.05
threads
<
p95
37
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
48
file descriptors
<
mean
75.8
file descriptors
SD
13.58
file descriptors
<
p95
97
file descriptors

Write/get_agent_activity

↑ Back to index

A scenario where write peers write entries, while get_agent_activity peers each query a single write agent's activity with get_agent_activity.

Before a target write peer and the requesting get_agent_activity peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started
Thu, 25 Jun 2026 02:19:19 UTC
Peer count
30
Behaviours
  • get_agent_activity (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
write_get_agent_activity_28140184351_1
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
3855.33
Max
Highest chain head value observed for any single write agent.
8486
Write agents observed
6
get_agent_activity_full zome call timing
The time taken to call the zome function that retrieves information on a write peer's source chain.
Mean
mean
0.154704
s
SD
0.103406
s
Max
Highest per-partition mean latency
max mean
0.22979
s
Min
Lowest per-partition mean latency
min mean
0.005063
s
Error count
The number of errors accumulated.
33
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000412
s
SD
0.001873
s
p50
0.000595
s
<
p95
0.006228
s
<
p99
0.007296
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 1764.221503182s
Not enough time data to show a trend.
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 897.057283862s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
167794835
over 897.057283862s
mean rate
5.962379241e+07
/s
std
5.577169653e+07
/s
p5
2.82959133e+06
/s
p95
1.911353007e+08
/s
peak
2.1203424379e+08
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
3412572205
over 1895.808071426s
mean rate
2.44542423089e+09
/s
std
4.44053893923e+09
/s
p5
4.57837496e+06
/s
p95
1.20601513158e+10
/s
peak
2.96984729523e+10
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
9547313174
over 37470.419225885s
mean rate
4.6619615462e+08
/s
std
7.4988738644e+08
/s
p5
0
/s
p95
2.03943178603e+09
/s
peak
4.04302547935e+09
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
634957747
over 37470.419225885s
mean rate
5.3704274e+07
/s
std
9.800656237e+07
/s
p5
0
/s
p95
2.4060831572e+08
/s
peak
1.31993820625e+09
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.006209
s
SD
0.003103
s
p50
0.003948
s
<
p95
0.012171
s
≤
p99
0.012171
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.010582
s
SD
0.010008
s
p50
0.006701
s
<
p95
0.037106
s
<
p99
0.039125
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.062045
s
SD
0.049299
s
p50
0.126818
s
<
p95
0.194077
s
<
p99
0.21339
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.003643
s
SD
0.04842
s
p50
0.003893
s
<
p95
0.187532
s
≤
p99
0.187532
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00485
s
SD
0.002196
s
p50
0.003146
s
<
p95
0.008631
s
≤
p99
0.008631
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.009126
s
SD
0.009092
s
p50
0.00554
s
<
p95
0.033168
s
<
p99
0.035105
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.069408
s
SD
0.057591
s
p50
0.136774
s
<
p95
0.22963
s
<
p99
0.234681
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003048
s
SD
0.048274
s
p50
0.003281
s
<
p95
0.186419
s
≤
p99
0.186419
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000967
s
SD
0.00073
s
p50
0.001128
s
<
p95
0.002538
s
<
p99
0.004259
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.9e-05
s
SD
1.3e-05
s
p50
2.3e-05
s
<
p95
5.5e-05
s
≤
p99
5.5e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.002598
s
SD
0.005079
s
p50
0.000653
s
<
p95
0.016127
s
<
p99
0.017457
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000497
s
SD
0.000236
s
p50
0.000378
s
<
p95
0.000888
s
≤
p99
0.000888
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.067422
s
SD
0.056959
s
p50
0.134407
s
<
p95
0.225685
s
<
p99
0.231306
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000647
s
SD
0.047702
s
p50
0.000707
s
<
p95
0.180896
s
≤
p99
0.180896
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
5e-06
s
p50
8e-06
s
<
p95
2.2e-05
s
≤
p99
2.2e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001669
s
SD
0.002033
s
p50
0.001971
s
<
p95
0.005561
s
<
p99
0.012926
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000947
s
SD
0.000752
s
p50
0.000179
s
<
p95
0.001233
s
<
p99
0.004197
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.65
s
<
mean
452.57
s
SD
259.8
s
<
p95
857.7
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
53.250404
s
SD
28.362839
s
p50
36.342268
s
<
p95
89.217853
s
<
p99
98.340521
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.902193
s
SD
0.287854
s
p50
2.000192
s
<
p95
2.008451
s
<
p99
2.012156
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.580419
s
SD
7.782731
s
p50
2.218944
s
<
p95
25.997281
s
<
p99
30.15711
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001477
s
SD
0.001513
s
p50
0.000859
s
<
p95
0.005616
s
<
p99
0.006067
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.026878
s
SD
0.130745
s
p50
0.01594
s
<
p95
0.075682
s
<
p99
0.0936
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.079731
s
SD
0.031977
s
p50
0.002194
s
<
p95
0.100334
s
<
p99
0.134478
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.879581
s
SD
20.855758
s
p50
7.859128
s
<
p95
61.808987
s
<
p99
84.767718
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
2.197329
s
SD
23.676367
s
p50
0.352268
s
<
p95
71.857422
s
<
p99
84.908398
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000859
s
SD
0.00259
s
p50
0.000255
s
<
p95
0.009183
s
<
p99
0.011517
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.004515
s
SD
0.003713
s
p50
0.00267
s
<
p95
0.011587
s
<
p99
0.016606
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000153
s
SD
0.000319
s
p50
0.000173
s
<
p95
0.001012
s
<
p99
0.001669
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000259
s
SD
0.000236
s
p50
0.000229
s
<
p95
0.000742
s
<
p99
0.001195
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000201
s
SD
0.000364
s
p50
9.9e-05
s
<
p95
0.000344
s
<
p99
0.002051
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000285
s
SD
0.000257
s
p50
0.000173
s
<
p95
0.001035
s
<
p99
0.001098
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003327
s
SD
0.011947
s
p50
0.000702
s
<
p95
0.026393
s
<
p99
0.062711
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00165
s
SD
0.002592
s
p50
0.000352
s
<
p95
0.000893
s
<
p99
0.014996
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
3.0964
s
SD
29.769622
s
p50
0.150296
s
<
p95
60.003302
s
<
p99
60.020456
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.145818
s
SD
0.007522
s
p50
0.146195
s
≤
p95
0.146195
s
≤
p99
0.146195
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.166912
s
SD
28.134997
s
p50
0.152254
s
<
p95
60.001796
s
<
p99
60.003496
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.729039
s
SD
14.067377
s
p50
0.665468
s
<
p95
60.00087
s
<
p99
60.001415
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
36.13
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.63
KiB/s
<
mean
550.71
KiB/s
SD
554.03
KiB/s
<
p95
1.31
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
463
B/s
<
mean
768.76
KiB/s
SD
506.29
KiB/s
<
p95
1.62
MiB/s
Total bytes received
Total bytes received on primary network interface
count
13.19
GiB
mean
15.00
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
18.41
GiB
mean
20.95
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.3%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 641.92 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/6 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 21% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
10.64
%
<
mean
43.89
%
SD
27.9
%
<
p95
95.75
%
System
7.76
%
CPU percentiles
CPU usage percentiles
p50
35.78
%
p95
95.75
%
p99
98.35
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
7
hosts
mean time
0.80
s
Memory used percentage
Percentage of memory used
p5
6.4
%
<
mean
14.43
%
SD
13.57
%
<
p95
33.05
%
Memory available percentage
Percentage of available memory
p5
66.95
%
<
mean
85.57
%
SD
13.57
%
<
p95
93.6
%
Max host memory used
Maximum memory usage percentage across all hosts
max
76.38
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.17
%
Memory growth rate
Rate of memory growth over time
growth
641.92
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.12
MiB/s
Disk write throughput
Disk write throughput in MiB/s
166.42
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/10
hosts
Mount Point /efi-boot
0/6
hosts
Mount Point /etc/hostname
1/6
hosts
Mount Point /etc/hosts
1/6
hosts
Mount Point /etc/resolv.conf
1/6
hosts
Mount Point /nix/store
0/10
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.16
5 min
2.45
15 min
2.25
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
21.43
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
16.7176
%
SD
27.4245
%
<
p95
86.62
%
60 second average
15.7576
%
300 second average
11.9789
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
11.6908
%
SD
14.9276
%
<
p95
39.03
%
60 second average
11.2815
%
300 second average
9.6088
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
9.4923
%
SD
12.3318
%
<
p95
32.22
%
60 second average
9.1963
%
300 second average
8.0060
%
Holochain process CPU usage
CPU usage by Holochain process
p5
8.56
%
<
mean
40.73
%
SD
27.01
%
<
p95
93.46
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
234.86
KiB
<
mean
342.68
KiB
SD
66.68
KiB
<
p95
453.95
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
33.47
threads
SD
9.58
threads
<
p95
46
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
55
file descriptors
<
mean
78.47
file descriptors
SD
18.23
file descriptors
<
p95
112
file descriptors

Write/get_agent_activity with volatile conductors

↑ Back to index

A scenario where write peers write entries, while get_agent_activity_volatile peers each query a single write agents activity with get_agent_activity but shutdown and restart their conductors at semi-random intervals.

Before a target write peer and the requesting get_agent_activity_volatile peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started
Thu, 25 Jun 2026 02:35:16 UTC
Peer count
30
Peer count at end
18
Behaviours
  • get_agent_activity_volatile (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
write_get_agent_activity_volatile_28140184351_1
Highest observed action_seq
The rate at which zero-arc readers observe new chain heads on the writers' chains via get_agent_activity. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.
Mean
mean
80.47
/s
Max
Highest per-partition mean rate
max
851.76
/s
Min
Lowest per-partition mean rate
min
7.62
/s
get_agent_activity_full zome call timing
The time taken to call the zome function that retrieves information on a write peer's source chain.
Mean
mean
0.20475
s
SD
0.217823
s
Max
Highest per-partition mean latency
max mean
0.938162
s
Min
Lowest per-partition mean latency
min mean
0.008089
s
Running volatile conductors count
The number of conductors running by get_agent_activity_volatile peers.
p5
7
conductors
<
mean
11.17
conductors
SD
3.28
conductors
<
p95
17
conductors
Volatile conductor total running duration
The total running duration of a get_agent_activity_volatile conductor.
Mean
mean
790.598985
s
SD
427.250134
s
Max
Highest per-partition mean latency
max mean
1406.285714
s
Min
Lowest per-partition mean latency
min mean
195.9
s
Volatile conductor running duration
The duration that a get_agent_activity_volatile conductor was running before being stopped.
Mean
mean
53.220836
s
SD
43.412768
s
Max
Highest per-partition mean latency
max mean
140.642962
s
Min
Lowest per-partition mean latency
min mean
31.414444
s
Volatile conductor stopped duration
The duration that a get_agent_activity_volatile conductor was stopped before being started again.
Mean
mean
37.825148
s
SD
47.317046
s
Max
Highest per-partition mean latency
max mean
57.918193
s
Min
Lowest per-partition mean latency
min mean
7.244823
s
Reached target arc
Did get_agent_activity_volatile peer reach their target arc in the moment before they were shutdown.
  • get_agent_activity_volatile_agent: uhCAk5NVjPR8SFVZqWPQIE8OjVBO1ThCpwQbWAfBdlMe1_xhL8XlQ
p5
0
<
mean
0.14
SD
0.35
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkAeeXsGWL5BDF3m61RfeET5DiDoarfHlrQ6uGJKSVtvtZ48zt
p5
0
<
mean
0.03
SD
0.17
≤
p95
0
  • get_agent_activity_volatile_agent: uhCAkAwJqMeffoPb8uN2dKiRMjHLIP5YjToZxgU-0JvzgoNCTlOko
p5
0
<
mean
0.79
SD
0.41
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkBDzIc-Kkk56ypHA15wBqCqmgfj6JvbEH6YaREyqMmMuX7iUc
p5
0
<
mean
0.26
SD
0.44
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkPoKBUqkpdEM4lOGoclAvE5VozMne2QnWJipLUA5J4xSnl9R6
p5
0
<
mean
0.24
SD
0.43
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkPobb1ZHhf4czB3nQu_unSuPh355mO2epxr8ijkhA1hj2MfcY
p5
0
≤
mean
0
SD
0
≤
p95
0
  • get_agent_activity_volatile_agent: uhCAkS0s39sLPNqY2CG24FRzhXDC_Y-Q6SoLTVFSXO_d-QAYXjn9p
p5
0
<
mean
0.86
SD
0.35
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkVcjAiATrrimdzC5TtIOc_MkOaeK46aX5rLQEtlWwj5d0eT2q
p5
0
<
mean
0.92
SD
0.28
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkYNYTIRiGWUCKaIdN2ZihLdPpfKGtCe4hJW7uBB4fjxyae7r1
p5
0
<
mean
0.38
SD
0.48
<
p95
1
  • get_agent_activity_volatile_agent: uhCAk_v5q5kl8xTo2DS4b198sqfRf9EwE443MBVOVPVp-HiQ6n9Am
p5
0
<
mean
0.39
SD
0.49
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkaDQ4njryqB5TNNSnLSpoVnBoY5EWMTG9-e2Man5QrQKsjwBm
p5
0
<
mean
0.28
SD
0.45
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkbqOn7-z3SEZGZzsYc91BdJFsxBw61bR_wysmGT1d0LTa5fjb
p5
0
<
mean
0.24
SD
0.43
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkd9m34MAzVfD7nPKAklMu1mqDRZrmTZ2Z0SH491MXrOWdqWhr
p5
0
<
mean
0.34
SD
0.48
<
p95
1
  • get_agent_activity_volatile_agent: uhCAklBzy-e1hraVK_NXNugA0HM4w63OYhs5FpD7TjxDKT2JwaEr5
p5
0
<
mean
0.23
SD
0.42
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkm9o_ANJugn-aTvaPkNwLQiPXwqdizI3HfDtblnkqpadXIhQg
p5
0
<
mean
0.27
SD
0.44
<
p95
1
  • get_agent_activity_volatile_agent: uhCAknriAnNrsMMx3NQuegGO5LznipJlECnsJR7mmqrF8PkQI6EvF
p5
0
<
mean
0.9
SD
0.3
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkp6fMQuISGfhQddSdsuUodPD2XHH23QiRkjXjhXou_aCpR5Lw
p5
0
<
mean
0.6
SD
0.49
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkw_Cz0phozSVZpDU28_N8qd5rH2BNE1SkJscJZYHpOuV7okLW
p5
0
<
mean
0.24
SD
0.43
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkye6b4vuf-Clpv80J9YhSGBM--YsgYjODZaX1fpnqrmqMXqp5
p5
0
<
mean
0.18
SD
0.38
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkz5HIAm6DmSlUkAELehbdqlniQ7aCjom-IC-PHzWH0u1LVli4
p5
0
<
mean
0.22
SD
0.41
<
p95
1
Error count
The number of errors accumulated.
122
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000355
s
SD
0.003928
s
p50
0.000393
s
<
p95
0.017454
s
≤
p99
0.017454
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
4
over 1700.021842174s
mean rate
2.32
/s
std
4.44
/s
p5
0
/s
p95
12.17
/s
peak
12.53
/s
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 33981.801970498s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
283833533
over 33981.801970498s
mean rate
8.209975757e+07
/s
std
1.0066853638e+08
/s
p5
126955.61
/s
p95
3.0832671911e+08
/s
peak
3.3470152727e+08
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
19930641
over 2800.948487333s
mean rate
8.9749957136e+08
/s
std
7.04054047795e+09
/s
p5
2.39686616e+06
/s
p95
1.20379876175e+09
/s
peak
1.18629442068e+11
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
220385403
over 38346.842132609s
mean rate
7.9903632102e+08
/s
std
5.09674081542e+09
/s
p5
0
/s
p95
2.05046387627e+09
/s
peak
4.11044582148e+10
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
14486835
over 38347.137935596s
mean rate
1.506190361e+07
/s
std
9.40220454e+07
/s
p5
11552.36
/s
p95
3.594379317e+07
/s
peak
2.73563012723e+09
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.006047
s
SD
0.001285
s
p50
0.006755
s
<
p95
0.007436
s
≤
p99
0.007436
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006386
s
SD
0.002861
s
p50
0.005615
s
<
p95
0.013812
s
<
p99
0.015314
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.067481
s
SD
0.288957
s
p50
0.190726
s
<
p95
0.717972
s
<
p99
1.950588
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.003671
s
SD
0.475866
s
p50
0.003681
s
<
p95
2.059903
s
≤
p99
2.059903
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005056
s
SD
0.001048
s
p50
0.005735
s
<
p95
0.006176
s
≤
p99
0.006176
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005293
s
SD
0.0025
s
p50
0.004626
s
<
p95
0.011803
s
<
p99
0.013128
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.08725
s
SD
12.49933
s
p50
0.193823
s
<
p95
0.905383
s
<
p99
99.970989
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003099
s
SD
0.467595
s
p50
0.003119
s
<
p95
2.027768
s
≤
p99
2.027768
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001537
s
SD
0.000453
s
p50
0.001451
s
<
p95
0.002451
s
<
p99
0.002651
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.3e-05
s
SD
1e-05
s
p50
3.1e-05
s
<
p95
5.6e-05
s
≤
p99
5.6e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000667
s
SD
0.000754
s
p50
0.000432
s
<
p95
0.002671
s
<
p99
0.003359
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000421
s
SD
9.5e-05
s
p50
0.000474
s
<
p95
0.000521
s
≤
p99
0.000521
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.084837
s
SD
12.499506
s
p50
0.18788
s
<
p95
0.899464
s
<
p99
99.960525
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000641
s
SD
0.467602
s
p50
0.000547
s
<
p95
2.025251
s
≤
p99
2.025251
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
7e-06
s
SD
4e-06
s
p50
8e-06
s
<
p95
2.1e-05
s
≤
p99
2.1e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002856
s
SD
0.001093
s
p50
0.002606
s
<
p95
0.006414
s
<
p99
0.0066
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000427
s
SD
0.000312
s
p50
0.000372
s
<
p95
0.001231
s
<
p99
0.001338
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
5.91
s
<
mean
392.27
s
SD
536.54
s
<
p95
1598.22
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
29.893664
s
SD
73.280217
s
p50
25.000752
s
<
p95
155.618714
s
<
p99
407.160529
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.708272
s
SD
0.953262
s
p50
1.801761
s
<
p95
3.6
s
<
p99
5.909091
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.217689
s
SD
3.287858
s
p50
0.095618
s
<
p95
8.386196
s
<
p99
16.820905
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001316
s
SD
0.000942
s
p50
0.001077
s
<
p95
0.003212
s
<
p99
0.005619
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.022252
s
SD
0.026088
s
p50
0.003091
s
<
p95
0.056333
s
<
p99
0.125042
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.054152
s
SD
0.071285
s
p50
0.012422
s
<
p95
0.116496
s
<
p99
0.369794
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.692699
s
SD
24.532246
s
p50
0.54869
s
<
p95
54.784189
s
<
p99
70.464486
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.624714
s
SD
30.7878
s
p50
1.906765
s
<
p95
54.611188
s
<
p99
142.215152
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.004444
s
SD
0.002046
s
p50
0.000301
s
<
p95
0.00616
s
<
p99
0.008003
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.004521
s
SD
0.00393
s
p50
0.001463
s
<
p95
0.011571
s
<
p99
0.017642
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.0003
s
SD
0.000164
s
p50
0.000154
s
<
p95
0.000398
s
<
p99
0.000899
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000191
s
SD
0.00013
s
p50
0.000145
s
<
p95
0.000468
s
<
p99
0.000647
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.010787
s
SD
0.010627
s
p50
0.013911
s
<
p95
0.021802
s
<
p99
0.060715
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000216
s
SD
0.000141
s
p50
0.000149
s
<
p95
0.000387
s
<
p99
0.000749
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003551
s
SD
0.043886
s
p50
0.001008
s
<
p95
0.029916
s
<
p99
0.176085
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.0006
s
SD
0.00043
s
p50
0.000414
s
<
p95
0.001691
s
<
p99
0.002468
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
6.109904
s
SD
28.346607
s
p50
0.152378
s
<
p95
60.002038
s
<
p99
60.00865
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.168236
s
SD
0.147312
s
p50
0.132888
s
<
p95
0.461973
s
≤
p99
0.461973
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.255156
s
SD
12.549398
s
p50
0.192064
s
<
p95
2.295384
s
<
p99
60.001527
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.491123
s
SD
27.927084
s
p50
0.312545
s
<
p95
60.00171
s
<
p99
60.004953
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
18.01
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
395
B/s
<
mean
261.45
KiB/s
SD
484.82
KiB/s
<
p95
1.15
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
188
B/s
<
mean
335.70
KiB/s
SD
525.58
KiB/s
<
p95
1.40
MiB/s
Total bytes received
Total bytes received on primary network interface
count
11.08
GiB
mean
6.00
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
14.22
GiB
mean
7.71
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 93.4%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 310.18 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/5 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 11% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.78
%
<
mean
22.64
%
SD
27.73
%
<
p95
90.03
%
System
4.63
%
CPU percentiles
CPU usage percentiles
p50
10.79
%
p95
90.03
%
p99
93.38
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
6
hosts
mean time
0.37
s
Memory used percentage
Percentage of memory used
p5
5.37
%
<
mean
12.19
%
SD
11.15
%
<
p95
34.59
%
Memory available percentage
Percentage of available memory
p5
65.41
%
<
mean
87.81
%
SD
11.15
%
<
p95
94.63
%
Max host memory used
Maximum memory usage percentage across all hosts
max
74.01
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.17
%
Memory growth rate
Rate of memory growth over time
growth
310.18
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.16
MiB/s
Disk write throughput
Disk write throughput in MiB/s
83.62
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/11
hosts
Mount Point /efi-boot
0/6
hosts
Mount Point /etc/hostname
1/5
hosts
Mount Point /etc/hosts
1/5
hosts
Mount Point /etc/resolv.conf
1/5
hosts
Mount Point /nix/store
0/11
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.65
5 min
1.82
15 min
2.01
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
10.71
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
6.3176
%
SD
17.2992
%
<
p95
46.83
%
60 second average
6.3821
%
300 second average
7.2471
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
7.4041
%
SD
13.161
%
<
p95
38
%
60 second average
7.5248
%
300 second average
8.2537
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
6.5307
%
SD
11.6256
%
<
p95
33.73
%
60 second average
6.6292
%
300 second average
7.2040
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
<
mean
20.37
%
SD
26.69
%
<
p95
83.57
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
52.99
KiB
<
mean
223.41
KiB
SD
145.25
KiB
<
p95
500.50
KiB
Holochain process threads
Number of threads in Holochain process
p5
7
threads
<
mean
24.07
threads
SD
13.01
threads
<
p95
45
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
23
file descriptors
<
mean
72.84
file descriptors
SD
27.39
file descriptors
<
p95
128
file descriptors

Write/Query

↑ Back to index

Creates an entry, then queries the source chain and performs a simple operation on the entries, then repeats.

Started
Thu, 25 Jun 2026 01:22:09 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
write_query_28140184351_1
Write timing
The time it takes to complete the zome function call that writes the entry.
mean
0.024033
s
SD
0.009064
s
p50
0.02252
s
<
p95
0.040956
s
<
p99
0.048139
s
Write rate
The number of writes completed per second.
mean
98.41
/s
Query timing
The time it takes to complete the chain_query_count_len zome call that queries the source chain.
mean
0.076194
s
SD
0.031763
s
p50
0.076011
s
<
p95
0.128473
s
<
p99
0.145423
s
Query rate
The number of chain queries completed per second.
mean
98.41
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::chain_query_count_len'
Metered usage count of the WASM ribosome for this zome function.
total
152575771425
over 290.003130836s
mean rate
5.2611870956e+08
/s
std
1.8927158261e+08
/s
p5
1.5551133841e+08
/s
p95
7.5618669488e+08
/s
peak
8.1067382833e+08
/s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
120753738
over 290.003130836s
mean rate
416387.29
/s
std
93492.5
/s
p5
314413.86
/s
p95
603346.28
/s
peak
705309.68
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 290.003130836s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
26423880
over 290.003130836s
mean rate
91115.76
/s
std
20509.23
/s
p5
68789.36
/s
p95
132468.54
/s
peak
154776.71
/s
Zome call duration: 'crud::chain_query_count_len'
Duration of this zome call as measured by Holochain internally.
mean
0.052641
s
SD
0.013714
s
p50
0.048755
s
<
p95
0.064283
s
<
p99
0.065282
s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.007256
s
SD
0.001182
s
p50
0.007613
s
<
p95
0.00999
s
<
p99
0.010356
s
WASM call duration: 'crud::chain_query_count_len'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.051227
s
SD
0.013921
s
p50
0.047305
s
<
p95
0.063007
s
<
p99
0.064016
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006012
s
SD
0.000977
s
p50
0.00631
s
<
p95
0.008268
s
<
p99
0.008591
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001398
s
SD
0
s
p50
0.001398
s
≤
p95
0.001398
s
≤
p99
0.001398
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002
s
SD
0.000308
s
p50
0.002094
s
<
p95
0.002716
s
<
p99
0.002805
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000558
s
SD
0.000185
s
p50
0.000486
s
<
p95
0.000765
s
<
p99
0.000803
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.015616
s
SD
0.005023
s
p50
0.014414
s
<
p95
0.019582
s
<
p99
0.019903
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.003108
s
SD
0.000483
s
p50
0.00325
s
<
p95
0.004272
s
<
p99
0.004469
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000486
s
SD
0.000124
s
p50
0.000512
s
<
p95
0.000786
s
<
p99
0.000863
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.33
s
<
mean
153.33
s
SD
86.56
s
<
p95
288.33
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
8526
over 290.003030449s
mean rate
29.4
/s
std
6.6
/s
p5
22.2
/s
p95
42.6
/s
peak
49.8
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.003514
s
SD
0.00058
s
p50
0.00367
s
<
p95
0.004723
s
<
p99
0.005598
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000485
s
SD
0
s
p50
0.000485
s
≤
p95
0.000485
s
≤
p99
0.000485
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000747
s
SD
0
s
p50
0.000747
s
≤
p95
0.000747
s
≤
p99
0.000747
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001514
s
SD
0.000195
s
p50
0.001582
s
<
p95
0.001924
s
<
p99
0.001984
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.023838
s
SD
0.006583
s
p50
0.02221
s
<
p95
0.02908
s
<
p99
0.029555
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001199
s
SD
0
s
p50
0.001199
s
≤
p95
0.001199
s
≤
p99
0.001199
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.006308
s
SD
0.001625
s
p50
0.005995
s
<
p95
0.007454
s
<
p99
0.007515
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.00388
s
SD
0.001077
s
p50
0.003683
s
<
p95
0.004627
s
<
p99
0.004677
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002259
s
SD
0.000838
s
p50
0.0022
s
<
p95
0.00303
s
<
p99
0.003071
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000238
s
SD
3.2e-05
s
p50
0.000249
s
<
p95
0.000309
s
<
p99
0.000311
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000216
s
SD
2.8e-05
s
p50
0.000212
s
<
p95
0.000286
s
<
p99
0.000301
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
9.3e-05
s
SD
0
s
p50
9.3e-05
s
≤
p95
9.3e-05
s
≤
p99
9.3e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000179
s
SD
2.2e-05
s
p50
0.00018
s
<
p95
0.000239
s
<
p99
0.00024
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00138
s
SD
0.010396
s
p50
0.001314
s
<
p95
0.026946
s
≤
p99
0.026946
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00048
s
SD
7.7e-05
s
p50
0.000503
s
<
p95
0.000662
s
<
p99
0.000668
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
33.63
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
17.09
KiB/s
<
mean
246.25
KiB/s
SD
1.16
MiB/s
≤
p95
27.22
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
20.98
KiB/s
<
mean
26.68
KiB/s
SD
17.31
KiB/s
≤
p95
25.49
KiB/s
Total bytes received
Total bytes received on primary network interface
count
69.74
MiB
mean
246.25
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
7.56
MiB
mean
26.68
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 81.56 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
39.46
%
<
mean
41.12
%
SD
3.07
%
<
p95
42.29
%
System
7.49
%
CPU percentiles
CPU usage percentiles
p50
40.37
%
p95
42.29
%
p99
56.80
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
14.91
%
<
mean
15.29
%
SD
0.64
%
<
p95
15.82
%
Memory available percentage
Percentage of available memory
p5
84.18
%
<
mean
84.71
%
SD
0.64
%
<
p95
85.09
%
Max host memory used
Maximum memory usage percentage across all hosts
max
15.29
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
81.56
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
2.11
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.61
5 min
0.86
15 min
0.37
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
1.01
%
<
mean
1.858
%
SD
1.0359
%
<
p95
4.11
%
60 second average
1.6717
%
300 second average
0.8950
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
30.67
%
<
mean
33.26
%
SD
5.63
%
<
p95
35.67
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
234.66
KiB
<
mean
244.57
KiB
SD
10.26
KiB
<
p95
256.22
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
13.57
threads
SD
1.28
threads
<
p95
14
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
59
file descriptors
<
mean
60.6
file descriptors
SD
3.85
file descriptors
<
p95
68
file descriptors

Write/Read

↑ Back to index

Creates an entry and reads it back, then repeats.

Started
Thu, 25 Jun 2026 01:23:56 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
write_read_28140184351_1
Write timing
The time taken to write the entry.
mean
0.01825
s
SD
0.008521
s
p50
0.0171
s
<
p95
0.036801
s
<
p99
0.045046
s
Write rate
The number of writes completed per second.
mean
203.96
/s
Read timing
The time taken to read the entry.
mean
0.029867
s
SD
0.020069
s
p50
0.025054
s
<
p95
0.06624
s
<
p99
0.075744
s
Read rate
The number of reads completed per second.
mean
203.96
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.010766
s
SD
0.00417
s
p50
0.009977
s
<
p95
0.014889
s
<
p99
0.015205
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
250387677
over 290.004583127s
mean rate
863395.78
/s
std
547154.18
/s
p5
416389.58
/s
p95
2.32837633e+06
/s
peak
2.48135532e+06
/s
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
284634674
over 290.004583127s
mean rate
981487.51
/s
std
622059.21
/s
p5
473268.45
/s
p95
2.65126193e+06
/s
peak
2.8198818e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 290.004583127s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
27390664
over 290.004583127s
mean rate
94449.47
/s
std
59854.85
/s
p5
45550.11
/s
p95
254708.12
/s
peak
271442.95
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.00322
s
SD
0.000544
s
p50
0.003198
s
<
p95
0.004203
s
<
p99
0.006077
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.012445
s
SD
0.004048
s
p50
0.011637
s
<
p95
0.016564
s
<
p99
0.01688
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002643
s
SD
0.000475
s
p50
0.002618
s
<
p95
0.003523
s
<
p99
0.005125
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.011827
s
SD
0.004065
s
p50
0.011023
s
<
p95
0.01594
s
<
p99
0.016256
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001136
s
SD
0
s
p50
0.001136
s
≤
p95
0.001136
s
≤
p99
0.001136
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000884
s
SD
0.000177
s
p50
0.000873
s
<
p95
0.00122
s
<
p99
0.001802
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000239
s
SD
2.4e-05
s
p50
0.000243
s
<
p95
0.000266
s
<
p99
0.00042
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.010807
s
SD
0.00417
s
p50
0.010017
s
<
p95
0.014931
s
<
p99
0.015247
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001415
s
SD
0.000251
s
p50
0.001404
s
<
p95
0.001879
s
<
p99
0.002726
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000197
s
SD
1.9e-05
s
p50
0.000194
s
<
p95
0.000209
s
<
p99
0.000294
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.56
s
<
mean
153.56
s
SD
86.56
s
<
p95
288.56
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
17682
over 290.004599443s
mean rate
60.97
/s
std
38.66
/s
p5
29.4
/s
p95
164.4
/s
peak
175.5
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.001289
s
SD
0.000236
s
p50
0.001282
s
<
p95
0.00168
s
<
p99
0.002541
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000263
s
SD
0
s
p50
0.000263
s
≤
p95
0.000263
s
≤
p99
0.000263
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000535
s
SD
0
s
p50
0.000535
s
≤
p95
0.000535
s
≤
p99
0.000535
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000745
s
SD
4.3e-05
s
p50
0.00074
s
<
p95
0.000772
s
<
p99
0.000827
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.02763
s
SD
0.010413
s
p50
0.025089
s
<
p95
0.038722
s
<
p99
0.039658
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.00044
s
SD
0
s
p50
0.00044
s
≤
p95
0.00044
s
≤
p99
0.00044
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.005364
s
SD
0.001685
s
p50
0.005008
s
<
p95
0.007012
s
<
p99
0.007156
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.003628
s
SD
0.001354
s
p50
0.003356
s
<
p95
0.005
s
<
p99
0.005113
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.00477
s
SD
0.001903
s
p50
0.004478
s
<
p95
0.006724
s
<
p99
0.006874
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000121
s
SD
1.3e-05
s
p50
0.000119
s
<
p95
0.000132
s
<
p99
0.000167
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.005403
s
SD
0.002085
s
p50
0.005009
s
<
p95
0.007464
s
<
p99
0.007623
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
7.2e-05
s
SD
0
s
p50
7.2e-05
s
≤
p95
7.2e-05
s
≤
p99
7.2e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
9.9e-05
s
SD
9e-06
s
p50
9.9e-05
s
<
p95
0.000107
s
<
p99
0.00013
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00129
s
SD
0.007631
s
p50
0.000475
s
<
p95
0.019754
s
≤
p99
0.019754
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000213
s
SD
3e-05
s
p50
0.000211
s
<
p95
0.000267
s
<
p99
0.000368
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
47.04
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
908
B/s
<
mean
227.23
KiB/s
SD
1.16
MiB/s
≤
p95
7.37
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
21
B/s
<
mean
3.11
KiB/s
SD
12.81
KiB/s
≤
p95
2.50
KiB/s
Total bytes received
Total bytes received on primary network interface
count
64.35
MiB
mean
227.23
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
901.06
KiB
mean
3.11
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 478.89 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
42.99
%
<
mean
55.27
%
SD
11.65
%
<
p95
73.1
%
System
8.23
%
CPU percentiles
CPU usage percentiles
p50
49.41
%
p95
73.10
%
p99
80.48
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.03
s
Memory used percentage
Percentage of memory used
p5
6.04
%
<
mean
7.01
%
SD
1.27
%
<
p95
8.98
%
Memory available percentage
Percentage of available memory
p5
91.02
%
<
mean
92.99
%
SD
1.27
%
<
p95
93.96
%
Max host memory used
Maximum memory usage percentage across all hosts
max
7.01
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
478.89
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
3.05
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.95
5 min
0.84
15 min
0.33
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.69
%
<
mean
5.0657
%
SD
6.2077
%
<
p95
15.94
%
60 second average
3.2047
%
300 second average
1.1597
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0267
%
SD
0.0738
%
<
p95
0.18
%
60 second average
0.0120
%
300 second average
0.0007
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0087
%
SD
0.0337
%
<
p95
0.06
%
60 second average
0.0033
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
21.06
%
<
mean
40.3
%
SD
11.31
%
<
p95
49.38
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
133.85
KiB
<
mean
245.96
KiB
SD
37.37
KiB
<
p95
264.27
KiB
Holochain process threads
Number of threads in Holochain process
p5
14
threads
<
mean
14.47
threads
SD
0.92
threads
<
p95
17
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
44
file descriptors
<
mean
59.27
file descriptors
SD
5.8
file descriptors
<
p95
66
file descriptors

Write validated

↑ Back to index

Creates an entry, updates it and links the create to the update, then repeats. Each of the three actions is validated by the included hApp.

Started
Thu, 25 Jun 2026 01:25:37 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
write_validated_28140184351_1
Write timing
The time it takes to complete the zome function call that writes the entry, updates it, and links to the update.
mean
0.17498
s
SD
0.426766
s
p50
0.022258
s
<
p95
1.264452
s
<
p99
2.256262
s
Write rate
The number of write zome function calls that complete per second.
mean
23.96
/s
Read timing
The time it takes to complete the zome function call that reads the data.
mean
0.242257
s
SD
0.52546
s
p50
0.044135
s
<
p95
1.512792
s
<
p99
2.564363
s
Read rate
The number of read zome function calls that complete per second.
mean
21.81
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000481
s
SD
0.000148
s
p50
0.000653
s
<
p95
0.000686
s
<
p99
0.000688
s
WASM usage: 'validated::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
25369518
over 280.003009819s
mean rate
90604.43
/s
std
20929.62
/s
p5
69785.8
/s
p95
114941.37
/s
peak
160096.82
/s
WASM usage: 'validated::update_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
29796803
over 280.003009819s
mean rate
106415.99
/s
std
25417.31
/s
p5
77018.2
/s
p95
134781.92
/s
peak
192545.5
/s
WASM usage: 'validated_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
43822660
over 290.003133253s
mean rate
151110.95
/s
std
55848.88
/s
p5
105107.53
/s
p95
256312.67
/s
peak
389079.2
/s
WASM usage: 'validated_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
501880930
over 280.003009819s
mean rate
1.79241224e+06
/s
std
424620.51
/s
p5
1.3170457e+06
/s
p95
2.27108535e+06
/s
peak
3.22466634e+06
/s
Zome call duration: 'validated::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.003825
s
SD
6e-05
s
p50
0.003832
s
<
p95
0.003847
s
≤
p99
0.003847
s
Zome call duration: 'validated::update_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004758
s
SD
5.9e-05
s
p50
0.004757
s
<
p95
0.004788
s
≤
p99
0.004788
s
WASM call duration: 'validated::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003019
s
SD
5.6e-05
s
p50
0.003025
s
<
p95
0.00304
s
<
p99
0.003046
s
WASM call duration: 'validated::update_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004028
s
SD
4.2e-05
s
p50
0.004026
s
<
p95
0.004054
s
<
p99
0.004056
s
WASM call duration: 'validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000888
s
SD
2.8e-05
s
p50
0.000886
s
<
p95
0.000897
s
<
p99
0.000898
s
WASM call duration: 'validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002709
s
SD
3.9e-05
s
p50
0.0027
s
<
p95
0.002744
s
<
p99
0.002746
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000276
s
SD
4e-06
s
p50
0.000274
s
<
p95
0.000279
s
<
p99
0.000281
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000294
s
SD
4e-06
s
p50
0.000295
s
<
p95
0.000297
s
<
p99
0.000298
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.000567
s
SD
1.9e-05
s
p50
0.000558
s
<
p95
0.000589
s
<
p99
0.000591
s
Host function call duration: '__hc__update_1'
Duration of this host function call invoked from within WASM.
mean
0.000993
s
SD
1.1e-05
s
p50
0.00099
s
<
p95
0.001008
s
<
p99
0.00101
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001486
s
SD
6.2e-05
s
p50
0.001566
s
<
p95
0.001603
s
<
p99
0.001609
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000261
s
SD
2.1e-05
s
p50
0.000255
s
<
p95
0.00028
s
<
p99
0.000282
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.14
s
<
mean
152.14
s
SD
86.56
s
<
p95
287.15
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
7465
over 290.003136384s
mean rate
25.74
/s
std
9.49
/s
p5
17.6
/s
p95
43.2
/s
peak
66.4
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.05275
s
SD
0.01575
s
p50
0.049382
s
<
p95
0.064865
s
<
p99
0.094306
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000394
s
SD
0
s
p50
0.000394
s
≤
p95
0.000394
s
≤
p99
0.000394
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001279
s
SD
0
s
p50
0.001279
s
≤
p95
0.001279
s
≤
p99
0.001279
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.027052
s
SD
0.007707
s
p50
0.027248
s
<
p95
0.031311
s
<
p99
0.032094
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.020961
s
SD
0.00954
s
p50
0.014721
s
<
p95
0.03158
s
<
p99
0.034276
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.00044
s
SD
0
s
p50
0.00044
s
≤
p95
0.00044
s
≤
p99
0.00044
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.004324
s
SD
0.001532
s
p50
0.003786
s
<
p95
0.005706
s
<
p99
0.00587
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.001385
s
SD
0.000432
s
p50
0.001249
s
<
p95
0.00177
s
<
p99
0.001812
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000797
s
SD
0.000319
s
p50
0.000735
s
<
p95
0.001096
s
<
p99
0.001129
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000113
s
SD
8e-06
s
p50
0.000111
s
<
p95
0.000119
s
<
p99
0.00014
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000239
s
SD
8e-06
s
p50
0.000234
s
<
p95
0.000249
s
<
p99
0.00025
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
9.2e-05
s
SD
0
s
p50
9.2e-05
s
≤
p95
9.2e-05
s
≤
p99
9.2e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
7.5e-05
s
SD
4e-06
s
p50
7.3e-05
s
<
p95
7.8e-05
s
<
p99
7.9e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.013395
s
SD
0.388907
s
p50
0.0029
s
<
p95
1.04708
s
≤
p99
1.04708
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000233
s
SD
7.8e-05
s
p50
0.000232
s
<
p95
0.000234
s
<
p99
0.000667
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
7.91
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
67
B/s
<
mean
354
B/s
SD
359
B/s
<
p95
681
B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
29
B/s
<
mean
315
B/s
SD
293
B/s
<
p95
1.13
KiB/s
Total bytes received
Total bytes received on primary network interface
count
103.71
KiB
mean
354
B/s
Total bytes sent
Total bytes sent on primary network interface
count
92.19
KiB
mean
315
B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
5.06
%
<
mean
10.21
%
SD
11.37
%
<
p95
15.42
%
System
2.30
%
CPU percentiles
CPU usage percentiles
p50
8.10
%
p95
15.42
%
p99
70.50
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
13.76
%
<
mean
14.33
%
SD
1.13
%
<
p95
14.87
%
Memory available percentage
Percentage of available memory
p5
85.13
%
<
mean
85.67
%
SD
1.13
%
<
p95
86.24
%
Max host memory used
Maximum memory usage percentage across all hosts
max
14.33
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-101.37
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
5.98
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /efi-boot
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.53
5 min
0.73
15 min
0.30
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0548
%
SD
0.119
%
<
p95
0.37
%
60 second average
0.0406
%
300 second average
0.0116
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
9.32
%
<
mean
35.0329
%
SD
8.9033
%
<
p95
45.33
%
60 second average
29.1952
%
300 second average
13.6258
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
8.88
%
<
mean
34.3861
%
SD
8.8232
%
<
p95
44.65
%
60 second average
28.6587
%
300 second average
13.3761
%
Holochain process CPU usage
CPU usage by Holochain process
p5
4.74
%
<
mean
9.47
%
SD
11.55
%
<
p95
14.28
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
468.54
KiB
≤
mean
462.41
KiB
SD
59.58
KiB
<
p95
474.28
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
14.2
threads
SD
1.14
threads
<
p95
15
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
63
file descriptors
<
mean
64.67
file descriptors
SD
6.12
file descriptors
<
p95
72
file descriptors

Write Validated must_get_agent_activity

↑ Back to index

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Mixed-Arc must_get_agent_activity, but all agents are full-arc.

Started
Thu, 25 Jun 2026 03:06:04 UTC
Peer count
30
Peer count at end
26
Behaviours
  • must_get_agent_activity (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
write_validated_must_get_agent_activity_28140184351_1
Highest observed action_seq
The maximum chain length observed per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1471.67
Max
Highest chain head value observed for any single write agent.
1897
Write agents observed
3
Chain batch delay timing
The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.
Mean
mean
86.517186
s
SD
40.616565
s
Max
Highest per-partition mean latency
max mean
467.3853
s
Min
Lowest per-partition mean latency
min mean
9.190829
s
Chain batch delay rate
The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.
Mean
mean
2.06
/s
Max
Highest per-partition mean rate
max
5.12
/s
Min
Lowest per-partition mean rate
min
0
/s
create_validated_sample_entry zome call timing
The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.
Mean
mean
0.668371
s
SD
0.312597
s
Max
Highest per-partition mean latency
max mean
4.2565
s
Min
Lowest per-partition mean latency
min mean
0.090277
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.
Total
344
Agents affected
12 / 12
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
29
Max
Highest count in any single partition
54
Min
Lowest count in any single partition
7
Final error count
The total number of all types of error accumulated over the run by all agents.
74017
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.032618
s
SD
0.021181
s
p50
0.003709
s
<
p95
0.056572
s
<
p99
0.09394
s
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.004132
s
SD
0.002222
s
p50
0.003193
s
<
p95
0.01023
s
≤
p99
0.01023
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.06041
s
SD
0.013096
s
p50
0.054557
s
<
p95
0.087801
s
<
p99
0.090349
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004758
s
SD
0.001618
s
p50
0.005114
s
<
p95
0.007997
s
<
p99
0.012602
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.059821
s
SD
0.030211
s
p50
0.033272
s
<
p95
0.100714
s
<
p99
0.134815
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.008187
s
SD
0.004613
s
p50
0.006616
s
<
p95
0.023702
s
≤
p99
0.023702
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003483
s
SD
0.001975
s
p50
0.002677
s
<
p95
0.008893
s
≤
p99
0.008893
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.059197
s
SD
0.012827
s
p50
0.0535
s
<
p95
0.085821
s
<
p99
0.088517
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003922
s
SD
0.00136
s
p50
0.004161
s
<
p95
0.00667
s
<
p99
0.010538
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.038983
s
SD
0.023607
s
p50
0.031087
s
<
p95
0.076788
s
<
p99
0.113617
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.007028
s
SD
0.004473
s
p50
0.005553
s
<
p95
0.022772
s
≤
p99
0.022772
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001217
s
SD
0.000401
s
p50
0.001212
s
<
p95
0.002178
s
<
p99
0.002509
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006966
s
SD
0.010083
s
p50
0.005917
s
<
p95
0.027107
s
<
p99
0.04573
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.6e-05
s
SD
1e-05
s
p50
2.9e-05
s
<
p95
5e-05
s
<
p99
5.7e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000474
s
SD
0.000134
s
p50
0.00043
s
<
p95
0.000706
s
<
p99
0.00087
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000485
s
SD
0.000276
s
p50
0.000401
s
<
p95
0.001387
s
≤
p99
0.001387
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.032708
s
SD
0.021169
s
p50
0.003791
s
<
p95
0.05668
s
<
p99
0.094044
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.035145
s
SD
0.021059
s
p50
0.024027
s
<
p95
0.073375
s
<
p99
0.09442
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.007026
s
SD
0.003113
s
p50
0.005145
s
<
p95
0.01133
s
<
p99
0.013853
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1.4e-05
s
SD
4e-06
s
p50
1.3e-05
s
<
p95
2.1e-05
s
≤
p99
2.1e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002058
s
SD
0.000848
s
p50
0.002363
s
<
p95
0.004325
s
<
p99
0.004493
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000374
s
SD
0.000208
s
p50
0.000322
s
<
p95
0.000757
s
<
p99
0.001067
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.99
s
<
mean
454.25
s
SD
260.75
s
<
p95
858.54
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
26.044824
s
SD
70.317772
s
p50
8.970822
s
<
p95
188.462433
s
<
p99
334.794323
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
2.000885
s
SD
0.294453
s
p50
1.997365
s
<
p95
2.125063
s
<
p99
2.288355
s
App validation workflow duration
Time spent running the app validation workflow.
mean
3.586109
s
SD
24.688875
s
p50
2.679913
s
<
p95
74.92028
s
<
p99
112.865248
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001186
s
SD
0.001278
s
p50
0.000663
s
<
p95
0.004731
s
<
p99
0.005815
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.020601
s
SD
0.019876
s
p50
0.005583
s
<
p95
0.062813
s
<
p99
0.081754
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.010058
s
SD
0.01174
s
p50
0.002329
s
<
p95
0.030656
s
<
p99
0.05417
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.391317
s
SD
1.221653
s
p50
0.395047
s
<
p95
2.561128
s
<
p99
7.684277
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
14.426897
s
SD
21.488612
s
p50
15.525421
s
<
p95
65.606494
s
<
p99
83.76305
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.009815
s
SD
0.006902
s
p50
0.005572
s
<
p95
0.018408
s
<
p99
0.032093
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002327
s
SD
0.001742
s
p50
0.001371
s
<
p95
0.005204
s
<
p99
0.007821
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000238
s
SD
6.8e-05
s
p50
0.000201
s
<
p95
0.000326
s
<
p99
0.00046
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.012666
s
SD
0.006969
s
p50
0.006747
s
<
p95
0.019934
s
<
p99
0.029019
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
9.2e-05
s
SD
2.5e-05
s
p50
9.1e-05
s
<
p95
0.000135
s
<
p99
0.000171
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000172
s
SD
8.4e-05
s
p50
0.000159
s
<
p95
0.0004
s
<
p99
0.000509
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00321
s
SD
0.204403
s
p50
0.000467
s
<
p95
0.384452
s
<
p99
1.149321
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000296
s
SD
0.000104
s
p50
0.000323
s
<
p95
0.000531
s
<
p99
0.000579
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.092989
s
SD
2.473534
s
p50
0.093799
s
<
p95
0.15651
s
<
p99
0.194322
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.496791
s
SD
6.678209
s
p50
0.428657
s
<
p95
0.703202
s
<
p99
60.000478
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
18.30
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.75
KiB/s
<
mean
120.52
KiB/s
SD
295.55
KiB/s
<
p95
205.78
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
709
B/s
<
mean
133.22
KiB/s
SD
169.85
KiB/s
<
p95
365.46
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.91
GiB
mean
3.21
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
3.22
GiB
mean
3.54
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 91.6%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 184.47 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/6 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 4% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.22
%
<
mean
24.33
%
SD
20.48
%
<
p95
69.7
%
System
6.03
%
CPU percentiles
CPU usage percentiles
p50
17.02
%
p95
69.70
%
p99
91.57
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
6
hosts
mean time
0.12
s
Memory used percentage
Percentage of memory used
p5
8.09
%
<
mean
14.29
%
SD
7.01
%
<
p95
35.04
%
Memory available percentage
Percentage of available memory
p5
64.96
%
<
mean
85.71
%
SD
7.01
%
<
p95
91.91
%
Max host memory used
Maximum memory usage percentage across all hosts
max
37.40
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.17
%
Memory growth rate
Rate of memory growth over time
growth
184.47
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
136.71
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/11
hosts
Mount Point /efi-boot
0/7
hosts
Mount Point /etc/hostname
1/6
hosts
Mount Point /etc/hosts
1/6
hosts
Mount Point /etc/resolv.conf
1/6
hosts
Mount Point /nix/store
0/11
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.68
5 min
1.58
15 min
1.54
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
3.57
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
4.5094
%
SD
9.5576
%
<
p95
26.38
%
60 second average
4.4639
%
300 second average
4.6723
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
13.0858
%
SD
18.3124
%
<
p95
46.91
%
60 second average
12.7467
%
300 second average
10.7426
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
12.0425
%
SD
16.9738
%
<
p95
43.57
%
60 second average
11.7535
%
300 second average
9.8610
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.38
%
<
mean
21.26
%
SD
19.29
%
<
p95
64.63
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
295.15
KiB
<
mean
524.39
KiB
SD
88.05
KiB
<
p95
621.69
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
38.22
threads
SD
14.99
threads
<
p95
65
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
51
file descriptors
<
mean
86.83
file descriptors
SD
18.79
file descriptors
<
p95
114
file descriptors

Zome Call, Single Value

↑ Back to index

Calls a zome function that returns a fixed value. This tests the maximum performance of zome calls when the zome function is not calling into Holochain other otherwise doing any work.

Started
Thu, 25 Jun 2026 01:27:27 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
zome_call_single_value_28140184351_1
Call timing
The time taken for the call to complete.
mean
0.002771
s
SD
0.000671
s
p50
0.002674
s
<
p95
0.003836
s
<
p99
0.004466
s
Call rate
The number of zome calls completed per second.
mean
3582.57
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'return_single_value::get_value'
Metered usage count of the WASM ribosome for this zome function.
total
425895368
over 280.001893797s
mean rate
1.52104464e+06
/s
std
229112.02
/s
p5
1.14135858e+06
/s
p95
1.80623451e+06
/s
peak
1.84017773e+06
/s
Zome call duration: 'return_single_value::get_value'
Duration of this zome call as measured by Holochain internally.
mean
0.001364
s
SD
9.4e-05
s
p50
0.001324
s
<
p95
0.00146
s
<
p99
0.001469
s
WASM call duration: 'return_single_value::get_value'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000912
s
SD
7.2e-05
s
p50
0.000882
s
<
p95
0.000984
s
<
p99
0.000991
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000101
s
SD
0
s
p50
0.000101
s
≤
p95
0.000101
s
≤
p99
0.000101
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.42
s
<
mean
148.42
s
SD
83.67
s
<
p95
278.42
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001896368s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.065618
s
SD
0
s
p50
0.065618
s
≤
p95
0.065618
s
≤
p99
0.065618
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.00058
s
SD
0
s
p50
0.00058
s
≤
p95
0.00058
s
≤
p99
0.00058
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002731
s
SD
0
s
p50
0.002731
s
≤
p95
0.002731
s
≤
p99
0.002731
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001257
s
SD
0
s
p50
0.001257
s
≤
p95
0.001257
s
≤
p99
0.001257
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.002298
s
SD
0.00016
s
p50
0.002385
s
<
p95
0.002464
s
≤
p99
0.002464
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000555
s
SD
0
s
p50
0.000555
s
≤
p95
0.000555
s
≤
p99
0.000555
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.00085
s
SD
0
s
p50
0.00085
s
≤
p95
0.00085
s
≤
p99
0.00085
s
Authored DB connection use time
Time spent holding authored database connections.
mean
9.3e-05
s
SD
4e-06
s
p50
9.1e-05
s
<
p95
9.8e-05
s
≤
p99
9.8e-05
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
4.4e-05
s
SD
1e-06
s
p50
4.2e-05
s
<
p95
4.5e-05
s
≤
p99
4.5e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
8.2e-05
s
SD
5e-06
s
p50
7.9e-05
s
<
p95
8.7e-05
s
≤
p99
8.7e-05
s
Cache DB connection use time
Time spent holding cache database connections.
mean
5.8e-05
s
SD
0
s
p50
5.8e-05
s
≤
p95
5.8e-05
s
≤
p99
5.8e-05
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.2e-05
s
SD
0
s
p50
8.2e-05
s
≤
p95
8.2e-05
s
≤
p99
8.2e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
9.8e-05
s
SD
1.2e-05
s
p50
9.8e-05
s
<
p95
0.000129
s
<
p99
0.000139
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000116
s
SD
0.00706
s
p50
0.000116
s
<
p95
0.017771
s
≤
p99
0.017771
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000276
s
SD
0
s
p50
0.000276
s
≤
p95
0.000276
s
≤
p99
0.000276
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
28.57
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
932
B/s
<
mean
3.17
KiB/s
SD
2.30
KiB/s
<
p95
7.55
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
35
B/s
<
mean
1.62
KiB/s
SD
5.03
KiB/s
<
p95
2.50
KiB/s
Total bytes received
Total bytes received on primary network interface
count
919.85
KiB
mean
3.17
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
468.43
KiB
mean
1.62
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
25.38
%
<
mean
40.04
%
SD
21.61
%
<
p95
73.08
%
System
11.47
%
CPU percentiles
CPU usage percentiles
p50
25.74
%
p95
73.08
%
p99
80.48
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.03
s
Memory used percentage
Percentage of memory used
p5
6.75
%
<
mean
7.68
%
SD
0.81
%
<
p95
8.98
%
Memory available percentage
Percentage of available memory
p5
91.02
%
<
mean
92.32
%
SD
0.81
%
<
p95
93.25
%
Max host memory used
Maximum memory usage percentage across all hosts
max
7.68
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-367.25
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
1.71
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.03
5 min
1.53
15 min
0.72
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
4.913
%
SD
6.7884
%
<
p95
15.94
%
60 second average
5.0713
%
300 second average
3.2903
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0087
%
SD
0.0337
%
<
p95
0.06
%
60 second average
0.0033
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
21.05
%
<
mean
22.55
%
SD
2.59
%
<
p95
22.75
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
245.03
KiB
≤
mean
242.97
KiB
SD
29.03
KiB
<
p95
251.23
KiB
Holochain process threads
Number of threads in Holochain process
p5
14
threads
<
mean
14.61
threads
SD
2.55
threads
<
p95
15
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
44
file descriptors
<
mean
46.52
file descriptors
SD
10.52
file descriptors
<
p95
60
file descriptors