App Install

↑ Back to index

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Wed, 03 Jun 2026 13:18:27 UTC
Peer count
1
Peer count at end
1
Behaviours
  • minimal (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
app_install_minimal_26886318076_1
First install time
The time from conductor startup to completion of the first app installation attempt.
0.901604396
s
Install app timing
The time taken to install an app.
mean
0.301536
s
SD
0
s
p50
0.301536
s
≤
p95
0.301536
s
≤
p99
0.301536
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'callback::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 290.004233894s
Not enough time data to show a trend.
WASM usage: 'callback_integrity::genesis_self_check_2'
Metered usage count of the WASM ribosome for this zome function.
total
1092600
over 290.004233894s
mean rate
3767.52
/s
std
3777.57
/s
p5
0
/s
p95
10379.72
/s
peak
13110.87
/s
WASM call duration: 'callback::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000853
s
SD
9.2e-05
s
p50
0.000945
s
≤
p95
0.000945
s
≤
p99
0.000945
s
WASM call duration: 'callback_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00246
s
SD
0.0001
s
p50
0.002406
s
<
p95
0.002592
s
<
p99
0.0026
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000144
s
SD
0
s
p50
0.000144
s
≤
p95
0.000144
s
≤
p99
0.000144
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.19
s
<
mean
152.2
s
SD
86.56
s
<
p95
287.2
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 290.004204836s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.048164
s
SD
0
s
p50
0.048164
s
≤
p95
0.048164
s
≤
p99
0.048164
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000595
s
SD
0
s
p50
0.000595
s
≤
p95
0.000595
s
≤
p99
0.000595
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001184
s
SD
0
s
p50
0.001184
s
≤
p95
0.001184
s
≤
p99
0.001184
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.0192
s
SD
0
s
p50
0.0192
s
≤
p95
0.0192
s
≤
p99
0.0192
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001034
s
SD
3.7e-05
s
p50
0.00105
s
≤
p95
0.00105
s
≤
p99
0.00105
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000723
s
SD
0
s
p50
0.000723
s
≤
p95
0.000723
s
≤
p99
0.000723
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000447
s
SD
0
s
p50
0.000447
s
≤
p95
0.000447
s
≤
p99
0.000447
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000476
s
SD
0.000183
s
p50
0.000482
s
<
p95
0.000708
s
<
p99
0.001142
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
5.4e-05
s
SD
0
s
p50
5.4e-05
s
≤
p95
5.4e-05
s
≤
p99
5.4e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000225
s
SD
8e-06
s
p50
0.000219
s
<
p95
0.000236
s
≤
p99
0.000236
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000107
s
SD
0
s
p50
0.000107
s
≤
p95
0.000107
s
≤
p99
0.000107
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.6e-05
s
SD
0
s
p50
8.6e-05
s
≤
p95
8.6e-05
s
≤
p99
8.6e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000263
s
SD
5.2e-05
s
p50
0.000238
s
<
p95
0.000293
s
<
p99
0.000294
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000964
s
SD
0.008096
s
p50
0.002083
s
<
p95
0.003187
s
<
p99
0.005655
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000743
s
SD
6.4e-05
s
p50
0.000709
s
<
p95
0.000823
s
<
p99
0.000825
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
20.46
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
322
B/s
<
mean
815.53
KiB/s
SD
1.58
MiB/s
<
p95
6.35
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
190
B/s
<
mean
251.26
KiB/s
SD
211.37
KiB/s
<
p95
500.44
KiB/s
Total bytes received
Total bytes received on primary network interface
count
238.92
MiB
mean
815.53
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
73.61
MiB
mean
251.26
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 955.26 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
3.31
%
<
mean
29.23
%
SD
18.74
%
<
p95
46.3
%
System
8.77
%
CPU percentiles
CPU usage percentiles
p50
39.54
%
p95
46.30
%
p99
63.01
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
13.82
%
<
mean
20.81
%
SD
4.43
%
<
p95
26.01
%
Memory available percentage
Percentage of available memory
p5
73.99
%
<
mean
79.19
%
SD
4.43
%
<
p95
86.18
%
Max host memory used
Maximum memory usage percentage across all hosts
max
20.81
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
955.26
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
5.46
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.87
5 min
1.64
15 min
0.63
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
8.7058
%
SD
7.4774
%
<
p95
16.82
%
60 second average
6.3290
%
300 second average
2.3513
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
22.98
%
<
mean
49.2235
%
SD
12.3146
%
<
p95
66.62
%
60 second average
40.1039
%
300 second average
18.8594
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
20.68
%
<
mean
35.7258
%
SD
12.1182
%
<
p95
52.53
%
60 second average
30.4435
%
300 second average
15.2335
%
Holochain process CPU usage
CPU usage by Holochain process
p5
1.97
%
<
mean
19.6
%
SD
13.78
%
<
p95
31.91
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
16.66
KiB
<
mean
328.57
KiB
SD
193.49
KiB
<
p95
715.71
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
22.29
threads
SD
8.95
threads
<
p95
31
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
7
file descriptors
<
mean
128.97
file descriptors
SD
95.85
file descriptors
<
p95
331
file descriptors

App Install

↑ Back to index

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Wed, 03 Jun 2026 13:16:36 UTC
Peer count
1
Behaviours
  • large (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
app_install_large_26886318076_1
First install time
The time from conductor startup to completion of the first app installation attempt.
0.159474954
s
Install app timing
The time taken to install an app.
mean
0.069933
s
SD
0.02008
s
p50
0.063864
s
<
p95
0.105347
s
<
p99
0.14745
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'large::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 220.006735615s
Not enough time data to show a trend.
WASM call duration: 'large::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004467
s
SD
0.003188
s
p50
0.003034
s
<
p95
0.010943
s
<
p99
0.015314
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000143
s
SD
0.000123
s
p50
0.000107
s
<
p95
0.000353
s
<
p99
0.000518
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.84
s
<
mean
117.84
s
SD
66.33
s
<
p95
217.85
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
5379
over 220.008021387s
mean rate
24.48
/s
std
20.44
/s
p5
0
/s
p95
51.7
/s
peak
52.4
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.001224
s
SD
0.000691
s
p50
0.001228
s
<
p95
0.001763
s
<
p99
0.004568
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000929
s
SD
4.3e-05
s
p50
0.000913
s
<
p95
0.000963
s
<
p99
0.00097
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002017
s
SD
9.6e-05
s
p50
0.001987
s
<
p95
0.002093
s
<
p99
0.00211
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.015964
s
SD
0.000797
s
p50
0.015183
s
<
p95
0.016547
s
<
p99
0.016555
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001718
s
SD
6e-05
s
p50
0.001664
s
<
p95
0.001776
s
≤
p99
0.001776
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001199
s
SD
2.8e-05
s
p50
0.001182
s
<
p95
0.001228
s
<
p99
0.001238
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000478
s
SD
1.4e-05
s
p50
0.000474
s
<
p95
0.00049
s
≤
p99
0.00049
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000244
s
SD
7.6e-05
s
p50
0.000226
s
<
p95
0.000374
s
<
p99
0.000459
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
4.2e-05
s
SD
1e-06
s
p50
4.1e-05
s
<
p95
4.3e-05
s
≤
p99
4.3e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
9.3e-05
s
SD
1.4e-05
s
p50
9.1e-05
s
<
p95
0.0001
s
<
p99
0.000157
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000103
s
SD
1e-05
s
p50
9.3e-05
s
<
p95
0.000112
s
<
p99
0.000113
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
7.8e-05
s
SD
0
s
p50
7.8e-05
s
≤
p95
7.8e-05
s
≤
p99
7.8e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000114
s
SD
1e-05
s
p50
0.000118
s
<
p95
0.00013
s
<
p99
0.000143
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000512
s
SD
0.000197
s
p50
0.000418
s
<
p95
0.000657
s
<
p99
0.001438
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000363
s
SD
2.9e-05
s
p50
0.000338
s
<
p95
0.000401
s
≤
p99
0.000401
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
32.16
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
0
B/s
≤
mean
0
B/s
SD
0
B/s
≤
p95
0
B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
0
B/s
≤
mean
0
B/s
SD
0
B/s
≤
p95
0
B/s
Total bytes received
Total bytes received on primary network interface
count
0
B
mean
0
B/s
Total bytes sent
Total bytes sent on primary network interface
count
0
B
mean
0
B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1975.89 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (21.5% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
28.98
%
<
mean
41.79
%
SD
8.66
%
<
p95
53.06
%
System
9.64
%
CPU percentiles
CPU usage percentiles
p50
39.09
%
p95
53.06
%
p99
63.76
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
15.77
%
<
mean
25.65
%
SD
5.41
%
<
p95
30.27
%
Memory available percentage
Percentage of available memory
p5
69.73
%
<
mean
74.35
%
SD
5.41
%
<
p95
84.23
%
Max host memory used
Maximum memory usage percentage across all hosts
max
25.65
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
21.46
%
Memory growth rate
Rate of memory growth over time
growth
1975.89
MiB/s
Disk read throughput
Disk read throughput in MiB/s
3.62
MiB/s
Disk write throughput
Disk write throughput in MiB/s
70.77
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
0/1
hosts
Mount Point /etc/hosts
0/1
hosts
Mount Point /etc/resolv.conf
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.48
5 min
0.67
15 min
0.31
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.95
%
<
mean
3.3217
%
SD
1.8803
%
<
p95
5.12
%
60 second average
2.3921
%
300 second average
0.9883
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.9192
%
SD
1.1867
%
<
p95
3.6
%
60 second average
0.5554
%
300 second average
0.1717
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.85
%
SD
1.1258
%
<
p95
3.46
%
60 second average
0.5263
%
300 second average
0.1629
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
1.5521
%
SD
1.7169
%
<
p95
3.86
%
60 second average
0.9771
%
300 second average
0.3096
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
1.4279
%
SD
1.5871
%
<
p95
3.61
%
60 second average
0.9138
%
300 second average
0.2888
%
Holochain process CPU usage
CPU usage by Holochain process
p5
19.63
%
<
mean
27.93
%
SD
6.92
%
<
p95
33.2
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
226.93
KiB
<
mean
1.50
MiB
SD
631.14
KiB
<
p95
2.01
MiB
Holochain process threads
Number of threads in Holochain process
p5
17
threads
<
mean
20.5
threads
SD
4.54
threads
<
p95
23
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
65
file descriptors
<
mean
851.21
file descriptors
SD
330.82
file descriptors
<
p95
1024
file descriptors

DHT Sync Lag

↑ Back to index

Measures the lag time between an agent publishing data and other peers being able to see it. This scenario has two roles:

  • write: Creates entries with a timestamp field, linked to a known base hash so that record_lag agents can discover them.
  • record_lag: Repeatedly queries for links from the known base hash. When a new entry is discovered, it calculates the time difference between the entry's timestamp and the current time, giving the sync lag for that entry.
Started
Wed, 03 Jun 2026 13:20:18 UTC
Peer count
30
Peer count at end
28
Behaviours
  • record_lag (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
dht_sync_lag_26886318076_1
Create rate
The average number of created records per agent.
Mean
mean
45.15
/s
Max
Highest per-partition mean rate
max
90.07
/s
Min
Lowest per-partition mean rate
min
8.43
/s
Sync lag timing
The average time between when a record was created and when it is first seen by an agent.
Mean
mean
714.714184
s
SD
372.007004
s
Max
Highest per-partition mean latency
max mean
1655.648773
s
Min
Lowest per-partition mean latency
min mean
35.443637
s
Sync lag rate
The average number of created records discovered per agent.
Mean
mean
83.47
/s
Max
Highest per-partition mean rate
max
281
/s
Min
Lowest per-partition mean rate
min
10.71
/s
Delivery ratio
The proportion of created entries successfully received by all record_lag agents.
0.009
Sent count
The total number of entries sent (created) by write agents, by agent.
Total
187593
Agents affected
23 / 23
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
8156
Max
Highest count in any single partition
16404
Min
Lowest count in any single partition
1431
Received count
The total number of entries received by record_lag agents, by agent.
Total
8455
Agents affected
5 / 5
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
1691
Max
Highest count in any single partition
2545
Min
Lowest count in any single partition
1165
Error count
The number of errors encountered during the scenario.
77
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.008701
s
SD
0.093834
s
p50
0.002455
s
<
p95
0.296191
s
<
p99
0.407848
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 1420.011166255s
Not enough time data to show a trend.
WASM usage: 'timed::created_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
514207408
over 38367.86382118s
mean rate
4.41386395582e+10
/s
std
7.71783140971e+11
/s
p5
130757.46
/s
p95
3.08933704956e+10
/s
peak
2.71660233821e+13
/s
WASM usage: 'timed::get_timed_entries_local'
Metered usage count of the WASM ribosome for this zome function.
total
25684177383
over 2808.498676044s
mean rate
3.49088061434e+09
/s
std
3.29382171892e+09
/s
p5
0
/s
p95
8.87467125248e+09
/s
peak
1.35511218557e+10
/s
WASM usage: 'timed_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
58087744
over 38367.86382118s
mean rate
4.06435241992e+09
/s
std
7.79207956565e+10
/s
p5
12924.61
/s
p95
1.90051459329e+09
/s
peak
3.06882590014e+12
/s
Zome call duration: 'timed::created_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.010516
s
SD
0.010522
s
p50
0.012397
s
<
p95
0.028
s
<
p99
0.063162
s
Zome call duration: 'timed::get_timed_entries_local'
Duration of this zome call as measured by Holochain internally.
mean
0.168944
s
SD
0.229964
s
p50
0.139654
s
<
p95
0.711689
s
<
p99
0.882792
s
WASM call duration: 'timed::created_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.009489
s
SD
0.010051
s
p50
0.01115
s
<
p95
0.025635
s
<
p99
0.060291
s
WASM call duration: 'timed::get_timed_entries_local'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.168319
s
SD
0.229923
s
p50
0.13907
s
<
p95
0.710959
s
<
p99
0.882158
s
WASM call duration: 'timed_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001388
s
SD
0.00079
s
p50
0.001472
s
<
p95
0.003106
s
<
p99
0.004332
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.001254
s
SD
0.003169
s
p50
0.001146
s
<
p95
0.003112
s
<
p99
0.019083
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.001201
s
SD
0.002843
s
p50
0.001172
s
<
p95
0.003143
s
<
p99
0.017086
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.008835
s
SD
0.101175
s
p50
0.002496
s
<
p95
0.318613
s
<
p99
0.433597
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.00274
s
SD
0.002578
s
p50
0.002723
s
<
p95
0.009376
s
<
p99
0.01331
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002539
s
SD
0.001796
s
p50
0.002774
s
<
p95
0.006381
s
<
p99
0.009921
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000544
s
SD
0.00049
s
p50
0.000607
s
<
p95
0.00137
s
<
p99
0.002803
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
96.51
s
<
mean
909.03
s
SD
523.49
s
<
p95
1727.13
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
37726
over 38367.863831055s
mean rate
9.81847553e+06
/s
std
2.670733664e+08
/s
p5
7.8
/s
p95
3.4982186e+06
/s
peak
1.27554941057e+10
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
33.750845
s
SD
36.833887
s
p50
10.936461
s
<
p95
95.24086
s
<
p99
183.467655
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.417332
s
SD
0.324656
s
p50
1.462704
s
<
p95
2.05666
s
<
p99
2.15131
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.398855
s
SD
13.676618
s
p50
0.511313
s
<
p95
37.858375
s
<
p99
65.249371
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001158
s
SD
0.001011
s
p50
0.000775
s
<
p95
0.003437
s
<
p99
0.004917
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.021441
s
SD
0.054837
s
p50
0.026233
s
<
p95
0.132282
s
<
p99
0.307324
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.21992
s
SD
0.135804
s
p50
0.153797
s
<
p95
0.386557
s
<
p99
0.605766
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.876685
s
SD
33.995062
s
p50
0.788833
s
<
p95
73.860273
s
<
p99
248.694676
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.214337
s
SD
26.762314
s
p50
0.995392
s
<
p95
64.024155
s
<
p99
174.775361
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.008502
s
SD
0.019183
s
p50
0.008649
s
<
p95
0.021286
s
<
p99
0.135006
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.00098
s
SD
0.003444
s
p50
0.000673
s
<
p95
0.010608
s
<
p99
0.016196
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000254
s
SD
0.000192
s
p50
0.000297
s
<
p95
0.00081
s
<
p99
0.000861
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.004613
s
SD
0.009704
s
p50
0.000222
s
<
p95
0.005016
s
<
p99
0.066893
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.00013
s
SD
6.9e-05
s
p50
9.9e-05
s
<
p95
0.000275
s
<
p99
0.000333
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000165
s
SD
0.000158
s
p50
0.000149
s
<
p95
0.000678
s
<
p99
0.000769
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.006792
s
SD
0.013746
s
p50
0.003824
s
<
p95
0.034024
s
<
p99
0.050307
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.001113
s
SD
0.002796
s
p50
0.000475
s
<
p95
0.002431
s
<
p99
0.017933
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
1.612711
s
SD
29.535363
s
p50
2.305502
s
<
p95
60.39705
s
<
p99
76.235363
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.723747
s
SD
18.129795
s
p50
0.72706
s
<
p95
60.000915
s
<
p99
60.00127
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
46.55
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
101
B/s
<
mean
623.12
KiB/s
SD
623.44
KiB/s
<
p95
1.47
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
36
B/s
<
mean
683.29
KiB/s
SD
706.27
KiB/s
<
p95
1.91
MiB/s
Total bytes received
Total bytes received on primary network interface
count
30.37
GiB
mean
16.11
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
33.31
GiB
mean
17.67
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 97.0%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 882.99 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 61% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
14.64
%
<
mean
56.25
%
SD
23.09
%
<
p95
93.61
%
System
9.70
%
CPU percentiles
CPU usage percentiles
p50
55.06
%
p95
93.61
%
p99
97.00
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
20
hosts
mean time
0.28
s
Memory used percentage
Percentage of memory used
p5
7.82
%
<
mean
14.88
%
SD
4.91
%
<
p95
24.64
%
Memory available percentage
Percentage of available memory
p5
75.36
%
<
mean
85.12
%
SD
4.91
%
<
p95
92.18
%
Max host memory used
Maximum memory usage percentage across all hosts
max
31.02
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.96
%
Memory growth rate
Rate of memory growth over time
growth
882.99
MiB/s
Disk read throughput
Disk read throughput in MiB/s
3.18
MiB/s
Disk write throughput
Disk write throughput in MiB/s
326.51
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/17
hosts
Mount Point /efi-boot
0/16
hosts
Mount Point /etc/hostname
0/7
hosts
Mount Point /etc/hosts
0/7
hosts
Mount Point /etc/resolv.conf
0/7
hosts
Mount Point /nix/store
0/17
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.76
5 min
4.11
15 min
2.79
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
60.71
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
17.62
%
SD
16.723
%
<
p95
51.82
%
60 second average
17.0974
%
300 second average
14.7460
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0031
%
SD
0.077
%
≤
p95
0
%
60 second average
0.0045
%
300 second average
0.0046
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0019
%
SD
0.0468
%
≤
p95
0
%
60 second average
0.0033
%
300 second average
0.0036
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
18.8689
%
SD
17.2952
%
<
p95
48.93
%
60 second average
18.4481
%
300 second average
16.1633
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
11.2918
%
SD
12.9466
%
<
p95
36.08
%
60 second average
11.0685
%
300 second average
9.8253
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.13
%
<
mean
37.17
%
SD
28.52
%
<
p95
85.43
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
219.16
KiB
<
mean
384.96
KiB
SD
180.55
KiB
<
p95
673.85
KiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
<
mean
35.86
threads
SD
17.52
threads
<
p95
61
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
49
file descriptors
<
mean
79.08
file descriptors
SD
26.06
file descriptors
<
p95
125
file descriptors

First Call

↑ Back to index

This scenario installs a simple app which implements the init callback, and measures the time elapsed between start of install and calling init. It will uninstall the app it installed so that it can re-install it on the next iteration. This is required to re-run the initialisation callback.

Started
Wed, 03 Jun 2026 12:59:38 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
first_call_26886318076_1
Zome call timing
The time elapsed between start of install and calling init.
mean
0.022491
s
SD
0.076997
s
p50
0.00984
s
<
p95
0.029571
s
<
p99
0.202079
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.005519987s
Not enough time data to show a trend.
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.005519987s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
2798096
over 280.005519987s
mean rate
9993.02
/s
std
1789.45
/s
p5
7434.98
/s
p95
13014.2
/s
peak
15802.8
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005266
s
SD
0.000131
s
p50
0.005255
s
<
p95
0.005382
s
<
p99
0.005396
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004379
s
SD
0.002466
s
p50
0.003167
s
<
p95
0.009298
s
<
p99
0.009979
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001343
s
SD
0.000212
s
p50
0.00132
s
<
p95
0.00155
s
<
p99
0.001952
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001195
s
SD
2.8e-05
s
p50
0.001192
s
<
p95
0.001214
s
<
p99
0.001216
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000323
s
SD
6e-05
s
p50
0.000362
s
<
p95
0.00039
s
<
p99
0.000392
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00231
s
SD
6.3e-05
s
p50
0.002306
s
<
p95
0.002367
s
≤
p99
0.002367
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000214
s
SD
9.6e-05
s
p50
0.000185
s
<
p95
0.000406
s
<
p99
0.000536
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.19
s
<
mean
147.19
s
SD
83.67
s
<
p95
277.19
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
4809
over 280.00623848s
mean rate
17.17
/s
std
2.99
/s
p5
12.1
/s
p95
21.7
/s
peak
26.5
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.008614
s
SD
0.001757
s
p50
0.008545
s
<
p95
0.010587
s
<
p99
0.017202
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000605
s
SD
3.8e-05
s
p50
0.000602
s
<
p95
0.000628
s
<
p99
0.00063
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001325
s
SD
4e-05
s
p50
0.001312
s
<
p95
0.001361
s
<
p99
0.001366
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.018069
s
SD
0.001143
s
p50
0.017922
s
<
p95
0.018362
s
<
p99
0.018364
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001494
s
SD
5.8e-05
s
p50
0.001489
s
<
p95
0.001514
s
<
p99
0.001519
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000868
s
SD
3e-05
s
p50
0.000866
s
<
p95
0.000885
s
<
p99
0.000887
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000366
s
SD
1.2e-05
s
p50
0.000366
s
<
p95
0.000376
s
<
p99
0.000377
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.00027
s
SD
5.5e-05
s
p50
0.000253
s
<
p95
0.000379
s
<
p99
0.000419
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
5.9e-05
s
SD
0
s
p50
5.9e-05
s
≤
p95
5.9e-05
s
≤
p99
5.9e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
9.3e-05
s
SD
1.5e-05
s
p50
9.3e-05
s
<
p95
0.000126
s
<
p99
0.000168
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.00013
s
SD
9e-06
s
p50
0.000129
s
<
p95
0.000135
s
<
p99
0.000175
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.8e-05
s
SD
0
s
p50
8.8e-05
s
≤
p95
8.8e-05
s
≤
p99
8.8e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000122
s
SD
7e-06
s
p50
0.000121
s
<
p95
0.000125
s
≤
p99
0.000125
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001903
s
SD
0.000559
s
p50
0.000592
s
<
p95
0.000859
s
<
p99
0.003383
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000471
s
SD
1e-05
s
p50
0.000468
s
<
p95
0.000478
s
<
p99
0.000481
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
12.43
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
29.58
KiB/s
<
mean
263.54
KiB/s
SD
1.16
MiB/s
≤
p95
61.55
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
15.03
KiB/s
<
mean
21.53
KiB/s
SD
11.00
KiB/s
<
p95
56.19
KiB/s
Total bytes received
Total bytes received on primary network interface
count
74.63
MiB
mean
263.54
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
6.10
MiB
mean
21.53
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1379.65 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
10.41
%
<
mean
15.76
%
SD
10.04
%
<
p95
48.65
%
System
3.33
%
CPU percentiles
CPU usage percentiles
p50
12.59
%
p95
48.65
%
p99
54.50
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
11.74
%
<
mean
19.33
%
SD
5.13
%
<
p95
28.52
%
Memory available percentage
Percentage of available memory
p5
71.48
%
<
mean
80.67
%
SD
5.13
%
<
p95
88.26
%
Max host memory used
Maximum memory usage percentage across all hosts
max
19.33
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1379.65
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
4.82
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /efi-boot
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.84
5 min
0.87
15 min
0.35
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.17
%
<
mean
0.7197
%
SD
0.8236
%
<
p95
2.42
%
60 second average
0.5123
%
300 second average
0.2123
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
12.77
%
<
mean
31.8173
%
SD
7.1652
%
<
p95
45.31
%
60 second average
26.4783
%
300 second average
12.3077
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
12.24
%
<
mean
30.3887
%
SD
6.9208
%
<
p95
42.57
%
60 second average
25.4867
%
300 second average
11.9077
%
Holochain process CPU usage
CPU usage by Holochain process
p5
4.32
%
<
mean
12.18
%
SD
9.48
%
<
p95
44.88
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
123.48
KiB
<
mean
659.73
KiB
SD
334.62
KiB
<
p95
1.13
MiB
Holochain process threads
Number of threads in Holochain process
p5
17
threads
<
mean
19.47
threads
SD
0.92
threads
<
p95
20
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
64
file descriptors
<
mean
423.3
file descriptors
SD
197.68
file descriptors
<
p95
610
file descriptors

Full-Arc Create (Validated) / Zero-Arc Read

↑ Back to index

A full-arc/zero-arc mixed scenario where full-arc nodes create data that gets validated and zero-arc nodes read the data. The scenario has two roles:

  • full: A full-arc conductor that creates entries with a timestamp field. Those entries get validated and then retrieved by zero-arc nodes.
  • zero: A zero-arc conductor that reads the entries created by the full-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Wed, 03 Jun 2026 16:09:03 UTC
Peer count
30
Peer count at end
28
Behaviours
  • full (1 agent)
  • zero (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
full_arc_create_validated_zero_arc_read--high_zero_26886318076_1
Create rate
The number of timed entries created by the full-arc node(s) per second.
Mean
mean
31.67
/s
Max
Highest per-partition mean rate
max
56.02
/s
Min
Lowest per-partition mean rate
min
7.32
/s
Fetch lag timing
For each entry, the time lag between when it was created by a full-arc node and when a zero-arc node fetched it from the network.
Mean
mean
111.216743
s
SD
166.022818
s
Max
Highest per-partition mean latency
max mean
183.829867
s
Min
Lowest per-partition mean latency
min mean
65.139197
s
Fetch rate
The number of entries per second fetched by zero-arc nodes.
Mean
mean
10.69
/s
Max
Highest per-partition mean rate
max
18.19
/s
Min
Lowest per-partition mean rate
min
6.49
/s
Delivery ratio
The proportion of created entries successfully fetched by all zero-arc nodes.
0.0969
Entry created count
Total number of entries created by full-arc nodes, by agent.
Total
5659
Agents affected
2 / 2
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
2830
Max
Highest count in any single partition
5016
Min
Lowest count in any single partition
643
Received count
Total number of entries fetched by zero-arc nodes, by agent.
Total
14261
Agents affected
22 / 26
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
549
Max
Highest count in any single partition
771
Min
Lowest count in any single partition
0
Open connections
The number of currently open connections to other conductors.
full-arc
p5
2
<
mean
19.81
SD
5.15
<
p95
23
zero-arc
p5
0
<
mean
9.91
SD
7.17
<
p95
20
Retrieval errors
Errors encountered by zero-arc nodes when attempting to retrieve entries created by full-arc nodes.
Total
65
Agents affected
21 / 26
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
3
Max
Highest count in any single partition
7
Min
Lowest count in any single partition
0
Error count
The number of errors accumulated across all nodes.
70
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000459
s
SD
0.000282
s
p50
0.000424
s
<
p95
0.000969
s
<
p99
0.001786
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
2
over 796.934237262s
mean rate
6.1
/s
std
24.96
/s
p5
0
/s
p95
20.31
/s
peak
176.56
/s
WASM usage: 'timed_and_validated::create_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
47665476
over 1159.407599807s
mean rate
2.4508414736e+08
/s
std
2.4050952566e+08
/s
p5
8542.13
/s
p95
5.9850309543e+08
/s
peak
6.2653535421e+08
/s
WASM usage: 'timed_and_validated::get_timed_entries_network'
Metered usage count of the WASM ribosome for this zome function.
total
7886835000
over 37457.817679411s
mean rate
2.21767110399e+10
/s
std
9.32631917715e+10
/s
p5
8.2664683e+06
/s
p95
9.18768236643e+10
/s
peak
2.12762222332e+12
/s
WASM usage: 'timed_and_validated_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
734511300
over 37457.817679411s
mean rate
1.22435104911e+09
/s
std
8.32972649154e+09
/s
p5
763409
/s
p95
2.35899762885e+09
/s
peak
1.99286397731e+11
/s
WASM usage: 'timed_and_validated_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37457.817679411s
Not enough time data to show a trend.
Zome call duration: 'timed_and_validated::create_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006588
s
SD
0.002514
s
p50
0.006206
s
<
p95
0.011423
s
<
p99
0.01147
s
Zome call duration: 'timed_and_validated::get_timed_entries_network'
Duration of this zome call as measured by Holochain internally.
mean
0.007626
s
SD
0.037895
s
p50
0.00661
s
<
p95
0.100859
s
<
p99
0.224713
s
WASM call duration: 'timed_and_validated::create_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005814
s
SD
0.002256
s
p50
0.005473
s
<
p95
0.010149
s
<
p99
0.010194
s
WASM call duration: 'timed_and_validated::get_timed_entries_network'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.008315
s
SD
0.051966
s
p50
0.006775
s
<
p95
0.125342
s
<
p99
0.310172
s
WASM call duration: 'timed_and_validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001094
s
SD
0.000555
s
p50
0.000872
s
<
p95
0.001989
s
<
p99
0.003317
s
WASM call duration: 'timed_and_validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003629
s
SD
0.001255
s
p50
0.000838
s
<
p95
0.00438
s
<
p99
0.006176
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000325
s
SD
0.000181
s
p50
0.000286
s
<
p95
0.000677
s
<
p99
0.00068
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000342
s
SD
0.000173
s
p50
0.000304
s
<
p95
0.000677
s
<
p99
0.00068
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.002187
s
SD
0.11962
s
p50
0.004405
s
<
p95
0.314933
s
<
p99
0.468987
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.002148
s
SD
0.018869
s
p50
0.001047
s
<
p95
0.054663
s
<
p99
0.095684
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.001469
s
SD
0.000507
s
p50
0.001079
s
<
p95
0.002023
s
<
p99
0.002101
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00178
s
SD
0.000861
s
p50
0.001456
s
<
p95
0.003257
s
<
p99
0.005252
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000294
s
SD
0.000135
s
p50
0.00016
s
<
p95
0.000506
s
<
p99
0.000719
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.21
s
<
mean
449.43
s
SD
258.17
s
<
p95
848.57
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 37457.817607028s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
9.284105
s
SD
6.870761
s
p50
0.118616
s
<
p95
1.069588
s
<
p99
44.751061
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.156157
s
SD
0.08471
s
p50
1
s
<
p95
1.076941
s
<
p99
1.483682
s
App validation workflow duration
Time spent running the app validation workflow.
mean
6.341737
s
SD
9.230022
s
p50
0.000641
s
<
p95
4.720735
s
<
p99
41.424358
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001232
s
SD
0.001301
s
p50
0.000771
s
<
p95
0.005653
s
<
p99
0.0058
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.034459
s
SD
0.019597
s
p50
0.000818
s
<
p95
0.021796
s
<
p99
0.134222
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.091843
s
SD
0.019297
s
p50
0.001731
s
<
p95
0.024207
s
<
p99
0.123975
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
4.058677
s
SD
2.148339
s
p50
0.000985
s
<
p95
1.115676
s
<
p99
12.773874
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.175998
s
SD
0.205546
s
p50
0.000895
s
<
p95
0.044792
s
<
p99
1.457978
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000261
s
SD
0.001274
s
p50
0.000203
s
<
p95
0.001518
s
<
p99
0.008638
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000451
s
SD
0.000277
s
p50
0.000361
s
<
p95
0.001052
s
<
p99
0.001441
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000105
s
SD
7.1e-05
s
p50
8.5e-05
s
<
p95
0.000339
s
<
p99
0.000355
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000409
s
SD
0.000145
s
p50
0.000359
s
<
p95
0.000656
s
<
p99
0.000837
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000147
s
SD
0.000114
s
p50
0.000103
s
<
p95
0.000344
s
<
p99
0.000627
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000121
s
SD
5.1e-05
s
p50
0.00011
s
<
p95
0.000194
s
<
p99
0.000358
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00077
s
SD
0.280277
s
p50
0.000275
s
<
p95
0.387504
s
<
p99
1.850532
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00028
s
SD
0.000211
s
p50
0.000442
s
<
p95
0.000865
s
<
p99
0.00125
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.344091
s
SD
29.133889
s
p50
0.330423
s
<
p95
60.001627
s
<
p99
60.001742
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.391071
s
SD
24.679278
s
p50
0.693369
s
<
p95
60.001037
s
<
p99
60.001319
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
1.323124
s
SD
15.750541
s
p50
0.594569
s
<
p95
47.455438
s
<
p99
60.001088
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
11.87
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
168
B/s
<
mean
85.20
KiB/s
SD
216.21
KiB/s
<
p95
375.11
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
34
B/s
<
mean
78.94
KiB/s
SD
410.62
KiB/s
≤
p95
70.19
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.10
GiB
mean
1.82
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.95
GiB
mean
1.69
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 533.99 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.13
%
<
mean
17.67
%
SD
15.16
%
<
p95
55.15
%
System
5.81
%
CPU percentiles
CPU usage percentiles
p50
14.47
%
p95
55.15
%
p99
64.94
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
3
hosts
mean time
0.02
s
Memory used percentage
Percentage of memory used
p5
7.64
%
<
mean
15.97
%
SD
12.1
%
<
p95
17.84
%
Memory available percentage
Percentage of available memory
p5
82.16
%
<
mean
84.03
%
SD
12.1
%
<
p95
92.36
%
Max host memory used
Maximum memory usage percentage across all hosts
max
77.86
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.05
%
Memory growth rate
Rate of memory growth over time
growth
533.99
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.51
MiB/s
Disk write throughput
Disk write throughput in MiB/s
58.55
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/16
hosts
Mount Point /boot
0/1
hosts
Mount Point /efi-boot
0/15
hosts
Mount Point /etc/hostname
0/6
hosts
Mount Point /etc/hosts
0/6
hosts
Mount Point /etc/resolv.conf
0/6
hosts
Mount Point /nix/store
0/16
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.96
5 min
1.01
15 min
0.91
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.8591
%
SD
2.718
%
<
p95
6.4
%
60 second average
0.8780
%
300 second average
0.9266
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
4.682
%
SD
9.9534
%
<
p95
21.95
%
60 second average
4.7899
%
300 second average
4.7603
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
4.3424
%
SD
8.9715
%
<
p95
20.68
%
60 second average
4.4183
%
300 second average
4.3319
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.32
%
<
mean
14.25
%
SD
11.94
%
<
p95
30.48
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
336.38
KiB
<
mean
462.09
KiB
SD
89.67
KiB
<
p95
549.61
KiB
Holochain process threads
Number of threads in Holochain process
p5
11
threads
<
mean
14.34
threads
SD
5.67
threads
<
p95
26
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
47
file descriptors
<
mean
59.04
file descriptors
SD
11.99
file descriptors
<
p95
77
file descriptors

Local Signals

↑ Back to index

This scenario is for testing the speed and reliability of local signals. It uses a zome with a function that will emit 10,000 signals. The scenario measures how long it takes to send the signals and how many have been received by the time the zome call ends.

Started
Wed, 03 Jun 2026 13:01:36 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
local_signals_26886318076_1
Send timing
The time taken to emit a batch of 10,000 signals.
mean
2.982105
s
SD
1.718277
s
p50
2.897641
s
<
p95
6.020341
s
<
p99
6.406251
s
Receive timing
The time taken to receive the completed batch, to the nearest 250ms.
mean
8.164206
s
SD
13.255043
s
p50
0.250793
s
<
p95
30.001602
s
<
p99
30.001771
s
Success ratio
The proportion of signals successfully received in a batch.
min
0.31380000710487366
<
mean
0.9733
SD
0.1294
<
max
1
Holochain MetricsClick to toggle visibility.
WASM usage: 'signal::emit_10k_signals'
Metered usage count of the WASM ribosome for this zome function.
total
872338922
over 290.003417496s
mean rate
3.00803719e+06
/s
std
3.4514803e+06
/s
p5
0
/s
p95
1.006537312e+07
/s
peak
1.006538781e+07
/s
Zome call duration: 'signal::emit_10k_signals'
Duration of this zome call as measured by Holochain internally.
mean
0.359872
s
SD
0.009439
s
p50
0.358598
s
<
p95
0.377231
s
≤
p99
0.377231
s
WASM call duration: 'signal::emit_10k_signals'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.358969
s
SD
0.009388
s
p50
0.357691
s
<
p95
0.376361
s
≤
p99
0.376361
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
2.5e-05
s
SD
1e-06
s
p50
2.5e-05
s
<
p95
2.6e-05
s
≤
p99
2.6e-05
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
260000
over 290.003426823s
mean rate
896.54
/s
std
1028.8
/s
p5
0
/s
p95
2999.98
/s
peak
2999.98
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000147
s
SD
0
s
p50
0.000147
s
≤
p95
0.000147
s
≤
p99
0.000147
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.18
s
<
mean
152.18
s
SD
86.56
s
<
p95
287.19
s
Dropped WebSocket signals
Count of signals dropped from the app WebSocket due to channel overload.
total
32
over 290.003341866s
mean rate
0.11
/s
std
0.26
/s
p5
0
/s
p95
0.7
/s
peak
1.2
/s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 290.003350116s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.058966
s
SD
0
s
p50
0.058966
s
≤
p95
0.058966
s
≤
p99
0.058966
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000577
s
SD
0
s
p50
0.000577
s
≤
p95
0.000577
s
≤
p99
0.000577
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001188
s
SD
0
s
p50
0.001188
s
≤
p95
0.001188
s
≤
p99
0.001188
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000822
s
SD
0
s
p50
0.000822
s
≤
p95
0.000822
s
≤
p99
0.000822
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.000987
s
SD
8.7e-05
s
p50
0.001005
s
<
p95
0.001154
s
≤
p99
0.001154
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000746
s
SD
0
s
p50
0.000746
s
≤
p95
0.000746
s
≤
p99
0.000746
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000576
s
SD
0
s
p50
0.000576
s
≤
p95
0.000576
s
≤
p99
0.000576
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.00021
s
SD
7e-06
s
p50
0.000214
s
<
p95
0.000219
s
<
p99
0.00022
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
4.1e-05
s
SD
0
s
p50
4.1e-05
s
≤
p95
4.1e-05
s
≤
p99
4.1e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000186
s
SD
4e-06
s
p50
0.000188
s
<
p95
0.000191
s
≤
p99
0.000191
s
Cache DB connection use time
Time spent holding cache database connections.
mean
7.4e-05
s
SD
0
s
p50
7.4e-05
s
≤
p95
7.4e-05
s
≤
p99
7.4e-05
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.2e-05
s
SD
0
s
p50
8.2e-05
s
≤
p95
8.2e-05
s
≤
p99
8.2e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000131
s
SD
2.3e-05
s
p50
0.000133
s
<
p95
0.000145
s
<
p99
0.000148
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00013
s
SD
0.008229
s
p50
0.000293
s
<
p95
0.020831
s
≤
p99
0.020831
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000301
s
SD
0
s
p50
0.000301
s
≤
p95
0.000301
s
≤
p99
0.000301
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
6.82
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
37
B/s
<
mean
191.26
KiB/s
SD
537.43
KiB/s
<
p95
1.81
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
99
B/s
<
mean
5.22
KiB/s
SD
12.89
KiB/s
<
p95
44.71
KiB/s
Total bytes received
Total bytes received on primary network interface
count
63.50
MiB
mean
191.26
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.73
MiB
mean
5.22
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 226.41 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.08
%
<
mean
20.77
%
SD
28.54
%
<
p95
78.16
%
System
13.95
%
CPU percentiles
CPU usage percentiles
p50
3.01
%
p95
78.16
%
p99
79.46
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
8.54
%
<
mean
11.81
%
SD
1.4
%
<
p95
13.28
%
Memory available percentage
Percentage of available memory
p5
86.72
%
<
mean
88.19
%
SD
1.4
%
<
p95
91.46
%
Max host memory used
Maximum memory usage percentage across all hosts
max
11.81
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
226.41
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
0.72
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /efi-boot
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.27
5 min
0.86
15 min
0.33
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
9.0506
%
SD
12.8263
%
<
p95
40.93
%
60 second average
5.7903
%
300 second average
2.2083
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.31
%
<
mean
1.984
%
SD
1.9035
%
<
p95
7.17
%
60 second average
2.0020
%
300 second average
1.4566
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
1.8274
%
SD
1.9301
%
<
p95
7.11
%
60 second average
1.8857
%
300 second average
1.4040
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.18
%
<
mean
1.21
%
SD
1.34
%
<
p95
3.82
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
256.40
KiB
≤
mean
250.69
KiB
SD
41.51
KiB
<
p95
258.64
KiB
Holochain process threads
Number of threads in Holochain process
p5
15
threads
≤
mean
14.84
threads
SD
0.88
threads
<
p95
15
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
47
file descriptors
<
mean
50.06
file descriptors
SD
10.71
file descriptors
<
p95
68
file descriptors

Mixed Arc get_agent_activity

↑ Back to index

A mixed-arc scenario that measures the DHT's ability to propagate agent activity and make it available via get_agent_activity calls. The scenario has three roles:

  • zero_write: A zero-arc conductor that creates entries on its source chain.
  • full_write: A full-arc conductor that creates entries on its source chain.
  • zero_read: A zero-arc conductor that picks a random writer and repeatedly calls get_agent_activity to observe new entries appearing on the writer's chain, measuring the lag between creation and discovery.
Started
Wed, 03 Jun 2026 16:24:17 UTC
Peer count
30
Peer count at end
26
Behaviours
  • full_write (1 agent)
  • zero_read (1 agent)
  • zero_write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
mixed_arc_get_agent_activity_26886318076_1
Entry created count
The total number of entries created by write agents over the run, partitioned by agent and behaviour.
Total
193480
Agents affected
17 / 17
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
11381
Max
Highest count in any single partition
32390
Min
Lowest count in any single partition
3380
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
6936.4
Max
Highest chain head value observed for any single write agent.
9667
Write agents observed
5
Chain head delay timing
The time lag between when a writer creates a new entry and when a reader discovers it via get_agent_activity. This is measured per new action in the chain.
Mean
mean
0.010719
s
SD
0.077708
s
Max
Highest per-partition mean latency
max mean
0.023199
s
Min
Lowest per-partition mean latency
min mean
0.003594
s
Chain head delay rate
The rate at which readers detect new chain heads appearing on writers' chains.
Mean
mean
39.64
/s
Max
Highest per-partition mean rate
max
56.94
/s
Min
Lowest per-partition mean rate
min
17.83
/s
get_agent_activity_full zome call timing
The time taken to complete the get_agent_activity_full zome call that queries a writer's chain.
Mean
mean
0.172124
s
SD
0.206293
s
Max
Highest per-partition mean latency
max mean
0.341977
s
Min
Lowest per-partition mean latency
min mean
0.050365
s
Retrieval errors
A running accumulation of errors encountered by read agents when calling get_agent_activity.
Total
26
Agents affected
8 / 8
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
3
Max
Highest count in any single partition
8
Min
Lowest count in any single partition
2
Open connections
The number of currently open connections to other conductors, partitioned by agent behaviour.
  • behaviour: full_write
p5
19
<
mean
23.14
SD
1.83
<
p95
24
  • behaviour: zero_read
p5
0
<
mean
12.87
SD
6.53
<
p95
21
  • behaviour: zero_write
p5
3
<
mean
14.51
SD
4.66
<
p95
20
Final error count
The total number of errors accumulated across all agents over the run.
30
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000287
s
SD
0.000216
s
p50
0.000637
s
<
p95
0.001025
s
≤
p99
0.001025
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
2
over 878.356219948s
mean rate
5.15
/s
std
12.11
/s
p5
0
/s
p95
35.86
/s
peak
44.81
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.008613
s
SD
0.003707
s
p50
0.00842
s
<
p95
0.016348
s
≤
p99
0.016348
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005464
s
SD
0.00784
s
p50
0.005544
s
<
p95
0.032353
s
<
p99
0.037786
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.141872
s
SD
0.096297
s
p50
0.130557
s
<
p95
0.337684
s
<
p99
0.4463
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.003976
s
SD
0.206845
s
p50
0.058039
s
<
p95
0.693052
s
≤
p99
0.693052
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.007235
s
SD
0.003248
s
p50
0.006966
s
<
p95
0.014074
s
≤
p99
0.014074
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004577
s
SD
0.007043
s
p50
0.004618
s
<
p95
0.028951
s
<
p99
0.03403
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.179513
s
SD
0.115226
s
p50
0.166046
s
<
p95
0.424742
s
<
p99
0.526387
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003246
s
SD
0.206809
s
p50
0.057027
s
<
p95
0.692149
s
≤
p99
0.692149
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001142
s
SD
0.000807
s
p50
0.000997
s
<
p95
0.003208
s
<
p99
0.004833
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
6.3e-05
s
SD
8.7e-05
s
p50
3.9e-05
s
<
p95
0.000406
s
≤
p99
0.000406
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000683
s
SD
0.003095
s
p50
0.000464
s
<
p95
0.011199
s
<
p99
0.014603
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.00071
s
SD
0.000435
s
p50
0.000577
s
<
p95
0.001997
s
≤
p99
0.001997
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.174688
s
SD
0.114952
s
p50
0.161633
s
<
p95
0.418268
s
<
p99
0.52251
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000638
s
SD
0.207069
s
p50
0.052218
s
<
p95
0.68949
s
≤
p99
0.68949
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
9e-06
s
p50
1.4e-05
s
<
p95
3.9e-05
s
≤
p99
3.9e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002044
s
SD
0.002373
s
p50
0.002715
s
<
p95
0.007439
s
<
p99
0.014661
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.00036
s
SD
0.000623
s
p50
0.00017
s
<
p95
0.001898
s
<
p99
0.00338
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.2
s
<
mean
450.03
s
SD
258.52
s
<
p95
855.06
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
4
over 37467.801521635s
mean rate
102561.11
/s
std
1.44180378e+06
/s
p5
0
/s
p95
481618.06
/s
peak
6.300501505e+07
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
11.459544
s
SD
5.48337
s
p50
0.131394
s
<
p95
16.518067
s
<
p99
21.328459
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.611805
s
SD
0.271184
s
p50
1
s
<
p95
1.672253
s
<
p99
1.709077
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.058727
s
SD
1.170809
s
p50
0.001176
s
<
p95
0.150267
s
<
p99
4.13305
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001569
s
SD
0.002398
s
p50
0.000839
s
<
p95
0.00275
s
<
p99
0.013921
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.009661
s
SD
0.00881
s
p50
0.000695
s
<
p95
0.022414
s
<
p99
0.035532
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.087681
s
SD
2.792005
s
p50
0.032133
s
<
p95
6.376904
s
<
p99
17.278144
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.07537
s
SD
1.043928
s
p50
0.001481
s
<
p95
0.114573
s
<
p99
0.214801
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.967945
s
SD
10.301528
s
p50
0.000979
s
<
p95
19.480408
s
<
p99
68.08496
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.001899
s
SD
0.003234
s
p50
0.000412
s
<
p95
0.009893
s
<
p99
0.012812
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002306
s
SD
0.00227
s
p50
0.000165
s
<
p95
0.005729
s
<
p99
0.011274
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000198
s
SD
0.000342
s
p50
0.000207
s
<
p95
0.00144
s
<
p99
0.001636
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000273
s
SD
0.000279
s
p50
0.000253
s
<
p95
0.001135
s
<
p99
0.001368
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000135
s
SD
7.3e-05
s
p50
0.00011
s
<
p95
0.000235
s
<
p99
0.000436
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000238
s
SD
0.0002
s
p50
0.000148
s
<
p95
0.00086
s
<
p99
0.000973
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003343
s
SD
0.011859
s
p50
0.000685
s
<
p95
0.027812
s
<
p99
0.054467
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000756
s
SD
0.001439
s
p50
0.000455
s
<
p95
0.001839
s
<
p99
0.009055
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
3.65639
s
SD
26.333469
s
p50
0.104364
s
<
p95
60.001579
s
<
p99
60.002231
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.099282
s
SD
0.205737
s
p50
0.091407
s
<
p95
0.685436
s
≤
p99
0.685436
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.25536
s
SD
29.50441
s
p50
0.278696
s
<
p95
60.001987
s
≤
p99
60.001987
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.195514
s
SD
0.300455
s
p50
0.201386
s
<
p95
0.306493
s
<
p99
0.470185
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
21.76
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
158
B/s
<
mean
308.65
KiB/s
SD
437.74
KiB/s
<
p95
1.18
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
46
B/s
<
mean
334.02
KiB/s
SD
652.48
KiB/s
<
p95
1.58
MiB/s
Total bytes received
Total bytes received on primary network interface
count
8.02
GiB
mean
8.05
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
8.68
GiB
mean
8.71
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 97.2%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 354.64 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 17% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.81
%
<
mean
28.92
%
SD
32.12
%
<
p95
94.52
%
System
7.16
%
CPU percentiles
CPU usage percentiles
p50
9.22
%
p95
94.52
%
p99
97.25
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
8
hosts
mean time
0.50
s
Memory used percentage
Percentage of memory used
p5
5.99
%
<
mean
13.9
%
SD
12.58
%
<
p95
30.59
%
Memory available percentage
Percentage of available memory
p5
69.41
%
<
mean
86.1
%
SD
12.58
%
<
p95
94.01
%
Max host memory used
Maximum memory usage percentage across all hosts
max
77.60
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.05
%
Memory growth rate
Rate of memory growth over time
growth
354.64
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.05
MiB/s
Disk write throughput
Disk write throughput in MiB/s
167.47
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/17
hosts
Mount Point /boot
0/1
hosts
Mount Point /efi-boot
0/15
hosts
Mount Point /etc/hostname
0/5
hosts
Mount Point /etc/hosts
0/5
hosts
Mount Point /etc/resolv.conf
0/5
hosts
Mount Point /nix/store
0/17
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.33
5 min
1.88
15 min
1.39
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
16.67
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
11.5638
%
SD
21.5891
%
<
p95
55.64
%
60 second average
10.9059
%
300 second average
8.1217
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
11.9799
%
SD
17.9582
%
<
p95
50.05
%
60 second average
11.5819
%
300 second average
9.5199
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
10.5387
%
SD
17.0328
%
<
p95
49.1
%
60 second average
10.1939
%
300 second average
8.4286
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.18
%
<
mean
24.26
%
SD
30.75
%
<
p95
91.83
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
199.75
KiB
<
mean
272.10
KiB
SD
100.02
KiB
<
p95
483.35
KiB
Holochain process threads
Number of threads in Holochain process
p5
9
threads
<
mean
19.52
threads
SD
11.25
threads
<
p95
45
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
43
file descriptors
<
mean
60.98
file descriptors
SD
15.52
file descriptors
<
p95
83
file descriptors

Mixed Arc must_get_agent_activity

↑ Back to index

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Write Validated must_get_agent_activity, but some write agents are zero-arc and all must_get_agent_activity agents are zero-arc. This forces the must_get_agent_activity host call to go to the network.

Started
Wed, 03 Jun 2026 16:39:39 UTC
Peer count
30
Peer count at end
25
Behaviours
  • full_write (1 agent)
  • zero_must_get_agent_activity (1 agent)
  • zero_write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
mixed_arc_must_get_agent_activity_26886318076_1
Highest observed action_seq
The maximum chain length observed per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1860.33
Max
Highest chain head value observed for any single write agent.
1886
Write agents observed
3
Chain batch delay timing
The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.
Mean
mean
9.740661
s
SD
13.878893
s
Max
Highest per-partition mean latency
max mean
31.866994
s
Min
Lowest per-partition mean latency
min mean
2.02858
s
Chain batch delay rate
The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.
Mean
mean
2.11
/s
Max
Highest per-partition mean rate
max
2.51
/s
Min
Lowest per-partition mean rate
min
1.91
/s
create_validated_sample_entry zome call timing
The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.
Mean
mean
0.594834
s
SD
0.56795
s
Max
Highest per-partition mean latency
max mean
1.130727
s
Min
Lowest per-partition mean latency
min mean
0.350979
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.
Total
5139
Agents affected
8 / 8
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
642
Max
Highest count in any single partition
800
Min
Lowest count in any single partition
425
Open connections
The average number of open connections maintained by an agent over the run, broken down by behaviour.
  • behaviour: full_write
p5
18
<
mean
22.24
SD
1.8
<
p95
23
  • behaviour: zero_must_get_agent_activity
p5
0
<
mean
13.58
SD
6.32
<
p95
21
  • behaviour: zero_write
p5
9
<
mean
14.82
SD
4.51
<
p95
20
Final error count
The total number of all types of error accumulated over the run by all agents.
17473
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000566
s
SD
0.00036
s
p50
0.000851
s
<
p95
0.001594
s
<
p99
0.001774
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
1
over 642.445581976s
mean rate
0.38
/s
std
0.63
/s
p5
0
/s
p95
1.83
/s
peak
1.83
/s
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.008379
s
SD
0.002067
s
p50
0.008286
s
<
p95
0.011939
s
≤
p99
0.011939
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.06019
s
SD
0.011522
s
p50
0.055766
s
<
p95
0.071061
s
<
p99
0.108282
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.008003
s
SD
0.001797
s
p50
0.008755
s
<
p95
0.010104
s
<
p99
0.010273
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.196992
s
SD
0.046367
s
p50
0.196847
s
<
p95
0.26761
s
<
p99
0.274761
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.006915
s
SD
0.244287
s
p50
0.372174
s
<
p95
0.703361
s
≤
p99
0.703361
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006954
s
SD
0.001864
s
p50
0.006961
s
<
p95
0.009793
s
≤
p99
0.009793
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.059051
s
SD
0.011421
s
p50
0.054604
s
<
p95
0.069707
s
<
p99
0.10664
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006636
s
SD
0.001519
s
p50
0.007262
s
<
p95
0.008391
s
<
p99
0.008528
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.22434
s
SD
0.078914
s
p50
0.226997
s
<
p95
0.406314
s
<
p99
0.414548
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005945
s
SD
0.244122
s
p50
0.371354
s
<
p95
0.701298
s
≤
p99
0.701298
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001379
s
SD
0.000535
s
p50
0.001249
s
<
p95
0.00256
s
<
p99
0.002682
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.007786
s
SD
0.041889
s
p50
0.003055
s
<
p95
0.126124
s
<
p99
0.18257
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.4e-05
s
SD
1.1e-05
s
p50
3.6e-05
s
<
p95
5.6e-05
s
<
p99
8e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.00047
s
SD
0.000127
s
p50
0.00047
s
<
p95
0.000805
s
<
p99
0.000822
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000432
s
SD
0.000156
s
p50
0.000485
s
<
p95
0.000792
s
<
p99
0.000909
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.030936
s
SD
0.194624
s
p50
0.245981
s
<
p95
0.692734
s
≤
p99
0.692734
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.267593
s
SD
0.13921
s
p50
0.230424
s
<
p95
0.526052
s
<
p99
0.737807
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.007414
s
SD
0.003518
s
p50
0.005619
s
<
p95
0.010118
s
<
p99
0.020487
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1.2e-05
s
SD
7e-06
s
p50
1.7e-05
s
<
p95
2.8e-05
s
≤
p99
2.8e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002285
s
SD
0.00102
s
p50
0.002896
s
<
p95
0.00481
s
<
p99
0.005821
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000268
s
SD
0.000182
s
p50
0.000191
s
<
p95
0.000661
s
<
p99
0.00105
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.3
s
<
mean
454.96
s
SD
261.55
s
<
p95
863.13
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
21.495298
s
SD
22.421156
s
p50
0.125927
s
<
p95
67.263767
s
<
p99
104.315148
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.866709
s
SD
0.396013
s
p50
1
s
<
p95
1.887347
s
<
p99
1.890686
s
App validation workflow duration
Time spent running the app validation workflow.
mean
1.800582
s
SD
10.598254
s
p50
0.001329
s
<
p95
27.204846
s
<
p99
63.705963
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001013
s
SD
0.000755
s
p50
0.000741
s
<
p95
0.002115
s
<
p99
0.004467
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.020014
s
SD
0.011445
s
p50
0.000422
s
<
p95
0.035254
s
<
p99
0.05243
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.016161
s
SD
0.024418
s
p50
0.011154
s
<
p95
0.070509
s
<
p99
0.125214
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.246231
s
SD
0.151157
s
p50
0.001374
s
<
p95
0.335259
s
<
p99
0.652429
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
14.112188
s
SD
12.051754
s
p50
0.001152
s
<
p95
32.359074
s
<
p99
55.851462
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.0003
s
SD
0.000163
s
p50
0.000319
s
<
p95
0.000675
s
<
p99
0.000798
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001135
s
SD
0.000665
s
p50
0.000324
s
<
p95
0.001647
s
<
p99
0.004176
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000186
s
SD
7.1e-05
s
p50
0.000175
s
<
p95
0.000326
s
<
p99
0.000557
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000333
s
SD
0.000361
s
p50
0.000129
s
<
p95
0.001136
s
<
p99
0.001278
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000123
s
SD
5.5e-05
s
p50
0.0001
s
<
p95
0.000257
s
<
p99
0.000267
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.00014
s
SD
6e-05
s
p50
0.000124
s
<
p95
0.000234
s
<
p99
0.000392
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002201
s
SD
0.230333
s
p50
0.000357
s
<
p95
0.406432
s
<
p99
1.54338
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000285
s
SD
0.000119
s
p50
0.000383
s
<
p95
0.000552
s
<
p99
0.000701
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.087801
s
SD
0.029196
s
p50
0.088583
s
<
p95
0.131729
s
<
p99
0.136871
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.14615
s
SD
16.455569
s
p50
0.207506
s
<
p95
60.001219
s
<
p99
60.002078
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
0.277472
s
SD
16.719747
s
p50
0.252032
s
<
p95
60.001283
s
<
p99
60.001779
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.621815
s
SD
1.065573
s
p50
0.513189
s
<
p95
0.926325
s
<
p99
10.029419
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
8.19
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
101
B/s
<
mean
97.57
KiB/s
SD
362.64
KiB/s
<
p95
282.06
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
26
B/s
<
mean
90.97
KiB/s
SD
229.25
KiB/s
<
p95
486.88
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.47
GiB
mean
2.41
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.30
GiB
mean
2.25
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 292.61 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 3% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.75
%
<
mean
13.37
%
SD
16.52
%
<
p95
37
%
System
5.19
%
CPU percentiles
CPU usage percentiles
p50
5.42
%
p95
37.00
%
p99
82.38
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
6
hosts
mean time
0.06
s
Memory used percentage
Percentage of memory used
p5
7.61
%
<
mean
13.68
%
SD
3.61
%
<
p95
17.48
%
Memory available percentage
Percentage of available memory
p5
82.52
%
<
mean
86.32
%
SD
3.61
%
<
p95
92.39
%
Max host memory used
Maximum memory usage percentage across all hosts
max
23.44
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.05
%
Memory growth rate
Rate of memory growth over time
growth
292.61
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
93.12
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/17
hosts
Mount Point /boot
0/1
hosts
Mount Point /efi-boot
0/14
hosts
Mount Point /etc/hostname
0/6
hosts
Mount Point /etc/hosts
0/6
hosts
Mount Point /etc/resolv.conf
0/6
hosts
Mount Point /nix/store
0/17
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.93
5 min
1.19
15 min
1.29
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
3.45
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
1.8665
%
SD
7.284
%
<
p95
5.23
%
60 second average
2.3086
%
300 second average
3.9194
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
5.4149
%
SD
11.2398
%
<
p95
34.92
%
60 second average
5.8764
%
300 second average
7.5163
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
4.9758
%
SD
10.4486
%
<
p95
32.27
%
60 second average
5.3862
%
300 second average
6.7706
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.1
%
<
mean
9.44
%
SD
14.98
%
<
p95
32.66
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
418.09
KiB
<
mean
475.87
KiB
SD
92.80
KiB
<
p95
610.17
KiB
Holochain process threads
Number of threads in Holochain process
p5
11
threads
<
mean
20.94
threads
SD
12.47
threads
<
p95
48
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
44
file descriptors
<
mean
65.29
file descriptors
SD
16.26
file descriptors
<
p95
95
file descriptors

Remote Call Rate

↑ Back to index

Test the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

Started
Wed, 03 Jun 2026 13:03:39 UTC
Peer count
10
Peer count at end
10
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
remote_call_rate_26886318076_1
Dispatch timing
The time between sending a remote call and the remote handler being invoked.
Mean
mean
0.215588
s
SD
0.615985
s
Max
Highest per-partition mean latency
max mean
3.152865
s
Min
Lowest per-partition mean latency
min mean
-0.145774
s
Round-trip timing
The total elapsed time to get a response to the client.
Mean
mean
0.118212
s
SD
0.09211
s
Max
Highest per-partition mean latency
max mean
0.244695
s
Min
Lowest per-partition mean latency
min mean
0.064114
s
Error count
The total number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_call::call_echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
128084772
over 938.467687901s
mean rate
1.3526327878e+08
/s
std
2.3745730293e+08
/s
p5
209614.33
/s
p95
7.7880792819e+08
/s
peak
1.04724752528e+09
/s
WASM usage: 'remote_call::echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
54772200
over 938.467687901s
mean rate
2.06005812e+06
/s
std
2.85277516e+06
/s
p5
20153.94
/s
p95
9.14776068e+06
/s
peak
1.247346999e+07
/s
WASM usage: 'remote_call::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 938.467687901s
Not enough time data to show a trend.
Zome call duration: 'remote_call::call_echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.116347
s
SD
0.065255
s
p50
0.122708
s
<
p95
0.250785
s
<
p99
0.265329
s
Zome call duration: 'remote_call::echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.003895
s
SD
0.000579
s
p50
0.0039
s
<
p95
0.004819
s
<
p99
0.004864
s
WASM call duration: 'remote_call::call_echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.114981
s
SD
0.065203
s
p50
0.121727
s
<
p95
0.24928
s
<
p99
0.263939
s
WASM call duration: 'remote_call::echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002566
s
SD
0.000398
s
p50
0.002525
s
<
p95
0.003192
s
<
p99
0.00322
s
WASM call duration: 'remote_call::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001695
s
SD
0.000427
s
p50
0.00155
s
<
p95
0.002869
s
≤
p99
0.002869
s
Host function call duration: '__hc__call_1'
Duration of this host function call invoked from within WASM.
mean
0.111855
s
SD
0.065076
s
p50
0.118004
s
<
p95
0.246163
s
<
p99
0.260992
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000292
s
SD
0.000135
s
p50
0.00024
s
<
p95
0.000692
s
≤
p99
0.000692
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
2e-05
s
SD
5e-06
s
p50
2e-05
s
<
p95
2.9e-05
s
<
p99
3.1e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000468
s
SD
0.000193
s
p50
0.00032
s
<
p95
0.000558
s
<
p99
0.000962
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000183
s
SD
6.5e-05
s
p50
0.000159
s
<
p95
0.00028
s
≤
p99
0.00028
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.19
s
<
mean
450.41
s
SD
258.66
s
<
p95
856.36
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
91
over 938.467473519s
mean rate
4.87
/s
std
18.75
/s
p5
0
/s
p95
36.44
/s
peak
147.99
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
2.602784
s
SD
0.884448
s
p50
2.789732
s
<
p95
4.0173
s
<
p99
4.653756
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.977916
s
SD
0.060449
s
p50
1.976923
s
<
p95
2.030769
s
≤
p99
2.030769
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.135701
s
SD
0.252974
s
p50
0.178204
s
<
p95
0.642023
s
<
p99
1.271566
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.00073
s
SD
0.000234
s
p50
0.000708
s
<
p95
0.001221
s
≤
p99
0.001221
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.005619
s
SD
0.010529
s
p50
0.001243
s
<
p95
0.03343
s
<
p99
0.051023
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001552
s
SD
0.000645
s
p50
0.001486
s
<
p95
0.00278
s
<
p99
0.002989
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.813803
s
SD
0.601726
s
p50
0.69194
s
<
p95
2.137681
s
<
p99
2.326762
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.68682
s
SD
0.945037
s
p50
0.519493
s
<
p95
3.483323
s
<
p99
3.969047
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.00026
s
SD
4.2e-05
s
p50
0.000261
s
<
p95
0.000338
s
<
p99
0.000348
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.00011
s
SD
3.4e-05
s
p50
9.8e-05
s
<
p95
0.000181
s
<
p99
0.000217
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000251
s
SD
4.1e-05
s
p50
0.00025
s
<
p95
0.000312
s
<
p99
0.000333
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000215
s
SD
0.00011
s
p50
0.000181
s
<
p95
0.000478
s
<
p99
0.000614
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000108
s
SD
4.7e-05
s
p50
9.7e-05
s
<
p95
0.000233
s
≤
p99
0.000233
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000194
s
SD
6.1e-05
s
p50
0.000181
s
<
p95
0.000341
s
<
p99
0.000463
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000473
s
SD
0.017715
s
p50
0.000858
s
<
p95
0.02709
s
<
p99
0.123294
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000465
s
SD
6.5e-05
s
p50
0.000489
s
<
p95
0.000561
s
<
p99
0.000598
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.086493
s
SD
0.071821
s
p50
0.082678
s
<
p95
0.249527
s
<
p99
0.271062
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.157752
s
SD
0.084874
s
p50
0.125811
s
<
p95
0.332413
s
<
p99
0.354554
s
P2P request roundtrip: 'call_remote'
Time spent sending a call_remote request and awaiting its response.
mean
0.11123
s
SD
0.065047
s
p50
0.117246
s
<
p95
0.24551
s
<
p99
0.260362
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
5.37
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
12.12
KiB/s
<
mean
66.51
KiB/s
SD
508.92
KiB/s
≤
p95
23.60
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
13.44
KiB/s
<
mean
19.03
KiB/s
SD
9.51
KiB/s
<
p95
27.07
KiB/s
Total bytes received
Total bytes received on primary network interface
count
583.24
MiB
mean
635.36
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
166.88
MiB
mean
181.79
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 356.01 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
3.67
%
<
mean
8.33
%
SD
9.84
%
<
p95
24.82
%
System
2.97
%
CPU percentiles
CPU usage percentiles
p50
6.37
%
p95
24.82
%
p99
54.34
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
5.72
%
<
mean
11.45
%
SD
4.04
%
<
p95
18.14
%
Memory available percentage
Percentage of available memory
p5
81.86
%
<
mean
88.55
%
SD
4.04
%
<
p95
94.28
%
Max host memory used
Maximum memory usage percentage across all hosts
max
17.23
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.05
%
Memory growth rate
Rate of memory growth over time
growth
356.01
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.04
MiB/s
Disk write throughput
Disk write throughput in MiB/s
9.85
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/8
hosts
Mount Point /efi-boot
0/7
hosts
Mount Point /etc/hostname
0/1
hosts
Mount Point /etc/hosts
0/1
hosts
Mount Point /etc/resolv.conf
0/1
hosts
Mount Point /nix/store
0/8
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.51
5 min
0.40
15 min
0.22
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.615
%
SD
2.6572
%
<
p95
3.49
%
60 second average
0.6131
%
300 second average
0.4809
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
1.4304
%
SD
3.6732
%
<
p95
4.7
%
60 second average
1.6301
%
300 second average
1.7930
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
1.3016
%
SD
3.3346
%
<
p95
4.35
%
60 second average
1.4942
%
300 second average
1.6698
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.42
%
<
mean
4.72
%
SD
8.65
%
<
p95
5.45
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
172.51
KiB
<
mean
206.41
KiB
SD
41.62
KiB
<
p95
241.99
KiB
Holochain process threads
Number of threads in Holochain process
p5
17
threads
<
mean
18.97
threads
SD
3.99
threads
<
p95
30
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
49
file descriptors
<
mean
59.13
file descriptors
SD
19.53
file descriptors
<
p95
84
file descriptors

Remote Signals

↑ Back to index

This scenario tests the throughput of remote_signals operations.

Started
Wed, 03 Jun 2026 13:05:43 UTC
Peer count
10
Peer count at end
10
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
remote_signals_26886318076_1
Round trip time
The time from origin signal dispatch to origin receive of the remote side's response signal.
mean
0.126628
s
SD
0.260424
s
p50
0.100842
s
<
p95
0.281778
s
<
p99
0.379015
s
Timeouts
The number of timeouts waiting for the remote side's response signal (default timeout is 20 seconds).
total
19
over 24.643788323s
mean rate
0.92
/s
std
0.93
/s
p5
0
/s
p95
1.78
/s
peak
3.54
/s
Timeout rate
The proportion of remote signal round-trips that timed out.
0.0022
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_signal::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 935.799678933s
Not enough time data to show a trend.
WASM usage: 'remote_signal::recv_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
35413113
over 925.799559363s
mean rate
9.2007741122e+08
/s
std
7.75426052606e+09
/s
p5
1914.97
/s
p95
1.85363799686e+09
/s
peak
1.64946210269e+11
/s
WASM usage: 'remote_signal::signal_request'
Metered usage count of the WASM ribosome for this zome function.
total
15485487
over 925.799559363s
mean rate
2.4776342015e+08
/s
std
2.07318257993e+09
/s
p5
0
/s
p95
5.176051236e+08
/s
peak
4.36699266504e+10
/s
Zome call duration: 'remote_signal::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.003755
s
SD
0.000467
s
p50
0.00375
s
<
p95
0.004383
s
<
p99
0.004444
s
Zome call duration: 'remote_signal::signal_request'
Duration of this zome call as measured by Holochain internally.
mean
0.003725
s
SD
0.000406
s
p50
0.003738
s
<
p95
0.004236
s
<
p99
0.004254
s
WASM call duration: 'remote_signal::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001592
s
SD
0.00021
s
p50
0.001609
s
<
p95
0.001965
s
≤
p99
0.001965
s
WASM call duration: 'remote_signal::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002473
s
SD
0.000305
s
p50
0.002508
s
<
p95
0.002881
s
<
p99
0.002933
s
WASM call duration: 'remote_signal::signal_request'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002425
s
SD
0.000266
s
p50
0.002493
s
<
p95
0.002723
s
<
p99
0.002734
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000277
s
SD
5.7e-05
s
p50
0.000262
s
<
p95
0.000417
s
≤
p99
0.000417
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
7.1e-05
s
SD
1e-05
s
p50
7.5e-05
s
<
p95
8.7e-05
s
<
p99
8.8e-05
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
7.7e-05
s
SD
1.1e-05
s
p50
7.8e-05
s
<
p95
9.6e-05
s
<
p99
9.8e-05
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
1.7e-05
s
SD
3e-06
s
p50
1.8e-05
s
<
p95
2e-05
s
≤
p99
2e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000182
s
SD
5.2e-05
s
p50
0.000167
s
<
p95
0.000271
s
≤
p99
0.000271
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
1668
over 925.79967102s
mean rate
134312.54
/s
std
662807.53
/s
p5
0
/s
p95
645300.06
/s
peak
1.077199282e+07
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
1669
over 925.799671313s
mean rate
127708.45
/s
std
548831.34
/s
p5
0
/s
p95
732332.48
/s
peak
6.5681445e+06
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000221
s
SD
0.000106
s
p50
0.000196
s
<
p95
0.000476
s
≤
p99
0.000476
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.46
s
<
mean
451.51
s
SD
259.8
s
<
p95
856.47
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
117
over 935.799749541s
mean rate
35577.29
/s
std
342276.79
/s
p5
0
/s
p95
81330.57
/s
peak
8.49514563e+06
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
3.900325
s
SD
1.877787
s
p50
3.659791
s
<
p95
7.320441
s
<
p99
9.213297
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.953248
s
SD
0.115159
s
p50
1.953846
s
<
p95
1.984615
s
≤
p99
1.984615
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.311089
s
SD
0.38374
s
p50
0.362684
s
<
p95
0.861226
s
<
p99
2.137092
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002915
s
SD
0.003756
s
p50
0.001471
s
<
p95
0.01243
s
≤
p99
0.01243
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.002005
s
SD
0.00105
s
p50
0.001616
s
<
p95
0.00411
s
<
p99
0.004324
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.002279
s
SD
0.00125
s
p50
0.002061
s
<
p95
0.004494
s
<
p99
0.005154
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.76272
s
SD
0.696783
s
p50
0.863881
s
<
p95
2.027901
s
<
p99
4.220626
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.411253
s
SD
0.692687
s
p50
0.246956
s
<
p95
1.937576
s
<
p99
2.568404
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.00024
s
SD
6.2e-05
s
p50
0.000247
s
<
p95
0.000279
s
<
p99
0.000306
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000118
s
SD
2e-05
s
p50
0.000114
s
<
p95
0.000157
s
<
p99
0.000175
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000224
s
SD
3.8e-05
s
p50
0.000233
s
<
p95
0.000257
s
<
p99
0.000334
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000233
s
SD
0.000111
s
p50
0.000234
s
<
p95
0.000332
s
<
p99
0.000455
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000153
s
SD
8.1e-05
s
p50
0.000157
s
<
p95
0.000318
s
≤
p99
0.000318
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000205
s
SD
6e-05
s
p50
0.000184
s
<
p95
0.000318
s
<
p99
0.00041
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000284
s
SD
0.011756
s
p50
0.00089
s
<
p95
0.031994
s
<
p99
0.037281
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000592
s
SD
0.000113
s
p50
0.000593
s
<
p95
0.00071
s
<
p99
0.000718
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.075846
s
SD
0.109477
s
p50
0.039465
s
<
p95
0.293627
s
<
p99
0.369276
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.111275
s
SD
0.044389
s
p50
0.083493
s
<
p95
0.178455
s
<
p99
0.189843
s
P2P received remote signals
Count of remote signals received.
total
1668
over 925.799662678s
mean rate
147819.73
/s
std
1.11071834e+06
/s
p5
0
/s
p95
504686.37
/s
peak
2.097902098e+07
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
4.63
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
5.64
KiB/s
<
mean
92.38
KiB/s
SD
558.03
KiB/s
≤
p95
44.61
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
5.68
KiB/s
<
mean
24.34
KiB/s
SD
73.45
KiB/s
<
p95
33.85
KiB/s
Total bytes received
Total bytes received on primary network interface
count
408.66
MiB
mean
445.18
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
107.66
MiB
mean
117.28
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2.18
%
<
mean
7.17
%
SD
9.75
%
<
p95
10.02
%
System
2.55
%
CPU percentiles
CPU usage percentiles
p50
4.70
%
p95
10.02
%
p99
67.38
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
8.9
%
<
mean
14.13
%
SD
3.25
%
<
p95
18.24
%
Memory available percentage
Percentage of available memory
p5
81.76
%
<
mean
85.87
%
SD
3.25
%
<
p95
91.1
%
Max host memory used
Maximum memory usage percentage across all hosts
max
17.57
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-39.26
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
4.77
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/5
hosts
Mount Point /efi-boot
0/4
hosts
Mount Point /nix/store
0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.46
5 min
0.37
15 min
0.21
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
1.0242
%
SD
4.6923
%
<
p95
3.85
%
60 second average
0.8733
%
300 second average
0.7576
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
1.8764
%
SD
2.8336
%
<
p95
6.81
%
60 second average
1.7407
%
300 second average
1.4926
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
1.6392
%
SD
2.2336
%
<
p95
6.26
%
60 second average
1.5733
%
300 second average
1.3691
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.4
%
<
mean
1.86
%
SD
6.54
%
≤
p95
1.5
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
165.53
KiB
<
mean
185.81
KiB
SD
29.37
KiB
<
p95
221.00
KiB
Holochain process threads
Number of threads in Holochain process
p5
16
threads
<
mean
21.73
threads
SD
6.3
threads
<
p95
30
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
49
file descriptors
<
mean
58.4
file descriptors
SD
13.88
file descriptors
<
p95
82
file descriptors

Single-write, many-read

↑ Back to index

Creates an entry in the agent setup, then read one's own record back. This tests the maximum read performance for reading back local data when the chain is short.

Started
Wed, 03 Jun 2026 13:07:34 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
single_write_many_read_26886318076_1
read call timing
The time it takes to complete the zome call that retrieves the record.
mean
0.004696
s
SD
0.000999
s
p50
0.004486
s
<
p95
0.00563
s
<
p99
0.008255
s
read call rate
The number of read zome calls completed per second.
mean
2098.25
/s
Error count
The number of errors collected.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000488
s
SD
1e-06
s
p50
0.000487
s
<
p95
0.000489
s
≤
p99
0.000489
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 270.003694838s
Not enough time data to show a trend.
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
2709700432
over 270.003694838s
mean rate
1.003579006e+07
/s
std
65848.3
/s
p5
9.94461425e+06
/s
p95
1.01550561e+07
/s
peak
1.01980987e+07
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 270.003694838s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
4648
over 280.003923259s
mean rate
16.6
/s
std
86.25
/s
p5
0
/s
p95
0
/s
peak
464.79
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.00461
s
SD
0
s
p50
0.00461
s
≤
p95
0.00461
s
≤
p99
0.00461
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.002754
s
SD
1.1e-05
s
p50
0.002751
s
<
p95
0.002761
s
<
p99
0.002762
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003814
s
SD
0
s
p50
0.003814
s
≤
p95
0.003814
s
≤
p99
0.003814
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001984
s
SD
7e-06
s
p50
0.001982
s
<
p95
0.001989
s
≤
p99
0.001989
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002144
s
SD
0
s
p50
0.002144
s
≤
p95
0.002144
s
≤
p99
0.002144
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001223
s
SD
3e-06
s
p50
0.001223
s
≤
p95
0.001223
s
<
p99
0.001238
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000377
s
SD
2.4e-05
s
p50
0.000401
s
≤
p95
0.000401
s
≤
p99
0.000401
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000544
s
SD
2e-06
s
p50
0.000544
s
<
p95
0.000546
s
≤
p99
0.000546
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001881
s
SD
0
s
p50
0.001881
s
≤
p95
0.001881
s
≤
p99
0.001881
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000669
s
SD
0
s
p50
0.000669
s
≤
p95
0.000669
s
≤
p99
0.000669
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
16.8
s
<
mean
146.81
s
SD
83.67
s
<
p95
276.81
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
9
over 280.003917006s
mean rate
0.03
/s
std
0.17
/s
p5
0
/s
p95
0
/s
peak
0.9
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.104818
s
SD
0.023782
s
p50
0.102813
s
≤
p95
0.102813
s
<
p99
0.233152
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.003079
s
SD
0
s
p50
0.003079
s
≤
p95
0.003079
s
≤
p99
0.003079
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.00358
s
SD
0
s
p50
0.00358
s
≤
p95
0.00358
s
≤
p99
0.00358
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001443
s
SD
0.000197
s
p50
0.001434
s
≤
p95
0.001434
s
<
p99
0.002513
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.002185
s
SD
0.000168
s
p50
0.002211
s
<
p95
0.0024
s
<
p99
0.002793
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.002307
s
SD
0
s
p50
0.002307
s
≤
p95
0.002307
s
≤
p99
0.002307
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000722
s
SD
3.7e-05
s
p50
0.000719
s
≤
p95
0.000719
s
<
p99
0.00092
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000193
s
SD
1.7e-05
s
p50
0.000193
s
≤
p95
0.000193
s
<
p99
0.000284
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000409
s
SD
6.5e-05
s
p50
0.000409
s
<
p95
0.000418
s
≤
p99
0.000418
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000129
s
SD
3.7e-05
s
p50
0.000129
s
≤
p95
0.000129
s
<
p99
0.000333
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000427
s
SD
6.2e-05
s
p50
0.000427
s
<
p95
0.000428
s
≤
p99
0.000428
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000147
s
SD
0
s
p50
0.000147
s
≤
p95
0.000147
s
≤
p99
0.000147
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000158
s
SD
1.4e-05
s
p50
0.000157
s
<
p95
0.000169
s
<
p99
0.000171
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00025
s
SD
0.018903
s
p50
0.000266
s
<
p95
0.04753
s
≤
p99
0.04753
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000664
s
SD
6.8e-05
s
p50
0.000657
s
≤
p95
0.000657
s
<
p99
0.001028
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
36.31
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
81
B/s
<
mean
1.21
KiB/s
SD
2.36
KiB/s
<
p95
4.60
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
132
B/s
<
mean
1.64
KiB/s
SD
1.36
KiB/s
<
p95
4.29
KiB/s
Total bytes received
Total bytes received on primary network interface
count
352.01
KiB
mean
1.21
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
476.57
KiB
mean
1.64
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 92.3%

Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
54.02
%
<
mean
56.25
%
SD
6.85
%
≤
p95
55.94
%
System
19.94
%
CPU percentiles
CPU usage percentiles
p50
54.93
%
p95
55.94
%
p99
92.30
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.03
s
Memory used percentage
Percentage of memory used
p5
12.87
%
<
mean
13.02
%
SD
0.21
%
<
p95
13.22
%
Memory available percentage
Percentage of available memory
p5
86.78
%
<
mean
86.98
%
SD
0.21
%
<
p95
87.13
%
Max host memory used
Maximum memory usage percentage across all hosts
max
13.02
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-24.71
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
6.22
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
0/1
hosts
Mount Point /etc/hosts
0/1
hosts
Mount Point /etc/resolv.conf
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.03
5 min
0.47
15 min
0.19
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
5.77
%
<
mean
14.5503
%
SD
2.7648
%
<
p95
16.46
%
60 second average
12.0147
%
300 second average
5.7433
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0413
%
SD
0.0948
%
<
p95
0.3
%
60 second average
0.0337
%
300 second average
0.0067
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0303
%
SD
0.0685
%
<
p95
0.21
%
60 second average
0.0227
%
300 second average
0.0027
%
Holochain process CPU usage
CPU usage by Holochain process
p5
47.5
%
<
mean
49.21
%
SD
7.5
%
≤
p95
48.1
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
221.17
KiB
≤
mean
216.92
KiB
SD
29.33
KiB
<
p95
223.31
KiB
Holochain process threads
Number of threads in Holochain process
p5
10
threads
<
mean
10.83
threads
SD
0.45
threads
<
p95
11
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
54
file descriptors
<
mean
55.2
file descriptors
SD
4.06
file descriptors
<
p95
62
file descriptors

Two-party countersigning

↑ Back to index

This scenario tests the performance of countersigning operations. There are two roles: initiate and participate. The participants commit an entry to advertise that they are willing to participate in sessions. They listen for sessions and participate in one at a time.

Started
Wed, 03 Jun 2026 14:21:29 UTC
Peer count
3
Peer count at end
2
Behaviours
  • initiate (1 agent)
  • participate (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
two_party_countersigning_26886318076_1
Session accepted -- timing
The duration of the session from acceptance to completion.
Mean
mean
1.203171
s
SD
3.637955
s
Max
Highest per-partition mean latency
max mean
1.632377
s
Min
Lowest per-partition mean latency
min mean
0.773964
s
Session accepted -- success rate
The number of accepted sessions that completed per second.
Mean
mean
3.74
/s
Max
Highest per-partition mean rate
max
3.89
/s
Min
Lowest per-partition mean rate
min
3.58
/s
Session accepted -- success ratio
Fraction of accepted sessions that completed successfully (0–1).
1
Session accepted -- failures
Accepted sessions that failed to complete.
Total
3
Agents affected
2 / 2
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
2
Max
Highest count in any single partition
2
Min
Lowest count in any single partition
1
Session initiated -- timing
The duration of the session from initiation to completion.
Mean
mean
1.317879
s
SD
1.612089
s
Max
Highest per-partition mean latency
max mean
1.317879
s
Min
Lowest per-partition mean latency
min mean
1.317879
s
Session initiated -- success rate
The number of initiated sessions that completed per second.
Mean
mean
6.62
/s
Max
Highest per-partition mean rate
max
6.62
/s
Min
Lowest per-partition mean rate
min
6.62
/s
Session initiated -- success ratio
Fraction of initiated sessions that completed successfully (0–1).
0.8995
Session initiated -- failures
Initiated sessions that failed to complete.
Total
6
Agents affected
1 / 1
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
6
Max
Highest count in any single partition
6
Min
Lowest count in any single partition
6
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000497
s
SD
9.8e-05
s
p50
0.000518
s
<
p95
0.000569
s
<
p99
0.000571
s
WASM usage: 'countersigning::accept_two_party'
Metered usage count of the WASM ribosome for this zome function.
total
10438794
over 282.805129315s
mean rate
75987.28
/s
std
51199.82
/s
p5
0
/s
p95
138010.06
/s
peak
183925.59
/s
WASM usage: 'countersigning::call_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
5760655
over 284.63505637s
mean rate
92414.49
/s
std
61390.24
/s
p5
24650.06
/s
p95
190033.1
/s
peak
197810.79
/s
WASM usage: 'countersigning::commit_two_party'
Metered usage count of the WASM ribosome for this zome function.
total
20343722
over 284.63505637s
mean rate
1.25056846e+06
/s
std
1.2262338e+06
/s
p5
49895.3
/s
p95
3.10466724e+06
/s
peak
3.1333001e+06
/s
WASM usage: 'countersigning::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 294.635126069s
Not enough time data to show a trend.
WASM usage: 'countersigning::initiator_hello'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 270.006185421s
Not enough time data to show a trend.
WASM usage: 'countersigning::list_participants'
Metered usage count of the WASM ribosome for this zome function.
total
7216290
over 270.006185421s
mean rate
26726.42
/s
std
23633.07
/s
p5
0
/s
p95
80180.49
/s
peak
89088.89
/s
WASM usage: 'countersigning::participant_hello'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 282.805129315s
Not enough time data to show a trend.
WASM usage: 'countersigning::start_two_party'
Metered usage count of the WASM ribosome for this zome function.
total
30653371
over 270.006185421s
mean rate
113528.64
/s
std
99602.14
/s
p5
0
/s
p95
340597.17
/s
peak
359521.41
/s
WASM usage: 'countersigning_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
1046595
over 294.635126069s
mean rate
208557.12
/s
std
232695.83
/s
p5
2263.45
/s
p95
566832.12
/s
peak
575097.73
/s
Zome call duration: 'countersigning::accept_two_party'
Duration of this zome call as measured by Holochain internally.
mean
0.256979
s
SD
0.087769
s
p50
0.195414
s
<
p95
0.399556
s
≤
p99
0.399556
s
Zome call duration: 'countersigning::call_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.002802
s
SD
0.001146
s
p50
0.003365
s
<
p95
0.004495
s
<
p99
0.005824
s
Zome call duration: 'countersigning::commit_two_party'
Duration of this zome call as measured by Holochain internally.
mean
0.147698
s
SD
0.040514
s
p50
0.152362
s
<
p95
0.188376
s
<
p99
0.188467
s
Zome call duration: 'countersigning::initiator_hello'
Duration of this zome call as measured by Holochain internally.
mean
0.001322
s
SD
0
s
p50
0.001322
s
≤
p95
0.001322
s
≤
p99
0.001322
s
Zome call duration: 'countersigning::list_participants'
Duration of this zome call as measured by Holochain internally.
mean
0.003938
s
SD
0.000136
s
p50
0.003955
s
<
p95
0.004008
s
<
p99
0.00401
s
Zome call duration: 'countersigning::participant_hello'
Duration of this zome call as measured by Holochain internally.
mean
0.007227
s
SD
0.003119
s
p50
0.010346
s
≤
p95
0.010346
s
≤
p99
0.010346
s
Zome call duration: 'countersigning::start_two_party'
Duration of this zome call as measured by Holochain internally.
mean
0.245083
s
SD
0.048969
s
p50
0.219334
s
<
p95
0.279784
s
<
p99
0.296379
s
WASM call duration: 'countersigning::accept_two_party'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.291717
s
SD
0.183652
s
p50
0.194286
s
<
p95
0.39862
s
<
p99
1.135577
s
WASM call duration: 'countersigning::call_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001839
s
SD
0.000799
s
p50
0.00224
s
<
p95
0.003014
s
<
p99
0.003938
s
WASM call duration: 'countersigning::commit_two_party'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.14674
s
SD
0.040641
s
p50
0.151775
s
<
p95
0.18722
s
<
p99
0.187274
s
WASM call duration: 'countersigning::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004621
s
SD
0.000756
s
p50
0.004907
s
<
p95
0.005371
s
≤
p99
0.005371
s
WASM call duration: 'countersigning::initiator_hello'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000843
s
SD
0
s
p50
0.000843
s
≤
p95
0.000843
s
≤
p99
0.000843
s
WASM call duration: 'countersigning::list_participants'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00336
s
SD
0.000132
s
p50
0.003373
s
<
p95
0.003428
s
<
p99
0.00343
s
WASM call duration: 'countersigning::participant_hello'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006184
s
SD
0.002773
s
p50
0.008956
s
≤
p95
0.008956
s
≤
p99
0.008956
s
WASM call duration: 'countersigning::start_two_party'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.263246
s
SD
0.094005
s
p50
0.218725
s
<
p95
0.279139
s
<
p99
0.662071
s
WASM call duration: 'countersigning_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001279
s
SD
0.000438
s
p50
0.001827
s
<
p95
0.001993
s
<
p99
0.002089
s
Host function call duration: '__hc__accept_countersigning_preflight_request_1'
Duration of this host function call invoked from within WASM.
mean
0.00092
s
SD
0.000278
s
p50
0.000792
s
<
p95
0.001437
s
<
p99
0.001521
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.5e-05
s
SD
1.6e-05
s
p50
3.8e-05
s
<
p95
6.1e-05
s
<
p99
6.4e-05
s
Host function call duration: '__hc__call_1'
Duration of this host function call invoked from within WASM.
mean
0.272441
s
SD
0.160806
s
p50
0.203281
s
<
p95
0.394492
s
<
p99
1.131435
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000414
s
SD
0.000166
s
p50
0.000289
s
<
p95
0.00066
s
<
p99
0.000685
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000513
s
SD
0.000203
s
p50
0.000716
s
≤
p95
0.000716
s
≤
p99
0.000716
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
6.2e-05
s
SD
2.1e-05
s
p50
7.5e-05
s
<
p95
8.4e-05
s
<
p99
0.000177
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.141599
s
SD
0.04154
s
p50
0.148292
s
<
p95
0.181522
s
<
p99
0.181548
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000569
s
SD
9e-05
s
p50
0.000587
s
<
p95
0.000635
s
<
p99
0.000637
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
4e-06
s
SD
0
s
p50
4e-06
s
≤
p95
4e-06
s
≤
p99
4e-06
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002095
s
SD
0.00107
s
p50
0.00176
s
<
p95
0.004618
s
≤
p99
0.004618
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
83
over 284.635275592s
mean rate
5.35
/s
std
5.7
/s
p5
0
/s
p95
14.15
/s
peak
14.52
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000237
s
SD
6.2e-05
s
p50
0.000276
s
<
p95
0.000313
s
<
p99
0.000332
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.68
s
<
mean
148.39
s
SD
84.67
s
<
p95
278.19
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
980
over 294.635387193s
mean rate
5.17
/s
std
5.65
/s
p5
0
/s
p95
12.13
/s
peak
39.9
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.659706
s
SD
0.537797
s
p50
0.366361
s
<
p95
1.654935
s
<
p99
2.009655
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.67567
s
SD
0.147448
s
p50
1.740513
s
<
p95
1.756257
s
<
p99
1.757949
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.009347
s
SD
0.016034
s
p50
0.009264
s
<
p95
0.022763
s
<
p99
0.119077
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.01125
s
SD
0.007434
s
p50
0.009574
s
<
p95
0.029039
s
<
p99
0.035973
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001158
s
SD
0.000395
s
p50
0.000985
s
<
p95
0.001824
s
<
p99
0.001827
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.00217
s
SD
0.000619
s
p50
0.001873
s
<
p95
0.003116
s
<
p99
0.003231
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.107689
s
SD
0.236333
s
p50
0.03402
s
<
p95
0.676897
s
<
p99
1.005439
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.377977
s
SD
0.17453
s
p50
0.302843
s
<
p95
0.61728
s
<
p99
0.863701
s
Witnessing workflow duration
Time spent running the witnessing workflow.
mean
0.014249
s
SD
0.015886
s
p50
0.001716
s
<
p95
0.038923
s
<
p99
0.043177
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000248
s
SD
4.6e-05
s
p50
0.000255
s
<
p95
0.000317
s
<
p99
0.000322
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000304
s
SD
0.000152
s
p50
0.000308
s
<
p95
0.000545
s
<
p99
0.000548
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000181
s
SD
3.1e-05
s
p50
0.0002
s
<
p95
0.000222
s
<
p99
0.000262
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000176
s
SD
2.9e-05
s
p50
0.000168
s
<
p95
0.000202
s
<
p99
0.000305
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000596
s
SD
0.000593
s
p50
0.00019
s
<
p95
0.001442
s
≤
p99
0.001442
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000161
s
SD
2.4e-05
s
p50
0.000163
s
<
p95
0.000178
s
<
p99
0.00031
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000986
s
SD
0.0113
s
p50
0.000317
s
<
p95
0.039078
s
≤
p99
0.039078
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000325
s
SD
0.000104
s
p50
0.000326
s
<
p95
0.000462
s
<
p99
0.000471
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.732213
s
SD
8.897661
s
p50
0.20545
s
<
p95
0.892594
s
<
p99
60.001922
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.142222
s
SD
0.041462
s
p50
0.154652
s
<
p95
0.181016
s
<
p99
0.181039
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.276838
s
SD
7.147115
s
p50
0.2141
s
<
p95
0.40321
s
<
p99
60.001284
s
P2P request roundtrip: 'call_remote'
Time spent sending a call_remote request and awaiting its response.
mean
0.272084
s
SD
10.78811
s
p50
0.208139
s
<
p95
0.394178
s
<
p99
60.002215
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
33.72
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
8.46
KiB/s
<
mean
276.65
KiB/s
SD
536.76
KiB/s
<
p95
1.34
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
8.91
KiB/s
<
mean
416.29
KiB/s
SD
573.36
KiB/s
<
p95
1.46
MiB/s
Total bytes received
Total bytes received on primary network interface
count
240.44
MiB
mean
820.72
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
361.82
MiB
mean
1.21
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 97.3%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 139.88 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (34.5% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
3.07
%
<
mean
40.25
%
SD
30.21
%
<
p95
89.05
%
System
6.53
%
CPU percentiles
CPU usage percentiles
p50
36.25
%
p95
89.05
%
p99
97.27
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.55
s
Memory used percentage
Percentage of memory used
p5
13.36
%
<
mean
21.06
%
SD
5.45
%
<
p95
26.87
%
Memory available percentage
Percentage of available memory
p5
73.13
%
<
mean
78.94
%
SD
5.45
%
<
p95
86.64
%
Max host memory used
Maximum memory usage percentage across all hosts
max
26.62
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
34.50
%
Memory growth rate
Rate of memory growth over time
growth
139.88
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
14.22
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /efi-boot
0/1
hosts
Mount Point /etc/hostname
1/1
hosts
Mount Point /etc/hosts
1/1
hosts
Mount Point /etc/resolv.conf
1/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.70
5 min
2.15
15 min
1.59
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
7.2074
%
SD
9.0096
%
<
p95
23.8
%
60 second average
7.0867
%
300 second average
4.9566
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
9.5217
%
SD
13.8125
%
<
p95
34.91
%
60 second average
8.4747
%
300 second average
6.4805
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
7.3997
%
SD
10.7301
%
<
p95
28.02
%
60 second average
6.6572
%
300 second average
5.2953
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.15
%
<
mean
6.25
%
SD
9.67
%
<
p95
24.87
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
24.24
KiB
<
mean
159.59
KiB
SD
98.26
KiB
<
p95
268.79
KiB
Holochain process threads
Number of threads in Holochain process
p5
9
threads
<
mean
21.85
threads
SD
11.95
threads
<
p95
42
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
12
file descriptors
<
mean
70.34
file descriptors
SD
27.08
file descriptors
<
p95
134
file descriptors

Unyt Chain Transaction

↑ Back to index

Tests Unyt chain transaction system performance with credit ledger and smart agreement primitives. The scenario has three roles:

  • initiate: Progenitor agent that initializes the network with system templates, global configuration, and foundational smart agreements
  • spend: Transaction agents that accept incoming commitments and create spend transactions distributed among participants
  • smart_agreements: Smart agreement agents that collect RAVEs, execute agreements, and create parked link spending transactions
Started
Wed, 03 Jun 2026 16:55:09 UTC
Peer count
30
Peer count at end
3
Behaviours
  • initiate (1 agent)
  • smart_agreements (1 agent)
  • spend (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
unyt_chain_transaction_26886318076_1
Global definition propagation time
Time from session start until each agent detected the global_definition propagation. Shows aggregate statistics across agents.
Mean
mean
8
s
SD
0
s
Max
Highest per-partition mean latency
max mean
16
s
Min
Lowest per-partition mean latency
min mean
0
s
Sync lag: Commitment transactions
Time between commitment creation and discovery by the receiving agent (seconds). Shows aggregate statistics across agents.
Mean
mean
14.021063
s
SD
5.552675
s
Max
Highest per-partition mean latency
max mean
15.298807
s
Min
Lowest per-partition mean latency
min mean
12.743319
s
Sync lag: RAVE transactions
Time between RAVE creation and discovery by smart_agreements agents (seconds). Shows aggregate statistics across agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Sync lag: Grouped parked requests
Time between grouped_parked request creation and discovery (seconds). Shows aggregate statistics across agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Final ledger balance
Final ledger balance across all agents at teardown (base unyt units). Sum should be stable across runs; deviation indicates value was created or destroyed.
sum
-1003928006568
mean
-3.34642668856e+11
min
-705043317645
max
0
n
3
Final ledger fees
Final ledger fees owed across all agents at teardown (base unyt units).
sum
3326955404
mean
1.10898513467e+09
min
0
max
2344867262
n
3
Actionable transaction commitments
Remaining actionable transaction commitments at teardown. Non-zero sum indicates work left unfinished.
sum
2
mean
0.67
min
0
max
2
n
3
Actionable transaction accepts
Remaining actionable transaction accepts at teardown. Non-zero sum indicates work left unfinished.
sum
0
mean
0
min
0
max
0
n
3
Completed transaction accepts
Completed transaction accepts at teardown.
sum
101
mean
33.67
min
0
max
57
n
3
Completed transaction spends
Completed transaction spends at teardown.
sum
106
mean
35.33
min
0
max
62
n
3
Completed transaction RAVEs
Completed transaction RAVEs at teardown.
sum
106
mean
35.33
min
0
max
62
n
3
Parked spends
Parked spend counts at teardown. These are pending link-spending transactions.
sum
104
mean
34.67
min
0
max
61
n
3
Check agent exists: Duration
Duration of the check_agent_exists loop per behaviour iteration (seconds).
mean
0.006217
s
SD
0.008
s
p50
6e-06
s
<
p95
0.014604
s
<
p99
0.016673
s
Check agent exists: Total calls
Total check_agent_exists calls made across all agents and iterations.
sum
104
mean
0.47
min
0
max
1
n
221
Check agent exists: Failed calls
Total check_agent_exists calls that failed across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
221
Check agent exists: Missing agents
Total check_agent_exists calls that reported a missing agent across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
221
UI action list refresh: Duration
Duration of the UI action list refresh per behaviour iteration (seconds).
mean
0.07234
s
SD
0.028488
s
p50
0.067463
s
<
p95
0.113396
s
<
p99
0.118778
s
UI action list refresh: Failed calls
Total UI action list refresh calls that failed across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
221
UI routine refresh: Duration
Duration of the full UI routine refresh per behaviour iteration (seconds), including check_agent_exists, action list refresh, and transaction detail refresh.
mean
1.367783
s
SD
1.717817
s
p50
0.261093
s
<
p95
4.581405
s
<
p99
7.545915
s
UI routine refresh: Watchlist count
Watchlist size (number of transactions being tracked) per behaviour iteration. Indicates how many transactions agents are actively monitoring.
sum
200
mean
0.9
min
0
max
4
n
221
UI transaction detail item refresh: Duration
Duration of refreshing a single transaction detail item per behaviour iteration (seconds).
mean
1.290717
s
SD
0.992257
s
p50
1.068652
s
<
p95
3.574837
s
<
p99
4.232688
s
UI transaction detail item refresh: Primary transaction total calls
Total primary transaction fetches made during per-item detail refresh across all agents and iterations.
sum
400
mean
2
min
2
max
2
n
200
UI transaction detail item refresh: Primary transaction failed calls
Total primary transaction fetches that failed during per-item detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
200
UI transaction detail item refresh: Related transaction total calls
Total related transaction fetches made during per-item detail refresh across all agents and iterations.
sum
69
mean
0.35
min
0
max
1
n
200
UI transaction detail item refresh: Related transaction failed calls
Total related transaction fetches that failed during per-item detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
200
UI transaction detail refresh: Duration
Duration of refreshing all watched transaction details per behaviour iteration (seconds).
mean
2.482167
s
SD
1.704426
s
p50
2.165117
s
<
p95
5.673976
s
<
p99
8.312553
s
UI transaction detail refresh: Transactions processed
Total number of transactions processed during the detail refresh across all agents and iterations.
sum
200
mean
1.92
min
1
max
4
n
104
UI transaction detail refresh: Primary transaction total calls
Total primary transaction fetches made during the full detail refresh across all agents and iterations.
sum
400
mean
3.85
min
2
max
8
n
104
UI transaction detail refresh: Primary transaction failed calls
Total primary transaction fetches that failed during the full detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
104
UI transaction detail refresh: Related transaction total calls
Total related transaction fetches made during the full detail refresh across all agents and iterations.
sum
69
mean
0.66
min
0
max
2
n
104
UI transaction detail refresh: Related transaction failed calls
Total related transaction fetches that failed during the full detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
104
Error count
The total number of errors accumulated across all agents over the run.
12
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.002781
s
SD
0.001617
s
p50
0.0009
s
<
p95
0.003446
s
<
p99
0.010387
s
WASM usage: 'transactor::check_agent_exists'
Metered usage count of the WASM ribosome for this zome function.
total
668580
over 700.006267294s
mean rate
18885.17
/s
std
10023.12
/s
p5
1114.33
/s
p95
34473.22
/s
peak
34478.24
/s
WASM usage: 'transactor::create_accept'
Metered usage count of the WASM ribosome for this zome function.
total
2071904820
over 694.856529632s
mean rate
1.753745319e+07
/s
std
1.455221503e+07
/s
p5
488286.67
/s
p95
4.206652249e+07
/s
peak
5.496960462e+07
/s
WASM usage: 'transactor::create_code_template'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 744.857308176s
Not enough time data to show a trend.
WASM usage: 'transactor::create_commitment'
Metered usage count of the WASM ribosome for this zome function.
total
2735140583
over 700.006267294s
mean rate
8.934547176e+07
/s
std
5.810314939e+07
/s
p5
8.30831081e+06
/s
p95
1.8768445002e+08
/s
peak
2.0546364193e+08
/s
WASM usage: 'transactor::create_smart_agreement'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 720.007977079s
Not enough time data to show a trend.
WASM usage: 'transactor::get_actionable_transactions'
Metered usage count of the WASM ribosome for this zome function.
total
507385224
over 734.857095874s
mean rate
1.58315533e+07
/s
std
4.79134819e+06
/s
p5
3.2300689e+06
/s
p95
2.301780427e+07
/s
peak
2.320474107e+07
/s
WASM usage: 'transactor::get_all_notification_links'
Metered usage count of the WASM ribosome for this zome function.
total
25077875
over 734.857095874s
mean rate
5.09091191e+06
/s
std
1.39476871e+06
/s
p5
853322.74
/s
p95
5.60091579e+06
/s
peak
5.65011675e+06
/s
WASM usage: 'transactor::get_code_templates_lib'
Metered usage count of the WASM ribosome for this zome function.
total
92722932
over 742.021051482s
mean rate
1.967114793e+07
/s
std
8.82997821e+06
/s
p5
3.84279105e+06
/s
p95
2.967616181e+07
/s
peak
3.025820561e+07
/s
WASM usage: 'transactor::get_current_global_definition'
Metered usage count of the WASM ribosome for this zome function.
total
10253361
over 744.857308176s
mean rate
3.484589725e+07
/s
std
4.489106733e+07
/s
p5
465930.03
/s
p95
1.2449855699e+08
/s
peak
1.4064771091e+08
/s
WASM usage: 'transactor::get_global_units_details'
Metered usage count of the WASM ribosome for this zome function.
total
24133458
over 734.857095874s
mean rate
8.14663916e+06
/s
std
2.24693652e+06
/s
p5
1.43953545e+06
/s
p95
9.37203582e+06
/s
peak
9.45491075e+06
/s
WASM usage: 'transactor::get_history'
Metered usage count of the WASM ribosome for this zome function.
total
1138603385
over 734.857095874s
mean rate
2.917117893e+07
/s
std
1.697276674e+07
/s
p5
3.84480344e+06
/s
p95
5.669786293e+07
/s
peak
6.075486581e+07
/s
WASM usage: 'transactor::get_incoming_raves'
Metered usage count of the WASM ribosome for this zome function.
total
13746639
over 734.857095874s
mean rate
4.63934772e+06
/s
std
1.28066273e+06
/s
p5
819853.24
/s
p95
5.33762048e+06
/s
peak
5.38481993e+06
/s
WASM usage: 'transactor::get_ledger'
Metered usage count of the WASM ribosome for this zome function.
total
1112916344
over 734.857095874s
mean rate
1.3570266646e+08
/s
std
1.4016403562e+08
/s
p5
3.97571397e+06
/s
p95
4.094123861e+08
/s
peak
4.4777709418e+08
/s
WASM usage: 'transactor::get_my_current_applied_credit_limit'
Metered usage count of the WASM ribosome for this zome function.
total
929144826
over 734.857095874s
mean rate
3.1362459159e+08
/s
std
8.656409204e+07
/s
p5
5.54213746e+07
/s
p95
3.60842044e+08
/s
peak
3.6401576081e+08
/s
WASM usage: 'transactor::get_requests_to_execute_agreements'
Metered usage count of the WASM ribosome for this zome function.
total
14083338
over 734.857095874s
mean rate
4.75365491e+06
/s
std
1.31240504e+06
/s
p5
839936.98
/s
p95
5.4686322e+06
/s
peak
5.51673053e+06
/s
WASM usage: 'transactor::get_smart_agreements_for_code_template'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 742.021051482s
Not enough time data to show a trend.
WASM usage: 'transactor::get_sorted_requests_to_spend'
Metered usage count of the WASM ribosome for this zome function.
total
14464725
over 734.857095874s
mean rate
4.88240689e+06
/s
std
1.34795122e+06
/s
p5
862686.32
/s
p95
5.61674777e+06
/s
peak
5.66614882e+06
/s
WASM usage: 'transactor::get_status'
Metered usage count of the WASM ribosome for this zome function.
total
40025804816
over 700.006267294s
mean rate
1.5788732367e+09
/s
std
1.12562748965e+09
/s
p5
4.808343016e+07
/s
p95
3.42063022926e+09
/s
peak
3.61734370137e+09
/s
WASM usage: 'transactor::get_transaction'
Metered usage count of the WASM ribosome for this zome function.
total
1930129137
over 700.006267294s
mean rate
9.293263833e+07
/s
std
4.530916793e+07
/s
p5
1.39929987e+07
/s
p95
1.5425968852e+08
/s
peak
1.5431392019e+08
/s
WASM usage: 'transactor::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 864.859280026s
Not enough time data to show a trend.
WASM usage: 'transactor::initialize_global_definition'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 720.007977079s
Not enough time data to show a trend.
WASM usage: 'transactor::post_commit'
Metered usage count of the WASM ribosome for this zome function.
total
2011681855
over 864.859280026s
mean rate
3.5238785077e+08
/s
std
3.3060220625e+08
/s
p5
7008.53
/s
p95
9.0823834397e+08
/s
peak
9.6947906694e+08
/s
WASM usage: 'transactor::recv_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
1133388938
over 704.856839115s
mean rate
4.63371622e+06
/s
std
3.06024169e+06
/s
p5
537823.6
/s
p95
1.136725544e+07
/s
peak
1.376131324e+07
/s
WASM usage: 'transactor::whoami'
Metered usage count of the WASM ribosome for this zome function.
total
509417
over 734.857095874s
mean rate
174285.89
/s
std
48114.24
/s
p5
30806.75
/s
p95
200569.72
/s
peak
202343.32
/s
WASM usage: 'transactor_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
1554197448
over 904.859639533s
mean rate
1.6696863218e+08
/s
std
2.2150933816e+08
/s
p5
0
/s
p95
6.3700638756e+08
/s
peak
7.0292237281e+08
/s
WASM usage: 'transactor_integrity::genesis_self_check_2'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 904.859639533s
Not enough time data to show a trend.
WASM usage: 'transactor_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
15931103990
over 864.859280026s
mean rate
2.48451107108e+09
/s
std
2.77198639991e+09
/s
p5
0
/s
p95
8.20528508476e+09
/s
peak
9.57962968387e+09
/s
Zome call duration: 'transactor::check_agent_exists'
Duration of this zome call as measured by Holochain internally.
mean
0.007962
s
SD
0.000437
s
p50
0.007966
s
<
p95
0.00856
s
<
p99
0.00891
s
Zome call duration: 'transactor::create_accept'
Duration of this zome call as measured by Holochain internally.
mean
0.184088
s
SD
0.048293
s
p50
0.137936
s
<
p95
0.239473
s
<
p99
0.242142
s
Zome call duration: 'transactor::create_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.023638
s
SD
0.006985
s
p50
0.030935
s
<
p95
0.033953
s
≤
p99
0.033953
s
Zome call duration: 'transactor::create_commitment'
Duration of this zome call as measured by Holochain internally.
mean
0.133735
s
SD
0.042434
s
p50
0.110337
s
<
p95
0.185444
s
<
p99
0.209376
s
Zome call duration: 'transactor::create_smart_agreement'
Duration of this zome call as measured by Holochain internally.
mean
0.014115
s
SD
0
s
p50
0.014115
s
≤
p95
0.014115
s
≤
p99
0.014115
s
Zome call duration: 'transactor::get_actionable_transactions'
Duration of this zome call as measured by Holochain internally.
mean
0.027736
s
SD
0.00615
s
p50
0.028838
s
<
p95
0.032273
s
<
p99
0.033334
s
Zome call duration: 'transactor::get_all_notification_links'
Duration of this zome call as measured by Holochain internally.
mean
0.013979
s
SD
0.00293
s
p50
0.014098
s
<
p95
0.018849
s
<
p99
0.018969
s
Zome call duration: 'transactor::get_code_templates_lib'
Duration of this zome call as measured by Holochain internally.
mean
0.009431
s
SD
0.002896
s
p50
0.009018
s
<
p95
0.015059
s
<
p99
0.01552
s
Zome call duration: 'transactor::get_current_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.032251
s
SD
0.005496
s
p50
0.028508
s
<
p95
0.034038
s
<
p99
0.034522
s
Zome call duration: 'transactor::get_global_units_details'
Duration of this zome call as measured by Holochain internally.
mean
0.014268
s
SD
0.003269
s
p50
0.014244
s
<
p95
0.020542
s
<
p99
0.020742
s
Zome call duration: 'transactor::get_history'
Duration of this zome call as measured by Holochain internally.
mean
0.068361
s
SD
0.007714
s
p50
0.066389
s
<
p95
0.073596
s
<
p99
0.07377
s
Zome call duration: 'transactor::get_incoming_raves'
Duration of this zome call as measured by Holochain internally.
mean
0.011198
s
SD
0.00254
s
p50
0.011944
s
<
p95
0.01245
s
<
p99
0.012693
s
Zome call duration: 'transactor::get_ledger'
Duration of this zome call as measured by Holochain internally.
mean
0.051726
s
SD
0.010631
s
p50
0.054265
s
<
p95
0.062422
s
<
p99
0.06757
s
Zome call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of this zome call as measured by Holochain internally.
mean
0.023463
s
SD
0.003956
s
p50
0.024044
s
<
p95
0.026333
s
<
p99
0.028492
s
Zome call duration: 'transactor::get_requests_to_execute_agreements'
Duration of this zome call as measured by Holochain internally.
mean
0.011415
s
SD
0.003007
s
p50
0.012404
s
<
p95
0.012866
s
<
p99
0.013037
s
Zome call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.010602
s
SD
0.001924
s
p50
0.008916
s
<
p95
0.011569
s
<
p99
0.011909
s
Zome call duration: 'transactor::get_sorted_requests_to_spend'
Duration of this zome call as measured by Holochain internally.
mean
0.011684
s
SD
0.00322
s
p50
0.012744
s
<
p95
0.013173
s
<
p99
0.013318
s
Zome call duration: 'transactor::get_status'
Duration of this zome call as measured by Holochain internally.
mean
0.966846
s
SD
0.494112
s
p50
0.821107
s
<
p95
1.854865
s
<
p99
1.962157
s
Zome call duration: 'transactor::get_transaction'
Duration of this zome call as measured by Holochain internally.
mean
0.01142
s
SD
0.002621
s
p50
0.009627
s
<
p95
0.015065
s
<
p99
0.015129
s
Zome call duration: 'transactor::initialize_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.029405
s
SD
0
s
p50
0.029405
s
≤
p95
0.029405
s
≤
p99
0.029405
s
Zome call duration: 'transactor::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.020627
s
SD
0.006185
s
p50
0.019705
s
<
p95
0.029354
s
<
p99
0.030731
s
Zome call duration: 'transactor::whoami'
Duration of this zome call as measured by Holochain internally.
mean
0.004948
s
SD
0.00118
s
p50
0.005182
s
<
p95
0.007068
s
<
p99
0.007187
s
WASM call duration: 'transactor::check_agent_exists'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.0051
s
SD
0.000317
s
p50
0.005133
s
<
p95
0.005556
s
<
p99
0.005813
s
WASM call duration: 'transactor::create_accept'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.179246
s
SD
0.048527
s
p50
0.134986
s
<
p95
0.23665
s
<
p99
0.239337
s
WASM call duration: 'transactor::create_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.021276
s
SD
0.006435
s
p50
0.027785
s
<
p95
0.030922
s
≤
p99
0.030922
s
WASM call duration: 'transactor::create_commitment'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.132385
s
SD
0.042122
s
p50
0.109293
s
<
p95
0.183668
s
<
p99
0.207689
s
WASM call duration: 'transactor::create_smart_agreement'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.012699
s
SD
0
s
p50
0.012699
s
≤
p95
0.012699
s
≤
p99
0.012699
s
WASM call duration: 'transactor::get_actionable_transactions'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.025524
s
SD
0.005865
s
p50
0.026506
s
<
p95
0.029935
s
<
p99
0.031044
s
WASM call duration: 'transactor::get_all_notification_links'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.011782
s
SD
0.002838
s
p50
0.011894
s
<
p95
0.016511
s
<
p99
0.016611
s
WASM call duration: 'transactor::get_code_templates_lib'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.008135
s
SD
0.002521
s
p50
0.007763
s
<
p95
0.013086
s
<
p99
0.013382
s
WASM call duration: 'transactor::get_current_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.024792
s
SD
0.005871
s
p50
0.018229
s
<
p95
0.030535
s
<
p99
0.031122
s
WASM call duration: 'transactor::get_global_units_details'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.012036
s
SD
0.002919
s
p50
0.011987
s
<
p95
0.017757
s
<
p99
0.017955
s
WASM call duration: 'transactor::get_history'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.066207
s
SD
0.007106
s
p50
0.063882
s
<
p95
0.071198
s
<
p99
0.071363
s
WASM call duration: 'transactor::get_incoming_raves'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.009093
s
SD
0.002023
s
p50
0.009663
s
<
p95
0.010088
s
<
p99
0.010166
s
WASM call duration: 'transactor::get_ledger'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.049508
s
SD
0.010544
s
p50
0.051747
s
<
p95
0.061096
s
<
p99
0.065364
s
WASM call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.02175
s
SD
0.00358
s
p50
0.02228
s
<
p95
0.024326
s
<
p99
0.026377
s
WASM call duration: 'transactor::get_requests_to_execute_agreements'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00921
s
SD
0.002331
s
p50
0.009947
s
<
p95
0.010268
s
<
p99
0.010452
s
WASM call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.009028
s
SD
0.001689
s
p50
0.007465
s
<
p95
0.009948
s
<
p99
0.010317
s
WASM call duration: 'transactor::get_sorted_requests_to_spend'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.009481
s
SD
0.00257
s
p50
0.010288
s
<
p95
0.010718
s
<
p99
0.010769
s
WASM call duration: 'transactor::get_status'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.965123
s
SD
0.493713
s
p50
0.819856
s
<
p95
1.852271
s
<
p99
1.959563
s
WASM call duration: 'transactor::get_transaction'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.010021
s
SD
0.002207
s
p50
0.008495
s
<
p95
0.013094
s
<
p99
0.013145
s
WASM call duration: 'transactor::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.036739
s
SD
0.014642
s
p50
0.037542
s
<
p95
0.054196
s
≤
p99
0.054196
s
WASM call duration: 'transactor::initialize_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.028278
s
SD
0
s
p50
0.028278
s
≤
p95
0.028278
s
≤
p99
0.028278
s
WASM call duration: 'transactor::post_commit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.035539
s
SD
0.013657
s
p50
0.024116
s
<
p95
0.04743
s
<
p99
0.047908
s
WASM call duration: 'transactor::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.017938
s
SD
0.005376
s
p50
0.017122
s
<
p95
0.025654
s
<
p99
0.026381
s
WASM call duration: 'transactor::whoami'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002867
s
SD
0.000774
s
p50
0.003229
s
<
p95
0.00424
s
<
p99
0.004292
s
WASM call duration: 'transactor_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001811
s
SD
0.000644
s
p50
0.001618
s
<
p95
0.00289
s
<
p99
0.003112
s
WASM call duration: 'transactor_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001587
s
SD
0.000231
s
p50
0.001637
s
<
p95
0.00165
s
<
p99
0.00289
s
WASM call duration: 'transactor_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.024497
s
SD
0.012502
s
p50
0.017809
s
<
p95
0.044827
s
<
p99
0.051249
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.9e-05
s
SD
1.5e-05
s
p50
2.9e-05
s
<
p95
5.9e-05
s
<
p99
6.2e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000415
s
SD
0.000184
s
p50
0.000358
s
<
p95
0.000782
s
≤
p99
0.000782
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000428
s
SD
0.000195
s
p50
0.000321
s
<
p95
0.000759
s
≤
p99
0.000759
s
Host function call duration: '__hc__delete_link_1'
Duration of this host function call invoked from within WASM.
mean
0.001336
s
SD
0.000451
s
p50
0.001177
s
<
p95
0.001884
s
<
p99
0.001968
s
Host function call duration: '__hc__dna_info_2'
Duration of this host function call invoked from within WASM.
mean
1e-05
s
SD
3e-06
s
p50
8e-06
s
<
p95
1.3e-05
s
≤
p99
1.3e-05
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
6.2e-05
s
SD
2.3e-05
s
p50
4.9e-05
s
<
p95
0.000103
s
<
p99
0.000109
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.068408
s
SD
0.044556
s
p50
0.002368
s
<
p95
0.138254
s
<
p99
0.173338
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.006195
s
SD
0.001155
s
p50
0.005824
s
<
p95
0.007292
s
<
p99
0.007481
s
Host function call duration: '__hc__get_details_1'
Duration of this host function call invoked from within WASM.
mean
0.000447
s
SD
0.000661
s
p50
0.000349
s
<
p95
0.001618
s
<
p99
0.00324
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.001597
s
SD
0.000891
s
p50
0.001394
s
<
p95
0.003574
s
<
p99
0.004957
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.002699
s
SD
0.000918
s
p50
0.002342
s
<
p95
0.003969
s
<
p99
0.004279
s
Host function call duration: '__hc__must_get_entry_1'
Duration of this host function call invoked from within WASM.
mean
0.001183
s
SD
9.4e-05
s
p50
0.001224
s
<
p95
0.001325
s
<
p99
0.001444
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.000373
s
SD
0.000315
s
p50
0.000444
s
<
p95
0.001152
s
<
p99
0.001325
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.001102
s
SD
0.001734
s
p50
0.000652
s
<
p95
0.00522
s
<
p99
0.008621
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
4.7e-05
s
SD
7e-06
s
p50
4.2e-05
s
<
p95
5.8e-05
s
<
p99
6.2e-05
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
9e-06
s
SD
6e-06
s
p50
8e-06
s
<
p95
2.4e-05
s
<
p99
2.5e-05
s
Host function call duration: '__hc__trace_1'
Duration of this host function call invoked from within WASM.
mean
6.3e-05
s
SD
2.8e-05
s
p50
7.9e-05
s
<
p95
0.000136
s
<
p99
0.000155
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00316
s
SD
0.001607
s
p50
0.003915
s
<
p95
0.007251
s
<
p99
0.007748
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
100
over 704.856767557s
mean rate
0.29
/s
std
0.26
/s
p5
0
/s
p95
0.99
/s
peak
0.99
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
218
over 700.006304782s
mean rate
3.53
/s
std
1.85
/s
p5
0.19
/s
p95
6.39
/s
peak
6.6
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.037788
s
SD
0.01424
s
p50
0.025663
s
<
p95
0.050449
s
<
p99
0.050906
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
14.36
s
<
mean
244.7
s
SD
265.6
s
<
p95
807.03
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
2628
over 904.859692108s
mean rate
3.73
/s
std
4.14
/s
p5
0
/s
p95
11.93
/s
peak
21.15
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
2.724292
s
SD
4.144923
s
p50
2.731129
s
<
p95
11.098921
s
<
p99
23.411034
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
2.015702
s
SD
0.381545
s
p50
1.839313
s
<
p95
2.520937
s
<
p99
2.534422
s
App validation workflow duration
Time spent running the app validation workflow.
mean
2.185549
s
SD
1.95647
s
p50
2.182294
s
<
p95
7.038212
s
<
p99
11.026394
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001073
s
SD
0.000201
s
p50
0.000943
s
<
p95
0.001306
s
<
p99
0.001748
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001787
s
SD
0.000456
s
p50
0.001593
s
<
p95
0.002373
s
<
p99
0.002514
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.013215
s
SD
0.005869
s
p50
0.004839
s
<
p95
0.02019
s
<
p99
0.021121
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.015248
s
SD
0.090631
s
p50
0.007934
s
<
p95
0.328008
s
<
p99
0.422108
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.024562
s
SD
0.011206
s
p50
0.01874
s
<
p95
0.040152
s
<
p99
0.04551
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.001223
s
SD
0.00059
s
p50
0.000555
s
<
p95
0.001974
s
<
p99
0.002187
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001178
s
SD
0.000626
s
p50
0.000322
s
<
p95
0.001962
s
<
p99
0.002164
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000349
s
SD
0.0021
s
p50
0.000181
s
<
p95
0.000957
s
<
p99
0.012963
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.001262
s
SD
0.000628
s
p50
0.000747
s
<
p95
0.002112
s
<
p99
0.002276
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000212
s
SD
0.000199
s
p50
0.000125
s
<
p95
0.000655
s
≤
p99
0.000655
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000266
s
SD
0.000194
s
p50
0.000202
s
<
p95
0.000465
s
<
p99
0.001151
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000798
s
SD
0.375807
s
p50
0.000571
s
<
p95
0.817381
s
<
p99
1.614879
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000225
s
SD
9.7e-05
s
p50
0.000204
s
<
p95
0.000436
s
<
p99
0.000558
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.002438
s
SD
0.000221
s
p50
0.002452
s
<
p95
0.002709
s
<
p99
0.002983
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.005815
s
SD
0.001177
s
p50
0.005335
s
<
p95
0.007049
s
<
p99
0.007257
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.015684
s
SD
0.004611
s
p50
0.015422
s
<
p95
0.018636
s
<
p99
0.022418
s
P2P received remote signals
Count of remote signals received.
total
100
over 704.856797775s
mean rate
0.29
/s
std
0.26
/s
p5
0
/s
p95
0.99
/s
peak
0.99
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
8.59
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
453
B/s
<
mean
135.03
KiB/s
SD
527.87
KiB/s
<
p95
626.70
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
214
B/s
<
mean
12.15
KiB/s
SD
12.51
KiB/s
<
p95
30.39
KiB/s
Total bytes received
Total bytes received on primary network interface
count
957.34
MiB
mean
759.93
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
86.15
MiB
mean
68.39
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 99.1%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 2418.49 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 3% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.58
%
<
mean
11.29
%
SD
20.18
%
<
p95
34.83
%
System
2.70
%
CPU percentiles
CPU usage percentiles
p50
2.41
%
p95
34.83
%
p99
99.07
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
5
hosts
mean time
0.10
s
Memory used percentage
Percentage of memory used
p5
5.08
%
<
mean
17.04
%
SD
10.41
%
<
p95
34.7
%
Memory available percentage
Percentage of available memory
p5
65.3
%
<
mean
82.96
%
SD
10.41
%
<
p95
94.92
%
Max host memory used
Maximum memory usage percentage across all hosts
max
26.52
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.05
%
Memory growth rate
Rate of memory growth over time
growth
2418.49
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.01
MiB/s
Disk write throughput
Disk write throughput in MiB/s
50.98
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/18
hosts
Mount Point /boot
0/1
hosts
Mount Point /efi-boot
0/14
hosts
Mount Point /etc/hostname
0/5
hosts
Mount Point /etc/hosts
0/5
hosts
Mount Point /etc/resolv.conf
0/5
hosts
Mount Point /nix/store
0/18
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.79
5 min
0.81
15 min
0.82
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
3.45
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
2.1113
%
SD
11.0538
%
≤
p95
2.07
%
60 second average
1.9767
%
300 second average
2.0781
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
2.2924
%
SD
3.7817
%
<
p95
8.95
%
60 second average
2.8093
%
300 second average
3.4042
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
2.0828
%
SD
3.6383
%
<
p95
8.31
%
60 second average
2.5524
%
300 second average
3.0725
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.02
%
<
mean
4.26
%
SD
14.12
%
<
p95
29.38
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
18.96
KiB
<
mean
368.73
KiB
SD
368.64
KiB
<
p95
919.68
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
17.58
threads
SD
12.35
threads
<
p95
36
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
8
file descriptors
<
mean
46.5
file descriptors
SD
20.83
file descriptors
<
p95
76
file descriptors

Validation Receipts

↑ Back to index

Creates an entry, wait for required validation receipts, then repeat. Records the amount of time it took to accumulate the required number of receipts for all DHT operations. This is measured to the nearest 20ms so that we don't keep the agent too busy checking for receipts.

Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

By default, this scenario will wait for a complete set of validation receipts before committing the next record. If the NO_VALIDATION_COMPLETE environment variable is set, it will instead publish new records on every round, building up an ever-growing list of action hashes to check on.

Started
Wed, 03 Jun 2026 13:22:07 UTC
Peer count
20
Peer count at end
20
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
validation_receipts_26886318076_1
Receipts complete timing
The amount of time between publishing a record and receiving the required number of validation receipts.
Mean
mean
11.272986
s
SD
5.973284
s
Max
Highest per-partition mean latency
max mean
40.034091
s
Min
Lowest per-partition mean latency
min mean
8.468868
s
Receipts complete rate
The number of complete validation receipt sets collected per second.
Mean
mean
1.25
/s
Max
Highest per-partition mean rate
max
1.38
/s
Min
Lowest per-partition mean rate
min
1
/s
Error count
The total number of errors accumulated during the run.
1
Holochain MetricsClick to toggle visibility.
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
1
over 420.00294193s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37474.138269712s
Not enough time data to show a trend.
WASM usage: 'crud::get_sample_entry_validation_receipts'
Metered usage count of the WASM ribosome for this zome function.
total
1079048
over 37474.138269712s
mean rate
2.371984957e+07
/s
std
6.046786012e+07
/s
p5
0
/s
p95
1.5447507444e+08
/s
peak
3.3846766565e+08
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37474.138269712s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37474.138269712s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006753
s
SD
0.002159
s
p50
0.006275
s
<
p95
0.009983
s
<
p99
0.01059
s
Zome call duration: 'crud::get_sample_entry_validation_receipts'
Duration of this zome call as measured by Holochain internally.
mean
0.010039
s
SD
0.006263
s
p50
0.007941
s
<
p95
0.023871
s
<
p99
0.028526
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005595
s
SD
0.001809
s
p50
0.005185
s
<
p95
0.008364
s
<
p99
0.008766
s
WASM call duration: 'crud::get_sample_entry_validation_receipts'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.008779
s
SD
0.005953
s
p50
0.00678
s
<
p95
0.021913
s
<
p99
0.026653
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002022
s
SD
0.001211
s
p50
0.001309
s
<
p95
0.00475
s
≤
p99
0.00475
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001806
s
SD
0.000605
s
p50
0.001514
s
<
p95
0.002645
s
<
p99
0.00286
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000515
s
SD
0.000362
s
p50
0.00037
s
<
p95
0.001373
s
<
p99
0.002177
s
Host function call duration: '__hc__get_validation_receipts_1'
Duration of this host function call invoked from within WASM.
mean
0.006463
s
SD
0.00477
s
p50
0.004631
s
<
p95
0.016019
s
<
p99
0.020357
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.003037
s
SD
0.001009
s
p50
0.002742
s
<
p95
0.004567
s
<
p99
0.004927
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000553
s
SD
0.000334
s
p50
0.000395
s
<
p95
0.001141
s
<
p99
0.001412
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.02
s
<
mean
450.49
s
SD
259.39
s
<
p95
856.22
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
2.034177
s
SD
1.793382
s
p50
1.251621
s
<
p95
4.875129
s
<
p99
9.480369
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.949283
s
SD
0.414841
s
p50
1.926842
s
<
p95
2.064948
s
<
p99
2.068759
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.033731
s
SD
0.828422
s
p50
0.007501
s
<
p95
0.329438
s
<
p99
5.65331
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002143
s
SD
0.001597
s
p50
0.001732
s
<
p95
0.00712
s
≤
p99
0.00712
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.009835
s
SD
0.020699
s
p50
0.001664
s
<
p95
0.029729
s
<
p99
0.107797
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.007628
s
SD
0.009956
s
p50
0.003304
s
<
p95
0.024557
s
<
p99
0.06344
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.146893
s
SD
0.166647
s
p50
0.079565
s
<
p95
0.352572
s
<
p99
0.925722
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
1.021113
s
SD
13.109667
s
p50
0.738223
s
<
p95
27.116639
s
<
p99
57.391973
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000316
s
SD
0.000141
s
p50
0.000257
s
<
p95
0.000567
s
<
p99
0.000623
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000487
s
SD
0.000231
s
p50
0.000404
s
<
p95
0.000692
s
<
p99
0.000813
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000252
s
SD
0.000147
s
p50
0.000205
s
<
p95
0.000521
s
<
p99
0.000712
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.00028
s
SD
0.000303
s
p50
0.000182
s
<
p95
0.000735
s
<
p99
0.0016
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000152
s
SD
0.000106
s
p50
0.000103
s
<
p95
0.000382
s
<
p99
0.000443
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000233
s
SD
0.000133
s
p50
0.000203
s
<
p95
0.00048
s
<
p99
0.000558
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003023
s
SD
0.019652
s
p50
0.000438
s
<
p95
0.042525
s
<
p99
0.085917
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000353
s
SD
0.000134
s
p50
0.000394
s
<
p95
0.000589
s
<
p99
0.000684
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.152255
s
SD
0.090482
s
p50
0.070732
s
<
p95
0.367704
s
≤
p99
0.367704
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.303789
s
SD
10.173007
s
p50
0.295574
s
<
p95
41.488927
s
≤
p99
41.488927
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
34.51
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
51
B/s
<
mean
360.95
KiB/s
SD
407.66
KiB/s
<
p95
1.03
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
0
B/s
<
mean
392.30
KiB/s
SD
530.89
KiB/s
<
p95
1.49
MiB/s
Total bytes received
Total bytes received on primary network interface
count
6.51
GiB
mean
3.94
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
7.07
GiB
mean
4.28
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 96.3%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 852.98 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 45% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.09
%
<
mean
41.91
%
SD
29.8
%
<
p95
93.98
%
System
7.40
%
CPU percentiles
CPU usage percentiles
p50
46.34
%
p95
93.98
%
p99
96.35
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
10
hosts
mean time
0.25
s
Memory used percentage
Percentage of memory used
p5
6.65
%
<
mean
14.24
%
SD
4.35
%
<
p95
19.73
%
Memory available percentage
Percentage of available memory
p5
80.27
%
<
mean
85.76
%
SD
4.35
%
<
p95
93.35
%
Max host memory used
Maximum memory usage percentage across all hosts
max
19.97
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.05
%
Memory growth rate
Rate of memory growth over time
growth
852.98
MiB/s
Disk read throughput
Disk read throughput in MiB/s
1.61
MiB/s
Disk write throughput
Disk write throughput in MiB/s
191.48
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/12
hosts
Mount Point /efi-boot
0/10
hosts
Mount Point /etc/hostname
0/5
hosts
Mount Point /etc/hosts
0/5
hosts
Mount Point /etc/resolv.conf
0/5
hosts
Mount Point /nix/store
0/12
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.73
5 min
3.01
15 min
1.76
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
45.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
13.207
%
SD
18.5857
%
<
p95
56.49
%
60 second average
12.9950
%
300 second average
10.4582
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0027
%
300 second average
0.0078
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0018
%
300 second average
0.0060
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
15.3668
%
SD
19.1756
%
<
p95
51.75
%
60 second average
15.3192
%
300 second average
12.5530
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
10.1166
%
SD
13.8195
%
<
p95
38.44
%
60 second average
10.1294
%
300 second average
8.3729
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.1
%
<
mean
3.74
%
SD
10.61
%
<
p95
32.23
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
217.06
KiB
<
mean
243.02
KiB
SD
55.72
KiB
<
p95
281.12
KiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
<
mean
23.18
threads
SD
8.23
threads
<
p95
38
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
48
file descriptors
<
mean
72.66
file descriptors
SD
19.07
file descriptors
<
p95
102
file descriptors

Write/get_agent_activity

↑ Back to index

A scenario where write peers write entries, while get_agent_activity peers each query a single write agent's activity with get_agent_activity.

Before a target write peer and the requesting get_agent_activity peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started
Wed, 03 Jun 2026 13:50:48 UTC
Peer count
30
Peer count at end
29
Behaviours
  • get_agent_activity (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
write_get_agent_activity_26886318076_1
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
2856.4
Max
Highest chain head value observed for any single write agent.
5766
Write agents observed
5
get_agent_activity_full zome call timing
The time taken to call the zome function that retrieves information on a write peer's source chain.
Mean
mean
0.248872
s
SD
0.281487
s
Max
Highest per-partition mean latency
max mean
0.763411
s
Min
Lowest per-partition mean latency
min mean
0.102091
s
Error count
The number of errors accumulated.
4
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000941
s
SD
0.001653
s
p50
0.000767
s
<
p95
0.004248
s
<
p99
0.007636
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
1
over 1176.401474573s
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 1912.487566963s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
115657827
over 1912.487566963s
mean rate
5.271507934e+08
/s
std
8.6852337847e+08
/s
p5
67710.11
/s
p95
2.54845370742e+09
/s
peak
2.86689979208e+09
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
4550877154
over 995.408808963s
mean rate
1.50847283998e+10
/s
std
2.52570732347e+10
/s
p5
1.32877627e+08
/s
p95
7.69806583596e+10
/s
peak
1.23281557743e+11
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
9475735213
over 33074.526189037s
mean rate
2.84258382976e+09
/s
std
5.65088969026e+09
/s
p5
5.39200465e+06
/s
p95
2.05221120391e+10
/s
peak
2.251508238e+10
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
630198117
over 33074.526189037s
mean rate
1.9406000344e+08
/s
std
5.6455077978e+08
/s
p5
10628.23
/s
p95
1.3492042721e+09
/s
peak
1.64263056019e+10
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.006554
s
SD
0.00286
s
p50
0.004591
s
<
p95
0.011299
s
≤
p99
0.011299
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.009695
s
SD
0.006782
s
p50
0.008375
s
<
p95
0.02789
s
<
p99
0.028677
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.140239
s
SD
0.158777
s
p50
0.128017
s
<
p95
0.539073
s
<
p99
0.669793
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.004901
s
SD
0.187722
s
p50
0.004657
s
<
p95
0.506726
s
<
p99
0.743944
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005491
s
SD
0.002473
s
p50
0.003777
s
<
p95
0.009763
s
≤
p99
0.009763
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.008216
s
SD
0.006033
s
p50
0.006874
s
<
p95
0.024419
s
<
p99
0.02511
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.139649
s
SD
0.158831
s
p50
0.127262
s
<
p95
0.53769
s
<
p99
0.668998
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004188
s
SD
0.187684
s
p50
0.003909
s
<
p95
0.505515
s
<
p99
0.74339
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001109
s
SD
0.00067
s
p50
0.001142
s
<
p95
0.002171
s
<
p99
0.004066
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
4.1e-05
s
SD
3e-05
s
p50
3.4e-05
s
<
p95
0.000117
s
≤
p99
0.000117
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.001715
s
SD
0.002214
s
p50
0.000811
s
<
p95
0.007656
s
<
p99
0.007912
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000553
s
SD
0.000251
s
p50
0.000506
s
<
p95
0.000968
s
≤
p99
0.000968
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.134677
s
SD
0.157693
s
p50
0.122204
s
<
p95
0.528891
s
<
p99
0.665159
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.001189
s
SD
0.187532
s
p50
0.000903
s
<
p95
0.499991
s
<
p99
0.741279
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
9e-06
s
SD
5e-06
s
p50
9e-06
s
<
p95
2.1e-05
s
<
p99
2.4e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001827
s
SD
0.0019
s
p50
0.001896
s
<
p95
0.004933
s
<
p99
0.012442
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000856
s
SD
0.000549
s
p50
0.000329
s
<
p95
0.001408
s
<
p99
0.003059
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.18
s
<
mean
451.64
s
SD
259.61
s
<
p95
856.94
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
42.743149
s
SD
25.444319
s
p50
27.998306
s
<
p95
75.518617
s
<
p99
101.059609
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.925775
s
SD
0.36439
s
p50
2.002131
s
<
p95
2.020595
s
<
p99
2.032237
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.51017
s
SD
9.943676
s
p50
1.252025
s
<
p95
27.120488
s
<
p99
38.779325
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001477
s
SD
0.00127
s
p50
0.001038
s
<
p95
0.004245
s
<
p99
0.006449
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.042397
s
SD
0.048886
s
p50
0.018336
s
<
p95
0.105619
s
<
p99
0.315181
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.057462
s
SD
0.025962
s
p50
0.002298
s
<
p95
0.071278
s
<
p99
0.118271
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.545618
s
SD
13.863782
s
p50
0.622902
s
<
p95
42.148457
s
<
p99
53.330334
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
1.227094
s
SD
19.24851
s
p50
1.40806
s
<
p95
43.63361
s
<
p99
96.870864
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000507
s
SD
0.002201
s
p50
0.000274
s
<
p95
0.004481
s
<
p99
0.013992
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.003921
s
SD
0.003018
s
p50
0.002379
s
<
p95
0.009157
s
<
p99
0.013625
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000142
s
SD
0.000299
s
p50
0.000176
s
<
p95
0.000478
s
<
p99
0.001782
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000617
s
SD
0.000734
s
p50
0.000258
s
<
p95
0.00264
s
<
p99
0.003588
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000175
s
SD
0.000424
s
p50
8.9e-05
s
<
p95
0.0002
s
<
p99
0.002413
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000245
s
SD
0.000195
s
p50
0.000169
s
<
p95
0.000574
s
<
p99
0.001067
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.004015
s
SD
0.009782
s
p50
0.000935
s
<
p95
0.026163
s
<
p99
0.033789
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000717
s
SD
0.000803
s
p50
0.000367
s
<
p95
0.00069
s
<
p99
0.005155
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
1.745396
s
SD
29.636129
s
p50
0.390052
s
<
p95
60.001854
s
<
p99
60.006184
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.366335
s
SD
0.296264
s
p50
0.107662
s
<
p95
0.739645
s
≤
p99
0.739645
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.135062
s
SD
9.575537
s
p50
0.12367
s
<
p95
0.552095
s
<
p99
60.001258
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
1.218323
s
SD
13.777416
s
p50
1.166306
s
<
p95
60.001059
s
<
p99
60.00207
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
30.46
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
864
B/s
<
mean
761.12
KiB/s
SD
831.06
KiB/s
<
p95
2.29
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
34
B/s
<
mean
858.35
KiB/s
SD
662.87
KiB/s
<
p95
2.05
MiB/s
Total bytes received
Total bytes received on primary network interface
count
19.03
GiB
mean
19.89
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
21.46
GiB
mean
22.43
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 97.7%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 176.11 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 41% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
9.88
%
<
mean
38.05
%
SD
22.15
%
<
p95
83.6
%
System
7.59
%
CPU percentiles
CPU usage percentiles
p50
34.43
%
p95
83.60
%
p99
97.71
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
11
hosts
mean time
0.15
s
Memory used percentage
Percentage of memory used
p5
6.65
%
<
mean
12.69
%
SD
5.13
%
<
p95
21.65
%
Memory available percentage
Percentage of available memory
p5
78.35
%
<
mean
87.31
%
SD
5.13
%
<
p95
93.35
%
Max host memory used
Maximum memory usage percentage across all hosts
max
32.65
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.05
%
Memory growth rate
Rate of memory growth over time
growth
176.11
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.06
MiB/s
Disk write throughput
Disk write throughput in MiB/s
205.29
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/17
hosts
Mount Point /efi-boot
0/15
hosts
Mount Point /etc/hostname
0/6
hosts
Mount Point /etc/hosts
0/6
hosts
Mount Point /etc/resolv.conf
0/6
hosts
Mount Point /nix/store
0/17
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.03
5 min
3.31
15 min
3.31
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
41.38
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
9.1001
%
SD
17.7952
%
<
p95
37.15
%
60 second average
9.4424
%
300 second average
10.9222
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0004
%
SD
0.0124
%
≤
p95
0
%
60 second average
0.0004
%
300 second average
0.0001
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0002
%
SD
0.0062
%
≤
p95
0
%
60 second average
0.0002
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
16.4831
%
SD
16.7219
%
<
p95
45.14
%
60 second average
16.4752
%
300 second average
16.2479
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
12.5703
%
SD
14.1843
%
<
p95
39.09
%
60 second average
12.4452
%
300 second average
11.5451
%
Holochain process CPU usage
CPU usage by Holochain process
p5
8.13
%
<
mean
33.85
%
SD
21.64
%
<
p95
79.53
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
213.76
KiB
<
mean
339.58
KiB
SD
80.67
KiB
<
p95
451.94
KiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
<
mean
35.71
threads
SD
12.87
threads
<
p95
53
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
53
file descriptors
<
mean
80.69
file descriptors
SD
20.03
file descriptors
<
p95
118
file descriptors

Write/get_agent_activity with volatile conductors

↑ Back to index

A scenario where write peers write entries, while get_agent_activity_volatile peers each query a single write agents activity with get_agent_activity but shutdown and restart their conductors at semi-random intervals.

Before a target write peer and the requesting get_agent_activity_volatile peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started
Wed, 03 Jun 2026 14:06:04 UTC
Peer count
30
Peer count at end
21
Behaviours
  • get_agent_activity_volatile (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
write_get_agent_activity_volatile_26886318076_1
Highest observed action_seq
The rate at which zero-arc readers observe new chain heads on the writers' chains via get_agent_activity. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.
Mean
mean
83.27
/s
Max
Highest per-partition mean rate
max
876.88
/s
Min
Lowest per-partition mean rate
min
13.02
/s
get_agent_activity_full zome call timing
The time taken to call the zome function that retrieves information on a write peer's source chain.
Mean
mean
0.238406
s
SD
0.173913
s
Max
Highest per-partition mean latency
max mean
0.523894
s
Min
Lowest per-partition mean latency
min mean
0.00757
s
Running volatile conductors count
The number of conductors running by get_agent_activity_volatile peers.
p5
6
conductors
<
mean
10.84
conductors
SD
3.38
conductors
<
p95
16
conductors
Volatile conductor total running duration
The total running duration of a get_agent_activity_volatile conductor.
Mean
mean
866.360928
s
SD
455.858183
s
Max
Highest per-partition mean latency
max mean
1741.375
s
Min
Lowest per-partition mean latency
min mean
270.076923
s
Volatile conductor running duration
The duration that a get_agent_activity_volatile conductor was running before being stopped.
Mean
mean
50.499786
s
SD
48.346524
s
Max
Highest per-partition mean latency
max mean
139.789247
s
Min
Lowest per-partition mean latency
min mean
27.18925
s
Volatile conductor stopped duration
The duration that a get_agent_activity_volatile conductor was stopped before being started again.
Mean
mean
36.344178
s
SD
48.871005
s
Max
Highest per-partition mean latency
max mean
75.041594
s
Min
Lowest per-partition mean latency
min mean
7.842605
s
Reached target arc
Did get_agent_activity_volatile peer reach their target arc in the moment before they were shutdown.
  • get_agent_activity_volatile_agent: uhCAk2XCzN8Q6Cpj7dDtcFB03z0coy8wHcHXrRUtRcrP-U-LesyDT
p5
0
<
mean
0.21
SD
0.41
<
p95
1
  • get_agent_activity_volatile_agent: uhCAk7fdrwqrpV257gq3ewyRSCds_9-wRWY_4Dek-eOIwYDaKD56h
p5
0
<
mean
0.13
SD
0.34
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkBWDsUiKf9KFdBiKrHerMsKpTZ1oRcwY3MPZCfDsl373dBXwC
p5
0
<
mean
0.85
SD
0.36
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkDVn7vQXD-g-0C5LP6baccuEWoyEFEhOfSNjRuNKowsqwseqz
p5
0
<
mean
0.36
SD
0.48
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkFFGLaUWLhBfXrYwqa8sfgni_u2mLk_bOwuBU2JbLB6Vv6DK1
p5
0
<
mean
0.16
SD
0.37
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkHJ-m-dQ78bp20bHcwf0r33VpzbfVvp4pSjW21mUUYBdZy0Cy
p5
0
<
mean
0.29
SD
0.45
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkIQ9jhYDl_z0KsGpsuFLPD_pVsmVb87UfBoGYi3J5Rn3PEV9x
p5
0
<
mean
0.28
SD
0.45
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkQISJIVuXct7gmxjg-dnbIvL93kfUDhUQ1zCmW5LvraPL-XvR
p5
0
<
mean
0.38
SD
0.48
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkSH57hC41AWFigRK0iEOVKQ4gMUiz2CvAAd_rnOVZRYuSiON0
p5
0
<
mean
0.23
SD
0.42
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkVvgSVJVxcAf9gRz-J1LbguAc9x3TPihNppVs53LJSbY_klHV
p5
0
<
mean
0.12
SD
0.33
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkac9apR3gJqfMAHATUHltvFmxY68N8bhsP7WG1j1sVtpblnkJ
p5
0
<
mean
0.15
SD
0.36
<
p95
1
  • get_agent_activity_volatile_agent: uhCAki0_K4RImMZRki7bdLYo4Ah5O1H40imXVyNC8TlaeRC9cVRMi
p5
0
<
mean
0.67
SD
0.47
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkiKLFPMu9ClKBYTQEBB9Jf9wFalTUtIh_HcHL8dvKqwS-osGp
p5
0
<
mean
0.41
SD
0.49
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkir7VaawWR1Zdf9ZRSomEgDdiwF1oSubOWOUAXtYgzjC5Q4i0
p5
0
<
mean
0.17
SD
0.38
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkmssAGR54i_3TLlzKXdTItlXAvDqpYl6SVTPp3cXN7mLJez5U
p5
0
<
mean
0.24
SD
0.43
<
p95
1
  • get_agent_activity_volatile_agent: uhCAktAFF7JiUA0BBtwsElKJLZUt1ycQaApEtE2HVxfmgoXRDLI8e
p5
0
<
mean
0.13
SD
0.34
<
p95
1
  • get_agent_activity_volatile_agent: uhCAktnAqPuQZ-wqECUb-Nl_hmLqn6z92GcCbk3Gv9DYsfzAYKss7
p5
0
<
mean
0.63
SD
0.48
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkwSHc0DXe3w0DIw76jN-5N9TridcIDx-UZrM6rTtP_OribY_d
p5
0
<
mean
0.24
SD
0.42
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkxh3m3lnbk2wS-IrDvNtgmmFPuDu_Px9uIL2I_IZ5jKqhbOZn
p5
0
≤
mean
0
SD
0
≤
p95
0
Error count
The number of errors accumulated.
74
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000594
s
SD
0.00229
s
p50
0.001012
s
<
p95
0.008418
s
<
p99
0.010148
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
3
over 1848.759236508s
mean rate
2.61
/s
std
5.5
/s
p5
0
/s
p95
11.4
/s
peak
30.81
/s
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 2069.106637885s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
531695916
over 2069.106637885s
mean rate
3.8971892613e+08
/s
std
4.430339324e+08
/s
p5
1.41952815e+06
/s
p95
1.47273107296e+09
/s
peak
1.73642843945e+09
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
57559016
over 2803.930822052s
mean rate
4.236382793e+08
/s
std
3.36637497672e+09
/s
p5
270525.01
/s
p95
1.01313914669e+09
/s
peak
8.40879116476e+10
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
5280632
over 1746.584926537s
mean rate
8.961838578e+07
/s
std
2.0089880817e+08
/s
p5
2320.59
/s
p95
4.5461577486e+08
/s
peak
1.12713960027e+09
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
58284673
over 2069.106805288s
mean rate
1.36748104646e+09
/s
std
3.63614196461e+10
/s
p5
29112.07
/s
p95
1.6510087195e+08
/s
peak
1.04158497317e+12
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.004773
s
SD
0.001841
s
p50
0.003544
s
<
p95
0.007954
s
≤
p99
0.007954
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005247
s
SD
0.001065
s
p50
0.005476
s
<
p95
0.00761
s
<
p99
0.008346
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.059946
s
SD
0.251196
s
p50
0.266205
s
<
p95
0.714475
s
<
p99
1.202177
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.006162
s
SD
0.398653
s
p50
0.013169
s
<
p95
1.379058
s
<
p99
1.780742
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003989
s
SD
0.001545
s
p50
0.002903
s
<
p95
0.006751
s
≤
p99
0.006751
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004313
s
SD
0.000937
s
p50
0.00451
s
<
p95
0.006422
s
<
p99
0.007082
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.077002
s
SD
27.49534
s
p50
0.269814
s
<
p95
0.795541
s
<
p99
2.774739
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005189
s
SD
0.389186
s
p50
0.011032
s
<
p95
1.331541
s
<
p99
1.746888
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001326
s
SD
0.000345
s
p50
0.001408
s
<
p95
0.001872
s
<
p99
0.003234
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.1e-05
s
SD
1.3e-05
s
p50
2.6e-05
s
<
p95
5.2e-05
s
≤
p99
5.2e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000424
s
SD
0.000134
s
p50
0.000413
s
<
p95
0.000806
s
<
p99
0.000881
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000478
s
SD
0.000404
s
p50
0.000287
s
<
p95
0.001575
s
≤
p99
0.001575
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.074945
s
SD
27.495553
s
p50
0.261356
s
<
p95
0.793292
s
<
p99
2.766111
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.001168
s
SD
0.389834
s
p50
0.002006
s
<
p95
1.328355
s
<
p99
1.744495
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1.2e-05
s
SD
9e-06
s
p50
2e-05
s
<
p95
2.9e-05
s
≤
p99
2.9e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002393
s
SD
0.000812
s
p50
0.002313
s
<
p95
0.003836
s
<
p99
0.004349
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000363
s
SD
0.000178
s
p50
0.000407
s
<
p95
0.000702
s
<
p99
0.000767
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
4.78
s
<
mean
426.44
s
SD
548.66
s
<
p95
1608.23
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
36
over 2812.104394645s
mean rate
202420.3
/s
std
1.81917115e+06
/s
p5
0
/s
p95
512134.38
/s
peak
6.229722046e+07
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
36.282159
s
SD
67.260125
s
p50
24.91942
s
<
p95
200.915604
s
<
p99
325.892331
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.660325
s
SD
1.027108
s
p50
1.774126
s
<
p95
4
s
<
p99
6.333333
s
App validation workflow duration
Time spent running the app validation workflow.
mean
1.462573
s
SD
9.223457
s
p50
0.302394
s
<
p95
27.516206
s
<
p99
34.3234
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001293
s
SD
0.001024
s
p50
0.00109
s
<
p95
0.002794
s
<
p99
0.005634
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.030003
s
SD
0.023423
s
p50
0.003046
s
<
p95
0.066585
s
<
p99
0.086608
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.055699
s
SD
0.399918
s
p50
0.013625
s
<
p95
0.912246
s
<
p99
2.13017
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
3.57836
s
SD
30.656736
s
p50
1.993737
s
<
p95
52.872626
s
<
p99
130.111202
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.194367
s
SD
53.142413
s
p50
2.080487
s
<
p95
156.6364
s
<
p99
254.826662
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.004181
s
SD
0.00185
s
p50
0.000343
s
<
p95
0.005685
s
<
p99
0.008203
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.004899
s
SD
0.003479
s
p50
0.001594
s
<
p95
0.010095
s
<
p99
0.013577
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.00028
s
SD
0.000117
s
p50
0.000172
s
<
p95
0.000374
s
<
p99
0.000778
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.00015
s
SD
0.000159
s
p50
0.000126
s
<
p95
0.000528
s
<
p99
0.000853
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.011037
s
SD
0.01012
s
p50
0.015251
s
<
p95
0.025035
s
<
p99
0.036483
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000181
s
SD
7.9e-05
s
p50
0.000165
s
<
p95
0.00033
s
<
p99
0.000395
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00467
s
SD
0.133732
s
p50
0.001841
s
<
p95
0.105356
s
<
p99
0.490597
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00035
s
SD
0.000261
s
p50
0.000421
s
<
p95
0.000795
s
<
p99
0.001749
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
4.837094
s
SD
28.610371
s
p50
0.238002
s
<
p95
60.001784
s
<
p99
60.005124
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.328099
s
SD
0.320858
s
p50
0.187825
s
<
p95
1.163651
s
≤
p99
1.163651
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.316612
s
SD
16.453144
s
p50
0.279671
s
<
p95
60.001418
s
<
p99
60.001545
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.439727
s
SD
27.892317
s
p50
0.333896
s
<
p95
60.00148
s
<
p99
60.001712
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
23.18
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.08
KiB/s
<
mean
241.71
KiB/s
SD
643.24
KiB/s
<
p95
787.78
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
172
B/s
<
mean
206.48
KiB/s
SD
315.01
KiB/s
<
p95
851.96
KiB/s
Total bytes received
Total bytes received on primary network interface
count
10.53
GiB
mean
5.80
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
8.99
GiB
mean
4.95
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.7%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1161.00 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/5 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (34.5% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 18% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.1
%
<
mean
28.7
%
SD
28.31
%
<
p95
89.63
%
System
5.53
%
CPU percentiles
CPU usage percentiles
p50
17.49
%
p95
89.63
%
p99
98.70
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
12
hosts
mean time
0.19
s
Memory used percentage
Percentage of memory used
p5
6.15
%
<
mean
14.02
%
SD
5.33
%
<
p95
22.82
%
Memory available percentage
Percentage of available memory
p5
77.18
%
<
mean
85.98
%
SD
5.33
%
<
p95
93.85
%
Max host memory used
Maximum memory usage percentage across all hosts
max
24.95
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
34.49
%
Memory growth rate
Rate of memory growth over time
growth
1161.00
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.02
MiB/s
Disk write throughput
Disk write throughput in MiB/s
139.41
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/17
hosts
Mount Point /boot
0/1
hosts
Mount Point /efi-boot
0/15
hosts
Mount Point /etc/hostname
1/5
hosts
Mount Point /etc/hosts
1/5
hosts
Mount Point /etc/resolv.conf
1/5
hosts
Mount Point /nix/store
0/17
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.27
5 min
2.22
15 min
2.25
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
17.86
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
6.2102
%
SD
15.0753
%
<
p95
26.15
%
60 second average
6.2611
%
300 second average
6.3963
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
13.8879
%
SD
16.9203
%
<
p95
45.58
%
60 second average
13.9463
%
300 second average
13.5541
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
10.5193
%
SD
13.879
%
<
p95
38.59
%
60 second average
10.5470
%
300 second average
10.2567
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.05
%
<
mean
16.08
%
SD
21.95
%
<
p95
72.47
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
49.73
KiB
<
mean
232.31
KiB
SD
164.29
KiB
<
p95
539.78
KiB
Holochain process threads
Number of threads in Holochain process
p5
7
threads
<
mean
23.63
threads
SD
14.06
threads
<
p95
54
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
8
file descriptors
<
mean
67.44
file descriptors
SD
24.43
file descriptors
<
p95
94
file descriptors

Write/Query

↑ Back to index

Creates an entry, then queries the source chain and performs a simple operation on the entries, then repeats.

Started
Wed, 03 Jun 2026 13:09:19 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
write_query_26886318076_1
Write timing
The time it takes to complete the zome function call that writes the entry.
mean
0.009946
s
SD
0.003822
s
p50
0.009075
s
<
p95
0.017063
s
<
p99
0.018594
s
Write rate
The number of writes completed per second.
mean
151.9
/s
Query timing
The time it takes to complete the chain_query_count_len zome call that queries the source chain.
mean
0.050864
s
SD
0.031377
s
p50
0.04634
s
<
p95
0.104294
s
<
p99
0.115418
s
Query rate
The number of chain queries completed per second.
mean
151.9
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::chain_query_count_len'
Metered usage count of the WASM ribosome for this zome function.
total
398766270933
over 280.002310148s
mean rate
1.42415344338e+09
/s
std
9.844620479e+07
/s
p5
1.25014755955e+09
/s
p95
1.54439917015e+09
/s
peak
1.55597580527e+09
/s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
182532744
over 280.002310148s
mean rate
651897.49
/s
std
340929.68
/s
p5
378146.27
/s
p95
1.38513366e+06
/s
peak
1.82276567e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.002310148s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
39935616
over 280.002310148s
mean rate
142626.07
/s
std
74587.66
/s
p5
82733.12
/s
p95
303047.91
/s
peak
398795.68
/s
Zome call duration: 'crud::chain_query_count_len'
Duration of this zome call as measured by Holochain internally.
mean
0.031027
s
SD
0.01034
s
p50
0.028514
s
<
p95
0.041199
s
<
p99
0.04203
s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.002288
s
SD
8.3e-05
s
p50
0.002281
s
<
p95
0.002337
s
<
p99
0.00234
s
WASM call duration: 'crud::chain_query_count_len'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.030469
s
SD
0.010283
s
p50
0.027963
s
<
p95
0.040596
s
<
p99
0.041423
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001823
s
SD
5.8e-05
s
p50
0.001818
s
<
p95
0.001859
s
<
p99
0.001861
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000988
s
SD
0
s
p50
0.000988
s
≤
p95
0.000988
s
≤
p99
0.000988
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000554
s
SD
1.3e-05
s
p50
0.000554
s
<
p95
0.000562
s
≤
p99
0.000562
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000181
s
SD
5.1e-05
s
p50
0.00028
s
≤
p95
0.00028
s
≤
p99
0.00028
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.010259
s
SD
0.003557
s
p50
0.009383
s
<
p95
0.013837
s
<
p99
0.014137
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001007
s
SD
5.2e-05
s
p50
0.001006
s
<
p95
0.001038
s
<
p99
0.001042
s
Post-commit duration
Time spent executing post-commit workflows.
mean
8.1e-05
s
SD
4e-06
s
p50
8.1e-05
s
<
p95
8.4e-05
s
≤
p99
8.4e-05
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.81
s
<
mean
148.81
s
SD
83.67
s
<
p95
278.81
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
12888
over 280.002303406s
mean rate
46.03
/s
std
24.07
/s
p5
26.7
/s
p95
97.8
/s
peak
128.7
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.001067
s
SD
1.2e-05
s
p50
0.001066
s
<
p95
0.00108
s
<
p99
0.001089
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000229
s
SD
0
s
p50
0.000229
s
≤
p95
0.000229
s
≤
p99
0.000229
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000413
s
SD
0
s
p50
0.000413
s
≤
p95
0.000413
s
≤
p99
0.000413
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000402
s
SD
2.8e-05
s
p50
0.000399
s
<
p95
0.000423
s
<
p99
0.000424
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.016384
s
SD
0.005806
s
p50
0.014817
s
<
p95
0.022409
s
<
p99
0.022949
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000717
s
SD
0
s
p50
0.000717
s
≤
p95
0.000717
s
≤
p99
0.000717
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.004304
s
SD
0.001373
s
p50
0.004055
s
<
p95
0.005557
s
<
p99
0.005664
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.002438
s
SD
0.000795
s
p50
0.002231
s
<
p95
0.003244
s
<
p99
0.003312
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001772
s
SD
0.000653
s
p50
0.001694
s
<
p95
0.002428
s
<
p99
0.002481
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
9.7e-05
s
SD
1.1e-05
s
p50
9.4e-05
s
<
p95
0.000106
s
<
p99
0.000107
s
Cache DB connection use time
Time spent holding cache database connections.
mean
7.6e-05
s
SD
9e-06
s
p50
7.4e-05
s
<
p95
8.4e-05
s
<
p99
8.5e-05
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
4.6e-05
s
SD
0
s
p50
4.6e-05
s
≤
p95
4.6e-05
s
≤
p99
4.6e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
7.2e-05
s
SD
1.1e-05
s
p50
7.2e-05
s
<
p95
8e-05
s
≤
p99
8e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000716
s
SD
0.006035
s
p50
0.000395
s
<
p95
0.015487
s
≤
p99
0.015487
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000158
s
SD
5e-06
s
p50
0.000157
s
<
p95
0.000162
s
≤
p99
0.000162
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
15.76
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.01
KiB/s
<
mean
84.30
KiB/s
SD
432.77
KiB/s
≤
p95
5.32
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
17
B/s
<
mean
1.47
KiB/s
SD
5.43
KiB/s
≤
p95
1.40
KiB/s
Total bytes received
Total bytes received on primary network interface
count
23.87
MiB
mean
84.30
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
427.51
KiB
mean
1.47
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 88.99 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
17.34
%
<
mean
18.99
%
SD
2.33
%
<
p95
19.55
%
System
3.23
%
CPU percentiles
CPU usage percentiles
p50
18.78
%
p95
19.55
%
p99
30.88
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
14.1
%
<
mean
14.38
%
SD
0.85
%
<
p95
15.02
%
Memory available percentage
Percentage of available memory
p5
84.98
%
<
mean
85.62
%
SD
0.85
%
<
p95
85.9
%
Max host memory used
Maximum memory usage percentage across all hosts
max
14.38
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
88.99
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
1.97
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.12
5 min
0.51
15 min
0.20
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0043
%
SD
0.0169
%
<
p95
0.03
%
60 second average
0.0023
%
300 second average
0.0000
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
17.06
%
<
mean
18.33
%
SD
0.66
%
<
p95
19.24
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
267.59
KiB
<
mean
286.43
KiB
SD
8.90
KiB
<
p95
297.85
KiB
Holochain process threads
Number of threads in Holochain process
p5
16
threads
<
mean
16.9
threads
SD
0.3
threads
<
p95
17
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
60
file descriptors
<
mean
62.07
file descriptors
SD
4.05
file descriptors
<
p95
70
file descriptors

Write/Read

↑ Back to index

Creates an entry and reads it back, then repeats.

Started
Wed, 03 Jun 2026 13:11:07 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
write_read_26886318076_1
Write timing
The time taken to write the entry.
mean
0.02618
s
SD
0.020505
s
p50
0.023795
s
<
p95
0.047058
s
<
p99
0.07801
s
Write rate
The number of writes completed per second.
mean
162.93
/s
Read timing
The time taken to read the entry.
mean
0.033617
s
SD
0.023184
s
p50
0.027523
s
<
p95
0.072499
s
<
p99
0.101697
s
Read rate
The number of reads completed per second.
mean
162.93
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.011626
s
SD
0.00483
s
p50
0.010308
s
<
p95
0.01661
s
<
p99
0.017013
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
201440349
over 289.972473697s
mean rate
694695.89
/s
std
384141.05
/s
p5
310113.78
/s
p95
1.49559409e+06
/s
peak
1.82277116e+06
/s
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
228867692
over 289.972473697s
mean rate
789283.38
/s
std
435987.5
/s
p5
352475.34
/s
p95
1.6950631e+06
/s
peak
2.06764903e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 289.972473697s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
22036168
over 289.972473697s
mean rate
75994.88
/s
std
42024.12
/s
p5
33924.28
/s
p95
163607.55
/s
peak
199398.44
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004942
s
SD
6.9e-05
s
p50
0.004898
s
<
p95
0.005047
s
<
p99
0.00505
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.014239
s
SD
0.004877
s
p50
0.012913
s
<
p95
0.019264
s
<
p99
0.019664
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004091
s
SD
5.3e-05
s
p50
0.004053
s
<
p95
0.004179
s
<
p99
0.004181
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.013272
s
SD
0.004852
s
p50
0.011946
s
<
p95
0.018285
s
<
p99
0.018687
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002098
s
SD
0
s
p50
0.002098
s
≤
p95
0.002098
s
≤
p99
0.002098
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001338
s
SD
1.5e-05
s
p50
0.001328
s
<
p95
0.001362
s
≤
p99
0.001362
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000355
s
SD
8.5e-05
s
p50
0.000523
s
≤
p95
0.000523
s
≤
p99
0.000523
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.011688
s
SD
0.004832
s
p50
0.01037
s
<
p95
0.016673
s
<
p99
0.017076
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002218
s
SD
3.4e-05
s
p50
0.002194
s
<
p95
0.002275
s
≤
p99
0.002275
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000337
s
SD
1.2e-05
s
p50
0.000332
s
<
p95
0.000359
s
≤
p99
0.000359
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.59
s
<
mean
152.59
s
SD
86.56
s
<
p95
287.6
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
14223
over 289.97246199799997s
mean rate
49.05
/s
std
27.12
/s
p5
21.9
/s
p95
105.6
/s
peak
128.7
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.00431
s
SD
0.00276
s
p50
0.002473
s
<
p95
0.010031
s
<
p99
0.010145
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000716
s
SD
0
s
p50
0.000716
s
≤
p95
0.000716
s
≤
p99
0.000716
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001443
s
SD
0
s
p50
0.001443
s
≤
p95
0.001443
s
≤
p99
0.001443
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001517
s
SD
0.000285
s
p50
0.001379
s
<
p95
0.001932
s
≤
p99
0.001932
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.03202
s
SD
0.012662
s
p50
0.028313
s
<
p95
0.045511
s
<
p99
0.046714
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.00092
s
SD
0
s
p50
0.00092
s
≤
p95
0.00092
s
≤
p99
0.00092
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.006649
s
SD
0.002236
s
p50
0.006221
s
<
p95
0.008636
s
<
p99
0.008776
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.003964
s
SD
0.001542
s
p50
0.00356
s
<
p95
0.005507
s
<
p99
0.005637
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.005101
s
SD
0.002106
s
p50
0.004768
s
<
p95
0.007045
s
<
p99
0.007216
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000197
s
SD
1.8e-05
s
p50
0.000194
s
<
p95
0.000214
s
≤
p99
0.000214
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.00584
s
SD
0.002418
s
p50
0.005181
s
<
p95
0.008334
s
<
p99
0.008536
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000156
s
SD
0
s
p50
0.000156
s
≤
p95
0.000156
s
≤
p99
0.000156
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.00017
s
SD
1e-05
s
p50
0.00017
s
<
p95
0.000174
s
≤
p99
0.000174
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001668
s
SD
0.012434
s
p50
0.000798
s
<
p95
0.032017
s
≤
p99
0.032017
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000313
s
SD
6e-06
s
p50
0.000309
s
<
p95
0.000325
s
<
p99
0.000326
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
39.68
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
14.92
KiB/s
<
mean
16.91
KiB/s
SD
1.25
KiB/s
<
p95
18.97
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
17.95
KiB/s
<
mean
19.44
KiB/s
SD
1.02
KiB/s
<
p95
21.22
KiB/s
Total bytes received
Total bytes received on primary network interface
count
4.95
MiB
mean
16.91
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
5.70
MiB
mean
19.44
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
41.84
%
<
mean
50.83
%
SD
4.45
%
<
p95
56.84
%
System
11.15
%
CPU percentiles
CPU usage percentiles
p50
50.95
%
p95
56.84
%
p99
61.68
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
16.42
%
<
mean
16.93
%
SD
0.36
%
<
p95
17.1
%
Memory available percentage
Percentage of available memory
p5
82.9
%
<
mean
83.07
%
SD
0.36
%
<
p95
83.58
%
Max host memory used
Maximum memory usage percentage across all hosts
max
16.93
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.05
%
Memory growth rate
Rate of memory growth over time
growth
-8.92
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
7.02
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
0/1
hosts
Mount Point /etc/hosts
0/1
hosts
Mount Point /etc/resolv.conf
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.31
5 min
1.26
15 min
0.55
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
5.69
%
<
mean
7.1819
%
SD
0.9278
%
<
p95
9.5
%
60 second average
6.2652
%
300 second average
3.5761
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.4
%
SD
0.7892
%
<
p95
2.69
%
60 second average
0.2990
%
300 second average
0.1129
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.2781
%
SD
0.6713
%
<
p95
2.29
%
60 second average
0.1945
%
300 second average
0.0552
%
Holochain process CPU usage
CPU usage by Holochain process
p5
34.06
%
<
mean
44.98
%
SD
9.05
%
<
p95
51.76
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
207.25
KiB
<
mean
217.14
KiB
SD
35.14
KiB
<
p95
228.96
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
14.87
threads
SD
1.34
threads
<
p95
15
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
53
file descriptors
<
mean
60.81
file descriptors
SD
6.51
file descriptors
<
p95
68
file descriptors

Write validated

↑ Back to index

Creates an entry, updates it and links the create to the update, then repeats. Each of the three actions is validated by the included hApp.

Started
Wed, 03 Jun 2026 13:12:52 UTC
Peer count
1
Peer count at end
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
write_validated_26886318076_1
Write timing
The time it takes to complete the zome function call that writes the entry, updates it, and links to the update.
mean
0.072859
s
SD
0.099227
s
p50
0.038793
s
<
p95
0.34739
s
<
p99
0.427197
s
Write rate
The number of write zome function calls that complete per second.
mean
56.07
/s
Read timing
The time it takes to complete the zome function call that reads the data.
mean
0.102135
s
SD
0.101802
s
p50
0.065401
s
<
p95
0.360408
s
<
p99
0.461016
s
Read rate
The number of read zome function calls that complete per second.
mean
56.04
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000569
s
SD
0.000158
s
p50
0.000646
s
<
p95
0.000817
s
<
p99
0.000821
s
WASM usage: 'validated::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
64080611
over 280.002655891s
mean rate
228857.26
/s
std
59108.99
/s
p5
168308.07
/s
p95
348930.41
/s
peak
381769.72
/s
WASM usage: 'validated::update_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
75093720
over 280.002655891s
mean rate
268189.44
/s
std
69386.43
/s
p5
192546.82
/s
p95
413974.54
/s
peak
442855.08
/s
WASM usage: 'validated_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
105218640
over 290.002746269s
mean rate
362819.63
/s
std
92754.24
/s
p5
263229.39
/s
p95
553195.1
/s
peak
595604.85
/s
WASM usage: 'validated_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
1265524330
over 280.002655891s
mean rate
4.51968904e+06
/s
std
1.16630057e+06
/s
p5
3.31093186e+06
/s
p95
6.95622923e+06
/s
peak
7.48110159e+06
/s
Zome call duration: 'validated::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.003866
s
SD
7e-05
s
p50
0.00387
s
<
p95
0.003901
s
<
p99
0.003905
s
Zome call duration: 'validated::update_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005052
s
SD
0.000139
s
p50
0.00507
s
<
p95
0.005091
s
<
p99
0.005092
s
WASM call duration: 'validated::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003165
s
SD
6.2e-05
s
p50
0.003164
s
<
p95
0.003192
s
<
p99
0.003195
s
WASM call duration: 'validated::update_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00435
s
SD
0.000124
s
p50
0.004368
s
<
p95
0.004383
s
<
p99
0.004385
s
WASM call duration: 'validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000994
s
SD
3.9e-05
s
p50
0.000998
s
<
p95
0.001004
s
<
p99
0.001005
s
WASM call duration: 'validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002978
s
SD
9.9e-05
s
p50
0.002993
s
<
p95
0.00301
s
<
p99
0.003011
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000273
s
SD
6e-06
s
p50
0.000274
s
<
p95
0.000276
s
≤
p99
0.000276
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000295
s
SD
7e-06
s
p50
0.000295
s
<
p95
0.000298
s
≤
p99
0.000298
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.000651
s
SD
5.3e-05
s
p50
0.000649
s
<
p95
0.000679
s
<
p99
0.000681
s
Host function call duration: '__hc__update_1'
Duration of this host function call invoked from within WASM.
mean
0.0011
s
SD
6.3e-05
s
p50
0.001086
s
<
p95
0.001148
s
≤
p99
0.001148
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001613
s
SD
6.2e-05
s
p50
0.00167
s
<
p95
0.001716
s
<
p99
0.001723
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000227
s
SD
2.6e-05
s
p50
0.000223
s
<
p95
0.000244
s
≤
p99
0.000244
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.18
s
<
mean
152.18
s
SD
86.56
s
<
p95
287.18
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
17937
over 290.002725196s
mean rate
61.85
/s
std
15.83
/s
p5
45.1
/s
p95
93.8
/s
peak
102
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.015918
s
SD
0.01483
s
p50
0.016256
s
<
p95
0.017644
s
<
p99
0.094974
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000479
s
SD
0
s
p50
0.000479
s
≤
p95
0.000479
s
≤
p99
0.000479
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000858
s
SD
0
s
p50
0.000858
s
≤
p95
0.000858
s
≤
p99
0.000858
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.009111
s
SD
0.002665
s
p50
0.008339
s
<
p95
0.011176
s
<
p99
0.011283
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.045614
s
SD
0.020743
s
p50
0.03816
s
<
p95
0.066513
s
<
p99
0.068332
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000805
s
SD
0
s
p50
0.000805
s
≤
p95
0.000805
s
≤
p99
0.000805
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.010472
s
SD
0.004164
s
p50
0.009146
s
<
p95
0.013971
s
<
p99
0.014287
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.003371
s
SD
0.001335
s
p50
0.00283
s
<
p95
0.004682
s
<
p99
0.004807
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002086
s
SD
0.000871
s
p50
0.001843
s
<
p95
0.002891
s
<
p99
0.002962
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000128
s
SD
1.6e-05
s
p50
0.000127
s
<
p95
0.000138
s
<
p99
0.000171
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000286
s
SD
3.7e-05
s
p50
0.000282
s
<
p95
0.000304
s
<
p99
0.000305
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000295
s
SD
0
s
p50
0.000295
s
≤
p95
0.000295
s
≤
p99
0.000295
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
7.4e-05
s
SD
4e-06
s
p50
7.4e-05
s
<
p95
7.6e-05
s
≤
p99
7.6e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.005681
s
SD
0.127789
s
p50
0.000572
s
<
p95
0.34445
s
≤
p99
0.34445
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000236
s
SD
5.2e-05
s
p50
0.000237
s
<
p95
0.000238
s
<
p99
0.000522
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
28.94
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
25
B/s
<
mean
635
B/s
SD
987
B/s
<
p95
2.80
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
103
B/s
<
mean
573
B/s
SD
821
B/s
<
p95
1.17
KiB/s
Total bytes received
Total bytes received on primary network interface
count
186.09
KiB
mean
635
B/s
Total bytes sent
Total bytes sent on primary network interface
count
167.73
KiB
mean
573
B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
22.51
%
<
mean
34.33
%
SD
8.04
%
<
p95
45.14
%
System
5.39
%
CPU percentiles
CPU usage percentiles
p50
35.06
%
p95
45.14
%
p99
67.81
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
12.33
%
<
mean
14.93
%
SD
1.24
%
<
p95
15.83
%
Memory available percentage
Percentage of available memory
p5
84.17
%
<
mean
85.07
%
SD
1.24
%
<
p95
87.67
%
Max host memory used
Maximum memory usage percentage across all hosts
max
14.93
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-52.94
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
13.73
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /efi-boot
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.82
5 min
0.87
15 min
0.34
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.061
%
SD
0.1032
%
<
p95
0.27
%
60 second average
0.0645
%
300 second average
0.0229
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
9.09
%
<
mean
12
%
SD
1.8807
%
<
p95
15.35
%
60 second average
10.2690
%
300 second average
6.1777
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
8.96
%
<
mean
11.5681
%
SD
1.8987
%
<
p95
14.83
%
60 second average
9.9116
%
300 second average
6.0042
%
Holochain process CPU usage
CPU usage by Holochain process
p5
21.55
%
<
mean
33.43
%
SD
8.24
%
<
p95
44.1
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
335.79
KiB
<
mean
466.09
KiB
SD
43.94
KiB
<
p95
480.96
KiB
Holochain process threads
Number of threads in Holochain process
p5
14
threads
<
mean
14.53
threads
SD
1.59
threads
<
p95
15
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
64
file descriptors
≤
mean
63.43
file descriptors
SD
9.66
file descriptors
<
p95
68
file descriptors

Write Validated must_get_agent_activity

↑ Back to index

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Mixed-Arc must_get_agent_activity, but all agents are full-arc.

Started
Wed, 03 Jun 2026 14:19:42 UTC
Peer count
30
Peer count at end
28
Behaviours
  • must_get_agent_activity (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
write_validated_must_get_agent_activity_26886318076_1
Highest observed action_seq
The maximum chain length observed per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1462.5
Max
Highest chain head value observed for any single write agent.
1501
Write agents observed
2
Chain batch delay timing
The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.
Mean
mean
126.389483
s
SD
79.223822
s
Max
Highest per-partition mean latency
max mean
345.010304
s
Min
Lowest per-partition mean latency
min mean
9.374638
s
Chain batch delay rate
The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.
Mean
mean
2.64
/s
Max
Highest per-partition mean rate
max
4.5
/s
Min
Lowest per-partition mean rate
min
1.61
/s
create_validated_sample_entry zome call timing
The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.
Mean
mean
0.766534
s
SD
0.659875
s
Max
Highest per-partition mean latency
max mean
2.906497
s
Min
Lowest per-partition mean latency
min mean
0.064882
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.
Total
1922
Agents affected
13 / 13
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
148
Max
Highest count in any single partition
373
Min
Lowest count in any single partition
11
Final error count
The total number of all types of error accumulated over the run by all agents.
67258
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.021653
s
SD
0.020098
s
p50
0.001532
s
<
p95
0.041054
s
<
p99
0.120249
s
WASM usage: 'validated_must_get_agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 1023.321131125s
Not enough time data to show a trend.
WASM usage: 'validated_must_get_agent_activity::create_sample_entries_batch'
Metered usage count of the WASM ribosome for this zome function.
total
4362801655
over 1023.321131125s
mean rate
1.15064376046e+09
/s
std
1.41477066949e+09
/s
p5
3986.12
/s
p95
4.05717573285e+09
/s
peak
5.32509763516e+09
/s
WASM usage: 'validated_must_get_agent_activity::create_validated_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
10591864
over 1016.849578613s
mean rate
2.3661062795e+08
/s
std
5.3676173838e+08
/s
p5
946577.14
/s
p95
1.62707594812e+09
/s
peak
5.26786182477e+09
/s
WASM usage: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Metered usage count of the WASM ribosome for this zome function.
total
552358354
over 1016.849578613s
mean rate
2.08022291846e+09
/s
std
1.42060029974e+10
/s
p5
512077.17
/s
p95
1.7862781699e+09
/s
peak
2.53387619467e+11
/s
WASM usage: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
58568458
over 33067.856923754s
mean rate
4.764610091e+07
/s
std
1.0083733166e+08
/s
p5
77675.96
/s
p95
3.1922125297e+08
/s
peak
4.785309917e+08
/s
WASM usage: 'validated_must_get_agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
4810268
over 33072.403294379s
mean rate
8.2610188459e+08
/s
std
5.66678400418e+09
/s
p5
5711.32
/s
p95
1.89400531169e+09
/s
peak
1.21772054256e+11
/s
WASM usage: 'validated_must_get_agent_activity_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 33070.887201587s
Not enough time data to show a trend.
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.006774
s
SD
0.00323
s
p50
0.00608
s
<
p95
0.012464
s
≤
p99
0.012464
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.052972
s
SD
0.019257
s
p50
0.046716
s
<
p95
0.095813
s
<
p99
0.104009
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006245
s
SD
0.001475
s
p50
0.006041
s
<
p95
0.007993
s
<
p99
0.008205
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.040099
s
SD
0.021565
s
p50
0.025263
s
<
p95
0.05965
s
<
p99
0.125729
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.008068
s
SD
0.002463
s
p50
0.00694
s
<
p95
0.013187
s
<
p99
0.013945
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005659
s
SD
0.002845
s
p50
0.005143
s
<
p95
0.010604
s
≤
p99
0.010604
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.0519
s
SD
0.019006
s
p50
0.045673
s
<
p95
0.094081
s
<
p99
0.102312
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005152
s
SD
0.001201
s
p50
0.005016
s
<
p95
0.006464
s
<
p99
0.00673
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.028529
s
SD
0.026026
s
p50
0.018429
s
<
p95
0.063411
s
<
p99
0.154857
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00678
s
SD
0.002182
s
p50
0.005824
s
<
p95
0.011861
s
≤
p99
0.011861
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00129
s
SD
0.000494
s
p50
0.001309
s
<
p95
0.002352
s
<
p99
0.00334
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.007386
s
SD
0.004846
s
p50
0.006056
s
<
p95
0.015709
s
<
p99
0.026187
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.3e-05
s
SD
9e-06
s
p50
3.1e-05
s
<
p95
5.3e-05
s
≤
p99
5.3e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000423
s
SD
0.000139
s
p50
0.000435
s
<
p95
0.000686
s
<
p99
0.000791
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000398
s
SD
0.000231
s
p50
0.000386
s
<
p95
0.00105
s
≤
p99
0.00105
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.021761
s
SD
0.020077
s
p50
0.001591
s
<
p95
0.041164
s
<
p99
0.120359
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.014935
s
SD
0.015299
s
p50
0.013117
s
<
p95
0.046345
s
<
p99
0.086174
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.00627
s
SD
0.003349
s
p50
0.004029
s
<
p95
0.012584
s
<
p99
0.014799
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1.8e-05
s
SD
5e-06
s
p50
1.3e-05
s
<
p95
2.1e-05
s
<
p99
3.2e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002263
s
SD
0.00097
s
p50
0.002579
s
<
p95
0.004149
s
<
p99
0.00725
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000473
s
SD
0.000253
s
p50
0.000359
s
<
p95
0.000886
s
<
p99
0.001519
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.23
s
<
mean
452.3
s
SD
260.02
s
<
p95
857.27
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
4
over 33072.403329256s
mean rate
118634.67
/s
std
939719.31
/s
p5
0
/s
p95
215698.31
/s
peak
1.993908906e+07
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
30.045209
s
SD
42.855326
s
p50
8.905372
s
<
p95
133.803284
s
<
p99
176.757596
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
2.118528
s
SD
0.555463
s
p50
1.989036
s
<
p95
2.606252
s
<
p99
3.169015
s
App validation workflow duration
Time spent running the app validation workflow.
mean
2.254636
s
SD
17.292757
s
p50
1.535651
s
<
p95
50.328447
s
<
p99
84.476531
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001637
s
SD
0.001018
s
p50
0.001333
s
<
p95
0.003631
s
<
p99
0.003822
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.021332
s
SD
0.027328
s
p50
0.003477
s
<
p95
0.055983
s
<
p99
0.157465
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.009154
s
SD
0.008715
s
p50
0.003142
s
<
p95
0.025437
s
<
p99
0.038446
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.431768
s
SD
0.382074
s
p50
0.355945
s
<
p95
0.834523
s
<
p99
1.45587
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
11.07222
s
SD
22.93604
s
p50
10.644886
s
<
p95
52.547065
s
<
p99
136.438566
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.007291
s
SD
0.006057
s
p50
0.002038
s
<
p95
0.02073
s
<
p99
0.028332
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002573
s
SD
0.001894
s
p50
0.000968
s
<
p95
0.004648
s
<
p99
0.009
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.00024
s
SD
0.000146
s
p50
0.00022
s
<
p95
0.000364
s
<
p99
0.000449
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.00979
s
SD
0.005873
s
p50
0.003699
s
<
p95
0.016301
s
<
p99
0.027258
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000121
s
SD
6.3e-05
s
p50
9.6e-05
s
<
p95
0.000216
s
<
p99
0.000354
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000189
s
SD
8.8e-05
s
p50
0.000171
s
<
p95
0.000356
s
<
p99
0.000436
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.005429
s
SD
0.542812
s
p50
0.000544
s
<
p95
0.451359
s
<
p99
1.976529
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000286
s
SD
0.000141
s
p50
0.000339
s
<
p95
0.00058
s
<
p99
0.000763
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.135158
s
SD
3.64849
s
p50
0.089311
s
<
p95
0.242442
s
<
p99
0.305995
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
1.135675
s
SD
5.397442
s
p50
1.184525
s
<
p95
10.269448
s
<
p99
19.444956
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
24.04
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.01
KiB/s
<
mean
172.08
KiB/s
SD
343.17
KiB/s
<
p95
700.42
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
29
B/s
<
mean
163.58
KiB/s
SD
266.58
KiB/s
<
p95
707.24
KiB/s
Total bytes received
Total bytes received on primary network interface
count
4.19
GiB
mean
4.16
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
3.98
GiB
mean
3.96
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.8%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 425.73 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 14% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.01
%
<
mean
31.39
%
SD
27.84
%
<
p95
91.69
%
System
7.35
%
CPU percentiles
CPU usage percentiles
p50
20.23
%
p95
91.69
%
p99
98.75
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
12
hosts
mean time
0.23
s
Memory used percentage
Percentage of memory used
p5
7.31
%
<
mean
19.54
%
SD
12.56
%
<
p95
36.25
%
Memory available percentage
Percentage of available memory
p5
63.75
%
<
mean
80.46
%
SD
12.56
%
<
p95
92.69
%
Max host memory used
Maximum memory usage percentage across all hosts
max
78.46
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.05
%
Memory growth rate
Rate of memory growth over time
growth
425.73
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.05
MiB/s
Disk write throughput
Disk write throughput in MiB/s
130.46
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/15
hosts
Mount Point /boot
0/1
hosts
Mount Point /efi-boot
0/12
hosts
Mount Point /etc/hostname
0/5
hosts
Mount Point /etc/hosts
0/5
hosts
Mount Point /etc/resolv.conf
0/5
hosts
Mount Point /nix/store
0/15
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.55
5 min
2.19
15 min
1.97
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
14.29
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
7.6356
%
SD
16.7626
%
<
p95
26.73
%
60 second average
7.4523
%
300 second average
6.4567
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
16.2163
%
SD
19.1632
%
<
p95
48.42
%
60 second average
15.6611
%
300 second average
13.3408
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
12.1251
%
SD
15.7714
%
<
p95
41.28
%
60 second average
11.6978
%
300 second average
10.0714
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.25
%
<
mean
10.8
%
SD
12.91
%
<
p95
34.95
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
50.71
KiB
<
mean
362.70
KiB
SD
196.48
KiB
<
p95
565.80
KiB
Holochain process threads
Number of threads in Holochain process
p5
8
threads
<
mean
24.42
threads
SD
15.94
threads
<
p95
52
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
23
file descriptors
<
mean
66.49
file descriptors
SD
22.05
file descriptors
<
p95
92
file descriptors

Zome Call, Single Value

↑ Back to index

Calls a zome function that returns a fixed value. This tests the maximum performance of zome calls when the zome function is not calling into Holochain other otherwise doing any work.

Started
Wed, 03 Jun 2026 13:14:42 UTC
Peer count
1
Peer count at end
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
zome_call_single_value_26886318076_1
Call timing
The time taken for the call to complete.
mean
0.003203
s
SD
0.013793
s
p50
0.002533
s
<
p95
0.002792
s
<
p99
0.007443
s
Call rate
The number of zome calls completed per second.
mean
3092.57
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'return_single_value::get_value'
Metered usage count of the WASM ribosome for this zome function.
total
367409856
over 280.002064071s
mean rate
1.31216839e+06
/s
std
68212.39
/s
p5
1.18294198e+06
/s
p95
1.39041275e+06
/s
peak
1.41588025e+06
/s
Zome call duration: 'return_single_value::get_value'
Duration of this zome call as measured by Holochain internally.
mean
0.0014
s
SD
1e-05
s
p50
0.0014
s
<
p95
0.001401
s
≤
p99
0.001401
s
WASM call duration: 'return_single_value::get_value'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000851
s
SD
5e-06
s
p50
0.000851
s
<
p95
0.000853
s
≤
p99
0.000853
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000158
s
SD
0
s
p50
0.000158
s
≤
p95
0.000158
s
≤
p99
0.000158
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
16.13
s
<
mean
146.13
s
SD
83.67
s
<
p95
276.13
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.002053874s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.094537
s
SD
0
s
p50
0.094537
s
≤
p95
0.094537
s
≤
p99
0.094537
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001524
s
SD
0
s
p50
0.001524
s
≤
p95
0.001524
s
≤
p99
0.001524
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000773
s
SD
0
s
p50
0.000773
s
≤
p95
0.000773
s
≤
p99
0.000773
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001175
s
SD
0
s
p50
0.001175
s
≤
p95
0.001175
s
≤
p99
0.001175
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.000957
s
SD
4.7e-05
s
p50
0.000994
s
<
p95
0.001009
s
≤
p99
0.001009
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001609
s
SD
0
s
p50
0.001609
s
≤
p95
0.001609
s
≤
p99
0.001609
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000511
s
SD
0
s
p50
0.000511
s
≤
p95
0.000511
s
≤
p99
0.000511
s
Authored DB connection use time
Time spent holding authored database connections.
mean
9.1e-05
s
SD
0
s
p50
9.1e-05
s
≤
p95
9.1e-05
s
≤
p99
9.1e-05
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
5.8e-05
s
SD
0
s
p50
5.8e-05
s
≤
p95
5.8e-05
s
<
p99
5.9e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
7.4e-05
s
SD
1e-06
s
p50
7.4e-05
s
≤
p95
7.4e-05
s
<
p99
7.6e-05
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000169
s
SD
0
s
p50
0.000169
s
≤
p95
0.000169
s
≤
p99
0.000169
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000335
s
SD
0
s
p50
0.000335
s
≤
p95
0.000335
s
≤
p99
0.000335
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
7.6e-05
s
SD
7e-06
s
p50
7.4e-05
s
<
p95
8.4e-05
s
≤
p99
8.4e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000651
s
SD
0.008387
s
p50
0.000661
s
<
p95
0.02133
s
≤
p99
0.02133
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000681
s
SD
0
s
p50
0.000681
s
≤
p95
0.000681
s
≤
p99
0.000681
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
15.69
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
38
B/s
<
mean
642
B/s
SD
997
B/s
<
p95
2.80
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
109
B/s
<
mean
620
B/s
SD
1007
B/s
<
p95
1.09
KiB/s
Total bytes received
Total bytes received on primary network interface
count
188.01
KiB
mean
642
B/s
Total bytes sent
Total bytes sent on primary network interface
count
181.60
KiB
mean
620
B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
21.32
%
<
mean
24.23
%
SD
5.31
%
<
p95
25.16
%
System
8.54
%
CPU percentiles
CPU usage percentiles
p50
23.68
%
p95
25.16
%
p99
52.22
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
11.93
%
<
mean
13.88
%
SD
1.06
%
<
p95
15.37
%
Memory available percentage
Percentage of available memory
p5
84.63
%
<
mean
86.12
%
SD
1.06
%
<
p95
88.07
%
Max host memory used
Maximum memory usage percentage across all hosts
max
13.88
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-40.76
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
5.72
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /efi-boot
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.07
5 min
0.52
15 min
0.21
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0248
%
SD
0.0778
%
<
p95
0.18
%
60 second average
0.0142
%
300 second average
0.0013
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
3.72
%
<
mean
6.1855
%
SD
2.0168
%
<
p95
10.57
%
60 second average
5.5135
%
300 second average
3.0168
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
3.66
%
<
mean
6.0177
%
SD
1.9563
%
<
p95
10.09
%
60 second average
5.3687
%
300 second average
2.9400
%
Holochain process CPU usage
CPU usage by Holochain process
p5
18.3
%
<
mean
21.05
%
SD
5.76
%
<
p95
21.53
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
259.82
KiB
<
mean
261.21
KiB
SD
2.31
KiB
<
p95
261.91
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
≤
mean
12.8
threads
SD
1.08
threads
<
p95
13
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
47
file descriptors
<
mean
49.9
file descriptors
SD
10.38
file descriptors
<
p95
66
file descriptors