App Install

↑ Back to index

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Thu, 11 Jun 2026 01:37:13 UTC
Peer count
1
Behaviours
  • large (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
app_install_large_27317315203_1
First install time
The time from conductor startup to completion of the first app installation attempt.
0.168848583
s
Install app timing
The time taken to install an app.
mean
0.054767
s
SD
0.10714
s
p50
0.040311
s
<
p95
0.070972
s
<
p99
0.078903
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'large::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 60.000754679s
Not enough time data to show a trend.
WASM call duration: 'large::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002581
s
SD
0.000107
s
p50
0.00256
s
<
p95
0.002727
s
<
p99
0.003034
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000131
s
SD
8.6e-05
s
p50
0.000104
s
<
p95
0.000297
s
<
p99
0.000488
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
8.55
s
<
mean
38.55
s
SD
20
s
<
p95
68.55
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
3575
over 60.001634359s
mean rate
59.58
/s
std
6.19
/s
p5
45.8
/s
p95
63.4
/s
peak
63.4
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.000757
s
SD
0.000487
s
p50
0.000745
s
<
p95
0.002128
s
≤
p99
0.002128
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000528
s
SD
4.5e-05
s
p50
0.00053
s
<
p95
0.000562
s
≤
p99
0.000562
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001015
s
SD
4.7e-05
s
p50
0.001019
s
<
p95
0.001023
s
≤
p99
0.001023
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.012728
s
SD
0.000242
s
p50
0.012703
s
<
p95
0.012821
s
≤
p99
0.012821
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.000999
s
SD
1.6e-05
s
p50
0.001003
s
<
p95
0.001038
s
≤
p99
0.001038
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000638
s
SD
7e-06
s
p50
0.000636
s
<
p95
0.000651
s
≤
p99
0.000651
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000269
s
SD
9e-06
s
p50
0.000265
s
<
p95
0.000274
s
≤
p99
0.000274
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000149
s
SD
3.4e-05
s
p50
0.000138
s
<
p95
0.00021
s
<
p99
0.00029
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
3.1e-05
s
SD
0
s
p50
3.1e-05
s
≤
p95
3.1e-05
s
≤
p99
3.1e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
7.5e-05
s
SD
3e-06
s
p50
7.6e-05
s
<
p95
8.4e-05
s
≤
p99
8.4e-05
s
Cache DB connection use time
Time spent holding cache database connections.
mean
6.6e-05
s
SD
3e-06
s
p50
6.6e-05
s
≤
p95
6.6e-05
s
≤
p99
6.6e-05
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
6.6e-05
s
SD
0
s
p50
6.6e-05
s
≤
p95
6.6e-05
s
≤
p99
6.6e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
6.6e-05
s
SD
9e-06
s
p50
6.6e-05
s
<
p95
8.9e-05
s
≤
p99
8.9e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000301
s
SD
0.000113
s
p50
0.000255
s
<
p95
0.000327
s
<
p99
0.000507
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000235
s
SD
2e-06
s
p50
0.000234
s
<
p95
0.00024
s
≤
p99
0.00024
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
30.20
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
162.53
KiB/s
<
mean
186.97
KiB/s
SD
11.07
KiB/s
<
p95
195.43
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
53.71
KiB/s
<
mean
55.38
KiB/s
SD
790
B/s
<
p95
56.09
KiB/s
Total bytes received
Total bytes received on primary network interface
count
10.96
MiB
mean
186.97
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
3.24
MiB
mean
55.38
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1611.76 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
33.26
%
<
mean
35.72
%
SD
1.12
%
<
p95
36.43
%
System
5.52
%
CPU percentiles
CPU usage percentiles
p50
36.32
%
p95
36.43
%
p99
36.43
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
8.73
%
<
mean
12.08
%
SD
2.98
%
<
p95
17.11
%
Memory available percentage
Percentage of available memory
p5
82.89
%
<
mean
87.92
%
SD
2.98
%
<
p95
91.27
%
Max host memory used
Maximum memory usage percentage across all hosts
max
12.08
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1611.76
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.09
MiB/s
Disk write throughput
Disk write throughput in MiB/s
10.69
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.63
5 min
0.18
15 min
0.06
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.42
%
<
mean
2.3557
%
SD
0.8824
%
<
p95
2.99
%
60 second average
1.0829
%
300 second average
0.2886
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0957
%
SD
0.0965
%
<
p95
0.24
%
60 second average
0.0386
%
300 second average
0.0071
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.07
%
SD
0.0776
%
<
p95
0.22
%
60 second average
0.0229
%
300 second average
0.0014
%
Holochain process CPU usage
CPU usage by Holochain process
p5
31.79
%
<
mean
34.23
%
SD
1.11
%
<
p95
34.98
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
345.94
KiB
<
mean
1.13
MiB
SD
543.10
KiB
<
p95
1.93
MiB
Holochain process threads
Number of threads in Holochain process
p5
14
threads
<
mean
20
threads
SD
2.45
threads
<
p95
21
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
62
file descriptors
<
mean
1306.43
file descriptors
SD
820.49
file descriptors
<
p95
2523
file descriptors

App Install

↑ Back to index

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Thu, 11 Jun 2026 01:39:00 UTC
Peer count
1
Behaviours
  • minimal (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
app_install_minimal_27317315203_1
First install time
The time from conductor startup to completion of the first app installation attempt.
0.518231839
s
Install app timing
The time taken to install an app.
mean
0.056333
s
SD
0.039284
s
p50
0.047037
s
<
p95
0.095517
s
<
p99
0.239055
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'callback::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 120.004001162s
Not enough time data to show a trend.
WASM usage: 'callback_integrity::genesis_self_check_2'
Metered usage count of the WASM ribosome for this zome function.
total
2939094
over 120.004001162s
mean rate
24491.08
/s
std
5232.67
/s
p5
12565.57
/s
p95
27861.86
/s
peak
27861.86
/s
WASM call duration: 'callback::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000949
s
SD
0.001204
s
p50
0.000848
s
<
p95
0.001301
s
<
p99
0.001682
s
WASM call duration: 'callback_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000915
s
SD
3.2e-05
s
p50
0.000895
s
<
p95
0.000991
s
≤
p99
0.000991
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000228
s
SD
0.000183
s
p50
0.0002
s
<
p95
0.000471
s
<
p99
0.00075
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
7.62
s
<
mean
67.62
s
SD
37.42
s
<
p95
127.62
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
5918
over 120.000830329s
mean rate
49.32
/s
std
10.45
/s
p5
25.7
/s
p95
55.7
/s
peak
55.7
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.000914
s
SD
0.001746
s
p50
0.000936
s
<
p95
0.007477
s
≤
p99
0.007477
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001053
s
SD
4.1e-05
s
p50
0.001055
s
<
p95
0.001182
s
≤
p99
0.001182
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001849
s
SD
2.6e-05
s
p50
0.001844
s
<
p95
0.001907
s
≤
p99
0.001907
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.016893
s
SD
0.000824
s
p50
0.016482
s
<
p95
0.018245
s
≤
p99
0.018245
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001626
s
SD
4.4e-05
s
p50
0.001598
s
<
p95
0.001744
s
≤
p99
0.001744
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001147
s
SD
1.6e-05
s
p50
0.001145
s
<
p95
0.001161
s
≤
p99
0.001161
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000554
s
SD
8e-06
s
p50
0.000554
s
<
p95
0.000576
s
≤
p99
0.000576
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000222
s
SD
5.4e-05
s
p50
0.000214
s
<
p95
0.000318
s
<
p99
0.000379
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
3.9e-05
s
SD
1e-06
s
p50
3.8e-05
s
<
p95
4.2e-05
s
≤
p99
4.2e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000108
s
SD
3.3e-05
s
p50
0.000108
s
<
p95
0.000232
s
≤
p99
0.000232
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000105
s
SD
8e-06
s
p50
0.000105
s
<
p95
0.000135
s
≤
p99
0.000135
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
7.1e-05
s
SD
0
s
p50
7.1e-05
s
≤
p95
7.1e-05
s
≤
p99
7.1e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000139
s
SD
1.1e-05
s
p50
0.000132
s
<
p95
0.000169
s
≤
p99
0.000169
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000424
s
SD
9.7e-05
s
p50
0.000342
s
<
p95
0.000469
s
<
p99
0.000581
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000345
s
SD
1.5e-05
s
p50
0.000337
s
<
p95
0.000378
s
≤
p99
0.000378
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
48.28
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
84.02
KiB/s
<
mean
759.74
KiB/s
SD
1.69
MiB/s
<
p95
6.52
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
35.28
KiB/s
<
mean
141.29
KiB/s
SD
216.02
KiB/s
<
p95
776.83
KiB/s
Total bytes received
Total bytes received on primary network interface
count
96.45
MiB
mean
759.74
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
17.94
MiB
mean
141.29
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 94.8%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1557.38 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
50.64
%
<
mean
59.73
%
SD
14.87
%
<
p95
94.76
%
System
11.45
%
CPU percentiles
CPU usage percentiles
p50
51.79
%
p95
94.76
%
p99
94.76
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.15
s
Memory used percentage
Percentage of memory used
p5
12.77
%
<
mean
23.87
%
SD
8.56
%
<
p95
38.69
%
Memory available percentage
Percentage of available memory
p5
61.31
%
<
mean
76.13
%
SD
8.56
%
<
p95
87.23
%
Max host memory used
Maximum memory usage percentage across all hosts
max
23.87
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1557.38
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.21
MiB/s
Disk write throughput
Disk write throughput in MiB/s
9.89
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.44
5 min
0.46
15 min
0.16
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
2.15
%
<
mean
21.2014
%
SD
19.4209
%
<
p95
67.08
%
60 second average
10.8964
%
300 second average
3.3436
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.1714
%
SD
0.6181
%
<
p95
2.4
%
60 second average
0.0357
%
300 second average
0.0071
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.055
%
SD
0.1983
%
<
p95
0.77
%
60 second average
0.0107
%
300 second average
0.0021
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
4.5321
%
SD
8.6264
%
<
p95
33.16
%
60 second average
1.7214
%
300 second average
0.4714
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
1.125
%
SD
2.2153
%
<
p95
8.99
%
60 second average
0.4929
%
300 second average
0.1493
%
Holochain process CPU usage
CPU usage by Holochain process
p5
28.02
%
<
mean
48.7
%
SD
7.66
%
<
p95
65.9
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
133.03
KiB
<
mean
882.56
KiB
SD
589.09
KiB
<
p95
1.83
MiB
Holochain process threads
Number of threads in Holochain process
p5
17
threads
<
mean
20.07
threads
SD
3.37
threads
<
p95
31
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
67
file descriptors
<
mean
1021.93
file descriptors
SD
760.33
file descriptors
<
p95
1887
file descriptors

DHT Sync Lag

↑ Back to index

Measures the lag time between an agent publishing data and other peers being able to see it. This scenario has two roles:

  • write: Creates entries with a timestamp field, linked to a known base hash so that record_lag agents can discover them.
  • record_lag: Repeatedly queries for links from the known base hash. When a new entry is discovered, it calculates the time difference between the entry's timestamp and the current time, giving the sync lag for that entry.
Started
Thu, 11 Jun 2026 01:40:49 UTC
Peer count
30
Peer count at end
24
Behaviours
  • record_lag (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
dht_sync_lag_27317315203_1
Create rate
The average number of created records per agent.
Mean
mean
48.73
/s
Max
Highest per-partition mean rate
max
85.02
/s
Min
Lowest per-partition mean rate
min
11.44
/s
Sync lag timing
The average time between when a record was created and when it is first seen by an agent.
Mean
mean
150.326311
s
SD
109.231989
s
Max
Highest per-partition mean latency
max mean
567.586082
s
Min
Lowest per-partition mean latency
min mean
40.188484
s
Sync lag rate
The average number of created records discovered per agent.
Mean
mean
87.38
/s
Max
Highest per-partition mean rate
max
421
/s
Min
Lowest per-partition mean rate
min
0
/s
Delivery ratio
The proportion of created entries successfully received by all record_lag agents.
0.0074
Sent count
The total number of entries sent (created) by write agents, by agent.
Total
211427
Agents affected
24 / 24
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
8809
Max
Highest count in any single partition
15606
Min
Lowest count in any single partition
1979
Received count
The total number of entries received by record_lag agents, by agent.
Total
7786
Agents affected
5 / 5
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
1557
Max
Highest count in any single partition
1753
Min
Lowest count in any single partition
1441
Error count
The number of errors encountered during the scenario.
139
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.062808
s
SD
0.101637
s
p50
0.07128
s
<
p95
0.314193
s
<
p99
0.362534
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
1463
over 34.374277509s
mean rate
2457.12
/s
std
4197.7
/s
p5
155.21
/s
p95
13283.84
/s
peak
13283.84
/s
WASM usage: 'timed::created_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
530552208
over 38368.316608951s
mean rate
3.72186780901e+09
/s
std
2.79686188468e+10
/s
p5
138930.04
/s
p95
8.7004592399e+09
/s
peak
8.19137577651e+11
/s
WASM usage: 'timed::get_timed_entries_local'
Metered usage count of the WASM ribosome for this zome function.
total
872512640
over 1796.505362417s
mean rate
1.46949233208e+09
/s
std
2.11436021554e+09
/s
p5
4.13222342e+07
/s
p95
6.26513944541e+09
/s
peak
6.87422221317e+09
/s
WASM usage: 'timed_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
60589616
over 38368.889070722s
mean rate
4.6663998228e+08
/s
std
2.95153249663e+09
/s
p5
19386.96
/s
p95
1.75911024017e+09
/s
peak
9.25343609818e+10
/s
Zome call duration: 'timed::created_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.013357
s
SD
0.022957
s
p50
0.009281
s
<
p95
0.071189
s
<
p99
0.127634
s
Zome call duration: 'timed::get_timed_entries_local'
Duration of this zome call as measured by Holochain internally.
mean
0.46435
s
SD
0.840613
s
p50
0.415653
s
<
p95
2.363441
s
<
p99
3.740147
s
WASM call duration: 'timed::created_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.012352
s
SD
0.022388
s
p50
0.00839
s
<
p95
0.068872
s
<
p99
0.124024
s
WASM call duration: 'timed::get_timed_entries_local'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.463728
s
SD
0.840626
s
p50
0.415108
s
<
p95
2.362823
s
<
p99
3.739603
s
WASM call duration: 'timed_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001401
s
SD
0.000998
s
p50
0.001232
s
<
p95
0.003854
s
<
p99
0.005845
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.002633
s
SD
0.008372
s
p50
0.000962
s
<
p95
0.023658
s
<
p99
0.045308
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.002512
s
SD
0.008124
s
p50
0.00093
s
<
p95
0.022495
s
<
p99
0.044859
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.064182
s
SD
0.103848
s
p50
0.075732
s
<
p95
0.319514
s
<
p99
0.37856
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.005348
s
SD
0.012568
s
p50
0.00426
s
<
p95
0.04073
s
<
p99
0.053314
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002735
s
SD
0.002501
s
p50
0.002028
s
<
p95
0.009207
s
<
p99
0.013876
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000587
s
SD
0.000808
s
p50
0.000393
s
<
p95
0.002811
s
<
p99
0.004134
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
96.58
s
<
mean
910.09
s
SD
523.89
s
<
p95
1727.51
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
39963
over 38368.889071228s
mean rate
487987.02
/s
std
3.19598535e+06
/s
p5
13.2
/s
p95
1.74989829e+06
/s
peak
1.0701752484e+08
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
41.340585
s
SD
31.483365
s
p50
19.428458
s
<
p95
84.560284
s
<
p99
177.487809
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.538008
s
SD
0.284365
s
p50
1.494408
s
<
p95
2.06505
s
<
p99
2.092996
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.600459
s
SD
10.854623
s
p50
4.26805
s
<
p95
35.305228
s
<
p99
54.977772
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000999
s
SD
0.000599
s
p50
0.000761
s
<
p95
0.002435
s
<
p99
0.002637
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.019355
s
SD
1.027609
s
p50
0.022701
s
<
p95
0.762114
s
<
p99
8.143939
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.232139
s
SD
0.16462
s
p50
0.163548
s
<
p95
0.461715
s
<
p99
0.716554
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
1.790488
s
SD
25.889448
s
p50
9.270772
s
<
p95
72.462156
s
<
p99
106.613724
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.54491
s
SD
37.172483
s
p50
0.704859
s
<
p95
112.674747
s
<
p99
141.066508
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.016692
s
SD
0.019612
s
p50
0.009235
s
<
p95
0.071167
s
<
p99
0.091008
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000944
s
SD
0.002663
s
p50
0.000559
s
<
p95
0.008377
s
<
p99
0.011852
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000259
s
SD
0.000153
s
p50
0.000215
s
<
p95
0.000509
s
<
p99
0.000727
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.009872
s
SD
0.011491
s
p50
0.000215
s
<
p95
0.034773
s
<
p99
0.054927
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000119
s
SD
0.000116
s
p50
8.9e-05
s
<
p95
0.000245
s
<
p99
0.000677
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000141
s
SD
0.000107
s
p50
0.000133
s
<
p95
0.000306
s
<
p99
0.00057
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.004208
s
SD
0.012127
s
p50
0.001622
s
<
p95
0.032122
s
<
p99
0.049615
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.002346
s
SD
0.006802
s
p50
0.000367
s
<
p95
0.018225
s
<
p99
0.040653
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.398872
s
SD
28.939875
s
p50
0.393426
s
<
p95
60.002609
s
<
p99
60.049722
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.232106
s
SD
6.968753
s
p50
0.272755
s
<
p95
10.167699
s
<
p99
30.049709
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
54.82
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
375
B/s
<
mean
1.02
MiB/s
SD
779.33
KiB/s
<
p95
2.14
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
129
B/s
<
mean
1.38
MiB/s
SD
1.33
MiB/s
<
p95
4.02
MiB/s
Total bytes received
Total bytes received on primary network interface
count
52.40
GiB
mean
28.85
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
71.07
GiB
mean
39.13
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 97.8%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 735.17 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/7 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (36.6% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 62% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
13.35
%
<
mean
64.86
%
SD
25.44
%
<
p95
96.54
%
System
10.04
%
CPU percentiles
CPU usage percentiles
p50
70.79
%
p95
96.54
%
p99
97.82
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
22
hosts
mean time
0.47
s
Memory used percentage
Percentage of memory used
p5
7.3
%
<
mean
13.56
%
SD
6.33
%
<
p95
26.11
%
Memory available percentage
Percentage of available memory
p5
73.89
%
<
mean
86.44
%
SD
6.33
%
<
p95
92.7
%
Max host memory used
Maximum memory usage percentage across all hosts
max
37.74
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
36.56
%
Memory growth rate
Rate of memory growth over time
growth
735.17
MiB/s
Disk read throughput
Disk read throughput in MiB/s
1.01
MiB/s
Disk write throughput
Disk write throughput in MiB/s
328.41
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/8
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
1/7
hosts
Mount Point /etc/hosts
1/7
hosts
Mount Point /etc/resolv.conf
1/7
hosts
Mount Point /nix/store
0/8
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
5.41
5 min
4.70
15 min
3.24
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
62.07
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
25.9593
%
SD
20.6975
%
<
p95
59.94
%
60 second average
25.2455
%
300 second average
21.7822
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0011
%
SD
0.0377
%
≤
p95
0
%
60 second average
0.0008
%
300 second average
0.0003
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0005
%
SD
0.0149
%
≤
p95
0
%
60 second average
0.0003
%
300 second average
0.0001
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
12.1115
%
SD
18.2137
%
<
p95
48.99
%
60 second average
11.8043
%
300 second average
10.2699
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
7.5596
%
SD
13.7937
%
<
p95
38.52
%
60 second average
7.3966
%
300 second average
6.5240
%
Holochain process CPU usage
CPU usage by Holochain process
p5
9.12
%
<
mean
58.69
%
SD
26.09
%
<
p95
95.15
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
235.06
KiB
<
mean
509.89
KiB
SD
180.95
KiB
<
p95
841.52
KiB
Holochain process threads
Number of threads in Holochain process
p5
15
threads
<
mean
46.33
threads
SD
16.45
threads
<
p95
82
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
61
file descriptors
<
mean
88.24
file descriptors
SD
20.29
file descriptors
<
p95
126
file descriptors

First Call

↑ Back to index

This scenario installs a simple app which implements the init callback, and measures the time elapsed between start of install and calling init. It will uninstall the app it installed so that it can re-install it on the next iteration. This is required to re-run the initialisation callback.

Started
Thu, 11 Jun 2026 01:20:13 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
first_call_27317315203_1
Zome call timing
The time elapsed between start of install and calling init.
mean
0.011926
s
SD
0.006018
s
p50
0.00991
s
<
p95
0.022705
s
<
p99
0.027152
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 120.002928548s
Not enough time data to show a trend.
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 120.002928548s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
4759552
over 120.002928548s
mean rate
39661.88
/s
std
2630.35
/s
p5
34394.53
/s
p95
41831.39
/s
peak
41831.39
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004536
s
SD
0.000156
s
p50
0.004519
s
<
p95
0.004657
s
≤
p99
0.004657
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003768
s
SD
0.001404
s
p50
0.003286
s
<
p95
0.007557
s
<
p99
0.00781
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001768
s
SD
0.000436
s
p50
0.001666
s
<
p95
0.00263
s
<
p99
0.003216
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001084
s
SD
2.8e-05
s
p50
0.001079
s
<
p95
0.001117
s
≤
p99
0.001117
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.00041
s
SD
6.3e-05
s
p50
0.000365
s
<
p95
0.000475
s
≤
p99
0.000475
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002009
s
SD
6.8e-05
s
p50
0.002
s
<
p95
0.002067
s
≤
p99
0.002067
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000367
s
SD
0.000181
s
p50
0.000327
s
<
p95
0.000661
s
<
p99
0.001027
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
7.57
s
<
mean
67.57
s
SD
37.42
s
<
p95
127.57
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
8192
over 120.000927164s
mean rate
68.27
/s
std
4.55
/s
p5
58.5
/s
p95
72.7
/s
peak
72.7
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.001155
s
SD
0.001734
s
p50
0.001092
s
<
p95
0.007632
s
≤
p99
0.007632
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001073
s
SD
9.7e-05
s
p50
0.00107
s
<
p95
0.00141
s
≤
p99
0.00141
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.00194
s
SD
5.1e-05
s
p50
0.001954
s
<
p95
0.002127
s
≤
p99
0.002127
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.013121
s
SD
0.000615
s
p50
0.013113
s
<
p95
0.013191
s
≤
p99
0.013191
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.002114
s
SD
7.7e-05
s
p50
0.002107
s
<
p95
0.002173
s
≤
p99
0.002173
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001196
s
SD
5.2e-05
s
p50
0.001204
s
<
p95
0.001379
s
≤
p99
0.001379
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000582
s
SD
1.7e-05
s
p50
0.00058
s
<
p95
0.000618
s
≤
p99
0.000618
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000243
s
SD
4.5e-05
s
p50
0.000235
s
<
p95
0.000324
s
<
p99
0.000374
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
4.1e-05
s
SD
0
s
p50
4.1e-05
s
≤
p95
4.1e-05
s
≤
p99
4.1e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
9.5e-05
s
SD
1.9e-05
s
p50
9.5e-05
s
<
p95
0.000163
s
≤
p99
0.000163
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000101
s
SD
7e-06
s
p50
0.0001
s
<
p95
0.000105
s
≤
p99
0.000105
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000103
s
SD
0
s
p50
0.000103
s
≤
p95
0.000103
s
≤
p99
0.000103
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000214
s
SD
1.9e-05
s
p50
0.000213
s
<
p95
0.000229
s
≤
p99
0.000229
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000354
s
SD
0.000107
s
p50
0.00046
s
<
p95
0.00062
s
<
p99
0.000732
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000348
s
SD
1.7e-05
s
p50
0.000344
s
<
p95
0.000356
s
≤
p99
0.000356
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
42.01
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
81.23
KiB/s
<
mean
152.83
KiB/s
SD
22.42
KiB/s
<
p95
164.67
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
33.18
KiB/s
<
mean
48.35
KiB/s
SD
4.83
KiB/s
<
p95
51.37
KiB/s
Total bytes received
Total bytes received on primary network interface
count
17.91
MiB
mean
152.83
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
5.67
MiB
mean
48.35
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1910.46 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
45.2
%
<
mean
52.46
%
SD
4.34
%
<
p95
64.51
%
System
10.44
%
CPU percentiles
CPU usage percentiles
p50
52.59
%
p95
64.51
%
p99
64.51
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
13.25
%
<
mean
23.37
%
SD
7.05
%
<
p95
34.67
%
Memory available percentage
Percentage of available memory
p5
65.33
%
<
mean
76.63
%
SD
7.05
%
<
p95
86.75
%
Max host memory used
Maximum memory usage percentage across all hosts
max
23.37
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1910.46
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.11
MiB/s
Disk write throughput
Disk write throughput in MiB/s
9.09
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.37
5 min
0.46
15 min
0.16
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
2.32
%
<
mean
14.3408
%
SD
4.2834
%
<
p95
17.06
%
60 second average
8.9800
%
300 second average
2.8800
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
1.5108
%
SD
1.5425
%
<
p95
5.46
%
60 second average
0.7877
%
300 second average
0.2408
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.8485
%
SD
1.2394
%
<
p95
4.8
%
60 second average
0.3931
%
300 second average
0.1123
%
Holochain process CPU usage
CPU usage by Holochain process
p5
42.13
%
<
mean
49.51
%
SD
4.44
%
<
p95
62.06
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
132.04
KiB
<
mean
1.12
MiB
SD
583.48
KiB
<
p95
1.97
MiB
Holochain process threads
Number of threads in Holochain process
p5
15
threads
<
mean
18.15
threads
SD
1.56
threads
<
p95
19
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
61
file descriptors
<
mean
1204.85
file descriptors
SD
562.24
file descriptors
<
p95
1688
file descriptors

Full-Arc Create (Validated) / Zero-Arc Read

↑ Back to index

A full-arc/zero-arc mixed scenario where full-arc nodes create data that gets validated and zero-arc nodes read the data. The scenario has two roles:

  • full: A full-arc conductor that creates entries with a timestamp field. Those entries get validated and then retrieved by zero-arc nodes.
  • zero: A zero-arc conductor that reads the entries created by the full-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Thu, 11 Jun 2026 05:04:14 UTC
Peer count
30
Peer count at end
27
Behaviours
  • full (1 agent)
  • zero (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
full_arc_create_validated_zero_arc_read--high_zero_27317315203_1
Create rate
The number of timed entries created by the full-arc node(s) per second.
Mean
mean
55.77
/s
Max
Highest per-partition mean rate
max
101.69
/s
Min
Lowest per-partition mean rate
min
9.85
/s
Fetch lag timing
For each entry, the time lag between when it was created by a full-arc node and when a zero-arc node fetched it from the network.
Mean
mean
140.529347
s
SD
111.266969
s
Max
Highest per-partition mean latency
max mean
624.232162
s
Min
Lowest per-partition mean latency
min mean
18.021201
s
Fetch rate
The number of entries per second fetched by zero-arc nodes.
Mean
mean
47.94
/s
Max
Highest per-partition mean rate
max
220.65
/s
Min
Lowest per-partition mean rate
min
17.61
/s
Delivery ratio
The proportion of created entries successfully fetched by all zero-arc nodes.
0.1297
Entry created count
Total number of entries created by full-arc nodes, by agent.
Total
10076
Agents affected
2 / 2
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
5038
Max
Highest count in any single partition
9123
Min
Lowest count in any single partition
953
Received count
Total number of entries fetched by zero-arc nodes, by agent.
Total
32659
Agents affected
23 / 25
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
1306
Max
Highest count in any single partition
4579
Min
Lowest count in any single partition
0
Open connections
The number of currently open connections to other conductors.
full-arc
p5
18
<
mean
23.17
SD
2.78
<
p95
24
zero-arc
p5
0
<
mean
9.37
SD
7.07
<
p95
20
Retrieval errors
Errors encountered by zero-arc nodes when attempting to retrieve entries created by full-arc nodes.
Total
188
Agents affected
23 / 25
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
8
Max
Highest count in any single partition
12
Min
Lowest count in any single partition
0
Error count
The number of errors accumulated across all nodes.
188
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.00144
s
SD
0.001845
s
p50
0.000769
s
<
p95
0.005219
s
<
p99
0.008553
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
1
over 818.811115552s
mean rate
0.13
/s
std
0.46
/s
p5
0
/s
p95
0.42
/s
peak
7.28
/s
WASM usage: 'timed_and_validated::create_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
76111002
over 894.866629923s
mean rate
8.128446912e+07
/s
std
3.526659274e+07
/s
p5
1.923390317e+07
/s
p95
1.3173058017e+08
/s
peak
1.3578416037e+08
/s
WASM usage: 'timed_and_validated::get_timed_entries_network'
Metered usage count of the WASM ribosome for this zome function.
total
7786894500
over 37458.177299856s
mean rate
4.50137700562e+10
/s
std
7.84876440387e+10
/s
p5
8.24665466e+06
/s
p95
2.29550994489e+11
/s
peak
4.75481357821e+11
/s
WASM usage: 'timed_and_validated_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
725203710
over 37458.177299856s
mean rate
1.5638259464e+08
/s
std
3.2887998151e+08
/s
p5
650006.18
/s
p95
1.03064664742e+09
/s
peak
1.69094558582e+09
/s
WASM usage: 'timed_and_validated_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37458.177299856s
Not enough time data to show a trend.
Zome call duration: 'timed_and_validated::create_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.0058
s
SD
0.003709
s
p50
0.006423
s
<
p95
0.012801
s
<
p99
0.012817
s
Zome call duration: 'timed_and_validated::get_timed_entries_network'
Duration of this zome call as measured by Holochain internally.
mean
0.038002
s
SD
0.17688
s
p50
0.114907
s
<
p95
0.531243
s
<
p99
0.928059
s
WASM call duration: 'timed_and_validated::create_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005091
s
SD
0.003335
s
p50
0.005697
s
<
p95
0.011388
s
<
p99
0.011402
s
WASM call duration: 'timed_and_validated::get_timed_entries_network'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.044089
s
SD
0.215806
s
p50
0.164114
s
<
p95
0.779639
s
<
p99
0.991861
s
WASM call duration: 'timed_and_validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000913
s
SD
0.000539
s
p50
0.001219
s
<
p95
0.001762
s
<
p99
0.003303
s
WASM call duration: 'timed_and_validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003345
s
SD
0.001399
s
p50
0.000825
s
<
p95
0.005081
s
<
p99
0.006859
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000301
s
SD
0.000258
s
p50
0.000303
s
<
p95
0.000808
s
<
p99
0.000811
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000302
s
SD
0.000273
s
p50
0.000304
s
<
p95
0.000828
s
<
p99
0.000833
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.004634
s
SD
0.054322
s
p50
0.004098
s
<
p95
0.085026
s
<
p99
0.201115
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.006838
s
SD
0.046378
s
p50
0.025874
s
<
p95
0.128679
s
<
p99
0.245295
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.00174
s
SD
0.000804
s
p50
0.001746
s
<
p95
0.003066
s
<
p99
0.003151
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001516
s
SD
0.000891
s
p50
0.001836
s
<
p95
0.003752
s
<
p99
0.005199
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000202
s
SD
0.000205
s
p50
0.000138
s
<
p95
0.000611
s
<
p99
0.001024
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.84
s
<
mean
451.97
s
SD
259.38
s
<
p95
857.49
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 37458.177194763s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
15.133559
s
SD
12.808917
s
p50
0.109603
s
<
p95
3.693378
s
<
p99
83.552449
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.178424
s
SD
0.097269
s
p50
1
s
<
p95
1.114253
s
<
p99
1.540506
s
App validation workflow duration
Time spent running the app validation workflow.
mean
2.055355
s
SD
4.733718
s
p50
0.000584
s
<
p95
1.314467
s
<
p99
29.72893
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001175
s
SD
0.000981
s
p50
0.000788
s
<
p95
0.003227
s
<
p99
0.003297
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.01895
s
SD
0.015758
s
p50
0.000793
s
<
p95
0.002681
s
<
p99
0.101064
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.091716
s
SD
0.019675
s
p50
0.001795
s
<
p95
0.035455
s
<
p99
0.128372
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.376156
s
SD
0.613228
s
p50
0.001324
s
<
p95
0.159997
s
<
p99
1.67502
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.179131
s
SD
0.095589
s
p50
0.000654
s
<
p95
0.096302
s
<
p99
0.625644
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.001207
s
SD
0.002075
s
p50
0.000663
s
<
p95
0.006114
s
<
p99
0.010874
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001371
s
SD
0.001581
s
p50
0.00069
s
<
p95
0.004821
s
<
p99
0.007554
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
8.7e-05
s
SD
8e-05
s
p50
0.000127
s
<
p95
0.000302
s
<
p99
0.000502
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.001333
s
SD
0.001601
s
p50
0.00067
s
<
p95
0.004962
s
<
p99
0.007732
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000113
s
SD
7e-05
s
p50
8.5e-05
s
<
p95
0.000294
s
<
p99
0.000346
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000126
s
SD
6.3e-05
s
p50
0.000135
s
<
p95
0.000273
s
<
p99
0.000344
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00283
s
SD
0.160068
s
p50
0.000276
s
<
p95
0.340346
s
<
p99
1.046582
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000254
s
SD
0.000207
s
p50
0.000369
s
<
p95
0.000848
s
<
p99
0.000953
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.139046
s
SD
29.360045
s
p50
0.115351
s
<
p95
60.001623
s
<
p99
60.00215
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.143926
s
SD
11.50761
s
p50
0.219636
s
<
p95
1.407857
s
<
p99
60.000805
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.424274
s
SD
21.14052
s
p50
4.143861
s
<
p95
60.001004
s
≤
p99
60.001004
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
19.37
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
94
B/s
<
mean
443.57
KiB/s
SD
743.63
KiB/s
<
p95
2.19
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
46
B/s
<
mean
673.29
KiB/s
SD
3.74
MiB/s
<
p95
2.19
MiB/s
Total bytes received
Total bytes received on primary network interface
count
10.25
GiB
mean
11.53
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
15.55
GiB
mean
17.50
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 97.1%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 205.78 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.13
%
<
mean
23.38
%
SD
20.96
%
<
p95
68.41
%
System
4.01
%
CPU percentiles
CPU usage percentiles
p50
18.96
%
p95
68.41
%
p99
97.14
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
10
hosts
mean time
0.08
s
Memory used percentage
Percentage of memory used
p5
7.49
%
<
mean
15.64
%
SD
13.71
%
<
p95
37.16
%
Memory available percentage
Percentage of available memory
p5
62.84
%
<
mean
84.36
%
SD
13.71
%
<
p95
92.51
%
Max host memory used
Maximum memory usage percentage across all hosts
max
78.58
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.04
%
Memory growth rate
Rate of memory growth over time
growth
205.78
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.53
MiB/s
Disk write throughput
Disk write throughput in MiB/s
63.17
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/9
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/6
hosts
Mount Point /etc/hosts
0/6
hosts
Mount Point /etc/resolv.conf
0/6
hosts
Mount Point /nix/store
0/9
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.47
5 min
1.69
15 min
1.72
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
2.1165
%
SD
8.498
%
<
p95
8.1
%
60 second average
2.1266
%
300 second average
3.5401
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
7.0408
%
SD
13.2807
%
<
p95
37.76
%
60 second average
6.8189
%
300 second average
6.4056
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
6.1851
%
SD
11.7994
%
<
p95
33.32
%
60 second average
5.9721
%
300 second average
5.5539
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.27
%
<
mean
20.76
%
SD
20.09
%
<
p95
64.38
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
431.05
KiB
<
mean
529.12
KiB
SD
88.86
KiB
<
p95
678.60
KiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
<
mean
17.37
threads
SD
6.46
threads
<
p95
33
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
54
file descriptors
<
mean
65.73
file descriptors
SD
14.06
file descriptors
<
p95
96
file descriptors

Local Signals

↑ Back to index

This scenario is for testing the speed and reliability of local signals. It uses a zome with a function that will emit 10,000 signals. The scenario measures how long it takes to send the signals and how many have been received by the time the zome call ends.

Started
Thu, 11 Jun 2026 01:22:02 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
local_signals_27317315203_1
Send timing
The time taken to emit a batch of 10,000 signals.
mean
1.590441
s
SD
1.081852
s
p50
1.411331
s
<
p95
3.864993
s
≤
p99
3.864993
s
Receive timing
The time taken to receive the completed batch, to the nearest 250ms.
mean
27.621019
s
SD
7.140295
s
p50
30.001181
s
<
p95
30.001684
s
≤
p99
30.001684
s
Success ratio
The proportion of signals successfully received in a batch.
min
0.8988999724388123
<
mean
0.9471
SD
0.028
<
max
0.9926999807357788
Holochain MetricsClick to toggle visibility.
WASM usage: 'signal::emit_10k_signals'
Metered usage count of the WASM ribosome for this zome function.
total
301963473
over 290.00315446s
mean rate
1.04124214e+06
/s
std
1.55219213e+06
/s
p5
0
/s
p95
3.35512833e+06
/s
peak
3.3551313e+06
/s
Zome call duration: 'signal::emit_10k_signals'
Duration of this zome call as measured by Holochain internally.
mean
0.308508
s
SD
0.009234
s
p50
0.306782
s
<
p95
0.328389
s
≤
p99
0.328389
s
WASM call duration: 'signal::emit_10k_signals'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.307584
s
SD
0.009292
s
p50
0.305863
s
<
p95
0.327714
s
≤
p99
0.327714
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
2.2e-05
s
SD
1e-06
s
p50
2.2e-05
s
<
p95
2.3e-05
s
≤
p99
2.3e-05
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
90000
over 290.003153795s
mean rate
310.34
/s
std
455.62
/s
p5
0
/s
p95
999.99
/s
peak
999.99
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000127
s
SD
0
s
p50
0.000127
s
≤
p95
0.000127
s
≤
p99
0.000127
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.33
s
<
mean
152.33
s
SD
86.56
s
<
p95
287.33
s
Dropped WebSocket signals
Count of signals dropped from the app WebSocket due to channel overload.
total
140
over 290.003113373s
mean rate
0.48
/s
std
1.04
/s
p5
0
/s
p95
2.3
/s
peak
4.9
/s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 290.003116657s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.073256
s
SD
0
s
p50
0.073256
s
≤
p95
0.073256
s
≤
p99
0.073256
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000609
s
SD
0
s
p50
0.000609
s
≤
p95
0.000609
s
≤
p99
0.000609
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001004
s
SD
0
s
p50
0.001004
s
≤
p95
0.001004
s
≤
p99
0.001004
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001165
s
SD
0
s
p50
0.001165
s
≤
p95
0.001165
s
≤
p99
0.001165
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001106
s
SD
6.1e-05
s
p50
0.001108
s
<
p95
0.001231
s
≤
p99
0.001231
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000737
s
SD
0
s
p50
0.000737
s
≤
p95
0.000737
s
≤
p99
0.000737
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000832
s
SD
0
s
p50
0.000832
s
≤
p95
0.000832
s
≤
p99
0.000832
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000212
s
SD
9e-06
s
p50
0.000212
s
<
p95
0.000233
s
≤
p99
0.000233
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
5e-05
s
SD
0
s
p50
5e-05
s
≤
p95
5e-05
s
≤
p99
5e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000129
s
SD
5e-06
s
p50
0.000126
s
<
p95
0.000135
s
≤
p99
0.000135
s
Cache DB connection use time
Time spent holding cache database connections.
mean
9.7e-05
s
SD
0
s
p50
9.7e-05
s
≤
p95
9.7e-05
s
≤
p99
9.7e-05
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
7.8e-05
s
SD
0
s
p50
7.8e-05
s
≤
p95
7.8e-05
s
≤
p99
7.8e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
9.5e-05
s
SD
1.4e-05
s
p50
9.7e-05
s
<
p95
0.000103
s
<
p99
0.000104
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000106
s
SD
0.00816
s
p50
0.000264
s
<
p95
0.020796
s
≤
p99
0.020796
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000439
s
SD
0
s
p50
0.000439
s
≤
p95
0.000439
s
≤
p99
0.000439
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
9.86
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
50
B/s
<
mean
226.81
KiB/s
SD
1.16
MiB/s
≤
p95
9.61
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
17
B/s
<
mean
2.75
KiB/s
SD
10.76
KiB/s
<
p95
6.75
KiB/s
Total bytes received
Total bytes received on primary network interface
count
64.23
MiB
mean
226.81
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
797.51
KiB
mean
2.75
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 552.73 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.75
%
<
mean
14.68
%
SD
18.51
%
<
p95
51.93
%
System
4.83
%
CPU percentiles
CPU usage percentiles
p50
4.65
%
p95
51.93
%
p99
54.41
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
10.11
%
<
mean
12.93
%
SD
2.38
%
<
p95
15.19
%
Memory available percentage
Percentage of available memory
p5
84.81
%
<
mean
87.07
%
SD
2.38
%
<
p95
89.89
%
Max host memory used
Maximum memory usage percentage across all hosts
max
12.93
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
552.73
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
2.02
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
0/1
hosts
Mount Point /etc/hosts
0/1
hosts
Mount Point /etc/resolv.conf
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.43
5 min
0.57
15 min
0.21
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.14
%
<
mean
2.638
%
SD
3.2422
%
<
p95
11.11
%
60 second average
1.7390
%
300 second average
0.6570
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.56
%
<
mean
2.6903
%
SD
2.7247
%
<
p95
9.31
%
60 second average
2.5843
%
300 second average
1.3647
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.12
%
<
mean
2.572
%
SD
2.7212
%
<
p95
9.25
%
60 second average
2.5157
%
300 second average
1.3360
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.15
%
<
mean
3.98
%
SD
7.49
%
<
p95
17.71
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
224.34
KiB
<
mean
225.74
KiB
SD
19.25
KiB
<
p95
237.40
KiB
Holochain process threads
Number of threads in Holochain process
p5
11
threads
<
mean
11.53
threads
SD
2.25
threads
<
p95
13
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
40
file descriptors
<
mean
49.97
file descriptors
SD
13.57
file descriptors
<
p95
67
file descriptors

Mixed Arc get_agent_activity

↑ Back to index

A mixed-arc scenario that measures the DHT's ability to propagate agent activity and make it available via get_agent_activity calls. The scenario has three roles:

  • zero_write: A zero-arc conductor that creates entries on its source chain.
  • full_write: A full-arc conductor that creates entries on its source chain.
  • zero_read: A zero-arc conductor that picks a random writer and repeatedly calls get_agent_activity to observe new entries appearing on the writer's chain, measuring the lag between creation and discovery.
Started
Thu, 11 Jun 2026 05:19:55 UTC
Peer count
30
Peer count at end
25
Behaviours
  • full_write (1 agent)
  • zero_read (1 agent)
  • zero_write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
mixed_arc_get_agent_activity_27317315203_1
Entry created count
The total number of entries created by write agents over the run, partitioned by agent and behaviour.
Total
292314
Agents affected
17 / 17
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
17195
Max
Highest count in any single partition
32729
Min
Lowest count in any single partition
1426
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
6465.5
Max
Highest chain head value observed for any single write agent.
13224
Write agents observed
4
Chain head delay timing
The time lag between when a writer creates a new entry and when a reader discovers it via get_agent_activity. This is measured per new action in the chain.
Mean
mean
0.009606
s
SD
0.385154
s
Max
Highest per-partition mean latency
max mean
0.029092
s
Min
Lowest per-partition mean latency
min mean
-0.006628
s
Chain head delay rate
The rate at which readers detect new chain heads appearing on writers' chains.
Mean
mean
38.42
/s
Max
Highest per-partition mean rate
max
48.99
/s
Min
Lowest per-partition mean rate
min
24.78
/s
get_agent_activity_full zome call timing
The time taken to complete the get_agent_activity_full zome call that queries a writer's chain.
Mean
mean
0.164758
s
SD
0.125117
s
Max
Highest per-partition mean latency
max mean
0.26808
s
Min
Lowest per-partition mean latency
min mean
0.130217
s
Retrieval errors
A running accumulation of errors encountered by read agents when calling get_agent_activity.
Total
29
Agents affected
8 / 8
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
4
Max
Highest count in any single partition
6
Min
Lowest count in any single partition
1
Open connections
The number of currently open connections to other conductors, partitioned by agent behaviour.
  • behaviour: full_write
p5
0
<
mean
20.36
SD
7.95
<
p95
24
  • behaviour: zero_read
p5
6
<
mean
11.74
SD
4.57
<
p95
21
  • behaviour: zero_write
p5
6
<
mean
12.61
SD
3.78
<
p95
18
Final error count
The total number of errors accumulated across all agents over the run.
32
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000314
s
SD
0.00024
s
p50
0.000408
s
<
p95
0.000928
s
≤
p99
0.000928
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
19
over 1844.115077344s
mean rate
1.19
/s
std
2.8
/s
p5
0
/s
p95
7.86
/s
peak
15.46
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.00798
s
SD
0.002705
s
p50
0.008441
s
<
p95
0.013528
s
≤
p99
0.013528
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.003691
s
SD
0.002239
s
p50
0.003634
s
<
p95
0.008946
s
<
p99
0.011714
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.137555
s
SD
0.045037
s
p50
0.131167
s
<
p95
0.24429
s
<
p99
0.266565
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.006952
s
SD
0.00627
s
p50
0.006447
s
<
p95
0.023924
s
≤
p99
0.023924
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006637
s
SD
0.002332
s
p50
0.006963
s
<
p95
0.011989
s
≤
p99
0.011989
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003032
s
SD
0.00186
s
p50
0.00295
s
<
p95
0.007373
s
<
p99
0.009563
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.168945
s
SD
0.06672
s
p50
0.155031
s
<
p95
0.291488
s
<
p99
0.333995
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.025596
s
SD
0.110182
s
p50
0.007377
s
<
p95
0.350851
s
≤
p99
0.350851
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000975
s
SD
0.000624
s
p50
0.001042
s
<
p95
0.002361
s
<
p99
0.003238
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
5.1e-05
s
SD
4.2e-05
s
p50
4.1e-05
s
<
p95
0.000209
s
≤
p99
0.000209
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000299
s
SD
0.000303
s
p50
0.000288
s
<
p95
0.00104
s
<
p99
0.00139
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000574
s
SD
0.000231
s
p50
0.000578
s
<
p95
0.001067
s
≤
p99
0.001067
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.164829
s
SD
0.066842
s
p50
0.152537
s
<
p95
0.288649
s
<
p99
0.331087
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.022357
s
SD
0.108696
s
p50
0.004143
s
<
p95
0.342009
s
≤
p99
0.342009
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
7e-06
s
p50
1e-05
s
<
p95
2.8e-05
s
≤
p99
2.8e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001631
s
SD
0.001357
s
p50
0.002483
s
<
p95
0.005168
s
<
p99
0.007298
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000191
s
SD
0.000241
s
p50
0.000144
s
<
p95
0.000636
s
<
p99
0.001385
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.81
s
<
mean
449.07
s
SD
257.78
s
<
p95
848.56
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
4
over 37458.39794554s
mean rate
73303.93
/s
std
241786.7
/s
p5
0
/s
p95
459103.97
/s
peak
1.26237384e+06
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
18.450393
s
SD
10.987402
s
p50
0.103622
s
<
p95
26.293372
s
<
p99
56.001451
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.480858
s
SD
0.221003
s
p50
1
s
<
p95
1.58198
s
<
p99
1.698904
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.400156
s
SD
1.795914
s
p50
0.001272
s
<
p95
4.584165
s
<
p99
9.743847
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001173
s
SD
0.001204
s
p50
0.000665
s
<
p95
0.003877
s
<
p99
0.005406
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.004649
s
SD
0.01642
s
p50
0.000443
s
<
p95
0.043904
s
<
p99
0.068102
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.097708
s
SD
2.058181
s
p50
0.052624
s
<
p95
6.271023
s
<
p99
7.270442
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.561958
s
SD
6.964622
s
p50
0.001306
s
<
p95
19.097546
s
<
p99
28.02875
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.259791
s
SD
13.83312
s
p50
0.000795
s
<
p95
49.603333
s
<
p99
71.438739
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.002349
s
SD
0.003068
s
p50
0.000671
s
<
p95
0.008707
s
<
p99
0.017957
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.00178
s
SD
0.002806
s
p50
0.00013
s
<
p95
0.007783
s
<
p99
0.015668
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000143
s
SD
0.000148
s
p50
0.000166
s
<
p95
0.000433
s
<
p99
0.000879
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000122
s
SD
0.000194
s
p50
0.000133
s
<
p95
0.000724
s
<
p99
0.000796
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.00015
s
SD
0.000202
s
p50
8.7e-05
s
<
p95
0.000827
s
<
p99
0.00085
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000124
s
SD
0.000127
s
p50
0.000107
s
<
p95
0.000318
s
<
p99
0.000728
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002655
s
SD
0.011662
s
p50
0.000329
s
<
p95
0.025794
s
<
p99
0.048285
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00027
s
SD
0.000209
s
p50
0.000275
s
<
p95
0.000701
s
<
p99
0.00127
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
8.933137
s
SD
29.648886
s
p50
0.150978
s
<
p95
60.010085
s
<
p99
60.011111
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.092067
s
SD
23.437683
s
p50
0.121265
s
<
p95
60.001053
s
≤
p99
60.001053
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.229545
s
SD
29.08675
s
p50
0.152987
s
<
p95
60.001613
s
<
p99
60.001724
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.382575
s
SD
1.350763
s
p50
0.324217
s
<
p95
1.012504
s
<
p99
10.106221
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
18.53
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
127
B/s
<
mean
363.42
KiB/s
SD
566.20
KiB/s
<
p95
1.51
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
29
B/s
<
mean
478.24
KiB/s
SD
1.05
MiB/s
<
p95
3.03
MiB/s
Total bytes received
Total bytes received on primary network interface
count
8.39
GiB
mean
9.44
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
11.04
GiB
mean
12.43
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 95.1%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 311.01 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 4% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.63
%
<
mean
23.94
%
SD
25.21
%
<
p95
81.48
%
System
5.40
%
CPU percentiles
CPU usage percentiles
p50
12.85
%
p95
81.48
%
p99
95.14
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
4
hosts
mean time
0.35
s
Memory used percentage
Percentage of memory used
p5
5.91
%
<
mean
13.53
%
SD
13.66
%
<
p95
32.08
%
Memory available percentage
Percentage of available memory
p5
67.92
%
<
mean
86.47
%
SD
13.66
%
<
p95
94.09
%
Max host memory used
Maximum memory usage percentage across all hosts
max
77.51
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.04
%
Memory growth rate
Rate of memory growth over time
growth
311.01
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.56
MiB/s
Disk write throughput
Disk write throughput in MiB/s
131.84
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/8
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/7
hosts
Mount Point /etc/hosts
0/7
hosts
Mount Point /etc/resolv.conf
0/7
hosts
Mount Point /nix/store
0/8
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.97
5 min
1.89
15 min
1.75
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
3.70
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
5.5814
%
SD
11.8082
%
<
p95
32.66
%
60 second average
5.5588
%
300 second average
5.0340
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0004
%
SD
0.0202
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0004
%
SD
0.0202
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
9.7131
%
SD
17.6144
%
<
p95
47.63
%
60 second average
9.5298
%
300 second average
8.7278
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
8.3347
%
SD
15.7704
%
<
p95
45.34
%
60 second average
8.1669
%
300 second average
7.4596
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.15
%
<
mean
20.02
%
SD
24.3
%
<
p95
77.74
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
203.66
KiB
<
mean
276.28
KiB
SD
105.34
KiB
<
p95
489.93
KiB
Holochain process threads
Number of threads in Holochain process
p5
11
threads
<
mean
20.55
threads
SD
10.96
threads
<
p95
45
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
45
file descriptors
<
mean
61.91
file descriptors
SD
18.28
file descriptors
<
p95
88
file descriptors

Mixed Arc must_get_agent_activity

↑ Back to index

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Write Validated must_get_agent_activity, but some write agents are zero-arc and all must_get_agent_activity agents are zero-arc. This forces the must_get_agent_activity host call to go to the network.

Started
Thu, 11 Jun 2026 05:35:42 UTC
Peer count
30
Peer count at end
26
Behaviours
  • full_write (1 agent)
  • zero_must_get_agent_activity (1 agent)
  • zero_write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
mixed_arc_must_get_agent_activity_27317315203_1
Highest observed action_seq
The maximum chain length observed per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1842
Max
Highest chain head value observed for any single write agent.
1886
Write agents observed
4
Chain batch delay timing
The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.
Mean
mean
4.915647
s
SD
9.11028
s
Max
Highest per-partition mean latency
max mean
7.213
s
Min
Lowest per-partition mean latency
min mean
2.14386
s
Chain batch delay rate
The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.
Mean
mean
2.03
/s
Max
Highest per-partition mean rate
max
2.17
/s
Min
Lowest per-partition mean rate
min
1.91
/s
create_validated_sample_entry zome call timing
The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.
Mean
mean
0.318635
s
SD
0.248078
s
Max
Highest per-partition mean latency
max mean
0.501093
s
Min
Lowest per-partition mean latency
min mean
0.227615
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.
Total
5429
Agents affected
8 / 8
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
679
Max
Highest count in any single partition
835
Min
Lowest count in any single partition
542
Open connections
The average number of open connections maintained by an agent over the run, broken down by behaviour.
  • behaviour: full_write
p5
18
<
mean
23.54
SD
1.75
<
p95
24
  • behaviour: zero_must_get_agent_activity
p5
0
<
mean
14.94
SD
6.33
<
p95
21
  • behaviour: zero_write
p5
0
<
mean
12.74
SD
6.04
<
p95
23
Final error count
The total number of all types of error accumulated over the run by all agents.
21208
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000358
s
SD
0.000371
s
p50
0.000666
s
<
p95
0.001301
s
<
p99
0.001666
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 520.689876106s
Not enough time data to show a trend.
WASM usage: 'validated_must_get_agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 1898.999751655s
Not enough time data to show a trend.
WASM usage: 'validated_must_get_agent_activity::create_sample_entries_batch'
Metered usage count of the WASM ribosome for this zome function.
total
4801651571
over 1898.999751655s
mean rate
1.19072802302e+09
/s
std
3.50253993659e+09
/s
p5
0
/s
p95
7.76657709451e+09
/s
peak
2.23555669017e+10
/s
WASM usage: 'validated_must_get_agent_activity::create_validated_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
50560962
over 907.778357279s
mean rate
1.820884444e+07
/s
std
3.410209364e+07
/s
p5
130879.14
/s
p95
1.1238364224e+08
/s
peak
1.387992984e+08
/s
WASM usage: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Metered usage count of the WASM ribosome for this zome function.
total
358703502
over 907.778357279s
mean rate
4.350904353e+07
/s
std
6.803987411e+07
/s
p5
352514.41
/s
p95
2.2935459973e+08
/s
peak
2.8154817032e+08
/s
WASM usage: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
12504754168
over 37457.67308969s
mean rate
6.109829973e+07
/s
std
1.1422000115e+08
/s
p5
72415.88
/s
p95
2.8842379659e+08
/s
peak
2.88645154e+08
/s
WASM usage: 'validated_must_get_agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
1021604464
over 37457.67308969s
mean rate
1.37048001681e+09
/s
std
3.42789324658e+09
/s
p5
0
/s
p95
7.38992314202e+09
/s
peak
2.13533434408e+10
/s
WASM usage: 'validated_must_get_agent_activity_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37457.67308969s
Not enough time data to show a trend.
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.008679
s
SD
0.002353
s
p50
0.009356
s
<
p95
0.011823
s
≤
p99
0.011823
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.05855
s
SD
0.012903
s
p50
0.054389
s
<
p95
0.079787
s
<
p99
0.10467
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.007641
s
SD
0.002599
s
p50
0.007974
s
<
p95
0.012439
s
<
p99
0.012527
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.131075
s
SD
0.037744
s
p50
0.133288
s
<
p95
0.179687
s
<
p99
0.217127
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.00361
s
SD
0.073224
s
p50
0.008381
s
<
p95
0.198187
s
≤
p99
0.198187
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.007213
s
SD
0.002002
s
p50
0.007753
s
<
p95
0.01001
s
≤
p99
0.01001
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.057406
s
SD
0.012776
s
p50
0.053213
s
<
p95
0.078341
s
<
p99
0.103194
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006309
s
SD
0.002215
s
p50
0.006576
s
<
p95
0.010287
s
<
p99
0.010361
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.199347
s
SD
0.033382
s
p50
0.190543
s
<
p95
0.260446
s
<
p99
0.262573
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003001
s
SD
0.07297
s
p50
0.007693
s
<
p95
0.196977
s
≤
p99
0.196977
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001107
s
SD
0.000638
s
p50
0.001185
s
<
p95
0.002727
s
<
p99
0.003383
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005646
s
SD
0.024443
s
p50
0.003161
s
<
p95
0.069246
s
<
p99
0.084622
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.3e-05
s
SD
5.9e-05
s
p50
3.6e-05
s
<
p95
7.6e-05
s
<
p99
0.000386
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000448
s
SD
0.000145
s
p50
0.000452
s
<
p95
0.000747
s
<
p99
0.00093
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000421
s
SD
0.000198
s
p50
0.000498
s
<
p95
0.000988
s
<
p99
0.001043
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.020387
s
SD
0.085682
s
p50
0.156861
s
<
p95
0.23584
s
<
p99
0.255915
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.176032
s
SD
0.04256
s
p50
0.161549
s
<
p95
0.2309
s
<
p99
0.289792
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.007449
s
SD
0.00361
s
p50
0.005472
s
<
p95
0.011856
s
<
p99
0.0207
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
6e-06
s
p50
1.1e-05
s
<
p95
2.1e-05
s
≤
p99
2.1e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001848
s
SD
0.001161
s
p50
0.002617
s
<
p95
0.005126
s
<
p99
0.005421
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000263
s
SD
0.000207
s
p50
0.000183
s
<
p95
0.00063
s
<
p99
0.001153
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
48.23
s
<
mean
456.08
s
SD
262.07
s
<
p95
865.6
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 37457.67299839s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
8.584413
s
SD
13.84584
s
p50
0.133138
s
<
p95
8.842017
s
<
p99
86.659945
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.877485
s
SD
0.407619
s
p50
1
s
<
p95
1.887362
s
<
p99
1.893664
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.828787
s
SD
10.495741
s
p50
0.001119
s
<
p95
2.565775
s
<
p99
85.169302
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001307
s
SD
0.001668
s
p50
0.000673
s
<
p95
0.003987
s
<
p99
0.008438
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.015111
s
SD
0.014173
s
p50
0.000411
s
<
p95
0.015845
s
<
p99
0.082651
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.015073
s
SD
0.052551
s
p50
0.010111
s
<
p95
0.194094
s
<
p99
0.234444
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.238828
s
SD
0.140754
s
p50
0.001283
s
<
p95
0.299241
s
<
p99
0.491709
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
8.977135
s
SD
10.95268
s
p50
0.001035
s
<
p95
22.524127
s
<
p99
59.556016
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.00021
s
SD
0.000182
s
p50
0.000311
s
<
p95
0.000721
s
<
p99
0.000913
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001081
s
SD
0.000688
s
p50
0.000293
s
<
p95
0.001466
s
<
p99
0.004503
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000107
s
SD
6.8e-05
s
p50
0.000189
s
<
p95
0.000333
s
<
p99
0.000443
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000267
s
SD
0.000344
s
p50
0.00012
s
<
p95
0.001038
s
<
p99
0.001442
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
9.8e-05
s
SD
7.6e-05
s
p50
8.6e-05
s
<
p95
0.000146
s
<
p99
0.000468
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000128
s
SD
6.8e-05
s
p50
0.000113
s
<
p95
0.000278
s
<
p99
0.000411
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001303
s
SD
0.214081
s
p50
0.000343
s
<
p95
0.359021
s
<
p99
1.332045
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000297
s
SD
0.000124
s
p50
0.000359
s
<
p95
0.000554
s
<
p99
0.000795
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.100658
s
SD
4.136491
s
p50
0.114328
s
<
p95
0.15926
s
<
p99
0.199545
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.123979
s
SD
17.60859
s
p50
0.111427
s
<
p95
60.000797
s
<
p99
60.00133
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
0.185661
s
SD
14.718561
s
p50
0.168734
s
<
p95
60.001002
s
<
p99
60.001331
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.433377
s
SD
1.585118
s
p50
0.390027
s
<
p95
0.649598
s
<
p99
11.366012
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
8.76
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
225
B/s
<
mean
84.69
KiB/s
SD
145.19
KiB/s
<
p95
262.96
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
46
B/s
<
mean
120.50
KiB/s
SD
261.23
KiB/s
<
p95
585.11
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.98
GiB
mean
2.18
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.81
GiB
mean
3.10
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 160.91 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 4% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.7
%
<
mean
12.71
%
SD
16.72
%
<
p95
42.36
%
System
3.95
%
CPU percentiles
CPU usage percentiles
p50
5.44
%
p95
42.36
%
p99
84.30
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
3
hosts
mean time
0.14
s
Memory used percentage
Percentage of memory used
p5
7.27
%
<
mean
15.59
%
SD
13.15
%
<
p95
36
%
Memory available percentage
Percentage of available memory
p5
64
%
<
mean
84.41
%
SD
13.15
%
<
p95
92.73
%
Max host memory used
Maximum memory usage percentage across all hosts
max
76.22
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.04
%
Memory growth rate
Rate of memory growth over time
growth
160.91
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.07
MiB/s
Disk write throughput
Disk write throughput in MiB/s
75.62
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/9
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/7
hosts
Mount Point /etc/hosts
0/7
hosts
Mount Point /etc/resolv.conf
0/7
hosts
Mount Point /nix/store
0/9
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.72
5 min
0.98
15 min
1.31
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
3.70
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
1.7405
%
SD
6.9344
%
<
p95
5.44
%
60 second average
1.8069
%
300 second average
2.5763
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
2.2752
%
SD
7.1596
%
<
p95
8.33
%
60 second average
2.6562
%
300 second average
4.5184
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
2.0826
%
SD
6.6017
%
<
p95
8.12
%
60 second average
2.4231
%
300 second average
3.9899
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.37
%
<
mean
10.24
%
SD
15.67
%
<
p95
39.79
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
434.41
KiB
<
mean
504.96
KiB
SD
66.49
KiB
<
p95
603.82
KiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
<
mean
23.38
threads
SD
14.26
threads
<
p95
57
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
54
file descriptors
<
mean
70.14
file descriptors
SD
16.37
file descriptors
<
p95
106
file descriptors

Remote Call Rate

↑ Back to index

Test the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

Started
Thu, 11 Jun 2026 01:23:56 UTC
Peer count
10
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
remote_call_rate_27317315203_1
Dispatch timing
The time between sending a remote call and the remote handler being invoked.
Mean
mean
-41.915828
s
SD
200.820659
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
-61.805524
s
Round-trip timing
The total elapsed time to get a response to the client.
Mean
mean
0.109976
s
SD
0.096483
s
Max
Highest per-partition mean latency
max mean
0.181185
s
Min
Lowest per-partition mean latency
min mean
0.074502
s
Error count
The total number of errors accumulated during the run.
7968
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_call::call_echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
54307324
over 1906.173744137s
mean rate
6.476614792e+07
/s
std
7.704982534e+07
/s
p5
0
/s
p95
2.2859710622e+08
/s
peak
2.7872431672e+08
/s
WASM usage: 'remote_call::echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
46373796
over 895.287573639s
mean rate
2.23332148e+06
/s
std
2.67599143e+06
/s
p5
209900.02
/s
p95
8.5360285e+06
/s
peak
9.99589315e+06
/s
WASM usage: 'remote_call::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37467.423688163s
Not enough time data to show a trend.
Zome call duration: 'remote_call::call_echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.105485
s
SD
0.03935
s
p50
0.10509
s
<
p95
0.196363
s
<
p99
0.205351
s
Zome call duration: 'remote_call::echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.002998
s
SD
0.00077
s
p50
0.003238
s
<
p95
0.004
s
<
p99
0.004013
s
WASM call duration: 'remote_call::call_echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.102256
s
SD
0.039774
s
p50
0.107878
s
<
p95
0.192439
s
<
p99
0.200079
s
WASM call duration: 'remote_call::echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001935
s
SD
0.000537
s
p50
0.002109
s
<
p95
0.002617
s
<
p99
0.002656
s
WASM call duration: 'remote_call::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001533
s
SD
0.000162
s
p50
0.001544
s
<
p95
0.0018
s
≤
p99
0.0018
s
Host function call duration: '__hc__call_1'
Duration of this host function call invoked from within WASM.
mean
0.099733
s
SD
0.040216
s
p50
0.105885
s
<
p95
0.191084
s
<
p99
0.198655
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000245
s
SD
2.3e-05
s
p50
0.000245
s
<
p95
0.000283
s
≤
p99
0.000283
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
1.6e-05
s
SD
6e-06
s
p50
1.6e-05
s
<
p95
2.6e-05
s
<
p99
2.7e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000371
s
SD
0.000119
s
p50
0.000263
s
<
p95
0.000449
s
<
p99
0.000503
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000165
s
SD
6.2e-05
s
p50
0.000151
s
<
p95
0.000249
s
≤
p99
0.000249
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.62
s
<
mean
451.05
s
SD
258.85
s
<
p95
857.19
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
2.425849
s
SD
1.28109
s
p50
1.979814
s
<
p95
4.104823
s
≤
p99
4.104823
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.864401
s
SD
0.376606
s
p50
1.901099
s
<
p95
1.923077
s
≤
p99
1.923077
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.12631
s
SD
0.147931
s
p50
0.010324
s
<
p95
0.383048
s
≤
p99
0.383048
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001092
s
SD
0.00061
s
p50
0.000933
s
<
p95
0.002532
s
≤
p99
0.002532
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001457
s
SD
0.001428
s
p50
0.000995
s
<
p95
0.005356
s
≤
p99
0.005356
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001158
s
SD
0.000409
s
p50
0.000993
s
<
p95
0.001774
s
<
p99
0.001885
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.484642
s
SD
0.345127
s
p50
0.61632
s
<
p95
0.858698
s
≤
p99
0.858698
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.227251
s
SD
0.190755
s
p50
0.15052
s
<
p95
0.527606
s
≤
p99
0.527606
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000208
s
SD
5.2e-05
s
p50
0.000216
s
<
p95
0.000268
s
<
p99
0.000272
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
6.6e-05
s
SD
2.4e-05
s
p50
6.2e-05
s
<
p95
0.000103
s
<
p99
0.000111
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000198
s
SD
5.5e-05
s
p50
0.000188
s
<
p95
0.000257
s
<
p99
0.000259
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000219
s
SD
0.000123
s
p50
0.000154
s
<
p95
0.00042
s
≤
p99
0.00042
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.3e-05
s
SD
2.6e-05
s
p50
8.3e-05
s
<
p95
0.000136
s
≤
p99
0.000136
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000132
s
SD
4.3e-05
s
p50
0.000144
s
<
p95
0.00019
s
<
p99
0.000204
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000415
s
SD
0.008554
s
p50
0.000458
s
<
p95
0.022717
s
<
p99
0.034605
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000389
s
SD
9.1e-05
s
p50
0.000381
s
<
p95
0.000495
s
<
p99
0.000498
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.121101
s
SD
0.054364
s
p50
0.099599
s
<
p95
0.190883
s
≤
p99
0.190883
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.105558
s
SD
0.029102
s
p50
0.100955
s
<
p95
0.165121
s
≤
p99
0.165121
s
P2P request roundtrip: 'call_remote'
Time spent sending a call_remote request and awaiting its response.
mean
0.099207
s
SD
0.040318
s
p50
0.105466
s
<
p95
0.190827
s
<
p99
0.198389
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
13.50
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
75
B/s
<
mean
92.12
KiB/s
SD
631.30
KiB/s
≤
p95
31.26
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
54
B/s
<
mean
19.92
KiB/s
SD
15.98
KiB/s
<
p95
43.38
KiB/s
Total bytes received
Total bytes received on primary network interface
count
723.30
MiB
mean
822.95
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
156.37
MiB
mean
177.91
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1070.05 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.3
%
<
mean
19.81
%
SD
19.78
%
<
p95
48.12
%
System
6.31
%
CPU percentiles
CPU usage percentiles
p50
8.27
%
p95
48.12
%
p99
60.94
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
2
hosts
mean time
0.02
s
Memory used percentage
Percentage of memory used
p5
5.84
%
<
mean
15.84
%
SD
9.8
%
<
p95
39.84
%
Memory available percentage
Percentage of available memory
p5
60.16
%
<
mean
84.16
%
SD
9.8
%
<
p95
94.16
%
Max host memory used
Maximum memory usage percentage across all hosts
max
40.57
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1070.05
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.01
MiB/s
Disk write throughput
Disk write throughput in MiB/s
24.57
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/3
hosts
Mount Point /efi-boot
0/2
hosts
Mount Point /etc/hostname
0/4
hosts
Mount Point /etc/hosts
0/4
hosts
Mount Point /etc/resolv.conf
0/4
hosts
Mount Point /nix/store
0/3
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.17
5 min
0.83
15 min
0.42
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
2.392
%
SD
4.3291
%
<
p95
8.35
%
60 second average
2.2687
%
300 second average
1.5876
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
4.2138
%
SD
9.1446
%
<
p95
28.12
%
60 second average
4.0635
%
300 second average
2.7729
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
3.4078
%
SD
7.9279
%
<
p95
24.83
%
60 second average
3.3193
%
300 second average
2.3177
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.15
%
<
mean
8.66
%
SD
8.59
%
<
p95
22.45
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
174.50
KiB
<
mean
230.27
KiB
SD
66.17
KiB
<
p95
344.25
KiB
Holochain process threads
Number of threads in Holochain process
p5
11
threads
<
mean
16.4
threads
SD
3.45
threads
<
p95
21
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
40
file descriptors
<
mean
54.21
file descriptors
SD
13.93
file descriptors
<
p95
82
file descriptors

Remote Signals

↑ Back to index

This scenario tests the throughput of remote_signals operations.

Started
Thu, 11 Jun 2026 01:25:57 UTC
Peer count
10
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
remote_signals_27317315203_1
Round trip time
The time from origin signal dispatch to origin receive of the remote side's response signal.
mean
0.158924
s
SD
0.548967
s
p50
0.130653
s
<
p95
0.252687
s
<
p99
0.306245
s
Timeout rate
The proportion of remote signal round-trips that timed out.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_signal::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 896.474553794s
Not enough time data to show a trend.
WASM usage: 'remote_signal::recv_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
36965439
over 896.474553794s
mean rate
6.6188949987e+08
/s
std
8.50000888999e+09
/s
p5
0
/s
p95
5.5550641309e+08
/s
peak
1.75346590909e+11
/s
WASM usage: 'remote_signal::signal_request'
Metered usage count of the WASM ribosome for this zome function.
total
15628375
over 896.474553794s
mean rate
8.01554411e+07
/s
std
1.35739583671e+09
/s
p5
0
/s
p95
4.367921783e+07
/s
peak
3.38276515152e+10
/s
Zome call duration: 'remote_signal::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.002848
s
SD
0.000771
s
p50
0.002579
s
<
p95
0.004112
s
<
p99
0.004123
s
Zome call duration: 'remote_signal::signal_request'
Duration of this zome call as measured by Holochain internally.
mean
0.002837
s
SD
0.000744
s
p50
0.002673
s
<
p95
0.004084
s
<
p99
0.004097
s
WASM call duration: 'remote_signal::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003147
s
SD
0.002425
s
p50
0.001894
s
<
p95
0.008449
s
≤
p99
0.008449
s
WASM call duration: 'remote_signal::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001842
s
SD
0.000516
s
p50
0.001611
s
<
p95
0.00269
s
<
p99
0.002699
s
WASM call duration: 'remote_signal::signal_request'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001809
s
SD
0.000495
s
p50
0.001674
s
<
p95
0.002635
s
<
p99
0.002644
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000547
s
SD
0.000645
s
p50
0.000263
s
<
p95
0.002386
s
≤
p99
0.002386
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
5.8e-05
s
SD
1.6e-05
s
p50
5.8e-05
s
<
p95
7.9e-05
s
<
p99
8.4e-05
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
6.2e-05
s
SD
1.8e-05
s
p50
6.5e-05
s
<
p95
8.8e-05
s
<
p99
8.9e-05
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
1.2e-05
s
SD
5e-06
s
p50
9e-06
s
<
p95
2e-05
s
≤
p99
2e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001295
s
SD
0.001653
s
p50
0.00046
s
<
p95
0.004707
s
≤
p99
0.004707
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
1745
over 896.474674707s
mean rate
56007.73
/s
std
690360.69
/s
p5
0
/s
p95
47707.65
/s
peak
1.510574018e+07
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
1746
over 896.474628396s
mean rate
216520.04
/s
std
4.05187679e+06
/s
p5
0
/s
p95
54439.54
/s
peak
9.090909091e+07
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000308
s
SD
0.000335
s
p50
0.000204
s
<
p95
0.00129
s
≤
p99
0.00129
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.24
s
<
mean
450.25
s
SD
258.95
s
<
p95
856.04
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
91
over 896.474611604s
mean rate
17226.19
/s
std
125013.36
/s
p5
0
/s
p95
60.39
/s
peak
1.65016502e+06
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
4.651305
s
SD
2.109354
s
p50
4.873398
s
<
p95
8.615911
s
<
p99
10.27296
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.963346
s
SD
0.105448
s
p50
1.961538
s
<
p95
2
s
≤
p99
2
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.286643
s
SD
0.639669
s
p50
0.454596
s
<
p95
1.473769
s
<
p99
3.167733
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002051
s
SD
0.002305
s
p50
0.00115
s
<
p95
0.007875
s
≤
p99
0.007875
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.00257
s
SD
0.00334
s
p50
0.001267
s
<
p95
0.01193
s
<
p99
0.012638
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001959
s
SD
0.001437
s
p50
0.001933
s
<
p95
0.005254
s
≤
p99
0.005254
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.574482
s
SD
0.639339
s
p50
0.727933
s
<
p95
1.556835
s
<
p99
3.860794
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.621297
s
SD
0.259213
s
p50
0.607097
s
<
p95
1.127615
s
<
p99
1.202161
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000199
s
SD
6.6e-05
s
p50
0.000212
s
<
p95
0.000261
s
<
p99
0.000355
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
9.3e-05
s
SD
5.1e-05
s
p50
0.000112
s
<
p95
0.000184
s
<
p99
0.00023
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000176
s
SD
6.4e-05
s
p50
0.000187
s
<
p95
0.000257
s
<
p99
0.000372
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000369
s
SD
0.000367
s
p50
0.000212
s
<
p95
0.001033
s
<
p99
0.001449
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000203
s
SD
0.000306
s
p50
9.6e-05
s
<
p95
0.00111
s
≤
p99
0.00111
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000204
s
SD
0.000113
s
p50
0.00021
s
<
p95
0.000371
s
<
p99
0.000701
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000262
s
SD
0.012837
s
p50
0.000514
s
<
p95
0.03265
s
<
p99
0.06686
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00049
s
SD
0.000169
s
p50
0.000492
s
<
p95
0.000683
s
<
p99
0.000959
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.118856
s
SD
0.037201
s
p50
0.128296
s
<
p95
0.164767
s
<
p99
0.201831
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.140634
s
SD
0.051988
s
p50
0.161606
s
<
p95
0.26059
s
≤
p99
0.26059
s
P2P received remote signals
Count of remote signals received.
total
1746
over 896.474379443s
mean rate
41053.02
/s
std
599799.75
/s
p5
0
/s
p95
87263.84
/s
peak
1.346801347e+07
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
4.70
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
7.48
KiB/s
<
mean
108.95
KiB/s
SD
718.38
KiB/s
≤
p95
36.69
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
9.38
KiB/s
<
mean
25.26
KiB/s
SD
17.26
KiB/s
<
p95
51.43
KiB/s
Total bytes received
Total bytes received on primary network interface
count
474.51
MiB
mean
539.89
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
110.00
MiB
mean
125.16
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 463.27 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.27
%
<
mean
7.01
%
SD
10.4
%
<
p95
20.77
%
System
2.32
%
CPU percentiles
CPU usage percentiles
p50
3.62
%
p95
20.77
%
p99
59.40
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
3
hosts
mean time
0.01
s
Memory used percentage
Percentage of memory used
p5
13.94
%
<
mean
21.72
%
SD
10.41
%
<
p95
43.75
%
Memory available percentage
Percentage of available memory
p5
56.25
%
<
mean
78.28
%
SD
10.41
%
<
p95
86.06
%
Max host memory used
Maximum memory usage percentage across all hosts
max
41.66
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
463.27
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
8.59
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/2
hosts
Mount Point /efi-boot
0/2
hosts
Mount Point /etc/hostname
0/2
hosts
Mount Point /etc/hosts
0/2
hosts
Mount Point /etc/resolv.conf
0/2
hosts
Mount Point /nix/store
0/2
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.51
5 min
0.41
15 min
0.22
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
1.2999
%
SD
5.8743
%
<
p95
2.13
%
60 second average
1.2918
%
300 second average
1.1550
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
2.6737
%
SD
6.9442
%
<
p95
22.22
%
60 second average
2.6729
%
300 second average
2.2339
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
2.4035
%
SD
6.2162
%
<
p95
19.52
%
60 second average
2.3998
%
300 second average
2.0072
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.14
%
<
mean
2.7
%
SD
5.97
%
<
p95
12.73
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
174.30
KiB
<
mean
202.56
KiB
SD
51.08
KiB
<
p95
344.24
KiB
Holochain process threads
Number of threads in Holochain process
p5
14
threads
<
mean
18.95
threads
SD
3.95
threads
<
p95
25
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
46
file descriptors
<
mean
53.86
file descriptors
SD
12.98
file descriptors
<
p95
76
file descriptors

Single-write, many-read

↑ Back to index

Creates an entry in the agent setup, then read one's own record back. This tests the maximum read performance for reading back local data when the chain is short.

Started
Thu, 11 Jun 2026 01:27:48 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
single_write_many_read_27317315203_1
read call timing
The time it takes to complete the zome call that retrieves the record.
mean
0.004095
s
SD
0.000731
s
p50
0.004138
s
<
p95
0.004915
s
<
p99
0.006202
s
read call rate
The number of read zome calls completed per second.
mean
2433.32
/s
Error count
The number of errors collected.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.0004
s
SD
3.5e-05
s
p50
0.000401
s
<
p95
0.000418
s
<
p99
0.000589
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.002004291s
Not enough time data to show a trend.
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
3255390704
over 280.002004291s
mean rate
1.162631319e+07
/s
std
1.04822019e+06
/s
p5
9.93979566e+06
/s
p95
1.316385765e+07
/s
peak
1.401528225e+07
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.002004291s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.002004291s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.003612
s
SD
0
s
p50
0.003612
s
≤
p95
0.003612
s
≤
p99
0.003612
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.002468
s
SD
0.000218
s
p50
0.002475
s
<
p95
0.002586
s
<
p99
0.003658
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003053
s
SD
0
s
p50
0.003053
s
≤
p95
0.003053
s
≤
p99
0.003053
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001835
s
SD
0.000163
s
p50
0.00184
s
<
p95
0.001924
s
<
p99
0.002727
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001202
s
SD
0
s
p50
0.001202
s
≤
p95
0.001202
s
≤
p99
0.001202
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00092
s
SD
0
s
p50
0.00092
s
≤
p95
0.00092
s
≤
p99
0.00092
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.00027
s
SD
3e-06
s
p50
0.000273
s
≤
p95
0.000273
s
≤
p99
0.000273
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000442
s
SD
3.8e-05
s
p50
0.000443
s
<
p95
0.000462
s
<
p99
0.00065
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001641
s
SD
0
s
p50
0.001641
s
≤
p95
0.001641
s
≤
p99
0.001641
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.00017
s
SD
0
s
p50
0.00017
s
≤
p95
0.00017
s
≤
p99
0.00017
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.51
s
<
mean
148.51
s
SD
83.67
s
<
p95
278.51
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.002032868s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.028805
s
SD
0
s
p50
0.028805
s
≤
p95
0.028805
s
≤
p99
0.028805
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000357
s
SD
0
s
p50
0.000357
s
≤
p95
0.000357
s
≤
p99
0.000357
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.00061
s
SD
0
s
p50
0.00061
s
≤
p95
0.00061
s
≤
p99
0.00061
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000588
s
SD
0
s
p50
0.000588
s
≤
p95
0.000588
s
≤
p99
0.000588
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.000681
s
SD
1.7e-05
s
p50
0.000674
s
<
p95
0.000716
s
≤
p99
0.000716
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000647
s
SD
0
s
p50
0.000647
s
≤
p95
0.000647
s
≤
p99
0.000647
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000269
s
SD
0
s
p50
0.000269
s
≤
p95
0.000269
s
≤
p99
0.000269
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000168
s
SD
1.5e-05
s
p50
0.000169
s
<
p95
0.000176
s
<
p99
0.00025
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000329
s
SD
2.7e-05
s
p50
0.000331
s
<
p95
0.000334
s
≤
p99
0.000334
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000115
s
SD
1.2e-05
s
p50
0.000116
s
<
p95
0.000122
s
<
p99
0.00018
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000345
s
SD
3e-05
s
p50
0.000346
s
<
p95
0.000361
s
<
p99
0.00051
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000114
s
SD
0
s
p50
0.000114
s
≤
p95
0.000114
s
≤
p99
0.000114
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
8.8e-05
s
SD
3e-06
s
p50
8.8e-05
s
<
p95
9e-05
s
<
p99
9.1e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00016
s
SD
0.008437
s
p50
0.000169
s
<
p95
0.021239
s
≤
p99
0.021239
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000243
s
SD
0
s
p50
0.000243
s
≤
p95
0.000243
s
≤
p99
0.000243
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
18.79
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
15.02
KiB/s
<
mean
76.87
KiB/s
SD
307.17
KiB/s
≤
p95
26.37
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
17.26
KiB/s
<
mean
21.56
KiB/s
SD
2.53
KiB/s
<
p95
24.66
KiB/s
Total bytes received
Total bytes received on primary network interface
count
21.77
MiB
mean
76.87
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
6.11
MiB
mean
21.56
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
27.81
%
<
mean
28.99
%
SD
3.55
%
<
p95
29.37
%
System
10.20
%
CPU percentiles
CPU usage percentiles
p50
28.24
%
p95
29.37
%
p99
47.68
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
8.16
%
<
mean
8.49
%
SD
0.36
%
<
p95
9.49
%
Memory available percentage
Percentage of available memory
p5
90.51
%
<
mean
91.51
%
SD
0.36
%
<
p95
91.84
%
Max host memory used
Maximum memory usage percentage across all hosts
max
8.49
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-62.94
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
1.73
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.10
5 min
0.56
15 min
0.22
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.2
%
<
mean
0.5483
%
SD
0.3216
%
<
p95
1.12
%
60 second average
0.5043
%
300 second average
0.2713
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
22.33
%
<
mean
23.26
%
SD
3.67
%
≤
p95
22.96
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
241.59
KiB
<
mean
244.75
KiB
SD
6.52
KiB
<
p95
245.41
KiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
≤
mean
11.83
threads
SD
0.9
threads
<
p95
12
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
58
file descriptors
<
mean
59.43
file descriptors
SD
8.23
file descriptors
<
p95
70
file descriptors

Two-party countersigning

↑ Back to index

This scenario tests the performance of countersigning operations. There are two roles: initiate and participate. The participants commit an entry to advertise that they are willing to participate in sessions. They listen for sessions and participate in one at a time.

Started
Thu, 11 Jun 2026 03:15:45 UTC
Peer count
3
Peer count at end
3
Behaviours
  • initiate (1 agent)
  • participate (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
two_party_countersigning_27317315203_1
Session accepted -- timing
The duration of the session from acceptance to completion.
Mean
mean
0.573534
s
SD
0.858126
s
Max
Highest per-partition mean latency
max mean
0.681076
s
Min
Lowest per-partition mean latency
min mean
0.465991
s
Session accepted -- success rate
The number of accepted sessions that completed per second.
Mean
mean
5.4
/s
Max
Highest per-partition mean rate
max
5.43
/s
Min
Lowest per-partition mean rate
min
5.38
/s
Session accepted -- success ratio
Fraction of accepted sessions that completed successfully (0–1).
0.989
Session accepted -- failures
Accepted sessions that failed to complete.
Total
1
Agents affected
1 / 2
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
1
Max
Highest count in any single partition
1
Min
Lowest count in any single partition
0
Session initiated -- timing
The duration of the session from initiation to completion.
Mean
mean
0.927611
s
SD
1.190553
s
Max
Highest per-partition mean latency
max mean
0.927611
s
Min
Lowest per-partition mean latency
min mean
0.927611
s
Session initiated -- success rate
The number of initiated sessions that completed per second.
Mean
mean
10.76
/s
Max
Highest per-partition mean rate
max
10.76
/s
Min
Lowest per-partition mean rate
min
10.76
/s
Session initiated -- success ratio
Fraction of initiated sessions that completed successfully (0–1).
1
Session initiated -- failures
Initiated sessions that failed to complete.
Total
3
Agents affected
1 / 1
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
3
Max
Highest count in any single partition
3
Min
Lowest count in any single partition
3
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.005248
s
SD
0.004699
s
p50
0.004955
s
<
p95
0.014782
s
<
p99
0.027865
s
WASM usage: 'countersigning::accept_two_party'
Metered usage count of the WASM ribosome for this zome function.
total
14691636
over 210.227580912s
mean rate
125755.79
/s
std
193235.47
/s
p5
0
/s
p95
571475.69
/s
peak
571626.13
/s
WASM usage: 'countersigning::call_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
9824051
over 265.378879713s
mean rate
132025.34
/s
std
127171.62
/s
p5
0
/s
p95
317440.98
/s
peak
338703.49
/s
WASM usage: 'countersigning::commit_two_party'
Metered usage count of the WASM ribosome for this zome function.
total
54110587
over 265.378879713s
mean rate
1.46335556e+06
/s
std
1.19507401e+06
/s
p5
0
/s
p95
3.46157079e+06
/s
peak
3.75221106e+06
/s
WASM usage: 'countersigning::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 335.37936926s
Not enough time data to show a trend.
WASM usage: 'countersigning::initiator_hello'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 260.003012638s
Not enough time data to show a trend.
WASM usage: 'countersigning::list_participants'
Metered usage count of the WASM ribosome for this zome function.
total
10156260
over 260.003012638s
mean rate
39062.09
/s
std
19623.99
/s
p5
0
/s
p95
62362.45
/s
peak
62362.64
/s
WASM usage: 'countersigning::participant_hello'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.228070459s
Not enough time data to show a trend.
WASM usage: 'countersigning::start_two_party'
Metered usage count of the WASM ribosome for this zome function.
total
43152874
over 260.003012638s
mean rate
165970.67
/s
std
86129.49
/s
p5
0
/s
p95
264909.86
/s
peak
283832.88
/s
WASM usage: 'countersigning_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
5359835
over 335.37936926s
mean rate
168404.41
/s
std
238137.11
/s
p5
0
/s
p95
663772.55
/s
peak
730273.69
/s
Zome call duration: 'countersigning::accept_two_party'
Duration of this zome call as measured by Holochain internally.
mean
0.118982
s
SD
0.003201
s
p50
0.116622
s
<
p95
0.125992
s
<
p99
0.126423
s
Zome call duration: 'countersigning::call_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.003494
s
SD
0.000966
s
p50
0.002599
s
<
p95
0.004271
s
<
p99
0.004278
s
Zome call duration: 'countersigning::commit_two_party'
Duration of this zome call as measured by Holochain internally.
mean
0.072267
s
SD
0.051089
s
p50
0.010763
s
<
p95
0.115388
s
≤
p99
0.115388
s
Zome call duration: 'countersigning::initiator_hello'
Duration of this zome call as measured by Holochain internally.
mean
0.002999
s
SD
0
s
p50
0.002999
s
≤
p95
0.002999
s
≤
p99
0.002999
s
Zome call duration: 'countersigning::list_participants'
Duration of this zome call as measured by Holochain internally.
mean
0.014372
s
SD
0.004562
s
p50
0.014089
s
<
p95
0.02355
s
<
p99
0.036392
s
Zome call duration: 'countersigning::participant_hello'
Duration of this zome call as measured by Holochain internally.
mean
0.003402
s
SD
0.000419
s
p50
0.00299
s
<
p95
0.003829
s
≤
p99
0.003829
s
Zome call duration: 'countersigning::start_two_party'
Duration of this zome call as measured by Holochain internally.
mean
0.14025
s
SD
0.010463
s
p50
0.129845
s
<
p95
0.151064
s
<
p99
0.151958
s
WASM call duration: 'countersigning::accept_two_party'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.118077
s
SD
0.00317
s
p50
0.116002
s
<
p95
0.125041
s
<
p99
0.125455
s
WASM call duration: 'countersigning::call_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002286
s
SD
0.000652
s
p50
0.00173
s
<
p95
0.002809
s
<
p99
0.002818
s
WASM call duration: 'countersigning::commit_two_party'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.070987
s
SD
0.050755
s
p50
0.009866
s
<
p95
0.11383
s
≤
p99
0.11383
s
WASM call duration: 'countersigning::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.0047
s
SD
0.000188
s
p50
0.004812
s
<
p95
0.004844
s
≤
p99
0.004844
s
WASM call duration: 'countersigning::initiator_hello'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001906
s
SD
0
s
p50
0.001906
s
≤
p95
0.001906
s
≤
p99
0.001906
s
WASM call duration: 'countersigning::list_participants'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.012607
s
SD
0.004619
s
p50
0.012293
s
<
p95
0.021937
s
<
p99
0.034882
s
WASM call duration: 'countersigning::participant_hello'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00275
s
SD
0.000236
s
p50
0.002518
s
<
p95
0.002991
s
≤
p99
0.002991
s
WASM call duration: 'countersigning::start_two_party'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.138645
s
SD
0.010461
s
p50
0.128236
s
<
p95
0.149456
s
<
p99
0.150351
s
WASM call duration: 'countersigning_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002093
s
SD
0.000644
s
p50
0.001193
s
<
p95
0.002441
s
<
p99
0.00258
s
Host function call duration: '__hc__accept_countersigning_preflight_request_1'
Duration of this host function call invoked from within WASM.
mean
0.007772
s
SD
0.006926
s
p50
0.001156
s
<
p95
0.021367
s
<
p99
0.023699
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
5.2e-05
s
SD
1.5e-05
s
p50
3.1e-05
s
<
p95
5.9e-05
s
<
p99
6.1e-05
s
Host function call duration: '__hc__call_1'
Duration of this host function call invoked from within WASM.
mean
0.114502
s
SD
0.002895
s
p50
0.113744
s
<
p95
0.117888
s
<
p99
0.119644
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000579
s
SD
0.000168
s
p50
0.000376
s
<
p95
0.00071
s
<
p99
0.000717
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000343
s
SD
7.3e-05
s
p50
0.000271
s
<
p95
0.000418
s
≤
p99
0.000418
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
7.6e-05
s
SD
2e-05
s
p50
7.6e-05
s
<
p95
8.8e-05
s
<
p99
8.9e-05
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.064315
s
SD
0.04873
s
p50
0.005307
s
<
p95
0.105492
s
≤
p99
0.105492
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.005374
s
SD
0.004696
s
p50
0.005091
s
<
p95
0.014896
s
<
p99
0.027984
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
1.4e-05
s
SD
1e-06
s
p50
1.4e-05
s
<
p95
1.5e-05
s
<
p99
1.6e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.003372
s
SD
0.001051
s
p50
0.001711
s
<
p95
0.004191
s
<
p99
0.004297
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
239
over 265.378739672s
mean rate
7.25
/s
std
7.92
/s
p5
0
/s
p95
20.97
/s
peak
23.3
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000369
s
SD
0.00012
s
p50
0.000313
s
<
p95
0.000471
s
≤
p99
0.000471
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
16.48
s
<
mean
146.9
s
SD
83.67
s
<
p95
276.49
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
1450
over 335.379378826s
mean rate
13.4
/s
std
26.79
/s
p5
0
/s
p95
97.54
/s
peak
115.25
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.40584
s
SD
0.907512
s
p50
0.424397
s
<
p95
3.235684
s
≤
p99
3.235684
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.646105
s
SD
0.158673
s
p50
1.686567
s
<
p95
1.751622
s
<
p99
1.755736
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.014814
s
SD
0.419123
s
p50
0.02008
s
<
p95
1.668897
s
≤
p99
1.668897
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.050682
s
SD
0.036425
s
p50
0.003622
s
<
p95
0.090052
s
<
p99
0.09023
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.003613
s
SD
0.004172
s
p50
0.00064
s
<
p95
0.010468
s
<
p99
0.011369
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.008336
s
SD
0.005447
s
p50
0.001875
s
<
p95
0.018537
s
<
p99
0.01901
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.042996
s
SD
0.839771
s
p50
0.023552
s
<
p95
3.335841
s
≤
p99
3.335841
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.139133
s
SD
0.055527
s
p50
0.122733
s
<
p95
0.178716
s
<
p99
0.220628
s
Witnessing workflow duration
Time spent running the witnessing workflow.
mean
0.000634
s
SD
0.000428
s
p50
0.00067
s
<
p95
0.001052
s
<
p99
0.001102
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.00067
s
SD
0.000328
s
p50
0.000242
s
<
p95
0.001141
s
≤
p99
0.001141
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000444
s
SD
0.000306
s
p50
0.000298
s
<
p95
0.001116
s
≤
p99
0.001116
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.00025
s
SD
0.000128
s
p50
0.00022
s
<
p95
0.000578
s
<
p99
0.000731
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000337
s
SD
0.000342
s
p50
0.000159
s
<
p95
0.000793
s
<
p99
0.00226
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000145
s
SD
4.7e-05
s
p50
0.000128
s
<
p95
0.000209
s
≤
p99
0.000209
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000268
s
SD
0.000123
s
p50
0.000285
s
<
p95
0.000444
s
<
p99
0.000591
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003187
s
SD
0.010975
s
p50
0.000378
s
<
p95
0.03508
s
≤
p99
0.03508
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00039
s
SD
0.000118
s
p50
0.000328
s
<
p95
0.000518
s
<
p99
0.000529
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.06932
s
SD
0.025517
s
p50
0.053462
s
<
p95
0.105113
s
≤
p99
0.105113
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.063959
s
SD
0.048803
s
p50
0.006753
s
<
p95
0.104876
s
≤
p99
0.104876
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.134345
s
SD
0.052122
s
p50
0.107102
s
<
p95
0.170475
s
<
p99
0.205927
s
P2P request roundtrip: 'call_remote'
Time spent sending a call_remote request and awaiting its response.
mean
0.113948
s
SD
0.00289
s
p50
0.113123
s
<
p95
0.117472
s
<
p99
0.119222
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
23.91
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
57.13
KiB/s
<
mean
131.17
KiB/s
SD
162.45
KiB/s
<
p95
185.92
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
36.24
KiB/s
<
mean
158.57
KiB/s
SD
107.90
KiB/s
<
p95
313.16
KiB/s
Total bytes received
Total bytes received on primary network interface
count
115.29
MiB
mean
368.92
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
139.37
MiB
mean
445.99
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 81.04 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
12.96
%
<
mean
29.81
%
SD
14.04
%
<
p95
54.09
%
System
5.90
%
CPU percentiles
CPU usage percentiles
p50
26.04
%
p95
54.09
%
p99
83.62
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.03
s
Memory used percentage
Percentage of memory used
p5
10.13
%
<
mean
17.7
%
SD
5.24
%
<
p95
22.79
%
Memory available percentage
Percentage of available memory
p5
77.21
%
<
mean
82.3
%
SD
5.24
%
<
p95
89.87
%
Max host memory used
Maximum memory usage percentage across all hosts
max
22.55
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
81.04
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
9.28
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.19
5 min
1.82
15 min
1.74
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.8
%
<
mean
3.479
%
SD
3.3174
%
<
p95
7.79
%
60 second average
3.4513
%
300 second average
2.5995
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
16.726
%
SD
22.7505
%
<
p95
51.74
%
60 second average
16.7954
%
300 second average
14.7131
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
14.1741
%
SD
19.3612
%
<
p95
44.65
%
60 second average
14.3288
%
300 second average
12.2311
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.18
%
<
mean
3.98
%
SD
5.98
%
<
p95
8.19
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
226.40
KiB
<
mean
255.90
KiB
SD
60.67
KiB
<
p95
277.63
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
18.17
threads
SD
4.75
threads
<
p95
23
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
47
file descriptors
<
mean
72.73
file descriptors
SD
11.46
file descriptors
<
p95
86
file descriptors

Unyt Chain Transaction

↑ Back to index

Tests Unyt chain transaction system performance with credit ledger and smart agreement primitives. The scenario has three roles:

  • initiate: Progenitor agent that initializes the network with system templates, global configuration, and foundational smart agreements
  • spend: Transaction agents that accept incoming commitments and create spend transactions distributed among participants
  • smart_agreements: Smart agreement agents that collect RAVEs, execute agreements, and create parked link spending transactions
Started
Thu, 11 Jun 2026 05:51:21 UTC
Peer count
30
Peer count at end
14
Behaviours
  • initiate (1 agent)
  • smart_agreements (1 agent)
  • spend (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
unyt_chain_transaction_27317315203_1
Global definition propagation time
Time from session start until each agent detected the global_definition propagation. Shows aggregate statistics across agents.
Mean
mean
20.25
s
SD
0
s
Max
Highest per-partition mean latency
max mean
85
s
Min
Lowest per-partition mean latency
min mean
0
s
Sync lag: Commitment transactions
Time between commitment creation and discovery by the receiving agent (seconds). Shows aggregate statistics across agents.
Mean
mean
326.268593
s
SD
64.484501
s
Max
Highest per-partition mean latency
max mean
1195.901481
s
Min
Lowest per-partition mean latency
min mean
47.349262
s
Sync lag: RAVE transactions
Time between RAVE creation and discovery by smart_agreements agents (seconds). Shows aggregate statistics across agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Sync lag: Grouped parked requests
Time between grouped_parked request creation and discovery (seconds). Shows aggregate statistics across agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Final ledger balance
Final ledger balance across all agents at teardown (base unyt units). Sum should be stable across runs; deviation indicates value was created or destroyed.
sum
-7579084947340
mean
-3.60908807016e+11
min
-989398381983
max
0
n
21
Final ledger fees
Final ledger fees owed across all agents at teardown (base unyt units).
sum
460840165
mean
2.194476976e+07
min
0
max
52034913
n
21
Actionable transaction commitments
Remaining actionable transaction commitments at teardown. Non-zero sum indicates work left unfinished.
sum
13
mean
0.62
min
0
max
7
n
21
Actionable transaction accepts
Remaining actionable transaction accepts at teardown. Non-zero sum indicates work left unfinished.
sum
0
mean
0
min
0
max
0
n
21
Completed transaction accepts
Completed transaction accepts at teardown.
sum
66
mean
3.14
min
0
max
25
n
21
Completed transaction spends
Completed transaction spends at teardown.
sum
1261
mean
60.05
min
0
max
148
n
21
Completed transaction RAVEs
Completed transaction RAVEs at teardown.
sum
1273
mean
60.62
min
0
max
148
n
21
Parked spends
Parked spend counts at teardown. These are pending link-spending transactions.
sum
1287
mean
61.29
min
0
max
147
n
21
Check agent exists: Duration
Duration of the check_agent_exists loop per behaviour iteration (seconds).
mean
0.01317
s
SD
0.039994
s
p50
2e-06
s
<
p95
0.107487
s
<
p99
0.194458
s
Check agent exists: Total calls
Total check_agent_exists calls made across all agents and iterations.
sum
591
mean
1.65
min
0
max
23
n
359
Check agent exists: Failed calls
Total check_agent_exists calls that failed across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
359
Check agent exists: Missing agents
Total check_agent_exists calls that reported a missing agent across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
359
UI action list refresh: Duration
Duration of the UI action list refresh per behaviour iteration (seconds).
mean
0.616593
s
SD
3.429223
s
p50
0.065802
s
<
p95
0.327011
s
<
p99
26.139483
s
UI action list refresh: Failed calls
Total UI action list refresh calls that failed across all agents and iterations.
sum
1
mean
0
min
0
max
1
n
359
UI routine refresh: Duration
Duration of the full UI routine refresh per behaviour iteration (seconds), including check_agent_exists, action list refresh, and transaction detail refresh.
mean
12.829597
s
SD
67.541601
s
p50
0.155415
s
<
p95
54.382579
s
<
p99
485.400831
s
UI routine refresh: Watchlist count
Watchlist size (number of transactions being tracked) per behaviour iteration. Indicates how many transactions agents are actively monitoring.
sum
1452
mean
4.04
min
0
max
65
n
359
UI transaction detail item refresh: Duration
Duration of refreshing a single transaction detail item per behaviour iteration (seconds).
mean
2.989901
s
SD
5.056987
s
p50
1.264401
s
<
p95
11.835748
s
<
p99
25.083077
s
UI transaction detail item refresh: Primary transaction total calls
Total primary transaction fetches made during per-item detail refresh across all agents and iterations.
sum
2904
mean
2
min
2
max
2
n
1452
UI transaction detail item refresh: Primary transaction failed calls
Total primary transaction fetches that failed during per-item detail refresh across all agents and iterations.
sum
5
mean
0
min
0
max
1
n
1452
UI transaction detail item refresh: Related transaction total calls
Total related transaction fetches made during per-item detail refresh across all agents and iterations.
sum
18
mean
0.01
min
0
max
1
n
1452
UI transaction detail item refresh: Related transaction failed calls
Total related transaction fetches that failed during per-item detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
1452
UI transaction detail refresh: Duration
Duration of refreshing all watched transaction details per behaviour iteration (seconds).
mean
57.884662
s
SD
138.116649
s
p50
11.672045
s
<
p95
484.807483
s
<
p99
763.882507
s
UI transaction detail refresh: Transactions processed
Total number of transactions processed during the detail refresh across all agents and iterations.
sum
1452
mean
19.36
min
1
max
65
n
75
UI transaction detail refresh: Primary transaction total calls
Total primary transaction fetches made during the full detail refresh across all agents and iterations.
sum
2904
mean
38.72
min
2
max
130
n
75
UI transaction detail refresh: Primary transaction failed calls
Total primary transaction fetches that failed during the full detail refresh across all agents and iterations.
sum
5
mean
0.07
min
0
max
1
n
75
UI transaction detail refresh: Related transaction total calls
Total related transaction fetches made during the full detail refresh across all agents and iterations.
sum
18
mean
0.24
min
0
max
4
n
75
UI transaction detail refresh: Related transaction failed calls
Total related transaction fetches that failed during the full detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
75
Error count
The total number of errors accumulated across all agents over the run.
2738
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.016795
s
SD
0.020945
s
p50
0.003753
s
<
p95
0.027635
s
<
p99
0.103376
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
4
over 1601.760322179s
mean rate
292.89
/s
std
606.16
/s
p5
0
/s
p95
1739.52
/s
peak
3149
/s
WASM usage: 'transactor::check_agent_exists'
Metered usage count of the WASM ribosome for this zome function.
total
468006
over 1450.955510964s
mean rate
245676.81
/s
std
148967.53
/s
p5
9746.8
/s
p95
435838.35
/s
peak
523030.28
/s
WASM usage: 'transactor::create_accept'
Metered usage count of the WASM ribosome for this zome function.
total
73414671
over 1455.569932091s
mean rate
4.8017762852e+09
/s
std
1.20276339804e+10
/s
p5
1.811796948e+07
/s
p95
3.95717062824e+10
/s
peak
5.26339448395e+10
/s
WASM usage: 'transactor::create_code_template'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37331.707993735s
Not enough time data to show a trend.
WASM usage: 'transactor::create_commitment'
Metered usage count of the WASM ribosome for this zome function.
total
12502340173
over 1748.019990793s
mean rate
4.73779992698e+09
/s
std
8.40049591213e+09
/s
p5
7.353220548e+07
/s
p95
2.18652633584e+10
/s
peak
5.24120094563e+10
/s
WASM usage: 'transactor::create_parked_spend'
Metered usage count of the WASM ribosome for this zome function.
total
37812149
over 750.020604082s
mean rate
6.14152849e+06
/s
std
934342.23
/s
p5
6.28814136e+06
/s
p95
6.29933986e+06
/s
peak
6.29982097e+06
/s
WASM usage: 'transactor::create_smart_agreement'
Metered usage count of the WASM ribosome for this zome function.
total
714050
over 865.164258768s
mean rate
635874.18
/s
std
789692.06
/s
p5
0
/s
p95
1.62584319e+06
/s
peak
1.62655451e+06
/s
WASM usage: 'transactor::get_actionable_transactions'
Metered usage count of the WASM ribosome for this zome function.
total
71196618
over 1748.019990793s
mean rate
2.6706354608e+08
/s
std
4.7145373578e+08
/s
p5
0
/s
p95
1.41687345764e+09
/s
peak
1.87386813316e+09
/s
WASM usage: 'transactor::get_all_notification_links'
Metered usage count of the WASM ribosome for this zome function.
total
1220955
over 1461.534326835s
mean rate
6.121173975e+07
/s
std
1.9642706699e+08
/s
p5
0
/s
p95
6.688137611e+08
/s
peak
9.5314478562e+08
/s
WASM usage: 'transactor::get_code_templates_lib'
Metered usage count of the WASM ribosome for this zome function.
total
399270749
over 1748.019990793s
mean rate
3.7655769795e+08
/s
std
6.5023018109e+08
/s
p5
1.04841451e+06
/s
p95
1.70743083162e+09
/s
peak
3.08889589201e+09
/s
WASM usage: 'transactor::get_current_global_definition'
Metered usage count of the WASM ribosome for this zome function.
total
108325992
over 37331.707993735s
mean rate
4.1286686339e+08
/s
std
9.6568978597e+08
/s
p5
123386.46
/s
p95
1.88165288693e+09
/s
peak
5.78454180499e+09
/s
WASM usage: 'transactor::get_global_units_details'
Metered usage count of the WASM ribosome for this zome function.
total
1392415
over 1461.534326835s
mean rate
4.038878312e+07
/s
std
1.2373934364e+08
/s
p5
0
/s
p95
4.3050563784e+08
/s
peak
4.4249392934e+08
/s
WASM usage: 'transactor::get_history'
Metered usage count of the WASM ribosome for this zome function.
total
58404988
over 1461.534326835s
mean rate
4.2594675784e+08
/s
std
1.08059889926e+09
/s
p5
22947.36
/s
p95
3.50269126405e+09
/s
peak
3.8276486448e+09
/s
WASM usage: 'transactor::get_incoming_raves'
Metered usage count of the WASM ribosome for this zome function.
total
18021042
over 1748.019990793s
mean rate
2.565068486e+07
/s
std
6.284149025e+07
/s
p5
0
/s
p95
2.4272940472e+08
/s
peak
2.5201253906e+08
/s
WASM usage: 'transactor::get_ledger'
Metered usage count of the WASM ribosome for this zome function.
total
3587458032
over 1748.019990793s
mean rate
1.98542708887e+09
/s
std
3.83178595145e+09
/s
p5
1.72322408e+06
/s
p95
9.75029593658e+09
/s
peak
2.22281159119e+10
/s
WASM usage: 'transactor::get_my_current_applied_credit_limit'
Metered usage count of the WASM ribosome for this zome function.
total
1222559003
over 1748.019990793s
mean rate
1.80617796353e+09
/s
std
4.31884983061e+09
/s
p5
0
/s
p95
1.64074456059e+10
/s
peak
1.70952485099e+10
/s
WASM usage: 'transactor::get_requests_to_execute_agreements'
Metered usage count of the WASM ribosome for this zome function.
total
18464067
over 1748.019990793s
mean rate
2.32721576834e+09
/s
std
1.0861730767e+10
/s
p5
0
/s
p95
1.13956151997e+10
/s
peak
7.79502936235e+10
/s
WASM usage: 'transactor::get_smart_agreements_for_code_template'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 1748.019990793s
Not enough time data to show a trend.
WASM usage: 'transactor::get_sorted_requests_to_spend'
Metered usage count of the WASM ribosome for this zome function.
total
761282
over 1461.534326835s
mean rate
2.338461135e+07
/s
std
7.301739513e+07
/s
p5
0
/s
p95
2.5720790859e+08
/s
peak
2.6517885347e+08
/s
WASM usage: 'transactor::get_status'
Metered usage count of the WASM ribosome for this zome function.
total
12110142969
over 1460.955548572s
mean rate
5.85590052544e+09
/s
std
7.31297143543e+09
/s
p5
1.9827913634e+08
/s
p95
2.01088425416e+10
/s
peak
5.17289893848e+10
/s
WASM usage: 'transactor::get_transaction'
Metered usage count of the WASM ribosome for this zome function.
total
1062231342
over 1450.955510964s
mean rate
4.8075409923e+08
/s
std
3.2952369549e+08
/s
p5
2.311743147e+07
/s
p95
1.00314766266e+09
/s
peak
2.00960847051e+09
/s
WASM usage: 'transactor::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37451.712459936s
Not enough time data to show a trend.
WASM usage: 'transactor::initialize_global_definition'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 750.008108646s
Not enough time data to show a trend.
WASM usage: 'transactor::post_commit'
Metered usage count of the WASM ribosome for this zome function.
total
1001298
over 37451.712459936s
mean rate
1.15322931479e+09
/s
std
2.47454370598e+09
/s
p5
0
/s
p95
5.9562859339e+09
/s
peak
1.7676554078e+10
/s
WASM usage: 'transactor::recv_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
494307970
over 1465.966772301s
mean rate
2.02276823407e+09
/s
std
3.85603317255e+09
/s
p5
4.239341747e+07
/s
p95
7.2546881689e+09
/s
peak
2.02119686253e+10
/s
WASM usage: 'transactor::whoami'
Metered usage count of the WASM ribosome for this zome function.
total
27269
over 1461.534326835s
mean rate
835986.12
/s
std
2.61012967e+06
/s
p5
0
/s
p95
9.21315854e+06
/s
peak
9.4703829e+06
/s
WASM usage: 'transactor_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
7430013
over 37461.712528568s
mean rate
5.04954191e+08
/s
std
9.2557647803e+08
/s
p5
0
/s
p95
2.87552646972e+09
/s
peak
4.70592567648e+09
/s
WASM usage: 'transactor_integrity::genesis_self_check_2'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37461.712528568s
Not enough time data to show a trend.
WASM usage: 'transactor_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
1873498
over 37451.712459936s
mean rate
9.14979224558e+10
/s
std
2.15522193126e+11
/s
p5
0
/s
p95
4.33251960242e+11
/s
peak
2.08650963262e+12
/s
Zome call duration: 'transactor::check_agent_exists'
Duration of this zome call as measured by Holochain internally.
mean
0.004191
s
SD
0.001667
s
p50
0.004495
s
<
p95
0.007016
s
<
p99
0.007441
s
Zome call duration: 'transactor::create_accept'
Duration of this zome call as measured by Holochain internally.
mean
0.204817
s
SD
0.092846
s
p50
0.205299
s
<
p95
0.47169
s
≤
p99
0.47169
s
Zome call duration: 'transactor::create_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.023062
s
SD
0.008474
s
p50
0.02167
s
<
p95
0.036328
s
<
p99
0.043388
s
Zome call duration: 'transactor::create_commitment'
Duration of this zome call as measured by Holochain internally.
mean
0.342089
s
SD
0.290377
s
p50
0.276215
s
<
p95
1.318109
s
≤
p99
1.318109
s
Zome call duration: 'transactor::create_parked_spend'
Duration of this zome call as measured by Holochain internally.
mean
0.248545
s
SD
0.071239
s
p50
0.318928
s
≤
p95
0.318928
s
≤
p99
0.318928
s
Zome call duration: 'transactor::create_smart_agreement'
Duration of this zome call as measured by Holochain internally.
mean
0.019096
s
SD
0.002114
s
p50
0.020154
s
<
p95
0.020277
s
≤
p99
0.020277
s
Zome call duration: 'transactor::get_actionable_transactions'
Duration of this zome call as measured by Holochain internally.
mean
0.053203
s
SD
0.062076
s
p50
0.045048
s
<
p95
0.14707
s
<
p99
0.167367
s
Zome call duration: 'transactor::get_all_notification_links'
Duration of this zome call as measured by Holochain internally.
mean
0.014971
s
SD
0.009157
s
p50
0.013036
s
<
p95
0.036127
s
≤
p99
0.036127
s
Zome call duration: 'transactor::get_code_templates_lib'
Duration of this zome call as measured by Holochain internally.
mean
0.025984
s
SD
0.035518
s
p50
0.024237
s
<
p95
0.085397
s
<
p99
0.154345
s
Zome call duration: 'transactor::get_current_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.032852
s
SD
0.018503
s
p50
0.032274
s
<
p95
0.047082
s
<
p99
0.094325
s
Zome call duration: 'transactor::get_global_units_details'
Duration of this zome call as measured by Holochain internally.
mean
0.012313
s
SD
0.013838
s
p50
0.019509
s
<
p95
0.049322
s
≤
p99
0.049322
s
Zome call duration: 'transactor::get_history'
Duration of this zome call as measured by Holochain internally.
mean
0.058218
s
SD
0.104431
s
p50
0.073619
s
<
p95
0.175218
s
≤
p99
0.175218
s
Zome call duration: 'transactor::get_incoming_raves'
Duration of this zome call as measured by Holochain internally.
mean
0.015286
s
SD
0.015632
s
p50
0.012749
s
<
p95
0.037784
s
<
p99
0.046981
s
Zome call duration: 'transactor::get_ledger'
Duration of this zome call as measured by Holochain internally.
mean
0.04652
s
SD
0.014171
s
p50
0.038371
s
<
p95
0.070945
s
≤
p99
0.070945
s
Zome call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of this zome call as measured by Holochain internally.
mean
0.046719
s
SD
0.084085
s
p50
0.041591
s
<
p95
0.264603
s
≤
p99
0.264603
s
Zome call duration: 'transactor::get_requests_to_execute_agreements'
Duration of this zome call as measured by Holochain internally.
mean
0.166028
s
SD
0.078829
s
p50
0.01608
s
<
p95
0.039936
s
<
p99
0.570333
s
Zome call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.016417
s
SD
0.037628
s
p50
0.011022
s
<
p95
0.072492
s
<
p99
0.198694
s
Zome call duration: 'transactor::get_sorted_requests_to_spend'
Duration of this zome call as measured by Holochain internally.
mean
0.010008
s
SD
0.010269
s
p50
0.010824
s
<
p95
0.040986
s
≤
p99
0.040986
s
Zome call duration: 'transactor::get_status'
Duration of this zome call as measured by Holochain internally.
mean
2.958689
s
SD
2.911985
s
p50
2.494475
s
<
p95
9.344127
s
<
p99
14.872959
s
Zome call duration: 'transactor::get_transaction'
Duration of this zome call as measured by Holochain internally.
mean
0.015394
s
SD
0.011956
s
p50
0.014214
s
<
p95
0.052992
s
≤
p99
0.052992
s
Zome call duration: 'transactor::initialize_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.054219
s
SD
0
s
p50
0.054219
s
≤
p95
0.054219
s
≤
p99
0.054219
s
Zome call duration: 'transactor::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.016173
s
SD
0.005908
s
p50
0.013147
s
<
p95
0.030206
s
<
p99
0.031316
s
Zome call duration: 'transactor::whoami'
Duration of this zome call as measured by Holochain internally.
mean
0.004094
s
SD
0.003356
s
p50
0.00353
s
<
p95
0.013254
s
≤
p99
0.013254
s
WASM call duration: 'transactor::check_agent_exists'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00263
s
SD
0.001188
s
p50
0.002764
s
<
p95
0.004877
s
≤
p99
0.004877
s
WASM call duration: 'transactor::create_accept'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.337354
s
SD
0.103724
s
p50
0.254452
s
<
p95
0.470474
s
≤
p99
0.470474
s
WASM call duration: 'transactor::create_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.020799
s
SD
0.007853
s
p50
0.01952
s
<
p95
0.03268
s
<
p99
0.040751
s
WASM call duration: 'transactor::create_commitment'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.340849
s
SD
0.274176
s
p50
0.27511
s
<
p95
1.314741
s
≤
p99
1.314741
s
WASM call duration: 'transactor::create_parked_spend'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.247041
s
SD
0.070818
s
p50
0.31701
s
≤
p95
0.31701
s
≤
p99
0.31701
s
WASM call duration: 'transactor::create_smart_agreement'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.017208
s
SD
0.00164
s
p50
0.018028
s
<
p95
0.018086
s
≤
p99
0.018086
s
WASM call duration: 'transactor::get_actionable_transactions'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.051533
s
SD
0.061866
s
p50
0.042965
s
<
p95
0.14386
s
<
p99
0.165417
s
WASM call duration: 'transactor::get_all_notification_links'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.013275
s
SD
0.009034
s
p50
0.011723
s
<
p95
0.034424
s
≤
p99
0.034424
s
WASM call duration: 'transactor::get_code_templates_lib'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.098177
s
SD
0.338469
s
p50
0.023051
s
<
p95
0.082646
s
<
p99
1.633795
s
WASM call duration: 'transactor::get_current_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.014362
s
SD
0.018546
s
p50
0.017093
s
<
p95
0.043296
s
<
p99
0.089932
s
WASM call duration: 'transactor::get_global_units_details'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.010585
s
SD
0.012998
s
p50
0.017688
s
<
p95
0.046731
s
≤
p99
0.046731
s
WASM call duration: 'transactor::get_history'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.056525
s
SD
0.104405
s
p50
0.072494
s
<
p95
0.173967
s
≤
p99
0.173967
s
WASM call duration: 'transactor::get_incoming_raves'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.01373
s
SD
0.015493
s
p50
0.010911
s
<
p95
0.035452
s
<
p99
0.045269
s
WASM call duration: 'transactor::get_ledger'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.044891
s
SD
0.013735
s
p50
0.037091
s
<
p95
0.067936
s
<
p99
0.0682
s
WASM call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.04522
s
SD
0.084
s
p50
0.040404
s
<
p95
0.262894
s
≤
p99
0.262894
s
WASM call duration: 'transactor::get_requests_to_execute_agreements'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.164473
s
SD
0.078749
s
p50
0.015063
s
<
p95
0.037918
s
<
p99
0.56859
s
WASM call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.014841
s
SD
0.037236
s
p50
0.009582
s
<
p95
0.067927
s
<
p99
0.196598
s
WASM call duration: 'transactor::get_sorted_requests_to_spend'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.008316
s
SD
0.010008
s
p50
0.009137
s
<
p95
0.038679
s
≤
p99
0.038679
s
WASM call duration: 'transactor::get_status'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
3.069247
s
SD
3.047908
s
p50
2.623492
s
<
p95
9.341459
s
<
p99
16.629879
s
WASM call duration: 'transactor::get_transaction'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.014096
s
SD
0.011664
s
p50
0.012795
s
<
p95
0.050802
s
≤
p99
0.050802
s
WASM call duration: 'transactor::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.021299
s
SD
0.008552
s
p50
0.017612
s
<
p95
0.043677
s
≤
p99
0.043677
s
WASM call duration: 'transactor::initialize_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.051997
s
SD
0
s
p50
0.051997
s
≤
p95
0.051997
s
≤
p99
0.051997
s
WASM call duration: 'transactor::post_commit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.066151
s
SD
0.048791
s
p50
0.040273
s
<
p95
0.11439
s
<
p99
0.237369
s
WASM call duration: 'transactor::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.01419
s
SD
0.005309
s
p50
0.011336
s
<
p95
0.026988
s
<
p99
0.027724
s
WASM call duration: 'transactor::whoami'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002363
s
SD
0.002929
s
p50
0.001865
s
<
p95
0.010686
s
≤
p99
0.010686
s
WASM call duration: 'transactor_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001507
s
SD
0.00055
s
p50
0.001644
s
<
p95
0.002672
s
<
p99
0.003307
s
WASM call duration: 'transactor_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00183
s
SD
0.000763
s
p50
0.001455
s
<
p95
0.003227
s
<
p99
0.003332
s
WASM call duration: 'transactor_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.034176
s
SD
0.057158
s
p50
0.022272
s
<
p95
0.174584
s
<
p99
0.319806
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.3e-05
s
SD
1.2e-05
s
p50
2.2e-05
s
<
p95
4.5e-05
s
<
p99
6.1e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000426
s
SD
0.000411
s
p50
0.000322
s
<
p95
0.001183
s
<
p99
0.002251
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000567
s
SD
0.000549
s
p50
0.000337
s
<
p95
0.00096
s
<
p99
0.003918
s
Host function call duration: '__hc__delete_link_1'
Duration of this host function call invoked from within WASM.
mean
0.011729
s
SD
0.007181
s
p50
0.00687
s
<
p95
0.024793
s
<
p99
0.026795
s
Host function call duration: '__hc__dna_info_2'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
4e-06
s
p50
7e-06
s
<
p95
1.5e-05
s
<
p99
1.7e-05
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
0.000111
s
SD
0.00012
s
p50
5.1e-05
s
<
p95
0.000385
s
<
p99
0.000491
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.516491
s
SD
0.579922
s
p50
0.107385
s
<
p95
1.414201
s
<
p99
2.861857
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.110024
s
SD
0.087724
s
p50
0.117686
s
<
p95
0.189525
s
<
p99
0.631129
s
Host function call duration: '__hc__get_details_1'
Duration of this host function call invoked from within WASM.
mean
0.004735
s
SD
0.108329
s
p50
0.00051
s
<
p95
0.010141
s
<
p99
0.028066
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.012477
s
SD
0.014787
s
p50
0.005645
s
<
p95
0.030564
s
<
p99
0.080961
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.036265
s
SD
0.02776
s
p50
0.018637
s
<
p95
0.066433
s
<
p99
0.148205
s
Host function call duration: '__hc__must_get_entry_1'
Duration of this host function call invoked from within WASM.
mean
0.000618
s
SD
0.000545
s
p50
0.000528
s
<
p95
0.001944
s
≤
p99
0.001944
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.002325
s
SD
0.010662
s
p50
0.002887
s
<
p95
0.024987
s
<
p99
0.065521
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.001617
s
SD
0.001648
s
p50
0.000925
s
<
p95
0.00518
s
<
p99
0.007471
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
5.3e-05
s
SD
2.3e-05
s
p50
4e-05
s
<
p95
0.000104
s
≤
p99
0.000104
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
7e-06
s
p50
7e-06
s
<
p95
1.7e-05
s
<
p99
5.4e-05
s
Host function call duration: '__hc__trace_1'
Duration of this host function call invoked from within WASM.
mean
5.7e-05
s
SD
4e-05
s
p50
6.2e-05
s
<
p95
0.00013
s
<
p99
0.000245
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002844
s
SD
0.001826
s
p50
0.002893
s
<
p95
0.007199
s
<
p99
0.011128
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
44
over 1465.966887807s
mean rate
176.63
/s
std
341.45
/s
p5
3.44
/s
p95
627.29
/s
peak
1801.66
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
435
over 1748.019975543s
mean rate
159.65
/s
std
281.54
/s
p5
1.72
/s
p95
753.06
/s
peak
1545.35
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.068248
s
SD
0.049379
s
p50
0.041574
s
<
p95
0.117963
s
<
p99
0.241454
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
57.63
s
<
mean
584.54
s
SD
382.1
s
<
p95
1358.57
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
18
over 37461.712608435s
mean rate
4797.87
/s
std
9095.47
/s
p5
0
/s
p95
29307.17
/s
peak
38036.72
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
99.046232
s
SD
60.875807
s
p50
26.439583
s
<
p95
154.147942
s
<
p99
266.298806
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.937177
s
SD
0.38376
s
p50
1.924196
s
<
p95
2.491956
s
<
p99
2.807336
s
App validation workflow duration
Time spent running the app validation workflow.
mean
8.813143
s
SD
10.446552
s
p50
5.134659
s
<
p95
32.418236
s
<
p99
47.722896
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001213
s
SD
0.001423
s
p50
0.000692
s
<
p95
0.006618
s
≤
p99
0.006618
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.011164
s
SD
0.018618
s
p50
0.001693
s
<
p95
0.048463
s
<
p99
0.102508
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.021968
s
SD
0.021565
s
p50
0.007277
s
<
p95
0.060269
s
<
p99
0.106682
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.20089
s
SD
1.275585
s
p50
0.179733
s
<
p95
3.456439
s
<
p99
7.639948
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
5.733767
s
SD
10.053985
s
p50
3.274711
s
<
p95
33.187008
s
<
p99
44.993037
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.008441
s
SD
0.009176
s
p50
0.002081
s
<
p95
0.026802
s
<
p99
0.041583
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.006202
s
SD
0.005213
s
p50
0.001624
s
<
p95
0.016683
s
<
p99
0.020264
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000209
s
SD
0.00013
s
p50
0.000183
s
<
p95
0.000344
s
<
p99
0.000769
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.008431
s
SD
0.008707
s
p50
0.002093
s
<
p95
0.026324
s
<
p99
0.03796
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
9.2e-05
s
SD
4.4e-05
s
p50
8.1e-05
s
<
p95
0.000249
s
≤
p99
0.000249
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000207
s
SD
0.000173
s
p50
0.00016
s
<
p95
0.000543
s
<
p99
0.000892
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00203
s
SD
0.251713
s
p50
0.000382
s
<
p95
0.772638
s
<
p99
1.234905
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000283
s
SD
0.000205
s
p50
0.0003
s
<
p95
0.000742
s
<
p99
0.001092
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
1.28482
s
SD
27.889642
s
p50
0.116206
s
<
p95
60.001398
s
<
p99
60.003052
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.098961
s
SD
0.022629
s
p50
0.092201
s
<
p95
0.126774
s
<
p99
0.13039
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.156047
s
SD
23.942901
s
p50
0.105521
s
<
p95
60.001192
s
<
p99
60.001298
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.505576
s
SD
25.93021
s
p50
0.4274
s
<
p95
60.001692
s
<
p99
60.002156
s
P2P received remote signals
Count of remote signals received.
total
12
over 1752.161125991s
mean rate
166.29
/s
std
333.03
/s
p5
1.23
/s
p95
583.42
/s
peak
1801.39
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
25.21
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
352
B/s
<
mean
94.36
KiB/s
SD
484.91
KiB/s
<
p95
196.16
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
144
B/s
<
mean
70.46
KiB/s
SD
97.05
KiB/s
<
p95
255.09
KiB/s
Total bytes received
Total bytes received on primary network interface
count
3.21
GiB
mean
1.30
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.01
GiB
mean
831.22
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 99.2%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1408.70 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 9% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.8
%
<
mean
30.14
%
SD
27.59
%
<
p95
90.67
%
System
4.94
%
CPU percentiles
CPU usage percentiles
p50
24.33
%
p95
90.67
%
p99
99.25
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
21
hosts
mean time
0.08
s
Memory used percentage
Percentage of memory used
p5
11.37
%
<
mean
22.3
%
SD
9.99
%
<
p95
41.43
%
Memory available percentage
Percentage of available memory
p5
58.57
%
<
mean
77.7
%
SD
9.99
%
<
p95
88.63
%
Max host memory used
Maximum memory usage percentage across all hosts
max
45.68
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.04
%
Memory growth rate
Rate of memory growth over time
growth
1408.70
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.03
MiB/s
Disk write throughput
Disk write throughput in MiB/s
87.92
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/10
hosts
Mount Point /efi-boot
0/7
hosts
Mount Point /etc/hostname
0/6
hosts
Mount Point /etc/hosts
0/6
hosts
Mount Point /etc/resolv.conf
0/6
hosts
Mount Point /nix/store
0/10
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.79
5 min
1.55
15 min
1.28
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
8.70
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
5.2233
%
SD
12.7792
%
<
p95
33.31
%
60 second average
5.1801
%
300 second average
4.8199
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0007
%
SD
0.0137
%
≤
p95
0
%
60 second average
0.0005
%
300 second average
0.0001
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0004
%
SD
0.0085
%
≤
p95
0
%
60 second average
0.0003
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
7.3454
%
SD
14.0919
%
<
p95
39.22
%
60 second average
7.0204
%
300 second average
5.7478
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
6.1674
%
SD
11.9538
%
<
p95
33.8
%
60 second average
5.9032
%
300 second average
4.8703
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.15
%
<
mean
19.95
%
SD
26.98
%
<
p95
85.05
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
719.14
KiB
<
mean
1.04
MiB
SD
232.35
KiB
<
p95
1.30
MiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
28.96
threads
SD
16.05
threads
<
p95
57
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
42
file descriptors
<
mean
78.6
file descriptors
SD
27.15
file descriptors
<
p95
131
file descriptors

Validation Receipts

↑ Back to index

Creates an entry, wait for required validation receipts, then repeat. Records the amount of time it took to accumulate the required number of receipts for all DHT operations. This is measured to the nearest 20ms so that we don't keep the agent too busy checking for receipts.

Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

By default, this scenario will wait for a complete set of validation receipts before committing the next record. If the NO_VALIDATION_COMPLETE environment variable is set, it will instead publish new records on every round, building up an ever-growing list of action hashes to check on.

Started
Thu, 11 Jun 2026 02:11:26 UTC
Peer count
20
Peer count at end
15
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
validation_receipts_27317315203_1
Receipts complete timing
The amount of time between publishing a record and receiving the required number of validation receipts.
Mean
mean
6.277809
s
SD
4.071694
s
Max
Highest per-partition mean latency
max mean
21.976546
s
Min
Lowest per-partition mean latency
min mean
5.144387
s
Receipts complete rate
The number of complete validation receipt sets collected per second.
Mean
mean
1.87
/s
Max
Highest per-partition mean rate
max
1.94
/s
Min
Lowest per-partition mean rate
min
1.52
/s
Error count
The total number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 33078.295992135s
Not enough time data to show a trend.
WASM usage: 'crud::get_sample_entry_validation_receipts'
Metered usage count of the WASM ribosome for this zome function.
total
1093246
over 33078.295992135s
mean rate
5.12353998e+06
/s
std
1.405403199e+07
/s
p5
1419.78
/s
p95
4.157526526e+07
/s
peak
6.803489623e+07
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 33078.295992135s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 33078.295992135s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005731
s
SD
0.002086
s
p50
0.005562
s
<
p95
0.011527
s
<
p99
0.012386
s
Zome call duration: 'crud::get_sample_entry_validation_receipts'
Duration of this zome call as measured by Holochain internally.
mean
0.013586
s
SD
0.006454
s
p50
0.009667
s
<
p95
0.020952
s
<
p99
0.035718
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004733
s
SD
0.001734
s
p50
0.004584
s
<
p95
0.009559
s
<
p99
0.010231
s
WASM call duration: 'crud::get_sample_entry_validation_receipts'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.012385
s
SD
0.006222
s
p50
0.008474
s
<
p95
0.019543
s
<
p99
0.033318
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001551
s
SD
0.000723
s
p50
0.001252
s
<
p95
0.004125
s
≤
p99
0.004125
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001579
s
SD
0.000593
s
p50
0.001446
s
<
p95
0.003133
s
<
p99
0.003425
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000426
s
SD
0.000223
s
p50
0.000365
s
<
p95
0.000926
s
<
p99
0.001256
s
Host function call duration: '__hc__get_validation_receipts_1'
Duration of this host function call invoked from within WASM.
mean
0.010229
s
SD
0.005811
s
p50
0.006431
s
<
p95
0.017121
s
<
p99
0.028963
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.0025
s
SD
0.000901
s
p50
0.00239
s
<
p95
0.004964
s
<
p99
0.00531
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000381
s
SD
0.00023
s
p50
0.00033
s
<
p95
0.00091
s
<
p99
0.001
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
48.17
s
<
mean
457.1
s
SD
262.39
s
<
p95
867.25
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.841196
s
SD
1.336373
s
p50
0.838831
s
<
p95
4.20763
s
<
p99
5.685311
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.943443
s
SD
0.226713
s
p50
1.940279
s
<
p95
1.980084
s
<
p99
1.997537
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.007995
s
SD
0.118507
s
p50
0.004488
s
<
p95
0.042174
s
<
p99
0.563878
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001347
s
SD
0.001104
s
p50
0.000838
s
<
p95
0.003904
s
≤
p99
0.003904
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.002628
s
SD
0.003829
s
p50
0.001192
s
<
p95
0.011237
s
<
p99
0.012259
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.003641
s
SD
0.001568
s
p50
0.003024
s
<
p95
0.006696
s
<
p99
0.008565
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.031811
s
SD
0.449986
s
p50
0.033549
s
<
p95
0.437097
s
<
p99
1.218792
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.362917
s
SD
2.733564
s
p50
0.354014
s
<
p95
2.795671
s
<
p99
20.655262
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000285
s
SD
8.1e-05
s
p50
0.000271
s
<
p95
0.000395
s
<
p99
0.00053
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000668
s
SD
0.000316
s
p50
0.000523
s
<
p95
0.001127
s
<
p99
0.001384
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000204
s
SD
5.4e-05
s
p50
0.000195
s
<
p95
0.000324
s
<
p99
0.000361
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.00019
s
SD
9.9e-05
s
p50
0.000171
s
<
p95
0.000331
s
<
p99
0.00048
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
9.2e-05
s
SD
4.1e-05
s
p50
8.1e-05
s
<
p95
0.000194
s
≤
p99
0.000194
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000171
s
SD
5.6e-05
s
p50
0.000177
s
<
p95
0.000306
s
<
p99
0.00033
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001517
s
SD
0.009828
s
p50
0.000444
s
<
p95
0.026785
s
<
p99
0.031579
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000379
s
SD
0.000127
s
p50
0.000413
s
<
p95
0.000631
s
<
p99
0.00066
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.132821
s
SD
0.100312
s
p50
0.092271
s
<
p95
0.407336
s
<
p99
0.443651
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.169305
s
SD
0.054328
s
p50
0.155994
s
<
p95
0.258468
s
<
p99
0.285688
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
7.48
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
0
B/s
<
mean
41.83
KiB/s
SD
317.40
KiB/s
<
p95
46.98
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
0
B/s
<
mean
30.14
KiB/s
SD
20.16
KiB/s
<
p95
64.50
KiB/s
Total bytes received
Total bytes received on primary network interface
count
632.32
MiB
mean
688.82
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
455.65
MiB
mean
496.36
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 94.41 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.68
%
<
mean
9.11
%
SD
14.36
%
<
p95
52.27
%
System
1.63
%
CPU percentiles
CPU usage percentiles
p50
5.05
%
p95
52.27
%
p99
64.88
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
3
hosts
mean time
0.01
s
Memory used percentage
Percentage of memory used
p5
6
%
<
mean
12
%
SD
5.89
%
<
p95
32.8
%
Memory available percentage
Percentage of available memory
p5
67.2
%
<
mean
88
%
SD
5.89
%
<
p95
94
%
Max host memory used
Maximum memory usage percentage across all hosts
max
32.92
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.04
%
Memory growth rate
Rate of memory growth over time
growth
94.41
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.02
MiB/s
Disk write throughput
Disk write throughput in MiB/s
36.72
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/5
hosts
Mount Point /efi-boot
0/4
hosts
Mount Point /etc/hostname
0/5
hosts
Mount Point /etc/hosts
0/5
hosts
Mount Point /etc/resolv.conf
0/5
hosts
Mount Point /nix/store
0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.77
5 min
1.69
15 min
2.55
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.6905
%
SD
1.8507
%
<
p95
3.46
%
60 second average
1.6126
%
300 second average
6.5032
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0.0005
%
≤
p95
0
%
60 second average
0.0002
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
5.347
%
SD
10.2507
%
<
p95
25.93
%
60 second average
5.8773
%
300 second average
7.7954
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
5.2025
%
SD
10.0024
%
<
p95
25.24
%
60 second average
5.6110
%
300 second average
6.6542
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.2
%
<
mean
4.5
%
SD
5.18
%
<
p95
10.35
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
230.90
KiB
<
mean
253.08
KiB
SD
29.96
KiB
<
p95
288.22
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
26.43
threads
SD
6.11
threads
<
p95
36
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
50
file descriptors
<
mean
77.01
file descriptors
SD
14.74
file descriptors
<
p95
95
file descriptors

Write/get_agent_activity

↑ Back to index

A scenario where write peers write entries, while get_agent_activity peers each query a single write agent's activity with get_agent_activity.

Before a target write peer and the requesting get_agent_activity peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started
Thu, 11 Jun 2026 02:27:05 UTC
Peer count
30
Peer count at end
24
Behaviours
  • get_agent_activity (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
write_get_agent_activity_27317315203_1
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
4225.83
Max
Highest chain head value observed for any single write agent.
7683
Write agents observed
6
get_agent_activity_full zome call timing
The time taken to call the zome function that retrieves information on a write peer's source chain.
Mean
mean
0.24704
s
SD
0.285258
s
Max
Highest per-partition mean latency
max mean
1.223637
s
Min
Lowest per-partition mean latency
min mean
0.010721
s
Error count
The number of errors accumulated.
8
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.001098
s
SD
0.001458
s
p50
0.000754
s
<
p95
0.003905
s
<
p99
0.005673
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 687.295930811s
Not enough time data to show a trend.
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37468.160496606s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
264282155
over 37468.160496606s
mean rate
2.6869237333e+08
/s
std
4.7622437296e+08
/s
p5
186202.19
/s
p95
1.32435463311e+09
/s
peak
1.88676343042e+09
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
1858353720
over 1910.471771618s
mean rate
3.51269941662e+09
/s
std
4.04437573075e+09
/s
p5
1.68728488e+06
/s
p95
1.28902391625e+10
/s
peak
1.67516469473e+10
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
10029367789
over 33076.673043039s
mean rate
8.6561805202e+08
/s
std
1.3435888004e+09
/s
p5
0
/s
p95
3.74622685186e+09
/s
peak
4.72932828381e+09
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
30960700
over 37469.651884713s
mean rate
1.8335977521e+08
/s
std
1.10252895359e+09
/s
p5
0
/s
p95
4.3322198739e+08
/s
peak
1.99232543736e+10
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.005855
s
SD
0.002793
s
p50
0.004768
s
<
p95
0.011835
s
≤
p99
0.011835
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.008113
s
SD
0.008179
s
p50
0.006372
s
<
p95
0.030871
s
<
p99
0.033039
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.088782
s
SD
0.169716
s
p50
0.14597
s
<
p95
0.353778
s
<
p99
1.115434
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.004678
s
SD
0.30805
s
p50
0.006737
s
<
p95
1.293959
s
≤
p99
1.293959
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004884
s
SD
0.002536
s
p50
0.003496
s
<
p95
0.010594
s
≤
p99
0.010594
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006945
s
SD
0.00738
s
p50
0.005415
s
<
p95
0.027466
s
<
p99
0.029536
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.090382
s
SD
0.169951
s
p50
0.149982
s
<
p95
0.352998
s
<
p99
1.114648
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004007
s
SD
0.308051
s
p50
0.005769
s
<
p95
1.293324
s
≤
p99
1.293324
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001102
s
SD
0.000694
s
p50
0.001005
s
<
p95
0.002269
s
<
p99
0.004034
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.8e-05
s
SD
1.1e-05
s
p50
2.7e-05
s
<
p95
4.5e-05
s
≤
p99
4.5e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.001694
s
SD
0.003398
s
p50
0.000666
s
<
p95
0.011049
s
<
p99
0.0129
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000622
s
SD
0.000542
s
p50
0.000388
s
<
p95
0.00196
s
≤
p99
0.00196
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.088148
s
SD
0.169794
s
p50
0.146541
s
<
p95
0.350764
s
<
p99
1.111261
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.001306
s
SD
0.307896
s
p50
0.001484
s
<
p95
1.289645
s
≤
p99
1.289645
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
9e-06
s
SD
6e-06
s
p50
1.4e-05
s
<
p95
2.7e-05
s
≤
p99
2.7e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001995
s
SD
0.001963
s
p50
0.001958
s
<
p95
0.006709
s
<
p99
0.012323
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000702
s
SD
0.00063
s
p50
0.000205
s
<
p95
0.001691
s
<
p99
0.003278
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
48.19
s
<
mean
454.37
s
SD
260.76
s
<
p95
858.57
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
19060
over 37469.651996332s
mean rate
135406.28
/s
std
226301.99
/s
p5
0
/s
p95
607255.3
/s
peak
4.17605421e+06
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
56.220054
s
SD
29.235782
s
p50
41.472543
s
<
p95
93.80497
s
<
p99
105.311539
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.883574
s
SD
0.29278
s
p50
1.999797
s
<
p95
2.012098
s
<
p99
2.026915
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.548548
s
SD
6.298624
s
p50
1.98451
s
<
p95
17.610053
s
<
p99
26.042974
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001109
s
SD
0.0009
s
p50
0.000744
s
<
p95
0.003354
s
<
p99
0.004254
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.027507
s
SD
0.643836
s
p50
0.022048
s
<
p95
1.723727
s
<
p99
3.79112
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.065063
s
SD
0.031717
s
p50
0.00184
s
<
p95
0.084385
s
<
p99
0.111218
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.960013
s
SD
23.802489
s
p50
6.724772
s
<
p95
73.024642
s
<
p99
103.216497
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.491265
s
SD
19.545567
s
p50
0.899965
s
<
p95
48.89158
s
<
p99
102.327434
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.001371
s
SD
0.002286
s
p50
0.000548
s
<
p95
0.006418
s
<
p99
0.010538
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.004199
s
SD
0.002882
s
p50
0.00309
s
<
p95
0.009284
s
<
p99
0.012241
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000169
s
SD
0.000289
s
p50
0.000175
s
<
p95
0.000993
s
<
p99
0.001523
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.00034
s
SD
0.000537
s
p50
0.000195
s
<
p95
0.000832
s
<
p99
0.003132
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.6e-05
s
SD
2.4e-05
s
p50
8.7e-05
s
<
p95
0.000126
s
<
p99
0.000164
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000214
s
SD
0.000177
s
p50
0.000155
s
<
p95
0.000501
s
<
p99
0.000977
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002737
s
SD
0.009915
s
p50
0.000584
s
<
p95
0.026098
s
<
p99
0.043084
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.001001
s
SD
0.00174
s
p50
0.000294
s
<
p95
0.003286
s
<
p99
0.009672
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
2.473799
s
SD
29.687411
s
p50
0.312824
s
<
p95
60.004705
s
<
p99
60.025681
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.389917
s
SD
0.440477
s
p50
0.292253
s
<
p95
1.287794
s
≤
p99
1.287794
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.171956
s
SD
21.373692
s
p50
0.154155
s
<
p95
60.001485
s
<
p99
60.00176
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.313836
s
SD
2.014784
s
p50
0.288252
s
<
p95
1.040234
s
<
p99
14.373826
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
39.69
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
62
B/s
<
mean
829.47
KiB/s
SD
756.28
KiB/s
<
p95
2.09
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
32
B/s
<
mean
1.12
MiB/s
SD
801.08
KiB/s
<
p95
2.45
MiB/s
Total bytes received
Total bytes received on primary network interface
count
19.26
GiB
mean
20.55
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
26.59
GiB
mean
28.37
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.2%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 401.57 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/7 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (36.6% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 19% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
14.82
%
<
mean
47.69
%
SD
29.12
%
<
p95
96.94
%
System
8.00
%
CPU percentiles
CPU usage percentiles
p50
36.04
%
p95
96.94
%
p99
98.25
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
15
hosts
mean time
0.40
s
Memory used percentage
Percentage of memory used
p5
7
%
<
mean
12.68
%
SD
6.14
%
<
p95
25.2
%
Memory available percentage
Percentage of available memory
p5
74.8
%
<
mean
87.32
%
SD
6.14
%
<
p95
93
%
Max host memory used
Maximum memory usage percentage across all hosts
max
36.50
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
36.62
%
Memory growth rate
Rate of memory growth over time
growth
401.57
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.07
MiB/s
Disk write throughput
Disk write throughput in MiB/s
248.28
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/9
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
1/7
hosts
Mount Point /etc/hosts
1/7
hosts
Mount Point /etc/resolv.conf
1/7
hosts
Mount Point /nix/store
0/9
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.57
5 min
2.77
15 min
2.47
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
18.52
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
14.0247
%
SD
24.3458
%
<
p95
90
%
60 second average
13.3490
%
300 second average
10.3180
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
10.755
%
SD
15.7362
%
<
p95
41.03
%
60 second average
10.3249
%
300 second average
8.5093
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
8.4325
%
SD
12.8255
%
<
p95
33.74
%
60 second average
8.1209
%
300 second average
6.8299
%
Holochain process CPU usage
CPU usage by Holochain process
p5
13.62
%
<
mean
43.48
%
SD
27.47
%
<
p95
94.13
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
229.48
KiB
<
mean
398.25
KiB
SD
109.17
KiB
<
p95
570.87
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
38.54
threads
SD
12.29
threads
<
p95
57
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
55
file descriptors
<
mean
84.64
file descriptors
SD
19.42
file descriptors
<
p95
120
file descriptors

Write/get_agent_activity with volatile conductors

↑ Back to index

A scenario where write peers write entries, while get_agent_activity_volatile peers each query a single write agents activity with get_agent_activity but shutdown and restart their conductors at semi-random intervals.

Before a target write peer and the requesting get_agent_activity_volatile peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started
Thu, 11 Jun 2026 02:42:57 UTC
Peer count
30
Peer count at end
21
Behaviours
  • get_agent_activity_volatile (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
write_get_agent_activity_volatile_27317315203_1
Highest observed action_seq
The rate at which zero-arc readers observe new chain heads on the writers' chains via get_agent_activity. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.
Mean
mean
36.85
/s
Max
Highest per-partition mean rate
max
56.15
/s
Min
Lowest per-partition mean rate
min
25.59
/s
get_agent_activity_full zome call timing
The time taken to call the zome function that retrieves information on a write peer's source chain.
Mean
mean
0.191342
s
SD
0.207129
s
Max
Highest per-partition mean latency
max mean
0.254527
s
Min
Lowest per-partition mean latency
min mean
0.126854
s
Running volatile conductors count
The number of conductors running by get_agent_activity_volatile peers.
p5
6
conductors
<
mean
10.07
conductors
SD
2.44
conductors
<
p95
14
conductors
Volatile conductor total running duration
The total running duration of a get_agent_activity_volatile conductor.
Mean
mean
655.223457
s
SD
337.190416
s
Max
Highest per-partition mean latency
max mean
1105.357143
s
Min
Lowest per-partition mean latency
min mean
93
s
Volatile conductor running duration
The duration that a get_agent_activity_volatile conductor was running before being stopped.
Mean
mean
41.545449
s
SD
26.007821
s
Max
Highest per-partition mean latency
max mean
140.325729
s
Min
Lowest per-partition mean latency
min mean
20.603177
s
Volatile conductor stopped duration
The duration that a get_agent_activity_volatile conductor was stopped before being started again.
Mean
mean
23.733051
s
SD
26.616928
s
Max
Highest per-partition mean latency
max mean
38.089495
s
Min
Lowest per-partition mean latency
min mean
8.056595
s
Reached target arc
Did get_agent_activity_volatile peer reach their target arc in the moment before they were shutdown.
  • get_agent_activity_volatile_agent: uhCAk0FlndjOSRibHqKF4AT15JFgrcEVt2ta2BJrftz2XpeVSaJhT
p5
0
<
mean
0.05
SD
0.23
<
p95
1
  • get_agent_activity_volatile_agent: uhCAk0vOOe8itEmyxyyuHYFNFCWx7Iegbn4ldZ_zz2CFXsd5OetXE
p5
0
≤
mean
0
SD
0
≤
p95
0
  • get_agent_activity_volatile_agent: uhCAk4y5QzBTRSmQdFa6mmzVG6fZNOV3pimrOeGrmoRiklHAnAB_B
p5
0
<
mean
0.04
SD
0.2
≤
p95
0
  • get_agent_activity_volatile_agent: uhCAk8QDQDJ5m5rTPOAdrHjzmL6BM0olWQy2BXhu_EpA4dTgRACxf
p5
0
<
mean
0.11
SD
0.31
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkIFVbnuB2uq1ZgywLNYmPXQFPCPAzMJCMMxS312KNNGPASbsp
p5
0
<
mean
0.09
SD
0.28
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkJ_AXMQoya7qM8wKVBVKFNGPcM4OdvRBC9O9If245XuirZELS
p5
0
<
mean
0.5
SD
0.5
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkMxUrgvUw8-M4wEnGUwcs9AXTWNrm4vgRCDRPP9WVJ1i2cjJx
p5
0
<
mean
0.11
SD
0.31
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkTlrP4Ul9iNiRjJb1m6BvyQmRtl9xKFC6vGY_-SG-T3xegmuV
p5
0
<
mean
0.05
SD
0.21
≤
p95
0
  • get_agent_activity_volatile_agent: uhCAkYgM8iEaWkpJllBlYrbkBNASRNa7Q1ZH-F4vIEIB6GhN3IWvt
p5
0
<
mean
0.07
SD
0.25
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkZ4uJgTdWyQ049l0W7eEaoDpVNsDGyEEVLzZIX3sHQwLeJE_J
p5
0
<
mean
0.06
SD
0.23
<
p95
1
  • get_agent_activity_volatile_agent: uhCAk_bRmQk-37U4Sxu7mYJmiyly-YPeo4UmZ-fdxILsyYgL_qz-X
p5
0
≤
mean
0
SD
0
≤
p95
0
  • get_agent_activity_volatile_agent: uhCAkf_ZqEgOS4b6TIhsUgjTk6l3XCA_6tTERfvPqzVLkoKMsGjxw
p5
0
<
mean
0.07
SD
0.25
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkiI2jKCAtueFblAQJ-X1WHf9upz0bZXbSTZkB3Lgy6dM08yb2
p5
0
<
mean
0.06
SD
0.24
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkjPaPz6pPx3HXD73mMMfZtr_s-vixUmhzgFNfSRKh-PM932sQ
p5
0
<
mean
0.16
SD
0.36
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkjT0jNiOfDGi6R07fnyn1zj1Izh8foLJxNLkbxLmfLhy-7P_X
p5
0
<
mean
0.08
SD
0.28
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkrHykomGAkIWy6rc0K5Xa0_hqbfmfer95ZN7W6OW8MsbH-vrB
p5
0
<
mean
0.04
SD
0.2
≤
p95
0
  • get_agent_activity_volatile_agent: uhCAkuaEY3bbJ2GlFzoDGnnYgvURsTodLrV4-9oQuhQCKrVwEBGKA
p5
0
<
mean
0.02
SD
0.15
≤
p95
0
  • get_agent_activity_volatile_agent: uhCAkysfYkWy3npyIjdZu-Iv8rQTsCdsPoVTEbo78IYw2Ha2qn7Su
p5
0
<
mean
0.08
SD
0.27
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkzF37oatNyTYnOhIHSZdxR9I8PUTQuaxiNUeU2j6uO61iYe8B
p5
0
<
mean
0.05
SD
0.21
≤
p95
0
Error count
The number of errors accumulated.
41
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000357
s
SD
0.00233
s
p50
0.000401
s
<
p95
0.009165
s
≤
p99
0.009165
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
1
over 1722.224564908s
mean rate
0.13
/s
std
0.14
/s
p5
0
/s
p95
0.3
/s
peak
0.3
/s
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 2808.910565287s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
44181036
over 2808.910565287s
mean rate
1.2325391165e+08
/s
std
1.2271489904e+08
/s
p5
16927.41
/s
p95
3.4114483337e+08
/s
peak
3.8450593744e+08
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
48699701
over 1796.417253136s
mean rate
5.1586777427e+08
/s
std
3.46998232533e+09
/s
p5
4.91416632e+06
/s
p95
1.31732372229e+09
/s
peak
8.16547620429e+10
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
221983489
over 38360.12250305s
mean rate
1.6082573965e+08
/s
std
3.3791697233e+08
/s
p5
181.77
/s
p95
7.3473148874e+08
/s
peak
1.82035649938e+09
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
14759474
over 38360.12250305s
mean rate
1.296191474e+07
/s
std
1.415143006e+07
/s
p5
1386.28
/s
p95
3.725112302e+07
/s
peak
1.2108111636e+08
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.004494
s
SD
0.001907
s
p50
0.00311
s
<
p95
0.008702
s
≤
p99
0.008702
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004482
s
SD
0.001056
s
p50
0.00477
s
<
p95
0.006277
s
<
p99
0.006922
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.163232
s
SD
0.099481
s
p50
0.212165
s
<
p95
0.377317
s
<
p99
0.512274
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.003775
s
SD
0.319015
s
p50
0.003509
s
<
p95
1.344413
s
≤
p99
1.344413
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00371
s
SD
0.001557
s
p50
0.002558
s
<
p95
0.007084
s
≤
p99
0.007084
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003649
s
SD
0.000897
s
p50
0.003901
s
<
p95
0.00516
s
<
p99
0.005768
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.197676
s
SD
6.212216
s
p50
0.209722
s
<
p95
0.386697
s
<
p99
14.989888
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003145
s
SD
0.275314
s
p50
0.002909
s
<
p95
1.148439
s
≤
p99
1.148439
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001124
s
SD
0.000291
s
p50
0.001206
s
<
p95
0.00162
s
<
p99
0.002141
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.7e-05
s
SD
1.1e-05
s
p50
2.6e-05
s
<
p95
5e-05
s
≤
p99
5e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000344
s
SD
0.000102
s
p50
0.000357
s
<
p95
0.000534
s
<
p99
0.000543
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000328
s
SD
0.000134
s
p50
0.00026
s
<
p95
0.000587
s
≤
p99
0.000587
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.193019
s
SD
6.212274
s
p50
0.206851
s
<
p95
0.382392
s
<
p99
14.988654
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000644
s
SD
0.27534
s
p50
0.000549
s
<
p95
1.145821
s
≤
p99
1.145821
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
5e-06
s
p50
8e-06
s
<
p95
2.1e-05
s
≤
p99
2.1e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002003
s
SD
0.000677
s
p50
0.001909
s
<
p95
0.003573
s
≤
p99
0.003573
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000266
s
SD
0.000182
s
p50
0.000375
s
<
p95
0.000648
s
<
p99
0.000683
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
4.58
s
<
mean
389.58
s
SD
540.88
s
<
p95
1588.54
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
26.592045
s
SD
29.968064
s
p50
21.001121
s
<
p95
69.957903
s
<
p99
131.536738
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.649931
s
SD
0.598988
s
p50
1.726143
s
<
p95
2.234694
s
<
p99
3.733333
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.111011
s
SD
4.209799
s
p50
0.08012
s
<
p95
2.67854
s
<
p99
27.22117
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001445
s
SD
0.001228
s
p50
0.001186
s
<
p95
0.003774
s
<
p99
0.006288
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.027649
s
SD
0.051724
s
p50
0.004523
s
<
p95
0.068723
s
<
p99
0.188251
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.093879
s
SD
0.108158
s
p50
0.008251
s
<
p95
0.35979
s
<
p99
0.407225
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.434462
s
SD
11.563999
s
p50
0.147556
s
<
p95
23.697576
s
<
p99
42.104429
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
2.529466
s
SD
27.04553
s
p50
1.5151
s
<
p95
105.386859
s
≤
p99
105.386859
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.005161
s
SD
0.002123
s
p50
0.000324
s
<
p95
0.007079
s
<
p99
0.008522
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.007482
s
SD
0.004367
s
p50
0.002207
s
<
p95
0.012927
s
<
p99
0.016832
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000221
s
SD
7.9e-05
s
p50
0.000137
s
<
p95
0.000318
s
<
p99
0.000372
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000131
s
SD
0.000104
s
p50
0.000128
s
<
p95
0.000283
s
<
p99
0.000564
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.010908
s
SD
0.010186
s
p50
0.01379
s
<
p95
0.024004
s
<
p99
0.038673
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000108
s
SD
6.8e-05
s
p50
0.000121
s
<
p95
0.000254
s
<
p99
0.000328
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.004092
s
SD
0.059654
s
p50
0.000618
s
<
p95
0.027161
s
<
p99
0.171891
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000291
s
SD
0.000401
s
p50
0.000416
s
<
p95
0.001222
s
<
p99
0.00238
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
5.041136
s
SD
28.71041
s
p50
0.256195
s
<
p95
60.001605
s
<
p99
60.00172
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.129672
s
SD
0.141319
s
p50
0.081253
s
<
p95
0.50203
s
≤
p99
0.50203
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.207251
s
SD
11.137073
s
p50
0.208443
s
<
p95
0.455826
s
<
p99
60.001249
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
1.004675
s
SD
28.56939
s
p50
0.554741
s
<
p95
60.013338
s
<
p99
60.040883
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
18.90
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
46
B/s
<
mean
350.90
KiB/s
SD
499.98
KiB/s
<
p95
1.36
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
30
B/s
<
mean
489.93
KiB/s
SD
1.02
MiB/s
<
p95
2.28
MiB/s
Total bytes received
Total bytes received on primary network interface
count
15.53
GiB
mean
8.60
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
21.69
GiB
mean
12.01
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 93.8%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 329.46 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 7% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.65
%
<
mean
24.05
%
SD
25.93
%
<
p95
84.6
%
System
5.15
%
CPU percentiles
CPU usage percentiles
p50
13.11
%
p95
84.60
%
p99
93.77
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
8
hosts
mean time
0.21
s
Memory used percentage
Percentage of memory used
p5
5.26
%
<
mean
11.07
%
SD
7.57
%
<
p95
15.53
%
Memory available percentage
Percentage of available memory
p5
84.47
%
<
mean
88.93
%
SD
7.57
%
<
p95
94.74
%
Max host memory used
Maximum memory usage percentage across all hosts
max
76.34
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.04
%
Memory growth rate
Rate of memory growth over time
growth
329.46
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.09
MiB/s
Disk write throughput
Disk write throughput in MiB/s
97.43
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/8
hosts
Mount Point /efi-boot
0/6
hosts
Mount Point /etc/hostname
0/7
hosts
Mount Point /etc/hosts
0/7
hosts
Mount Point /etc/resolv.conf
0/7
hosts
Mount Point /nix/store
0/8
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.77
5 min
1.92
15 min
2.08
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
7.41
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
2.52
%
SD
4.8535
%
<
p95
14.25
%
60 second average
2.6898
%
300 second average
3.9898
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
6.8106
%
SD
13.7201
%
<
p95
39.77
%
60 second average
6.8973
%
300 second average
7.3793
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
5.8139
%
SD
11.909
%
<
p95
34.57
%
60 second average
5.8868
%
300 second average
6.2288
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
<
mean
21.44
%
SD
26.63
%
<
p95
83.62
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
51.60
KiB
<
mean
222.89
KiB
SD
161.61
KiB
<
p95
526.47
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
22.72
threads
SD
12.78
threads
<
p95
46
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
<
mean
73.61
file descriptors
SD
31.47
file descriptors
<
p95
127
file descriptors

Write/Query

↑ Back to index

Creates an entry, then queries the source chain and performs a simple operation on the entries, then repeats.

Started
Thu, 11 Jun 2026 01:29:30 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
write_query_27317315203_1
Write timing
The time it takes to complete the zome function call that writes the entry.
mean
0.090769
s
SD
0.283973
s
p50
0.011393
s
<
p95
0.606883
s
<
p99
1.472229
s
Write rate
The number of writes completed per second.
mean
75.21
/s
Query timing
The time it takes to complete the chain_query_count_len zome call that queries the source chain.
mean
0.040516
s
SD
0.034032
s
p50
0.037979
s
<
p95
0.074905
s
<
p99
0.088399
s
Query rate
The number of chain queries completed per second.
mean
75.25
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::chain_query_count_len'
Metered usage count of the WASM ribosome for this zome function.
total
85087459400
over 280.002786439s
mean rate
3.0388070341e+08
/s
std
1.5056313484e+08
/s
p5
8.945255023e+07
/s
p95
5.5817134405e+08
/s
peak
5.6055068299e+08
/s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
85615335
over 280.002786439s
mean rate
305766.07
/s
std
130625.95
/s
p5
195446.54
/s
p95
556602.06
/s
peak
582095.49
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.002786439s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
20446552
over 290.002919314s
mean rate
70504.64
/s
std
33935.88
/s
p5
42296.18
/s
p95
127354.37
/s
peak
171508.92
/s
Zome call duration: 'crud::chain_query_count_len'
Duration of this zome call as measured by Holochain internally.
mean
0.025105
s
SD
0.008202
s
p50
0.022414
s
<
p95
0.032229
s
<
p99
0.032904
s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.003275
s
SD
0.000104
s
p50
0.003264
s
<
p95
0.00351
s
<
p99
0.003571
s
WASM call duration: 'crud::chain_query_count_len'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.024294
s
SD
0.008184
s
p50
0.021617
s
<
p95
0.031402
s
<
p99
0.032077
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002678
s
SD
9e-05
s
p50
0.00267
s
<
p95
0.002883
s
<
p99
0.002935
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001119
s
SD
0
s
p50
0.001119
s
≤
p95
0.001119
s
≤
p99
0.001119
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000942
s
SD
4e-05
s
p50
0.000937
s
<
p95
0.000983
s
≤
p99
0.000983
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000262
s
SD
2.4e-05
s
p50
0.000257
s
<
p95
0.000277
s
<
p99
0.000287
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.00852
s
SD
0.003229
s
p50
0.007587
s
<
p95
0.011226
s
<
p99
0.011446
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001523
s
SD
0.000106
s
p50
0.001556
s
<
p95
0.001667
s
<
p99
0.001669
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000245
s
SD
1e-05
s
p50
0.000243
s
<
p95
0.000261
s
<
p99
0.000262
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
16.38
s
<
mean
151.38
s
SD
86.56
s
<
p95
286.38
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
6603
over 290.002941039s
mean rate
22.77
/s
std
11
/s
p5
13.2
/s
p95
41.1
/s
peak
55.8
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.027195
s
SD
0.017681
s
p50
0.027402
s
<
p95
0.034346
s
<
p99
0.122159
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.00038
s
SD
0
s
p50
0.00038
s
≤
p95
0.00038
s
≤
p99
0.00038
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001182
s
SD
0
s
p50
0.001182
s
≤
p95
0.001182
s
≤
p99
0.001182
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.013077
s
SD
0.002832
s
p50
0.012958
s
<
p95
0.016334
s
<
p99
0.016551
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.014836
s
SD
0.00517
s
p50
0.012679
s
<
p95
0.019083
s
<
p99
0.019399
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000883
s
SD
0
s
p50
0.000883
s
≤
p95
0.000883
s
≤
p99
0.000883
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.004281
s
SD
0.001546
s
p50
0.003798
s
<
p95
0.005558
s
<
p99
0.005674
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.002064
s
SD
0.000749
s
p50
0.001867
s
<
p95
0.002649
s
<
p99
0.002698
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001222
s
SD
0.000598
s
p50
0.001145
s
<
p95
0.001895
s
<
p99
0.001946
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000112
s
SD
1.6e-05
s
p50
0.000111
s
<
p95
0.000115
s
<
p99
0.000197
s
Cache DB connection use time
Time spent holding cache database connections.
mean
9.7e-05
s
SD
1.2e-05
s
p50
9.7e-05
s
<
p95
0.000104
s
<
p99
0.000162
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000179
s
SD
0
s
p50
0.000179
s
≤
p95
0.000179
s
≤
p99
0.000179
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
7.9e-05
s
SD
3e-06
s
p50
7.9e-05
s
<
p95
8.2e-05
s
<
p99
9.7e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.007403
s
SD
0.008619
s
p50
0.007168
s
<
p95
0.024222
s
≤
p99
0.024222
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000227
s
SD
6e-05
s
p50
0.000227
s
<
p95
0.000252
s
<
p99
0.00056
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
17.69
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
19.93
KiB/s
<
mean
23.25
KiB/s
SD
1.93
KiB/s
<
p95
26.07
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
26.32
KiB/s
<
mean
31.61
KiB/s
SD
2.63
KiB/s
<
p95
35.62
KiB/s
Total bytes received
Total bytes received on primary network interface
count
6.81
MiB
mean
23.25
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
9.26
MiB
mean
31.61
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
16.37
%
<
mean
23.36
%
SD
8.44
%
<
p95
32.19
%
System
5.67
%
CPU percentiles
CPU usage percentiles
p50
20.83
%
p95
32.19
%
p99
59.42
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
21.6
%
<
mean
22.16
%
SD
0.78
%
<
p95
23.39
%
Memory available percentage
Percentage of available memory
p5
76.61
%
<
mean
77.84
%
SD
0.78
%
<
p95
78.4
%
Max host memory used
Maximum memory usage percentage across all hosts
max
22.16
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-163.06
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
6.88
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /efi-boot
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.97
5 min
1.18
15 min
0.54
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.73
%
<
mean
1.3423
%
SD
0.4424
%
<
p95
1.99
%
60 second average
1.3690
%
300 second average
1.5516
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
10.47
%
<
mean
23.9477
%
SD
8.3597
%
<
p95
36.72
%
60 second average
20.5271
%
300 second average
11.2384
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
8.98
%
<
mean
21.2716
%
SD
7.4754
%
<
p95
32.35
%
60 second average
18.1574
%
300 second average
9.9468
%
Holochain process CPU usage
CPU usage by Holochain process
p5
6.97
%
<
mean
15.15
%
SD
9.34
%
<
p95
25.47
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
1.47
KiB
<
mean
215.37
KiB
SD
66.35
KiB
<
p95
250.65
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
<
mean
12.82
threads
SD
3.86
threads
<
p95
15
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
5
file descriptors
<
mean
52.5
file descriptors
SD
16.1
file descriptors
<
p95
64
file descriptors

Write/Read

↑ Back to index

Creates an entry and reads it back, then repeats.

Started
Thu, 11 Jun 2026 01:31:22 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
write_read_27317315203_1
Write timing
The time taken to write the entry.
mean
0.139949
s
SD
0.437724
s
p50
0.011978
s
<
p95
1.068419
s
<
p99
2.407064
s
Write rate
The number of writes completed per second.
mean
63.5
/s
Read timing
The time taken to read the entry.
mean
0.015869
s
SD
0.019711
s
p50
0.013045
s
<
p95
0.03465
s
<
p99
0.053324
s
Read rate
The number of reads completed per second.
mean
63.5
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.004774
s
SD
0.001543
s
p50
0.004341
s
<
p95
0.006188
s
<
p99
0.006346
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
77627403
over 290.003096029s
mean rate
267677.91
/s
std
117138.28
/s
p5
140211.86
/s
p95
480119.79
/s
peak
637328.8
/s
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
88141255
over 290.003096029s
mean rate
303932.2
/s
std
132317.51
/s
p5
159364.8
/s
p95
543143.41
/s
peak
717943.22
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 290.003096029s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
8491896
over 290.003096029s
mean rate
29282.09
/s
std
12814.11
/s
p5
15338.2
/s
p95
52521.75
/s
peak
69719.32
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.003518
s
SD
7.6e-05
s
p50
0.003523
s
<
p95
0.003547
s
<
p99
0.003554
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006882
s
SD
0.001608
s
p50
0.006454
s
<
p95
0.008299
s
<
p99
0.008453
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002865
s
SD
6.4e-05
s
p50
0.002872
s
<
p95
0.002891
s
<
p99
0.002901
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006088
s
SD
0.001582
s
p50
0.005658
s
<
p95
0.007506
s
<
p99
0.007661
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001149
s
SD
0
s
p50
0.001149
s
≤
p95
0.001149
s
≤
p99
0.001149
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000941
s
SD
2.5e-05
s
p50
0.000944
s
<
p95
0.000953
s
<
p99
0.000955
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000267
s
SD
2.4e-05
s
p50
0.000239
s
<
p95
0.00027
s
<
p99
0.000271
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.004829
s
SD
0.001544
s
p50
0.004396
s
<
p95
0.006243
s
<
p99
0.006401
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001509
s
SD
3.3e-05
s
p50
0.001512
s
<
p95
0.001524
s
<
p99
0.001529
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.00029
s
SD
2.2e-05
s
p50
0.000289
s
<
p95
0.000299
s
<
p99
0.0003
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
16.68
s
<
mean
151.68
s
SD
86.56
s
<
p95
286.69
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
5478
over 290.003109666s
mean rate
18.89
/s
std
8.24
/s
p5
9.9
/s
p95
33.9
/s
peak
44.7
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.033782
s
SD
0.007381
s
p50
0.03413
s
<
p95
0.038328
s
<
p99
0.038539
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000491
s
SD
0
s
p50
0.000491
s
≤
p95
0.000491
s
≤
p99
0.000491
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001311
s
SD
0
s
p50
0.001311
s
≤
p95
0.001311
s
≤
p99
0.001311
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.019921
s
SD
0.005602
s
p50
0.019624
s
<
p95
0.02378
s
<
p99
0.023828
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.017749
s
SD
0.0062
s
p50
0.01708
s
<
p95
0.0231
s
<
p99
0.023351
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001661
s
SD
0
s
p50
0.001661
s
≤
p95
0.001661
s
≤
p99
0.001661
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.003913
s
SD
0.001319
s
p50
0.003437
s
<
p95
0.005148
s
<
p99
0.005282
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.001635
s
SD
0.000522
s
p50
0.00147
s
<
p95
0.00213
s
<
p99
0.002182
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001975
s
SD
0.000845
s
p50
0.001785
s
<
p95
0.002939
s
<
p99
0.003033
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000115
s
SD
6e-06
s
p50
0.000114
s
<
p95
0.000119
s
<
p99
0.00012
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.002409
s
SD
0.000772
s
p50
0.002192
s
<
p95
0.003118
s
<
p99
0.003197
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.0002
s
SD
0
s
p50
0.0002
s
≤
p95
0.0002
s
≤
p99
0.0002
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
8.5e-05
s
SD
6e-06
s
p50
8.1e-05
s
<
p95
9.3e-05
s
≤
p99
9.3e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.010179
s
SD
0.009187
s
p50
0.008978
s
<
p95
0.024952
s
≤
p99
0.024952
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000231
s
SD
4e-06
s
p50
0.000232
s
<
p95
0.000235
s
<
p99
0.000251
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
12.61
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
10.88
KiB/s
<
mean
102.69
KiB/s
SD
477.32
KiB/s
≤
p95
30.61
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
13.68
KiB/s
<
mean
19.89
KiB/s
SD
8.48
KiB/s
<
p95
29.62
KiB/s
Total bytes received
Total bytes received on primary network interface
count
31.09
MiB
mean
102.69
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
6.02
MiB
mean
19.89
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 20.72 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
11.43
%
<
mean
16.84
%
SD
8.13
%
<
p95
19.63
%
System
4.23
%
CPU percentiles
CPU usage percentiles
p50
15.47
%
p95
19.63
%
p99
59.93
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
15.36
%
<
mean
15.54
%
SD
0.55
%
<
p95
16.12
%
Memory available percentage
Percentage of available memory
p5
83.88
%
<
mean
84.46
%
SD
0.55
%
<
p95
84.64
%
Max host memory used
Maximum memory usage percentage across all hosts
max
15.54
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
20.72
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
5.63
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.08
5 min
1.11
15 min
0.49
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.59
%
<
mean
0.8631
%
SD
0.3043
%
<
p95
1.19
%
60 second average
0.7725
%
300 second average
0.3916
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
9.62
%
<
mean
34.3825
%
SD
9.3937
%
<
p95
48.18
%
60 second average
29.2931
%
300 second average
14.6406
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
8.36
%
<
mean
31.2597
%
SD
8.6183
%
<
p95
43.45
%
60 second average
26.5919
%
300 second average
13.2822
%
Holochain process CPU usage
CPU usage by Holochain process
p5
4.61
%
<
mean
9.53
%
SD
8.48
%
<
p95
12.24
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
235.95
KiB
<
mean
240.05
KiB
SD
10.74
KiB
<
p95
244.57
KiB
Holochain process threads
Number of threads in Holochain process
p5
14
threads
<
mean
14.78
threads
SD
1.6
threads
<
p95
15
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
50
file descriptors
<
mean
62.78
file descriptors
SD
9.99
file descriptors
<
p95
70
file descriptors

Write validated

↑ Back to index

Creates an entry, updates it and links the create to the update, then repeats. Each of the three actions is validated by the included hApp.

Started
Thu, 11 Jun 2026 01:33:21 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
write_validated_27317315203_1
Write timing
The time it takes to complete the zome function call that writes the entry, updates it, and links to the update.
mean
0.124352
s
SD
0.291826
s
p50
0.03891
s
<
p95
0.660728
s
<
p99
1.46776
s
Write rate
The number of write zome function calls that complete per second.
mean
30.85
/s
Read timing
The time it takes to complete the zome function call that reads the data.
mean
0.18671
s
SD
0.372732
s
p50
0.068998
s
<
p95
1.016817
s
<
p99
1.89768
s
Read rate
The number of read zome function calls that complete per second.
mean
30.88
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000736
s
SD
0.000255
s
p50
0.000906
s
<
p95
0.00112
s
<
p99
0.001124
s
WASM usage: 'validated::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
33661820
over 270.002648106s
mean rate
124671.98
/s
std
57969.32
/s
p5
61576.13
/s
p95
225778.54
/s
peak
225779.09
/s
WASM usage: 'validated::update_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
39424203
over 270.002648106s
mean rate
146013.88
/s
std
68250.96
/s
p5
72205.06
/s
p95
259938.18
/s
peak
269564.86
/s
WASM usage: 'validated_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
57459040
over 280.002731817s
mean rate
205208.55
/s
std
102190.87
/s
p5
96809.42
/s
p95
355888.91
/s
peak
458230.16
/s
WASM usage: 'validated_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
664490554
over 270.002648106s
mean rate
2.46104779e+06
/s
std
1.15038508e+06
/s
p5
1.21666065e+06
/s
p95
4.45350471e+06
/s
peak
4.4686607e+06
/s
Zome call duration: 'validated::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005118
s
SD
0.000246
s
p50
0.005168
s
<
p95
0.005194
s
<
p99
0.005196
s
Zome call duration: 'validated::update_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006411
s
SD
0.000313
s
p50
0.006412
s
<
p95
0.006588
s
<
p99
0.006596
s
WASM call duration: 'validated::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004142
s
SD
0.000217
s
p50
0.004183
s
<
p95
0.004213
s
≤
p99
0.004213
s
WASM call duration: 'validated::update_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005432
s
SD
0.000271
s
p50
0.005425
s
<
p95
0.005601
s
<
p99
0.005608
s
WASM call duration: 'validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001089
s
SD
4.1e-05
s
p50
0.001088
s
<
p95
0.00112
s
<
p99
0.001133
s
WASM call duration: 'validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003442
s
SD
0.000153
s
p50
0.003447
s
<
p95
0.003548
s
<
p99
0.003555
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.00038
s
SD
2.1e-05
s
p50
0.000384
s
<
p95
0.000391
s
<
p99
0.000392
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000383
s
SD
1.3e-05
s
p50
0.000384
s
<
p95
0.000394
s
≤
p99
0.000394
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.00079
s
SD
5.3e-05
s
p50
0.000794
s
<
p95
0.000827
s
<
p99
0.000828
s
Host function call duration: '__hc__update_1'
Duration of this host function call invoked from within WASM.
mean
0.001527
s
SD
7.9e-05
s
p50
0.00152
s
<
p95
0.001584
s
<
p99
0.001585
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001932
s
SD
0.000198
s
p50
0.002022
s
<
p95
0.002342
s
<
p99
0.002355
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000409
s
SD
3.2e-05
s
p50
0.000404
s
<
p95
0.000442
s
<
p99
0.000446
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
16.74
s
<
mean
151.75
s
SD
86.56
s
<
p95
286.75
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
9794
over 280.002728846s
mean rate
34.98
/s
std
17.35
/s
p5
16.5
/s
p95
60.8
/s
peak
77.7
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.036632
s
SD
0.024314
s
p50
0.03725
s
<
p95
0.044573
s
<
p99
0.164544
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001312
s
SD
0
s
p50
0.001312
s
≤
p95
0.001312
s
≤
p99
0.001312
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001294
s
SD
0
s
p50
0.001294
s
≤
p95
0.001294
s
≤
p99
0.001294
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.017956
s
SD
0.005397
s
p50
0.01559
s
<
p95
0.022548
s
<
p99
0.023012
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.039186
s
SD
0.019087
s
p50
0.028089
s
<
p95
0.061571
s
<
p99
0.063434
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.004114
s
SD
0
s
p50
0.004114
s
≤
p95
0.004114
s
≤
p99
0.004114
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.007575
s
SD
0.002799
s
p50
0.006991
s
<
p95
0.009872
s
<
p99
0.010085
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.002565
s
SD
0.000913
s
p50
0.002389
s
<
p95
0.003289
s
<
p99
0.003352
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001482
s
SD
0.00063
s
p50
0.001433
s
<
p95
0.002064
s
<
p99
0.002109
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000276
s
SD
4.2e-05
s
p50
0.000278
s
<
p95
0.000287
s
<
p99
0.000288
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000372
s
SD
6.4e-05
s
p50
0.000366
s
<
p95
0.000393
s
<
p99
0.000394
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000111
s
SD
0
s
p50
0.000111
s
≤
p95
0.000111
s
≤
p99
0.000111
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000145
s
SD
2e-05
s
p50
0.000145
s
<
p95
0.000155
s
<
p99
0.00022
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.009337
s
SD
0.152816
s
p50
0.001436
s
<
p95
0.413965
s
≤
p99
0.413965
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000315
s
SD
0.000134
s
p50
0.000318
s
<
p95
0.00032
s
<
p99
0.001043
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
41.85
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
37
B/s
<
mean
1.48
KiB/s
SD
1.27
KiB/s
<
p95
3.52
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
17
B/s
<
mean
723
B/s
SD
746
B/s
<
p95
1.95
KiB/s
Total bytes received
Total bytes received on primary network interface
count
443.80
KiB
mean
1.48
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
211.82
KiB
mean
723
B/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 90.5%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 117.39 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
52.92
%
<
mean
58.25
%
SD
8.07
%
<
p95
80.63
%
System
16.40
%
CPU percentiles
CPU usage percentiles
p50
55.22
%
p95
80.63
%
p99
90.54
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.07
s
Memory used percentage
Percentage of memory used
p5
15.01
%
<
mean
17.68
%
SD
0.95
%
<
p95
18.2
%
Memory available percentage
Percentage of available memory
p5
81.8
%
<
mean
82.32
%
SD
0.95
%
<
p95
84.99
%
Max host memory used
Maximum memory usage percentage across all hosts
max
17.68
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
117.39
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
10.99
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
0/1
hosts
Mount Point /etc/hosts
0/1
hosts
Mount Point /etc/resolv.conf
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.22
5 min
3.09
15 min
1.73
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
11.17
%
<
mean
16.3061
%
SD
5.2344
%
<
p95
24.85
%
60 second average
14.9648
%
300 second average
10.0235
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
4.64
%
<
mean
18.0671
%
SD
5.703
%
<
p95
26.43
%
60 second average
14.6839
%
300 second average
7.2139
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
2.26
%
<
mean
8.67
%
SD
2.7823
%
<
p95
12.78
%
60 second average
7.0152
%
300 second average
3.5074
%
Holochain process CPU usage
CPU usage by Holochain process
p5
8.28
%
<
mean
16.04
%
SD
10.91
%
<
p95
44.25
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
165.85
KiB
<
mean
476.42
KiB
SD
113.98
KiB
<
p95
518.10
KiB
Holochain process threads
Number of threads in Holochain process
p5
7
threads
<
mean
14.38
threads
SD
2.89
threads
<
p95
15
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
11
file descriptors
<
mean
60.25
file descriptors
SD
14.35
file descriptors
<
p95
70
file descriptors

Write Validated must_get_agent_activity

↑ Back to index

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Mixed-Arc must_get_agent_activity, but all agents are full-arc.

Started
Thu, 11 Jun 2026 03:13:44 UTC
Peer count
30
Peer count at end
25
Behaviours
  • must_get_agent_activity (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
write_validated_must_get_agent_activity_27317315203_1
Highest observed action_seq
The maximum chain length observed per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1369
Max
Highest chain head value observed for any single write agent.
1897
Write agents observed
6
Chain batch delay timing
The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.
Mean
mean
113.92985
s
SD
27.877603
s
Max
Highest per-partition mean latency
max mean
1025.699433
s
Min
Lowest per-partition mean latency
min mean
8.798418
s
Chain batch delay rate
The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.
Mean
mean
2.22
/s
Max
Highest per-partition mean rate
max
5.4
/s
Min
Lowest per-partition mean rate
min
0
/s
create_validated_sample_entry zome call timing
The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.
Mean
mean
0.429013
s
SD
0.12454
s
Max
Highest per-partition mean latency
max mean
3.80694
s
Min
Lowest per-partition mean latency
min mean
0.067159
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.
Total
3476
Agents affected
19 / 19
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
183
Max
Highest count in any single partition
777
Min
Lowest count in any single partition
15
Final error count
The total number of all types of error accumulated over the run by all agents.
71429
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.031741
s
SD
0.031797
s
p50
0.001972
s
<
p95
0.057841
s
<
p99
0.186722
s
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.004601
s
SD
0.001927
s
p50
0.003576
s
<
p95
0.00761
s
≤
p99
0.00761
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.054109
s
SD
0.008131
s
p50
0.051261
s
<
p95
0.06584
s
<
p99
0.067962
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005766
s
SD
0.001878
s
p50
0.005313
s
<
p95
0.008538
s
<
p99
0.010515
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.051808
s
SD
0.038738
s
p50
0.03195
s
<
p95
0.126219
s
<
p99
0.176668
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.010868
s
SD
0.013422
s
p50
0.007583
s
<
p95
0.059732
s
≤
p99
0.059732
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003841
s
SD
0.001653
s
p50
0.002958
s
<
p95
0.006304
s
≤
p99
0.006304
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.053025
s
SD
0.008044
s
p50
0.050121
s
<
p95
0.064561
s
<
p99
0.066732
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004749
s
SD
0.001573
s
p50
0.00432
s
<
p95
0.007095
s
<
p99
0.008697
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.03715
s
SD
0.047794
s
p50
0.027773
s
<
p95
0.161583
s
<
p99
0.227111
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.009587
s
SD
0.0135
s
p50
0.006404
s
<
p95
0.059045
s
≤
p99
0.059045
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001098
s
SD
0.00037
s
p50
0.001141
s
<
p95
0.001835
s
<
p99
0.00245
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.008739
s
SD
0.007767
s
p50
0.007635
s
<
p95
0.024795
s
<
p99
0.041318
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.3e-05
s
SD
9e-06
s
p50
3.1e-05
s
<
p95
4.5e-05
s
≤
p99
4.5e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000429
s
SD
0.000139
s
p50
0.000402
s
<
p95
0.000714
s
<
p99
0.000771
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.00042
s
SD
0.000389
s
p50
0.00043
s
<
p95
0.001809
s
≤
p99
0.001809
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.032277
s
SD
0.03861
s
p50
0.002788
s
<
p95
0.120855
s
<
p99
0.186841
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.020092
s
SD
0.01752
s
p50
0.016947
s
<
p95
0.050063
s
<
p99
0.100135
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.006374
s
SD
0.002513
s
p50
0.004959
s
<
p95
0.00893
s
<
p99
0.010013
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1.5e-05
s
SD
6e-06
s
p50
1.3e-05
s
<
p95
1.8e-05
s
<
p99
3.7e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001855
s
SD
0.000879
s
p50
0.002341
s
<
p95
0.003874
s
<
p99
0.005108
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000352
s
SD
0.00036
s
p50
0.000314
s
<
p95
0.001099
s
<
p99
0.002493
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
48.35
s
<
mean
455.24
s
SD
261.27
s
<
p95
858.88
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
4748
over 33076.580560192s
mean rate
51072.54
/s
std
111334.7
/s
p5
0
/s
p95
310761.08
/s
peak
618733.36
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
17.535207
s
SD
44.339624
s
p50
8.928367
s
<
p95
119.452362
s
<
p99
220.132677
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
2.202445
s
SD
0.362327
s
p50
2.094038
s
<
p95
2.607833
s
<
p99
2.986443
s
App validation workflow duration
Time spent running the app validation workflow.
mean
2.082468
s
SD
20.278299
s
p50
1.890495
s
<
p95
57.999569
s
<
p99
114.650019
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001142
s
SD
0.00106
s
p50
0.00076
s
<
p95
0.003721
s
<
p99
0.005094
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.015323
s
SD
0.022801
s
p50
0.001837
s
<
p95
0.071376
s
<
p99
0.101227
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.006435
s
SD
0.007174
s
p50
0.001861
s
<
p95
0.021727
s
<
p99
0.029192
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.286401
s
SD
0.786558
s
p50
0.294775
s
<
p95
1.939865
s
<
p99
4.359496
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
19.477113
s
SD
22.525613
s
p50
17.103871
s
<
p95
63.905055
s
<
p99
90.477417
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.010794
s
SD
0.009057
s
p50
0.00812
s
<
p95
0.024384
s
<
p99
0.050119
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.003313
s
SD
0.002388
s
p50
0.002588
s
<
p95
0.00749
s
<
p99
0.010424
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000218
s
SD
7.8e-05
s
p50
0.000195
s
<
p95
0.000362
s
<
p99
0.000491
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.013521
s
SD
0.007825
s
p50
0.009839
s
<
p95
0.022862
s
<
p99
0.037612
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
9.9e-05
s
SD
7.3e-05
s
p50
8.2e-05
s
<
p95
0.000196
s
<
p99
0.000433
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000144
s
SD
8.1e-05
s
p50
0.000139
s
<
p95
0.000377
s
<
p99
0.000414
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002376
s
SD
0.215832
s
p50
0.00041
s
<
p95
0.265506
s
<
p99
1.419742
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000258
s
SD
0.0001
s
p50
0.000283
s
<
p95
0.000464
s
<
p99
0.00055
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.107775
s
SD
0.040592
s
p50
0.096724
s
<
p95
0.165164
s
<
p99
0.211422
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.112033
s
SD
0.161929
s
p50
0.108787
s
<
p95
0.421552
s
≤
p99
0.421552
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
0.131782
s
SD
0.007201
s
p50
0.13468
s
<
p95
0.13874
s
<
p99
0.14351
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.638997
s
SD
1.548448
s
p50
0.588167
s
<
p95
0.841787
s
<
p99
10.151575
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
17.76
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
384
B/s
<
mean
101.09
KiB/s
SD
289.42
KiB/s
<
p95
174.05
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
146
B/s
<
mean
114.53
KiB/s
SD
160.39
KiB/s
<
p95
317.84
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.35
GiB
mean
2.58
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.66
GiB
mean
2.93
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 180.20 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.56
%
<
mean
23.2
%
SD
18.76
%
<
p95
63.77
%
System
5.44
%
CPU percentiles
CPU usage percentiles
p50
17.89
%
p95
63.77
%
p99
82.44
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
3
hosts
mean time
0.13
s
Memory used percentage
Percentage of memory used
p5
7.87
%
<
mean
16.22
%
SD
13.64
%
<
p95
38.15
%
Memory available percentage
Percentage of available memory
p5
61.85
%
<
mean
83.78
%
SD
13.64
%
<
p95
92.13
%
Max host memory used
Maximum memory usage percentage across all hosts
max
78.56
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.04
%
Memory growth rate
Rate of memory growth over time
growth
180.20
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.06
MiB/s
Disk write throughput
Disk write throughput in MiB/s
116.76
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/8
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/6
hosts
Mount Point /etc/hosts
0/6
hosts
Mount Point /etc/resolv.conf
0/6
hosts
Mount Point /nix/store
0/8
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.54
5 min
1.54
15 min
1.58
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
3.0404
%
SD
6.3079
%
<
p95
16.87
%
60 second average
2.9813
%
300 second average
2.8008
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
8.9952
%
SD
16.3863
%
<
p95
44.64
%
60 second average
8.8497
%
300 second average
8.1166
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
8.3256
%
SD
15.1969
%
<
p95
40.97
%
60 second average
8.1753
%
300 second average
7.3710
%
Holochain process CPU usage
CPU usage by Holochain process
p5
1.15
%
<
mean
19.82
%
SD
17.17
%
<
p95
57.39
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
430.25
KiB
<
mean
538.10
KiB
SD
86.61
KiB
<
p95
644.46
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
38.96
threads
SD
12.83
threads
<
p95
57
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
67
file descriptors
<
mean
90.24
file descriptors
SD
18.26
file descriptors
<
p95
120
file descriptors

Zome Call, Single Value

↑ Back to index

Calls a zome function that returns a fixed value. This tests the maximum performance of zome calls when the zome function is not calling into Holochain other otherwise doing any work.

Started
Thu, 11 Jun 2026 01:35:14 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.6.0
Run ID
zome_call_single_value_27317315203_1
Call timing
The time taken for the call to complete.
mean
0.002953
s
SD
0.001325
s
p50
0.003027
s
<
p95
0.003303
s
<
p99
0.00349
s
Call rate
The number of zome calls completed per second.
mean
3360.82
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'return_single_value::get_value'
Metered usage count of the WASM ribosome for this zome function.
total
399372375
over 280.001787225s
mean rate
1.4263208e+06
/s
std
63189.58
/s
p5
1.374726e+06
/s
p95
1.57117926e+06
/s
peak
1.6136001e+06
/s
Zome call duration: 'return_single_value::get_value'
Duration of this zome call as measured by Holochain internally.
mean
0.001777
s
SD
4.3e-05
s
p50
0.00177
s
<
p95
0.001794
s
<
p99
0.001796
s
WASM call duration: 'return_single_value::get_value'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001154
s
SD
3.9e-05
s
p50
0.001147
s
<
p95
0.00117
s
<
p99
0.001172
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000148
s
SD
0
s
p50
0.000148
s
≤
p95
0.000148
s
≤
p99
0.000148
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.79
s
<
mean
148.79
s
SD
83.67
s
<
p95
278.79
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001815605s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.069983
s
SD
0
s
p50
0.069983
s
≤
p95
0.069983
s
≤
p99
0.069983
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001545
s
SD
0
s
p50
0.001545
s
≤
p95
0.001545
s
≤
p99
0.001545
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000796
s
SD
0
s
p50
0.000796
s
≤
p95
0.000796
s
≤
p99
0.000796
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000807
s
SD
0
s
p50
0.000807
s
≤
p95
0.000807
s
≤
p99
0.000807
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.000671
s
SD
4.4e-05
s
p50
0.000685
s
<
p95
0.00075
s
≤
p99
0.00075
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001721
s
SD
0
s
p50
0.001721
s
≤
p95
0.001721
s
≤
p99
0.001721
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000594
s
SD
0
s
p50
0.000594
s
≤
p95
0.000594
s
≤
p99
0.000594
s
Authored DB connection use time
Time spent holding authored database connections.
mean
8.1e-05
s
SD
3e-06
s
p50
8.1e-05
s
<
p95
8.2e-05
s
≤
p99
8.2e-05
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
4.3e-05
s
SD
0
s
p50
4.3e-05
s
≤
p95
4.3e-05
s
≤
p99
4.3e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
7.3e-05
s
SD
2e-06
s
p50
7.2e-05
s
<
p95
7.4e-05
s
≤
p99
7.4e-05
s
Cache DB connection use time
Time spent holding cache database connections.
mean
4.7e-05
s
SD
0
s
p50
4.7e-05
s
≤
p95
4.7e-05
s
≤
p99
4.7e-05
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
5.4e-05
s
SD
0
s
p50
5.4e-05
s
≤
p95
5.4e-05
s
≤
p99
5.4e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
7e-05
s
SD
1e-06
s
p50
7e-05
s
<
p95
7.2e-05
s
≤
p99
7.2e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000173
s
SD
0.006643
s
p50
0.000179
s
<
p95
0.016774
s
≤
p99
0.016774
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000259
s
SD
0
s
p50
0.000259
s
≤
p95
0.000259
s
≤
p99
0.000259
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
5.23
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
7.49
KiB/s
<
mean
18.55
KiB/s
SD
7.09
KiB/s
<
p95
31.75
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
10.38
KiB/s
<
mean
25.85
KiB/s
SD
10.97
KiB/s
<
p95
53.41
KiB/s
Total bytes received
Total bytes received on primary network interface
count
5.43
MiB
mean
18.55
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
7.57
MiB
mean
25.85
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
9.68
%
<
mean
10.78
%
SD
1.95
%
<
p95
10.97
%
System
5.55
%
CPU percentiles
CPU usage percentiles
p50
10.62
%
p95
10.97
%
p99
21.09
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
42.34
%
<
mean
45.75
%
SD
2.3
%
<
p95
47.58
%
Memory available percentage
Percentage of available memory
p5
52.42
%
<
mean
54.25
%
SD
2.3
%
<
p95
57.66
%
Max host memory used
Maximum memory usage percentage across all hosts
max
45.75
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-398.19
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
6.71
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
0/1
hosts
Mount Point /etc/hosts
0/1
hosts
Mount Point /etc/resolv.conf
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.16
5 min
0.65
15 min
0.35
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.019
%
SD
0.0725
%
<
p95
0.14
%
60 second average
0.0181
%
300 second average
0.0332
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0187
%
SD
0.0424
%
<
p95
0.12
%
60 second average
0.0145
%
300 second average
0.0703
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0187
%
SD
0.0424
%
<
p95
0.12
%
60 second average
0.0145
%
300 second average
0.0671
%
Holochain process CPU usage
CPU usage by Holochain process
p5
8.29
%
<
mean
8.53
%
SD
2.43
%
≤
p95
8.5
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
224.97
KiB
<
mean
328.32
KiB
SD
59.54
KiB
<
p95
345.46
KiB
Holochain process threads
Number of threads in Holochain process
p5
17
threads
<
mean
19.78
threads
SD
1.02
threads
<
p95
20
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
12
file descriptors
<
mean
50.25
file descriptors
SD
13.93
file descriptors
<
p95
72
file descriptors