App Install
↑ Back to indexMeasure app installation speed. This scenario has two roles:
minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.
These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.
Started
Fri, 31 Jul 2026 00:05:03 UTC
Peer count
1
Behaviours
-
minimal(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
app_install_minimal_30587147196_1
First install time
The time from conductor startup to completion of the first app installation attempt.
1.319574012
s
Install app timing
The time taken to install an app.
mean
0.159377
s
SD
0.00844
s
p50
0.157782
s
p95
0.172096
s
p99
0.186249
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'callback::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 260.011344387s
Not enough time data to show a trend.
WASM usage: 'callback_integrity::genesis_self_check_2'
Metered usage count of the WASM ribosome for this zome function.
total
2207052
over 270.011426075s
mean rate
8173.91
/s
std
1117.37
/s
p5
7648.09
/s
p95
8741.16
/s
peak
8742.73
/s
WASM call duration: 'callback::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00268
s
SD
0.000983
s
p50
0.002312
s
p95
0.004529
s
p99
0.006445
s
WASM call duration: 'callback_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002154
s
SD
1.5e-05
s
p50
0.002155
s
p95
0.00217
s
p99
0.00221
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.001062
s
SD
0.00104
s
p50
0.000692
s
p95
0.0031
s
p99
0.006327
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.31
s
mean
143.32
s
SD
80.78
s
p95
268.32
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
4444
over 270.004687638s
mean rate
16.46
/s
std
2.15
/s
p5
15.4
/s
p95
17.6
/s
peak
17.6
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.004659
s
SD
0.067619
s
p50
0.004678
s
p95
0.042231
s
p99
0.369094
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
p95
1
s
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.002405
s
SD
0.000138
s
p50
0.002425
s
p95
0.002633
s
p99
0.002715
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.004692
s
SD
0.000178
s
p50
0.004676
s
p95
0.004842
s
p99
0.004969
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.073302
s
SD
0.01281
s
p50
0.07328
s
p95
0.073761
s
p99
0.073806
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.006487
s
SD
0.000761
s
p50
0.00645
s
p95
0.006593
s
p99
0.006613
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.002545
s
SD
0.000414
s
p50
0.002544
s
p95
0.003243
s
p99
0.004614
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001376
s
SD
0.000185
s
p50
0.001373
s
p95
0.001409
s
p99
0.002321
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.00077
s
SD
0.000241
s
p50
0.000711
s
p95
0.001183
s
p99
0.001529
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000181
s
SD
8e-06
s
p50
0.000181
s
p95
0.000183
s
p99
0.000183
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000307
s
SD
2e-05
s
p50
0.000308
s
p95
0.000332
s
p99
0.000412
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000289
s
SD
1.9e-05
s
p50
0.000288
s
p95
0.000318
s
p99
0.000359
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000289
s
SD
0
s
p50
0.000289
s
p95
0.000289
s
p99
0.000289
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000476
s
SD
6e-05
s
p50
0.00047
s
p95
0.000506
s
p99
0.000507
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001175
s
SD
0.001436
s
p50
0.001595
s
p95
0.002054
s
p99
0.002405
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.001186
s
SD
5.2e-05
s
p50
0.00117
s
p95
0.001216
s
p99
0.001356
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
37.30
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
6.58
KiB/s
mean
56.58
KiB/s
SD
15.41
KiB/s
p95
63.80
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
3.70
KiB/s
mean
20.48
KiB/s
SD
5.14
KiB/s
p95
22.68
KiB/s
Total bytes received
Total bytes received on primary network interface
count
16.02
MiB
mean
56.58
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
5.80
MiB
mean
20.48
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 99.8%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 1453.54 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
43.13
%
mean
47.64
%
SD
10.14
%
p95
51.41
%
System
10.34
%
CPU percentiles
CPU usage percentiles
p50
46.19
%
p95
51.41
%
p99
99.75
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.03
s
Memory used percentage
Percentage of memory used
p5
32.13
%
mean
40.87
%
SD
5.35
%
p95
49.1
%
Memory available percentage
Percentage of available memory
p5
50.9
%
mean
59.13
%
SD
5.35
%
p95
67.87
%
Max host memory used
Maximum memory usage percentage across all hosts
max
40.87
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.09
%
Memory growth rate
Rate of memory growth over time
growth
1453.54
MiB/s
Disk read throughput
Disk read throughput in MiB/s
2.47
MiB/s
Disk write throughput
Disk write throughput in MiB/s
19.60
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname0/1
hosts
Mount Point
/etc/hosts0/1
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.14
5 min
1.18
15 min
0.67
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
mean
0
%
SD
0
%
p95
0
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
200.76
KiB
mean
880.45
KiB
SD
419.98
KiB
p95
1.49
MiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
mean
1
threads
SD
0
threads
p95
1
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
mean
0
file descriptors
SD
0
file descriptors
p95
0
file descriptors
App Install
↑ Back to indexMeasure app installation speed. This scenario has two roles:
minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.
These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.
Started
Fri, 31 Jul 2026 00:02:57 UTC
Peer count
1
Behaviours
-
large(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
app_install_large_30587147196_1
First install time
The time from conductor startup to completion of the first app installation attempt.
1.508826982
s
Install app timing
The time taken to install an app.
mean
0.698823
s
SD
0.556913
s
p50
0.40253
s
p95
1.937431
s
p99
2.65443
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'large::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 270.004461546s
Not enough time data to show a trend.
WASM call duration: 'large::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002914
s
SD
0.000127
s
p50
0.002871
s
p95
0.003208
s
p99
0.003317
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000134
s
SD
6.3e-05
s
p50
0.000111
s
p95
0.000293
s
p99
0.000389
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.15
s
mean
147.15
s
SD
83.67
s
p95
277.16
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
3227
over 280.00510104s
mean rate
11.52
/s
std
2.69
/s
p5
7.7
/s
p95
16.9
/s
peak
17.6
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.006744
s
SD
0.021974
s
p50
0.006752
s
p95
0.007391
s
p99
0.126995
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
p95
1
s
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000598
s
SD
2.1e-05
s
p50
0.000597
s
p95
0.000615
s
p99
0.000618
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001321
s
SD
4.8e-05
s
p50
0.001321
s
p95
0.001352
s
p99
0.001364
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.025949
s
SD
0.004489
s
p50
0.025703
s
p95
0.026854
s
p99
0.02703
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001277
s
SD
1.6e-05
s
p50
0.001277
s
p95
0.001287
s
p99
0.001297
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000852
s
SD
3.5e-05
s
p50
0.000853
s
p95
0.000875
s
p99
0.000878
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000353
s
SD
6e-06
s
p50
0.000353
s
p95
0.000355
s
p99
0.000358
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000267
s
SD
4e-05
s
p50
0.000261
s
p95
0.00034
s
p99
0.000408
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
5.8e-05
s
SD
1e-06
s
p50
5.8e-05
s
p95
5.9e-05
s
p99
5.9e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000231
s
SD
1.8e-05
s
p50
0.000231
s
p95
0.000237
s
p99
0.000238
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000204
s
SD
3.2e-05
s
p50
0.000203
s
p95
0.000293
s
p99
0.000321
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
9.1e-05
s
SD
0
s
p50
9.1e-05
s
p95
9.1e-05
s
p99
9.1e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
9.6e-05
s
SD
9e-06
s
p50
9.4e-05
s
p95
0.0001
s
p99
0.0001
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002007
s
SD
0.003146
s
p50
0.000498
s
p95
0.000601
s
p99
0.002604
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00048
s
SD
3.8e-05
s
p50
0.000482
s
p95
0.000491
s
p99
0.000649
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
9.91
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
26.09
KiB/s
mean
58.39
KiB/s
SD
115.28
KiB/s
p95
60.22
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
9.59
KiB/s
mean
14.20
KiB/s
SD
3.61
KiB/s
p95
19.44
KiB/s
Total bytes received
Total bytes received on primary network interface
count
17.68
MiB
mean
58.39
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
4.30
MiB
mean
14.20
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 1426.07 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
7.01
%
mean
12.29
%
SD
9.75
%
p95
21.09
%
System
2.39
%
CPU percentiles
CPU usage percentiles
p50
10.47
%
p95
21.09
%
p99
62.75
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
12.38
%
mean
22
%
SD
5.67
%
p95
29.93
%
Memory available percentage
Percentage of available memory
p5
70.07
%
mean
78
%
SD
5.67
%
p95
87.62
%
Max host memory used
Maximum memory usage percentage across all hosts
max
22.00
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1426.07
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
2.83
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/1
hosts
Mount Point
/nix/store0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.55
5 min
0.73
15 min
0.29
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.02
%
mean
0.3284
%
SD
0.2077
%
p95
0.68
%
60 second average
0.2866
%
300 second average
0.1397
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
6.4
%
mean
33.5316
%
SD
12.0491
%
p95
47.92
%
60 second average
27.3119
%
300 second average
12.3459
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
5.94
%
mean
32.7428
%
SD
11.8882
%
p95
46.92
%
60 second average
26.6478
%
300 second average
12.0391
%
Holochain process CPU usage
CPU usage by Holochain process
p5
6.12
%
mean
11.21
%
SD
9.82
%
p95
19.53
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
273.04
KiB
mean
1.04
MiB
SD
417.74
KiB
p95
1.61
MiB
Holochain process threads
Number of threads in Holochain process
p5
7
threads
mean
19.77
threads
SD
4.32
threads
p95
22
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
11
file descriptors
mean
444.45
file descriptors
SD
168.83
file descriptors
p95
646
file descriptors
DHT Sync Lag
↑ Back to indexMeasures the lag time between an agent publishing data and other peers being able to see it. This scenario has two roles:
write: Creates entries with a timestamp field, linked to a known base hash so thatrecord_lagagents can discover them.record_lag: Repeatedly queries for links from the known base hash. When a new entry is discovered, it calculates the time difference between the entry's timestamp and the current time, giving the sync lag for that entry.
Started
Fri, 31 Jul 2026 00:15:36 UTC
Peer count
30
Behaviours
-
record_lag(1 agent) -
write(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
dht_sync_lag_30587147196_1
Create rate
The average number of created records per agent.
Mean
mean
49.54
/s
Max
Highest per-partition mean rate
max
111.7
/s
Min
Lowest per-partition mean rate
min
10.75
/s
Sync lag timing
The average time between when a record was created and when it is first seen by an agent.
Mean
mean
145.567247
s
SD
124.022778
s
Max
Highest per-partition mean latency
max mean
444.045351
s
Min
Lowest per-partition mean latency
min mean
39.498022
s
Sync lag rate
The average number of created records discovered per agent.
Mean
mean
4.17
/s
Max
Highest per-partition mean rate
max
16.66
/s
Min
Lowest per-partition mean rate
min
0
/s
Delivery ratio
The proportion of created entries successfully received by all record_lag agents.
0.0073
Sent count
The total number of entries sent (created) by write agents, by agent.
Total
196460
Agents affected
22 / 22
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
8930
Max
Highest count in any single partition
20753
Min
Lowest count in any single partition
1755
Received count
The total number of entries received by record_lag agents, by agent.
Total
5717
Agents affected
4 / 4
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
1429
Max
Highest count in any single partition
1683
Min
Lowest count in any single partition
1075
Error count
The number of errors encountered during the scenario.
141
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.051606
s
SD
0.116751
s
p50
0.070255
s
p95
0.352401
s
p99
0.451268
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 1640.01539141s
Not enough time data to show a trend.
WASM usage: 'timed::created_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
527757900
over 38372.986167132s
mean rate
1.90940523024e+10
/s
std
1.28334719974e+11
/s
p5
130510.56
/s
p95
5.16672884865e+10
/s
peak
2.14636915541e+12
/s
WASM usage: 'timed::get_timed_entries_local'
Metered usage count of the WASM ribosome for this zome function.
total
577695798
over 1809.752497668s
mean rate
4.91562257974e+09
/s
std
3.01409833332e+09
/s
p5
8.8724167586e+08
/s
p95
1.06245674871e+10
/s
peak
1.13559557651e+10
/s
WASM usage: 'timed_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
63340752
over 38372.99499493s
mean rate
2.17456509081e+09
/s
std
1.43171570766e+10
/s
p5
14771.05
/s
p95
5.75120670854e+09
/s
peak
2.42923624406e+11
/s
Zome call duration: 'timed::created_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.015898
s
SD
0.022031
s
p50
0.009867
s
p95
0.064309
s
p99
0.09824
s
Zome call duration: 'timed::get_timed_entries_local'
Duration of this zome call as measured by Holochain internally.
mean
0.449541
s
SD
6.745203
s
p50
0.322707
s
p95
22.420888
s
p99
28.209338
s
WASM call duration: 'timed::created_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.014695
s
SD
0.021137
s
p50
0.008783
s
p95
0.061774
s
p99
0.094698
s
WASM call duration: 'timed::get_timed_entries_local'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.448846
s
SD
6.74527
s
p50
0.322169
s
p95
22.420316
s
p99
28.208752
s
WASM call duration: 'timed_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00162
s
SD
0.001253
s
p50
0.00133
s
p95
0.004738
s
p99
0.006145
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.003224
s
SD
0.007258
s
p50
0.000903
s
p95
0.020427
s
p99
0.031786
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.002982
s
SD
0.006602
s
p50
0.000872
s
p95
0.018612
s
p99
0.029088
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.052897
s
SD
0.12063
s
p50
0.075288
s
p95
0.366239
s
p99
0.463573
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.004754
s
SD
0.016601
s
p50
0.007405
s
p95
0.055878
s
p99
0.074921
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.003269
s
SD
0.003123
s
p50
0.002472
s
p95
0.011369
s
p99
0.013957
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000743
s
SD
0.00096
s
p50
0.000528
s
p95
0.00316
s
p99
0.004097
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
96.54
s
mean
911.67
s
SD
524.86
s
p95
1728.38
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
41164
over 38372.994979945s
mean rate
1.34913425e+06
/s
std
9.57902499e+06
/s
p5
11.4
/s
p95
3.95493993e+06
/s
peak
1.685943993e+08
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
42.636474
s
SD
36.760009
s
p50
27.673318
s
p95
105.098435
s
p99
229.747579
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.438979
s
SD
0.267563
s
p50
1.433214
s
p95
2.00376
s
p99
2.022845
s
App validation workflow duration
Time spent running the app validation workflow.
mean
2.692116
s
SD
23.489773
s
p50
9.64002
s
p95
61.344336
s
p99
124.731783
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.00177
s
SD
0.001857
s
p50
0.001178
s
p95
0.004689
s
p99
0.009501
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.016631
s
SD
0.445104
s
p50
0.016319
s
p95
0.150837
s
p99
3.568839
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.28355
s
SD
0.298813
s
p50
0.205689
s
p95
0.804713
s
p99
1.364603
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
3.53585
s
SD
36.920362
s
p50
14.392727
s
p95
101.292918
s
p99
139.557359
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.666744
s
SD
30.559261
s
p50
2.279962
s
p95
72.653731
s
p99
147.973598
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.014669
s
SD
0.021326
s
p50
0.009146
s
p95
0.071333
s
p99
0.110033
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001186
s
SD
0.002537
s
p50
0.00084
s
p95
0.007995
s
p99
0.012178
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000301
s
SD
0.000278
s
p50
0.000282
s
p95
0.000906
s
p99
0.00148
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.009433
s
SD
0.015508
s
p50
0.000212
s
p95
0.045765
s
p99
0.076923
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000159
s
SD
0.000264
s
p50
9.1e-05
s
p95
0.000423
s
p99
0.001436
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000192
s
SD
0.000177
s
p50
0.000183
s
p95
0.000641
s
p99
0.000807
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003912
s
SD
0.015549
s
p50
0.001458
s
p95
0.031386
s
p99
0.092983
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.003003
s
SD
0.00574
s
p50
0.000607
s
p95
0.014994
s
p99
0.027478
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
2.112004
s
SD
26.77985
s
p50
7.734568
s
p95
60.00955
s
p99
60.131597
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.507709
s
SD
17.742141
s
p50
1.905967
s
p95
60.00114
s
p99
60.009648
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
53.80
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
146
B/s
mean
596.06
KiB/s
SD
547.13
KiB/s
p95
1.11
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
34
B/s
mean
807.89
KiB/s
SD
676.28
KiB/s
p95
1.91
MiB/s
Total bytes received
Total bytes received on primary network interface
count
25.59
GiB
mean
14.09
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
36.45
GiB
mean
20.07
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.6%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 944.67 MiB/s
Disk full anomaly
Disk full anomaly was detected
Detected
Critical Disk /etc/resolv.conf: 1/8 hosts above 90% capacity
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected
Warning 65% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
10.35
%
mean
64.41
%
SD
28.6
%
p95
98.02
%
System
10.60
%
CPU percentiles
CPU usage percentiles
p50
74.90
%
p95
98.02
%
p99
98.60
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
19
hosts
mean time
0.59
s
Memory used percentage
Percentage of memory used
p5
7.32
%
mean
18.98
%
SD
13.5
%
p95
39.01
%
Memory available percentage
Percentage of available memory
p5
60.99
%
mean
81.02
%
SD
13.5
%
p95
92.68
%
Max host memory used
Maximum memory usage percentage across all hosts
max
77.76
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.12
%
Memory growth rate
Rate of memory growth over time
growth
944.67
MiB/s
Disk read throughput
Disk read throughput in MiB/s
1.91
MiB/s
Disk write throughput
Disk write throughput in MiB/s
334.40
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/4
hosts
Mount Point
/efi-boot0/2
hosts
Mount Point
/etc/hostname1/8
hosts
Mount Point
/etc/hosts1/8
hosts
Mount Point
/etc/nomad.d/client-meta.json0/14
hosts
Mount Point
/etc/nomad.d/meta.json0/2
hosts
Mount Point
/etc/resolv.conf1/8
hosts
Mount Point
/nix/store0/4
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.95
5 min
4.30
15 min
2.96
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
65.38
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.02
%
mean
28.4509
%
SD
24.2709
%
p95
71.93
%
60 second average
27.6380
%
300 second average
23.9894
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0.0002
%
SD
0.0148
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0.0002
%
SD
0.0148
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
11.5523
%
SD
17.5175
%
p95
50.02
%
60 second average
11.2587
%
300 second average
9.6146
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
7.9158
%
SD
14.1416
%
p95
40.6
%
60 second average
7.7179
%
300 second average
6.6185
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.17
%
mean
36.7
%
SD
34.84
%
p95
95.9
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
234.29
KiB
mean
388.22
KiB
SD
155.20
KiB
p95
690.04
KiB
Holochain process threads
Number of threads in Holochain process
p5
5
threads
mean
35.77
threads
SD
16.39
threads
p95
72
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
8
file descriptors
mean
78.75
file descriptors
SD
23.11
file descriptors
p95
105
file descriptors
First Call
↑ Back to indexThis scenario installs a simple app which implements the init callback, and measures the time elapsed between start of install and calling init. It will uninstall the app it installed so that it can re-install it on the next iteration. This is required to re-run the initialisation callback.
Started
Thu, 30 Jul 2026 22:34:58 UTC
Peer count
1
Behaviours
-
default(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
first_call_30587147196_1
Zome call timing
The time elapsed between start of install and calling
init.mean
0.010154
s
SD
0.093376
s
p50
0.005404
s
p95
0.007535
s
p99
0.014743
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 50.002560868s
Not enough time data to show a trend.
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 50.002560868s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
3393040
over 50.002560868s
mean rate
67857.33
/s
std
588.59
/s
p5
66925.33
/s
p95
68786.61
/s
peak
68786.61
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.00235
s
SD
0.000341
s
p50
0.002381
s
p95
0.003235
s
p99
0.003235
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001904
s
SD
0.000649
s
p50
0.001711
s
p95
0.004051
s
p99
0.004552
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000797
s
SD
7.3e-05
s
p50
0.000777
s
p95
0.000932
s
p99
0.000958
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000594
s
SD
4.5e-05
s
p50
0.000599
s
p95
0.000712
s
p99
0.000712
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000184
s
SD
2.3e-05
s
p50
0.000182
s
p95
0.000264
s
p99
0.000264
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000997
s
SD
0.000144
s
p50
0.001013
s
p95
0.001371
s
p99
0.001371
s
Post-commit duration
Time spent executing post-commit workflows.
mean
6.9e-05
s
SD
1.7e-05
s
p50
6.5e-05
s
p95
0.000101
s
p99
0.000151
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
8.77
s
mean
33.77
s
SD
17.08
s
p95
58.77
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
5853
over 50.000283889s
mean rate
117.06
/s
std
0.82
/s
p5
115.8
/s
p95
118.1
/s
peak
118.1
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.00061
s
SD
0.000152
s
p50
0.000628
s
p95
0.001004
s
p99
0.001004
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
p95
1
s
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000277
s
SD
1e-06
s
p50
0.000277
s
p95
0.000278
s
p99
0.000278
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000557
s
SD
8e-06
s
p50
0.000556
s
p95
0.00056
s
p99
0.00056
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.006571
s
SD
3.2e-05
s
p50
0.006574
s
p95
0.006606
s
p99
0.006606
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.000595
s
SD
1.7e-05
s
p50
0.0006
s
p95
0.000636
s
p99
0.000636
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000386
s
SD
2e-06
s
p50
0.000386
s
p95
0.000388
s
p99
0.000388
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000137
s
SD
3e-06
s
p50
0.000137
s
p95
0.000145
s
p99
0.000145
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000106
s
SD
1.4e-05
s
p50
0.000102
s
p95
0.000141
s
p99
0.000161
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
2.2e-05
s
SD
0
s
p50
2.2e-05
s
p95
2.2e-05
s
p99
2.2e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
8e-05
s
SD
5e-06
s
p50
8.1e-05
s
p95
8.3e-05
s
p99
8.3e-05
s
Cache DB connection use time
Time spent holding cache database connections.
mean
4.2e-05
s
SD
3e-06
s
p50
4.2e-05
s
p95
5e-05
s
p99
5e-05
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
4.9e-05
s
SD
0
s
p50
4.9e-05
s
p95
4.9e-05
s
p99
4.9e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
4.2e-05
s
SD
4e-06
s
p50
4.4e-05
s
p95
5.1e-05
s
p99
5.1e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000227
s
SD
3.9e-05
s
p50
0.000256
s
p95
0.000337
s
p99
0.00037
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000166
s
SD
2e-06
s
p50
0.000166
s
p95
0.00017
s
p99
0.00017
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
18.57
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
215.47
KiB/s
mean
440.24
KiB/s
SD
500.96
KiB/s
p95
1.52
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
53.07
KiB/s
mean
59.30
KiB/s
SD
2.80
KiB/s
p95
60.86
KiB/s
Total bytes received
Total bytes received on primary network interface
count
25.80
MiB
mean
440.24
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
3.47
MiB
mean
59.30
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 2114.58 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
18.96
%
mean
20.94
%
SD
4.22
%
p95
30.38
%
System
2.37
%
CPU percentiles
CPU usage percentiles
p50
19.11
%
p95
30.38
%
p99
30.38
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
10.69
%
mean
23.7
%
SD
7.99
%
p95
35.67
%
Memory available percentage
Percentage of available memory
p5
64.33
%
mean
76.3
%
SD
7.99
%
p95
89.31
%
Max host memory used
Maximum memory usage percentage across all hosts
max
23.70
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
2114.58
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
12.79
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/nomad.d/client-meta.json0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.72
5 min
0.23
15 min
0.07
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0.0286
%
SD
0.0485
%
p95
0.14
%
60 second average
0.0100
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0.0286
%
SD
0.0485
%
p95
0.14
%
60 second average
0.0100
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
mean
15.63
%
SD
6.99
%
p95
18.85
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
447.36
KiB
mean
1.13
MiB
SD
489.42
KiB
p95
1.83
MiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
mean
18.43
threads
SD
7.13
threads
p95
22
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
mean
1524.14
file descriptors
SD
1082.57
file descriptors
p95
3187
file descriptors
Full-Arc Create (Validated) / Zero-Arc Read
↑ Back to indexA full-arc/zero-arc mixed scenario where full-arc nodes create data that gets validated and zero-arc nodes read the data. The scenario has two roles:
full: A full-arc conductor that creates entries with a timestamp field. Those entries get validated and then retrieved by zero-arc nodes.zero: A zero-arc conductor that reads the entries created by the full-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Fri, 31 Jul 2026 03:23:13 UTC
Peer count
30
Peer count at end
24
Behaviours
-
full(1 agent) -
zero(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
full_arc_create_validated_zero_arc_read--high_zero_30587147196_1
Create rate
The number of timed entries created by the full-arc node(s) per second.
Mean
mean
92.7
/s
Max
Highest per-partition mean rate
max
131.47
/s
Min
Lowest per-partition mean rate
min
53.93
/s
Fetch lag timing
For each entry, the time lag between when it was created by a full-arc node and when a zero-arc node fetched it from the network.
Mean
mean
43.476566
s
SD
11.256326
s
Max
Highest per-partition mean latency
max mean
43.476566
s
Min
Lowest per-partition mean latency
min mean
43.476566
s
Not enough time data to show a trend.
Fetch rate
The number of entries per second fetched by zero-arc nodes.
Mean
mean
0
/s
Max
Highest per-partition mean rate
max
0
/s
Min
Lowest per-partition mean rate
min
0
/s
Not enough time data to show a trend.
Delivery ratio
The proportion of created entries successfully fetched by all zero-arc nodes.
0
Entry created count
Total number of entries created by full-arc nodes, by agent.
Total
16556
Agents affected
2 / 2
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
8278
Max
Highest count in any single partition
11777
Min
Lowest count in any single partition
4779
Received count
Total number of entries fetched by zero-arc nodes, by agent.
Total
0
Agents affected
0 / 23
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
0
Max
Highest count in any single partition
0
Min
Lowest count in any single partition
0
Open connections
The number of currently open connections to other conductors.
full-arc
p5
23
mean
22.63
SD
2.27
p95
23
zero-arc
p5
0
mean
8.81
SD
7.97
p95
21
Retrieval errors
Errors encountered by zero-arc nodes when attempting to retrieve entries created by full-arc nodes.
Total
307
Agents affected
22 / 22
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
14
Max
Highest count in any single partition
14
Min
Lowest count in any single partition
13
Error count
The number of errors accumulated across all nodes.
307
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.007583
s
SD
0.007586
s
p50
0.004027
s
p95
0.016553
s
p99
0.044321
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
12
over 768.533708356s
mean rate
95.21
/s
std
401.68
/s
p5
0
/s
p95
307.81
/s
peak
2576.11
/s
Zome call duration: 'timed_and_validated::create_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006231
s
SD
0.003993
s
p50
0.004015
s
p95
0.012682
s
p99
0.012809
s
Zome call duration: 'timed_and_validated::get_timed_entries_network'
Duration of this zome call as measured by Holochain internally.
mean
0.008922
s
SD
18.035554
s
p50
0.003635
s
p95
0.094607
s
p99
99.437081
s
WASM call duration: 'timed_and_validated::create_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005544
s
SD
0.003642
s
p50
0.003514
s
p95
0.011446
s
p99
0.011551
s
WASM call duration: 'timed_and_validated::get_timed_entries_network'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.103446
s
SD
36.4791
s
p50
0.17373
s
p95
119.079079
s
p99
184.528792
s
WASM call duration: 'timed_and_validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00091
s
SD
0.000627
s
p50
0.000905
s
p95
0.002468
s
p99
0.003311
s
WASM call duration: 'timed_and_validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004374
s
SD
0.001938
s
p50
0.000868
s
p95
0.005943
s
p99
0.010907
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000413
s
SD
0.000359
s
p50
0.000216
s
p95
0.001032
s
p99
0.001042
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000395
s
SD
0.000352
s
p50
0.000201
s
p95
0.000988
s
p99
0.001005
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.077742
s
SD
0.083189
s
p50
0.111581
s
p95
0.279797
s
p99
0.372613
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.017051
s
SD
1.945909
s
p50
0.018107
s
p95
2.577714
s
p99
9.848204
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.005447
s
SD
0.003464
s
p50
0.004094
s
p95
0.012086
s
p99
0.012408
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001686
s
SD
0.001134
s
p50
0.001444
s
p95
0.004663
s
p99
0.005227
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000342
s
SD
0.000157
s
p50
0.000155
s
p95
0.000542
s
p99
0.000834
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
48.17
s
mean
452.68
s
SD
259.73
s
p95
857.89
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 33081.770118047s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
20.135232
s
SD
9.704449
s
p50
0.096593
s
p95
3.54368
s
p99
63.033936
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.345531
s
SD
0.103828
s
p50
1
s
p95
1.288031
s
p99
1.48133
s
App validation workflow duration
Time spent running the app validation workflow.
mean
2.227437
s
SD
7.633709
s
p50
0.000819
s
p95
1.286445
s
p99
59.700153
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001656
s
SD
0.002736
s
p50
0.000904
s
p95
0.00319
s
p99
0.014743
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.012525
s
SD
0.005452
s
p50
0.000718
s
p95
0.004311
s
p99
0.036867
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.086235
s
SD
0.023517
s
p50
0.00217
s
p95
0.071755
s
p99
0.120343
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.071569
s
SD
0.03569
s
p50
0.000949
s
p95
0.040767
s
p99
0.152574
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.304317
s
SD
0.149502
s
p50
0.000816
s
p95
0.221668
s
p99
0.961798
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.003424
s
SD
0.006486
s
p50
0.002192
s
p95
0.013059
s
p99
0.041187
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.004438
s
SD
0.006498
s
p50
0.002861
s
p95
0.01529
s
p99
0.038691
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
9.1e-05
s
SD
0.000112
s
p50
8.6e-05
s
p95
0.000315
s
p99
0.000611
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.006758
s
SD
0.006933
s
p50
0.003348
s
p95
0.016443
s
p99
0.041277
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000164
s
SD
0.000258
s
p50
9.6e-05
s
p95
0.00053
s
p99
0.001338
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000174
s
SD
8e-05
s
p50
0.000127
s
p95
0.000343
s
p99
0.000407
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001659
s
SD
0.17834
s
p50
0.000259
s
p95
0.148098
s
p99
1.038766
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000242
s
SD
0.000351
s
p50
0.000362
s
p95
0.001111
s
p99
0.001871
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.86068
s
SD
29.720338
s
p50
0.247948
s
p95
60.001614
s
p99
60.001822
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
22.884784
s
SD
24.9361
s
p50
4.530153
s
p95
60.001364
s
p99
60.001832
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
2.007943
s
SD
24.731252
s
p50
6.504808
s
p95
60.001553
s
p99
60.001761
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
16.07
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
2.93
KiB/s
mean
84.61
KiB/s
SD
242.65
KiB/s
p95
355.56
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
2.89
KiB/s
mean
120.19
KiB/s
SD
669.56
KiB/s
p95
403.10
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.81
GiB
mean
2.00
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.58
GiB
mean
2.84
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 99.2%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 542.07 MiB/s
Disk full anomaly
Disk full anomaly was detected
Detected
Critical Disk /etc/resolv.conf: 1/5 hosts above 90% capacity
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected
Warning 8% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.55
%
mean
21.63
%
SD
28.23
%
p95
94.94
%
System
5.56
%
CPU percentiles
CPU usage percentiles
p50
7.61
%
p95
94.94
%
p99
99.25
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
9
hosts
mean time
0.25
s
Memory used percentage
Percentage of memory used
p5
7.69
%
mean
16.75
%
SD
7.24
%
p95
31.93
%
Memory available percentage
Percentage of available memory
p5
68.07
%
mean
83.25
%
SD
7.24
%
p95
92.31
%
Max host memory used
Maximum memory usage percentage across all hosts
max
38.34
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.12
%
Memory growth rate
Rate of memory growth over time
growth
542.07
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.46
MiB/s
Disk write throughput
Disk write throughput in MiB/s
42.37
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/5
hosts
Mount Point
/efi-boot0/3
hosts
Mount Point
/etc/hostname1/5
hosts
Mount Point
/etc/hosts1/5
hosts
Mount Point
/etc/nomad.d/client-meta.json0/15
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf1/5
hosts
Mount Point
/nix/store0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.14
5 min
1.33
15 min
1.35
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
8.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
4.2429
%
SD
14.7549
%
p95
46.97
%
60 second average
4.3866
%
300 second average
5.3591
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
2.7128
%
SD
6.8277
%
p95
16.45
%
60 second average
3.0171
%
300 second average
3.7027
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
2.3484
%
SD
6.4343
%
p95
15.73
%
60 second average
2.5854
%
300 second average
2.9832
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.12
%
mean
14.98
%
SD
25.38
%
p95
92.56
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
425.72
KiB
mean
516.77
KiB
SD
105.12
KiB
p95
642.98
KiB
Holochain process threads
Number of threads in Holochain process
p5
10
threads
mean
16.21
threads
SD
8.07
threads
p95
40
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
11
file descriptors
mean
59.11
file descriptors
SD
17.71
file descriptors
p95
86
file descriptors
Local Signals
↑ Back to indexThis scenario is for testing the speed and reliability of local signals. It uses a zome with a function that will emit 10,000 signals. The scenario measures how long it takes to send the signals and how many have been received by the time the zome call ends.
Started
Thu, 30 Jul 2026 22:44:45 UTC
Peer count
1
Behaviours
-
default(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
local_signals_30587147196_1
Send timing
The time taken to emit a batch of 10,000 signals.
mean
1.474557
s
SD
0.729698
s
p50
1.483541
s
p95
2.596871
s
p99
2.596871
s
Receive timing
The time taken to receive the completed batch, to the nearest 250ms.
mean
25.091402
s
SD
10.480402
s
p50
30.000663
s
p95
30.00164
s
p99
30.00164
s
Success ratio
The proportion of signals successfully received in a batch.
min
0.8781999945640564
mean
0.9519
SD
0.0376
max
1
Holochain MetricsClick to toggle visibility.
WASM usage: 'signal::emit_10k_signals'
Metered usage count of the WASM ribosome for this zome function.
total
335514970
over 290.003074697s
mean rate
1.15693512e+06
/s
std
1.82194217e+06
/s
p5
0
/s
p95
3.35512665e+06
/s
peak
6.71020667e+06
/s
Zome call duration: 'signal::emit_10k_signals'
Duration of this zome call as measured by Holochain internally.
mean
0.293351
s
SD
0.002947
s
p50
0.292525
s
p95
0.297754
s
p99
0.297754
s
WASM call duration: 'signal::emit_10k_signals'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.292512
s
SD
0.002918
s
p50
0.291698
s
p95
0.296906
s
p99
0.296906
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
2.1e-05
s
SD
0
s
p50
2.1e-05
s
p95
2.1e-05
s
p99
2.1e-05
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
100000
over 290.003103759s
mean rate
344.82
/s
std
543.03
/s
p5
0
/s
p95
999.99
/s
peak
1999.99
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000121
s
SD
0
s
p50
0.000121
s
p95
0.000121
s
p99
0.000121
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.66
s
mean
152.67
s
SD
86.56
s
p95
287.67
s
Dropped WebSocket signals
Count of signals dropped from the app WebSocket due to channel overload.
total
152
over 290.003078668s
mean rate
0.52
/s
std
0.95
/s
p5
0
/s
p95
2.8
/s
peak
3.4
/s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 290.003083701s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.073227
s
SD
0
s
p50
0.073227
s
p95
0.073227
s
p99
0.073227
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
p95
1
s
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001666
s
SD
0
s
p50
0.001666
s
p95
0.001666
s
p99
0.001666
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000782
s
SD
0
s
p50
0.000782
s
p95
0.000782
s
p99
0.000782
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001135
s
SD
0
s
p50
0.001135
s
p95
0.001135
s
p99
0.001135
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.000991
s
SD
4.3e-05
s
p50
0.001015
s
p95
0.001059
s
p99
0.001059
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001073
s
SD
0
s
p50
0.001073
s
p95
0.001073
s
p99
0.001073
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.00053
s
SD
0
s
p50
0.00053
s
p95
0.00053
s
p99
0.00053
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000195
s
SD
7e-06
s
p50
0.000195
s
p95
0.000209
s
p99
0.000209
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
5.1e-05
s
SD
0
s
p50
5.1e-05
s
p95
5.1e-05
s
p99
5.1e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000131
s
SD
2e-06
s
p50
0.000131
s
p95
0.000132
s
p99
0.000134
s
Cache DB connection use time
Time spent holding cache database connections.
mean
8.5e-05
s
SD
0
s
p50
8.5e-05
s
p95
8.5e-05
s
p99
8.5e-05
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.7e-05
s
SD
0
s
p50
8.7e-05
s
p95
8.7e-05
s
p99
8.7e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000108
s
SD
8e-06
s
p50
0.000108
s
p95
0.000112
s
p99
0.000112
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
9.1e-05
s
SD
0.008078
s
p50
0.000238
s
p95
0.020426
s
p99
0.020426
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000422
s
SD
0
s
p50
0.000422
s
p95
0.000422
s
p99
0.000422
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
2.84
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
62
B/s
mean
657
B/s
SD
1.03
KiB/s
p95
1.15
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
18
B/s
mean
542
B/s
SD
1.02
KiB/s
p95
817
B/s
Total bytes received
Total bytes received on primary network interface
count
186.10
KiB
mean
657
B/s
Total bytes sent
Total bytes sent on primary network interface
count
153.61
KiB
mean
542
B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 87.04 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.4
%
mean
5.47
%
SD
10.38
%
p95
20.66
%
System
2.63
%
CPU percentiles
CPU usage percentiles
p50
0.50
%
p95
20.66
%
p99
52.19
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
10.68
%
mean
10.97
%
SD
0.69
%
p95
11.5
%
Memory available percentage
Percentage of available memory
p5
88.5
%
mean
89.03
%
SD
0.69
%
p95
89.32
%
Max host memory used
Maximum memory usage percentage across all hosts
max
10.97
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
87.04
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
0.78
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname0/1
hosts
Mount Point
/etc/hosts0/1
hosts
Mount Point
/etc/resolv.conf0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.88
5 min
0.39
15 min
0.15
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.14
%
mean
1.9023
%
SD
2.2655
%
p95
7.88
%
60 second average
1.4073
%
300 second average
0.5590
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
1.03
%
mean
2.179
%
SD
1.5977
%
p95
6.53
%
60 second average
2.0880
%
300 second average
1.1233
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
1.03
%
mean
2.1443
%
SD
1.5734
%
p95
6.35
%
60 second average
2.0517
%
300 second average
1.1033
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.12
%
mean
0.46
%
SD
0.46
%
p95
1.15
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
251.21
KiB
mean
253.94
KiB
SD
1.66
KiB
p95
255.59
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
mean
12.6
threads
SD
2.15
threads
p95
13
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
47
file descriptors
mean
50.2
file descriptors
SD
13.07
file descriptors
p95
70
file descriptors
Mixed Arc get_agent_activity
↑ Back to index
A mixed-arc scenario that measures the DHT's ability to propagate agent activity and make it available via get_agent_activity calls. The scenario has three roles:
zero_write: A zero-arc conductor that creates entries on its source chain.full_write: A full-arc conductor that creates entries on its source chain.zero_read: A zero-arc conductor that picks a random writer and repeatedly callsget_agent_activityto observe new entries appearing on the writer's chain, measuring the lag between creation and discovery.
Started
Fri, 31 Jul 2026 03:38:42 UTC
Peer count
30
Peer count at end
26
Behaviours
-
full_write(1 agent) -
zero_read(1 agent) -
zero_write(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
mixed_arc_get_agent_activity_30587147196_1
Entry created count
The total number of entries created by write agents over the run, partitioned by agent and behaviour.
Total
326977
Agents affected
18 / 18
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
18165
Max
Highest count in any single partition
35558
Min
Lowest count in any single partition
3624
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
10558.33
Max
Highest chain head value observed for any single write agent.
13513
Write agents observed
3
Chain head delay timing
The time lag between when a writer creates a new entry and when a reader discovers it via
get_agent_activity. This is measured per new action in the chain.Mean
mean
0.024816
s
SD
0.099729
s
Max
Highest per-partition mean latency
max mean
0.029794
s
Min
Lowest per-partition mean latency
min mean
0.020895
s
Chain head delay rate
The rate at which readers detect new chain heads appearing on writers' chains.
Mean
mean
17.1
/s
Max
Highest per-partition mean rate
max
20.22
/s
Min
Lowest per-partition mean rate
min
12.85
/s
get_agent_activity_full zome call timingThe time taken to complete the
get_agent_activity_full zome call that queries a writer's chain.Mean
mean
0.521642
s
SD
0.477303
s
Max
Highest per-partition mean latency
max mean
0.72836
s
Min
Lowest per-partition mean latency
min mean
0.418743
s
Retrieval errors
A running accumulation of errors encountered by read agents when calling
get_agent_activity.Total
1
Agents affected
1 / 8
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
0
Max
Highest count in any single partition
1
Min
Lowest count in any single partition
0
Open connections
The number of currently open connections to other conductors, partitioned by agent behaviour.
behaviour:full_write
p5
18
mean
23.66
SD
2.8
p95
25
behaviour:zero_read
p5
8
mean
12.68
SD
3.27
p95
18
behaviour:zero_write
p5
0
mean
12.3
SD
5.51
p95
20
Final error count
The total number of errors accumulated across all agents over the run.
3
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000211
s
SD
0.000175
s
p50
0.000583
s
p95
0.000793
s
p99
0.000793
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 568.660185392s
Not enough time data to show a trend.
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.008892
s
SD
0.007749
s
p50
0.006599
s
p95
0.030847
s
p99
0.030847
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004246
s
SD
0.009215
s
p50
0.003641
s
p95
0.029866
s
p99
0.037654
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.391089
s
SD
0.136042
s
p50
0.370218
s
p95
0.607182
s
p99
0.706679
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.04972
s
SD
0.142237
s
p50
0.239439
s
p95
0.426165
s
p99
0.426165
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.007532
s
SD
0.007033
s
p50
0.005365
s
p95
0.027749
s
p99
0.027749
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003505
s
SD
0.008199
s
p50
0.002963
s
p95
0.027003
s
p99
0.034054
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.393842
s
SD
0.13582
s
p50
0.374924
s
p95
0.606604
s
p99
0.705713
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.049263
s
SD
0.142134
s
p50
0.238523
s
p95
0.425407
s
p99
0.425407
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000972
s
SD
0.000999
s
p50
0.00094
s
p95
0.004143
s
p99
0.004886
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.8e-05
s
SD
1.8e-05
s
p50
3.2e-05
s
p95
7.8e-05
s
p99
7.8e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000632
s
SD
0.003756
s
p50
0.000294
s
p95
0.012411
s
p99
0.015306
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.001309
s
SD
0.002992
s
p50
0.000474
s
p95
0.013603
s
p99
0.013603
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.386471
s
SD
0.135177
s
p50
0.367054
s
p95
0.600668
s
p99
0.696576
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.046985
s
SD
0.141592
s
p50
0.233709
s
p95
0.422015
s
p99
0.422015
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
5e-06
s
SD
7e-06
s
p50
1.2e-05
s
p95
2.9e-05
s
p99
2.9e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00177
s
SD
0.0028
s
p50
0.001737
s
p95
0.010848
s
p99
0.013075
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.00026
s
SD
0.000759
s
p50
0.000156
s
p95
0.002599
s
p99
0.003124
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.86
s
mean
449.59
s
SD
257.89
s
p95
848.77
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
4
over 33091.888607444s
mean rate
96731.83
/s
std
287451.35
/s
p5
0
/s
p95
608110.03
/s
peak
1.6168598e+06
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
20.307095
s
SD
9.966535
s
p50
0.113356
s
p95
28.660479
s
p99
40.429975
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.650607
s
SD
0.299096
s
p50
1
s
p95
1.715664
s
p99
1.741047
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.101303
s
SD
2.204913
s
p50
0.00114
s
p95
0.318521
s
p99
15.549272
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001241
s
SD
0.001038
s
p50
0.000812
s
p95
0.00379
s
p99
0.004164
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.004411
s
SD
0.008028
s
p50
0.00068
s
p95
0.021798
s
p99
0.036353
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.104185
s
SD
7.030977
s
p50
0.07593
s
p95
21.026462
s
p99
27.218577
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.115113
s
SD
0.171273
s
p50
0.000889
s
p95
0.226707
s
p99
0.455477
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
2.137205
s
SD
16.83887
s
p50
0.000878
s
p95
31.509018
s
p99
82.823521
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.003024
s
SD
0.00388
s
p50
0.000848
s
p95
0.010799
s
p99
0.01498
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002364
s
SD
0.002535
s
p50
0.00017
s
p95
0.006491
s
p99
0.013156
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000162
s
SD
0.000314
s
p50
0.000141
s
p95
0.001205
s
p99
0.001338
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000154
s
SD
0.00026
s
p50
0.000104
s
p95
0.001075
s
p99
0.001154
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000107
s
SD
6.9e-05
s
p50
8.8e-05
s
p95
0.000204
s
p99
0.000401
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000187
s
SD
0.000185
s
p50
0.000117
s
p95
0.000733
s
p99
0.000849
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001634
s
SD
0.012479
s
p50
0.000458
s
p95
0.026271
s
p99
0.050117
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000631
s
SD
0.002799
s
p50
0.000256
s
p95
0.008951
s
p99
0.012899
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
5.695759
s
SD
28.063733
s
p50
2.403544
s
p95
60.021496
s
p99
60.531089
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.721403
s
SD
18.281674
s
p50
0.229333
s
p95
60.001975
s
p99
60.001975
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.393585
s
SD
14.832581
s
p50
0.372588
s
p95
60.000738
s
p99
60.000738
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
2.179457
s
SD
26.420673
s
p50
2.58195
s
p95
60.020668
s
p99
73.460051
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
28.36
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
120
B/s
mean
324.15
KiB/s
SD
311.06
KiB/s
p95
810.96
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
137
B/s
mean
503.77
KiB/s
SD
863.21
KiB/s
p95
2.52
MiB/s
Total bytes received
Total bytes received on primary network interface
count
7.49
GiB
mean
8.43
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
11.64
GiB
mean
13.10
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.0%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 768.25 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected
Warning 19% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.15
%
mean
35.71
%
SD
35.48
%
p95
95.94
%
System
7.34
%
CPU percentiles
CPU usage percentiles
p50
15.94
%
p95
95.94
%
p99
98.05
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
10
hosts
mean time
0.47
s
Memory used percentage
Percentage of memory used
p5
5.87
%
mean
13.44
%
SD
6.59
%
p95
32.3
%
Memory available percentage
Percentage of available memory
p5
67.7
%
mean
86.56
%
SD
6.59
%
p95
94.13
%
Max host memory used
Maximum memory usage percentage across all hosts
max
35.92
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.09
%
Memory growth rate
Rate of memory growth over time
growth
768.25
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.52
MiB/s
Disk write throughput
Disk write throughput in MiB/s
217.64
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/6
hosts
Mount Point
/efi-boot0/3
hosts
Mount Point
/etc/hostname0/6
hosts
Mount Point
/etc/hosts0/6
hosts
Mount Point
/etc/nomad.d/client-meta.json0/15
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/6
hosts
Mount Point
/nix/store0/6
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.42
5 min
2.04
15 min
1.66
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
18.52
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
10.4733
%
SD
22.1625
%
p95
77.56
%
60 second average
10.1318
%
300 second average
8.7235
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
5.7318
%
SD
14.1645
%
p95
46.17
%
60 second average
5.5203
%
300 second average
4.5815
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
5.3749
%
SD
13.8344
%
p95
45.49
%
60 second average
5.1550
%
300 second average
4.2115
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.15
%
mean
28.13
%
SD
32.39
%
p95
91.87
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
206.86
KiB
mean
318.97
KiB
SD
153.55
KiB
p95
704.93
KiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
mean
20.6
threads
SD
12.15
threads
p95
46
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
44
file descriptors
mean
64.23
file descriptors
SD
22.32
file descriptors
p95
107
file descriptors
Mixed Arc must_get_agent_activity
↑ Back to index
A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.
The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.
This test is similar to Write Validated must_get_agent_activity, but some write agents are zero-arc and all must_get_agent_activity agents are zero-arc. This forces the must_get_agent_activity host call to go to the network.
Started
Fri, 31 Jul 2026 03:54:21 UTC
Peer count
30
Peer count at end
26
Behaviours
-
full_write(1 agent) -
zero_must_get_agent_activity(1 agent) -
zero_write(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
mixed_arc_must_get_agent_activity_30587147196_1
Highest observed
action_seqThe maximum chain length observed per
write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1877.2
Max
Highest chain head value observed for any single write agent.
1919
Write agents observed
5
Chain batch delay timing
The time between a
write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.Mean
mean
5.75775
s
SD
10.088093
s
Max
Highest per-partition mean latency
max mean
9.123793
s
Min
Lowest per-partition mean latency
min mean
1.928684
s
Chain batch delay rate
The rate at which a
must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.Mean
mean
2.11
/s
Max
Highest per-partition mean rate
max
2.33
/s
Min
Lowest per-partition mean rate
min
1.97
/s
create_validated_sample_entry zome call timingThe time taken to complete the zome function call that creates the entry that depends on a
write agent's source chain.Mean
mean
0.581427
s
SD
0.731518
s
Max
Highest per-partition mean latency
max mean
0.938061
s
Min
Lowest per-partition mean latency
min mean
0.200896
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on
must_get_agent_activity calls.Total
4454
Agents affected
8 / 8
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
557
Max
Highest count in any single partition
638
Min
Lowest count in any single partition
479
Open connections
The average number of open connections maintained by an agent over the run, broken down by behaviour.
behaviour:full_write
p5
0
mean
22.27
SD
7.32
p95
25
behaviour:zero_must_get_agent_activity
p5
10
mean
17.69
SD
4.51
p95
24
behaviour:zero_write
p5
14
mean
18.47
SD
3
p95
23
Final error count
The total number of all types of error accumulated over the run by all agents.
17880
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.001012
s
SD
0.000356
s
p50
0.000787
s
p95
0.001584
s
p99
0.001748
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 330.004744403s
Not enough time data to show a trend.
WASM usage: 'validated_must_get_agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 1887.814409682s
Not enough time data to show a trend.
WASM usage: 'validated_must_get_agent_activity::create_sample_entries_batch'
Metered usage count of the WASM ribosome for this zome function.
total
4309098505
over 1887.814409682s
mean rate
3.4450340509e+08
/s
std
9.5960913772e+08
/s
p5
0
/s
p95
1.36355267e+09
/s
peak
7.30858913901e+09
/s
WASM usage: 'validated_must_get_agent_activity::create_validated_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
41112218
over 914.332536014s
mean rate
3.12324268e+06
/s
std
5.43293752e+06
/s
p5
33642.98
/s
p95
1.679981331e+07
/s
peak
3.214184081e+07
/s
WASM usage: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Metered usage count of the WASM ribosome for this zome function.
total
245775359
over 914.332536014s
mean rate
3.11106289e+07
/s
std
4.096030058e+07
/s
p5
667880.96
/s
p95
1.2488618411e+08
/s
peak
1.9709617811e+08
/s
WASM usage: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
10871
over 914.332536014s
mean rate
64442.02
/s
std
50578.26
/s
p5
11401.01
/s
p95
152554.16
/s
peak
152882.58
/s
WASM usage: 'validated_must_get_agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37472.121214218s
Not enough time data to show a trend.
WASM usage: 'validated_must_get_agent_activity_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37472.121214218s
Not enough time data to show a trend.
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.008026
s
SD
0.002334
s
p50
0.007144
s
p95
0.012404
s
p99
0.012404
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.059927
s
SD
0.019189
s
p50
0.053792
s
p95
0.096254
s
p99
0.117839
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.007342
s
SD
0.002278
s
p50
0.007299
s
p95
0.010388
s
p99
0.01044
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.164332
s
SD
0.093594
s
p50
0.155066
s
p95
0.334766
s
p99
0.351287
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.146418
s
SD
0.084018
s
p50
0.126228
s
p95
0.240629
s
p99
0.240629
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006655
s
SD
0.001972
s
p50
0.005878
s
p95
0.010333
s
p99
0.010333
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.058769
s
SD
0.018931
s
p50
0.052667
s
p95
0.09462
s
p99
0.115867
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005984
s
SD
0.001804
s
p50
0.006018
s
p95
0.008382
s
p99
0.008424
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.202462
s
SD
0.040483
s
p50
0.198147
s
p95
0.261033
s
p99
0.297997
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.145269
s
SD
0.084026
s
p50
0.125292
s
p95
0.239878
s
p99
0.239878
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001128
s
SD
0.000667
s
p50
0.001313
s
p95
0.002585
s
p99
0.003155
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006286
s
SD
0.033474
s
p50
0.003101
s
p95
0.095552
s
p99
0.133053
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.1e-05
s
SD
1.1e-05
s
p50
3.5e-05
s
p95
5.6e-05
s
p99
5.9e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000461
s
SD
0.000164
s
p50
0.00045
s
p95
0.000816
s
p99
0.000926
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000428
s
SD
0.00017
s
p50
0.000477
s
p95
0.000866
s
p99
0.00088
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.19695
s
SD
0.07225
s
p50
0.187424
s
p95
0.243837
s
p99
0.290011
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.238995
s
SD
0.089413
s
p50
0.199876
s
p95
0.381481
s
p99
0.488178
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.007154
s
SD
0.003435
s
p50
0.005283
s
p95
0.011419
s
p99
0.016681
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1.7e-05
s
SD
6e-06
s
p50
1.5e-05
s
p95
2.8e-05
s
p99
2.8e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00188
s
SD
0.001118
s
p50
0.002723
s
p95
0.004927
s
p99
0.005412
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000253
s
SD
0.00014
s
p50
0.000207
s
p95
0.000551
s
p99
0.00066
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
48.18
s
mean
456.65
s
SD
262.11
s
p95
867.22
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 37472.121225515s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
9.564783
s
SD
16.215227
s
p50
0.109542
s
p95
29.362828
s
p99
115.520464
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.862821
s
SD
0.396688
s
p50
1
s
p95
1.882832
s
p99
1.890201
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.612936
s
SD
9.023376
s
p50
0.001539
s
p95
16.67556
s
p99
41.113081
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001268
s
SD
0.00099
s
p50
0.000777
s
p95
0.003619
s
p99
0.004051
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.013353
s
SD
0.014027
s
p50
0.000363
s
p95
0.034696
s
p99
0.081519
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.012017
s
SD
0.01792
s
p50
0.011761
s
p95
0.060562
s
p99
0.084737
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.26486
s
SD
0.530961
s
p50
0.002168
s
p95
0.366883
s
p99
3.547599
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
6.533057
s
SD
7.369877
s
p50
0.001035
s
p95
20.180717
s
p99
38.965358
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000355
s
SD
0.000205
s
p50
0.000326
s
p95
0.000737
s
p99
0.001198
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000922
s
SD
0.000472
s
p50
0.000279
s
p95
0.001484
s
p99
0.00189
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000194
s
SD
4.8e-05
s
p50
0.000175
s
p95
0.000285
s
p99
0.000306
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000282
s
SD
0.000373
s
p50
0.000144
s
p95
0.001128
s
p99
0.001504
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000295
s
SD
0.000739
s
p50
8.8e-05
s
p95
0.00237
s
p99
0.003387
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000107
s
SD
6.4e-05
s
p50
0.000109
s
p95
0.00023
s
p99
0.000301
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001501
s
SD
0.207229
s
p50
0.000315
s
p95
0.22349
s
p99
1.354092
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000258
s
SD
0.000162
s
p50
0.000368
s
p95
0.000698
s
p99
0.000796
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.137926
s
SD
0.051134
s
p50
0.108597
s
p95
0.2453
s
p99
0.252415
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.138438
s
SD
16.4193
s
p50
0.119632
s
p95
60.001605
s
p99
60.001705
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
0.229494
s
SD
13.247016
s
p50
0.199011
s
p95
60.000288
s
p99
60.001955
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.501426
s
SD
1.555097
s
p50
0.40617
s
p95
0.690485
s
p99
10.214157
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
8.14
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
157
B/s
mean
76.90
KiB/s
SD
165.27
KiB/s
p95
263.63
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
144
B/s
mean
103.09
KiB/s
SD
222.36
KiB/s
p95
561.30
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.72
GiB
mean
1.89
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.09
GiB
mean
2.30
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 177.37 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.8
%
mean
13.21
%
SD
16.34
%
p95
49.17
%
System
5.07
%
CPU percentiles
CPU usage percentiles
p50
4.89
%
p95
49.17
%
p99
70.90
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
8
hosts
mean time
0.02
s
Memory used percentage
Percentage of memory used
p5
7.45
%
mean
14.31
%
SD
5.81
%
p95
17.89
%
Memory available percentage
Percentage of available memory
p5
82.11
%
mean
85.69
%
SD
5.81
%
p95
92.55
%
Max host memory used
Maximum memory usage percentage across all hosts
max
37.35
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.09
%
Memory growth rate
Rate of memory growth over time
growth
177.37
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.08
MiB/s
Disk write throughput
Disk write throughput in MiB/s
49.05
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/5
hosts
Mount Point
/efi-boot0/4
hosts
Mount Point
/etc/hostname0/5
hosts
Mount Point
/etc/hosts0/5
hosts
Mount Point
/etc/nomad.d/client-meta.json0/17
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/5
hosts
Mount Point
/nix/store0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.71
5 min
1.03
15 min
1.29
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
1.7783
%
SD
4.3257
%
p95
11.83
%
60 second average
2.0898
%
300 second average
3.9288
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
2.8222
%
SD
8.7307
%
p95
18.41
%
60 second average
2.9417
%
300 second average
3.2263
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
2.6382
%
SD
8.2941
%
p95
18.05
%
60 second average
2.7552
%
300 second average
3.0260
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.17
%
mean
8.85
%
SD
13.27
%
p95
38.84
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
415.29
KiB
mean
493.57
KiB
SD
62.72
KiB
p95
595.93
KiB
Holochain process threads
Number of threads in Holochain process
p5
10
threads
mean
22.7
threads
SD
16.57
threads
p95
60
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
44
file descriptors
mean
65.11
file descriptors
SD
18.11
file descriptors
p95
83
file descriptors
Remote Call Rate
↑ Back to indexTest the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.
Started
Thu, 30 Jul 2026 22:55:12 UTC
Peer count
10
Behaviours
-
default(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
remote_call_rate_30587147196_1
Dispatch timing
The time between sending a remote call and the remote handler being invoked.
Mean
mean
9.165745
s
SD
45.843912
s
Max
Highest per-partition mean latency
max mean
209.958601
s
Min
Lowest per-partition mean latency
min mean
-14.366817
s
Round-trip timing
The total elapsed time to get a response to the client.
Mean
mean
0.127141
s
SD
0.088075
s
Max
Highest per-partition mean latency
max mean
0.211698
s
Min
Lowest per-partition mean latency
min mean
0.070284
s
Error count
The total number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_call::call_echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
150395972
over 1105.487706103s
mean rate
1.3281679194e+08
/s
std
1.9930140515e+08
/s
p5
307205.12
/s
p95
6.6362322383e+08
/s
peak
9.0000766724e+08
/s
WASM usage: 'remote_call::echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
53505360
over 1105.487706103s
mean rate
6.0217134e+06
/s
std
8.52657386e+06
/s
p5
58870.06
/s
p95
2.205596727e+07
/s
peak
2.92918292e+07
/s
WASM usage: 'remote_call::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 1105.487706103s
Not enough time data to show a trend.
Zome call duration: 'remote_call::call_echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.12543
s
SD
0.04007
s
p50
0.123746
s
p95
0.223018
s
p99
0.230404
s
Zome call duration: 'remote_call::echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.003563
s
SD
0.00115
s
p50
0.003248
s
p95
0.00551
s
p99
0.005513
s
WASM call duration: 'remote_call::call_echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.124139
s
SD
0.040114
s
p50
0.122532
s
p95
0.222047
s
p99
0.229448
s
WASM call duration: 'remote_call::echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00235
s
SD
0.000766
s
p50
0.002193
s
p95
0.003567
s
p99
0.003578
s
WASM call duration: 'remote_call::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001815
s
SD
0.000314
s
p50
0.001706
s
p95
0.00239
s
p99
0.00239
s
Host function call duration: '__hc__call_1'
Duration of this host function call invoked from within WASM.
mean
0.121265
s
SD
0.040201
s
p50
0.119624
s
p95
0.219754
s
p99
0.227179
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000352
s
SD
0.000188
s
p50
0.000248
s
p95
0.000798
s
p99
0.000798
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
1.9e-05
s
SD
7e-06
s
p50
1.8e-05
s
p95
3.6e-05
s
p99
3.8e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000413
s
SD
0.000189
s
p50
0.000312
s
p95
0.000718
s
p99
0.000822
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000254
s
SD
0.000195
s
p50
0.000157
s
p95
0.000642
s
p99
0.000642
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.6
s
mean
448.79
s
SD
257.5
s
p95
848.34
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
72
over 1105.487832752s
mean rate
4.72
/s
std
18.09
/s
p5
0
/s
p95
30.66
/s
peak
205.73
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
2.550405
s
SD
1.222066
s
p50
2.896237
s
p95
4.387812
s
p99
5.607119
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.95219
s
SD
0.037402
s
p50
1.953846
s
p95
1.992308
s
p99
1.992308
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.100944
s
SD
0.199863
s
p50
0.072891
s
p95
0.332222
s
p99
1.533007
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001463
s
SD
0.000946
s
p50
0.001165
s
p95
0.003289
s
p99
0.003289
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001504
s
SD
0.000906
s
p50
0.001218
s
p95
0.003818
s
p99
0.004467
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001686
s
SD
0.000831
s
p50
0.001593
s
p95
0.003256
s
p99
0.003256
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.475791
s
SD
0.37196
s
p50
0.611975
s
p95
1.35495
s
p99
2.066551
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.54415
s
SD
0.503819
s
p50
0.520675
s
p95
1.461483
s
p99
1.852563
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000242
s
SD
7.7e-05
s
p50
0.000254
s
p95
0.000391
s
p99
0.000392
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000105
s
SD
3.3e-05
s
p50
9.4e-05
s
p95
0.00019
s
p99
0.000198
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000222
s
SD
7.6e-05
s
p50
0.00018
s
p95
0.000359
s
p99
0.00036
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000239
s
SD
9.3e-05
s
p50
0.000243
s
p95
0.000452
s
p99
0.00047
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
9.1e-05
s
SD
3.6e-05
s
p50
8.3e-05
s
p95
0.00019
s
p99
0.00019
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000176
s
SD
4.3e-05
s
p50
0.000181
s
p95
0.000262
s
p99
0.000267
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000347
s
SD
0.008764
s
p50
0.000662
s
p95
0.024276
s
p99
0.029401
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000436
s
SD
0.000141
s
p50
0.000401
s
p95
0.000722
s
p99
0.000725
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.104275
s
SD
0.036917
s
p50
0.108927
s
p95
0.158586
s
p99
0.177983
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.130089
s
SD
0.038172
s
p50
0.117058
s
p95
0.2146
s
p99
0.2146
s
P2P request roundtrip: 'call_remote'
Time spent sending a call_remote request and awaiting its response.
mean
0.120678
s
SD
0.04023
s
p50
0.119152
s
p95
0.219323
s
p99
0.226746
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
3.93
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
10.51
KiB/s
mean
60.37
KiB/s
SD
481.07
KiB/s
p95
21.82
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
12.56
KiB/s
mean
18.49
KiB/s
SD
14.66
KiB/s
p95
22.49
KiB/s
Total bytes received
Total bytes received on primary network interface
count
527.64
MiB
mean
593.74
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
161.59
MiB
mean
181.83
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 639.96 MiB/s
Disk full anomaly
Disk full anomaly was detected
Detected
Critical Disk /etc/resolv.conf: 1/2 hosts above 90% capacity
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.29
%
mean
9.53
%
SD
10.31
%
p95
36.69
%
System
5.60
%
CPU percentiles
CPU usage percentiles
p50
6.16
%
p95
36.69
%
p99
37.93
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
5.26
%
mean
12.33
%
SD
6
%
p95
28.26
%
Memory available percentage
Percentage of available memory
p5
71.74
%
mean
87.67
%
SD
6
%
p95
94.74
%
Max host memory used
Maximum memory usage percentage across all hosts
max
28.28
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.12
%
Memory growth rate
Rate of memory growth over time
growth
639.96
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.01
MiB/s
Disk write throughput
Disk write throughput in MiB/s
7.71
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/2
hosts
Mount Point
/efi-boot0/2
hosts
Mount Point
/etc/hostname1/2
hosts
Mount Point
/etc/hosts1/2
hosts
Mount Point
/etc/nomad.d/client-meta.json0/6
hosts
Mount Point
/etc/resolv.conf1/2
hosts
Mount Point
/nix/store0/2
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.48
5 min
0.40
15 min
0.30
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0.623
%
SD
1.5577
%
p95
2
%
60 second average
0.6048
%
300 second average
0.4476
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0.6835
%
SD
1.6829
%
p95
2.93
%
60 second average
0.6530
%
300 second average
0.5273
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0.6566
%
SD
1.6195
%
p95
2.85
%
60 second average
0.6274
%
300 second average
0.5061
%
Holochain process CPU usage
CPU usage by Holochain process
p5
1.01
%
mean
4.42
%
SD
4.06
%
p95
7.83
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
195.40
KiB
mean
219.78
KiB
SD
15.29
KiB
p95
241.52
KiB
Holochain process threads
Number of threads in Holochain process
p5
16
threads
mean
19.93
threads
SD
2.87
threads
p95
23
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
49
file descriptors
mean
56.36
file descriptors
SD
11.08
file descriptors
p95
78
file descriptors
Remote Signals
↑ Back to indexThis scenario tests the throughput of remote_signals operations.
Started
Thu, 30 Jul 2026 23:05:13 UTC
Peer count
10
Behaviours
-
default(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
remote_signals_30587147196_1
Round trip time
The time from origin signal dispatch to origin receive of the remote side's response signal.
mean
0.040291
s
SD
0.092477
s
p50
0.041323
s
p95
0.055569
s
p99
0.057917
s
Timeout rate
The proportion of remote signal round-trips that timed out.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_signal::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37471.066593567s
Not enough time data to show a trend.
WASM usage: 'remote_signal::recv_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
37339510
over 890.160369091s
mean rate
3.96545994169e+09
/s
std
7.27495213831e+10
/s
p5
0
/s
p95
5.614007643e+08
/s
peak
1.39561111111e+12
/s
WASM usage: 'remote_signal::signal_request'
Metered usage count of the WASM ribosome for this zome function.
total
15772146
over 890.160369091s
mean rate
2.91527284e+07
/s
std
5.960819523e+07
/s
p5
0
/s
p95
1.7070688246e+08
/s
peak
2.7164887307e+08
/s
Zome call duration: 'remote_signal::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.003793
s
SD
0.001463
s
p50
0.004688
s
p95
0.005084
s
p99
0.005102
s
Zome call duration: 'remote_signal::signal_request'
Duration of this zome call as measured by Holochain internally.
mean
0.003858
s
SD
0.001505
s
p50
0.004671
s
p95
0.005159
s
p99
0.005166
s
WASM call duration: 'remote_signal::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00178
s
SD
0.00062
s
p50
0.001474
s
p95
0.003295
s
p99
0.003295
s
WASM call duration: 'remote_signal::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002478
s
SD
0.001004
s
p50
0.002939
s
p95
0.003498
s
p99
0.003511
s
WASM call duration: 'remote_signal::signal_request'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002502
s
SD
0.001042
s
p50
0.002871
s
p95
0.003546
s
p99
0.003551
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000273
s
SD
0.000102
s
p50
0.000248
s
p95
0.000543
s
p99
0.000543
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
7.1e-05
s
SD
2.6e-05
s
p50
7.9e-05
s
p95
0.000101
s
p99
0.000102
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
8.1e-05
s
SD
3.2e-05
s
p50
8.2e-05
s
p95
0.000126
s
p99
0.000127
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
1.4e-05
s
SD
6e-06
s
p50
1.6e-05
s
p95
2.1e-05
s
p99
2.1e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000416
s
SD
0.000338
s
p50
0.000203
s
p95
0.001225
s
p99
0.001225
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
1766
over 890.160417824s
mean rate
39886.12
/s
std
303441.02
/s
p5
0
/s
p95
102396.07
/s
peak
5.61797753e+06
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
1764
over 890.160416465s
mean rate
147216.62
/s
std
1.74587334e+06
/s
p5
0
/s
p95
76394.19
/s
peak
2.702702703e+07
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000227
s
SD
0.000174
s
p50
0.000139
s
p95
0.00071
s
p99
0.00071
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.01
s
mean
451.65
s
SD
259.52
s
p95
857.01
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
6
over 37471.632916258s
mean rate
409.82
/s
std
10465.02
/s
p5
0
/s
p95
0
/s
peak
307571.05
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
2.546761
s
SD
1.698738
s
p50
0.726339
s
p95
4.470861
s
p99
5.361476
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.76997
s
SD
0.421028
s
p50
1.846154
s
p95
1.897436
s
p99
1.897436
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.424299
s
SD
0.426142
s
p50
0.190404
s
p95
0.988231
s
p99
2.445528
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001595
s
SD
0.001257
s
p50
0.000991
s
p95
0.004769
s
p99
0.004769
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001575
s
SD
0.000514
s
p50
0.001503
s
p95
0.002903
s
p99
0.002903
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001528
s
SD
0.000507
s
p50
0.001515
s
p95
0.002632
s
p99
0.002738
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.115488
s
SD
0.336897
s
p50
0.005046
s
p95
0.842432
s
p99
1.255458
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.025748
s
SD
0.019264
s
p50
0.026289
s
p95
0.056233
s
p99
0.080132
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000257
s
SD
8.5e-05
s
p50
0.000305
s
p95
0.000345
s
p99
0.000346
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000113
s
SD
4.6e-05
s
p50
9.2e-05
s
p95
0.000189
s
p99
0.000217
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000241
s
SD
9.9e-05
s
p50
0.000192
s
p95
0.000331
s
p99
0.000407
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000351
s
SD
0.000353
s
p50
0.000113
s
p95
0.001204
s
p99
0.001598
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.8e-05
s
SD
2.4e-05
s
p50
8.2e-05
s
p95
0.000149
s
p99
0.000149
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000254
s
SD
0.000111
s
p50
0.000234
s
p95
0.000426
s
p99
0.000653
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000156
s
SD
0.010773
s
p50
0.000319
s
p95
0.033557
s
p99
0.038089
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000603
s
SD
0.000181
s
p50
0.000467
s
p95
0.000792
s
p99
0.000801
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.017628
s
SD
0.007007
s
p50
0.013275
s
p95
0.023559
s
p99
0.026114
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.019164
s
SD
0.007904
s
p50
0.017223
s
p95
0.030427
s
p99
0.035145
s
P2P received remote signals
Count of remote signals received.
total
1764
over 890.160346413s
mean rate
17761.62
/s
std
144755.86
/s
p5
0
/s
p95
36649.5
/s
peak
2.42130751e+06
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
17.58
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
68
B/s
mean
12.71
KiB/s
SD
140.84
KiB/s
p95
20.20
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
64
B/s
mean
4.30
KiB/s
SD
6.35
KiB/s
p95
21.39
KiB/s
Total bytes received
Total bytes received on primary network interface
count
55.21
MiB
mean
63.53
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
18.70
MiB
mean
21.52
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2.46
%
mean
32.8
%
SD
29.16
%
p95
68.9
%
System
15.22
%
CPU percentiles
CPU usage percentiles
p50
35.66
%
p95
68.90
%
p99
69.10
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
2
hosts
mean time
0.01
s
Memory used percentage
Percentage of memory used
p5
6.79
%
mean
13.03
%
SD
3.36
%
p95
17.39
%
Memory available percentage
Percentage of available memory
p5
82.61
%
mean
86.97
%
SD
3.36
%
p95
93.21
%
Max host memory used
Maximum memory usage percentage across all hosts
max
16.31
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-41.56
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
11.25
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname0/2
hosts
Mount Point
/etc/hosts0/2
hosts
Mount Point
/etc/nomad.d/client-meta.json0/3
hosts
Mount Point
/etc/resolv.conf0/2
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.11
5 min
1.59
15 min
0.97
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
11.895
%
SD
15.3299
%
p95
32.94
%
60 second average
11.1889
%
300 second average
8.0754
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0.5581
%
SD
1.4193
%
p95
2.62
%
60 second average
0.5362
%
300 second average
0.2244
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0.3237
%
SD
1.3485
%
p95
1.98
%
60 second average
0.3106
%
300 second average
0.1111
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.3
%
mean
5.57
%
SD
6.73
%
p95
13.75
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
178.97
KiB
mean
190.86
KiB
SD
16.49
KiB
p95
214.37
KiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
mean
14.06
threads
SD
1.81
threads
p95
17
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
41
file descriptors
mean
49.64
file descriptors
SD
7.68
file descriptors
p95
66
file descriptors
Single-write, many-read
↑ Back to indexCreates an entry in the agent setup, then read one's own record back. This tests the maximum read performance for reading back local data when the chain is short.
Started
Thu, 30 Jul 2026 23:14:49 UTC
Peer count
1
Behaviours
-
default(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
single_write_many_read_30587147196_1
read call timingThe time it takes to complete the zome call that retrieves the record.
mean
0.004383
s
SD
0.036695
s
p50
0.003122
s
p95
0.004776
s
p99
0.005979
s
read call rateThe number of read zome calls completed per second.
mean
2244.86
/s
Error count
The number of errors collected.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000357
s
SD
2e-06
s
p50
0.000357
s
p95
0.000357
s
p99
0.000358
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.002185937s
Not enough time data to show a trend.
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
3013293480
over 280.002185937s
mean rate
1.076168015e+07
/s
std
1.2734681e+06
/s
p5
8.12249883e+06
/s
p95
1.257564608e+07
/s
peak
1.276191891e+07
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.002185937s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.002185937s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.003394
s
SD
0
s
p50
0.003394
s
p95
0.003394
s
p99
0.003394
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.001946
s
SD
1.6e-05
s
p50
0.001946
s
p95
0.001949
s
p99
0.001949
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002767
s
SD
0
s
p50
0.002767
s
p95
0.002767
s
p99
0.002767
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001366
s
SD
1.1e-05
s
p50
0.001366
s
p95
0.001368
s
p99
0.001368
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001205
s
SD
0
s
p50
0.001205
s
p95
0.001205
s
p99
0.001205
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000821
s
SD
0
s
p50
0.000821
s
p95
0.000821
s
p99
0.000821
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.00027
s
SD
9e-06
s
p50
0.000279
s
p95
0.000279
s
p99
0.000279
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000397
s
SD
3e-06
s
p50
0.000397
s
p95
0.000397
s
p99
0.000397
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001485
s
SD
0
s
p50
0.001485
s
p95
0.001485
s
p99
0.001485
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000142
s
SD
0
s
p50
0.000142
s
p95
0.000142
s
p99
0.000142
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.19
s
mean
147.19
s
SD
83.67
s
p95
277.19
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.002190237s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.053474
s
SD
0
s
p50
0.053474
s
p95
0.053474
s
p99
0.053474
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
p95
1
s
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000564
s
SD
0
s
p50
0.000564
s
p95
0.000564
s
p99
0.000564
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000655
s
SD
0
s
p50
0.000655
s
p95
0.000655
s
p99
0.000655
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000933
s
SD
0
s
p50
0.000933
s
p95
0.000933
s
p99
0.000933
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.000885
s
SD
3.7e-05
s
p50
0.000886
s
p95
0.000958
s
p99
0.000958
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001163
s
SD
0
s
p50
0.001163
s
p95
0.001163
s
p99
0.001163
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000533
s
SD
0
s
p50
0.000533
s
p95
0.000533
s
p99
0.000533
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.00014
s
SD
1e-06
s
p50
0.00014
s
p95
0.000141
s
p99
0.000141
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000299
s
SD
4.1e-05
s
p50
0.000299
s
p95
0.000306
s
p99
0.000307
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
8.2e-05
s
SD
1e-06
s
p50
8.2e-05
s
p95
8.2e-05
s
p99
8.2e-05
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000313
s
SD
2e-06
s
p50
0.000313
s
p95
0.000313
s
p99
0.000313
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000114
s
SD
0
s
p50
0.000114
s
p95
0.000114
s
p99
0.000114
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
6.8e-05
s
SD
5e-06
s
p50
6.5e-05
s
p95
7.7e-05
s
p99
7.8e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001169
s
SD
0.009322
s
p50
0.000463
s
p95
0.023742
s
p99
0.023742
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000361
s
SD
0
s
p50
0.000361
s
p95
0.000361
s
p99
0.000361
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
14.57
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
56
B/s
mean
367
B/s
SD
419
B/s
p95
782
B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
64
B/s
mean
265
B/s
SD
184
B/s
p95
490
B/s
Total bytes received
Total bytes received on primary network interface
count
103.97
KiB
mean
367
B/s
Total bytes sent
Total bytes sent on primary network interface
count
75.13
KiB
mean
265
B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 43.89 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
18.3
%
mean
21.35
%
SD
5
%
p95
24.13
%
System
6.78
%
CPU percentiles
CPU usage percentiles
p50
19.98
%
p95
24.13
%
p99
46.17
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
13.16
%
mean
13.79
%
SD
0.5
%
p95
14.5
%
Memory available percentage
Percentage of available memory
p5
85.5
%
mean
86.21
%
SD
0.5
%
p95
86.84
%
Max host memory used
Maximum memory usage percentage across all hosts
max
13.79
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
43.89
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
4.47
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/1
hosts
Mount Point
/efi-boot0/1
hosts
Mount Point
/nix/store0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.21
5 min
0.62
15 min
0.31
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0.0257
%
SD
0.0774
%
p95
0.26
%
60 second average
0.0250
%
300 second average
0.0053
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
7.74
%
mean
13.617
%
SD
4.0163
%
p95
19.89
%
60 second average
11.5150
%
300 second average
6.1973
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
7.69
%
mean
13.4483
%
SD
3.9556
%
p95
19.74
%
60 second average
11.3670
%
300 second average
6.1073
%
Holochain process CPU usage
CPU usage by Holochain process
p5
15.72
%
mean
18.54
%
SD
4.99
%
p95
20.95
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
241.27
KiB
mean
258.35
KiB
SD
23.29
KiB
p95
268.77
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
mean
13.13
threads
SD
0.72
threads
p95
13
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
54
file descriptors
mean
55.77
file descriptors
SD
3.06
file descriptors
p95
62
file descriptors
Two-party countersigning
↑ Back to indexThis scenario tests the performance of countersigning operations. There are two roles: initiate and participate. The participants commit an entry to advertise that they are willing to participate in sessions. They listen for sessions and participate in one at a time.
Started
Fri, 31 Jul 2026 01:40:38 UTC
Peer count
3
Peer count at end
3
Behaviours
-
initiate(1 agent) -
participate(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
two_party_countersigning_30587147196_1
Session accepted -- timing
The duration of the session from acceptance to completion.
Mean
mean
1.638714
s
SD
4.16777
s
Max
Highest per-partition mean latency
max mean
1.693596
s
Min
Lowest per-partition mean latency
min mean
1.583832
s
Session accepted -- success rate
The number of accepted sessions that completed per second.
Mean
mean
4.76
/s
Max
Highest per-partition mean rate
max
4.94
/s
Min
Lowest per-partition mean rate
min
4.59
/s
Session accepted -- success ratio
Fraction of accepted sessions that completed successfully (0–1).
1
Session accepted -- failures
Accepted sessions that failed to complete.
Total
22
Agents affected
2 / 2
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
11
Max
Highest count in any single partition
17
Min
Lowest count in any single partition
5
Session initiated -- timing
The duration of the session from initiation to completion.
Mean
mean
1.423638
s
SD
1.745163
s
Max
Highest per-partition mean latency
max mean
1.423638
s
Min
Lowest per-partition mean latency
min mean
1.423638
s
Session initiated -- success rate
The number of initiated sessions that completed per second.
Mean
mean
9.47
/s
Max
Highest per-partition mean rate
max
9.47
/s
Min
Lowest per-partition mean rate
min
9.47
/s
Session initiated -- success ratio
Fraction of initiated sessions that completed successfully (0–1).
1
Session initiated -- failures
Initiated sessions that failed to complete.
Total
23
Agents affected
1 / 1
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
23
Max
Highest count in any single partition
23
Min
Lowest count in any single partition
23
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000241
s
SD
3.2e-05
s
p50
0.000229
s
p95
0.000292
s
p99
0.000296
s
WASM usage: 'countersigning::accept_two_party'
Metered usage count of the WASM ribosome for this zome function.
total
11464229
over 346.319888053s
mean rate
385271
/s
std
368985.64
/s
p5
0
/s
p95
804663.25
/s
peak
804687.45
/s
WASM usage: 'countersigning::call_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
6243893
over 346.650084138s
mean rate
499806.97
/s
std
410597.37
/s
p5
0
/s
p95
1.30761374e+06
/s
peak
1.63836832e+06
/s
WASM usage: 'countersigning::commit_two_party'
Metered usage count of the WASM ribosome for this zome function.
total
22811954
over 346.650084138s
mean rate
1.58108781e+06
/s
std
1.74115609e+06
/s
p5
0
/s
p95
4.58534446e+06
/s
peak
4.90766495e+06
/s
WASM usage: 'countersigning::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 356.650100741s
Not enough time data to show a trend.
WASM usage: 'countersigning::initiator_hello'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.002231288s
Not enough time data to show a trend.
WASM usage: 'countersigning::list_participants'
Metered usage count of the WASM ribosome for this zome function.
total
12923923
over 280.002231288s
mean rate
46156.57
/s
std
69121.36
/s
p5
7833.35
/s
p95
71231.84
/s
peak
394541.94
/s
WASM usage: 'countersigning::participant_hello'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 346.319888053s
Not enough time data to show a trend.
WASM usage: 'countersigning::start_two_party'
Metered usage count of the WASM ribosome for this zome function.
total
35384905
over 270.002214685s
mean rate
131054.09
/s
std
79936.8
/s
p5
18920.42
/s
p95
245964.21
/s
peak
283803.69
/s
WASM usage: 'countersigning_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
856305
over 356.650100741s
mean rate
428111.13
/s
std
388571.07
/s
p5
0
/s
p95
1.09725746e+06
/s
peak
1.14451909e+06
/s
Zome call duration: 'countersigning::accept_two_party'
Duration of this zome call as measured by Holochain internally.
mean
0.170249
s
SD
0.041249
s
p50
0.213679
s
p95
0.216611
s
p99
0.217012
s
Zome call duration: 'countersigning::call_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.00226
s
SD
0.000838
s
p50
0.002726
s
p95
0.003274
s
p99
0.003274
s
Zome call duration: 'countersigning::commit_two_party'
Duration of this zome call as measured by Holochain internally.
mean
0.141062
s
SD
0.033973
s
p50
0.145584
s
p95
0.210141
s
p99
0.211708
s
Zome call duration: 'countersigning::initiator_hello'
Duration of this zome call as measured by Holochain internally.
mean
0.001104
s
SD
0
s
p50
0.001104
s
p95
0.001104
s
p99
0.001104
s
Zome call duration: 'countersigning::list_participants'
Duration of this zome call as measured by Holochain internally.
mean
0.002754
s
SD
3.6e-05
s
p50
0.002753
s
p95
0.002785
s
p99
0.002788
s
Zome call duration: 'countersigning::participant_hello'
Duration of this zome call as measured by Holochain internally.
mean
0.004632
s
SD
0.000852
s
p50
0.005437
s
p95
0.005437
s
p99
0.005437
s
Zome call duration: 'countersigning::start_two_party'
Duration of this zome call as measured by Holochain internally.
mean
0.186829
s
SD
0.011645
s
p50
0.188033
s
p95
0.21124
s
p99
0.211964
s
WASM call duration: 'countersigning::accept_two_party'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.191526
s
SD
0.093884
s
p50
0.213677
s
p95
0.216093
s
p99
0.797067
s
WASM call duration: 'countersigning::call_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001493
s
SD
0.000562
s
p50
0.001906
s
p95
0.002099
s
p99
0.002251
s
WASM call duration: 'countersigning::commit_two_party'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.140289
s
SD
0.034142
s
p50
0.144891
s
p95
0.209458
s
p99
0.210906
s
WASM call duration: 'countersigning::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004752
s
SD
0.001582
s
p50
0.004456
s
p95
0.006798
s
p99
0.006798
s
WASM call duration: 'countersigning::initiator_hello'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000648
s
SD
0
s
p50
0.000648
s
p95
0.000648
s
p99
0.000648
s
WASM call duration: 'countersigning::list_participants'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002286
s
SD
2.7e-05
s
p50
0.002285
s
p95
0.002309
s
p99
0.002311
s
WASM call duration: 'countersigning::participant_hello'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003919
s
SD
0.000789
s
p50
0.004664
s
p95
0.004664
s
p99
0.004664
s
WASM call duration: 'countersigning::start_two_party'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.186357
s
SD
0.011659
s
p50
0.187568
s
p95
0.210804
s
p99
0.211529
s
WASM call duration: 'countersigning_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001027
s
SD
0.000464
s
p50
0.001529
s
p95
0.001773
s
p99
0.001776
s
Host function call duration: '__hc__accept_countersigning_preflight_request_1'
Duration of this host function call invoked from within WASM.
mean
0.000955
s
SD
0.000425
s
p50
0.001319
s
p95
0.001376
s
p99
0.001419
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.3e-05
s
SD
9e-06
s
p50
2.5e-05
s
p95
4.1e-05
s
p99
4.1e-05
s
Host function call duration: '__hc__call_1'
Duration of this host function call invoked from within WASM.
mean
0.184227
s
SD
0.076484
s
p50
0.191254
s
p95
0.209173
s
p99
0.790397
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000339
s
SD
0.000152
s
p50
0.000268
s
p95
0.000609
s
p99
0.000609
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000474
s
SD
0.000197
s
p50
0.000661
s
p95
0.000661
s
p99
0.000661
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
0.000106
s
SD
0.000126
s
p50
6.2e-05
s
p95
0.000337
s
p99
0.000552
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.136366
s
SD
0.034801
s
p50
0.141142
s
p95
0.206039
s
p99
0.206664
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000282
s
SD
2.9e-05
s
p50
0.000271
s
p95
0.00033
s
p99
0.000334
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
3e-06
s
SD
0
s
p50
3e-06
s
p95
3e-06
s
p99
5e-06
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001659
s
SD
0.000737
s
p50
0.001517
s
p95
0.002982
s
p99
0.003004
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
90
over 346.650156583s
mean rate
7.8
/s
std
10.49
/s
p5
0
/s
p95
28.33
/s
peak
31.02
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000225
s
SD
8.3e-05
s
p50
0.000289
s
p95
0.000328
s
p99
0.000358
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.33
s
mean
145.07
s
SD
82.86
s
p95
273.79
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
1080
over 356.650094076s
mean rate
4.06
/s
std
4.56
/s
p5
0
/s
p95
12.53
/s
peak
18.15
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.306662
s
SD
1.299019
s
p50
0.330955
s
p95
3.783962
s
p99
3.783962
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.683323
s
SD
0.164107
s
p50
1.689922
s
p95
1.757025
s
p99
1.759197
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.030113
s
SD
0.898986
s
p50
0.030092
s
p95
2.801618
s
p99
2.801618
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.072492
s
SD
0.095135
s
p50
0.066437
s
p95
0.287888
s
p99
0.292857
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.0072
s
SD
0.005849
s
p50
0.000671
s
p95
0.015478
s
p99
0.016298
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001811
s
SD
0.000852
s
p50
0.00229
s
p95
0.003069
s
p99
0.004048
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.046494
s
SD
1.068324
s
p50
0.03338
s
p95
3.334965
s
p99
3.334965
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.269798
s
SD
0.115307
s
p50
0.221621
s
p95
0.393164
s
p99
0.4419
s
Witnessing workflow duration
Time spent running the witnessing workflow.
mean
0.052998
s
SD
0.05058
s
p50
0.000452
s
p95
0.12147
s
p99
0.154699
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000212
s
SD
0.000117
s
p50
0.000216
s
p95
0.000427
s
p99
0.000631
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000288
s
SD
0.000226
s
p50
0.000142
s
p95
0.000729
s
p99
0.000729
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000132
s
SD
6.4e-05
s
p50
0.000171
s
p95
0.000222
s
p99
0.000395
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000151
s
SD
5.8e-05
s
p50
0.000163
s
p95
0.000234
s
p99
0.000507
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000133
s
SD
8.8e-05
s
p50
8.1e-05
s
p95
0.00026
s
p99
0.00026
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000153
s
SD
9.4e-05
s
p50
0.000186
s
p95
0.000352
s
p99
0.000491
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003133
s
SD
0.008952
s
p50
0.000269
s
p95
0.027776
s
p99
0.027776
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000276
s
SD
0.000111
s
p50
0.000265
s
p95
0.000367
s
p99
0.00081
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.119283
s
SD
0.000792
s
p50
0.119778
s
p95
0.119778
s
p99
0.119778
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.156033
s
SD
0.038672
s
p50
0.158686
s
p95
0.205383
s
p99
0.206232
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.188842
s
SD
6.168743
s
p50
0.20439
s
p95
0.303307
s
p99
60.001675
s
P2P request roundtrip: 'call_remote'
Time spent sending a call_remote request and awaiting its response.
mean
0.183864
s
SD
6.566237
s
p50
0.191066
s
p95
0.20871
s
p99
60.001358
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
22.32
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
36.79
KiB/s
mean
96.30
KiB/s
SD
39.91
KiB/s
p95
148.91
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
55.25
KiB/s
mean
101.95
KiB/s
SD
33.26
KiB/s
p95
143.96
KiB/s
Total bytes received
Total bytes received on primary network interface
count
84.64
MiB
mean
270.84
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
89.60
MiB
mean
286.72
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.8%
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected
Warning 33% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
6.9
%
mean
27.84
%
SD
25.37
%
p95
71.74
%
System
5.52
%
CPU percentiles
CPU usage percentiles
p50
12.96
%
p95
71.74
%
p99
98.75
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.14
s
Memory used percentage
Percentage of memory used
p5
17.48
%
mean
21.16
%
SD
3.02
%
p95
25.5
%
Memory available percentage
Percentage of available memory
p5
74.5
%
mean
78.84
%
SD
3.02
%
p95
82.52
%
Max host memory used
Maximum memory usage percentage across all hosts
max
24.89
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-19.26
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
8.53
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/1
hosts
Mount Point
/efi-boot0/1
hosts
Mount Point
/etc/nomad.d/client-meta.json0/2
hosts
Mount Point
/nix/store0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.02
5 min
1.79
15 min
1.64
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
33.33
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
6.633
%
SD
9.6679
%
p95
24.75
%
60 second average
6.1781
%
300 second average
7.5112
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
18.7296
%
SD
25.1022
%
p95
59.91
%
60 second average
19.5083
%
300 second average
16.8533
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
16.5319
%
SD
22.5091
%
p95
53.07
%
60 second average
17.2516
%
300 second average
15.1508
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.14
%
mean
3.09
%
SD
7.5
%
p95
8.94
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
24.64
KiB
mean
239.33
KiB
SD
77.16
KiB
p95
278.43
KiB
Holochain process threads
Number of threads in Holochain process
p5
9
threads
mean
16.47
threads
SD
4.43
threads
p95
20
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
23
file descriptors
mean
68.84
file descriptors
SD
15.98
file descriptors
p95
85
file descriptors
Unyt Chain Transaction
↑ Back to indexTests Unyt chain transaction system performance with credit ledger and smart agreement primitives. The scenario has three roles:
initiate: Progenitor agent that initializes the network with system templates, global configuration, and foundational smart agreementsspend: Transaction agents that accept incoming commitments and create spend transactions distributed among participantssmart_agreements: Smart agreement agents that collect RAVEs, execute agreements, and create parked link spending transactions
Started
Fri, 31 Jul 2026 04:09:57 UTC
Peer count
30
Peer count at end
20
Behaviours
-
initiate(1 agent) -
smart_agreements(1 agent) -
spend(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
unyt_chain_transaction_30587147196_1
Global definition propagation time
Time from session start until each agent detected the global_definition propagation. Shows aggregate statistics across agents.
Mean
mean
23.166667
s
SD
0
s
Max
Highest per-partition mean latency
max mean
116
s
Min
Lowest per-partition mean latency
min mean
0
s
Sync lag: Commitment transactions
Time between commitment creation and discovery by the receiving agent (seconds). Shows aggregate statistics across agents.
Mean
mean
378.552876
s
SD
150.47337
s
Max
Highest per-partition mean latency
max mean
1047.337525
s
Min
Lowest per-partition mean latency
min mean
140.549789
s
Sync lag: RAVE transactions
Time between RAVE creation and discovery by smart_agreements agents (seconds). Shows aggregate statistics across agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Sync lag: Grouped parked requests
Time between grouped_parked request creation and discovery (seconds). Shows aggregate statistics across agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Final ledger balance
Final ledger balance across all agents at teardown (base unyt units). Sum should be stable across runs; deviation indicates value was created or destroyed.
sum
-8195698040026
mean
-3.41487418334e+11
min
-866516113296
max
0
n
24
Final ledger fees
Final ledger fees owed across all agents at teardown (base unyt units).
sum
0
mean
0
min
0
max
0
n
24
Actionable transaction commitments
Remaining actionable transaction commitments at teardown. Non-zero sum indicates work left unfinished.
sum
23
mean
0.96
min
0
max
7
n
24
Actionable transaction accepts
Remaining actionable transaction accepts at teardown. Non-zero sum indicates work left unfinished.
sum
0
mean
0
min
0
max
0
n
24
Completed transaction accepts
Completed transaction accepts at teardown.
sum
88
mean
3.67
min
0
max
35
n
24
Completed transaction spends
Completed transaction spends at teardown.
sum
1576
mean
65.67
min
0
max
148
n
24
Completed transaction RAVEs
Completed transaction RAVEs at teardown.
sum
1619
mean
67.46
min
0
max
158
n
24
Parked spends
Parked spend counts at teardown. These are pending link-spending transactions.
sum
120
mean
5
min
0
max
90
n
24
Check agent exists: Duration
Duration of the check_agent_exists loop per behaviour iteration (seconds).
mean
0.092023
s
SD
0.093359
s
p50
0.077147
s
p95
0.234278
s
p99
0.58455
s
Check agent exists: Total calls
Total check_agent_exists calls made across all agents and iterations.
sum
740
mean
11.04
min
0
max
24
n
67
Check agent exists: Failed calls
Total check_agent_exists calls that failed across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
67
Check agent exists: Missing agents
Total check_agent_exists calls that reported a missing agent across all agents and iterations.
sum
5
mean
0.07
min
0
max
2
n
67
UI action list refresh: Duration
Duration of the UI action list refresh per behaviour iteration (seconds).
mean
0.112887
s
SD
0.176078
s
p50
0.061869
s
p95
0.246487
s
p99
1.39837
s
UI action list refresh: Failed calls
Total UI action list refresh calls that failed across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
67
UI routine refresh: Duration
Duration of the full UI routine refresh per behaviour iteration (seconds), including check_agent_exists, action list refresh, and transaction detail refresh.
mean
84.144365
s
SD
164.097892
s
p50
17.989658
s
p95
510.007475
s
p99
748.68716
s
UI routine refresh: Watchlist count
Watchlist size (number of transactions being tracked) per behaviour iteration. Indicates how many transactions agents are actively monitoring.
sum
1528
mean
23.15
min
0
max
72
n
66
UI transaction detail item refresh: Duration
Duration of refreshing a single transaction detail item per behaviour iteration (seconds).
mean
3.917008
s
SD
5.533408
s
p50
1.731439
s
p95
14.755662
s
p99
26.202489
s
UI transaction detail item refresh: Primary transaction total calls
Total primary transaction fetches made during per-item detail refresh across all agents and iterations.
sum
3178
mean
2
min
2
max
2
n
1589
UI transaction detail item refresh: Primary transaction failed calls
Total primary transaction fetches that failed during per-item detail refresh across all agents and iterations.
sum
8
mean
0.01
min
0
max
1
n
1589
UI transaction detail item refresh: Related transaction total calls
Total related transaction fetches made during per-item detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
1589
UI transaction detail item refresh: Related transaction failed calls
Total related transaction fetches that failed during per-item detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
1589
UI transaction detail refresh: Duration
Duration of refreshing all watched transaction details per behaviour iteration (seconds).
mean
108.440027
s
SD
179.124162
s
p50
30.563741
s
p95
647.598169
s
p99
748.292295
s
UI transaction detail refresh: Transactions processed
Total number of transactions processed during the detail refresh across all agents and iterations.
sum
1528
mean
29.96
min
8
max
72
n
51
UI transaction detail refresh: Primary transaction total calls
Total primary transaction fetches made during the full detail refresh across all agents and iterations.
sum
3056
mean
59.92
min
16
max
144
n
51
UI transaction detail refresh: Primary transaction failed calls
Total primary transaction fetches that failed during the full detail refresh across all agents and iterations.
sum
6
mean
0.12
min
0
max
2
n
51
UI transaction detail refresh: Related transaction total calls
Total related transaction fetches made during the full detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
51
UI transaction detail refresh: Related transaction failed calls
Total related transaction fetches that failed during the full detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
51
Error count
The total number of errors accumulated across all agents over the run.
2600
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.02775
s
SD
0.022424
s
p50
0.005024
s
p95
0.045761
s
p99
0.096975
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
51
over 2391.308617447s
mean rate
52.34
/s
std
90.26
/s
p5
0
/s
p95
244.6
/s
peak
689.67
/s
Zome call duration: 'transactor::check_agent_exists'
Duration of this zome call as measured by Holochain internally.
mean
0.005984
s
SD
0.005925
s
p50
0.004294
s
p95
0.019735
s
p99
0.023964
s
Zome call duration: 'transactor::create_accept'
Duration of this zome call as measured by Holochain internally.
mean
0.175001
s
SD
0.07125
s
p50
0.179083
s
p95
0.346957
s
p99
0.346957
s
Zome call duration: 'transactor::create_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.019015
s
SD
0.007528
s
p50
0.017328
s
p95
0.034666
s
p99
0.035438
s
Zome call duration: 'transactor::create_commitment'
Duration of this zome call as measured by Holochain internally.
mean
0.262025
s
SD
0.14515
s
p50
0.238947
s
p95
0.52773
s
p99
0.881822
s
Zome call duration: 'transactor::create_parked_spend'
Duration of this zome call as measured by Holochain internally.
mean
0.150416
s
SD
0.070652
s
p50
0.122318
s
p95
0.266116
s
p99
0.266116
s
Zome call duration: 'transactor::create_smart_agreement'
Duration of this zome call as measured by Holochain internally.
mean
0.013159
s
SD
0.003679
s
p50
0.014059
s
p95
0.017009
s
p99
0.017009
s
Zome call duration: 'transactor::get_actionable_transactions'
Duration of this zome call as measured by Holochain internally.
mean
0.100338
s
SD
0.074217
s
p50
0.03927
s
p95
0.310668
s
p99
0.317325
s
Zome call duration: 'transactor::get_all_notification_links'
Duration of this zome call as measured by Holochain internally.
mean
0.018364
s
SD
0.018741
s
p50
0.014823
s
p95
0.093767
s
p99
0.093767
s
Zome call duration: 'transactor::get_code_templates_lib'
Duration of this zome call as measured by Holochain internally.
mean
0.040772
s
SD
0.023207
s
p50
0.025865
s
p95
0.064271
s
p99
0.143574
s
Zome call duration: 'transactor::get_current_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.03693
s
SD
0.013865
s
p50
0.023759
s
p95
0.051283
s
p99
0.091345
s
Zome call duration: 'transactor::get_global_units_details'
Duration of this zome call as measured by Holochain internally.
mean
0.019749
s
SD
0.017713
s
p50
0.0162
s
p95
0.091847
s
p99
0.091847
s
Zome call duration: 'transactor::get_history'
Duration of this zome call as measured by Holochain internally.
mean
0.085362
s
SD
0.071908
s
p50
0.073981
s
p95
0.142187
s
p99
0.275943
s
Zome call duration: 'transactor::get_incoming_raves'
Duration of this zome call as measured by Holochain internally.
mean
0.027121
s
SD
0.020667
s
p50
0.014902
s
p95
0.088493
s
p99
0.096904
s
Zome call duration: 'transactor::get_ledger'
Duration of this zome call as measured by Holochain internally.
mean
0.049739
s
SD
0.017674
s
p50
0.038171
s
p95
0.067753
s
p99
0.120797
s
Zome call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of this zome call as measured by Holochain internally.
mean
0.078705
s
SD
0.053621
s
p50
0.043719
s
p95
0.142418
s
p99
0.294676
s
Zome call duration: 'transactor::get_requests_to_execute_agreements'
Duration of this zome call as measured by Holochain internally.
mean
0.041584
s
SD
0.038498
s
p50
0.012918
s
p95
0.089437
s
p99
0.240369
s
Zome call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.022258
s
SD
0.011607
s
p50
0.009632
s
p95
0.043914
s
p99
0.050461
s
Zome call duration: 'transactor::get_sorted_requests_to_spend'
Duration of this zome call as measured by Holochain internally.
mean
0.016098
s
SD
0.016972
s
p50
0.012822
s
p95
0.08245
s
p99
0.08245
s
Zome call duration: 'transactor::get_status'
Duration of this zome call as measured by Holochain internally.
mean
3.155929
s
SD
2.651007
s
p50
3.05312
s
p95
8.915746
s
p99
12.489373
s
Zome call duration: 'transactor::get_transaction'
Duration of this zome call as measured by Holochain internally.
mean
0.01649
s
SD
0.009937
s
p50
0.015811
s
p95
0.034954
s
p99
0.059133
s
Zome call duration: 'transactor::initialize_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.035419
s
SD
0
s
p50
0.035419
s
p95
0.035419
s
p99
0.035419
s
Zome call duration: 'transactor::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.014231
s
SD
0.00582
s
p50
0.014977
s
p95
0.025059
s
p99
0.039326
s
Zome call duration: 'transactor::whoami'
Duration of this zome call as measured by Holochain internally.
mean
0.003637
s
SD
0.001222
s
p50
0.00304
s
p95
0.00556
s
p99
0.005671
s
WASM call duration: 'transactor::check_agent_exists'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00448
s
SD
0.00569
s
p50
0.002776
s
p95
0.01731
s
p99
0.022627
s
WASM call duration: 'transactor::create_accept'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.196498
s
SD
0.071119
s
p50
0.195157
s
p95
0.345423
s
p99
0.345423
s
WASM call duration: 'transactor::create_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.017033
s
SD
0.00684
s
p50
0.015926
s
p95
0.030962
s
p99
0.031951
s
WASM call duration: 'transactor::create_commitment'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.260148
s
SD
0.144643
s
p50
0.237679
s
p95
0.523922
s
p99
0.878406
s
WASM call duration: 'transactor::create_parked_spend'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.149338
s
SD
0.070445
s
p50
0.121333
s
p95
0.264699
s
p99
0.264699
s
WASM call duration: 'transactor::create_smart_agreement'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.011593
s
SD
0.003487
s
p50
0.012283
s
p95
0.01547
s
p99
0.01547
s
WASM call duration: 'transactor::get_actionable_transactions'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.098897
s
SD
0.073665
s
p50
0.037906
s
p95
0.307925
s
p99
0.314743
s
WASM call duration: 'transactor::get_all_notification_links'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.017033
s
SD
0.01826
s
p50
0.013561
s
p95
0.090352
s
p99
0.090352
s
WASM call duration: 'transactor::get_code_templates_lib'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.039496
s
SD
0.022913
s
p50
0.024815
s
p95
0.062164
s
p99
0.140899
s
WASM call duration: 'transactor::get_current_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.28178
s
SD
5.879857
s
p50
0.020652
s
p95
0.810627
s
p99
9.565511
s
WASM call duration: 'transactor::get_global_units_details'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.01842
s
SD
0.017505
s
p50
0.01494
s
p95
0.089652
s
p99
0.089652
s
WASM call duration: 'transactor::get_history'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.08394
s
SD
0.071693
s
p50
0.072429
s
p95
0.139355
s
p99
0.272943
s
WASM call duration: 'transactor::get_incoming_raves'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.025798
s
SD
0.020368
s
p50
0.013895
s
p95
0.085772
s
p99
0.09446
s
WASM call duration: 'transactor::get_ledger'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.048173
s
SD
0.017078
s
p50
0.036767
s
p95
0.063804
s
p99
0.117521
s
WASM call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.07741
s
SD
0.053247
s
p50
0.042485
s
p95
0.140141
s
p99
0.291932
s
WASM call duration: 'transactor::get_requests_to_execute_agreements'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.040248
s
SD
0.03835
s
p50
0.011978
s
p95
0.087049
s
p99
0.239216
s
WASM call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.020831
s
SD
0.011199
s
p50
0.008508
s
p95
0.042608
s
p99
0.048938
s
WASM call duration: 'transactor::get_sorted_requests_to_spend'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.014734
s
SD
0.01669
s
p50
0.011588
s
p95
0.079982
s
p99
0.079982
s
WASM call duration: 'transactor::get_status'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
3.154527
s
SD
2.650718
s
p50
3.052248
s
p95
8.914085
s
p99
12.486307
s
WASM call duration: 'transactor::get_transaction'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.015122
s
SD
0.009576
s
p50
0.014302
s
p95
0.032345
s
p99
0.056261
s
WASM call duration: 'transactor::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.020234
s
SD
0.008496
s
p50
0.018378
s
p95
0.045516
s
p99
0.049414
s
WASM call duration: 'transactor::initialize_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.034033
s
SD
0
s
p50
0.034033
s
p95
0.034033
s
p99
0.034033
s
WASM call duration: 'transactor::post_commit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.04344
s
SD
0.025773
s
p50
0.031273
s
p95
0.083469
s
p99
0.131031
s
WASM call duration: 'transactor::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.012533
s
SD
0.005196
s
p50
0.013006
s
p95
0.021854
s
p99
0.03498
s
WASM call duration: 'transactor::whoami'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002019
s
SD
0.000735
s
p50
0.001768
s
p95
0.003189
s
p99
0.003321
s
WASM call duration: 'transactor_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001452
s
SD
0.000525
s
p50
0.001648
s
p95
0.00267
s
p99
0.003196
s
WASM call duration: 'transactor_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001624
s
SD
0.000666
s
p50
0.001411
s
p95
0.00284
s
p99
0.002945
s
WASM call duration: 'transactor_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.032333
s
SD
0.066868
s
p50
0.026198
s
p95
0.169147
s
p99
0.361318
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.2e-05
s
SD
2e-05
s
p50
2.2e-05
s
p95
4.9e-05
s
p99
9.8e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000463
s
SD
0.00028
s
p50
0.000299
s
p95
0.001008
s
p99
0.001586
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000415
s
SD
0.000256
s
p50
0.000301
s
p95
0.001016
s
p99
0.001388
s
Host function call duration: '__hc__delete_link_1'
Duration of this host function call invoked from within WASM.
mean
0.00888
s
SD
0.006617
s
p50
0.006541
s
p95
0.025707
s
p99
0.025707
s
Host function call duration: '__hc__dna_info_2'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
3.6e-05
s
p50
7e-06
s
p95
1.4e-05
s
p99
0.000226
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
8.3e-05
s
SD
9.7e-05
s
p50
5.4e-05
s
p95
0.000273
s
p99
0.000587
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.574569
s
SD
0.550207
s
p50
0.127174
s
p95
1.439214
s
p99
2.604948
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.092884
s
SD
0.062001
s
p50
0.075442
s
p95
0.230857
s
p99
0.241986
s
Host function call duration: '__hc__get_details_1'
Duration of this host function call invoked from within WASM.
mean
0.001433
s
SD
0.004334
s
p50
0.000552
s
p95
0.009446
s
p99
0.022637
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.048729
s
SD
1.970839
s
p50
0.007574
s
p95
0.040639
s
p99
0.085546
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.032651
s
SD
0.023421
s
p50
0.025242
s
p95
0.067573
s
p99
0.134883
s
Host function call duration: '__hc__must_get_entry_1'
Duration of this host function call invoked from within WASM.
mean
0.00267
s
SD
0.005462
s
p50
0.000622
s
p95
0.014776
s
p99
0.0208
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.004248
s
SD
0.008729
s
p50
0.004065
s
p95
0.021575
s
p99
0.044468
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.001524
s
SD
0.001278
s
p50
0.000903
s
p95
0.004279
s
p99
0.005811
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
6.5e-05
s
SD
3.6e-05
s
p50
5.7e-05
s
p95
0.000134
s
p99
0.000186
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
8e-06
s
p50
8e-06
s
p95
1.9e-05
s
p99
6.5e-05
s
Host function call duration: '__hc__trace_1'
Duration of this host function call invoked from within WASM.
mean
5.8e-05
s
SD
9.4e-05
s
p50
6.5e-05
s
p95
0.000141
s
p99
0.000639
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002753
s
SD
0.001599
s
p50
0.002963
s
p95
0.006686
s
p99
0.008945
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
444
over 1444.379490603s
mean rate
671.49
/s
std
1737.77
/s
p5
0
/s
p95
6470.94
/s
peak
7007.53
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
149
over 2432.205411589s
mean rate
239.29
/s
std
350.46
/s
p5
0.1
/s
p95
1098.56
/s
peak
1829.49
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.045453
s
SD
0.026416
s
p50
0.032856
s
p95
0.088132
s
p99
0.134865
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
57.6
s
mean
603.25
s
SD
391.29
s
p95
1368.2
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
18
over 37464.753518579s
mean rate
14780.72
/s
std
34470.18
/s
p5
0
/s
p95
84775.06
/s
peak
200539.33
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
95.905135
s
SD
57.848048
s
p50
46.828829
s
p95
173.750949
s
p99
281.56488
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
2.030983
s
SD
0.330428
s
p50
1.997006
s
p95
2.170254
s
p99
2.278096
s
App validation workflow duration
Time spent running the app validation workflow.
mean
12.321058
s
SD
11.504011
s
p50
7.324253
s
p95
35.965639
s
p99
59.173357
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.0016
s
SD
0.001088
s
p50
0.001283
s
p95
0.003307
s
p99
0.004192
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.007563
s
SD
0.025262
s
p50
0.002286
s
p95
0.039833
s
p99
0.073135
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.013903
s
SD
0.011464
s
p50
0.007208
s
p95
0.024824
s
p99
0.041411
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.182027
s
SD
4.539762
s
p50
0.175191
s
p95
5.421543
s
p99
22.825043
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
7.160432
s
SD
10.574832
s
p50
5.465131
s
p95
31.44273
s
p99
54.430761
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.012279
s
SD
0.011293
s
p50
0.004122
s
p95
0.03255
s
p99
0.054795
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.008103
s
SD
0.005931
s
p50
0.003049
s
p95
0.017564
s
p99
0.024986
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000213
s
SD
0.000102
s
p50
0.000182
s
p95
0.000445
s
p99
0.000505
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.012204
s
SD
0.010709
s
p50
0.004076
s
p95
0.031043
s
p99
0.05042
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000216
s
SD
0.004019
s
p50
9.4e-05
s
p95
0.000397
s
p99
0.000434
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.00023
s
SD
0.00014
s
p50
0.000183
s
p95
0.000586
s
p99
0.000721
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001544
s
SD
0.293576
s
p50
0.000278
s
p95
0.608584
s
p99
1.383753
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000275
s
SD
0.000156
s
p50
0.000286
s
p95
0.000543
s
p99
0.0007
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.193612
s
SD
29.288648
s
p50
0.189368
s
p95
60.001361
s
p99
60.00182
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.097668
s
SD
0.059251
s
p50
0.07625
s
p95
0.231968
s
p99
0.241547
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
60.001283
s
SD
1.2e-05
s
p50
60.001283
s
p95
60.001283
s
p99
60.001283
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.427362
s
SD
16.345378
s
p50
0.367806
s
p95
60.001211
s
p99
60.001679
s
P2P received remote signals
Count of remote signals received.
total
46
over 1740.041416494s
mean rate
644.4
/s
std
1697.18
/s
p5
0
/s
p95
6438.31
/s
peak
6995.4
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
33.34
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
106
B/s
mean
128.37
KiB/s
SD
631.12
KiB/s
p95
151.22
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
157
B/s
mean
77.90
KiB/s
SD
82.92
KiB/s
p95
222.50
KiB/s
Total bytes received
Total bytes received on primary network interface
count
4.61
GiB
mean
1.72
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.65
GiB
mean
1012.46
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 99.5%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 2746.91 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected
Warning 13% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.26
%
mean
42.21
%
SD
30.27
%
p95
96.09
%
System
8.87
%
CPU percentiles
CPU usage percentiles
p50
38.89
%
p95
96.09
%
p99
99.45
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
30
hosts
mean time
0.16
s
Memory used percentage
Percentage of memory used
p5
11.85
%
mean
28.23
%
SD
15.59
%
p95
57.36
%
Memory available percentage
Percentage of available memory
p5
42.64
%
mean
71.77
%
SD
15.59
%
p95
88.15
%
Max host memory used
Maximum memory usage percentage across all hosts
max
83.47
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.09
%
Memory growth rate
Rate of memory growth over time
growth
2746.91
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.52
MiB/s
Disk write throughput
Disk write throughput in MiB/s
114.54
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/5
hosts
Mount Point
/efi-boot0/4
hosts
Mount Point
/etc/hostname0/8
hosts
Mount Point
/etc/hosts0/8
hosts
Mount Point
/etc/nomad.d/client-meta.json0/18
hosts
Mount Point
/etc/nomad.d/meta.json0/2
hosts
Mount Point
/etc/resolv.conf0/8
hosts
Mount Point
/nix/store0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.21
5 min
1.88
15 min
1.48
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
12.90
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
9.8085
%
SD
15.6889
%
p95
45.19
%
60 second average
9.4872
%
300 second average
7.9473
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
5.6121
%
SD
13.4283
%
p95
41.47
%
60 second average
5.3961
%
300 second average
4.4189
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
4.7316
%
SD
11.8172
%
p95
35.78
%
60 second average
4.5631
%
300 second average
3.7709
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.17
%
mean
26.54
%
SD
28.27
%
p95
85.75
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
690.11
KiB
mean
1.09
MiB
SD
228.54
KiB
p95
1.31
MiB
Holochain process threads
Number of threads in Holochain process
p5
11
threads
mean
30.31
threads
SD
14.86
threads
p95
58
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
41
file descriptors
mean
81.39
file descriptors
SD
25.13
file descriptors
p95
125
file descriptors
Unyt Swap
↑ Back to indexThis scenario exercises Unyt's bridging flow, converting an external
blockchain token (HOT) into Unyt's internal wrapped credit (wHOT), and the
follow-on wHOT → HF swap. The roles are:
initiate (progenitor that bootstraps the network and lane),
bridge_agent (oracle + bridging agent that drives deposits),
bridge (depositor that collects the deposit RAVE to receive
wHOT, then swaps that wHOT for HF), and
swap_agent (HoloFuel counterparty that accepts swap
commitments).
Started
Fri, 31 Jul 2026 04:32:16 UTC
Peer count
30
Peer count at end
14
Behaviours
-
bridge_agent(1 agent) -
initiate(1 agent) -
swap(1 agent) -
swap_agent(1 agent) -
user(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
unyt_swap_30587147196_1
Zome call — create_parked_link
Duration of the bridge agent's oracle step recording a proof of deposit, per agent.
Mean
mean
0.399782
s
SD
0.330898
s
Max
Highest per-partition mean latency
max mean
0.399782
s
Min
Lowest per-partition mean latency
min mean
0.399782
s
Zome call — create_parked_spend
Duration of the bridging agent's step parking the spend on the bridging agreement, per agent.
Mean
mean
2.629698
s
SD
1.384648
s
Max
Highest per-partition mean latency
max mean
2.629698
s
Min
Lowest per-partition mean latency
min mean
2.629698
s
Zome call — execute_rave
Duration of the bridging agent's step executing the credit-limit and bridging agreements into a deposit RAVE, per agent.
Mean
mean
1.554828
s
SD
0.902872
s
Max
Highest per-partition mean latency
max mean
1.554828
s
Min
Lowest per-partition mean latency
min mean
1.554828
s
Zome call — get_incoming_raves
Duration of the bridge's poll for incoming deposit RAVEs, per agent. Called every iteration.
Mean
mean
0.016122
s
SD
0.010439
s
Max
Highest per-partition mean latency
max mean
0.021584
s
Min
Lowest per-partition mean latency
min mean
0.0126
s
Zome call — create_collect_from_rave
Duration of the bridge's collect step receiving wHOT, per agent.
Mean
mean
0.833977
s
SD
0.389935
s
Max
Highest per-partition mean latency
max mean
1.107376
s
Min
Lowest per-partition mean latency
min mean
0.552618
s
Zome call — create_commitment
Duration of the bridge's commitment (wHOT -> HF), per agent.
Mean
mean
0.21639
s
SD
0.054258
s
Max
Highest per-partition mean latency
max mean
0.295709
s
Min
Lowest per-partition mean latency
min mean
0.137467
s
Zome call — create_accept
Duration of the swap agent accepting a commitment, per agent.
Mean
mean
0.613621
s
SD
0.259213
s
Max
Highest per-partition mean latency
max mean
0.613621
s
Min
Lowest per-partition mean latency
min mean
0.613621
s
Zome call — create_receipt_for_accept
Duration of the bridge finalizing an accepted commitment, per agent.
Mean
mean
0.18927
s
SD
0.041607
s
Max
Highest per-partition mean latency
max mean
0.252736
s
Min
Lowest per-partition mean latency
min mean
0.131905
s
Swap completion time
End-to-end time from the bridge creating a commitment to finalizing the accept with a receipt (wall-clock, includes propagation and poll gap), per agent.
Mean
mean
46.358846
s
SD
21.999349
s
Max
Highest per-partition mean latency
max mean
76.714172
s
Min
Lowest per-partition mean latency
min mean
32.477104
s
Zome call errors
Total number of zome call errors observed during the run.
15143
Proof-of-deposit links completed
Proof-of-deposit parked links the bridge agent completed across the run (deposit volume offered), as a per-agent counter.
Total
107
Agents affected
1 / 1
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
107
Max
Highest count in any single partition
107
Min
Lowest count in any single partition
107
Proof-of-deposit links failed
Proof-of-deposit parked links that failed across the run (deposit volume offered), as a per-agent counter.
Total
1
Agents affected
1 / 1
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
1
Max
Highest count in any single partition
1
Min
Lowest count in any single partition
1
Deposit RAVEs collected
Deposit RAVEs the bridge collected — completed HOT → wHOT conversions, as a per-agent counter.
Total
92
Agents affected
10 / 11
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
8
Max
Highest count in any single partition
10
Min
Lowest count in any single partition
0
Completed transaction RAVEs
Total RAVE agreement executions across all agents at teardown.
sum
443
mean
31.64
min
0
max
359
n
14
Swap commitments created
Swap commitments the bridge created (wHOT → HF offered), as a per-agent counter.
Total
74
Agents affected
10 / 10
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
7
Max
Highest count in any single partition
9
Min
Lowest count in any single partition
6
Commitments accepted
Swap commitments the swap agent accepted across the run, as a per-agent counter.
Total
84
Agents affected
1 / 1
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
84
Max
Highest count in any single partition
84
Min
Lowest count in any single partition
84
Swap receipts created
Receipts the bridge created for accepted commitments (completed wHOT → HF), as a per-agent counter.
Total
81
Agents affected
10 / 11
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
7
Max
Highest count in any single partition
10
Min
Lowest count in any single partition
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000557
s
SD
0.001824
s
p50
0.001341
s
p95
0.005663
s
p99
0.00854
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 667.638528857s
Not enough time data to show a trend.
Zome call duration: 'transactor::create_accept'
Duration of this zome call as measured by Holochain internally.
mean
0.121729
s
SD
0.006431
s
p50
0.120017
s
p95
0.124706
s
p99
0.125534
s
Zome call duration: 'transactor::create_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.024928
s
SD
0.007967
s
p50
0.021392
s
p95
0.037491
s
p99
0.037491
s
Zome call duration: 'transactor::create_collect_from_rave'
Duration of this zome call as measured by Holochain internally.
mean
0.068228
s
SD
0.086903
s
p50
0.075319
s
p95
0.16209
s
p99
0.227642
s
Zome call duration: 'transactor::create_commitment'
Duration of this zome call as measured by Holochain internally.
mean
0.094425
s
SD
0.035398
s
p50
0.093983
s
p95
0.169675
s
p99
0.247852
s
Zome call duration: 'transactor::create_parked_link'
Duration of this zome call as measured by Holochain internally.
mean
0.03095
s
SD
0.002787
s
p50
0.031169
s
p95
0.032829
s
p99
0.032829
s
Zome call duration: 'transactor::create_parked_spend'
Duration of this zome call as measured by Holochain internally.
mean
0.258043
s
SD
0.032767
s
p50
0.259719
s
p95
0.278109
s
p99
0.278109
s
Zome call duration: 'transactor::create_receipt_for_accept'
Duration of this zome call as measured by Holochain internally.
mean
0.060548
s
SD
0.015292
s
p50
0.063841
s
p95
0.085922
s
p99
0.090488
s
Zome call duration: 'transactor::create_smart_agreement'
Duration of this zome call as measured by Holochain internally.
mean
0.054066
s
SD
0.000932
s
p50
0.05415
s
p95
0.05415
s
p99
0.05415
s
Zome call duration: 'transactor::execute_rave'
Duration of this zome call as measured by Holochain internally.
mean
0.141006
s
SD
0.024404
s
p50
0.138208
s
p95
0.162775
s
p99
0.163124
s
Zome call duration: 'transactor::get_actionable_transactions'
Duration of this zome call as measured by Holochain internally.
mean
0.032097
s
SD
0.038833
s
p50
0.03085
s
p95
0.045397
s
p99
0.057258
s
Zome call duration: 'transactor::get_all_lane'
Duration of this zome call as measured by Holochain internally.
mean
0.02937
s
SD
0.151937
s
p50
0.018657
s
p95
0.61195
s
p99
0.61195
s
Zome call duration: 'transactor::get_code_templates_lib'
Duration of this zome call as measured by Holochain internally.
mean
0.038222
s
SD
0.082146
s
p50
0.029528
s
p95
0.345637
s
p99
0.345637
s
Zome call duration: 'transactor::get_current_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.037516
s
SD
0.072622
s
p50
0.026548
s
p95
0.308647
s
p99
0.308647
s
Zome call duration: 'transactor::get_history'
Duration of this zome call as measured by Holochain internally.
mean
0.776603
s
SD
0
s
p50
0.776603
s
p95
0.776603
s
p99
0.776603
s
Zome call duration: 'transactor::get_incoming_raves'
Duration of this zome call as measured by Holochain internally.
mean
0.01269
s
SD
0.017179
s
p50
0.011812
s
p95
0.019439
s
p99
0.029857
s
Zome call duration: 'transactor::get_ledger'
Duration of this zome call as measured by Holochain internally.
mean
0.029459
s
SD
0.007208
s
p50
0.029696
s
p95
0.042067
s
p99
0.052989
s
Zome call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.023856
s
SD
0.077386
s
p50
0.009328
s
p95
0.311623
s
p99
0.311623
s
Zome call duration: 'transactor::initialize_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.067004
s
SD
0
s
p50
0.067004
s
p95
0.067004
s
p99
0.067004
s
Zome call duration: 'transactor::initialize_lane'
Duration of this zome call as measured by Holochain internally.
mean
0.100525
s
SD
0
s
p50
0.100525
s
p95
0.100525
s
p99
0.100525
s
Zome call duration: 'transactor::progenitor_init_alpha_env'
Duration of this zome call as measured by Holochain internally.
mean
0.016873
s
SD
0
s
p50
0.016873
s
p95
0.016873
s
p99
0.016873
s
Zome call duration: 'transactor::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.013266
s
SD
0.003911
s
p50
0.012258
s
p95
0.021324
s
p99
0.02435
s
WASM call duration: 'transactor::create_accept'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.117604
s
SD
0.006362
s
p50
0.117176
s
p95
0.11978
s
p99
0.120318
s
WASM call duration: 'transactor::create_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.02305
s
SD
0.00747
s
p50
0.019305
s
p95
0.035976
s
p99
0.035976
s
WASM call duration: 'transactor::create_collect_from_rave'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.069845
s
SD
0.089965
s
p50
0.076567
s
p95
0.137129
s
p99
0.225719
s
WASM call duration: 'transactor::create_commitment'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.093067
s
SD
0.034901
s
p50
0.092755
s
p95
0.167276
s
p99
0.244148
s
WASM call duration: 'transactor::create_parked_link'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.028935
s
SD
0.00269
s
p50
0.02914
s
p95
0.030707
s
p99
0.030707
s
WASM call duration: 'transactor::create_parked_spend'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.255915
s
SD
0.032831
s
p50
0.257632
s
p95
0.275937
s
p99
0.275937
s
WASM call duration: 'transactor::create_receipt_for_accept'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.080747
s
SD
0.018554
s
p50
0.063105
s
p95
0.097073
s
p99
0.100855
s
WASM call duration: 'transactor::create_smart_agreement'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.052119
s
SD
0.000885
s
p50
0.052198
s
p95
0.052198
s
p99
0.052198
s
WASM call duration: 'transactor::execute_rave'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.138757
s
SD
0.024386
s
p50
0.135972
s
p95
0.160433
s
p99
0.160779
s
WASM call duration: 'transactor::get_actionable_transactions'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.030916
s
SD
0.038764
s
p50
0.029681
s
p95
0.04401
s
p99
0.056097
s
WASM call duration: 'transactor::get_all_lane'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.027809
s
SD
0.151815
s
p50
0.016628
s
p95
0.609972
s
p99
0.609972
s
WASM call duration: 'transactor::get_code_templates_lib'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.036354
s
SD
0.082327
s
p50
0.027526
s
p95
0.344509
s
p99
0.344509
s
WASM call duration: 'transactor::get_current_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.021107
s
SD
0.04812
s
p50
0.010363
s
p95
0.199569
s
p99
0.199569
s
WASM call duration: 'transactor::get_history'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.775023
s
SD
0
s
p50
0.775023
s
p95
0.775023
s
p99
0.775023
s
WASM call duration: 'transactor::get_incoming_raves'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.011503
s
SD
0.017137
s
p50
0.010575
s
p95
0.018102
s
p99
0.02872
s
WASM call duration: 'transactor::get_ledger'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.028256
s
SD
0.007048
s
p50
0.028423
s
p95
0.040335
s
p99
0.051368
s
WASM call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.022348
s
SD
0.077187
s
p50
0.00753
s
p95
0.309366
s
p99
0.309366
s
WASM call duration: 'transactor::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.021638
s
SD
0.009813
s
p50
0.01902
s
p95
0.046593
s
p99
0.046593
s
WASM call duration: 'transactor::initialize_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.065855
s
SD
0
s
p50
0.065855
s
p95
0.065855
s
p99
0.065855
s
WASM call duration: 'transactor::initialize_lane'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.099526
s
SD
0
s
p50
0.099526
s
p95
0.099526
s
p99
0.099526
s
WASM call duration: 'transactor::post_commit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.04468
s
SD
0.0127
s
p50
0.015863
s
p95
0.046991
s
p99
0.068485
s
WASM call duration: 'transactor::progenitor_init_alpha_env'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.015641
s
SD
0
s
p50
0.015641
s
p95
0.015641
s
p99
0.015641
s
WASM call duration: 'transactor::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.011529
s
SD
0.003634
s
p50
0.010704
s
p95
0.019477
s
p99
0.022449
s
WASM call duration: 'transactor_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001349
s
SD
0.000432
s
p50
0.001579
s
p95
0.002341
s
p99
0.002886
s
WASM call duration: 'transactor_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001326
s
SD
0.000328
s
p50
0.001387
s
p95
0.001998
s
p99
0.001998
s
WASM call duration: 'transactor_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.023902
s
SD
0.015418
s
p50
0.018732
s
p95
0.04134
s
p99
0.087974
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
1.8e-05
s
SD
2.1e-05
s
p50
1.7e-05
s
p95
4.3e-05
s
p99
0.000176
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.00031
s
SD
0.000649
s
p50
0.000348
s
p95
0.001421
s
p99
0.004218
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.0004
s
SD
0.000504
s
p50
0.000401
s
p95
0.00201
s
p99
0.002298
s
Host function call duration: '__hc__delete_link_1'
Duration of this host function call invoked from within WASM.
mean
0.00194
s
SD
0.00107
s
p50
0.001782
s
p95
0.003985
s
p99
0.005868
s
Host function call duration: '__hc__dna_info_2'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
3e-06
s
p50
6e-06
s
p95
1.2e-05
s
p99
1.4e-05
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
7.3e-05
s
SD
3.1e-05
s
p50
4.8e-05
s
p95
0.000126
s
p99
0.000147
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.002669
s
SD
0.004171
s
p50
0.003141
s
p95
0.006682
s
p99
0.007428
s
Host function call duration: '__hc__get_details_1'
Duration of this host function call invoked from within WASM.
mean
7.7e-05
s
SD
0.029629
s
p50
0.000396
s
p95
0.017527
s
p99
0.191723
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.004745
s
SD
0.027016
s
p50
0.003224
s
p95
0.016815
s
p99
0.150046
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.007447
s
SD
0.008409
s
p50
0.0067
s
p95
0.011957
s
p99
0.021063
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.000359
s
SD
0.00409
s
p50
0.000642
s
p95
0.002668
s
p99
0.00418
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.00039
s
SD
0.001675
s
p50
0.000379
s
p95
0.002289
s
p99
0.011551
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
6.8e-05
s
SD
4.2e-05
s
p50
4.4e-05
s
p95
0.000151
s
p99
0.000165
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
4e-06
s
p50
9e-06
s
p95
1.7e-05
s
p99
2.2e-05
s
Host function call duration: '__hc__trace_1'
Duration of this host function call invoked from within WASM.
mean
6e-05
s
SD
9.8e-05
s
p50
6.9e-05
s
p95
0.000157
s
p99
0.00055
s
Host function call duration: '__hc__update_1'
Duration of this host function call invoked from within WASM.
mean
0.005106
s
SD
0
s
p50
0.005106
s
p95
0.005106
s
p99
0.005106
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00249
s
SD
0.001632
s
p50
0.002953
s
p95
0.006445
s
p99
0.00834
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
211
over 764.232102702s
mean rate
482.69
/s
std
1077.92
/s
p5
0
/s
p95
3439.16
/s
peak
4805.62
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
354
over 760.070920544s
mean rate
916.46
/s
std
2036.28
/s
p5
0
/s
p95
6765.14
/s
peak
8111.95
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.046722
s
SD
0.012962
s
p50
0.017635
s
p95
0.049098
s
p99
0.070831
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
48.31
s
mean
456.57
s
SD
262.07
s
p95
867.59
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
334
over 1888.845395979s
mean rate
875.74
/s
std
2496.69
/s
p5
0
/s
p95
5274.33
/s
peak
24599.95
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
16.643529
s
SD
7.762248
s
p50
13.037781
s
p95
32.32849
s
p99
37.417471
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
3.131842
s
SD
0.807181
s
p50
2.827099
s
p95
4.103219
s
p99
4.357366
s
App validation workflow duration
Time spent running the app validation workflow.
mean
2.606121
s
SD
1.992163
s
p50
2.522355
s
p95
6.504069
s
p99
10.333512
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002046
s
SD
0.001352
s
p50
0.001673
s
p95
0.004898
s
p99
0.004898
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.013551
s
SD
0.030967
s
p50
0.00116
s
p95
0.055251
s
p99
0.184055
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.012135
s
SD
0.006542
s
p50
0.003438
s
p95
0.018403
s
p99
0.034304
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.29118
s
SD
0.212301
s
p50
0.291278
s
p95
0.688842
s
p99
1.22811
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
2.078961
s
SD
2.378667
s
p50
2.084394
s
p95
7.360584
s
p99
10.646231
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000676
s
SD
0.001666
s
p50
0.000546
s
p95
0.00118
s
p99
0.005025
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000709
s
SD
0.000335
s
p50
0.000566
s
p95
0.001144
s
p99
0.001415
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000112
s
SD
0.000227
s
p50
0.000125
s
p95
0.000344
s
p99
0.001713
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000741
s
SD
0.000324
s
p50
0.000622
s
p95
0.001249
s
p99
0.001567
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.7e-05
s
SD
2.6e-05
s
p50
8.5e-05
s
p95
0.000139
s
p99
0.000139
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000183
s
SD
0.000252
s
p50
0.000177
s
p95
0.000532
s
p99
0.001215
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000776
s
SD
0.185105
s
p50
0.000281
s
p95
0.46462
s
p99
1.026611
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000224
s
SD
0.00011
s
p50
0.000217
s
p95
0.000435
s
p99
0.00061
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.146159
s
SD
25.239137
s
p50
0.147381
s
p95
60.001514
s
p99
60.001537
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.146324
s
SD
0.004984
s
p50
0.146176
s
p95
0.1485
s
p99
0.148809
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
0.294059
s
SD
0
s
p50
0.294059
s
p95
0.294059
s
p99
0.294059
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.477363
s
SD
0.322106
s
p50
0.321896
s
p95
0.977392
s
p99
1.229054
s
P2P received remote signals
Count of remote signals received.
total
8
over 1682.087742078s
mean rate
427.07
/s
std
1024.46
/s
p5
0
/s
p95
3146.18
/s
peak
4732.66
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
35.37
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
3.64
KiB/s
mean
87.50
KiB/s
SD
575.89
KiB/s
p95
81.93
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
3.94
KiB/s
mean
39.66
KiB/s
SD
48.41
KiB/s
p95
121.64
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.06
GiB
mean
1.10
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
489.90
MiB
mean
511.90
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 99.2%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 1805.82 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected
Warning 16% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.91
%
mean
49.65
%
SD
27.51
%
p95
92.19
%
System
14.28
%
CPU percentiles
CPU usage percentiles
p50
51.39
%
p95
92.19
%
p99
99.20
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
13
hosts
mean time
0.14
s
Memory used percentage
Percentage of memory used
p5
7.12
%
mean
23.35
%
SD
10.66
%
p95
41.65
%
Memory available percentage
Percentage of available memory
p5
58.35
%
mean
76.65
%
SD
10.66
%
p95
92.88
%
Max host memory used
Maximum memory usage percentage across all hosts
max
45.67
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1805.82
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.05
MiB/s
Disk write throughput
Disk write throughput in MiB/s
30.08
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname0/3
hosts
Mount Point
/etc/hosts0/3
hosts
Mount Point
/etc/nomad.d/client-meta.json0/16
hosts
Mount Point
/etc/resolv.conf0/3
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.32
5 min
2.07
15 min
1.79
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
15.79
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
11.2711
%
SD
15.767
%
p95
44.09
%
60 second average
10.9324
%
300 second average
9.7754
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0.3437
%
SD
0.862
%
p95
1.7
%
60 second average
0.3477
%
300 second average
0.6102
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0.2016
%
SD
0.7156
%
p95
0.91
%
60 second average
0.2094
%
300 second average
0.4600
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
mean
31.17
%
SD
27.52
%
p95
80.11
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
806.94
KiB
mean
1.07
MiB
SD
212.09
KiB
p95
1.27
MiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
mean
28.67
threads
SD
14.69
threads
p95
52
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
mean
74.84
file descriptors
SD
25.88
file descriptors
p95
110
file descriptors
Validation Receipts
↑ Back to indexCreates an entry, wait for required validation receipts, then repeat. Records the amount of time it took to accumulate the required number of receipts for all DHT operations. This is measured to the nearest 20ms so that we don't keep the agent too busy checking for receipts.
Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.
By default, this scenario will wait for a complete set of validation receipts before committing the next record. If the NO_VALIDATION_COMPLETE environment variable is set, it will instead publish new records on every round, building up an ever-growing list of action hashes to check on.
Started
Fri, 31 Jul 2026 00:28:04 UTC
Peer count
20
Behaviours
-
default(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
validation_receipts_30587147196_1
Receipts complete timing
The amount of time between publishing a record and receiving the required number of validation receipts.
Mean
mean
7.892715
s
SD
4.967865
s
Max
Highest per-partition mean latency
max mean
19.848383
s
Min
Lowest per-partition mean latency
min mean
6.541307
s
Receipts complete rate
The number of complete validation receipt sets collected per second.
Mean
mean
1.42
/s
Max
Highest per-partition mean rate
max
1.57
/s
Min
Lowest per-partition mean rate
min
1
/s
Error count
The total number of errors accumulated during the run.
1
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 33131.752746601s
Not enough time data to show a trend.
WASM usage: 'crud::get_sample_entry_validation_receipts'
Metered usage count of the WASM ribosome for this zome function.
total
1057751
over 33131.752746601s
mean rate
1.635722562e+07
/s
std
4.521843166e+07
/s
p5
1419.78
/s
p95
1.5306602957e+08
/s
peak
2.1247331523e+08
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 33131.752746601s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 33131.752746601s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006136
s
SD
0.00471
s
p50
0.005013
s
p95
0.01095
s
p99
0.025794
s
Zome call duration: 'crud::get_sample_entry_validation_receipts'
Duration of this zome call as measured by Holochain internally.
mean
0.012113
s
SD
0.009994
s
p50
0.007577
s
p95
0.024738
s
p99
0.058678
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005099
s
SD
0.003788
s
p50
0.004211
s
p95
0.008871
s
p99
0.020795
s
WASM call duration: 'crud::get_sample_entry_validation_receipts'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.010896
s
SD
0.009149
s
p50
0.006503
s
p95
0.022028
s
p99
0.053364
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00252
s
SD
0.002313
s
p50
0.002
s
p95
0.005605
s
p99
0.011566
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00154
s
SD
0.000941
s
p50
0.001257
s
p95
0.00414
s
p99
0.004981
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000533
s
SD
0.000932
s
p50
0.00044
s
p95
0.001585
s
p99
0.005881
s
Host function call duration: '__hc__get_validation_receipts_1'
Duration of this host function call invoked from within WASM.
mean
0.008887
s
SD
0.008094
s
p50
0.004948
s
p95
0.018009
s
p99
0.046887
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002838
s
SD
0.002285
s
p50
0.002318
s
p95
0.005745
s
p99
0.012194
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000673
s
SD
0.000798
s
p50
0.000428
s
p95
0.001674
s
p99
0.003913
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.87
s
mean
452.86
s
SD
259.96
s
p95
857.87
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
1.567915
s
SD
2.531005
s
p50
1.116759
s
p95
9.209074
s
p99
12.268489
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.955785
s
SD
0.224958
s
p50
1.949269
s
p95
2.007853
s
p99
2.057197
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.019364
s
SD
0.774697
s
p50
0.00464
s
p95
1.359355
s
p99
3.675443
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.015946
s
SD
0.049347
s
p50
0.00285
s
p95
0.229239
s
p99
0.229239
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.004968
s
SD
0.027834
s
p50
0.0008
s
p95
0.084189
s
p99
0.123605
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.005956
s
SD
0.008158
s
p50
0.003708
s
p95
0.025478
s
p99
0.037792
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.04698
s
SD
0.402469
s
p50
0.037056
s
p95
0.681455
s
p99
1.885139
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
1.404637
s
SD
16.668036
s
p50
1.054793
s
p95
34.391798
s
p99
109.559073
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000348
s
SD
0.000379
s
p50
0.00024
s
p95
0.001652
s
p99
0.001873
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000495
s
SD
0.00046
s
p50
0.000373
s
p95
0.000853
s
p99
0.002535
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000303
s
SD
0.000315
s
p50
0.000235
s
p95
0.001182
s
p99
0.001653
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000301
s
SD
0.000385
s
p50
0.000204
s
p95
0.001458
s
p99
0.001919
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000162
s
SD
0.000132
s
p50
0.000128
s
p95
0.000281
s
p99
0.00067
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000246
s
SD
0.000287
s
p50
0.000178
s
p95
0.00097
s
p99
0.001468
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001617
s
SD
0.023637
s
p50
0.000395
s
p95
0.040949
s
p99
0.145612
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000295
s
SD
0.00047
s
p50
0.000264
s
p95
0.001146
s
p99
0.002871
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.107499
s
SD
0.055347
s
p50
0.09455
s
p95
0.193473
s
p99
0.198133
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.269776
s
SD
12.690348
s
p50
0.264266
s
p95
26.829891
s
p99
60.00131
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
51.24
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
101
B/s
mean
524.89
KiB/s
SD
396.58
KiB/s
p95
1.08
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
21
B/s
mean
775.27
KiB/s
SD
729.46
KiB/s
p95
1.95
MiB/s
Total bytes received
Total bytes received on primary network interface
count
8.47
GiB
mean
8.94
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
13.40
GiB
mean
14.15
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.6%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 284.43 MiB/s
Disk full anomaly
Disk full anomaly was detected
Detected
Critical Disk /etc/resolv.conf: 1/5 hosts above 90% capacity
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected
Warning 65% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2.43
%
mean
62
%
SD
32.13
%
p95
98.15
%
System
10.76
%
CPU percentiles
CPU usage percentiles
p50
73.29
%
p95
98.15
%
p99
98.60
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
15
hosts
mean time
0.58
s
Memory used percentage
Percentage of memory used
p5
9.93
%
mean
19.95
%
SD
6.98
%
p95
37.19
%
Memory available percentage
Percentage of available memory
p5
62.81
%
mean
80.05
%
SD
6.98
%
p95
90.07
%
Max host memory used
Maximum memory usage percentage across all hosts
max
39.13
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.12
%
Memory growth rate
Rate of memory growth over time
growth
284.43
MiB/s
Disk read throughput
Disk read throughput in MiB/s
2.83
MiB/s
Disk write throughput
Disk write throughput in MiB/s
233.72
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/3
hosts
Mount Point
/efi-boot0/1
hosts
Mount Point
/etc/hostname1/5
hosts
Mount Point
/etc/hosts1/5
hosts
Mount Point
/etc/nomad.d/client-meta.json0/12
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf1/5
hosts
Mount Point
/nix/store0/3
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.89
5 min
4.66
15 min
3.45
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
65.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
26.9595
%
SD
25.99
%
p95
88.62
%
60 second average
26.7940
%
300 second average
25.8720
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0.0006
%
SD
0.024
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0.0006
%
SD
0.024
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
11.0048
%
SD
19.3256
%
p95
56.95
%
60 second average
10.9336
%
300 second average
9.9651
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
6.5951
%
SD
13.9868
%
p95
42.28
%
60 second average
6.5708
%
300 second average
6.0304
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
mean
2.57
%
SD
4.98
%
p95
5.77
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
230.62
KiB
mean
252.74
KiB
SD
41.97
KiB
p95
290.71
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
mean
26.44
threads
SD
9.88
threads
p95
42
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
mean
74.31
file descriptors
SD
22.91
file descriptors
p95
103
file descriptors
Write/get_agent_activity
↑ Back to index
A scenario where write peers write entries, while get_agent_activity peers each query a single write agent's activity with get_agent_activity.
Before a target write peer and the requesting get_agent_activity peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.
Started
Fri, 31 Jul 2026 00:46:12 UTC
Peer count
30
Peer count at end
26
Behaviours
-
get_agent_activity(1 agent) -
write(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
write_get_agent_activity_30587147196_1
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
4311
Max
Highest chain head value observed for any single write agent.
9719
Write agents observed
6
get_agent_activity_full zome call timingThe time taken to call the zome function that retrieves information on a
write peer's source chain.Mean
mean
0.556837
s
SD
1.008395
s
Max
Highest per-partition mean latency
max mean
2.422606
s
Min
Lowest per-partition mean latency
min mean
0.241685
s
Error count
The number of errors accumulated.
4
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.002075
s
SD
0.007708
s
p50
0.001295
s
p95
0.016812
s
p99
0.034481
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
5
over 710.687081296s
mean rate
0.04
/s
std
0.09
/s
p5
0
/s
p95
0.21
/s
peak
0.4
/s
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 1138.7882443s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
232210000
over 1138.7882443s
mean rate
3.6533415724e+08
/s
std
4.4967128461e+08
/s
p5
223766.08
/s
p95
1.26862998348e+09
/s
peak
1.35645155808e+09
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
5899775898
over 917.920019276s
mean rate
2.28496920565e+09
/s
std
2.93567419676e+09
/s
p5
2.617477469e+07
/s
p95
8.84007794433e+09
/s
peak
1.51224493497e+10
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
10050663491
over 37472.678623086s
mean rate
8.8512914772e+08
/s
std
1.76954496183e+09
/s
p5
3.59135307e+06
/s
p95
6.10879165662e+09
/s
peak
6.22616833516e+09
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
668959065
over 37472.678623086s
mean rate
6.834759437e+07
/s
std
1.0413529289e+08
/s
p5
862735.36
/s
p95
3.9539186756e+08
/s
peak
4.1433471252e+08
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.005844
s
SD
0.004564
s
p50
0.004911
s
p95
0.017839
s
p99
0.017839
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005284
s
SD
0.004876
s
p50
0.00441
s
p95
0.0189
s
p99
0.020662
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.307753
s
SD
0.358723
s
p50
0.278771
s
p95
0.98813
s
p99
2.1404
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.005742
s
SD
0.305219
s
p50
0.007032
s
p95
1.124198
s
p99
1.124198
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005111
s
SD
0.004538
s
p50
0.003989
s
p95
0.017111
s
p99
0.017111
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004444
s
SD
0.004386
s
p50
0.003679
s
p95
0.016776
s
p99
0.018381
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.30973
s
SD
0.358364
s
p50
0.285713
s
p95
0.984389
s
p99
2.139559
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005061
s
SD
0.305151
s
p50
0.006173
s
p95
1.123057
s
p99
1.123057
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000981
s
SD
0.000635
s
p50
0.00109
s
p95
0.002691
s
p99
0.002896
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.6e-05
s
SD
7e-06
s
p50
2.9e-05
s
p95
3.6e-05
s
p99
3.6e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.001024
s
SD
0.001937
s
p50
0.000352
s
p95
0.006706
s
p99
0.007717
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.001247
s
SD
0.002418
s
p50
0.000371
s
p95
0.007707
s
p99
0.007707
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.305291
s
SD
0.357202
s
p50
0.280098
s
p95
0.965311
s
p99
2.135749
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.002285
s
SD
0.305216
s
p50
0.002967
s
p95
1.118519
s
p99
1.118519
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
9e-06
s
SD
9e-06
s
p50
1.1e-05
s
p95
3.8e-05
s
p99
3.8e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001818
s
SD
0.001772
s
p50
0.001917
s
p95
0.006646
s
p99
0.00767
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000429
s
SD
0.001569
s
p50
0.000167
s
p95
0.003444
s
p99
0.007813
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
48.14
s
mean
454.31
s
SD
260.73
s
p95
858.55
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
47.493565
s
SD
31.068025
s
p50
35.975138
s
p95
108.568079
s
p99
133.970083
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.844474
s
SD
0.29263
s
p50
1.999842
s
p95
2.004661
s
p99
2.00772
s
App validation workflow duration
Time spent running the app validation workflow.
mean
1.256363
s
SD
7.838503
s
p50
6.143699
s
p95
25.36696
s
p99
30.403615
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001647
s
SD
0.001389
s
p50
0.000901
s
p95
0.004021
s
p99
0.005878
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.011297
s
SD
0.021135
s
p50
0.012402
s
p95
0.069405
s
p99
0.089462
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.107462
s
SD
0.154338
s
p50
0.002358
s
p95
0.38878
s
p99
0.905727
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
1.134745
s
SD
24.04929
s
p50
6.964994
s
p95
69.098865
s
p99
90.721924
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.323009
s
SD
26.759305
s
p50
0.680443
s
p95
81.188426
s
p99
108.799674
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.002462
s
SD
0.002862
s
p50
0.000596
s
p95
0.008385
s
p99
0.012915
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002597
s
SD
0.001996
s
p50
0.001911
s
p95
0.006827
s
p99
0.009404
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000171
s
SD
0.000191
s
p50
0.000165
s
p95
0.000713
s
p99
0.000818
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000547
s
SD
0.001621
s
p50
0.000235
s
p95
0.002075
s
p99
0.009922
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000101
s
SD
7.7e-05
s
p50
8.4e-05
s
p95
0.000277
s
p99
0.000412
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.00018
s
SD
0.000158
s
p50
0.000135
s
p95
0.000569
s
p99
0.000691
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002156
s
SD
0.012521
s
p50
0.000552
s
p95
0.028552
s
p99
0.049594
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000711
s
SD
0.000875
s
p50
0.000298
s
p95
0.001798
s
p99
0.00534
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
4.460051
s
SD
28.893942
s
p50
4.600802
s
p95
60.008485
s
p99
61.447602
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.070844
s
SD
0.278992
s
p50
0.57833
s
p95
0.750648
s
p99
0.750648
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.310888
s
SD
15.153278
s
p50
0.29229
s
p95
60.000967
s
p99
60.00697
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.302315
s
SD
24.177727
s
p50
1.694645
s
p95
60.001796
s
p99
60.001956
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
41.61
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
199
B/s
mean
457.01
KiB/s
SD
402.69
KiB/s
p95
1.24
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
136
B/s
mean
670.90
KiB/s
SD
482.23
KiB/s
p95
1.51
MiB/s
Total bytes received
Total bytes received on primary network interface
count
10.22
GiB
mean
11.38
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
15.01
GiB
mean
16.71
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.4%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 319.41 MiB/s
Disk full anomaly
Disk full anomaly was detected
Detected
Critical Disk /etc/resolv.conf: 1/7 hosts above 90% capacity
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected
Warning 35% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
12.09
%
mean
50.25
%
SD
28.32
%
p95
97.5
%
System
8.63
%
CPU percentiles
CPU usage percentiles
p50
48.49
%
p95
97.50
%
p99
98.40
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
13
hosts
mean time
0.38
s
Memory used percentage
Percentage of memory used
p5
5.77
%
mean
14.26
%
SD
7.09
%
p95
29.79
%
Memory available percentage
Percentage of available memory
p5
70.21
%
mean
85.74
%
SD
7.09
%
p95
94.23
%
Max host memory used
Maximum memory usage percentage across all hosts
max
34.88
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.12
%
Memory growth rate
Rate of memory growth over time
growth
319.41
MiB/s
Disk read throughput
Disk read throughput in MiB/s
15.87
MiB/s
Disk write throughput
Disk write throughput in MiB/s
214.30
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/4
hosts
Mount Point
/efi-boot0/2
hosts
Mount Point
/etc/hostname1/7
hosts
Mount Point
/etc/hosts1/7
hosts
Mount Point
/etc/nomad.d/client-meta.json0/15
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf1/7
hosts
Mount Point
/nix/store0/4
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.26
5 min
3.38
15 min
3.27
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
34.62
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
17.2211
%
SD
26.4546
%
p95
86.13
%
60 second average
17.2454
%
300 second average
18.1074
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
7.3338
%
SD
13.5934
%
p95
41.59
%
60 second average
7.3710
%
300 second average
7.7903
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
5.8375
%
SD
11.802
%
p95
35.31
%
60 second average
5.7904
%
300 second average
5.7823
%
Holochain process CPU usage
CPU usage by Holochain process
p5
6.03
%
mean
43.09
%
SD
27.76
%
p95
94.65
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
245.29
KiB
mean
395.45
KiB
SD
90.07
KiB
p95
535.89
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
mean
36.26
threads
SD
11.87
threads
p95
50
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
49
file descriptors
mean
83.03
file descriptors
SD
24.75
file descriptors
p95
122
file descriptors
Write/get_agent_activity with volatile conductors
↑ Back to index
A scenario where write peers write entries, while get_agent_activity_volatile peers each query a single write agents activity with get_agent_activity but shutdown and restart their conductors at semi-random intervals.
Before a target write peer and the requesting get_agent_activity_volatile peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.
Started
Fri, 31 Jul 2026 01:01:53 UTC
Peer count
30
Peer count at end
12
Behaviours
-
get_agent_activity_volatile(1 agent) -
write(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
write_get_agent_activity_volatile_30587147196_1
Highest observed
action_seqThe rate at which zero-arc readers observe new chain heads on the writers' chains via
get_agent_activity. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.Mean
mean
26.32
/s
Max
Highest per-partition mean rate
max
58.53
/s
Min
Lowest per-partition mean rate
min
14.45
/s
get_agent_activity_full zome call timingThe time taken to call the zome function that retrieves information on a
write peer's source chain.Mean
mean
0.287105
s
SD
0.4412
s
Max
Highest per-partition mean latency
max mean
0.492164
s
Min
Lowest per-partition mean latency
min mean
0.119198
s
Running volatile conductors count
The number of conductors running by
get_agent_activity_volatile peers.p5
4
conductors
mean
11.54
conductors
SD
4.51
conductors
p95
18
conductors
Volatile conductor total running duration
The total running duration of a
get_agent_activity_volatile conductor.Mean
mean
784.649258
s
SD
413.579883
s
Max
Highest per-partition mean latency
max mean
1315.181818
s
Min
Lowest per-partition mean latency
min mean
353.9
s
Volatile conductor running duration
The duration that a
get_agent_activity_volatile conductor was running before being stopped.Mean
mean
47.524959
s
SD
38.166421
s
Max
Highest per-partition mean latency
max mean
141.814302
s
Min
Lowest per-partition mean latency
min mean
26.381093
s
Volatile conductor stopped duration
The duration that a
get_agent_activity_volatile conductor was stopped before being started again.Mean
mean
37.39422
s
SD
44.101039
s
Max
Highest per-partition mean latency
max mean
58.747785
s
Min
Lowest per-partition mean latency
min mean
8.3485
s
Reached target arc
Did
get_agent_activity_volatile peer reach their target arc in the moment before they were shutdown.get_agent_activity_volatile_agent:uhCAk1okO_aLmg8PBsF8j5V80J1gLwf9i4eXmTrr2brQ_8K7Lb4XB
p5
0
mean
0.63
SD
0.48
p95
1
get_agent_activity_volatile_agent:uhCAk20Sw9-RXC2tY56ReiNVRv08RI1tmKbCO8gmq-ytn4xj9TDID
p5
0
mean
0.29
SD
0.45
p95
1
get_agent_activity_volatile_agent:uhCAk5mpek8k-iEnmf4psWkYlSOd3VYLDu3CYc7LecAYSBxzxaQRZ
p5
0
mean
0.44
SD
0.5
p95
1
get_agent_activity_volatile_agent:uhCAkCV4WyZj6vsqYXVbeLQeq8pm5HVUM07f0iz9XUEg_kU23EBd8
p5
0
mean
0.18
SD
0.38
p95
1
get_agent_activity_volatile_agent:uhCAkDqvCs76usM_92At5B6NLLUHvF3V7FjVLIFy9glV-CRcSPwS4
p5
0
mean
0.29
SD
0.45
p95
1
get_agent_activity_volatile_agent:uhCAkGn-pOlHiGdcUF94aAhI6jdW-tDhLIYqejyi-H6tg4qzl8xJN
p5
0
mean
0.34
SD
0.47
p95
1
get_agent_activity_volatile_agent:uhCAkGonA42iPtFyvFiczaO0kzVfwOJMYQ5zADGdYUvpTaq6ymCqk
p5
0
mean
0.36
SD
0.48
p95
1
get_agent_activity_volatile_agent:uhCAkJuoL03ZghkyIHQqoCjx0kaI7kpVPy_BTk7C5D_EFYenmhCm4
p5
0
mean
0.24
SD
0.43
p95
1
get_agent_activity_volatile_agent:uhCAkMrRmAISrCdBU1ovI6X7BKg8nIigx2uF-Hj3GvDosi0uD22j0
p5
0
mean
0.43
SD
0.5
p95
1
get_agent_activity_volatile_agent:uhCAkNNu9Pgw_Rb7aKcFd9JgpG7Fgig5IhCix4qSF3Pfk-OPUt7NG
p5
0
mean
0.6
SD
0.49
p95
1
get_agent_activity_volatile_agent:uhCAkNrfUoJWR84RthZ7WILAIQB7E0R10zZjVluQRcJMwZDKjDBb1
p5
0
mean
0.29
SD
0.45
p95
1
get_agent_activity_volatile_agent:uhCAkPIlCcp3orICWxIs8KtW4HmU7k5b19EJkO9-wTfGHGCP-Qyg8
p5
0
mean
0.38
SD
0.49
p95
1
get_agent_activity_volatile_agent:uhCAkS49ciT0PoZG-OqLZZ9q_cJnqRhhV8yh6vLUyQGVjnnebzfNt
p5
0
mean
0.77
SD
0.42
p95
1
get_agent_activity_volatile_agent:uhCAkT-9KP-f_iFMai8d7kv4rQAnQGyKpiSUNldHiZcel4eVkC0qp
p5
0
mean
0.33
SD
0.47
p95
1
get_agent_activity_volatile_agent:uhCAkYjzKW8pToSlzcEWC4AchLCQSn9c1kdhcEQW0m6YFrdHQXxqK
p5
0
mean
0.38
SD
0.49
p95
1
get_agent_activity_volatile_agent:uhCAkZkq4yIKNAEQ_3GqWTn3xOpzxtUdDNM0sdJpvTiYxEsCyJlT2
p5
0
mean
0.29
SD
0.45
p95
1
get_agent_activity_volatile_agent:uhCAkd-z-SHWvlJ5lxiQC2O53klTCap-WdsTnMvIHOXZS31kTfHSB
p5
0
mean
0.5
SD
0.5
p95
1
get_agent_activity_volatile_agent:uhCAkfLS2Lap9FQjOzzXH9GR8iYNcCaQGYo9kU28jT8NdM51fl2Og
p5
0
mean
0.28
SD
0.45
p95
1
get_agent_activity_volatile_agent:uhCAkkmg_lg9v3U0J9XnvejMcD5_-7mn5j6q31hYtJQk8F6Yyf3cL
p5
0
mean
0.28
SD
0.45
p95
1
get_agent_activity_volatile_agent:uhCAkw1nME8CPCHHL1P9nFZDSgUOmPyJaKMFutYqGSrTnR3u3U1Q2
p5
0
mean
0
SD
0
p95
0
Error count
The number of errors accumulated.
83
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000372
s
SD
0.001245
s
p50
0.000662
s
p95
0.001918
s
p99
0.008136
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
3
over 2648.402238423s
mean rate
1.14
/s
std
5.08
/s
p5
0
/s
p95
2.71
/s
peak
28.56
/s
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 2796.810385887s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
60247940
over 2796.810385887s
mean rate
3.0980663944e+08
/s
std
3.785831626e+08
/s
p5
21109.85
/s
p95
1.13637303791e+09
/s
peak
1.2051697337e+09
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
4551367
over 1861.02858889s
mean rate
6.7734356474e+08
/s
std
3.35731124779e+09
/s
p5
4.30014731e+06
/s
p95
1.24709375465e+09
/s
peak
4.31937929179e+10
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
175652840
over 38367.069055465s
mean rate
8.284262262e+07
/s
std
4.1564646246e+08
/s
p5
0
/s
p95
2.046227814e+08
/s
peak
2.95824317314e+09
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
11686509
over 38367.069055465s
mean rate
3.137444739e+07
/s
std
4.089169753e+07
/s
p5
1848.38
/s
p95
1.2437398095e+08
/s
peak
1.9685103956e+08
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.004259
s
SD
0.001903
s
p50
0.003497
s
p95
0.009234
s
p99
0.009234
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006179
s
SD
0.001283
s
p50
0.005884
s
p95
0.008521
s
p99
0.010713
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.213165
s
SD
0.681298
s
p50
0.318829
s
p95
0.824556
s
p99
1.354718
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.003941
s
SD
0.296411
s
p50
0.075776
s
p95
0.865305
s
p99
0.865305
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003538
s
SD
0.00157
s
p50
0.002973
s
p95
0.007637
s
p99
0.007637
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005114
s
SD
0.001124
s
p50
0.004761
s
p95
0.007166
s
p99
0.008958
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.230772
s
SD
3.374688
s
p50
0.319177
s
p95
1.050344
s
p99
1.594599
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00334
s
SD
0.289479
s
p50
0.04311
s
p95
0.835815
s
p99
0.835815
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001554
s
SD
0.00038
s
p50
0.001476
s
p95
0.002252
s
p99
0.00289
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.4e-05
s
SD
7e-06
s
p50
2.2e-05
s
p95
4.1e-05
s
p99
4.1e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000523
s
SD
0.000146
s
p50
0.000456
s
p95
0.000785
s
p99
0.000939
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000356
s
SD
0.000164
s
p50
0.000337
s
p95
0.000747
s
p99
0.000747
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.226527
s
SD
3.374777
s
p50
0.313712
s
p95
1.043156
s
p99
1.58652
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000958
s
SD
0.289493
s
p50
0.040616
s
p95
0.832946
s
p99
0.832946
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
7e-06
s
SD
7e-06
s
p50
8e-06
s
p95
2.3e-05
s
p99
3.8e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002815
s
SD
0.000883
s
p50
0.002044
s
p95
0.003847
s
p99
0.004324
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000441
s
SD
0.000173
s
p50
0.000488
s
p95
0.000739
s
p99
0.000781
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
6.57
s
mean
384.67
s
SD
531.01
s
p95
1578.36
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
45.185625
s
SD
88.70561
s
p50
24.948876
s
p95
254.157336
s
p99
454.500278
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.682141
s
SD
1.191819
s
p50
1.827121
s
p95
4.4
s
p99
7.602649
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.191129
s
SD
10.368492
s
p50
0.05523
s
p95
16.549998
s
p99
35.753516
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001609
s
SD
0.001626
s
p50
0.001079
s
p95
0.003456
s
p99
0.008335
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.019005
s
SD
0.016603
s
p50
0.002399
s
p95
0.039441
s
p99
0.078937
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.095973
s
SD
0.475098
s
p50
0.004491
s
p95
0.354844
s
p99
3.940291
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.700674
s
SD
35.95423
s
p50
4.49781
s
p95
73.999404
s
p99
190.023509
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
2.130593
s
SD
35.35591
s
p50
3.422639
s
p95
85.442726
s
p99
85.442726
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.005075
s
SD
0.002085
s
p50
0.000295
s
p95
0.006482
s
p99
0.008221
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.004223
s
SD
0.00388
s
p50
0.001604
s
p95
0.011165
s
p99
0.013734
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000288
s
SD
0.00011
s
p50
0.00013
s
p95
0.000389
s
p99
0.000416
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000168
s
SD
0.000145
s
p50
0.000146
s
p95
0.000326
s
p99
0.0007
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.011874
s
SD
0.014071
s
p50
0.012231
s
p95
0.035871
s
p99
0.078824
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000188
s
SD
0.000122
s
p50
0.000159
s
p95
0.0003
s
p99
0.000406
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00405
s
SD
0.023119
s
p50
0.000436
s
p95
0.023054
s
p99
0.080475
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000438
s
SD
0.000552
s
p50
0.00041
s
p95
0.000968
s
p99
0.003497
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
5.464001
s
SD
27.799904
s
p50
0.699339
s
p95
60.001926
s
p99
60.002789
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.428287
s
SD
0.279207
s
p50
0.297012
s
p95
0.828897
s
p99
0.828897
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.283075
s
SD
9.915183
s
p50
0.315175
s
p95
1.192119
s
p99
60.001375
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.907807
s
SD
27.97004
s
p50
0.558714
s
p95
60.001548
s
p99
60.002046
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
19.21
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
93
B/s
mean
231.38
KiB/s
SD
484.30
KiB/s
p95
993.28
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
158
B/s
mean
340.49
KiB/s
SD
509.35
KiB/s
p95
1.37
MiB/s
Total bytes received
Total bytes received on primary network interface
count
10.35
GiB
mean
5.52
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
15.23
GiB
mean
8.12
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 98.3%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 413.20 MiB/s
Disk full anomaly
Disk full anomaly was detected
Detected
Critical Disk /etc/resolv.conf: 1/8 hosts above 90% capacity
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected
Warning 14% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.76
%
mean
24.73
%
SD
28.92
%
p95
91.78
%
System
5.52
%
CPU percentiles
CPU usage percentiles
p50
11.59
%
p95
91.78
%
p99
98.30
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
9
hosts
mean time
0.25
s
Memory used percentage
Percentage of memory used
p5
5.46
%
mean
12.51
%
SD
6.31
%
p95
26.78
%
Memory available percentage
Percentage of available memory
p5
73.22
%
mean
87.49
%
SD
6.31
%
p95
94.54
%
Max host memory used
Maximum memory usage percentage across all hosts
max
34.47
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.12
%
Memory growth rate
Rate of memory growth over time
growth
413.20
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.45
MiB/s
Disk write throughput
Disk write throughput in MiB/s
77.47
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/4
hosts
Mount Point
/efi-boot0/1
hosts
Mount Point
/etc/hostname1/8
hosts
Mount Point
/etc/hosts1/8
hosts
Mount Point
/etc/nomad.d/client-meta.json0/16
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf1/8
hosts
Mount Point
/nix/store0/4
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.42
5 min
1.56
15 min
1.94
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
14.29
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
7.8157
%
SD
17.9759
%
p95
55.47
%
60 second average
7.8998
%
300 second average
8.6797
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
5.0784
%
SD
11.6918
%
p95
36.92
%
60 second average
5.0346
%
300 second average
4.9225
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
4.2189
%
SD
10.3724
%
p95
32.34
%
60 second average
4.1792
%
300 second average
4.0558
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
mean
19.71
%
SD
27.51
%
p95
89.05
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
51.94
KiB
mean
214.45
KiB
SD
137.77
KiB
p95
449.83
KiB
Holochain process threads
Number of threads in Holochain process
p5
1
threads
mean
22.42
threads
SD
11.14
threads
p95
42
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
0
file descriptors
mean
73.19
file descriptors
SD
31.15
file descriptors
p95
128
file descriptors
Write/Query
↑ Back to indexCreates an entry, then queries the source chain and performs a simple operation on the entries, then repeats.
Started
Thu, 30 Jul 2026 23:23:31 UTC
Peer count
1
Behaviours
-
default(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
write_query_30587147196_1
Write timing
The time it takes to complete the zome function call that writes the entry.
mean
0.013026
s
SD
0.005828
s
p50
0.010782
s
p95
0.026136
s
p99
0.035282
s
Write rate
The number of writes completed per second.
mean
141.5
/s
Query timing
The time it takes to complete the
chain_query_count_len zome call that queries the source chain.mean
0.056053
s
SD
0.032966
s
p50
0.050014
s
p95
0.115374
s
p99
0.123671
s
Query rate
The number of chain queries completed per second.
mean
141.46
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::chain_query_count_len'
Metered usage count of the WASM ribosome for this zome function.
total
321226252122
over 290.002239947s
mean rate
1.10766795828e+09
/s
std
1.6206135789e+08
/s
p5
8.0531178187e+08
/s
p95
1.23054870891e+09
/s
peak
1.24344901045e+09
/s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
173290320
over 290.002239947s
mean rate
597548.5
/s
std
305449.15
/s
p5
322160.76
/s
p95
1.36919985e+06
/s
peak
1.42429086e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 290.002239947s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
38002048
over 290.002239947s
mean rate
131040.6
/s
std
66965.4
/s
p5
70648.89
/s
p95
300261.42
/s
peak
311877.92
/s
Zome call duration: 'crud::chain_query_count_len'
Duration of this zome call as measured by Holochain internally.
mean
0.035835
s
SD
0.01121
s
p50
0.032841
s
p95
0.047197
s
p99
0.048114
s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.003247
s
SD
0.000593
s
p50
0.003226
s
p95
0.00484
s
p99
0.006022
s
WASM call duration: 'crud::chain_query_count_len'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.035143
s
SD
0.01123
s
p50
0.032161
s
p95
0.046482
s
p99
0.047396
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002674
s
SD
0.000515
s
p50
0.002658
s
p95
0.004059
s
p99
0.005072
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001015
s
SD
0
s
p50
0.001015
s
p95
0.001015
s
p99
0.001015
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000888
s
SD
0.00019
s
p50
0.000883
s
p95
0.001407
s
p99
0.00176
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000238
s
SD
4.2e-05
s
p50
0.00023
s
p95
0.000293
s
p99
0.000418
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.011409
s
SD
0.003924
s
p50
0.010468
s
p95
0.015229
s
p99
0.015569
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001454
s
SD
0.00027
s
p50
0.001442
s
p95
0.002205
s
p99
0.002714
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000124
s
SD
1.4e-05
s
p50
0.000124
s
p95
0.000157
s
p99
0.000194
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.55
s
mean
153.55
s
SD
86.56
s
p95
288.55
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
12264
over 290.002250938s
mean rate
42.29
/s
std
21.62
/s
p5
22.8
/s
p95
96.9
/s
peak
100.8
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.0018
s
SD
0.00022
s
p50
0.001784
s
p95
0.002443
s
p99
0.002798
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
p95
1
s
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000437
s
SD
0
s
p50
0.000437
s
p95
0.000437
s
p99
0.000437
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000482
s
SD
0
s
p50
0.000482
s
p95
0.000482
s
p99
0.000482
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000722
s
SD
6.3e-05
s
p50
0.00072
s
p95
0.000864
s
p99
0.001041
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.017589
s
SD
0.005841
s
p50
0.01601
s
p95
0.023527
s
p99
0.024059
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001115
s
SD
0
s
p50
0.001115
s
p95
0.001115
s
p99
0.001115
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.004381
s
SD
0.001295
s
p50
0.004138
s
p95
0.00552
s
p99
0.005611
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.002644
s
SD
0.000827
s
p50
0.002446
s
p95
0.003454
s
p99
0.003532
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001759
s
SD
0.000643
s
p50
0.001698
s
p95
0.00238
s
p99
0.002425
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000109
s
SD
1.5e-05
s
p50
0.000108
s
p95
0.000149
s
p99
0.000181
s
Cache DB connection use time
Time spent holding cache database connections.
mean
9.5e-05
s
SD
9e-06
s
p50
9.5e-05
s
p95
0.000109
s
p99
0.000132
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.8e-05
s
SD
0
s
p50
8.8e-05
s
p95
8.8e-05
s
p99
8.8e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
8.8e-05
s
SD
1.1e-05
s
p50
8.8e-05
s
p95
0.000116
s
p99
0.000142
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000924
s
SD
0.007142
s
p50
0.000661
s
p95
0.018442
s
p99
0.018442
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000208
s
SD
3.3e-05
s
p50
0.000208
s
p95
0.0003
s
p99
0.00036
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
14.95
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
103
B/s
mean
353
B/s
SD
295
B/s
p95
701
B/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
44
B/s
mean
247
B/s
SD
161
B/s
p95
481
B/s
Total bytes received
Total bytes received on primary network interface
count
99.89
KiB
mean
353
B/s
Total bytes sent
Total bytes sent on primary network interface
count
69.82
KiB
mean
247
B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
16.75
%
mean
18.43
%
SD
2.15
%
p95
18.61
%
System
3.48
%
CPU percentiles
CPU usage percentiles
p50
18.29
%
p95
18.61
%
p99
29.33
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
6.57
%
mean
6.85
%
SD
0.23
%
p95
7.47
%
Memory available percentage
Percentage of available memory
p5
92.53
%
mean
93.15
%
SD
0.23
%
p95
93.43
%
Max host memory used
Maximum memory usage percentage across all hosts
max
6.85
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-35.42
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
12.12
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/1
hosts
Mount Point
/nix/store0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.15
5 min
0.53
15 min
0.21
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0.0043
%
SD
0.0169
%
p95
0.03
%
60 second average
0.0023
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
16.1
%
mean
17.98
%
SD
2.06
%
p95
18.29
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
268.65
KiB
mean
281.12
KiB
SD
27.23
KiB
p95
299.01
KiB
Holochain process threads
Number of threads in Holochain process
p5
17
threads
mean
17.27
threads
SD
1.44
threads
p95
17
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
59
file descriptors
mean
61.43
file descriptors
SD
3.62
file descriptors
p95
68
file descriptors
Write/Read
↑ Back to indexCreates an entry and reads it back, then repeats.
Started
Thu, 30 Jul 2026 23:33:38 UTC
Peer count
1
Behaviours
-
default(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
write_read_30587147196_1
Write timing
The time taken to write the entry.
mean
0.017448
s
SD
0.006992
s
p50
0.017352
s
p95
0.029152
s
p99
0.037102
s
Write rate
The number of writes completed per second.
mean
211
/s
Read timing
The time taken to read the entry.
mean
0.029519
s
SD
0.018805
s
p50
0.026938
s
p95
0.060534
s
p99
0.063586
s
Read rate
The number of reads completed per second.
mean
210.96
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.010753
s
SD
0.004149
s
p50
0.00999
s
p95
0.014765
s
p99
0.015059
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
256501890
over 290.002586692s
mean rate
884481.77
/s
std
563176.69
/s
p5
466286.12
/s
p95
2.28904739e+06
/s
peak
2.8146791e+06
/s
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
291838578
over 290.002586692s
mean rate
1.00633139e+06
/s
std
640371.53
/s
p5
530624.58
/s
p95
2.60489165e+06
/s
peak
3.1974893e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 290.002586692s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
28125048
over 290.002586692s
mean rate
96982.1
/s
std
61751.48
/s
p5
51127.57
/s
p95
250990.62
/s
peak
308625.35
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.003188
s
SD
0.000573
s
p50
0.003172
s
p95
0.003875
s
p99
0.00631
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.012394
s
SD
0.004033
s
p50
0.011622
s
p95
0.016394
s
p99
0.016688
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002632
s
SD
0.000497
s
p50
0.00262
s
p95
0.003254
s
p99
0.005333
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.0118
s
SD
0.004049
s
p50
0.011031
s
p95
0.015793
s
p99
0.016086
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001165
s
SD
0
s
p50
0.001165
s
p95
0.001165
s
p99
0.001165
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000867
s
SD
0.000182
s
p50
0.000864
s
p95
0.001105
s
p99
0.00185
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000231
s
SD
2.7e-05
s
p50
0.000253
s
p95
0.000253
s
p99
0.000428
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.010792
s
SD
0.004149
s
p50
0.010028
s
p95
0.014805
s
p99
0.015099
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00142
s
SD
0.000262
s
p50
0.001414
s
p95
0.001745
s
p99
0.002842
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000167
s
SD
1.8e-05
s
p50
0.000167
s
p95
0.000171
s
p99
0.000262
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.54
s
mean
153.54
s
SD
86.56
s
p95
288.54
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
18153
over 290.002420542s
mean rate
62.6
/s
std
39.85
/s
p5
32.7
/s
p95
161.7
/s
peak
199.2
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.001243
s
SD
0.000245
s
p50
0.001234
s
p95
0.001517
s
p99
0.002584
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
p95
1
s
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001276
s
SD
0
s
p50
0.001276
s
p95
0.001276
s
p99
0.001276
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000401
s
SD
0
s
p50
0.000401
s
p95
0.000401
s
p99
0.000401
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000703
s
SD
4.7e-05
s
p50
0.000705
s
p95
0.000715
s
p99
0.000887
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.027341
s
SD
0.010153
s
p50
0.025151
s
p95
0.03757
s
p99
0.038511
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000864
s
SD
0
s
p50
0.000864
s
p95
0.000864
s
p99
0.000864
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.005264
s
SD
0.001628
s
p50
0.004981
s
p95
0.006731
s
p99
0.006839
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.003623
s
SD
0.001342
s
p50
0.003376
s
p95
0.004931
s
p99
0.005041
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.004745
s
SD
0.001877
s
p50
0.004476
s
p95
0.006615
s
p99
0.006748
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000113
s
SD
1.5e-05
s
p50
0.000113
s
p95
0.000123
s
p99
0.000173
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.005395
s
SD
0.002075
s
p50
0.005013
s
p95
0.007403
s
p99
0.00755
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.8e-05
s
SD
0
s
p50
8.8e-05
s
p95
8.8e-05
s
p99
8.8e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
8.7e-05
s
SD
9e-06
s
p50
8.7e-05
s
p95
9e-05
s
p99
0.00013
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001257
s
SD
0.007452
s
p50
0.000462
s
p95
0.01929
s
p99
0.01929
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000205
s
SD
3.1e-05
s
p50
0.000204
s
p95
0.000243
s
p99
0.000375
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
43.59
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
45
B/s
mean
2.12
KiB/s
SD
2.43
KiB/s
p95
4.77
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
13
B/s
mean
584
B/s
SD
881
B/s
p95
1.16
KiB/s
Total bytes received
Total bytes received on primary network interface
count
614.17
KiB
mean
2.12
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
165.27
KiB
mean
584
B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
42.95
%
mean
49.42
%
SD
2.87
%
p95
51.61
%
System
5.83
%
CPU percentiles
CPU usage percentiles
p50
49.85
%
p95
51.61
%
p99
53.74
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
5.84
%
mean
6.04
%
SD
0.43
%
p95
7.58
%
Memory available percentage
Percentage of available memory
p5
92.42
%
mean
93.96
%
SD
0.43
%
p95
94.16
%
Max host memory used
Maximum memory usage percentage across all hosts
max
6.04
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-92.77
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
2.08
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/nomad.d/client-meta.json0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.61
5 min
0.75
15 min
0.32
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.04
%
mean
0.493
%
SD
0.52
%
p95
1.73
%
60 second average
0.4657
%
300 second average
0.2613
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
41.37
%
mean
48.38
%
SD
3.16
%
p95
50.77
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
249.25
KiB
mean
256.74
KiB
SD
4.99
KiB
p95
258.61
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
mean
13.73
threads
SD
1.26
threads
p95
14
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
58
file descriptors
mean
58.67
file descriptors
SD
7.31
file descriptors
p95
66
file descriptors
Write validated
↑ Back to indexCreates an entry, updates it and links the create to the update, then repeats. Each of the three actions is validated by the included hApp.
Started
Thu, 30 Jul 2026 23:43:27 UTC
Peer count
1
Behaviours
-
default(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
write_validated_30587147196_1
Write timing
The time it takes to complete the zome function call that writes the entry, updates it, and links to the update.
mean
0.073824
s
SD
0.035589
s
p50
0.065065
s
p95
0.145061
s
p99
0.18136
s
Write rate
The number of write zome function calls that complete per second.
mean
53.5
/s
Read timing
The time it takes to complete the zome function call that reads the data.
mean
0.111159
s
SD
0.038297
s
p50
0.106499
s
p95
0.187308
s
p99
0.215446
s
Read rate
The number of read zome function calls that complete per second.
mean
52.89
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000948
s
SD
0.000387
s
p50
0.001046
s
p95
0.001583
s
p99
0.001596
s
WASM usage: 'validated::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
58438504
over 270.012915501s
mean rate
216428.28
/s
std
70958.32
/s
p5
151516.37
/s
p95
352184.36
/s
peak
397180.83
/s
WASM usage: 'validated::update_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
68423758
over 270.012915501s
mean rate
253408.88
/s
std
83093.3
/s
p5
172737.4
/s
p95
417448.73
/s
peak
460574.67
/s
WASM usage: 'validated_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
95989420
over 280.013115585s
mean rate
342802.94
/s
std
110465.87
/s
p5
236952.07
/s
p95
559188.49
/s
peak
624570.75
/s
WASM usage: 'validated_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
1158205606
over 270.012915501s
mean rate
4.28943998e+06
/s
std
1.41056406e+06
/s
p5
2.98198876e+06
/s
p95
7.03221299e+06
/s
peak
7.85905312e+06
/s
Zome call duration: 'validated::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006872
s
SD
0.000264
s
p50
0.00689
s
p95
0.00693
s
p99
0.006965
s
Zome call duration: 'validated::update_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.008431
s
SD
0.000383
s
p50
0.008402
s
p95
0.008654
s
p99
0.008658
s
WASM call duration: 'validated::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005658
s
SD
0.000239
s
p50
0.005678
s
p95
0.005711
s
p99
0.005718
s
WASM call duration: 'validated::update_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.007285
s
SD
0.000349
s
p50
0.007249
s
p95
0.007507
s
p99
0.007508
s
WASM call duration: 'validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001499
s
SD
6.9e-05
s
p50
0.001502
s
p95
0.001524
s
p99
0.001525
s
WASM call duration: 'validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00458
s
SD
0.000263
s
p50
0.004605
s
p95
0.0047
s
p99
0.004708
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000484
s
SD
1.4e-05
s
p50
0.000484
s
p95
0.000489
s
p99
0.00049
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000494
s
SD
1.6e-05
s
p50
0.00049
s
p95
0.000508
s
p99
0.000508
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.001001
s
SD
8.8e-05
s
p50
0.000994
s
p95
0.001053
s
p99
0.001056
s
Host function call duration: '__hc__update_1'
Duration of this host function call invoked from within WASM.
mean
0.002018
s
SD
0.00017
s
p50
0.00199
s
p95
0.002169
s
p99
0.002174
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002598
s
SD
0.000335
s
p50
0.002803
s
p95
0.003269
s
p99
0.003277
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.00076
s
SD
8.9e-05
s
p50
0.000735
s
p95
0.000833
s
p99
0.000841
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
16.58
s
mean
151.59
s
SD
86.56
s
p95
286.59
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
16361
over 280.013167556s
mean rate
58.43
/s
std
18.8
/s
p5
40.4
/s
p95
94.9
/s
peak
106.39
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.012538
s
SD
0.042905
s
p50
0.012545
s
p95
0.018515
s
p99
0.245521
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
p95
1
s
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001676
s
SD
0
s
p50
0.001676
s
p95
0.001676
s
p99
0.001676
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002183
s
SD
0
s
p50
0.002183
s
p95
0.002183
s
p99
0.002183
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.005049
s
SD
0.001438
s
p50
0.005117
s
p95
0.005807
s
p99
0.00582
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.057825
s
SD
0.024828
s
p50
0.048037
s
p95
0.081802
s
p99
0.084064
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001806
s
SD
0
s
p50
0.001806
s
p95
0.001806
s
p99
0.001806
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.017825
s
SD
0.007059
s
p50
0.015041
s
p95
0.024236
s
p99
0.024791
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.005484
s
SD
0.002134
s
p50
0.004599
s
p95
0.007472
s
p99
0.007667
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.003435
s
SD
0.001462
s
p50
0.002948
s
p95
0.004898
s
p99
0.00502
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000406
s
SD
4.9e-05
s
p50
0.000407
s
p95
0.000414
s
p99
0.000414
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000525
s
SD
8.7e-05
s
p50
0.000515
s
p95
0.000562
s
p99
0.000564
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000207
s
SD
0
s
p50
0.000207
s
p95
0.000207
s
p99
0.000207
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.00026
s
SD
2.6e-05
s
p50
0.000258
s
p95
0.000267
s
p99
0.000268
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003774
s
SD
0.05112
s
p50
0.000386
s
p95
0.138559
s
p99
0.138559
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000402
s
SD
8.1e-05
s
p50
0.000399
s
p95
0.000412
s
p99
0.000837
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
63.14
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
132
B/s
mean
1.47
KiB/s
SD
2.42
KiB/s
p95
3.97
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
266
B/s
mean
1.69
KiB/s
SD
1.24
KiB/s
p95
4.40
KiB/s
Total bytes received
Total bytes received on primary network interface
count
425.19
KiB
mean
1.47
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
489.81
KiB
mean
1.69
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 92.8%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 120.47 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
59.82
%
mean
80.13
%
SD
9.11
%
p95
87.53
%
System
17.00
%
CPU percentiles
CPU usage percentiles
p50
84.69
%
p95
87.53
%
p99
92.83
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.69
s
Memory used percentage
Percentage of memory used
p5
14.1
%
mean
16.47
%
SD
1.13
%
p95
17.13
%
Memory available percentage
Percentage of available memory
p5
82.87
%
mean
83.53
%
SD
1.13
%
p95
85.9
%
Max host memory used
Maximum memory usage percentage across all hosts
max
16.47
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.02
%
Memory growth rate
Rate of memory growth over time
growth
120.47
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
18.74
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/hostname0/1
hosts
Mount Point
/etc/hosts0/1
hosts
Mount Point
/etc/resolv.conf0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.99
5 min
0.86
15 min
0.34
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
5.52
%
mean
31.71
%
SD
10.7983
%
p95
38.96
%
60 second average
25.5977
%
300 second average
11.5103
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0.2
%
mean
0.6263
%
SD
0.329
%
p95
1.24
%
60 second average
0.5380
%
300 second average
0.2643
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0.3627
%
SD
0.3631
%
p95
1.14
%
60 second average
0.3370
%
300 second average
0.1753
%
Holochain process CPU usage
CPU usage by Holochain process
p5
50.95
%
mean
72.56
%
SD
16.46
%
p95
83.08
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
293.53
KiB
mean
406.55
KiB
SD
58.35
KiB
p95
427.27
KiB
Holochain process threads
Number of threads in Holochain process
p5
9
threads
mean
14.93
threads
SD
2.97
threads
p95
16
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
38
file descriptors
mean
58.63
file descriptors
SD
11.75
file descriptors
p95
64
file descriptors
Write Validated must_get_agent_activity
↑ Back to index
A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.
The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.
This test is similar to Mixed-Arc must_get_agent_activity, but all agents are full-arc.
Started
Fri, 31 Jul 2026 01:31:11 UTC
Peer count
30
Peer count at end
27
Behaviours
-
must_get_agent_activity(1 agent) -
write(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
write_validated_must_get_agent_activity_30587147196_1
Highest observed
action_seqThe maximum chain length observed per
write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1607.86
Max
Highest chain head value observed for any single write agent.
1886
Write agents observed
7
Chain batch delay timing
The time between a
write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.Mean
mean
163.97813
s
SD
43.052201
s
Max
Highest per-partition mean latency
max mean
1055.29758
s
Min
Lowest per-partition mean latency
min mean
10.074671
s
Chain batch delay rate
The rate at which a
must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.Mean
mean
1.95
/s
Max
Highest per-partition mean rate
max
4.15
/s
Min
Lowest per-partition mean rate
min
0
/s
create_validated_sample_entry zome call timingThe time taken to complete the zome function call that creates the entry that depends on a
write agent's source chain.Mean
mean
0.425242
s
SD
0.30188
s
Max
Highest per-partition mean latency
max mean
3.280646
s
Min
Lowest per-partition mean latency
min mean
0.026099
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on
must_get_agent_activity calls.Total
1835
Agents affected
12 / 14
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
131
Max
Highest count in any single partition
779
Min
Lowest count in any single partition
0
Final error count
The total number of all types of error accumulated over the run by all agents.
70264
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.036861
s
SD
0.032215
s
p50
0.002037
s
p95
0.085322
s
p99
0.158035
s
WASM usage: 'validated_must_get_agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 33085.490558971s
Not enough time data to show a trend.
WASM usage: 'validated_must_get_agent_activity::create_sample_entries_batch'
Metered usage count of the WASM ribosome for this zome function.
total
3594278044
over 33085.490558971s
mean rate
2.00520150099e+09
/s
std
3.61013788763e+09
/s
p5
0
/s
p95
9.9771648124e+09
/s
peak
1.47654895069e+10
/s
WASM usage: 'validated_must_get_agent_activity::create_validated_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
5451042
over 1938.318183954s
mean rate
1.69112055957e+09
/s
std
5.78827868002e+09
/s
p5
0
/s
p95
1.10385423767e+10
/s
peak
5.92699995524e+10
/s
WASM usage: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Metered usage count of the WASM ribosome for this zome function.
total
726029579
over 1942.01537359s
mean rate
8.6354125763e+08
/s
std
1.13686949912e+09
/s
p5
449961.77
/s
p95
3.83277036334e+09
/s
peak
5.24533802765e+09
/s
WASM usage: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
3089
over 1948.272375384s
mean rate
2.711374163e+07
/s
std
6.069415001e+07
/s
p5
0
/s
p95
2.1561321538e+08
/s
peak
2.45268274e+08
/s
WASM usage: 'validated_must_get_agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
40512864
over 33091.522823931s
mean rate
1.2680192046e+09
/s
std
3.99143089057e+09
/s
p5
55844.04
/s
p95
6.41969254464e+09
/s
peak
3.76618896299e+10
/s
WASM usage: 'validated_must_get_agent_activity_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
335520376
over 33091.476763107s
mean rate
5.88373225088e+11
/s
std
3.70059787521e+12
/s
p5
463477.58
/s
p95
1.06405769588e+12
/s
peak
4.325202166e+13
/s
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.006102
s
SD
0.003377
s
p50
0.00553
s
p95
0.013455
s
p99
0.013455
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.054869
s
SD
0.015832
s
p50
0.050197
s
p95
0.07906
s
p99
0.09507
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005336
s
SD
0.002556
s
p50
0.00514
s
p95
0.014359
s
p99
0.015439
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.071046
s
SD
0.052459
s
p50
0.042111
s
p95
0.201558
s
p99
0.209756
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.01151
s
SD
0.102466
s
p50
0.008769
s
p95
0.455616
s
p99
0.455616
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005321
s
SD
0.003208
s
p50
0.004074
s
p95
0.012476
s
p99
0.012476
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.053799
s
SD
0.01561
s
p50
0.049236
s
p95
0.077547
s
p99
0.093523
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004396
s
SD
0.001958
s
p50
0.004216
s
p95
0.011129
s
p99
0.012011
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.045525
s
SD
0.045499
s
p50
0.034745
s
p95
0.150367
s
p99
0.209124
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.010262
s
SD
0.10255
s
p50
0.007494
s
p95
0.454792
s
p99
0.454792
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001157
s
SD
0.000432
s
p50
0.001138
s
p95
0.001989
s
p99
0.002598
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.007281
s
SD
0.015629
s
p50
0.006181
s
p95
0.029778
s
p99
0.093715
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.3e-05
s
SD
9e-06
s
p50
2.6e-05
s
p95
4.3e-05
s
p99
4.7e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000421
s
SD
0.000246
s
p50
0.000398
s
p95
0.000788
s
p99
0.001566
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000457
s
SD
0.000332
s
p50
0.000383
s
p95
0.001687
s
p99
0.001687
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.039822
s
SD
0.08017
s
p50
0.00371
s
p95
0.155634
s
p99
0.451981
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.031137
s
SD
0.041324
s
p50
0.026144
s
p95
0.145222
s
p99
0.210468
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.00758
s
SD
0.003689
s
p50
0.005474
s
p95
0.012977
s
p99
0.017088
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1.4e-05
s
SD
7e-06
s
p50
1.1e-05
s
p95
3.8e-05
s
p99
3.8e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001996
s
SD
0.001447
s
p50
0.002396
s
p95
0.005466
s
p99
0.01022
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000361
s
SD
0.000542
s
p50
0.000348
s
p95
0.001196
s
p99
0.003355
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.59
s
mean
456.81
s
SD
262.43
s
p95
867.12
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
4792
over 33091.522886843s
mean rate
101464.63
/s
std
222800.7
/s
p5
0
/s
p95
724983.01
/s
peak
1.38303022e+06
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
26.956075
s
SD
58.507678
s
p50
10.956768
s
p95
172.753748
s
p99
276.796948
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
2.036147
s
SD
0.242744
s
p50
2.001837
s
p95
2.225971
s
p99
2.360446
s
App validation workflow duration
Time spent running the app validation workflow.
mean
3.436096
s
SD
17.314991
s
p50
3.097868
s
p95
43.163294
s
p99
117.871914
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001562
s
SD
0.001653
s
p50
0.001012
s
p95
0.003678
s
p99
0.008643
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.017158
s
SD
0.01945
s
p50
0.005821
s
p95
0.050642
s
p99
0.101438
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.008443
s
SD
0.00738
s
p50
0.002633
s
p95
0.021301
s
p99
0.035975
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.448504
s
SD
1.056654
s
p50
0.456084
s
p95
3.557086
s
p99
5.990655
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
13.48824
s
SD
17.292249
s
p50
13.44627
s
p95
51.252444
s
p99
78.719509
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.009772
s
SD
0.010002
s
p50
0.005899
s
p95
0.022487
s
p99
0.059041
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.002681
s
SD
0.002369
s
p50
0.001534
s
p95
0.005791
s
p99
0.012883
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000237
s
SD
0.000121
s
p50
0.00022
s
p95
0.000547
s
p99
0.000608
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.013191
s
SD
0.008449
s
p50
0.008481
s
p95
0.020648
s
p99
0.04737
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000136
s
SD
0.000141
s
p50
9.6e-05
s
p95
0.000266
s
p99
0.000805
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000169
s
SD
0.000108
s
p50
0.000155
s
p95
0.000405
s
p99
0.000584
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002717
s
SD
0.120561
s
p50
0.000447
s
p95
0.395624
s
p99
0.565214
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000279
s
SD
0.00017
s
p50
0.000303
s
p95
0.000659
s
p99
0.000847
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.114947
s
SD
0.045176
s
p50
0.10223
s
p95
0.19656
s
p99
0.245041
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.143115
s
SD
0.05196
s
p50
0.145707
s
p95
0.193741
s
p99
0.193741
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
0.237353
s
SD
0.028222
s
p50
0.217465
s
p95
0.264972
s
p99
0.264972
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.380643
s
SD
1.087719
s
p50
0.344925
s
p95
0.539976
s
p99
0.692751
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
26.09
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
119
B/s
mean
91.58
KiB/s
SD
232.61
KiB/s
p95
143.72
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
154
B/s
mean
118.94
KiB/s
SD
143.94
KiB/s
p95
315.05
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.14
GiB
mean
2.33
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.78
GiB
mean
3.03
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected
Warning CPU p99 reached 96.6%
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 557.69 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected
Warning 15% of hosts overloaded (load5/ncpus > 1.0)
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
3.2
%
mean
34.3
%
SD
25.77
%
p95
81.34
%
System
8.21
%
CPU percentiles
CPU usage percentiles
p50
27.25
%
p95
81.34
%
p99
96.64
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
12
hosts
mean time
0.14
s
Memory used percentage
Percentage of memory used
p5
8.08
%
mean
15.45
%
SD
5.79
%
p95
23.32
%
Memory available percentage
Percentage of available memory
p5
76.68
%
mean
84.55
%
SD
5.79
%
p95
91.92
%
Max host memory used
Maximum memory usage percentage across all hosts
max
38.09
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.09
%
Memory growth rate
Rate of memory growth over time
growth
557.69
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.49
MiB/s
Disk write throughput
Disk write throughput in MiB/s
138.98
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/0/6
hosts
Mount Point
/efi-boot0/4
hosts
Mount Point
/etc/hostname0/6
hosts
Mount Point
/etc/hosts0/6
hosts
Mount Point
/etc/nomad.d/client-meta.json0/15
hosts
Mount Point
/etc/nomad.d/meta.json0/1
hosts
Mount Point
/etc/resolv.conf0/6
hosts
Mount Point
/nix/store0/6
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.86
5 min
1.73
15 min
1.62
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
14.81
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
6.4449
%
SD
11.1456
%
p95
28.47
%
60 second average
6.6198
%
300 second average
7.5246
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
9.8485
%
SD
17.012
%
p95
48
%
60 second average
9.6369
%
300 second average
8.3424
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
8.8233
%
SD
15.6873
%
p95
43.63
%
60 second average
8.6236
%
300 second average
7.3533
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.4
%
mean
26.18
%
SD
22.05
%
p95
72.36
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
263.64
KiB
mean
518.80
KiB
SD
101.53
KiB
p95
639.28
KiB
Holochain process threads
Number of threads in Holochain process
p5
9
threads
mean
37.09
threads
SD
15.35
threads
p95
61
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
23
file descriptors
mean
81.4
file descriptors
SD
21.72
file descriptors
p95
108
file descriptors
Zome Call, Single Value
↑ Back to indexCalls a zome function that returns a fixed value. This tests the maximum performance of zome calls when the zome function is not calling into Holochain other otherwise doing any work.
Started
Thu, 30 Jul 2026 23:52:20 UTC
Peer count
1
Behaviours
-
default(1 agent)
Holochain version
0.6.3
Wind Tunnel version
0.7.1
Run ID
zome_call_single_value_30587147196_1
Call timing
The time taken for the call to complete.
mean
0.001704
s
SD
0.000118
s
p50
0.001693
s
p95
0.001874
s
p99
0.002084
s
Call rate
The number of zome calls completed per second.
mean
5806.69
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'return_single_value::get_value'
Metered usage count of the WASM ribosome for this zome function.
total
690183352
over 280.002072553s
mean rate
2.4649223e+06
/s
std
41289.08
/s
p5
2.39600476e+06
/s
p95
2.52202153e+06
/s
peak
2.5271132e+06
/s
Zome call duration: 'return_single_value::get_value'
Duration of this zome call as measured by Holochain internally.
mean
0.00091
s
SD
4e-06
s
p50
0.000911
s
p95
0.000912
s
p99
0.000912
s
WASM call duration: 'return_single_value::get_value'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000601
s
SD
2e-06
s
p50
0.000601
s
p95
0.000601
s
p99
0.000602
s
Post-commit duration
Time spent executing post-commit workflows.
mean
9.8e-05
s
SD
0
s
p50
9.8e-05
s
p95
9.8e-05
s
p99
9.8e-05
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.75
s
mean
148.75
s
SD
83.67
s
p95
278.75
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.002068375s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.061549
s
SD
0
s
p50
0.061549
s
p95
0.061549
s
p99
0.061549
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
p95
1
s
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000752
s
SD
0
s
p50
0.000752
s
p95
0.000752
s
p99
0.000752
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000713
s
SD
0
s
p50
0.000713
s
p95
0.000713
s
p99
0.000713
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000592
s
SD
0
s
p50
0.000592
s
p95
0.000592
s
p99
0.000592
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.000577
s
SD
5e-05
s
p50
0.00059
s
p95
0.000669
s
p99
0.000669
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000616
s
SD
0
s
p50
0.000616
s
p95
0.000616
s
p99
0.000616
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000365
s
SD
0
s
p50
0.000365
s
p95
0.000365
s
p99
0.000365
s
Authored DB connection use time
Time spent holding authored database connections.
mean
5.6e-05
s
SD
1e-06
s
p50
5.6e-05
s
p95
5.7e-05
s
p99
5.7e-05
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
3.1e-05
s
SD
0
s
p50
3.1e-05
s
p95
3.1e-05
s
p99
3.1e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
4.9e-05
s
SD
1e-06
s
p50
4.9e-05
s
p95
4.9e-05
s
p99
4.9e-05
s
Cache DB connection use time
Time spent holding cache database connections.
mean
5.7e-05
s
SD
0
s
p50
5.7e-05
s
p95
5.7e-05
s
p99
5.7e-05
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
5.4e-05
s
SD
0
s
p50
5.4e-05
s
p95
5.4e-05
s
p99
5.4e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
4.5e-05
s
SD
2e-06
s
p50
4.4e-05
s
p95
4.6e-05
s
p99
4.6e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
7.1e-05
s
SD
0.004604
s
p50
7.2e-05
s
p95
0.011587
s
p99
0.011587
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000174
s
SD
0
s
p50
0.000174
s
p95
0.000174
s
p99
0.000174
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
5.88
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
238
B/s
mean
881
B/s
SD
758
B/s
p95
2.05
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
28
B/s
mean
344
B/s
SD
338
B/s
p95
997
B/s
Total bytes received
Total bytes received on primary network interface
count
249.58
KiB
mean
881
B/s
Total bytes sent
Total bytes sent on primary network interface
count
97.51
KiB
mean
344
B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected
Warning Memory growing at 40.29 MiB/s
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
12.96
%
mean
13.13
%
SD
0.11
%
p95
13.24
%
System
7.25
%
CPU percentiles
CPU usage percentiles
p50
13.11
%
p95
13.24
%
p99
13.58
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
15.81
%
mean
16.83
%
SD
0.68
%
p95
18.09
%
Memory available percentage
Percentage of available memory
p5
81.91
%
mean
83.17
%
SD
0.68
%
p95
84.19
%
Max host memory used
Maximum memory usage percentage across all hosts
max
16.83
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
40.29
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.01
MiB/s
Disk write throughput
Disk write throughput in MiB/s
1.09
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point
/etc/nomad.d/client-meta.json0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.85
5 min
0.39
15 min
0.15
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0.1047
%
SD
0.0924
%
p95
0.31
%
60 second average
0.0853
%
300 second average
0.0230
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
12.16
%
mean
12.2
%
SD
0.02
%
p95
12.25
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
300.49
KiB
mean
302.66
KiB
SD
1.08
KiB
p95
304.22
KiB
Holochain process threads
Number of threads in Holochain process
p5
17
threads
mean
17
threads
SD
0
threads
p95
17
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
49
file descriptors
mean
53.23
file descriptors
SD
8.47
file descriptors
p95
70
file descriptors