App Install

↑ Back to index

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Thu, 18 Jun 2026 01:39:43 UTC
Peer count
1
Behaviours
  • minimal (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
app_install_minimal_27730453039_1
First install time
The time from conductor startup to completion of the first app installation attempt.
1.280229668
s
Install app timing
The time taken to install an app.
mean
1.230419
s
SD
1.277337
s
p50
0.573625
s
<
p95
4.058151
s
<
p99
5.629204
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'callback::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.005832757s
Not enough time data to show a trend.
WASM usage: 'callback_integrity::genesis_self_check_2'
Metered usage count of the WASM ribosome for this zome function.
total
1021581
over 280.005832757s
mean rate
3648.45
/s
std
2469.36
/s
p5
1092.4
/s
p95
7102.19
/s
peak
7648.22
/s
WASM call duration: 'callback::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000979
s
SD
0.000234
s
p50
0.000915
s
<
p95
0.0014
s
<
p99
0.002032
s
WASM call duration: 'callback_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002001
s
SD
5.7e-05
s
p50
0.002039
s
<
p95
0.002059
s
<
p99
0.002075
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.00017
s
SD
0.000107
s
p50
0.000125
s
<
p95
0.000386
s
<
p99
0.00064
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.03
s
<
mean
147.03
s
SD
83.67
s
<
p95
277.03
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
2057
over 280.006530495s
mean rate
7.35
/s
std
4.97
/s
p5
2.2
/s
p95
14.3
/s
peak
15.4
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.005063
s
SD
0.003972
s
p50
0.004393
s
<
p95
0.006418
s
<
p99
0.025944
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000745
s
SD
6.1e-05
s
p50
0.000723
s
<
p95
0.000823
s
<
p99
0.000827
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001525
s
SD
0.000109
s
p50
0.001482
s
<
p95
0.001629
s
<
p99
0.00165
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.026955
s
SD
0.002771
s
p50
0.025572
s
<
p95
0.029191
s
<
p99
0.029471
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001448
s
SD
8.5e-05
s
p50
0.001416
s
<
p95
0.001545
s
<
p99
0.001552
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.00092
s
SD
4.2e-05
s
p50
0.000927
s
<
p95
0.000978
s
<
p99
0.000982
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.00039
s
SD
1.9e-05
s
p50
0.000386
s
<
p95
0.000417
s
<
p99
0.00042
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000275
s
SD
7.6e-05
s
p50
0.000251
s
<
p95
0.000441
s
<
p99
0.000547
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
6e-05
s
SD
3e-06
s
p50
5.8e-05
s
<
p95
6.4e-05
s
<
p99
6.5e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000245
s
SD
8e-06
s
p50
0.000243
s
<
p95
0.000254
s
<
p99
0.000258
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000191
s
SD
1.5e-05
s
p50
0.000179
s
<
p95
0.000205
s
<
p99
0.00021
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000202
s
SD
0
s
p50
0.000202
s
≤
p95
0.000202
s
≤
p99
0.000202
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000102
s
SD
1.2e-05
s
p50
9.7e-05
s
<
p95
0.000111
s
<
p99
0.000112
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002042
s
SD
0.000676
s
p50
0.000478
s
<
p95
0.000725
s
<
p99
0.003271
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000437
s
SD
1.9e-05
s
p50
0.000422
s
<
p95
0.000464
s
≤
p99
0.000464
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
26.74
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
32.32
KiB/s
<
mean
937.92
KiB/s
SD
1.21
MiB/s
<
p95
2.24
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
11.88
KiB/s
<
mean
605.09
KiB/s
SD
571.62
KiB/s
<
p95
1.58
MiB/s
Total bytes received
Total bytes received on primary network interface
count
274.78
MiB
mean
937.92
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
177.27
MiB
mean
605.09
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 868.17 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
10.02
%
<
mean
36.24
%
SD
20.18
%
<
p95
59.23
%
System
9.50
%
CPU percentiles
CPU usage percentiles
p50
48.66
%
p95
59.23
%
p99
64.32
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
14.68
%
<
mean
20.74
%
SD
4.14
%
<
p95
25.35
%
Memory available percentage
Percentage of available memory
p5
74.65
%
<
mean
79.26
%
SD
4.14
%
<
p95
85.32
%
Max host memory used
Maximum memory usage percentage across all hosts
max
20.74
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
868.17
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
6.35
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /efi-boot
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.09
5 min
1.93
15 min
0.84
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.11
%
<
mean
10.3703
%
SD
9.1197
%
<
p95
22.53
%
60 second average
7.6358
%
300 second average
2.8884
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
13.28
%
<
mean
36.6139
%
SD
8.1417
%
<
p95
43.92
%
60 second average
30.6394
%
300 second average
15.1026
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
12.22
%
<
mean
24.8877
%
SD
9.7318
%
<
p95
41.25
%
60 second average
22.0726
%
300 second average
11.8177
%
Holochain process CPU usage
CPU usage by Holochain process
p5
6.82
%
<
mean
26.72
%
SD
15.15
%
<
p95
47.69
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
26.27
KiB
<
mean
350.65
KiB
SD
162.81
KiB
<
p95
683.08
KiB
Holochain process threads
Number of threads in Holochain process
p5
9
threads
<
mean
23.22
threads
SD
6.3
threads
<
p95
30
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
12
file descriptors
<
mean
218.56
file descriptors
SD
221.62
file descriptors
<
p95
616
file descriptors

App Install

↑ Back to index

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Thu, 18 Jun 2026 01:37:54 UTC
Peer count
1
Behaviours
  • large (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
app_install_large_27730453039_1
First install time
The time from conductor startup to completion of the first app installation attempt.
1.486926733
s
Install app timing
The time taken to install an app.
mean
0.981588
s
SD
0.913495
s
p50
0.600119
s
<
p95
2.419682
s
<
p99
4.73585
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'large::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 270.004023579s
Not enough time data to show a trend.
WASM call duration: 'large::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003341
s
SD
0.001463
s
p50
0.002973
s
<
p95
0.005079
s
<
p99
0.008998
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000166
s
SD
0.000114
s
p50
0.000122
s
<
p95
0.000415
s
<
p99
0.00046
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
16.15
s
<
mean
146.15
s
SD
83.67
s
<
p95
276.15
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
2457
over 280.002777523s
mean rate
8.77
/s
std
3.05
/s
p5
2.2
/s
p95
12.1
/s
peak
12.3
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.007564
s
SD
0.021084
s
p50
0.007459
s
<
p95
0.01421
s
<
p99
0.123378
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000698
s
SD
0.000124
s
p50
0.000707
s
<
p95
0.000734
s
<
p99
0.001365
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001532
s
SD
0.000158
s
p50
0.001553
s
<
p95
0.001644
s
<
p99
0.001662
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.030743
s
SD
0.005487
s
p50
0.030008
s
<
p95
0.033076
s
<
p99
0.033085
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001522
s
SD
4.4e-05
s
p50
0.001551
s
<
p95
0.001594
s
<
p99
0.001605
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001063
s
SD
7.6e-05
s
p50
0.001068
s
<
p95
0.001268
s
<
p99
0.001315
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000411
s
SD
4e-05
s
p50
0.000407
s
<
p95
0.00043
s
<
p99
0.000604
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000301
s
SD
7.6e-05
s
p50
0.000286
s
<
p95
0.000454
s
<
p99
0.000592
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
6.6e-05
s
SD
3e-06
s
p50
6.7e-05
s
<
p95
7e-05
s
≤
p99
7e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000259
s
SD
1.1e-05
s
p50
0.000257
s
<
p95
0.00027
s
≤
p99
0.00027
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000248
s
SD
2.1e-05
s
p50
0.000247
s
<
p95
0.000257
s
<
p99
0.000259
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.00022
s
SD
0
s
p50
0.00022
s
≤
p95
0.00022
s
≤
p99
0.00022
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000121
s
SD
1.5e-05
s
p50
0.000122
s
<
p95
0.000134
s
<
p99
0.000135
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002526
s
SD
0.00724
s
p50
0.000526
s
<
p95
0.000926
s
<
p99
0.005352
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000514
s
SD
4e-05
s
p50
0.000514
s
<
p95
0.000521
s
<
p99
0.000726
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
20.74
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
31.36
KiB/s
<
mean
550.44
KiB/s
SD
1.19
MiB/s
<
p95
1.55
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
19.70
KiB/s
<
mean
205.36
KiB/s
SD
334.21
KiB/s
<
p95
833.31
KiB/s
Total bytes received
Total bytes received on primary network interface
count
166.64
MiB
mean
550.44
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
62.17
MiB
mean
205.36
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 565.38 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
11.22
%
<
mean
27.77
%
SD
17.63
%
<
p95
61.5
%
System
7.03
%
CPU percentiles
CPU usage percentiles
p50
19.77
%
p95
61.50
%
p99
67.52
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
19.44
%
<
mean
28.4
%
SD
4.28
%
<
p95
35.8
%
Memory available percentage
Percentage of available memory
p5
64.2
%
<
mean
71.6
%
SD
4.28
%
<
p95
80.56
%
Max host memory used
Maximum memory usage percentage across all hosts
max
28.40
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
565.38
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
4.92
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.69
5 min
1.49
15 min
0.79
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.79
%
<
mean
5.0675
%
SD
6.4556
%
<
p95
19.12
%
60 second average
3.3669
%
300 second average
1.8484
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
11.78
%
<
mean
34.5766
%
SD
12.7317
%
<
p95
57.47
%
60 second average
26.6950
%
300 second average
12.9422
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
9.77
%
<
mean
26.4728
%
SD
8.1713
%
<
p95
40.23
%
60 second average
21.6916
%
300 second average
10.8922
%
Holochain process CPU usage
CPU usage by Holochain process
p5
5.88
%
<
mean
17.5
%
SD
16.62
%
<
p95
47.76
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
16.89
KiB
<
mean
599.05
KiB
SD
381.55
KiB
<
p95
1.18
MiB
Holochain process threads
Number of threads in Holochain process
p5
9
threads
<
mean
21.29
threads
SD
7.71
threads
<
p95
36
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
13
file descriptors
<
mean
292.03
file descriptors
SD
187.79
file descriptors
<
p95
489
file descriptors

DHT Sync Lag

↑ Back to index

Measures the lag time between an agent publishing data and other peers being able to see it. This scenario has two roles:

  • write: Creates entries with a timestamp field, linked to a known base hash so that record_lag agents can discover them.
  • record_lag: Repeatedly queries for links from the known base hash. When a new entry is discovered, it calculates the time difference between the entry's timestamp and the current time, giving the sync lag for that entry.
Started
Thu, 18 Jun 2026 01:41:39 UTC
Peer count
30
Behaviours
  • record_lag (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
dht_sync_lag_27730453039_1
Create rate
The average number of created records per agent.
Mean
mean
46.2
/s
Max
Highest per-partition mean rate
max
76.7
/s
Min
Lowest per-partition mean rate
min
10.04
/s
Sync lag timing
The average time between when a record was created and when it is first seen by an agent.
Mean
mean
246.655993
s
SD
200.988032
s
Max
Highest per-partition mean latency
max mean
637.299304
s
Min
Lowest per-partition mean latency
min mean
37.603522
s
Sync lag rate
The average number of created records discovered per agent.
Mean
mean
69.29
/s
Max
Highest per-partition mean rate
max
197.5
/s
Min
Lowest per-partition mean rate
min
0
/s
Delivery ratio
The proportion of created entries successfully received by all record_lag agents.
0.0054
Sent count
The total number of entries sent (created) by write agents, by agent.
Total
184303
Agents affected
22 / 22
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
8377
Max
Highest count in any single partition
13822
Min
Lowest count in any single partition
1868
Received count
The total number of entries received by record_lag agents, by agent.
Total
3950
Agents affected
3 / 4
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
988
Max
Highest count in any single partition
1453
Min
Lowest count in any single partition
0
Error count
The number of errors encountered during the scenario.
77
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.025707
s
SD
0.117067
s
p50
0.003436
s
<
p95
0.354095
s
<
p99
0.467345
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
742
over 39.211963612s
mean rate
192.49
/s
std
80.49
/s
p5
78.66
/s
p95
249.41
/s
peak
249.41
/s
WASM usage: 'timed::created_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
410663100
over 33984.130933013s
mean rate
1.9747034128e+09
/s
std
4.08749421635e+09
/s
p5
122585.12
/s
p95
1.46116870656e+10
/s
peak
2.01158266373e+10
/s
WASM usage: 'timed::get_timed_entries_local'
Metered usage count of the WASM ribosome for this zome function.
total
16386677664
over 38359.363873031s
mean rate
1.3969095903e+09
/s
std
1.84875389037e+09
/s
p5
8.61932539e+06
/s
p95
5.05162273313e+09
/s
peak
5.36100651122e+09
/s
WASM usage: 'timed_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
1569292288
over 38360.371901556s
mean rate
2.0171562864e+08
/s
std
4.2711650059e+08
/s
p5
17540.72
/s
p95
1.51909843441e+09
/s
peak
2.27239625466e+09
/s
Zome call duration: 'timed::created_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.013779
s
SD
0.022026
s
p50
0.00938
s
<
p95
0.067601
s
<
p99
0.125566
s
Zome call duration: 'timed::get_timed_entries_local'
Duration of this zome call as measured by Holochain internally.
mean
0.018615
s
SD
0.31531
s
p50
0.234623
s
<
p95
0.855132
s
≤
p99
0.855132
s
WASM call duration: 'timed::created_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.012699
s
SD
0.021452
s
p50
0.008454
s
<
p95
0.065282
s
<
p99
0.121957
s
WASM call duration: 'timed::get_timed_entries_local'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.018002
s
SD
0.31519
s
p50
0.233822
s
<
p95
0.853978
s
≤
p99
0.853978
s
WASM call duration: 'timed_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001213
s
SD
0.000924
s
p50
0.001294
s
<
p95
0.00347
s
<
p99
0.005658
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.002548
s
SD
0.008116
s
p50
0.000976
s
<
p95
0.022508
s
<
p99
0.04503
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.002441
s
SD
0.00796
s
p50
0.000924
s
<
p95
0.021722
s
<
p99
0.044682
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.037266
s
SD
0.128363
s
p50
0.067465
s
<
p95
0.401522
s
<
p99
0.490492
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000577
s
SD
0.006078
s
p50
0.004264
s
<
p95
0.02051
s
<
p99
0.028492
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002274
s
SD
0.002341
s
p50
0.002544
s
<
p95
0.008386
s
<
p99
0.013381
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000631
s
SD
0.000848
s
p50
0.000466
s
<
p95
0.002604
s
<
p99
0.004679
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
94.56
s
<
mean
909.41
s
SD
523.76
s
<
p95
1727.17
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
35.959539
s
SD
22.522488
s
p50
18.94256
s
<
p95
65.656973
s
<
p99
92.978649
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.586175
s
SD
0.326699
s
p50
1.534149
s
<
p95
2.142024
s
<
p99
3.07843
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.447859
s
SD
12.236095
s
p50
1.836174
s
<
p95
39.864831
s
<
p99
59.4323
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001203
s
SD
0.000899
s
p50
0.000937
s
<
p95
0.002992
s
<
p99
0.003566
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.02137
s
SD
0.124056
s
p50
0.020213
s
<
p95
0.152641
s
<
p99
0.887336
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.215182
s
SD
0.134588
s
p50
0.159348
s
<
p95
0.396953
s
<
p99
0.62155
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.894896
s
SD
11.151367
s
p50
1.21802
s
<
p95
30.81919
s
<
p99
53.931588
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.778235
s
SD
28.246132
s
p50
1.043105
s
<
p95
77.343668
s
<
p99
77.53027
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.009231
s
SD
0.021168
s
p50
0.008551
s
<
p95
0.058646
s
<
p99
0.117479
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000812
s
SD
0.002601
s
p50
0.00054
s
<
p95
0.006336
s
<
p99
0.014345
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000179
s
SD
0.000192
s
p50
0.000315
s
<
p95
0.000771
s
<
p99
0.000944
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.005086
s
SD
0.009866
s
p50
0.000221
s
<
p95
0.029769
s
<
p99
0.049717
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000132
s
SD
0.000117
s
p50
8.8e-05
s
<
p95
0.000329
s
<
p99
0.000618
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.00016
s
SD
0.000143
s
p50
0.000155
s
<
p95
0.000568
s
<
p99
0.000619
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.004435
s
SD
0.013427
s
p50
0.001739
s
<
p95
0.029501
s
<
p99
0.082598
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.002474
s
SD
0.007233
s
p50
0.000721
s
<
p95
0.019275
s
<
p99
0.041146
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.219692
s
SD
29.272229
s
p50
0.18311
s
<
p95
60.003604
s
<
p99
60.030533
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.193275
s
SD
3.052205
s
p50
0.233597
s
<
p95
10.18646
s
<
p99
10.571773
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
54.08
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
0
B/s
<
mean
1.07
MiB/s
SD
771.54
KiB/s
<
p95
2.23
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
0
B/s
<
mean
1.52
MiB/s
SD
1.35
MiB/s
<
p95
4.03
MiB/s
Total bytes received
Total bytes received on primary network interface
count
49.21
GiB
mean
27.09
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
70.19
GiB
mean
38.64
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.4%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 726.40 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 62% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
11.61
%
<
mean
64.21
%
SD
25.28
%
<
p95
95.94
%
System
10.13
%
CPU percentiles
CPU usage percentiles
p50
73.07
%
p95
95.94
%
p99
98.40
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
19
hosts
mean time
0.50
s
Memory used percentage
Percentage of memory used
p5
7.41
%
<
mean
15.64
%
SD
13.5
%
<
p95
32.35
%
Memory available percentage
Percentage of available memory
p5
67.65
%
<
mean
84.36
%
SD
13.5
%
<
p95
92.59
%
Max host memory used
Maximum memory usage percentage across all hosts
max
77.84
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.12
%
Memory growth rate
Rate of memory growth over time
growth
726.40
MiB/s
Disk read throughput
Disk read throughput in MiB/s
1.68
MiB/s
Disk write throughput
Disk write throughput in MiB/s
307.37
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/9
hosts
Mount Point /efi-boot
0/4
hosts
Mount Point /etc/hostname
0/7
hosts
Mount Point /etc/hosts
0/7
hosts
Mount Point /etc/resolv.conf
0/7
hosts
Mount Point /nix/store
0/9
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
5.55
5 min
4.83
15 min
3.31
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
61.54
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
27.9247
%
SD
21.6254
%
<
p95
58.28
%
60 second average
27.1788
%
300 second average
23.6145
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
11.6171
%
SD
17.0571
%
<
p95
45.27
%
60 second average
11.4429
%
300 second average
10.2100
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
7.3016
%
SD
14.0868
%
<
p95
39.08
%
60 second average
7.2298
%
300 second average
6.5743
%
Holochain process CPU usage
CPU usage by Holochain process
p5
9.78
%
<
mean
59.33
%
SD
25.45
%
<
p95
93.68
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
242.41
KiB
<
mean
487.48
KiB
SD
153.54
KiB
<
p95
698.36
KiB
Holochain process threads
Number of threads in Holochain process
p5
18
threads
<
mean
45.67
threads
SD
14.04
threads
<
p95
68
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
61
file descriptors
<
mean
88.4
file descriptors
SD
21.27
file descriptors
<
p95
130
file descriptors

First Call

↑ Back to index

This scenario installs a simple app which implements the init callback, and measures the time elapsed between start of install and calling init. It will uninstall the app it installed so that it can re-install it on the next iteration. This is required to re-run the initialisation callback.

Started
Thu, 18 Jun 2026 01:21:40 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
first_call_27730453039_1
Zome call timing
The time elapsed between start of install and calling init.
mean
0.010729
s
SD
0.001196
s
p50
0.010885
s
<
p95
0.013305
s
≤
p99
0.013305
s
Not enough time data to show a trend.
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.006794654s
Not enough time data to show a trend.
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.006794654s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
69720
over 280.006794654s
mean rate
249
/s
std
1293.83
/s
p5
0
/s
p95
0
/s
peak
6971.92
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004409
s
SD
4.4e-05
s
p50
0.004407
s
≤
p95
0.004407
s
<
p99
0.004646
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003667
s
SD
0.000493
s
p50
0.003511
s
<
p95
0.004776
s
≤
p99
0.004776
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.0021
s
SD
0.000666
s
p50
0.001829
s
<
p95
0.003747
s
≤
p99
0.003747
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001153
s
SD
1.7e-05
s
p50
0.001152
s
≤
p95
0.001152
s
<
p99
0.001246
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000439
s
SD
9.5e-05
s
p50
0.000405
s
<
p95
0.000531
s
≤
p99
0.000531
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00197
s
SD
8e-06
s
p50
0.00197
s
≤
p95
0.00197
s
<
p99
0.002016
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000358
s
SD
0.000117
s
p50
0.000342
s
<
p95
0.00054
s
≤
p99
0.00054
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.94
s
<
mean
147.94
s
SD
83.67
s
<
p95
277.95
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
119
over 280.00679186s
mean rate
0.42
/s
std
2.21
/s
p5
0
/s
p95
0
/s
peak
11.9
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.010899
s
SD
0.004416
s
p50
0.010653
s
≤
p95
0.010653
s
<
p99
0.034857
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001097
s
SD
2.4e-05
s
p50
0.001096
s
≤
p95
0.001096
s
<
p99
0.001227
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.0029
s
SD
1.4e-05
s
p50
0.002901
s
≤
p95
0.002901
s
≤
p99
0.002901
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.028104
s
SD
0.001593
s
p50
0.028194
s
≤
p95
0.028194
s
≤
p99
0.028194
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.002479
s
SD
6e-05
s
p50
0.002477
s
<
p95
0.002504
s
≤
p99
0.002504
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001126
s
SD
1.4e-05
s
p50
0.001127
s
≤
p95
0.001127
s
≤
p99
0.001127
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000673
s
SD
3.4e-05
s
p50
0.000671
s
≤
p95
0.000671
s
<
p99
0.000858
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000303
s
SD
0.000125
s
p50
0.000335
s
<
p95
0.000667
s
<
p99
0.000698
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
8.4e-05
s
SD
0
s
p50
8.4e-05
s
≤
p95
8.4e-05
s
<
p99
8.6e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000163
s
SD
2.3e-05
s
p50
0.000163
s
<
p95
0.000169
s
<
p99
0.00029
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000148
s
SD
2e-06
s
p50
0.000148
s
≤
p95
0.000148
s
<
p99
0.000159
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000113
s
SD
0
s
p50
0.000113
s
≤
p95
0.000113
s
≤
p99
0.000113
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000155
s
SD
1.1e-05
s
p50
0.000155
s
<
p95
0.000186
s
<
p99
0.000207
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000279
s
SD
0.000729
s
p50
0.000388
s
<
p95
0.002801
s
≤
p99
0.002801
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000457
s
SD
1.3e-05
s
p50
0.000457
s
≤
p95
0.000457
s
<
p99
0.00053
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
28.81
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
873
B/s
<
mean
3.68
KiB/s
SD
7.25
KiB/s
<
p95
5.03
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
37
B/s
<
mean
1.03
KiB/s
SD
2.75
KiB/s
<
p95
1.38
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.04
MiB
mean
3.68
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
299.77
KiB
mean
1.03
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 38.51 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
49.04
%
<
mean
49.91
%
SD
1.05
%
<
p95
50.37
%
System
21.09
%
CPU percentiles
CPU usage percentiles
p50
49.76
%
p95
50.37
%
p99
55.10
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
30.88
%
<
mean
31.34
%
SD
0.76
%
<
p95
31.84
%
Memory available percentage
Percentage of available memory
p5
68.16
%
<
mean
68.66
%
SD
0.76
%
<
p95
69.12
%
Max host memory used
Maximum memory usage percentage across all hosts
max
31.34
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
38.51
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
3.48
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.11
5 min
0.98
15 min
0.39
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
15.25
%
<
mean
30.2143
%
SD
5.8677
%
<
p95
32.27
%
60 second average
24.9673
%
300 second average
11.5913
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
34.8
%
<
mean
35.65
%
SD
2.25
%
≤
p95
35.6
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
299.34
KiB
≤
mean
294.26
KiB
SD
27.68
KiB
<
p95
299.71
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
≤
mean
12.97
threads
SD
0.18
threads
<
p95
13
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
55
file descriptors
<
mean
71.73
file descriptors
SD
32.1
file descriptors
<
p95
139
file descriptors

Full-Arc Create (Validated) / Zero-Arc Read

↑ Back to index

A full-arc/zero-arc mixed scenario where full-arc nodes create data that gets validated and zero-arc nodes read the data. The scenario has two roles:

  • full: A full-arc conductor that creates entries with a timestamp field. Those entries get validated and then retrieved by zero-arc nodes.
  • zero: A zero-arc conductor that reads the entries created by the full-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
Started
Thu, 18 Jun 2026 05:04:37 UTC
Peer count
30
Peer count at end
25
Behaviours
  • full (1 agent)
  • zero (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
full_arc_create_validated_zero_arc_read--high_zero_27730453039_1
Create rate
The number of timed entries created by the full-arc node(s) per second.
Mean
mean
83.52
/s
Max
Highest per-partition mean rate
max
90.83
/s
Min
Lowest per-partition mean rate
min
76.21
/s
Fetch lag timing
For each entry, the time lag between when it was created by a full-arc node and when a zero-arc node fetched it from the network.
Mean
mean
121.401255
s
SD
28.407692
s
Max
Highest per-partition mean latency
max mean
1174.115175
s
Min
Lowest per-partition mean latency
min mean
18.998918
s
Fetch rate
The number of entries per second fetched by zero-arc nodes.
Mean
mean
288.57
/s
Max
Highest per-partition mean rate
max
915.5
/s
Min
Lowest per-partition mean rate
min
0
/s
Delivery ratio
The proportion of created entries successfully fetched by all zero-arc nodes.
0.1388
Entry created count
Total number of entries created by full-arc nodes, by agent.
Total
14999
Agents affected
2 / 2
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
7500
Max
Highest count in any single partition
8136
Min
Lowest count in any single partition
6863
Received count
Total number of entries fetched by zero-arc nodes, by agent.
Total
49981
Agents affected
13 / 24
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
2083
Max
Highest count in any single partition
9922
Min
Lowest count in any single partition
0
Open connections
The number of currently open connections to other conductors.
full-arc
p5
22
<
mean
22.58
SD
2.26
<
p95
23
zero-arc
p5
0
<
mean
5.16
SD
7.12
<
p95
20
Retrieval errors
Errors encountered by zero-arc nodes when attempting to retrieve entries created by full-arc nodes.
Total
251
Agents affected
22 / 24
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
10
Max
Highest count in any single partition
14
Min
Lowest count in any single partition
0
Error count
The number of errors accumulated across all nodes.
251
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.012587
s
SD
0.02021
s
p50
0.008921
s
<
p95
0.052837
s
<
p99
0.102269
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
5
over 902.963385168s
mean rate
10.94
/s
std
75.95
/s
p5
0
/s
p95
34.92
/s
peak
896.89
/s
Zome call duration: 'timed_and_validated::create_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.00566
s
SD
0.000729
s
p50
0.005495
s
<
p95
0.006435
s
<
p99
0.00649
s
Zome call duration: 'timed_and_validated::get_timed_entries_network'
Duration of this zome call as measured by Holochain internally.
mean
0.050846
s
SD
61.497786
s
p50
53.466215
s
<
p95
157.540608
s
<
p99
321.816067
s
WASM call duration: 'timed_and_validated::create_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004994
s
SD
0.000679
s
p50
0.004882
s
<
p95
0.005725
s
<
p99
0.005778
s
WASM call duration: 'timed_and_validated::get_timed_entries_network'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.078602
s
SD
90.295596
s
p50
60.92472
s
<
p95
249.887272
s
<
p99
466.989076
s
WASM call duration: 'timed_and_validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000873
s
SD
0.000422
s
p50
0.001184
s
<
p95
0.002345
s
<
p99
0.002499
s
WASM call duration: 'timed_and_validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00453
s
SD
0.001446
s
p50
0.000836
s
<
p95
0.005246
s
<
p99
0.007737
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000297
s
SD
5.9e-05
s
p50
0.000296
s
<
p95
0.000373
s
<
p99
0.000375
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000291
s
SD
5.9e-05
s
p50
0.000283
s
<
p95
0.000371
s
<
p99
0.000372
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.028935
s
SD
0.0408
s
p50
0.03415
s
<
p95
0.123917
s
<
p99
0.182355
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.002837
s
SD
1.92438
s
p50
0.750212
s
<
p95
5.284806
s
<
p99
9.847013
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.009628
s
SD
0.003182
s
p50
0.00861
s
<
p95
0.012693
s
<
p99
0.013186
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001503
s
SD
0.000763
s
p50
0.002041
s
<
p95
0.003672
s
<
p99
0.004521
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000226
s
SD
0.000191
s
p50
0.000139
s
<
p95
0.00037
s
<
p99
0.001096
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.8
s
<
mean
452.95
s
SD
260.06
s
<
p95
857.9
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
13.23402
s
SD
3.877774
s
p50
0.09424
s
<
p95
7.538989
s
<
p99
23.57509
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.453356
s
SD
0.121737
s
p50
1
s
<
p95
1.440146
s
<
p99
1.492906
s
App validation workflow duration
Time spent running the app validation workflow.
mean
5.852344
s
SD
2.802019
s
p50
0.000844
s
<
p95
5.182442
s
<
p99
15.419599
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001399
s
SD
0.001308
s
p50
0.000824
s
<
p95
0.004583
s
<
p99
0.005064
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.013932
s
SD
0.003685
s
p50
0.000774
s
<
p95
0.009549
s
<
p99
0.02256
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.095584
s
SD
0.024447
s
p50
0.002022
s
<
p95
0.073841
s
<
p99
0.124239
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.049735
s
SD
0.016048
s
p50
0.001296
s
<
p95
0.032476
s
<
p99
0.094741
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.75902
s
SD
0.255091
s
p50
0.000973
s
<
p95
0.510385
s
<
p99
1.577787
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.007218
s
SD
0.013785
s
p50
0.008002
s
<
p95
0.038815
s
<
p99
0.066529
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.007829
s
SD
0.013394
s
p50
0.006034
s
<
p95
0.037428
s
<
p99
0.061521
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
8.4e-05
s
SD
4.8e-05
s
p50
0.000128
s
<
p95
0.000246
s
<
p99
0.000261
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.0104
s
SD
0.014051
s
p50
0.006681
s
<
p95
0.039594
s
<
p99
0.066715
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000148
s
SD
0.000162
s
p50
0.0001
s
<
p95
0.000606
s
<
p99
0.000762
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000142
s
SD
0.000164
s
p50
0.00017
s
<
p95
0.000677
s
<
p99
0.000832
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.003157
s
SD
0.200557
s
p50
0.00033
s
<
p95
0.407388
s
<
p99
0.833841
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000166
s
SD
0.000232
s
p50
0.000381
s
<
p95
0.000929
s
<
p99
0.001193
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.059796
s
SD
27.084471
s
p50
0.06351
s
<
p95
60.00159
s
<
p99
60.001728
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.388473
s
SD
4.111257
s
p50
0.30981
s
<
p95
1.438837
s
<
p99
9.947541
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
2.866572
s
SD
28.481859
s
p50
2.134622
s
<
p95
60.001356
s
<
p99
60.00139
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
40.21
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
75
B/s
<
mean
154.65
KiB/s
SD
431.99
KiB/s
<
p95
748.16
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
23
B/s
<
mean
187.73
KiB/s
SD
632.82
KiB/s
<
p95
1.78
MiB/s
Total bytes received
Total bytes received on primary network interface
count
3.45
GiB
mean
3.80
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
4.19
GiB
mean
4.62
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 99.3%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 373.29 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 4% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
4.91
%
<
mean
45.03
%
SD
31.26
%
<
p95
98.6
%
System
4.82
%
CPU percentiles
CPU usage percentiles
p50
37.32
%
p95
98.60
%
p99
99.35
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
14
hosts
mean time
0.40
s
Memory used percentage
Percentage of memory used
p5
7.92
%
<
mean
17.87
%
SD
14.07
%
<
p95
40.93
%
Memory available percentage
Percentage of available memory
p5
59.07
%
<
mean
82.13
%
SD
14.07
%
<
p95
92.08
%
Max host memory used
Maximum memory usage percentage across all hosts
max
79.06
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.14
%
Memory growth rate
Rate of memory growth over time
growth
373.29
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.07
MiB/s
Disk write throughput
Disk write throughput in MiB/s
81.66
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/8
hosts
Mount Point /efi-boot
0/6
hosts
Mount Point /etc/hostname
0/7
hosts
Mount Point /etc/hosts
0/7
hosts
Mount Point /etc/resolv.conf
0/7
hosts
Mount Point /nix/store
0/8
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.45
5 min
1.93
15 min
1.51
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
3.85
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
9.4222
%
SD
20.4831
%
<
p95
74.56
%
60 second average
8.5248
%
300 second average
5.5456
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
6.4758
%
SD
12.9723
%
<
p95
37.75
%
60 second average
6.5646
%
300 second average
6.4124
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
5.1641
%
SD
11.1356
%
<
p95
31.97
%
60 second average
5.3282
%
300 second average
5.4398
%
Holochain process CPU usage
CPU usage by Holochain process
p5
3.19
%
<
mean
43.53
%
SD
31.39
%
<
p95
95.58
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
445.70
KiB
<
mean
555.45
KiB
SD
91.58
KiB
<
p95
691.98
KiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
<
mean
18.66
threads
SD
6.62
threads
<
p95
33
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
55
file descriptors
<
mean
68.75
file descriptors
SD
15.26
file descriptors
<
p95
95
file descriptors

Local Signals

↑ Back to index

This scenario is for testing the speed and reliability of local signals. It uses a zome with a function that will emit 10,000 signals. The scenario measures how long it takes to send the signals and how many have been received by the time the zome call ends.

Started
Thu, 18 Jun 2026 01:23:24 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
local_signals_27730453039_1
Send timing
The time taken to emit a batch of 10,000 signals.
mean
1.060846
s
SD
0.52798
s
p50
1.016258
s
<
p95
1.899786
s
≤
p99
1.899786
s
Receive timing
The time taken to receive the completed batch, to the nearest 250ms.
mean
28.514673
s
SD
4.459661
s
p50
30.001087
s
<
p95
30.002015
s
≤
p99
30.002015
s
Success ratio
The proportion of signals successfully received in a batch.
min
0.836899995803833
<
mean
0.9483
SD
0.0411
<
max
0.9860000014305116
Holochain MetricsClick to toggle visibility.
WASM usage: 'signal::emit_10k_signals'
Metered usage count of the WASM ribosome for this zome function.
total
301963473
over 280.00333089s
mean rate
1.07842942e+06
/s
std
1.56692162e+06
/s
p5
0
/s
p95
3.35514443e+06
/s
peak
3.3551454e+06
/s
Zome call duration: 'signal::emit_10k_signals'
Duration of this zome call as measured by Holochain internally.
mean
0.156466
s
SD
0.003078
s
p50
0.156139
s
<
p95
0.165613
s
≤
p99
0.165613
s
WASM call duration: 'signal::emit_10k_signals'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.155432
s
SD
0.003258
s
p50
0.155047
s
<
p95
0.165138
s
≤
p99
0.165138
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
1.2e-05
s
SD
0
s
p50
1.2e-05
s
<
p95
1.3e-05
s
≤
p99
1.3e-05
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
90000
over 280.003423085s
mean rate
321.42
/s
std
467.02
/s
p5
0
/s
p95
999.99
/s
peak
999.99
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000137
s
SD
0
s
p50
0.000137
s
≤
p95
0.000137
s
≤
p99
0.000137
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.55
s
<
mean
148.55
s
SD
83.67
s
<
p95
278.55
s
Dropped WebSocket signals
Count of signals dropped from the app WebSocket due to channel overload.
total
753
over 280.003344453s
mean rate
2.69
/s
std
7.99
/s
p5
0
/s
p95
13.8
/s
peak
41.5
/s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.003359936s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.043053
s
SD
0
s
p50
0.043053
s
≤
p95
0.043053
s
≤
p99
0.043053
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000462
s
SD
0
s
p50
0.000462
s
≤
p95
0.000462
s
≤
p99
0.000462
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001487
s
SD
0
s
p50
0.001487
s
≤
p95
0.001487
s
≤
p99
0.001487
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001162
s
SD
0
s
p50
0.001162
s
≤
p95
0.001162
s
≤
p99
0.001162
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001341
s
SD
4.1e-05
s
p50
0.001355
s
<
p95
0.001412
s
≤
p99
0.001412
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000914
s
SD
0
s
p50
0.000914
s
≤
p95
0.000914
s
≤
p99
0.000914
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000481
s
SD
0
s
p50
0.000481
s
≤
p95
0.000481
s
≤
p99
0.000481
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000242
s
SD
2.4e-05
s
p50
0.00024
s
<
p95
0.000258
s
<
p99
0.000261
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
2.8e-05
s
SD
0
s
p50
2.8e-05
s
≤
p95
2.8e-05
s
≤
p99
2.8e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000122
s
SD
2.1e-05
s
p50
0.000115
s
<
p95
0.000146
s
<
p99
0.000153
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000101
s
SD
0
s
p50
0.000101
s
≤
p95
0.000101
s
≤
p99
0.000101
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.1e-05
s
SD
0
s
p50
8.1e-05
s
≤
p95
8.1e-05
s
≤
p99
8.1e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000166
s
SD
3.2e-05
s
p50
0.000168
s
<
p95
0.000183
s
<
p99
0.000184
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000134
s
SD
0.006812
s
p50
0.000269
s
<
p95
0.017242
s
≤
p99
0.017242
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000257
s
SD
0
s
p50
0.000257
s
≤
p95
0.000257
s
≤
p99
0.000257
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
1.22
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
53
B/s
<
mean
1.71
KiB/s
SD
1.90
KiB/s
<
p95
4.57
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
21
B/s
<
mean
415
B/s
SD
394
B/s
<
p95
1.11
KiB/s
Total bytes received
Total bytes received on primary network interface
count
495.81
KiB
mean
1.71
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
117.58
KiB
mean
415
B/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 839.49 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.98
%
<
mean
3.69
%
SD
4.16
%
<
p95
13.3
%
System
2.47
%
CPU percentiles
CPU usage percentiles
p50
1.18
%
p95
13.30
%
p99
13.55
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
6.07
%
<
mean
7.89
%
SD
2.2
%
<
p95
12.87
%
Memory available percentage
Percentage of available memory
p5
87.13
%
<
mean
92.11
%
SD
2.2
%
<
p95
93.93
%
Max host memory used
Maximum memory usage percentage across all hosts
max
7.89
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
839.49
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
0.79
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.39
5 min
0.22
15 min
0.13
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.12
%
<
mean
1.571
%
SD
1.6595
%
<
p95
5.58
%
60 second average
1.1740
%
300 second average
0.4887
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0143
%
SD
0.0544
%
<
p95
0.1
%
60 second average
0.0083
%
300 second average
0.0007
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0143
%
SD
0.0544
%
<
p95
0.1
%
60 second average
0.0083
%
300 second average
0.0007
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.18
%
<
mean
0.37
%
SD
0.22
%
<
p95
0.75
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
242.56
KiB
<
mean
246.08
KiB
SD
1.50
KiB
<
p95
247.24
KiB
Holochain process threads
Number of threads in Holochain process
p5
14
threads
≤
mean
14
threads
SD
0
threads
≤
p95
14
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
47
file descriptors
<
mean
50.8
file descriptors
SD
7.6
file descriptors
<
p95
66
file descriptors

Mixed Arc get_agent_activity

↑ Back to index

A mixed-arc scenario that measures the DHT's ability to propagate agent activity and make it available via get_agent_activity calls. The scenario has three roles:

  • zero_write: A zero-arc conductor that creates entries on its source chain.
  • full_write: A full-arc conductor that creates entries on its source chain.
  • zero_read: A zero-arc conductor that picks a random writer and repeatedly calls get_agent_activity to observe new entries appearing on the writer's chain, measuring the lag between creation and discovery.
Started
Thu, 18 Jun 2026 05:20:17 UTC
Peer count
30
Peer count at end
25
Behaviours
  • full_write (1 agent)
  • zero_read (1 agent)
  • zero_write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
mixed_arc_get_agent_activity_27730453039_1
Entry created count
The total number of entries created by write agents over the run, partitioned by agent and behaviour.
Total
316236
Agents affected
18 / 18
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
17569
Max
Highest count in any single partition
34471
Min
Lowest count in any single partition
1704
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
4484.67
Max
Highest chain head value observed for any single write agent.
9199
Write agents observed
3
Chain head delay timing
The time lag between when a writer creates a new entry and when a reader discovers it via get_agent_activity. This is measured per new action in the chain.
Mean
mean
0.008513
s
SD
0.665695
s
Max
Highest per-partition mean latency
max mean
0.02961
s
Min
Lowest per-partition mean latency
min mean
-0.005381
s
Chain head delay rate
The rate at which readers detect new chain heads appearing on writers' chains.
Mean
mean
47.18
/s
Max
Highest per-partition mean rate
max
94.27
/s
Min
Lowest per-partition mean rate
min
32.36
/s
get_agent_activity_full zome call timing
The time taken to complete the get_agent_activity_full zome call that queries a writer's chain.
Mean
mean
0.153931
s
SD
0.447311
s
Max
Highest per-partition mean latency
max mean
0.221585
s
Min
Lowest per-partition mean latency
min mean
0.056363
s
Retrieval errors
A running accumulation of errors encountered by read agents when calling get_agent_activity.
Total
26
Agents affected
7 / 7
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
4
Max
Highest count in any single partition
9
Min
Lowest count in any single partition
1
Open connections
The number of currently open connections to other conductors, partitioned by agent behaviour.
  • behaviour: full_write
p5
0
<
mean
21.46
SD
6.48
<
p95
24
  • behaviour: zero_read
p5
0
<
mean
10.28
SD
5.49
<
p95
16
  • behaviour: zero_write
p5
7
<
mean
14.78
SD
4.39
<
p95
22
Final error count
The total number of errors accumulated across all agents over the run.
28
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000281
s
SD
0.000251
s
p50
0.000707
s
<
p95
0.000934
s
≤
p99
0.000934
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
16
over 1696.500773219s
mean rate
1.3
/s
std
2.17
/s
p5
0
/s
p95
6.44
/s
peak
9.95
/s
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 1894.288689147s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
111425927
over 1894.288689147s
mean rate
2.7846274343e+09
/s
std
4.66154022884e+09
/s
p5
29622.97
/s
p95
1.41383201082e+10
/s
peak
2.02312578709e+10
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
1505185973
over 915.520059342s
mean rate
1.10230936624e+09
/s
std
1.52270578066e+09
/s
p5
1.16300508e+07
/s
p95
5.27296427245e+09
/s
peak
5.99856713571e+09
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
11367255200
over 37458.1855845s
mean rate
9.079009149e+07
/s
std
1.3958559424e+08
/s
p5
4.22085164e+06
/s
p95
3.6910337207e+08
/s
peak
3.7053145163e+08
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
757224786
over 37459.133426276s
mean rate
4.5318866965e+08
/s
std
1.06555139591e+09
/s
p5
0
/s
p95
2.11092896503e+09
/s
peak
7.68482186584e+09
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.008287
s
SD
0.003039
s
p50
0.007419
s
<
p95
0.014502
s
≤
p99
0.014502
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004099
s
SD
0.002095
s
p50
0.004866
s
<
p95
0.009032
s
<
p99
0.009976
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.117747
s
SD
0.055552
s
p50
0.131328
s
<
p95
0.202661
s
<
p99
0.217591
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.003728
s
SD
0.055174
s
p50
0.036876
s
<
p95
0.150207
s
≤
p99
0.150207
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006906
s
SD
0.002554
s
p50
0.006015
s
<
p95
0.012452
s
≤
p99
0.012452
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003359
s
SD
0.001764
s
p50
0.003993
s
<
p95
0.007482
s
<
p99
0.008263
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.146349
s
SD
0.053304
s
p50
0.148009
s
<
p95
0.232319
s
<
p99
0.2342
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00313
s
SD
0.054777
s
p50
0.036093
s
<
p95
0.148493
s
≤
p99
0.148493
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001001
s
SD
0.000625
s
p50
0.001193
s
<
p95
0.002825
s
<
p99
0.002852
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
6.5e-05
s
SD
7.6e-05
s
p50
4.1e-05
s
<
p95
0.000374
s
≤
p99
0.000374
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000342
s
SD
0.000272
s
p50
0.000407
s
<
p95
0.00102
s
<
p99
0.001047
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000637
s
SD
0.000266
s
p50
0.000607
s
<
p95
0.001273
s
≤
p99
0.001273
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.143087
s
SD
0.052614
s
p50
0.145135
s
<
p95
0.227333
s
<
p99
0.229487
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.00077
s
SD
0.052834
s
p50
0.03326
s
<
p95
0.140558
s
≤
p99
0.140558
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
8e-06
s
p50
1.2e-05
s
<
p95
2.9e-05
s
≤
p99
2.9e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001662
s
SD
0.001319
s
p50
0.002395
s
<
p95
0.004969
s
<
p99
0.007227
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000233
s
SD
0.000175
s
p50
0.000214
s
<
p95
0.000608
s
<
p99
0.000648
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.64
s
<
mean
450.99
s
SD
258.98
s
<
p95
856.65
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 37459.133503181s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
26.435576
s
SD
13.745928
s
p50
0.123715
s
<
p95
21.9005
s
<
p99
73.910398
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.529088
s
SD
0.241941
s
p50
1
s
<
p95
1.609045
s
<
p99
1.670368
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.227571
s
SD
2.212384
s
p50
0.001309
s
<
p95
4.212687
s
<
p99
15.501314
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001283
s
SD
0.001243
s
p50
0.000716
s
<
p95
0.004512
s
<
p99
0.004642
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.004911
s
SD
0.014236
s
p50
0.000608
s
<
p95
0.04299
s
<
p99
0.057924
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.097034
s
SD
4.504237
s
p50
0.066241
s
<
p95
12.313971
s
<
p99
16.451449
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.432966
s
SD
8.581866
s
p50
0.001508
s
<
p95
7.212552
s
<
p99
56.27487
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.172519
s
SD
2.598271
s
p50
0.000891
s
<
p95
3.522456
s
<
p99
20.705908
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.002064
s
SD
0.002472
s
p50
0.00122
s
<
p95
0.009196
s
<
p99
0.010497
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001643
s
SD
0.001703
s
p50
0.000187
s
<
p95
0.00507
s
<
p99
0.008128
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000138
s
SD
0.000109
s
p50
0.000185
s
<
p95
0.000413
s
<
p99
0.000525
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000141
s
SD
0.000189
s
p50
0.000163
s
<
p95
0.000675
s
<
p99
0.000757
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000258
s
SD
0.000589
s
p50
9.6e-05
s
<
p95
0.001356
s
<
p99
0.002993
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000117
s
SD
8.2e-05
s
p50
0.000127
s
<
p95
0.00028
s
<
p99
0.0003
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002128
s
SD
0.011261
s
p50
0.000406
s
<
p95
0.024535
s
<
p99
0.047615
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000308
s
SD
0.000173
s
p50
0.000361
s
<
p95
0.000699
s
<
p99
0.000787
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
6.75154
s
SD
27.780155
s
p50
1.669192
s
<
p95
60.00178
s
<
p99
60.006186
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.027066
s
SD
0.045258
s
p50
0.104265
s
<
p95
0.132138
s
≤
p99
0.132138
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.202199
s
SD
27.768917
s
p50
0.154675
s
<
p95
60.001383
s
<
p99
60.001422
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.388065
s
SD
16.76157
s
p50
0.379783
s
<
p95
60.000803
s
<
p99
60.000875
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
24.14
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
85
B/s
<
mean
282.70
KiB/s
SD
475.42
KiB/s
<
p95
1.14
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
31
B/s
<
mean
398.62
KiB/s
SD
708.54
KiB/s
<
p95
1.99
MiB/s
Total bytes received
Total bytes received on primary network interface
count
6.57
GiB
mean
7.01
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
9.26
GiB
mean
9.88
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 96.3%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 472.79 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 26% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.13
%
<
mean
29.8
%
SD
28.42
%
<
p95
93.24
%
System
5.66
%
CPU percentiles
CPU usage percentiles
p50
24.04
%
p95
93.24
%
p99
96.31
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
7
hosts
mean time
0.43
s
Memory used percentage
Percentage of memory used
p5
5.99
%
<
mean
14.72
%
SD
13.46
%
<
p95
32.44
%
Memory available percentage
Percentage of available memory
p5
67.56
%
<
mean
85.28
%
SD
13.46
%
<
p95
94.01
%
Max host memory used
Maximum memory usage percentage across all hosts
max
76.27
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.14
%
Memory growth rate
Rate of memory growth over time
growth
472.79
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.08
MiB/s
Disk write throughput
Disk write throughput in MiB/s
148.04
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/8
hosts
Mount Point /efi-boot
0/7
hosts
Mount Point /etc/hostname
0/8
hosts
Mount Point /etc/hosts
0/8
hosts
Mount Point /etc/resolv.conf
0/8
hosts
Mount Point /nix/store
0/8
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.31
5 min
2.44
15 min
2.14
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
25.93
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
7.012
%
SD
12.5159
%
<
p95
34.44
%
60 second average
7.2608
%
300 second average
8.5588
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
7.377
%
SD
15.1467
%
<
p95
41.41
%
60 second average
7.2194
%
300 second average
6.6372
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
5.8507
%
SD
12.7159
%
<
p95
32.63
%
60 second average
5.7279
%
300 second average
5.1680
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.2
%
<
mean
26.89
%
SD
27.64
%
<
p95
90.68
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
205.89
KiB
<
mean
296.70
KiB
SD
115.55
KiB
<
p95
543.87
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
21.31
threads
SD
10.91
threads
<
p95
47
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
46
file descriptors
<
mean
65.88
file descriptors
SD
20.15
file descriptors
<
p95
106
file descriptors

Mixed Arc must_get_agent_activity

↑ Back to index

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Write Validated must_get_agent_activity, but some write agents are zero-arc and all must_get_agent_activity agents are zero-arc. This forces the must_get_agent_activity host call to go to the network.

Started
Thu, 18 Jun 2026 05:36:06 UTC
Peer count
30
Peer count at end
25
Behaviours
  • full_write (1 agent)
  • zero_must_get_agent_activity (1 agent)
  • zero_write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
mixed_arc_must_get_agent_activity_27730453039_1
Highest observed action_seq
The maximum chain length observed per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1864
Max
Highest chain head value observed for any single write agent.
1875
Write agents observed
2
Chain batch delay timing
The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.
Mean
mean
131.168246
s
SD
4.994711
s
Max
Highest per-partition mean latency
max mean
1013.758595
s
Min
Lowest per-partition mean latency
min mean
3.197529
s
Chain batch delay rate
The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.
Mean
mean
1.99
/s
Max
Highest per-partition mean rate
max
2.11
/s
Min
Lowest per-partition mean rate
min
1.89
/s
create_validated_sample_entry zome call timing
The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.
Mean
mean
0.561747
s
SD
0.558057
s
Max
Highest per-partition mean latency
max mean
2.096969
s
Min
Lowest per-partition mean latency
min mean
0.220704
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.
Total
4975
Agents affected
8 / 8
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
622
Max
Highest count in any single partition
783
Min
Lowest count in any single partition
117
Open connections
The average number of open connections maintained by an agent over the run, broken down by behaviour.
  • behaviour: full_write
p5
21
<
mean
24.44
SD
1.5
<
p95
25
  • behaviour: zero_must_get_agent_activity
p5
0
<
mean
15.79
SD
6.38
<
p95
22
  • behaviour: zero_write
p5
10
<
mean
15.22
SD
3.79
<
p95
21
Final error count
The total number of all types of error accumulated over the run by all agents.
21324
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000848
s
SD
0.000312
s
p50
0.000705
s
<
p95
0.00137
s
<
p99
0.001768
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 460.005028134s
Not enough time data to show a trend.
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.009498
s
SD
0.002564
s
p50
0.009675
s
<
p95
0.014893
s
≤
p99
0.014893
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.067155
s
SD
0.01846
s
p50
0.061084
s
<
p95
0.10345
s
<
p99
0.128631
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.007214
s
SD
0.001498
s
p50
0.006648
s
<
p95
0.010251
s
<
p99
0.010319
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.169257
s
SD
0.044646
s
p50
0.166235
s
<
p95
0.211778
s
<
p99
0.268184
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.040024
s
SD
0.085369
s
p50
0.180246
s
<
p95
0.280738
s
≤
p99
0.280738
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00795
s
SD
0.002155
s
p50
0.008153
s
<
p95
0.012322
s
≤
p99
0.012322
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.06586
s
SD
0.018202
s
p50
0.059839
s
<
p95
0.10123
s
<
p99
0.126497
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005962
s
SD
0.001206
s
p50
0.005564
s
<
p95
0.00826
s
<
p99
0.008323
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.185596
s
SD
0.06819
s
p50
0.236743
s
<
p95
0.299642
s
<
p99
0.325193
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.039283
s
SD
0.085247
s
p50
0.17941
s
<
p95
0.279975
s
≤
p99
0.279975
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001337
s
SD
0.000592
s
p50
0.001307
s
<
p95
0.002517
s
<
p99
0.003309
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006732
s
SD
0.034414
s
p50
0.00336
s
<
p95
0.088021
s
<
p99
0.147648
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.6e-05
s
SD
6.1e-05
s
p50
4e-05
s
<
p95
9.5e-05
s
<
p99
0.000402
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000498
s
SD
0.00014
s
p50
0.000492
s
<
p95
0.000843
s
<
p99
0.000899
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.00049
s
SD
0.000234
s
p50
0.000552
s
<
p95
0.001004
s
<
p99
0.001264
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.17531
s
SD
0.083031
s
p50
0.193583
s
<
p95
0.279169
s
<
p99
0.310689
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.250151
s
SD
0.105603
s
p50
0.190807
s
<
p95
0.422427
s
<
p99
0.624821
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.008129
s
SD
0.004265
s
p50
0.005952
s
<
p95
0.013636
s
<
p99
0.023062
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1e-05
s
SD
6e-06
s
p50
1.2e-05
s
<
p95
3e-05
s
≤
p99
3e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002223
s
SD
0.001099
s
p50
0.002907
s
<
p95
0.005192
s
<
p99
0.006478
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000277
s
SD
0.000193
s
p50
0.000199
s
<
p95
0.00065
s
<
p99
0.001134
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.86
s
<
mean
454.59
s
SD
261.06
s
<
p95
858.56
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
4
over 37459.129158788s
mean rate
64911.74
/s
std
170677.48
/s
p5
0
/s
p95
449300.03
/s
peak
1.26652147e+06
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
25.259811
s
SD
26.967873
s
p50
0.116299
s
<
p95
74.906024
s
<
p99
133.589815
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.880266
s
SD
0.416056
s
p50
1
s
<
p95
1.896019
s
<
p99
1.901318
s
App validation workflow duration
Time spent running the app validation workflow.
mean
1.440541
s
SD
9.375616
s
p50
0.001652
s
<
p95
30.54237
s
<
p99
47.718256
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001293
s
SD
0.001536
s
p50
0.00073
s
<
p95
0.003292
s
<
p99
0.008252
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.014614
s
SD
0.011865
s
p50
0.000462
s
<
p95
0.0284
s
<
p99
0.064948
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.016416
s
SD
0.027979
s
p50
0.010616
s
<
p95
0.065462
s
<
p99
0.115515
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.294516
s
SD
0.295829
s
p50
0.001481
s
<
p95
0.606127
s
<
p99
1.549129
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
9.752066
s
SD
12.849366
s
p50
0.001213
s
<
p95
45.007867
s
<
p99
50.627797
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000415
s
SD
0.000218
s
p50
0.000335
s
<
p95
0.000798
s
<
p99
0.001283
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001103
s
SD
0.000702
s
p50
0.000305
s
<
p95
0.001782
s
<
p99
0.004321
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000195
s
SD
6.5e-05
s
p50
0.000188
s
<
p95
0.000306
s
<
p99
0.000457
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000242
s
SD
0.00029
s
p50
0.000125
s
<
p95
0.000849
s
<
p99
0.001317
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
9.8e-05
s
SD
5.5e-05
s
p50
8.4e-05
s
<
p95
0.000165
s
<
p99
0.000345
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000139
s
SD
5.8e-05
s
p50
0.00012
s
<
p95
0.000224
s
<
p99
0.000366
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00203
s
SD
0.354206
s
p50
0.00039
s
<
p95
0.430103
s
<
p99
1.385246
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000333
s
SD
0.000122
s
p50
0.000383
s
<
p95
0.000725
s
<
p99
0.00077
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.470652
s
SD
20.683969
s
p50
0.198384
s
<
p95
60.000953
s
<
p99
60.001159
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.152894
s
SD
8.253494
s
p50
0.144537
s
<
p95
0.274571
s
<
p99
60.001113
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
0.253543
s
SD
10.552071
s
p50
0.201944
s
<
p95
0.577171
s
<
p99
60.001433
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.595525
s
SD
22.78864
s
p50
0.536156
s
<
p95
60.001322
s
<
p99
60.001388
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
7.27
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
249
B/s
<
mean
95.81
KiB/s
SD
263.09
KiB/s
<
p95
248.38
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
52
B/s
<
mean
113.45
KiB/s
SD
258.08
KiB/s
<
p95
557.97
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.32
GiB
mean
2.50
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.74
GiB
mean
2.96
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 309.59 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.71
%
<
mean
9.77
%
SD
12.25
%
<
p95
34.94
%
System
2.50
%
CPU percentiles
CPU usage percentiles
p50
4.48
%
p95
34.94
%
p99
59.86
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
4
hosts
mean time
0.02
s
Memory used percentage
Percentage of memory used
p5
7.55
%
<
mean
15.36
%
SD
13.39
%
<
p95
32.74
%
Memory available percentage
Percentage of available memory
p5
67.26
%
<
mean
84.64
%
SD
13.39
%
<
p95
92.45
%
Max host memory used
Maximum memory usage percentage across all hosts
max
78.72
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.14
%
Memory growth rate
Rate of memory growth over time
growth
309.59
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.05
MiB/s
Disk write throughput
Disk write throughput in MiB/s
82.13
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/8
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/8
hosts
Mount Point /etc/hosts
0/8
hosts
Mount Point /etc/resolv.conf
0/8
hosts
Mount Point /nix/store
0/8
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.80
5 min
1.05
15 min
1.38
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
1.3937
%
SD
4.2499
%
<
p95
11.06
%
60 second average
1.5337
%
300 second average
2.4057
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
3.5767
%
SD
8.4786
%
<
p95
27.38
%
60 second average
3.7834
%
300 second average
4.6976
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
3.3282
%
SD
8.0654
%
<
p95
25.93
%
60 second average
3.4786
%
300 second average
4.0804
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.18
%
<
mean
8.33
%
SD
11.72
%
<
p95
31.98
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
402.20
KiB
<
mean
492.00
KiB
SD
67.02
KiB
<
p95
606.10
KiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
<
mean
23.44
threads
SD
13.75
threads
<
p95
52
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
47
file descriptors
<
mean
69.6
file descriptors
SD
16.83
file descriptors
<
p95
103
file descriptors

Remote Call Rate

↑ Back to index

Test the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

Started
Thu, 18 Jun 2026 01:25:10 UTC
Peer count
10
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
remote_call_rate_27730453039_1
Dispatch timing
The time between sending a remote call and the remote handler being invoked.
Mean
mean
0.053329
s
SD
0.077581
s
Max
Highest per-partition mean latency
max mean
0.07438
s
Min
Lowest per-partition mean latency
min mean
0.031734
s
Round-trip timing
The total elapsed time to get a response to the client.
Mean
mean
0.104369
s
SD
0.097843
s
Max
Highest per-partition mean latency
max mean
0.14588
s
Min
Lowest per-partition mean latency
min mean
0.06441
s
Error count
The total number of errors accumulated during the run.
2
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_call::call_echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
211775246
over 992.57813922s
mean rate
6.083675986e+07
/s
std
6.937090686e+07
/s
p5
492250.18
/s
p95
2.2691441833e+08
/s
peak
2.6567774583e+08
/s
WASM usage: 'remote_call::echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
55606824
over 992.57813922s
mean rate
4.643310346e+07
/s
std
8.896710295e+07
/s
p5
36004.65
/s
p95
2.6726165335e+08
/s
peak
3.2803513015e+08
/s
WASM usage: 'remote_call::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 33080.441678253s
Not enough time data to show a trend.
Zome call duration: 'remote_call::call_echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.09829
s
SD
0.066077
s
p50
0.105506
s
<
p95
0.159066
s
<
p99
0.181759
s
Zome call duration: 'remote_call::echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.004309
s
SD
0.000507
s
p50
0.004215
s
<
p95
0.004998
s
<
p99
0.00507
s
WASM call duration: 'remote_call::call_echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.096971
s
SD
0.066091
s
p50
0.103975
s
<
p95
0.157638
s
<
p99
0.180418
s
WASM call duration: 'remote_call::echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002832
s
SD
0.000394
s
p50
0.002715
s
<
p95
0.003367
s
<
p99
0.003421
s
WASM call duration: 'remote_call::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.0016
s
SD
0.000135
s
p50
0.001563
s
<
p95
0.001841
s
≤
p99
0.001841
s
Host function call duration: '__hc__call_1'
Duration of this host function call invoked from within WASM.
mean
0.093593
s
SD
0.065937
s
p50
0.100263
s
<
p95
0.154272
s
<
p99
0.1773
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000261
s
SD
6.8e-05
s
p50
0.000245
s
<
p95
0.000413
s
≤
p99
0.000413
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
2.2e-05
s
SD
5e-06
s
p50
2e-05
s
<
p95
3.6e-05
s
≤
p99
3.6e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.000492
s
SD
0.000146
s
p50
0.000385
s
<
p95
0.000631
s
<
p99
0.000634
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000277
s
SD
0.000264
s
p50
0.000137
s
<
p95
0.000936
s
≤
p99
0.000936
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.63
s
<
mean
450.33
s
SD
258.53
s
<
p95
856.28
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
1.759018
s
SD
1.237865
s
p50
1.544043
s
<
p95
4.66559
s
≤
p99
4.66559
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.924812
s
SD
0.29806
s
p50
1.942308
s
<
p95
1.971154
s
≤
p99
1.971154
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.099018
s
SD
0.232045
s
p50
0.082287
s
<
p95
0.721883
s
<
p99
0.908054
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001891
s
SD
0.00248
s
p50
0.000947
s
<
p95
0.008802
s
≤
p99
0.008802
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.003843
s
SD
0.003961
s
p50
0.001946
s
<
p95
0.012818
s
<
p99
0.019619
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001912
s
SD
0.001793
s
p50
0.001493
s
<
p95
0.00675
s
≤
p99
0.00675
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.264652
s
SD
0.168478
s
p50
0.249052
s
<
p95
0.559691
s
≤
p99
0.559691
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.309901
s
SD
0.556188
s
p50
0.195847
s
<
p95
1.820975
s
≤
p99
1.820975
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000286
s
SD
4.1e-05
s
p50
0.000292
s
<
p95
0.00034
s
<
p99
0.000342
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000123
s
SD
3.6e-05
s
p50
0.000115
s
<
p95
0.000169
s
<
p99
0.000224
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000275
s
SD
6.1e-05
s
p50
0.000267
s
<
p95
0.00032
s
≤
p99
0.00032
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000319
s
SD
0.000124
s
p50
0.000259
s
<
p95
0.000525
s
≤
p99
0.000525
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000158
s
SD
0.000176
s
p50
9.8e-05
s
<
p95
0.000649
s
≤
p99
0.000649
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000217
s
SD
5.8e-05
s
p50
0.000208
s
<
p95
0.000285
s
<
p99
0.000327
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.0005
s
SD
0.009125
s
p50
0.000632
s
<
p95
0.022174
s
<
p99
0.042676
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000517
s
SD
8.5e-05
s
p50
0.000531
s
<
p95
0.000603
s
<
p99
0.000606
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.076803
s
SD
0.044553
s
p50
0.054465
s
<
p95
0.129655
s
≤
p99
0.129655
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.107895
s
SD
0.042372
s
p50
0.10558
s
<
p95
0.176377
s
≤
p99
0.176377
s
P2P request roundtrip: 'call_remote'
Time spent sending a call_remote request and awaiting its response.
mean
0.092706
s
SD
0.065844
s
p50
0.099551
s
<
p95
0.153577
s
<
p99
0.176617
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
9.25
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.12
KiB/s
<
mean
93.19
KiB/s
SD
625.91
KiB/s
≤
p95
53.86
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
157
B/s
<
mean
29.18
KiB/s
SD
155.40
KiB/s
<
p95
35.83
KiB/s
Total bytes received
Total bytes received on primary network interface
count
750.77
MiB
mean
768.79
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
235.11
MiB
mean
240.75
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 869.08 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2.39
%
<
mean
13.84
%
SD
15.66
%
<
p95
47.18
%
System
4.59
%
CPU percentiles
CPU usage percentiles
p50
7.39
%
p95
47.18
%
p99
59.24
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.01
s
Memory used percentage
Percentage of memory used
p5
5.64
%
<
mean
11.55
%
SD
5.43
%
<
p95
20.11
%
Memory available percentage
Percentage of available memory
p5
79.89
%
<
mean
88.45
%
SD
5.43
%
<
p95
94.36
%
Max host memory used
Maximum memory usage percentage across all hosts
max
19.13
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
869.08
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.01
MiB/s
Disk write throughput
Disk write throughput in MiB/s
13.49
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/4
hosts
Mount Point /efi-boot
0/3
hosts
Mount Point /etc/hostname
0/1
hosts
Mount Point /etc/hosts
0/1
hosts
Mount Point /etc/resolv.conf
0/1
hosts
Mount Point /nix/store
0/4
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.70
5 min
0.47
15 min
0.24
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
1.6177
%
SD
4.234
%
<
p95
6
%
60 second average
1.4117
%
300 second average
0.9412
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
2.7724
%
SD
7.6519
%
<
p95
22.58
%
60 second average
2.3965
%
300 second average
1.5334
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
2.4803
%
SD
6.9235
%
<
p95
20.05
%
60 second average
2.1412
%
300 second average
1.3818
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.55
%
<
mean
7.68
%
SD
9.84
%
<
p95
17.85
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
193.85
KiB
<
mean
227.88
KiB
SD
75.37
KiB
<
p95
427.70
KiB
Holochain process threads
Number of threads in Holochain process
p5
12
threads
<
mean
17.83
threads
SD
5.63
threads
<
p95
31
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
42
file descriptors
<
mean
59.42
file descriptors
SD
45.95
file descriptors
<
p95
80
file descriptors

Remote Signals

↑ Back to index

This scenario tests the throughput of remote_signals operations.

Started
Thu, 18 Jun 2026 01:26:59 UTC
Peer count
10
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
remote_signals_27730453039_1
Round trip time
The time from origin signal dispatch to origin receive of the remote side's response signal.
mean
0.097138
s
SD
0.312637
s
p50
0.11673
s
<
p95
0.136846
s
<
p99
0.155434
s
Timeout rate
The proportion of remote signal round-trips that timed out.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_signal::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 900.128320004s
Not enough time data to show a trend.
WASM usage: 'remote_signal::recv_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
36794638
over 900.128320004s
mean rate
2.5346370844e+08
/s
std
1.41528083407e+09
/s
p5
0
/s
p95
1.06224627876e+09
/s
peak
1.97706586826e+10
/s
WASM usage: 'remote_signal::signal_request'
Metered usage count of the WASM ribosome for this zome function.
total
15574792
over 900.128320004s
mean rate
3.463029756e+07
/s
std
3.3643638188e+08
/s
p5
0
/s
p95
1.48427845e+06
/s
peak
6.84985618408e+09
/s
Zome call duration: 'remote_signal::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.003985
s
SD
0.001064
s
p50
0.004338
s
<
p95
0.005546
s
<
p99
0.005568
s
Zome call duration: 'remote_signal::signal_request'
Duration of this zome call as measured by Holochain internally.
mean
0.003999
s
SD
0.001117
s
p50
0.004356
s
<
p95
0.005584
s
<
p99
0.005689
s
WASM call duration: 'remote_signal::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002033
s
SD
0.000871
s
p50
0.001652
s
<
p95
0.004114
s
≤
p99
0.004114
s
WASM call duration: 'remote_signal::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002583
s
SD
0.000678
s
p50
0.002733
s
<
p95
0.003574
s
<
p99
0.003586
s
WASM call duration: 'remote_signal::signal_request'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002554
s
SD
0.000697
s
p50
0.002719
s
<
p95
0.003554
s
<
p99
0.003633
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000392
s
SD
0.000299
s
p50
0.000253
s
<
p95
0.001116
s
≤
p99
0.001116
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
8.8e-05
s
SD
1.5e-05
s
p50
9.2e-05
s
<
p95
0.000105
s
<
p99
0.000106
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
9.8e-05
s
SD
2.3e-05
s
p50
9.9e-05
s
<
p95
0.000128
s
<
p99
0.000133
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
1.7e-05
s
SD
8e-06
s
p50
1.8e-05
s
<
p95
2.9e-05
s
<
p99
3e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00034
s
SD
0.000203
s
p50
0.000339
s
<
p95
0.0007
s
≤
p99
0.0007
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
1732
over 900.12830733s
mean rate
28630.2
/s
std
146259.88
/s
p5
0
/s
p95
104536.9
/s
peak
2.299908e+06
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
1734
over 900.128308682s
mean rate
24199
/s
std
155830.29
/s
p5
0
/s
p95
70646.41
/s
peak
2.75229358e+06
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000659
s
SD
0.000963
s
p50
0.000159
s
<
p95
0.002881
s
≤
p99
0.002881
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.68
s
<
mean
451.41
s
SD
259.24
s
<
p95
856.54
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
87
over 900.12835694s
mean rate
11864.75
/s
std
79152.14
/s
p5
0
/s
p95
55307.55
/s
peak
1.58802178e+06
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
4.040817
s
SD
1.494611
s
p50
3.71835
s
<
p95
6.286517
s
<
p99
7.632283
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.961287
s
SD
0.096141
s
p50
1.953846
s
<
p95
2.007692
s
≤
p99
2.007692
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.214645
s
SD
0.656529
s
p50
0.170375
s
<
p95
1.869813
s
<
p99
2.737208
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.003645
s
SD
0.002994
s
p50
0.003541
s
<
p95
0.01168
s
≤
p99
0.01168
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.002056
s
SD
0.000961
s
p50
0.002325
s
<
p95
0.003958
s
≤
p99
0.003958
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.003165
s
SD
0.001604
s
p50
0.002972
s
<
p95
0.005495
s
<
p99
0.006369
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.523752
s
SD
0.512049
s
p50
0.464827
s
<
p95
1.592955
s
<
p99
1.819088
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.262151
s
SD
0.33877
s
p50
0.225392
s
<
p95
1.172858
s
<
p99
1.440784
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000272
s
SD
9.6e-05
s
p50
0.000284
s
<
p95
0.000371
s
<
p99
0.000398
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000161
s
SD
6.9e-05
s
p50
0.000155
s
<
p95
0.000294
s
<
p99
0.000369
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000252
s
SD
9.3e-05
s
p50
0.00027
s
<
p95
0.000349
s
<
p99
0.000532
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000535
s
SD
0.000495
s
p50
0.000586
s
<
p95
0.001157
s
<
p99
0.001955
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000224
s
SD
0.000186
s
p50
0.000151
s
<
p95
0.000668
s
≤
p99
0.000668
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000337
s
SD
0.000242
s
p50
0.000298
s
<
p95
0.000683
s
<
p99
0.001298
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000259
s
SD
0.010979
s
p50
0.000589
s
<
p95
0.032218
s
<
p99
0.036032
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000629
s
SD
0.000144
s
p50
0.00068
s
<
p95
0.000764
s
<
p99
0.000777
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.054087
s
SD
0.024281
s
p50
0.048999
s
<
p95
0.086191
s
<
p99
0.15059
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.07244
s
SD
0.027115
s
p50
0.074206
s
<
p95
0.127857
s
<
p99
0.157902
s
P2P received remote signals
Count of remote signals received.
total
1737
over 900.128389919s
mean rate
242288.22
/s
std
3.5187434e+06
/s
p5
0
/s
p95
253781.34
/s
peak
7.692307692e+07
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
5.49
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
7.13
KiB/s
<
mean
136.61
KiB/s
SD
757.29
KiB/s
≤
p95
57.51
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
8.25
KiB/s
<
mean
28.82
KiB/s
SD
97.95
KiB/s
<
p95
45.16
KiB/s
Total bytes received
Total bytes received on primary network interface
count
597.68
MiB
mean
672.56
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
126.09
MiB
mean
141.88
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1088.70 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.38
%
<
mean
7.94
%
SD
11.29
%
<
p95
19.75
%
System
2.46
%
CPU percentiles
CPU usage percentiles
p50
3.55
%
p95
19.75
%
p99
70.21
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.01
s
Memory used percentage
Percentage of memory used
p5
7.35
%
<
mean
19.21
%
SD
9.37
%
<
p95
34.68
%
Memory available percentage
Percentage of available memory
p5
65.32
%
<
mean
80.79
%
SD
9.37
%
<
p95
92.65
%
Max host memory used
Maximum memory usage percentage across all hosts
max
34.40
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
1088.70
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.01
MiB/s
Disk write throughput
Disk write throughput in MiB/s
6.19
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/2
hosts
Mount Point /nix/store
0/2
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.52
5 min
0.46
15 min
0.28
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
1.4685
%
SD
5.6471
%
<
p95
3.68
%
60 second average
1.7221
%
300 second average
2.3685
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
2.1981
%
SD
7.6159
%
<
p95
22.58
%
60 second average
1.7727
%
300 second average
1.0186
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
1.9023
%
SD
6.6498
%
<
p95
19.63
%
60 second average
1.5553
%
300 second average
0.8986
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.39
%
<
mean
2.69
%
SD
5.52
%
<
p95
7.12
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
169.81
KiB
<
mean
231.79
KiB
SD
149.99
KiB
<
p95
304.45
KiB
Holochain process threads
Number of threads in Holochain process
p5
14
threads
<
mean
19.4
threads
SD
5.53
threads
<
p95
31
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
48
file descriptors
<
mean
72.7
file descriptors
SD
81.55
file descriptors
<
p95
129
file descriptors

Single-write, many-read

↑ Back to index

Creates an entry in the agent setup, then read one's own record back. This tests the maximum read performance for reading back local data when the chain is short.

Started
Thu, 18 Jun 2026 01:28:51 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
single_write_many_read_27730453039_1
read call timing
The time it takes to complete the zome call that retrieves the record.
mean
0.003295
s
SD
0.00132
s
p50
0.002694
s
<
p95
0.006171
s
<
p99
0.006302
s
read call rate
The number of read zome calls completed per second.
mean
2997.62
/s
Error count
The number of errors collected.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.00036
s
SD
5.9e-05
s
p50
0.000386
s
<
p95
0.000477
s
<
p99
0.000487
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.001812242s
Not enough time data to show a trend.
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
4010019888
over 280.001812242s
mean rate
1.432140861e+07
/s
std
3.61165763e+06
/s
p5
8.11736943e+06
/s
p95
1.707185468e+07
/s
peak
1.716274079e+07
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.001812242s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.001812242s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.002972
s
SD
0
s
p50
0.002972
s
≤
p95
0.002972
s
≤
p99
0.002972
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.002255
s
SD
0.000386
s
p50
0.002429
s
<
p95
0.003028
s
<
p99
0.003086
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002514
s
SD
0
s
p50
0.002514
s
≤
p95
0.002514
s
≤
p99
0.002514
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00164
s
SD
0.000292
s
p50
0.001771
s
<
p95
0.002226
s
<
p99
0.002269
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001216
s
SD
0
s
p50
0.001216
s
≤
p95
0.001216
s
≤
p99
0.001216
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000822
s
SD
0
s
p50
0.000822
s
≤
p95
0.000822
s
≤
p99
0.000822
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000231
s
SD
3.7e-05
s
p50
0.000267
s
≤
p95
0.000267
s
≤
p99
0.000267
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000399
s
SD
6.3e-05
s
p50
0.000428
s
<
p95
0.000526
s
<
p99
0.000536
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001366
s
SD
0
s
p50
0.001366
s
≤
p95
0.001366
s
≤
p99
0.001366
s
Post-commit duration
Time spent executing post-commit workflows.
mean
7.9e-05
s
SD
0
s
p50
7.9e-05
s
≤
p95
7.9e-05
s
≤
p99
7.9e-05
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.55
s
<
mean
148.55
s
SD
83.67
s
<
p95
278.55
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001830797s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.029676
s
SD
0
s
p50
0.029677
s
≤
p95
0.029677
s
≤
p99
0.029677
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000661
s
SD
0
s
p50
0.000661
s
≤
p95
0.000661
s
≤
p99
0.000661
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.00099
s
SD
0
s
p50
0.00099
s
≤
p95
0.00099
s
≤
p99
0.00099
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000732
s
SD
0
s
p50
0.000732
s
≤
p95
0.000732
s
≤
p99
0.000732
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.000871
s
SD
3.1e-05
s
p50
0.000847
s
<
p95
0.000907
s
≤
p99
0.000907
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000704
s
SD
0
s
p50
0.000704
s
≤
p95
0.000704
s
≤
p99
0.000704
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000336
s
SD
0
s
p50
0.000336
s
≤
p95
0.000336
s
≤
p99
0.000336
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000149
s
SD
2.6e-05
s
p50
0.000162
s
<
p95
0.0002
s
<
p99
0.000204
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000297
s
SD
4.3e-05
s
p50
0.000304
s
<
p95
0.000373
s
<
p99
0.000383
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000101
s
SD
2.2e-05
s
p50
0.000111
s
<
p95
0.000144
s
<
p99
0.000147
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.00031
s
SD
5.1e-05
s
p50
0.000332
s
<
p95
0.000412
s
<
p99
0.00042
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.7e-05
s
SD
0
s
p50
8.7e-05
s
≤
p95
8.7e-05
s
≤
p99
8.7e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
8.9e-05
s
SD
1.3e-05
s
p50
8.8e-05
s
<
p95
0.000102
s
<
p99
0.000104
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000146
s
SD
0.007881
s
p50
0.000163
s
<
p95
0.019852
s
≤
p99
0.019852
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000214
s
SD
0
s
p50
0.000214
s
≤
p95
0.000214
s
≤
p99
0.000214
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
35.10
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
37
B/s
<
mean
226.03
KiB/s
SD
1.17
MiB/s
≤
p95
2.34
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
34
B/s
<
mean
1.77
KiB/s
SD
8.27
KiB/s
≤
p95
526
B/s
Total bytes received
Total bytes received on primary network interface
count
64.01
MiB
mean
226.03
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
514.30
KiB
mean
1.77
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 446.17 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
25.93
%
<
mean
48.53
%
SD
14.98
%
<
p95
59.7
%
System
13.43
%
CPU percentiles
CPU usage percentiles
p50
58.14
%
p95
59.70
%
p99
59.94
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
6.03
%
<
mean
7.87
%
SD
1.06
%
<
p95
8.95
%
Memory available percentage
Percentage of available memory
p5
91.05
%
<
mean
92.13
%
SD
1.06
%
<
p95
93.97
%
Max host memory used
Maximum memory usage percentage across all hosts
max
7.87
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
446.17
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.01
MiB/s
Disk write throughput
Disk write throughput in MiB/s
2.54
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.95
5 min
0.87
15 min
0.38
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
5.369
%
SD
3.7938
%
<
p95
9.42
%
60 second average
4.0690
%
300 second average
1.6250
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0143
%
SD
0.0385
%
<
p95
0.14
%
60 second average
0.0117
%
300 second average
0.0003
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0033
%
SD
0.0147
%
<
p95
0.02
%
60 second average
0.0023
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
22.97
%
<
mean
29.29
%
SD
4.91
%
<
p95
33.96
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
232.24
KiB
<
mean
256.55
KiB
SD
19.23
KiB
<
p95
284.59
KiB
Holochain process threads
Number of threads in Holochain process
p5
14
threads
<
mean
14.67
threads
SD
0.47
threads
<
p95
15
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
59
file descriptors
<
mean
62.53
file descriptors
SD
4.48
file descriptors
<
p95
68
file descriptors

Unyt Chain Transaction

↑ Back to index

Tests Unyt chain transaction system performance with credit ledger and smart agreement primitives. The scenario has three roles:

  • initiate: Progenitor agent that initializes the network with system templates, global configuration, and foundational smart agreements
  • spend: Transaction agents that accept incoming commitments and create spend transactions distributed among participants
  • smart_agreements: Smart agreement agents that collect RAVEs, execute agreements, and create parked link spending transactions
Started
Thu, 18 Jun 2026 05:51:49 UTC
Peer count
30
Peer count at end
25
Behaviours
  • initiate (1 agent)
  • smart_agreements (1 agent)
  • spend (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
unyt_chain_transaction_27730453039_1
Global definition propagation time
Time from session start until each agent detected the global_definition propagation. Shows aggregate statistics across agents.
Mean
mean
3.478261
s
SD
0
s
Max
Highest per-partition mean latency
max mean
18
s
Min
Lowest per-partition mean latency
min mean
0
s
Sync lag: Commitment transactions
Time between commitment creation and discovery by the receiving agent (seconds). Shows aggregate statistics across agents.
Mean
mean
342.492023
s
SD
101.382471
s
Max
Highest per-partition mean latency
max mean
790.047198
s
Min
Lowest per-partition mean latency
min mean
69.66151
s
Sync lag: RAVE transactions
Time between RAVE creation and discovery by smart_agreements agents (seconds). Shows aggregate statistics across agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Sync lag: Grouped parked requests
Time between grouped_parked request creation and discovery (seconds). Shows aggregate statistics across agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Final ledger balance
Final ledger balance across all agents at teardown (base unyt units). Sum should be stable across runs; deviation indicates value was created or destroyed.
sum
-11897392273553
mean
-4.57592010521e+11
min
-902410819707
max
0
n
26
Final ledger fees
Final ledger fees owed across all agents at teardown (base unyt units).
sum
868804657
mean
3.341556373e+07
min
0
max
82058949
n
26
Actionable transaction commitments
Remaining actionable transaction commitments at teardown. Non-zero sum indicates work left unfinished.
sum
29
mean
1.12
min
0
max
17
n
26
Actionable transaction accepts
Remaining actionable transaction accepts at teardown. Non-zero sum indicates work left unfinished.
sum
0
mean
0
min
0
max
0
n
26
Completed transaction accepts
Completed transaction accepts at teardown.
sum
52
mean
2
min
0
max
21
n
26
Completed transaction spends
Completed transaction spends at teardown.
sum
1889
mean
72.65
min
0
max
192
n
26
Completed transaction RAVEs
Completed transaction RAVEs at teardown.
sum
1906
mean
73.31
min
0
max
192
n
26
Parked spends
Parked spend counts at teardown. These are pending link-spending transactions.
sum
1986
mean
76.38
min
0
max
191
n
26
Check agent exists: Duration
Duration of the check_agent_exists loop per behaviour iteration (seconds).
mean
0.067824
s
SD
0.044174
s
p50
0.06949
s
<
p95
0.133995
s
<
p99
0.220027
s
Check agent exists: Total calls
Total check_agent_exists calls made across all agents and iterations.
sum
575
mean
7.99
min
0
max
19
n
72
Check agent exists: Failed calls
Total check_agent_exists calls that failed across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
72
Check agent exists: Missing agents
Total check_agent_exists calls that reported a missing agent across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
72
UI action list refresh: Duration
Duration of the UI action list refresh per behaviour iteration (seconds).
mean
0.109983
s
SD
0.159389
s
p50
0.065368
s
<
p95
0.350846
s
<
p99
1.089385
s
UI action list refresh: Failed calls
Total UI action list refresh calls that failed across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
72
UI routine refresh: Duration
Duration of the full UI routine refresh per behaviour iteration (seconds), including check_agent_exists, action list refresh, and transaction detail refresh.
mean
34.418144
s
SD
67.815036
s
p50
9.51744
s
<
p95
138.489602
s
<
p99
499.401614
s
UI routine refresh: Watchlist count
Watchlist size (number of transactions being tracked) per behaviour iteration. Indicates how many transactions agents are actively monitoring.
sum
2341
mean
32.51
min
0
max
179
n
72
UI transaction detail item refresh: Duration
Duration of refreshing a single transaction detail item per behaviour iteration (seconds).
mean
1.048004
s
SD
2.531762
s
p50
0.060351
s
<
p95
4.120784
s
<
p99
10.457104
s
UI transaction detail item refresh: Primary transaction total calls
Total primary transaction fetches made during per-item detail refresh across all agents and iterations.
sum
4682
mean
2
min
2
max
2
n
2341
UI transaction detail item refresh: Primary transaction failed calls
Total primary transaction fetches that failed during per-item detail refresh across all agents and iterations.
sum
2
mean
0
min
0
max
1
n
2341
UI transaction detail item refresh: Related transaction total calls
Total related transaction fetches made during per-item detail refresh across all agents and iterations.
sum
1
mean
0
min
0
max
1
n
2341
UI transaction detail item refresh: Related transaction failed calls
Total related transaction fetches that failed during per-item detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
2341
UI transaction detail refresh: Duration
Duration of refreshing all watched transaction details per behaviour iteration (seconds).
mean
40.890007
s
SD
72.323607
s
p50
13.517682
s
<
p95
145.594488
s
<
p99
499.015819
s
UI transaction detail refresh: Transactions processed
Total number of transactions processed during the detail refresh across all agents and iterations.
sum
2341
mean
39.02
min
2
max
179
n
60
UI transaction detail refresh: Primary transaction total calls
Total primary transaction fetches made during the full detail refresh across all agents and iterations.
sum
4682
mean
78.03
min
4
max
358
n
60
UI transaction detail refresh: Primary transaction failed calls
Total primary transaction fetches that failed during the full detail refresh across all agents and iterations.
sum
2
mean
0.03
min
0
max
1
n
60
UI transaction detail refresh: Related transaction total calls
Total related transaction fetches made during the full detail refresh across all agents and iterations.
sum
1
mean
0.02
min
0
max
1
n
60
UI transaction detail refresh: Related transaction failed calls
Total related transaction fetches that failed during the full detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
60
Error count
The total number of errors accumulated across all agents over the run.
905
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.010464
s
SD
0.016253
s
p50
0.004121
s
<
p95
0.03579
s
<
p99
0.085119
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 1672.65752876s
Not enough time data to show a trend.
Zome call duration: 'transactor::check_agent_exists'
Duration of this zome call as measured by Holochain internally.
mean
0.005435
s
SD
0.002073
s
p50
0.005534
s
<
p95
0.010483
s
≤
p99
0.010483
s
Zome call duration: 'transactor::create_accept'
Duration of this zome call as measured by Holochain internally.
mean
0.173598
s
SD
0.096226
s
p50
0.175018
s
<
p95
0.48301
s
≤
p99
0.48301
s
Zome call duration: 'transactor::create_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.025745
s
SD
0.023779
s
p50
0.020686
s
<
p95
0.120379
s
≤
p99
0.120379
s
Zome call duration: 'transactor::create_commitment'
Duration of this zome call as measured by Holochain internally.
mean
0.372686
s
SD
0.339898
s
p50
0.29999
s
<
p95
1.11025
s
<
p99
1.297067
s
Zome call duration: 'transactor::create_parked_spend'
Duration of this zome call as measured by Holochain internally.
mean
0.145111
s
SD
0.014033
s
p50
0.131357
s
<
p95
0.159143
s
≤
p99
0.159143
s
Zome call duration: 'transactor::create_smart_agreement'
Duration of this zome call as measured by Holochain internally.
mean
0.010196
s
SD
0.001223
s
p50
0.009835
s
<
p95
0.011996
s
≤
p99
0.011996
s
Zome call duration: 'transactor::get_actionable_transactions'
Duration of this zome call as measured by Holochain internally.
mean
0.093332
s
SD
0.079189
s
p50
0.055587
s
<
p95
0.26719
s
<
p99
0.33748
s
Zome call duration: 'transactor::get_all_notification_links'
Duration of this zome call as measured by Holochain internally.
mean
0.019834
s
SD
0.023291
s
p50
0.015687
s
<
p95
0.074412
s
<
p99
0.100248
s
Zome call duration: 'transactor::get_code_templates_lib'
Duration of this zome call as measured by Holochain internally.
mean
0.037069
s
SD
0.033307
s
p50
0.026788
s
<
p95
0.10739
s
<
p99
0.131015
s
Zome call duration: 'transactor::get_current_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.034927
s
SD
0.077166
s
p50
0.030833
s
<
p95
0.148816
s
<
p99
0.419539
s
Zome call duration: 'transactor::get_global_units_details'
Duration of this zome call as measured by Holochain internally.
mean
0.025356
s
SD
0.037149
s
p50
0.01727
s
<
p95
0.079307
s
<
p99
0.178886
s
Zome call duration: 'transactor::get_history'
Duration of this zome call as measured by Holochain internally.
mean
0.113036
s
SD
0.278776
s
p50
0.08021
s
<
p95
0.437774
s
<
p99
0.593943
s
Zome call duration: 'transactor::get_incoming_raves'
Duration of this zome call as measured by Holochain internally.
mean
0.024012
s
SD
0.019177
s
p50
0.015719
s
<
p95
0.067733
s
<
p99
0.084571
s
Zome call duration: 'transactor::get_ledger'
Duration of this zome call as measured by Holochain internally.
mean
0.051449
s
SD
0.028955
s
p50
0.040126
s
<
p95
0.133402
s
<
p99
0.141703
s
Zome call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of this zome call as measured by Holochain internally.
mean
0.07381
s
SD
0.092542
s
p50
0.048744
s
<
p95
0.30502
s
<
p99
0.376984
s
Zome call duration: 'transactor::get_requests_to_execute_agreements'
Duration of this zome call as measured by Holochain internally.
mean
0.024087
s
SD
0.018141
s
p50
0.017485
s
<
p95
0.057636
s
<
p99
0.081333
s
Zome call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.030138
s
SD
0.045102
s
p50
0.011917
s
<
p95
0.133988
s
<
p99
0.205131
s
Zome call duration: 'transactor::get_sorted_requests_to_spend'
Duration of this zome call as measured by Holochain internally.
mean
0.016265
s
SD
0.020544
s
p50
0.011904
s
<
p95
0.059833
s
<
p99
0.081412
s
Zome call duration: 'transactor::get_status'
Duration of this zome call as measured by Holochain internally.
mean
1.565877
s
SD
2.114672
s
p50
2.031882
s
<
p95
7.11908
s
<
p99
7.663259
s
Zome call duration: 'transactor::get_transaction'
Duration of this zome call as measured by Holochain internally.
mean
0.013975
s
SD
0.011938
s
p50
0.014826
s
<
p95
0.05508
s
≤
p99
0.05508
s
Zome call duration: 'transactor::initialize_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.024518
s
SD
0
s
p50
0.024518
s
≤
p95
0.024518
s
≤
p99
0.024518
s
Zome call duration: 'transactor::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.012066
s
SD
0.006739
s
p50
0.016108
s
<
p95
0.031622
s
<
p99
0.04184
s
Zome call duration: 'transactor::whoami'
Duration of this zome call as measured by Holochain internally.
mean
0.005629
s
SD
0.003099
s
p50
0.005704
s
<
p95
0.012501
s
<
p99
0.016178
s
WASM call duration: 'transactor::check_agent_exists'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003471
s
SD
0.001635
s
p50
0.003436
s
<
p95
0.008044
s
≤
p99
0.008044
s
WASM call duration: 'transactor::create_accept'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.232795
s
SD
0.091138
s
p50
0.180082
s
<
p95
0.447673
s
≤
p99
0.447673
s
WASM call duration: 'transactor::create_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.023257
s
SD
0.022719
s
p50
0.018601
s
<
p95
0.114308
s
≤
p99
0.114308
s
WASM call duration: 'transactor::create_commitment'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.370805
s
SD
0.339403
s
p50
0.298436
s
<
p95
1.106999
s
<
p99
1.293378
s
WASM call duration: 'transactor::create_parked_spend'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.144038
s
SD
0.013913
s
p50
0.13041
s
<
p95
0.157947
s
≤
p99
0.157947
s
WASM call duration: 'transactor::create_smart_agreement'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00918
s
SD
0.001082
s
p50
0.008893
s
<
p95
0.010751
s
≤
p99
0.010751
s
WASM call duration: 'transactor::get_actionable_transactions'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.091614
s
SD
0.078591
s
p50
0.054303
s
<
p95
0.262631
s
<
p99
0.334414
s
WASM call duration: 'transactor::get_all_notification_links'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.018035
s
SD
0.022667
s
p50
0.014504
s
<
p95
0.070407
s
<
p99
0.093232
s
WASM call duration: 'transactor::get_code_templates_lib'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.035671
s
SD
0.032623
s
p50
0.025447
s
<
p95
0.101983
s
<
p99
0.128017
s
WASM call duration: 'transactor::get_current_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.021072
s
SD
0.075365
s
p50
0.025638
s
<
p95
0.143191
s
<
p99
0.417851
s
WASM call duration: 'transactor::get_global_units_details'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.023321
s
SD
0.036586
s
p50
0.015879
s
<
p95
0.074158
s
<
p99
0.176783
s
WASM call duration: 'transactor::get_history'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.111387
s
SD
0.278495
s
p50
0.079142
s
<
p95
0.434097
s
<
p99
0.592814
s
WASM call duration: 'transactor::get_incoming_raves'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.022491
s
SD
0.018331
s
p50
0.014677
s
<
p95
0.06176
s
<
p99
0.081538
s
WASM call duration: 'transactor::get_ledger'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.049752
s
SD
0.027591
s
p50
0.038513
s
<
p95
0.127201
s
<
p99
0.133798
s
WASM call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.07237
s
SD
0.090845
s
p50
0.047502
s
<
p95
0.293802
s
<
p99
0.374216
s
WASM call duration: 'transactor::get_requests_to_execute_agreements'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.022602
s
SD
0.017715
s
p50
0.016035
s
<
p95
0.053849
s
<
p99
0.078255
s
WASM call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.027999
s
SD
0.042485
s
p50
0.010153
s
<
p95
0.112916
s
<
p99
0.20303
s
WASM call duration: 'transactor::get_sorted_requests_to_spend'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.014683
s
SD
0.019921
s
p50
0.010512
s
<
p95
0.055744
s
<
p99
0.080007
s
WASM call duration: 'transactor::get_status'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
1.565036
s
SD
2.115713
s
p50
2.030568
s
<
p95
7.115871
s
<
p99
7.661834
s
WASM call duration: 'transactor::get_transaction'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.012655
s
SD
0.011453
s
p50
0.013426
s
<
p95
0.052159
s
≤
p99
0.052159
s
WASM call duration: 'transactor::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.022147
s
SD
0.010976
s
p50
0.017615
s
<
p95
0.046912
s
<
p99
0.05037
s
WASM call duration: 'transactor::initialize_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.023584
s
SD
0
s
p50
0.023584
s
≤
p95
0.023584
s
≤
p99
0.023584
s
WASM call duration: 'transactor::post_commit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.07127
s
SD
0.050151
s
p50
0.050084
s
<
p95
0.179103
s
<
p99
0.223123
s
WASM call duration: 'transactor::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.010496
s
SD
0.006275
s
p50
0.014137
s
<
p95
0.029763
s
<
p99
0.039386
s
WASM call duration: 'transactor::whoami'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003272
s
SD
0.001938
s
p50
0.003178
s
<
p95
0.007357
s
<
p99
0.009928
s
WASM call duration: 'transactor_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001603
s
SD
0.000727
s
p50
0.001697
s
<
p95
0.003339
s
<
p99
0.004128
s
WASM call duration: 'transactor_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002234
s
SD
0.000994
s
p50
0.001949
s
<
p95
0.00403
s
<
p99
0.005108
s
WASM call duration: 'transactor_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.033547
s
SD
0.077374
s
p50
0.023654
s
<
p95
0.181565
s
<
p99
0.393277
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.3e-05
s
SD
1.9e-05
s
p50
2.4e-05
s
<
p95
5.4e-05
s
<
p99
0.000105
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000471
s
SD
0.000893
s
p50
0.000277
s
<
p95
0.001732
s
<
p99
0.006921
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000674
s
SD
0.001425
s
p50
0.000355
s
<
p95
0.001917
s
<
p99
0.009591
s
Host function call duration: '__hc__delete_link_1'
Duration of this host function call invoked from within WASM.
mean
0.007891
s
SD
0.005843
s
p50
0.005864
s
<
p95
0.022886
s
≤
p99
0.022886
s
Host function call duration: '__hc__dna_info_2'
Duration of this host function call invoked from within WASM.
mean
9e-06
s
SD
4e-05
s
p50
7e-06
s
<
p95
1.9e-05
s
<
p99
0.000353
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
5.1e-05
s
SD
0.000265
s
p50
5.5e-05
s
<
p95
0.000855
s
<
p99
0.001494
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.244709
s
SD
0.414504
s
p50
0.114059
s
<
p95
1.308432
s
<
p99
1.571091
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.072696
s
SD
0.22559
s
p50
0.102267
s
<
p95
0.297479
s
<
p99
0.362534
s
Host function call duration: '__hc__get_details_1'
Duration of this host function call invoked from within WASM.
mean
0.001396
s
SD
0.014539
s
p50
0.000614
s
<
p95
0.011806
s
<
p99
0.055416
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.018272
s
SD
0.021713
s
p50
0.007376
s
<
p95
0.044726
s
<
p99
0.088962
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.032271
s
SD
0.024405
s
p50
0.019878
s
<
p95
0.075337
s
<
p99
0.119853
s
Host function call duration: '__hc__must_get_entry_1'
Duration of this host function call invoked from within WASM.
mean
0.000847
s
SD
0.000942
s
p50
0.000749
s
<
p95
0.003647
s
≤
p99
0.003647
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.002115
s
SD
0.013004
s
p50
0.003267
s
<
p95
0.029025
s
<
p99
0.062111
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.001816
s
SD
0.001834
s
p50
0.001199
s
<
p95
0.006067
s
<
p99
0.008735
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
6e-05
s
SD
3.1e-05
s
p50
5.3e-05
s
<
p95
0.000124
s
<
p99
0.000174
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
6e-06
s
p50
8e-06
s
<
p95
2e-05
s
<
p99
3.7e-05
s
Host function call duration: '__hc__trace_1'
Duration of this host function call invoked from within WASM.
mean
6.2e-05
s
SD
5.1e-05
s
p50
6.5e-05
s
<
p95
0.000136
s
<
p99
0.000221
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.003049
s
SD
0.003848
s
p50
0.003078
s
<
p95
0.012363
s
<
p99
0.022486
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
566
over 1302.188095141s
mean rate
1240.67
/s
std
1963.42
/s
p5
0
/s
p95
5469.64
/s
peak
10996.08
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
573
over 1760.688991215s
mean rate
233.13
/s
std
332.4
/s
p5
0.3
/s
p95
904.61
/s
peak
1947.32
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.073509
s
SD
0.050891
s
p50
0.052245
s
<
p95
0.183741
s
<
p99
0.227035
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
48.79
s
<
mean
510.68
s
SD
310.03
s
<
p95
1016.67
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
18
over 37468.425310176s
mean rate
7115.2
/s
std
12642.06
/s
p5
0
/s
p95
30580.45
/s
peak
125107.24
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
85.312863
s
SD
53.407649
s
p50
38.551256
s
<
p95
190.757384
s
<
p99
202.85768
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.963934
s
SD
0.315963
s
p50
1.967505
s
<
p95
2.162903
s
<
p99
2.311939
s
App validation workflow duration
Time spent running the app validation workflow.
mean
7.803805
s
SD
8.273629
s
p50
5.956272
s
<
p95
23.765831
s
<
p99
37.842865
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.00134
s
SD
0.001338
s
p50
0.000813
s
<
p95
0.00317
s
<
p99
0.006745
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.019652
s
SD
0.023822
s
p50
0.007619
s
<
p95
0.072301
s
<
p99
0.109189
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.017683
s
SD
0.013597
s
p50
0.010723
s
<
p95
0.042324
s
<
p99
0.056827
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.273668
s
SD
0.629021
s
p50
0.30302
s
<
p95
2.254337
s
<
p99
3.040452
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
6.798441
s
SD
6.612871
s
p50
5.730548
s
<
p95
19.500303
s
<
p99
32.967036
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.005409
s
SD
0.006519
s
p50
0.002552
s
<
p95
0.019619
s
<
p99
0.027891
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.004141
s
SD
0.003666
s
p50
0.002016
s
<
p95
0.011042
s
<
p99
0.015542
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000211
s
SD
0.000121
s
p50
0.00019
s
<
p95
0.000557
s
<
p99
0.000586
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.005364
s
SD
0.006073
s
p50
0.002521
s
<
p95
0.018706
s
<
p99
0.025236
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.00025
s
SD
0.000583
s
p50
9.7e-05
s
<
p95
0.001332
s
<
p99
0.003041
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000222
s
SD
0.000229
s
p50
0.000182
s
<
p95
0.000801
s
<
p99
0.001039
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.0026
s
SD
0.304521
s
p50
0.000484
s
<
p95
0.806208
s
<
p99
1.661022
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000384
s
SD
0.000265
s
p50
0.00035
s
<
p95
0.000993
s
<
p99
0.001465
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.877113
s
SD
28.68879
s
p50
0.309801
s
<
p95
60.0016
s
<
p99
60.002205
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.102529
s
SD
0.031112
s
p50
0.099728
s
<
p95
0.143831
s
≤
p99
0.143831
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.112517
s
SD
2.65579
s
p50
0.102485
s
<
p95
0.29844
s
<
p99
0.36754
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
7.872558
s
SD
29.722926
s
p50
0.46182
s
<
p95
60.001089
s
≤
p99
60.001089
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.472748
s
SD
16.284902
s
p50
0.396398
s
<
p95
60.000905
s
<
p99
60.00159
s
P2P received remote signals
Count of remote signals received.
total
9
over 1765.022044937s
mean rate
1148.43
/s
std
1914.56
/s
p5
0
/s
p95
5169.96
/s
peak
11053.53
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
31.02
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
360
B/s
<
mean
132.70
KiB/s
SD
564.74
KiB/s
<
p95
200.56
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
59
B/s
<
mean
105.75
KiB/s
SD
104.57
KiB/s
<
p95
293.88
KiB/s
Total bytes received
Total bytes received on primary network interface
count
3.27
GiB
mean
2.31
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.60
GiB
mean
1.84
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 99.3%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1444.81 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 8% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.1
%
<
mean
37.21
%
SD
27.8
%
<
p95
93.67
%
System
6.19
%
CPU percentiles
CPU usage percentiles
p50
30.01
%
p95
93.67
%
p99
99.32
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
24
hosts
mean time
0.11
s
Memory used percentage
Percentage of memory used
p5
12.43
%
<
mean
27.74
%
SD
15.93
%
<
p95
62.43
%
Memory available percentage
Percentage of available memory
p5
37.57
%
<
mean
72.26
%
SD
15.93
%
<
p95
87.57
%
Max host memory used
Maximum memory usage percentage across all hosts
max
81.73
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.14
%
Memory growth rate
Rate of memory growth over time
growth
1444.81
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.22
MiB/s
Disk write throughput
Disk write throughput in MiB/s
122.34
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/8
hosts
Mount Point /efi-boot
0/5
hosts
Mount Point /etc/hostname
0/8
hosts
Mount Point /etc/hosts
0/8
hosts
Mount Point /etc/resolv.conf
0/8
hosts
Mount Point /nix/store
0/8
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.29
5 min
1.87
15 min
1.50
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
7.69
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
8.2139
%
SD
15.7436
%
<
p95
47.39
%
60 second average
7.9578
%
300 second average
6.5717
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0016
%
SD
0.023
%
≤
p95
0
%
60 second average
0.0013
%
300 second average
0.0003
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0011
%
SD
0.0185
%
≤
p95
0
%
60 second average
0.0009
%
300 second average
0.0002
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
8.8144
%
SD
13.9845
%
<
p95
39.74
%
60 second average
8.5069
%
300 second average
6.9375
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
7.3336
%
SD
11.8505
%
<
p95
32.3
%
60 second average
7.0990
%
300 second average
5.8527
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.23
%
<
mean
28.05
%
SD
27.72
%
<
p95
85.99
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
823.00
KiB
<
mean
1.11
MiB
SD
204.76
KiB
<
p95
1.28
MiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
31.92
threads
SD
14.24
threads
<
p95
55
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
43
file descriptors
<
mean
85.05
file descriptors
SD
23.83
file descriptors
<
p95
132
file descriptors

Unyt Chain Transaction Zero Arc

↑ Back to index

Tests Unyt chain transaction system performance where some agents operate with a 0-arc DHT configuration. Measures data propagation between zero-arc and full-arc nodes. The scenario has five roles:

  • initiate: Progenitor agent that initializes the network with system templates, global configuration, and foundational smart agreements
  • zero_spend: Zero-arc transaction agents that accept commitments and create spend transactions
  • zero_smart_agreements: Zero-arc agents that collect RAVEs and execute smart agreements
  • full_observer: Full-arc observer agents that passively monitor data propagation
  • zero_observer: Zero-arc observer agents that passively monitor data propagation for comparison
Started
Thu, 18 Jun 2026 05:53:46 UTC
Peer count
7
Peer count at end
5
Behaviours
  • full_observer (1 agent)
  • initiate (1 agent)
  • zero_observer (1 agent)
  • zero_smart_agreements (1 agent)
  • zero_spend (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
unyt_chain_transaction_zero_arc_27730453039_1
Global definition propagation time
Time from session start until each agent detected the global_definition propagation. Shows aggregate statistics across arc types and agents.
Mean
mean
10.75
s
SD
0
s
Max
Highest per-partition mean latency
max mean
38
s
Min
Lowest per-partition mean latency
min mean
0
s
Sync lag: Commitment transactions
Time between commitment creation and discovery by the receiving agent (seconds). Shows aggregate statistics across arc types and agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Sync lag: RAVE transactions
Time between RAVE creation and discovery by smart_agreements agents (seconds). Shows aggregate statistics across arc types and agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Sync lag: Grouped parked requests
Time between grouped_parked request creation and discovery (seconds). Shows aggregate statistics across arc types and agents.
Mean
mean
0
s
SD
0
s
Max
Highest per-partition mean latency
max mean
0
s
Min
Lowest per-partition mean latency
min mean
0
s
Not enough time data to show a trend.
Final ledger balance
Final ledger balance across all agents at teardown (base unyt units), partitioned by agent.
sum
-1800369177311
mean
-3.00061529552e+11
min
-982745383682
max
0
n
6
Final ledger fees
Final ledger fees owed across all agents at teardown (base unyt units).
sum
260065957
mean
4.334432617e+07
min
0
max
202614969
n
6
Actionable transaction proposals
Remaining actionable transaction proposals at teardown. Non-zero sum indicates work left unfinished.
sum
0
mean
0
min
0
max
0
n
6
Actionable transaction commitments
Remaining actionable transaction commitments at teardown. Non-zero sum indicates work left unfinished.
sum
0
mean
0
min
0
max
0
n
6
Actionable transaction accepts
Remaining actionable transaction accepts at teardown. Non-zero sum indicates work left unfinished.
sum
0
mean
0
min
0
max
0
n
6
Actionable transaction rejects
Remaining actionable transaction rejects at teardown. Non-zero sum indicates work left unfinished.
sum
0
mean
0
min
0
max
0
n
6
Completed transaction accepts
Completed transaction accepts at teardown.
sum
0
mean
0
min
0
max
0
n
6
Completed transaction spends
Completed transaction spends at teardown.
sum
30
mean
5
min
0
max
16
n
6
Completed transaction RAVEs
Completed transaction RAVEs at teardown.
sum
30
mean
5
min
0
max
16
n
6
Parked spends
Parked spend counts at teardown. These are pending link-spending transactions.
sum
28
mean
4.67
min
0
max
15
n
6
Code template discovery count
Cumulative count of unique code templates discovered by observer agents over the run. Shows aggregate statistics across arc types and agents.
Total
0
Agents affected
0 / 0
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
0
Max
Highest count in any single partition
0
Min
Lowest count in any single partition
0
Not enough time data to show a trend.
Check agent exists: Duration
Duration of the check_agent_exists loop per behaviour iteration (seconds).
mean
0.012556
s
SD
0.027641
s
p50
0.00466
s
<
p95
0.11187
s
≤
p99
0.11187
s
Check agent exists: Total calls
Total check_agent_exists calls made across all agents and iterations.
sum
13
mean
0.93
min
0
max
1
n
14
Check agent exists: Failed calls
Total check_agent_exists calls that failed across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
14
Check agent exists: Missing agents
Total check_agent_exists calls that reported a missing agent across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
14
UI action list refresh: Duration
Duration of the UI action list refresh per behaviour iteration (seconds).
mean
0.846071
s
SD
0.043915
s
p50
0.833743
s
<
p95
0.950531
s
≤
p99
0.950531
s
UI action list refresh: Failed calls
Total UI action list refresh calls that failed across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
14
UI routine refresh: Duration
Duration of the full UI routine refresh per behaviour iteration (seconds), including check_agent_exists, action list refresh, and transaction detail refresh.
mean
7.37822
s
SD
3.614885
s
p50
9.048323
s
<
p95
12.907789
s
≤
p99
12.907789
s
UI routine refresh: Watchlist count
Watchlist size (number of transactions being tracked) per behaviour iteration. Indicates how many transactions agents are actively monitoring.
sum
91
mean
6.5
min
0
max
13
n
14
UI transaction detail item refresh: Duration
Duration of refreshing a single transaction detail item per behaviour iteration (seconds).
mean
0.794266
s
SD
0.068893
s
p50
0.767919
s
<
p95
0.944534
s
<
p99
1.045061
s
UI transaction detail item refresh: Primary transaction total calls
Total primary transaction fetches made during per-item detail refresh across all agents and iterations.
sum
182
mean
2
min
2
max
2
n
91
UI transaction detail item refresh: Primary transaction failed calls
Total primary transaction fetches that failed during per-item detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
91
UI transaction detail item refresh: Related transaction total calls
Total related transaction fetches made during per-item detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
91
UI transaction detail item refresh: Related transaction failed calls
Total related transaction fetches that failed during per-item detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
91
UI transaction detail refresh: Duration
Duration of refreshing all watched transaction details per behaviour iteration (seconds).
mean
5.55995
s
SD
3.076407
s
p50
5.486446
s
<
p95
10.490489
s
≤
p99
10.490489
s
UI transaction detail refresh: Transactions processed
Total number of transactions processed during the detail refresh across all agents and iterations.
sum
91
mean
7
min
1
max
13
n
13
UI transaction detail refresh: Primary transaction total calls
Total primary transaction fetches made during the full detail refresh across all agents and iterations.
sum
182
mean
14
min
2
max
26
n
13
UI transaction detail refresh: Primary transaction failed calls
Total primary transaction fetches that failed during the full detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
13
UI transaction detail refresh: Related transaction total calls
Total related transaction fetches made during the full detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
13
UI transaction detail refresh: Related transaction failed calls
Total related transaction fetches that failed during the full detail refresh across all agents and iterations.
sum
0
mean
0
min
0
max
0
n
13
Error count
The total number of errors accumulated across all agents over the run.
25
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000539
s
SD
0.000208
s
p50
0.000542
s
<
p95
0.000985
s
<
p99
0.001066
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 0s
Not enough time data to show a trend.
WASM usage: 'transactor::check_agent_exists'
Metered usage count of the WASM ribosome for this zome function.
total
133716
over 700.006021603s
mean rate
191.02
/s
std
419.96
/s
p5
0
/s
p95
1114.3
/s
peak
1114.32
/s
WASM usage: 'transactor::create_code_template'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 32938.009163941s
Not enough time data to show a trend.
WASM usage: 'transactor::create_commitment'
Metered usage count of the WASM ribosome for this zome function.
total
448254710
over 710.059515959s
mean rate
5.78336963e+06
/s
std
2.52829391e+06
/s
p5
2.97447926e+06
/s
p95
8.06963835e+06
/s
peak
1.223659162e+07
/s
WASM usage: 'transactor::create_smart_agreement'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 720.012756965s
Not enough time data to show a trend.
WASM usage: 'transactor::get_actionable_transactions'
Metered usage count of the WASM ribosome for this zome function.
total
12351192
over 720.059653434s
mean rate
133101.14
/s
std
56604.43
/s
p5
67182.45
/s
p95
190042.1
/s
peak
284995.93
/s
WASM usage: 'transactor::get_all_notification_links'
Metered usage count of the WASM ribosome for this zome function.
total
3262714
over 720.006375172s
mean rate
4531.51
/s
std
9653.77
/s
p5
0
/s
p95
25097.74
/s
peak
25098.15
/s
WASM usage: 'transactor::get_code_templates_lib'
Metered usage count of the WASM ribosome for this zome function.
total
21101835
over 725.66951151s
mean rate
4.861781716e+07
/s
std
3.172229003e+07
/s
p5
0
/s
p95
9.896619339e+07
/s
peak
1.0818525771e+08
/s
WASM usage: 'transactor::get_current_global_definition'
Metered usage count of the WASM ribosome for this zome function.
total
10553433
over 755.728859737s
mean rate
1.05300873261e+09
/s
std
1.78892165216e+09
/s
p5
1.33204808e+06
/s
p95
5.37041859146e+09
/s
peak
6.24102740033e+09
/s
WASM usage: 'transactor::get_global_units_details'
Metered usage count of the WASM ribosome for this zome function.
total
5504122
over 720.006375172s
mean rate
7644.54
/s
std
16285.68
/s
p5
0
/s
p95
42339.29
/s
peak
42339.99
/s
WASM usage: 'transactor::get_history'
Metered usage count of the WASM ribosome for this zome function.
total
247077130
over 720.006375172s
mean rate
343158.81
/s
std
733604.72
/s
p5
0
/s
p95
1.95051244e+06
/s
peak
2.05760957e+06
/s
WASM usage: 'transactor::get_incoming_raves'
Metered usage count of the WASM ribosome for this zome function.
total
3135635
over 720.059653434s
mean rate
39563.39
/s
std
21477.57
/s
p5
23074.51
/s
p95
83973.65
/s
peak
134749.14
/s
WASM usage: 'transactor::get_ledger'
Metered usage count of the WASM ribosome for this zome function.
total
181609573
over 725.66951151s
mean rate
3.177756331e+07
/s
std
1.357474477e+07
/s
p5
1.89223436e+06
/s
p95
4.811720969e+07
/s
peak
5.100917637e+07
/s
WASM usage: 'transactor::get_my_current_applied_credit_limit'
Metered usage count of the WASM ribosome for this zome function.
total
211909644
over 720.059653434s
mean rate
2.33525431e+06
/s
std
1.26336424e+06
/s
p5
0
/s
p95
4.91608638e+06
/s
peak
4.91621901e+06
/s
WASM usage: 'transactor::get_requests_to_execute_agreements'
Metered usage count of the WASM ribosome for this zome function.
total
3212426
over 720.059653434s
mean rate
40653.26
/s
std
21446.73
/s
p5
23668.35
/s
p95
83973.65
/s
peak
134749.14
/s
WASM usage: 'transactor::get_smart_agreements_for_code_template'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 725.66951151s
Not enough time data to show a trend.
WASM usage: 'transactor::get_sorted_requests_to_spend'
Metered usage count of the WASM ribosome for this zome function.
total
3298516
over 720.006375172s
mean rate
4581.22
/s
std
9759.68
/s
p5
0
/s
p95
25373.13
/s
peak
25373.55
/s
WASM usage: 'transactor::get_status'
Metered usage count of the WASM ribosome for this zome function.
total
3250898300
over 710.006302767s
mean rate
4.57868603e+06
/s
std
5.9767406e+06
/s
p5
0
/s
p95
1.841826922e+07
/s
peak
2.214020463e+07
/s
WASM usage: 'transactor::get_transaction'
Metered usage count of the WASM ribosome for this zome function.
total
1016771388
over 700.006021603s
mean rate
1.45251282e+06
/s
std
3.03297103e+06
/s
p5
0
/s
p95
9.03858308e+06
/s
peak
1.46912532e+07
/s
WASM usage: 'transactor::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 33058.010241715s
Not enough time data to show a trend.
WASM usage: 'transactor::initialize_global_definition'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 720.012756965s
Not enough time data to show a trend.
WASM usage: 'transactor::post_commit'
Metered usage count of the WASM ribosome for this zome function.
total
1001462
over 33058.010241715s
mean rate
6.150087409e+07
/s
std
6.320366121e+07
/s
p5
0
/s
p95
1.5169253865e+08
/s
peak
1.7548190995e+08
/s
WASM usage: 'transactor::recv_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
293335157
over 700.071687265s
mean rate
2.5991333e+06
/s
std
672494.03
/s
p5
2.13466321e+06
/s
p95
3.3718478e+06
/s
peak
4.46279108e+06
/s
WASM usage: 'transactor::whoami'
Metered usage count of the WASM ribosome for this zome function.
total
117793
over 720.006375172s
mean rate
163.6
/s
std
348.53
/s
p5
0
/s
p95
906.1
/s
peak
906.11
/s
WASM usage: 'transactor_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
518373
over 33068.010378367s
mean rate
1.577964695e+08
/s
std
3.4700876055e+08
/s
p5
0
/s
p95
1.07263139685e+09
/s
peak
1.52163610625e+09
/s
WASM usage: 'transactor_integrity::genesis_self_check_2'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 33068.010378367s
Not enough time data to show a trend.
WASM usage: 'transactor_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
2343626
over 33058.010241715s
mean rate
3.8757675861e+08
/s
std
5.7165333403e+08
/s
p5
0
/s
p95
1.62376886774e+09
/s
peak
1.83341077382e+09
/s
Zome call duration: 'transactor::check_agent_exists'
Duration of this zome call as measured by Holochain internally.
mean
0.015847
s
SD
0.017831
s
p50
0.01512
s
<
p95
0.056739
s
<
p99
0.110448
s
Zome call duration: 'transactor::create_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.016517
s
SD
0.006323
s
p50
0.012978
s
<
p95
0.02647
s
≤
p99
0.02647
s
Zome call duration: 'transactor::create_commitment'
Duration of this zome call as measured by Holochain internally.
mean
2.279306
s
SD
0.087751
s
p50
2.270612
s
<
p95
2.328417
s
≤
p99
2.328417
s
Zome call duration: 'transactor::create_smart_agreement'
Duration of this zome call as measured by Holochain internally.
mean
0.012286
s
SD
0
s
p50
0.012286
s
≤
p95
0.012286
s
≤
p99
0.012286
s
Zome call duration: 'transactor::get_actionable_transactions'
Duration of this zome call as measured by Holochain internally.
mean
0.462595
s
SD
0.001741
s
p50
0.463403
s
<
p95
0.465524
s
<
p99
0.468608
s
Zome call duration: 'transactor::get_all_notification_links'
Duration of this zome call as measured by Holochain internally.
mean
0.118444
s
SD
0.000773
s
p50
0.118474
s
<
p95
0.119463
s
<
p99
0.121108
s
Zome call duration: 'transactor::get_code_templates_lib'
Duration of this zome call as measured by Holochain internally.
mean
0.147601
s
SD
0.131096
s
p50
0.234391
s
<
p95
0.318143
s
<
p99
0.325527
s
Zome call duration: 'transactor::get_current_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.190367
s
SD
0.474491
s
p50
0.357425
s
<
p95
1.300873
s
≤
p99
1.300873
s
Zome call duration: 'transactor::get_global_units_details'
Duration of this zome call as measured by Holochain internally.
mean
0.497592
s
SD
0.091447
s
p50
0.514481
s
<
p95
0.578242
s
≤
p99
0.578242
s
Zome call duration: 'transactor::get_history'
Duration of this zome call as measured by Holochain internally.
mean
0.609007
s
SD
0.159312
s
p50
0.633255
s
<
p95
0.677118
s
≤
p99
0.677118
s
Zome call duration: 'transactor::get_incoming_raves'
Duration of this zome call as measured by Holochain internally.
mean
0.117545
s
SD
0.001729
s
p50
0.117689
s
<
p95
0.120767
s
<
p99
0.128317
s
Zome call duration: 'transactor::get_ledger'
Duration of this zome call as measured by Holochain internally.
mean
0.050124
s
SD
0.01297
s
p50
0.050418
s
<
p95
0.068298
s
<
p99
0.074065
s
Zome call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of this zome call as measured by Holochain internally.
mean
1.172433
s
SD
0.114814
s
p50
1.198053
s
<
p95
1.265127
s
<
p99
1.39335
s
Zome call duration: 'transactor::get_requests_to_execute_agreements'
Duration of this zome call as measured by Holochain internally.
mean
0.11798
s
SD
0.000951
s
p50
0.117903
s
<
p95
0.118913
s
<
p99
0.119138
s
Zome call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of this zome call as measured by Holochain internally.
mean
0.037184
s
SD
0.111661
s
p50
0.229001
s
<
p95
0.236793
s
≤
p99
0.236793
s
Zome call duration: 'transactor::get_sorted_requests_to_spend'
Duration of this zome call as measured by Holochain internally.
mean
0.125746
s
SD
0.005397
s
p50
0.120706
s
<
p95
0.13165
s
≤
p99
0.13165
s
Zome call duration: 'transactor::get_status'
Duration of this zome call as measured by Holochain internally.
mean
0.655774
s
SD
0.016604
s
p50
0.654487
s
<
p95
0.676823
s
<
p99
0.772599
s
Zome call duration: 'transactor::get_transaction'
Duration of this zome call as measured by Holochain internally.
mean
0.124724
s
SD
0.000986
s
p50
0.125018
s
<
p95
0.125917
s
<
p99
0.128347
s
Zome call duration: 'transactor::initialize_global_definition'
Duration of this zome call as measured by Holochain internally.
mean
0.028849
s
SD
0
s
p50
0.028849
s
≤
p95
0.028849
s
≤
p99
0.028849
s
Zome call duration: 'transactor::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.009718
s
SD
0.001748
s
p50
0.00918
s
<
p95
0.012403
s
<
p99
0.013129
s
Zome call duration: 'transactor::whoami'
Duration of this zome call as measured by Holochain internally.
mean
0.003494
s
SD
0.000607
s
p50
0.003539
s
<
p95
0.004752
s
<
p99
0.006877
s
WASM call duration: 'transactor::check_agent_exists'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.014571
s
SD
0.01783
s
p50
0.013885
s
<
p95
0.055483
s
<
p99
0.109156
s
WASM call duration: 'transactor::create_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.014817
s
SD
0.005601
s
p50
0.01181
s
<
p95
0.02429
s
≤
p99
0.02429
s
WASM call duration: 'transactor::create_commitment'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
2.277342
s
SD
0.08773
s
p50
2.268632
s
<
p95
2.326521
s
≤
p99
2.326521
s
WASM call duration: 'transactor::create_smart_agreement'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.010388
s
SD
0
s
p50
0.010388
s
≤
p95
0.010388
s
≤
p99
0.010388
s
WASM call duration: 'transactor::get_actionable_transactions'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.460878
s
SD
0.001736
s
p50
0.461689
s
<
p95
0.463919
s
<
p99
0.466143
s
WASM call duration: 'transactor::get_all_notification_links'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.116558
s
SD
0.000656
s
p50
0.116665
s
<
p95
0.117188
s
<
p99
0.117809
s
WASM call duration: 'transactor::get_code_templates_lib'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.146112
s
SD
0.13061
s
p50
0.232826
s
<
p95
0.316217
s
<
p99
0.32354
s
WASM call duration: 'transactor::get_current_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.118481
s
SD
0.472646
s
p50
0.338366
s
<
p95
1.298388
s
≤
p99
1.298388
s
WASM call duration: 'transactor::get_global_units_details'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.496031
s
SD
0.091572
s
p50
0.512898
s
<
p95
0.576686
s
≤
p99
0.576686
s
WASM call duration: 'transactor::get_history'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.60697
s
SD
0.159347
s
p50
0.631204
s
<
p95
0.674995
s
≤
p99
0.674995
s
WASM call duration: 'transactor::get_incoming_raves'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.115856
s
SD
0.001573
s
p50
0.116064
s
<
p95
0.118763
s
<
p99
0.125504
s
WASM call duration: 'transactor::get_ledger'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.048708
s
SD
0.013124
s
p50
0.048539
s
<
p95
0.06727
s
<
p99
0.073061
s
WASM call duration: 'transactor::get_my_current_applied_credit_limit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
1.17095
s
SD
0.114815
s
p50
1.196521
s
<
p95
1.263638
s
<
p99
1.391902
s
WASM call duration: 'transactor::get_requests_to_execute_agreements'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.116239
s
SD
0.000921
s
p50
0.116153
s
<
p95
0.117233
s
<
p99
0.117441
s
WASM call duration: 'transactor::get_smart_agreements_for_code_template'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.035903
s
SD
0.110875
s
p50
0.22672
s
<
p95
0.23395
s
≤
p99
0.23395
s
WASM call duration: 'transactor::get_sorted_requests_to_spend'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.123655
s
SD
0.005358
s
p50
0.118252
s
<
p95
0.129434
s
≤
p99
0.129434
s
WASM call duration: 'transactor::get_status'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.653991
s
SD
0.016647
s
p50
0.652671
s
<
p95
0.675136
s
<
p99
0.77132
s
WASM call duration: 'transactor::get_transaction'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.122869
s
SD
0.000941
s
p50
0.123101
s
<
p95
0.124035
s
<
p99
0.125958
s
WASM call duration: 'transactor::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.021962
s
SD
0.008346
s
p50
0.016474
s
<
p95
0.035109
s
≤
p99
0.035109
s
WASM call duration: 'transactor::initialize_global_definition'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.027812
s
SD
0
s
p50
0.027812
s
≤
p95
0.027812
s
≤
p99
0.027812
s
WASM call duration: 'transactor::post_commit'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.124623
s
SD
0.082205
s
p50
0.008018
s
<
p95
0.212885
s
<
p99
0.230392
s
WASM call duration: 'transactor::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.008653
s
SD
0.001681
s
p50
0.008218
s
<
p95
0.011124
s
<
p99
0.012097
s
WASM call duration: 'transactor::whoami'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002033
s
SD
0.000395
s
p50
0.002072
s
<
p95
0.002841
s
<
p99
0.004256
s
WASM call duration: 'transactor_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002144
s
SD
0.000454
s
p50
0.002103
s
<
p95
0.002396
s
<
p99
0.002452
s
WASM call duration: 'transactor_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002533
s
SD
0.00093
s
p50
0.002856
s
<
p95
0.003831
s
≤
p99
0.003831
s
WASM call duration: 'transactor_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.698609
s
SD
0.493294
s
p50
0.003801
s
<
p95
1.496085
s
<
p99
1.778159
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3e-05
s
SD
1.4e-05
s
p50
2.6e-05
s
<
p95
4.6e-05
s
<
p99
6.5e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000349
s
SD
0.00012
s
p50
0.000273
s
<
p95
0.000641
s
≤
p99
0.000641
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000414
s
SD
0.000287
s
p50
0.000283
s
<
p95
0.0014
s
≤
p99
0.0014
s
Host function call duration: '__hc__dna_info_2'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
5e-06
s
p50
6e-06
s
<
p95
1.8e-05
s
≤
p99
1.8e-05
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
9.3e-05
s
SD
4.1e-05
s
p50
6e-05
s
<
p95
0.00015
s
<
p99
0.000151
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000768
s
SD
0.003763
s
p50
0.000781
s
<
p95
0.005337
s
<
p99
0.028834
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.108666
s
SD
0.001585
s
p50
0.107851
s
<
p95
0.110661
s
<
p99
0.11068
s
Host function call duration: '__hc__get_details_1'
Duration of this host function call invoked from within WASM.
mean
0.069613
s
SD
0.063312
s
p50
0.001381
s
<
p95
0.183144
s
<
p99
0.206818
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.061933
s
SD
0.20908
s
p50
0.109134
s
<
p95
0.256303
s
<
p99
1.165736
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.001071
s
SD
9.9e-05
s
p50
0.001034
s
<
p95
0.001172
s
<
p99
0.001236
s
Host function call duration: '__hc__must_get_entry_1'
Duration of this host function call invoked from within WASM.
mean
0.012866
s
SD
0.017834
s
p50
0.012223
s
<
p95
0.053837
s
<
p99
0.107448
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.102939
s
SD
0.050807
s
p50
0.108191
s
<
p95
0.136181
s
<
p99
0.147156
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.00048
s
SD
0.000306
s
p50
0.000429
s
<
p95
0.001193
s
<
p99
0.002054
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
5.9e-05
s
SD
9e-06
s
p50
5.9e-05
s
<
p95
6.7e-05
s
<
p99
9.8e-05
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
1.2e-05
s
SD
6e-06
s
p50
1.2e-05
s
<
p95
2.5e-05
s
≤
p99
2.5e-05
s
Host function call duration: '__hc__trace_1'
Duration of this host function call invoked from within WASM.
mean
8.5e-05
s
SD
2.8e-05
s
p50
7.7e-05
s
<
p95
0.000106
s
<
p99
0.000171
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.003701
s
SD
0.001189
s
p50
0.003529
s
<
p95
0.005992
s
<
p99
0.007013
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
26
over 700.071487004s
mean rate
0.24
/s
std
0.06
/s
p5
0.2
/s
p95
0.3
/s
peak
0.4
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
39
over 710.058879488s
mean rate
0.36
/s
std
0.24
/s
p5
0
/s
p95
0.6
/s
peak
0.9
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.126273
s
SD
0.082324
s
p50
0.0097
s
<
p95
0.21467
s
<
p99
0.232161
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
38.54
s
<
mean
445.89
s
SD
262.78
s
<
p95
857.15
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 33068.010329732s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
4.389574
s
SD
3.314093
s
p50
0.122425
s
<
p95
6.995968
s
<
p99
18.124927
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.601179
s
SD
0.353384
s
p50
1
s
<
p95
2
s
≤
p99
2
s
App validation workflow duration
Time spent running the app validation workflow.
mean
1.579471
s
SD
2.234779
s
p50
0.000626
s
<
p95
5.860689
s
<
p99
11.703679
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001835
s
SD
0.001304
s
p50
0.001447
s
<
p95
0.004565
s
<
p99
0.005295
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000841
s
SD
0.000471
s
p50
0.000833
s
<
p95
0.001545
s
<
p99
0.004011
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.004183
s
SD
0.002612
s
p50
0.002273
s
<
p95
0.009441
s
<
p99
0.011192
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.174946
s
SD
0.132687
s
p50
0.001005
s
<
p95
0.436261
s
≤
p99
0.436261
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.212483
s
SD
0.146041
s
p50
0.000807
s
<
p95
0.414873
s
≤
p99
0.414873
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000377
s
SD
0.0001
s
p50
0.000257
s
<
p95
0.000452
s
<
p99
0.000547
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000194
s
SD
9.8e-05
s
p50
0.000172
s
<
p95
0.00034
s
<
p99
0.00037
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000156
s
SD
8.4e-05
s
p50
0.000145
s
<
p95
0.000204
s
<
p99
0.000835
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000466
s
SD
0.000162
s
p50
0.000372
s
<
p95
0.000638
s
<
p99
0.00066
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000119
s
SD
4.8e-05
s
p50
0.000133
s
<
p95
0.00019
s
≤
p99
0.00019
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000159
s
SD
4.9e-05
s
p50
0.000154
s
<
p95
0.000265
s
<
p99
0.000294
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000662
s
SD
0.343015
s
p50
0.000302
s
<
p95
0.831357
s
<
p99
1.607552
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000282
s
SD
0.000174
s
p50
0.000349
s
<
p95
0.000518
s
<
p99
0.001654
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.109096
s
SD
0.025718
s
p50
0.106868
s
<
p95
0.19538
s
<
p99
0.198432
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.106537
s
SD
0.008035
s
p50
0.106572
s
<
p95
0.142897
s
≤
p99
0.142897
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.106299
s
SD
0.00056
s
p50
0.106156
s
<
p95
0.106986
s
<
p99
0.10718
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.361774
s
SD
0.11663
s
p50
0.431965
s
<
p95
0.446069
s
≤
p99
0.446069
s
P2P received remote signals
Count of remote signals received.
total
26
over 700.071520993s
mean rate
0.24
/s
std
0.06
/s
p5
0.2
/s
p95
0.3
/s
peak
0.4
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
29.46
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.11
KiB/s
<
mean
98.24
KiB/s
SD
69.83
KiB/s
<
p95
214.77
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
160
B/s
<
mean
124.53
KiB/s
SD
103.68
KiB/s
<
p95
299.89
KiB/s
Total bytes received
Total bytes received on primary network interface
count
525.72
MiB
mean
591.58
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
666.41
MiB
mean
749.89
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 99.2%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 788.22 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 14% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.44
%
<
mean
35.57
%
SD
30.46
%
<
p95
95.78
%
System
6.11
%
CPU percentiles
CPU usage percentiles
p50
26.55
%
p95
95.78
%
p99
99.20
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
7
hosts
mean time
0.27
s
Memory used percentage
Percentage of memory used
p5
19.18
%
<
mean
34.99
%
SD
8.75
%
<
p95
43.2
%
Memory available percentage
Percentage of available memory
p5
56.8
%
<
mean
65.01
%
SD
8.75
%
<
p95
80.82
%
Max host memory used
Maximum memory usage percentage across all hosts
max
39.84
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.01
%
Memory growth rate
Rate of memory growth over time
growth
788.22
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.03
MiB/s
Disk write throughput
Disk write throughput in MiB/s
37.17
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/3
hosts
Mount Point /efi-boot
0/2
hosts
Mount Point /etc/hostname
0/2
hosts
Mount Point /etc/hosts
0/2
hosts
Mount Point /etc/resolv.conf
0/2
hosts
Mount Point /nix/store
0/3
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.41
5 min
2.02
15 min
1.71
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
14.29
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
8.9045
%
SD
15.2893
%
<
p95
44.98
%
60 second average
8.4912
%
300 second average
7.0588
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0036
%
SD
0.0255
%
≤
p95
0
%
60 second average
0.0024
%
300 second average
0.0003
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0022
%
SD
0.0188
%
≤
p95
0
%
60 second average
0.0016
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
17.6961
%
SD
18.1858
%
<
p95
46.81
%
60 second average
17.2302
%
300 second average
13.5735
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
14.1699
%
SD
15.1312
%
<
p95
40.17
%
60 second average
13.7862
%
300 second average
10.8775
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.17
%
<
mean
5.29
%
SD
18.12
%
<
p95
54.99
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
651.82
KiB
<
mean
1019.55
KiB
SD
231.65
KiB
<
p95
1.23
MiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
13.6
threads
SD
2.29
threads
<
p95
17
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
43
file descriptors
<
mean
60.75
file descriptors
SD
12.94
file descriptors
<
p95
74
file descriptors

Validation Receipts

↑ Back to index

Creates an entry, wait for required validation receipts, then repeat. Records the amount of time it took to accumulate the required number of receipts for all DHT operations. This is measured to the nearest 20ms so that we don't keep the agent too busy checking for receipts.

Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

By default, this scenario will wait for a complete set of validation receipts before committing the next record. If the NO_VALIDATION_COMPLETE environment variable is set, it will instead publish new records on every round, building up an ever-growing list of action hashes to check on.

Started
Thu, 18 Jun 2026 02:12:09 UTC
Peer count
20
Peer count at end
18
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
validation_receipts_27730453039_1
Receipts complete timing
The amount of time between publishing a record and receiving the required number of validation receipts.
Mean
mean
6.052744
s
SD
4.559412
s
Max
Highest per-partition mean latency
max mean
18.485682
s
Min
Lowest per-partition mean latency
min mean
5.111275
s
Receipts complete rate
The number of complete validation receipt sets collected per second.
Mean
mean
1.88
/s
Max
Highest per-partition mean rate
max
1.96
/s
Min
Lowest per-partition mean rate
min
1.57
/s
Error count
The total number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
1487115
over 1907.309491698s
mean rate
683195.47
/s
std
1.83899551e+06
/s
p5
0
/s
p95
3.27503822e+06
/s
peak
1.657437443e+07
/s
WASM usage: 'crud::get_sample_entry_validation_receipts'
Metered usage count of the WASM ribosome for this zome function.
total
11662413
over 1907.309491698s
mean rate
5.13548098e+06
/s
std
1.090748866e+07
/s
p5
8388.88
/s
p95
1.451976813e+07
/s
peak
7.716647074e+07
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 1907.309491698s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
162680
over 1907.309491698s
mean rate
74623.99
/s
std
200907.71
/s
p5
0
/s
p95
358266.32
/s
peak
1.81312086e+06
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006312
s
SD
0.001931
s
p50
0.005879
s
<
p95
0.011247
s
<
p99
0.012124
s
Zome call duration: 'crud::get_sample_entry_validation_receipts'
Duration of this zome call as measured by Holochain internally.
mean
0.01746
s
SD
0.006936
s
p50
0.013434
s
<
p95
0.024312
s
<
p99
0.038048
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00523
s
SD
0.001623
s
p50
0.004875
s
<
p95
0.009307
s
<
p99
0.009976
s
WASM call duration: 'crud::get_sample_entry_validation_receipts'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.016145
s
SD
0.006837
s
p50
0.012091
s
<
p95
0.022986
s
<
p99
0.035695
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001823
s
SD
0.000998
s
p50
0.001406
s
<
p95
0.004987
s
≤
p99
0.004987
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001744
s
SD
0.000553
s
p50
0.001623
s
<
p95
0.003133
s
<
p99
0.003301
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000462
s
SD
0.000264
s
p50
0.000395
s
<
p95
0.000966
s
<
p99
0.001539
s
Host function call duration: '__hc__get_validation_receipts_1'
Duration of this host function call invoked from within WASM.
mean
0.013712
s
SD
0.006723
s
p50
0.009535
s
<
p95
0.020399
s
<
p99
0.032905
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002755
s
SD
0.000847
s
p50
0.002577
s
<
p95
0.004898
s
<
p99
0.005153
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000455
s
SD
0.000206
s
p50
0.000423
s
<
p95
0.000932
s
<
p99
0.001059
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.63
s
<
mean
458.23
s
SD
263.4
s
<
p95
868.35
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
8669
over 1907.309705501s
mean rate
101.24
/s
std
424.92
/s
p5
0
/s
p95
344.33
/s
peak
6710.67
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.677752
s
SD
1.21797
s
p50
0.714826
s
<
p95
4.240664
s
<
p99
5.712224
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.948985
s
SD
0.082917
s
p50
1.946533
s
<
p95
1.982671
s
<
p99
2.007121
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.006965
s
SD
0.166911
s
p50
0.004598
s
<
p95
0.029107
s
<
p99
0.916188
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001919
s
SD
0.00173
s
p50
0.000845
s
<
p95
0.005146
s
≤
p99
0.005146
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.002374
s
SD
0.002872
s
p50
0.001236
s
<
p95
0.008778
s
<
p99
0.011896
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.004108
s
SD
0.001303
s
p50
0.003583
s
<
p95
0.006496
s
<
p99
0.00844
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.02363
s
SD
0.691892
s
p50
0.02692
s
<
p95
0.404228
s
<
p99
3.731191
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.461427
s
SD
0.53404
s
p50
0.533735
s
<
p95
1.688991
s
<
p99
2.186416
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000298
s
SD
7.3e-05
s
p50
0.000277
s
<
p95
0.000419
s
<
p99
0.000549
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.000668
s
SD
0.000234
s
p50
0.00055
s
<
p95
0.000977
s
<
p99
0.001186
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000217
s
SD
5.5e-05
s
p50
0.000205
s
<
p95
0.000341
s
<
p99
0.000377
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000206
s
SD
9.1e-05
s
p50
0.000198
s
<
p95
0.00034
s
<
p99
0.000438
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000107
s
SD
6.4e-05
s
p50
9.2e-05
s
<
p95
0.00034
s
≤
p99
0.00034
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000191
s
SD
4.4e-05
s
p50
0.000189
s
<
p95
0.000298
s
<
p99
0.000325
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001468
s
SD
0.012641
s
p50
0.000537
s
<
p95
0.028564
s
<
p99
0.052778
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000408
s
SD
0.000104
s
p50
0.000416
s
<
p95
0.000644
s
<
p99
0.000653
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.107342
s
SD
0.037216
s
p50
0.093214
s
<
p95
0.173143
s
<
p99
0.174513
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.175503
s
SD
0.640444
s
p50
0.171109
s
<
p95
0.256138
s
<
p99
0.270125
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
5.76
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
0
B/s
<
mean
49.54
KiB/s
SD
338.33
KiB/s
<
p95
52.67
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
0
B/s
<
mean
38.66
KiB/s
SD
20.48
KiB/s
<
p95
80.44
KiB/s
Total bytes received
Total bytes received on primary network interface
count
791.92
MiB
mean
881.44
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
618.09
MiB
mean
687.97
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 50.96 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 6% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2.99
%
<
mean
7.45
%
SD
5.95
%
<
p95
13.98
%
System
1.69
%
CPU percentiles
CPU usage percentiles
p50
6.25
%
p95
13.98
%
p99
36.97
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
1
hosts
mean time
0.01
s
Memory used percentage
Percentage of memory used
p5
5.99
%
<
mean
14.8
%
SD
15.47
%
<
p95
74.28
%
Memory available percentage
Percentage of available memory
p5
25.72
%
<
mean
85.2
%
SD
15.47
%
<
p95
94.01
%
Max host memory used
Maximum memory usage percentage across all hosts
max
74.41
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.01
%
Memory growth rate
Rate of memory growth over time
growth
50.96
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.03
MiB/s
Disk write throughput
Disk write throughput in MiB/s
41.98
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/6
hosts
Mount Point /efi-boot
0/3
hosts
Mount Point /etc/hostname
0/4
hosts
Mount Point /etc/hosts
0/4
hosts
Mount Point /etc/resolv.conf
0/4
hosts
Mount Point /nix/store
0/6
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.81
5 min
1.95
15 min
3.04
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
5.56
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
1.0303
%
SD
2.7003
%
<
p95
3.69
%
60 second average
2.5669
%
300 second average
9.6583
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
4.902
%
SD
9.6237
%
<
p95
26.43
%
60 second average
5.3039
%
300 second average
6.3772
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
4.7442
%
SD
9.3535
%
<
p95
25.77
%
60 second average
4.9171
%
300 second average
5.0357
%
Holochain process CPU usage
CPU usage by Holochain process
p5
2.16
%
<
mean
5.94
%
SD
4.64
%
<
p95
11.87
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
221.31
KiB
<
mean
248.57
KiB
SD
26.67
KiB
<
p95
281.62
KiB
Holochain process threads
Number of threads in Holochain process
p5
20
threads
<
mean
27.09
threads
SD
6.02
threads
<
p95
39
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
67
file descriptors
<
mean
77.35
file descriptors
SD
12.95
file descriptors
<
p95
95
file descriptors

Write/get_agent_activity

↑ Back to index

A scenario where write peers write entries, while get_agent_activity peers each query a single write agent's activity with get_agent_activity.

Before a target write peer and the requesting get_agent_activity peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started
Thu, 18 Jun 2026 02:27:50 UTC
Peer count
30
Peer count at end
27
Behaviours
  • get_agent_activity (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
write_get_agent_activity_27730453039_1
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
7312.83
Max
Highest chain head value observed for any single write agent.
9868
Write agents observed
6
get_agent_activity_full zome call timing
The time taken to call the zome function that retrieves information on a write peer's source chain.
Mean
mean
0.238182
s
SD
0.194752
s
Max
Highest per-partition mean latency
max mean
0.395509
s
Min
Lowest per-partition mean latency
min mean
0.004847
s
Error count
The number of errors accumulated.
11
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.006054
s
SD
0.018582
s
p50
0.00133
s
<
p95
0.045674
s
<
p99
0.104153
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
1
over 667.202529836s
mean rate
0.2
/s
std
0.67
/s
p5
0
/s
p95
0.95
/s
peak
3.33
/s
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 915.163667898s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
358061059
over 915.163667898s
mean rate
6.211842551e+07
/s
std
2.257543974e+07
/s
p5
2.19339595e+07
/s
p95
1.0106638433e+08
/s
peak
1.1057086318e+08
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
4639903373
over 1891.186572266s
mean rate
7.03308903982e+09
/s
std
1.71982492403e+10
/s
p5
4.42999278e+06
/s
p95
4.91275814027e+10
/s
peak
9.89708305719e+10
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
9984841328
over 37470.024963597s
mean rate
1.28113281989e+09
/s
std
1.54068345422e+09
/s
p5
0
/s
p95
4.71136605702e+09
/s
peak
6.39023001172e+09
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
664060805
over 37470.024963597s
mean rate
2.4310173426e+08
/s
std
7.8759524539e+08
/s
p5
0
/s
p95
6.6955245906e+08
/s
peak
7.61372113778e+09
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.004353
s
SD
0.001364
s
p50
0.004004
s
<
p95
0.006689
s
≤
p99
0.006689
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006716
s
SD
0.00477
s
p50
0.006056
s
<
p95
0.019394
s
<
p99
0.019882
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.058971
s
SD
0.07504
s
p50
0.17577
s
<
p95
0.302525
s
<
p99
0.359365
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.009532
s
SD
0.114664
s
p50
0.005203
s
<
p95
0.485528
s
≤
p99
0.485528
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00363
s
SD
0.001137
s
p50
0.003256
s
<
p95
0.005419
s
≤
p99
0.005419
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005659
s
SD
0.004295
s
p50
0.005079
s
<
p95
0.017202
s
<
p99
0.017673
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.060474
s
SD
0.078653
s
p50
0.182887
s
<
p95
0.314693
s
<
p99
0.356088
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.008882
s
SD
0.114713
s
p50
0.004597
s
<
p95
0.484993
s
≤
p99
0.484993
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000977
s
SD
0.000659
s
p50
0.001007
s
<
p95
0.002858
s
<
p99
0.003054
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.4e-05
s
SD
9e-06
s
p50
2.5e-05
s
<
p95
4e-05
s
≤
p99
4e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.001149
s
SD
0.001984
s
p50
0.000617
s
<
p95
0.006821
s
<
p99
0.00717
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000298
s
SD
0.000104
s
p50
0.000273
s
<
p95
0.000491
s
≤
p99
0.000491
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.05865
s
SD
0.076509
s
p50
0.179714
s
<
p95
0.305984
s
<
p99
0.347704
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.006237
s
SD
0.115045
s
p50
0.002104
s
<
p95
0.482617
s
≤
p99
0.482617
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
9e-06
s
SD
7e-06
s
p50
1e-05
s
<
p95
2.9e-05
s
≤
p99
2.9e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001754
s
SD
0.001689
s
p50
0.001658
s
<
p95
0.007055
s
<
p99
0.007838
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000548
s
SD
0.000839
s
p50
0.000239
s
<
p95
0.002163
s
<
p99
0.004277
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.78
s
<
mean
453.87
s
SD
260.48
s
<
p95
858.53
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
55.859727
s
SD
32.16203
s
p50
43.610388
s
<
p95
97.773167
s
<
p99
143.663094
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.855911
s
SD
0.295416
s
p50
2
s
<
p95
2.012007
s
<
p99
2.075689
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.279425
s
SD
6.778053
s
p50
5.003187
s
<
p95
20.906258
s
<
p99
31.844837
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001239
s
SD
0.001188
s
p50
0.000766
s
<
p95
0.004143
s
<
p99
0.004583
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.022744
s
SD
0.981179
s
p50
0.019884
s
<
p95
2.943373
s
<
p99
3.767825
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.076273
s
SD
0.033082
s
p50
0.001818
s
<
p95
0.099551
s
<
p99
0.122439
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.739036
s
SD
24.37389
s
p50
14.721905
s
<
p95
67.935219
s
<
p99
112.244404
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.585563
s
SD
22.286994
s
p50
0.176047
s
<
p95
45.223423
s
<
p99
104.198494
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.001844
s
SD
0.00376
s
p50
0.000414
s
<
p95
0.009264
s
<
p99
0.019544
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.004143
s
SD
0.003177
s
p50
0.002882
s
<
p95
0.010297
s
<
p99
0.012359
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000147
s
SD
0.000272
s
p50
0.00015
s
<
p95
0.000999
s
<
p99
0.001078
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.002094
s
SD
0.004343
s
p50
0.000296
s
<
p95
0.013209
s
<
p99
0.022294
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.00012
s
SD
8.6e-05
s
p50
8.9e-05
s
<
p95
0.000202
s
<
p99
0.000498
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.00023
s
SD
0.000198
s
p50
0.000158
s
<
p95
0.000736
s
<
p99
0.000811
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00209
s
SD
0.011388
s
p50
0.000495
s
<
p95
0.024299
s
<
p99
0.048357
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000771
s
SD
0.000927
s
p50
0.000413
s
<
p95
0.002168
s
<
p99
0.005284
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
2.913729
s
SD
29.852178
s
p50
0.17389
s
<
p95
60.004346
s
<
p99
60.013002
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.202265
s
SD
0.102664
s
p50
0.17934
s
<
p95
0.382772
s
≤
p99
0.382772
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.206575
s
SD
23.258046
s
p50
0.190922
s
<
p95
60.001502
s
<
p99
60.00406
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.227422
s
SD
0.449118
s
p50
0.213395
s
<
p95
0.405732
s
<
p99
0.492058
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
48.63
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
81
B/s
<
mean
589.61
KiB/s
SD
494.64
KiB/s
<
p95
1.47
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
31
B/s
<
mean
847.01
KiB/s
SD
763.26
KiB/s
<
p95
2.29
MiB/s
Total bytes received
Total bytes received on primary network interface
count
13.67
GiB
mean
15.05
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
19.64
GiB
mean
21.62
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.5%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 457.26 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 30% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
19.48
%
<
mean
57.76
%
SD
29.7
%
<
p95
97.39
%
System
9.12
%
CPU percentiles
CPU usage percentiles
p50
55.00
%
p95
97.39
%
p99
98.45
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
16
hosts
mean time
0.58
s
Memory used percentage
Percentage of memory used
p5
7.03
%
<
mean
14.51
%
SD
13.32
%
<
p95
35.57
%
Memory available percentage
Percentage of available memory
p5
64.43
%
<
mean
85.49
%
SD
13.32
%
<
p95
92.97
%
Max host memory used
Maximum memory usage percentage across all hosts
max
76.94
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.03
%
Memory growth rate
Rate of memory growth over time
growth
457.26
MiB/s
Disk read throughput
Disk read throughput in MiB/s
2.50
MiB/s
Disk write throughput
Disk write throughput in MiB/s
296.20
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/9
hosts
Mount Point /efi-boot
0/7
hosts
Mount Point /etc/hostname
0/6
hosts
Mount Point /etc/hosts
0/6
hosts
Mount Point /etc/resolv.conf
0/6
hosts
Mount Point /nix/store
0/9
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.01
5 min
3.11
15 min
2.55
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
29.63
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
22.6255
%
SD
29.1251
%
<
p95
88.48
%
60 second average
21.4634
%
300 second average
16.3748
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
7.1459
%
SD
12.8052
%
<
p95
37.25
%
60 second average
6.9155
%
300 second average
6.0853
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
5.2834
%
SD
10.0437
%
<
p95
29.45
%
60 second average
5.1402
%
300 second average
4.7090
%
Holochain process CPU usage
CPU usage by Holochain process
p5
16.46
%
<
mean
55.53
%
SD
29.97
%
<
p95
95.44
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
210.53
KiB
<
mean
393.83
KiB
SD
105.02
KiB
<
p95
559.58
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
37.97
threads
SD
10.45
threads
<
p95
52
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
53
file descriptors
<
mean
79.58
file descriptors
SD
16.22
file descriptors
<
p95
108
file descriptors

Write/get_agent_activity with volatile conductors

↑ Back to index

A scenario where write peers write entries, while get_agent_activity_volatile peers each query a single write agents activity with get_agent_activity but shutdown and restart their conductors at semi-random intervals.

Before a target write peer and the requesting get_agent_activity_volatile peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started
Thu, 18 Jun 2026 02:43:44 UTC
Peer count
30
Peer count at end
19
Behaviours
  • get_agent_activity_volatile (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
write_get_agent_activity_volatile_27730453039_1
Highest observed action_seq
The rate at which zero-arc readers observe new chain heads on the writers' chains via get_agent_activity. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.
Mean
mean
44.6
/s
Max
Highest per-partition mean rate
max
77.79
/s
Min
Lowest per-partition mean rate
min
6.88
/s
get_agent_activity_full zome call timing
The time taken to call the zome function that retrieves information on a write peer's source chain.
Mean
mean
0.193931
s
SD
0.152926
s
Max
Highest per-partition mean latency
max mean
0.964561
s
Min
Lowest per-partition mean latency
min mean
0.088654
s
Running volatile conductors count
The number of conductors running by get_agent_activity_volatile peers.
p5
8
conductors
<
mean
13.35
conductors
SD
2.84
conductors
<
p95
17
conductors
Volatile conductor total running duration
The total running duration of a get_agent_activity_volatile conductor.
Mean
mean
1127.600555
s
SD
722.985213
s
Max
Highest per-partition mean latency
max mean
3479.6
s
Min
Lowest per-partition mean latency
min mean
436.461538
s
Volatile conductor running duration
The duration that a get_agent_activity_volatile conductor was running before being stopped.
Mean
mean
80.179622
s
SD
73.537842
s
Max
Highest per-partition mean latency
max mean
153.198002
s
Min
Lowest per-partition mean latency
min mean
32.958676
s
Volatile conductor stopped duration
The duration that a get_agent_activity_volatile conductor was stopped before being started again.
Mean
mean
46.658125
s
SD
67.368295
s
Max
Highest per-partition mean latency
max mean
99.29324
s
Min
Lowest per-partition mean latency
min mean
8.120272
s
Reached target arc
Did get_agent_activity_volatile peer reach their target arc in the moment before they were shutdown.
  • get_agent_activity_volatile_agent: uhCAk43g7IXMmxuGxeaovLKXX1IdB7nU5ahS2Rcx-YD-2B4148cMw
p5
0
<
mean
0.62
SD
0.49
<
p95
1
  • get_agent_activity_volatile_agent: uhCAk7Clf259Jhs7OosH5dmR04HV5H8Ht-DeBkPEAtz1e3zp4Lw6J
p5
0
<
mean
0.04
SD
0.2
≤
p95
0
  • get_agent_activity_volatile_agent: uhCAk8kS8TPZP4et314Xs11MeTDQsIeHAQQkFOB1I9r82WXZodk21
p5
0
≤
mean
0
SD
0
≤
p95
0
  • get_agent_activity_volatile_agent: uhCAkCelvinErv3KQvZ4PRjoWJy2xs7SCjuIFpalgxCSC4vyWGPkE
p5
0
<
mean
0.07
SD
0.25
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkFFTlLKk-BwdbGlAP8fz2S6D1-EXdIyX3qxleoOiniw2zDnjD
p5
0
≤
mean
0
SD
0
≤
p95
0
  • get_agent_activity_volatile_agent: uhCAkH7amtAR5ugtXsThxXODmSnfVE0eGqERWb-GZ1fET-va-GCp9
p5
0
<
mean
0.19
SD
0.39
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkJmiAJ-jwbjXRc5MZJ7lcjqRfuVoC4Szs01xc9mepWhW2N_qP
p5
0
<
mean
0.55
SD
0.5
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkMYA2Fs4pT5_isYPqRhN6oVo9uVuRcBJwElvXHOL-KKvyFdpL
p5
0
<
mean
0.19
SD
0.39
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkYtkjSw4CljlJ_P2widWYwHXlCOZJW9RJe-EkqUciiGnKaxuS
p5
0
<
mean
0.21
SD
0.41
<
p95
1
  • get_agent_activity_volatile_agent: uhCAk_Q4sOvnU_YV5vbibMAEEwqHiTmyUuOSEB3Jj2GVd_ZBBU4lu
p5
0
<
mean
0.26
SD
0.44
<
p95
1
  • get_agent_activity_volatile_agent: uhCAk_VB7k8vtaZOXhqzfofeTGoCNorWiutfPFs8zvxGRsy-kOAVT
p5
0
<
mean
0.15
SD
0.36
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkbrXlTie6VqdDpUxsNMfSyexo-T9p21bJwZ3VnB5QFT60ZN5E
p5
0
<
mean
0.2
SD
0.4
<
p95
1
  • get_agent_activity_volatile_agent: uhCAki9eO5lk0IFDLhJ71mVUtyJCV1pSxgGMe4bCdICBSARwhZqI2
p5
0
<
mean
0.12
SD
0.33
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkjx4jISyxzONU36h2wT7mr8IVK15UhUJWZv830p5pjkz_8o3l
p5
0
<
mean
0.23
SD
0.42
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkpvCyDHc_da2ZqJ8JJ7lA1fkcmQ20lXA3SLv4mTqd-UpIgbnl
p5
0
<
mean
0.26
SD
0.44
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkqcne6jvPXqo2a8jwxN8EEc50K5ZUyPq2ZAhoyHQ8N-wzjyLF
p5
0
<
mean
0.23
SD
0.42
<
p95
1
  • get_agent_activity_volatile_agent: uhCAksZaDpTt_0PqSrRMNdlplL5ZmuJI-b8EIdFGqZPIap914WBV-
p5
0
<
mean
0.25
SD
0.43
<
p95
1
  • get_agent_activity_volatile_agent: uhCAksyHj1Dd-IGIiJJqnf3pShDddk0llL1zwampJv-yx9dJSq3KU
p5
0
<
mean
0.31
SD
0.46
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkt12i_kryQw4X-zcThUUEet-l17nufgKjfOOkTPNakqfC7TL9
p5
0
<
mean
0.09
SD
0.28
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkt34HZDza588QXvd5d_8fpavvd6osrxnLIaWipz5vPKQmfPn6
p5
0
<
mean
0.19
SD
0.39
<
p95
1
Error count
The number of errors accumulated.
93
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000337
s
SD
0.00035
s
p50
0.000348
s
<
p95
0.001401
s
≤
p99
0.001401
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
2
over 2713.362425509s
mean rate
3.78
/s
std
16.14
/s
p5
0
/s
p95
26.68
/s
peak
102.93
/s
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 2806.819391338s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
47989746
over 2806.819391338s
mean rate
5.435824886e+08
/s
std
1.08540176587e+09
/s
p5
16927.47
/s
p95
3.31891095898e+09
/s
peak
5.00993044789e+09
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
406997629
over 1796.929066536s
mean rate
1.94855750636e+10
/s
std
6.06961336368e+11
/s
p5
8.26139758e+06
/s
p95
2.74450934445e+09
/s
peak
2.09938544733e+13
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
233586983
over 38333.815597266s
mean rate
4.8310052303e+08
/s
std
2.69881079679e+09
/s
p5
0
/s
p95
3.1603182241e+08
/s
peak
1.96189351997e+10
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
15531181
over 38333.815597266s
mean rate
5.536876293e+07
/s
std
1.2471506488e+08
/s
p5
462.1
/s
p95
3.438634344e+08
/s
peak
1.30455042748e+09
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.005262
s
SD
0.001868
s
p50
0.004753
s
<
p95
0.007628
s
≤
p99
0.007628
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005489
s
SD
0.001003
s
p50
0.005318
s
<
p95
0.00708
s
<
p99
0.010519
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.139681
s
SD
0.224387
s
p50
0.161131
s
<
p95
0.493286
s
<
p99
1.375942
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.003483
s
SD
0.05963
s
p50
0.003464
s
<
p95
0.181388
s
<
p99
0.236883
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004392
s
SD
0.001581
s
p50
0.003928
s
<
p95
0.006274
s
≤
p99
0.006274
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004528
s
SD
0.000863
s
p50
0.004374
s
<
p95
0.005919
s
<
p99
0.008875
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.198141
s
SD
3.871521
s
p50
0.163621
s
<
p95
1.119762
s
<
p99
5.13649
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002897
s
SD
0.059586
s
p50
0.002869
s
<
p95
0.180609
s
<
p99
0.236013
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001378
s
SD
0.000354
s
p50
0.001349
s
<
p95
0.001889
s
<
p99
0.002976
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.1e-05
s
SD
1.3e-05
s
p50
2.6e-05
s
<
p95
5e-05
s
≤
p99
5e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000426
s
SD
8.2e-05
s
p50
0.000427
s
<
p95
0.000531
s
<
p99
0.000783
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000393
s
SD
0.000169
s
p50
0.000316
s
<
p95
0.000613
s
≤
p99
0.000613
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.191601
s
SD
3.87185
s
p50
0.155885
s
<
p95
1.108961
s
<
p99
5.129813
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000577
s
SD
0.059629
s
p50
0.000536
s
<
p95
0.178184
s
<
p99
0.233569
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
8e-06
s
SD
9e-06
s
p50
8e-06
s
<
p95
3.8e-05
s
≤
p99
3.8e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002491
s
SD
0.000734
s
p50
0.002401
s
<
p95
0.003446
s
<
p99
0.004123
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000406
s
SD
0.000171
s
p50
0.000447
s
<
p95
0.000596
s
<
p99
0.00065
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
6.95
s
<
mean
318.03
s
SD
467.57
s
<
p95
1487.81
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
29.567707
s
SD
76.053789
s
p50
23.591355
s
<
p95
208.334299
s
<
p99
418.764552
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1.695562
s
SD
0.992182
s
p50
1.919676
s
<
p95
3.965714
s
<
p99
5.75
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.294125
s
SD
4.62723
s
p50
0.111081
s
<
p95
5.618314
s
<
p99
35.602806
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001571
s
SD
0.001401
s
p50
0.00101
s
<
p95
0.004857
s
<
p99
0.006961
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.026336
s
SD
0.044825
s
p50
0.002924
s
<
p95
0.046241
s
<
p99
0.069528
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.055058
s
SD
0.038417
s
p50
0.003746
s
<
p95
0.072138
s
<
p99
0.246237
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.619107
s
SD
45.413661
s
p50
0.705708
s
<
p95
70.042472
s
<
p99
250.147804
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
5.160927
s
SD
58.949147
s
p50
2.509619
s
<
p95
221.237101
s
<
p99
242.065798
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.004772
s
SD
0.001567
s
p50
0.000276
s
<
p95
0.005567
s
<
p99
0.006613
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.003742
s
SD
0.003049
s
p50
0.00107
s
<
p95
0.008332
s
<
p99
0.014178
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000267
s
SD
7.7e-05
s
p50
0.000141
s
<
p95
0.000304
s
<
p99
0.000353
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000161
s
SD
0.00012
s
p50
0.000142
s
<
p95
0.000305
s
<
p99
0.000641
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.012478
s
SD
0.00901
s
p50
0.014236
s
<
p95
0.024453
s
<
p99
0.038168
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000175
s
SD
7.9e-05
s
p50
0.000163
s
<
p95
0.000314
s
<
p99
0.000415
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.005711
s
SD
0.029995
s
p50
0.000538
s
<
p95
0.032453
s
<
p99
0.159818
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.00034
s
SD
0.000275
s
p50
0.000399
s
<
p95
0.00096
s
<
p99
0.001694
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
5.84861
s
SD
28.186245
s
p50
0.198524
s
<
p95
60.001978
s
<
p99
60.00773
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.20003
s
SD
0.035957
s
p50
0.174261
s
<
p95
0.299191
s
≤
p99
0.299191
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.314703
s
SD
19.275254
s
p50
0.167302
s
<
p95
60.001331
s
<
p99
60.002069
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.607354
s
SD
27.119194
s
p50
0.466535
s
<
p95
60.001394
s
<
p99
60.00202
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
15.63
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
160
B/s
<
mean
325.60
KiB/s
SD
639.89
KiB/s
<
p95
1.79
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
32
B/s
<
mean
443.77
KiB/s
SD
967.06
KiB/s
<
p95
2.48
MiB/s
Total bytes received
Total bytes received on primary network interface
count
14.18
GiB
mean
7.72
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
19.32
GiB
mean
10.52
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 95.4%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 307.00 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
Detected

Warning 8% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.6
%
<
mean
18.51
%
SD
24.19
%
<
p95
78.94
%
System
2.88
%
CPU percentiles
CPU usage percentiles
p50
7.69
%
p95
78.94
%
p99
95.36
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
9
hosts
mean time
0.14
s
Memory used percentage
Percentage of memory used
p5
5.35
%
<
mean
10.03
%
SD
4.53
%
<
p95
14.6
%
Memory available percentage
Percentage of available memory
p5
85.4
%
<
mean
89.97
%
SD
4.53
%
<
p95
94.65
%
Max host memory used
Maximum memory usage percentage across all hosts
max
26.71
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.03
%
Memory growth rate
Rate of memory growth over time
growth
307.00
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
63.23
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/9
hosts
Mount Point /efi-boot
0/6
hosts
Mount Point /etc/hostname
0/5
hosts
Mount Point /etc/hosts
0/5
hosts
Mount Point /etc/resolv.conf
0/5
hosts
Mount Point /nix/store
0/9
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.25
5 min
1.51
15 min
1.86
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
7.69
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
3.2132
%
SD
7.4539
%
<
p95
19.41
%
60 second average
3.4450
%
300 second average
5.5634
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
6.413
%
SD
13.4233
%
<
p95
40.44
%
60 second average
6.4789
%
300 second average
6.7304
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
5.4334
%
SD
11.4299
%
<
p95
34.56
%
60 second average
5.5011
%
300 second average
5.6881
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
<
mean
16.81
%
SD
24.63
%
<
p95
78.1
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
52.56
KiB
<
mean
193.33
KiB
SD
123.30
KiB
<
p95
438.62
KiB
Holochain process threads
Number of threads in Holochain process
p5
8
threads
<
mean
23.35
threads
SD
12.42
threads
<
p95
51
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
23
file descriptors
<
mean
70.77
file descriptors
SD
25.38
file descriptors
<
p95
124
file descriptors

Write/Query

↑ Back to index

Creates an entry, then queries the source chain and performs a simple operation on the entries, then repeats.

Started
Thu, 18 Jun 2026 01:30:33 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
write_query_27730453039_1
Write timing
The time it takes to complete the zome function call that writes the entry.
mean
0.011339
s
SD
0.003606
s
p50
0.010556
s
<
p95
0.018577
s
<
p99
0.019435
s
Write rate
The number of writes completed per second.
mean
142.31
/s
Query timing
The time it takes to complete the chain_query_count_len zome call that queries the source chain.
mean
0.058353
s
SD
0.03475
s
p50
0.05556
s
<
p95
0.115667
s
<
p99
0.124948
s
Query rate
The number of chain queries completed per second.
mean
142.28
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::chain_query_count_len'
Metered usage count of the WASM ribosome for this zome function.
total
313252253985
over 290.002667243s
mean rate
1.08017020335e+09
/s
std
6.646335924e+07
/s
p5
9.5117623175e+08
/s
p95
1.13263129517e+09
/s
peak
1.1512113085e+09
/s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
165749589
over 290.002667243s
mean rate
571545.57
/s
std
322441.9
/s
p5
318664.61
/s
p95
1.27890791e+06
/s
peak
1.75478932e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 290.002667243s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
36263696
over 290.002667243s
mean rate
125046.19
/s
std
70544.94
/s
p5
69719.37
/s
p95
279807.2
/s
peak
383923.4
/s
Zome call duration: 'crud::chain_query_count_len'
Duration of this zome call as measured by Holochain internally.
mean
0.037241
s
SD
0.012547
s
p50
0.034835
s
<
p95
0.049417
s
<
p99
0.050351
s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.002826
s
SD
4.2e-05
s
p50
0.002812
s
<
p95
0.002874
s
<
p99
0.002878
s
WASM call duration: 'crud::chain_query_count_len'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.036535
s
SD
0.012493
s
p50
0.034129
s
<
p95
0.04867
s
<
p99
0.049603
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002319
s
SD
3.1e-05
s
p50
0.002309
s
<
p95
0.002354
s
<
p99
0.002357
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001071
s
SD
0
s
p50
0.001071
s
≤
p95
0.001071
s
≤
p99
0.001071
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000808
s
SD
9e-06
s
p50
0.00081
s
<
p95
0.000813
s
≤
p99
0.000813
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.0002
s
SD
3e-06
s
p50
0.000196
s
<
p95
0.000204
s
<
p99
0.000205
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.011058
s
SD
0.003901
s
p50
0.010301
s
<
p95
0.014929
s
<
p99
0.015262
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001294
s
SD
7.8e-05
s
p50
0.001251
s
<
p95
0.001385
s
≤
p99
0.001385
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000209
s
SD
3e-06
s
p50
0.00021
s
<
p95
0.000212
s
≤
p99
0.000212
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.36
s
<
mean
153.36
s
SD
86.56
s
<
p95
288.36
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
11703
over 290.002660257s
mean rate
40.35
/s
std
22.77
/s
p5
22.5
/s
p95
90.3
/s
peak
123.9
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.001198
s
SD
6.5e-05
s
p50
0.001196
s
<
p95
0.001289
s
<
p99
0.001549
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001883
s
SD
0
s
p50
0.001883
s
≤
p95
0.001883
s
≤
p99
0.001883
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001201
s
SD
0
s
p50
0.001201
s
≤
p95
0.001201
s
≤
p99
0.001201
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000574
s
SD
4.7e-05
s
p50
0.000573
s
<
p95
0.000611
s
<
p99
0.000613
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.016094
s
SD
0.005579
s
p50
0.014784
s
<
p95
0.02188
s
<
p99
0.022364
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001339
s
SD
0
s
p50
0.001339
s
≤
p95
0.001339
s
≤
p99
0.001339
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.004018
s
SD
0.001248
s
p50
0.003867
s
<
p95
0.005076
s
<
p99
0.005147
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.002454
s
SD
0.000821
s
p50
0.002293
s
<
p95
0.003269
s
<
p99
0.003341
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001596
s
SD
0.000589
s
p50
0.001563
s
<
p95
0.002166
s
<
p99
0.002202
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000108
s
SD
1.1e-05
s
p50
0.000108
s
<
p95
0.000116
s
≤
p99
0.000116
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.0001
s
SD
1e-05
s
p50
0.0001
s
<
p95
0.000107
s
≤
p99
0.000107
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.5e-05
s
SD
0
s
p50
8.5e-05
s
≤
p95
8.5e-05
s
≤
p99
8.5e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
9.9e-05
s
SD
1e-05
s
p50
0.0001
s
<
p95
0.000104
s
≤
p99
0.000104
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000742
s
SD
0.008291
s
p50
0.000447
s
<
p95
0.021206
s
≤
p99
0.021206
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000172
s
SD
3e-06
s
p50
0.00017
s
<
p95
0.000176
s
≤
p99
0.000176
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
38.61
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
37
B/s
<
mean
931
B/s
SD
2.47
KiB/s
<
p95
9.60
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
24
B/s
<
mean
4.37
KiB/s
SD
20.78
KiB/s
<
p95
7.44
KiB/s
Total bytes received
Total bytes received on primary network interface
count
263.70
KiB
mean
931
B/s
Total bytes sent
Total bytes sent on primary network interface
count
1.24
MiB
mean
4.37
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
35.94
%
<
mean
51.21
%
SD
10.32
%
<
p95
59.7
%
System
12.60
%
CPU percentiles
CPU usage percentiles
p50
58.13
%
p95
59.70
%
p99
59.93
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
6.4
%
<
mean
7.87
%
SD
1.01
%
<
p95
8.95
%
Memory available percentage
Percentage of available memory
p5
91.05
%
<
mean
92.13
%
SD
1.01
%
<
p95
93.6
%
Max host memory used
Maximum memory usage percentage across all hosts
max
7.87
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-438.30
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
2.31
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.51
5 min
1.37
15 min
0.62
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.01
%
<
mean
5.644
%
SD
3.5141
%
<
p95
9.42
%
60 second average
5.2780
%
300 second average
2.7600
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0067
%
SD
0.0264
%
<
p95
0.05
%
60 second average
0.0050
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
31.01
%
<
mean
33.65
%
SD
1.51
%
<
p95
35.63
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
248.93
KiB
<
mean
266.25
KiB
SD
46.80
KiB
<
p95
289.84
KiB
Holochain process threads
Number of threads in Holochain process
p5
15
threads
≤
mean
14.81
threads
SD
1.06
threads
<
p95
15
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
59
file descriptors
<
mean
59.1
file descriptors
SD
9.98
file descriptors
<
p95
68
file descriptors

Write/Read

↑ Back to index

Creates an entry and reads it back, then repeats.

Started
Thu, 18 Jun 2026 01:32:18 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
write_read_27730453039_1
Write timing
The time taken to write the entry.
mean
0.020847
s
SD
0.014139
s
p50
0.017936
s
<
p95
0.047287
s
<
p99
0.065856
s
Write rate
The number of writes completed per second.
mean
200.41
/s
Read timing
The time taken to read the entry.
mean
0.029232
s
SD
0.017748
s
p50
0.025021
s
<
p95
0.059825
s
<
p99
0.067778
s
Read rate
The number of reads completed per second.
mean
200.38
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.010752
s
SD
0.00396
s
p50
0.009765
s
<
p95
0.014539
s
<
p99
0.014842
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
240785163
over 290.002297084s
mean rate
830287.29
/s
std
386802.04
/s
p5
471623.77
/s
p95
1.68680321e+06
/s
peak
1.80152035e+06
/s
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
273618438
over 290.002297084s
mean rate
943504.61
/s
std
439477.26
/s
p5
536047.61
/s
p95
1.91722063e+06
/s
peak
2.04760814e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 290.002297084s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
26340216
over 290.002297084s
mean rate
90827.63
/s
std
42313.44
/s
p5
51592.35
/s
p95
184524.5
/s
peak
197073.75
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.00345
s
SD
0.000642
s
p50
0.003431
s
<
p95
0.005673
s
<
p99
0.005798
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.012583
s
SD
0.003724
s
p50
0.01158
s
<
p95
0.016297
s
<
p99
0.016596
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002836
s
SD
0.000559
s
p50
0.002821
s
<
p95
0.004763
s
<
p99
0.004874
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.011908
s
SD
0.003781
s
p50
0.010911
s
<
p95
0.015635
s
<
p99
0.015935
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001087
s
SD
0
s
p50
0.001087
s
≤
p95
0.001087
s
≤
p99
0.001087
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000927
s
SD
0.000205
s
p50
0.000922
s
<
p95
0.001633
s
<
p99
0.001672
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000257
s
SD
3.1e-05
s
p50
0.000256
s
<
p95
0.000349
s
<
p99
0.000411
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.010795
s
SD
0.003957
s
p50
0.009809
s
<
p95
0.014583
s
<
p99
0.014885
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.00152
s
SD
0.000294
s
p50
0.001512
s
<
p95
0.002536
s
<
p99
0.002595
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000138
s
SD
1.4e-05
s
p50
0.000137
s
<
p95
0.000188
s
<
p99
0.000194
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.45
s
<
mean
153.46
s
SD
86.56
s
<
p95
288.46
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
16998
over 290.002242045s
mean rate
58.61
/s
std
27.32
/s
p5
33
/s
p95
119.4
/s
peak
126.9
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.00252
s
SD
0.00021
s
p50
0.002508
s
<
p95
0.003189
s
<
p99
0.003343
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000835
s
SD
0
s
p50
0.000835
s
≤
p95
0.000835
s
≤
p99
0.000835
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000425
s
SD
0
s
p50
0.000425
s
≤
p95
0.000425
s
≤
p99
0.000425
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001094
s
SD
2.2e-05
s
p50
0.001093
s
<
p95
0.001129
s
<
p99
0.001131
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.028437
s
SD
0.010121
s
p50
0.025687
s
<
p95
0.03853
s
<
p99
0.039448
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001047
s
SD
0
s
p50
0.001047
s
≤
p95
0.001047
s
≤
p99
0.001047
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.006064
s
SD
0.001791
s
p50
0.005714
s
<
p95
0.007621
s
<
p99
0.007735
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.003669
s
SD
0.001291
s
p50
0.003321
s
<
p95
0.004934
s
<
p99
0.005043
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.004929
s
SD
0.001909
s
p50
0.00459
s
<
p95
0.006788
s
<
p99
0.006927
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000127
s
SD
1.3e-05
s
p50
0.000127
s
<
p95
0.000173
s
<
p99
0.000174
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.005397
s
SD
0.00198
s
p50
0.004904
s
<
p95
0.007292
s
<
p99
0.007443
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
8.1e-05
s
SD
0
s
p50
8.1e-05
s
≤
p95
8.1e-05
s
≤
p99
8.1e-05
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
9.5e-05
s
SD
1.1e-05
s
p50
9.4e-05
s
<
p95
0.000134
s
<
p99
0.000137
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001658
s
SD
0.007152
s
p50
0.000903
s
<
p95
0.018739
s
≤
p99
0.018739
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000226
s
SD
3.6e-05
s
p50
0.000225
s
<
p95
0.000351
s
<
p99
0.000356
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
21.20
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
164
B/s
<
mean
181.68
KiB/s
SD
974.85
KiB/s
≤
p95
2.36
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
9
B/s
<
mean
5.20
KiB/s
SD
26.11
KiB/s
≤
p95
1.21
KiB/s
Total bytes received
Total bytes received on primary network interface
count
53.23
MiB
mean
181.68
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.52
MiB
mean
5.20
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
18.3
%
<
mean
23.82
%
SD
2.24
%
<
p95
26.05
%
System
2.62
%
CPU percentiles
CPU usage percentiles
p50
24.51
%
p95
26.05
%
p99
26.26
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
6.44
%
<
mean
6.62
%
SD
0.5
%
<
p95
6.94
%
Memory available percentage
Percentage of available memory
p5
93.06
%
<
mean
93.38
%
SD
0.5
%
<
p95
93.56
%
Max host memory used
Maximum memory usage percentage across all hosts
max
6.62
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-56.55
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
16.33
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.38
5 min
0.63
15 min
0.25
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.3887
%
SD
0.4303
%
<
p95
1.36
%
60 second average
0.3674
%
300 second average
0.2052
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.3797
%
SD
0.4224
%
<
p95
1.36
%
60 second average
0.3603
%
300 second average
0.1990
%
Holochain process CPU usage
CPU usage by Holochain process
p5
17.27
%
<
mean
23.15
%
SD
2.46
%
<
p95
25.56
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
250.27
KiB
<
mean
257.29
KiB
SD
3.87
KiB
<
p95
261.38
KiB
Holochain process threads
Number of threads in Holochain process
p5
17
threads
<
mean
17.87
threads
SD
0.43
threads
<
p95
18
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
61
file descriptors
<
mean
62.87
file descriptors
SD
3.66
file descriptors
<
p95
70
file descriptors

Write validated

↑ Back to index

Creates an entry, updates it and links the create to the update, then repeats. Each of the three actions is validated by the included hApp.

Started
Thu, 18 Jun 2026 01:34:18 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
write_validated_27730453039_1
Write timing
The time it takes to complete the zome function call that writes the entry, updates it, and links to the update.
mean
0.165651
s
SD
0.458587
s
p50
0.02488
s
<
p95
1.162416
s
<
p99
2.360505
s
Write rate
The number of write zome function calls that complete per second.
mean
24.59
/s
Read timing
The time it takes to complete the zome function call that reads the data.
mean
0.221687
s
SD
0.514918
s
p50
0.047084
s
<
p95
1.404659
s
<
p99
2.762465
s
Read rate
The number of read zome function calls that complete per second.
mean
24.56
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000525
s
SD
0.000181
s
p50
0.000637
s
<
p95
0.000779
s
<
p99
0.000784
s
WASM usage: 'validated::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
28119935
over 280.002540912s
mean rate
100427.46
/s
std
57002.93
/s
p5
49260.46
/s
p95
225779.28
/s
peak
283250.74
/s
WASM usage: 'validated::update_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
32925708
over 280.002540912s
mean rate
117590.79
/s
std
66705.47
/s
p5
57763.53
/s
p95
259938.39
/s
peak
332143.95
/s
WASM usage: 'validated_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
47326260
over 290.002655944s
mean rate
163192.54
/s
std
92451.34
/s
p5
77446.84
/s
p95
351280.1
/s
peak
443019.19
/s
WASM usage: 'validated_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
554985682
over 280.002540912s
mean rate
1.98207436e+06
/s
std
1.12270589e+06
/s
p5
973319.79
/s
p95
4.41449093e+06
/s
peak
5.56137512e+06
/s
Zome call duration: 'validated::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.004363
s
SD
0.000181
s
p50
0.004353
s
<
p95
0.004422
s
≤
p99
0.004422
s
Zome call duration: 'validated::update_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.00547
s
SD
0.000184
s
p50
0.005449
s
<
p95
0.005521
s
<
p99
0.005524
s
WASM call duration: 'validated::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003465
s
SD
0.000139
s
p50
0.003458
s
<
p95
0.003516
s
<
p99
0.003518
s
WASM call duration: 'validated::update_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.004636
s
SD
0.000154
s
p50
0.004616
s
<
p95
0.004682
s
≤
p99
0.004682
s
WASM call duration: 'validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000974
s
SD
4.6e-05
s
p50
0.000972
s
<
p95
0.000985
s
<
p99
0.000986
s
WASM call duration: 'validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00295
s
SD
7.4e-05
s
p50
0.00294
s
<
p95
0.002988
s
≤
p99
0.002988
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000304
s
SD
1.2e-05
s
p50
0.000301
s
<
p95
0.000311
s
<
p99
0.000312
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000332
s
SD
1.1e-05
s
p50
0.000332
s
<
p95
0.000336
s
<
p99
0.000337
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.000586
s
SD
2.6e-05
s
p50
0.000579
s
<
p95
0.000611
s
<
p99
0.000613
s
Host function call duration: '__hc__update_1'
Duration of this host function call invoked from within WASM.
mean
0.001142
s
SD
3.2e-05
s
p50
0.001139
s
<
p95
0.001164
s
<
p99
0.001166
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001635
s
SD
0.000122
s
p50
0.001799
s
<
p95
0.001878
s
<
p99
0.001885
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000301
s
SD
2.8e-05
s
p50
0.000297
s
<
p95
0.000321
s
<
p99
0.000326
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
16.71
s
<
mean
151.72
s
SD
86.56
s
<
p95
286.72
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
8067
over 290.002703959s
mean rate
27.82
/s
std
15.82
/s
p5
12.1
/s
p95
60.2
/s
peak
76.2
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.044225
s
SD
0.021581
s
p50
0.041718
s
<
p95
0.058875
s
<
p99
0.133292
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000515
s
SD
0
s
p50
0.000515
s
≤
p95
0.000515
s
≤
p99
0.000515
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000758
s
SD
0
s
p50
0.000758
s
≤
p95
0.000758
s
≤
p99
0.000758
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.024868
s
SD
0.008966
s
p50
0.024186
s
<
p95
0.031429
s
<
p99
0.031798
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.030467
s
SD
0.013757
s
p50
0.02269
s
<
p95
0.04749
s
<
p99
0.047573
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.00062
s
SD
0
s
p50
0.00062
s
≤
p95
0.00062
s
≤
p99
0.00062
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.005661
s
SD
0.001948
s
p50
0.005127
s
<
p95
0.007462
s
<
p99
0.00763
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.001759
s
SD
0.000541
s
p50
0.001631
s
<
p95
0.002228
s
<
p99
0.002271
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.001074
s
SD
0.000419
s
p50
0.00101
s
<
p95
0.001519
s
<
p99
0.001556
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000143
s
SD
1e-05
s
p50
0.00014
s
<
p95
0.000149
s
<
p99
0.000151
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.000267
s
SD
2.9e-05
s
p50
0.000261
s
<
p95
0.00028
s
<
p99
0.000281
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000164
s
SD
0
s
p50
0.000164
s
≤
p95
0.000164
s
≤
p99
0.000164
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
8.6e-05
s
SD
5e-06
s
p50
8.5e-05
s
<
p95
9e-05
s
<
p99
0.000104
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.011742
s
SD
0.135325
s
p50
0.002088
s
<
p95
0.367094
s
≤
p99
0.367094
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000267
s
SD
6.1e-05
s
p50
0.000266
s
<
p95
0.00027
s
<
p99
0.000606
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
14.11
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
13.27
KiB/s
<
mean
17.90
KiB/s
SD
11.04
KiB/s
≤
p95
17.69
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
18.04
KiB/s
<
mean
21.77
KiB/s
SD
2.11
KiB/s
<
p95
23.55
KiB/s
Total bytes received
Total bytes received on primary network interface
count
5.24
MiB
mean
17.90
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
6.38
MiB
mean
21.77
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 12.98 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
13.38
%
<
mean
19.33
%
SD
11.02
%
<
p95
58.26
%
System
5.21
%
CPU percentiles
CPU usage percentiles
p50
15.98
%
p95
58.26
%
p99
60.88
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
18.03
%
<
mean
18.65
%
SD
0.45
%
<
p95
19.08
%
Memory available percentage
Percentage of available memory
p5
80.92
%
<
mean
81.35
%
SD
0.45
%
<
p95
81.97
%
Max host memory used
Maximum memory usage percentage across all hosts
max
18.65
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
12.98
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
6.84
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/1
hosts
Mount Point /efi-boot
0/1
hosts
Mount Point /nix/store
0/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.99
5 min
1.16
15 min
0.55
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.56
%
<
mean
1.0258
%
SD
0.353
%
<
p95
1.8
%
60 second average
0.9229
%
300 second average
0.4723
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
11.73
%
<
mean
32.0929
%
SD
8.3079
%
<
p95
41.34
%
60 second average
26.4342
%
300 second average
13.0368
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
10.42
%
<
mean
29.0097
%
SD
7.703
%
<
p95
38.15
%
60 second average
23.8794
%
300 second average
11.7965
%
Holochain process CPU usage
CPU usage by Holochain process
p5
5.79
%
<
mean
12.05
%
SD
11.59
%
<
p95
53.11
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
273.10
KiB
<
mean
434.14
KiB
SD
42.72
KiB
<
p95
446.72
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
14.48
threads
SD
1.5
threads
<
p95
15
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
62
file descriptors
<
mean
63
file descriptors
SD
9.91
file descriptors
<
p95
70
file descriptors

Write Validated must_get_agent_activity

↑ Back to index

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Mixed-Arc must_get_agent_activity, but all agents are full-arc.

Started
Thu, 18 Jun 2026 03:14:31 UTC
Peer count
30
Peer count at end
26
Behaviours
  • must_get_agent_activity (1 agent)
  • write (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
write_validated_must_get_agent_activity_27730453039_1
Highest observed action_seq
The maximum chain length observed per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1615.71
Max
Highest chain head value observed for any single write agent.
1886
Write agents observed
7
Chain batch delay timing
The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.
Mean
mean
13.69869
s
SD
49.696958
s
Max
Highest per-partition mean latency
max mean
527.885786
s
Min
Lowest per-partition mean latency
min mean
-996.130667
s
Chain batch delay rate
The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.
Mean
mean
2.6
/s
Max
Highest per-partition mean rate
max
6
/s
Min
Lowest per-partition mean rate
min
1.79
/s
create_validated_sample_entry zome call timing
The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.
Mean
mean
0.431396
s
SD
0.289866
s
Max
Highest per-partition mean latency
max mean
3.243956
s
Min
Lowest per-partition mean latency
min mean
0.073097
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.
Total
2158
Agents affected
16 / 16
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
135
Max
Highest count in any single partition
717
Min
Lowest count in any single partition
9
Final error count
The total number of all types of error accumulated over the run by all agents.
65234
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.031866
s
SD
0.022267
s
p50
0.001982
s
<
p95
0.059282
s
<
p99
0.098217
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
5
over 210.002118595s
mean rate
0.02
/s
std
0.11
/s
p5
0
/s
p95
0
/s
peak
0.5
/s
WASM usage: 'validated_must_get_agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 1908.274577526s
Not enough time data to show a trend.
WASM usage: 'validated_must_get_agent_activity::create_sample_entries_batch'
Metered usage count of the WASM ribosome for this zome function.
total
3892844761
over 1908.274577526s
mean rate
1.7236953195e+08
/s
std
4.4115916541e+08
/s
p5
0
/s
p95
1.26409629521e+09
/s
peak
2.28837933409e+09
/s
WASM usage: 'validated_must_get_agent_activity::create_validated_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
40008987
over 900.841420084s
mean rate
2.631393053e+07
/s
std
1.2164465919e+08
/s
p5
303907.93
/s
p95
5.092158093e+07
/s
peak
2.15604021569e+09
/s
WASM usage: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Metered usage count of the WASM ribosome for this zome function.
total
25197059
over 907.88947646s
mean rate
5.25728342777e+09
/s
std
1.91515060372e+10
/s
p5
1.193437325e+07
/s
p95
1.93814264291e+10
/s
peak
3.0182720031e+11
/s
WASM usage: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
58723812
over 37475.710361953s
mean rate
1.928542703e+07
/s
std
6.643209073e+07
/s
p5
0
/s
p95
1.1615417613e+08
/s
peak
1.12667591599e+09
/s
WASM usage: 'validated_must_get_agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
4727770
over 37475.710361953s
mean rate
1.24884660266e+09
/s
std
4.88559261656e+09
/s
p5
6345.91
/s
p95
6.05940931178e+09
/s
peak
1.06307730817e+11
/s
WASM usage: 'validated_must_get_agent_activity_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37475.710361953s
Not enough time data to show a trend.
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.004356
s
SD
0.001932
s
p50
0.003521
s
<
p95
0.008933
s
≤
p99
0.008933
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.05444
s
SD
0.018623
s
p50
0.043714
s
<
p95
0.093725
s
<
p99
0.104807
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.00586
s
SD
0.001763
s
p50
0.005424
s
<
p95
0.008539
s
<
p99
0.008563
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.056634
s
SD
0.032946
s
p50
0.037209
s
<
p95
0.093041
s
<
p99
0.170557
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.007384
s
SD
0.023475
s
p50
0.008214
s
<
p95
0.108704
s
≤
p99
0.108704
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003588
s
SD
0.001493
s
p50
0.002952
s
<
p95
0.007107
s
≤
p99
0.007107
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.053343
s
SD
0.018306
s
p50
0.042861
s
<
p95
0.092
s
<
p99
0.103086
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00485
s
SD
0.001464
s
p50
0.004526
s
<
p95
0.007067
s
<
p99
0.007135
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.03876
s
SD
0.036659
s
p50
0.032163
s
<
p95
0.152614
s
<
p99
0.153545
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006251
s
SD
0.023544
s
p50
0.006616
s
<
p95
0.107848
s
≤
p99
0.107848
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001124
s
SD
0.000357
s
p50
0.001115
s
<
p95
0.001882
s
<
p99
0.002062
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.008938
s
SD
0.010584
s
p50
0.007614
s
<
p95
0.026087
s
<
p99
0.060766
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.5e-05
s
SD
1e-05
s
p50
2.5e-05
s
<
p95
4.7e-05
s
<
p99
6.1e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000417
s
SD
0.000147
s
p50
0.00038
s
<
p95
0.000699
s
<
p99
0.000756
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000423
s
SD
0.000128
s
p50
0.000345
s
<
p95
0.000662
s
<
p99
0.00076
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.032617
s
SD
0.033511
s
p50
0.002644
s
<
p95
0.105248
s
<
p99
0.146967
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.020266
s
SD
0.02178
s
p50
0.017123
s
<
p95
0.070313
s
<
p99
0.121186
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.007936
s
SD
0.004213
s
p50
0.005677
s
<
p95
0.014728
s
<
p99
0.019896
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1.4e-05
s
SD
3e-06
s
p50
1.4e-05
s
<
p95
1.9e-05
s
≤
p99
1.9e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001947
s
SD
0.000861
s
p50
0.002388
s
<
p95
0.003921
s
<
p99
0.004494
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.000434
s
SD
0.000267
s
p50
0.000429
s
<
p95
0.001037
s
<
p99
0.001166
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.77
s
<
mean
455.65
s
SD
261.57
s
<
p95
866.55
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
22.326836
s
SD
45.218669
s
p50
10.278797
s
<
p95
134.98536
s
<
p99
229.637558
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
2.20592
s
SD
0.396365
s
p50
2.073407
s
<
p95
2.537632
s
<
p99
2.706644
s
App validation workflow duration
Time spent running the app validation workflow.
mean
2.827562
s
SD
13.330429
s
p50
2.453961
s
<
p95
24.050296
s
<
p99
88.601985
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001473
s
SD
0.001409
s
p50
0.000715
s
<
p95
0.004513
s
<
p99
0.004977
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.013774
s
SD
0.031484
s
p50
0.002418
s
<
p95
0.057963
s
<
p99
0.176142
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.009699
s
SD
0.014255
s
p50
0.00269
s
<
p95
0.030078
s
<
p99
0.080512
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.373833
s
SD
0.827893
s
p50
0.357129
s
<
p95
2.069741
s
<
p99
4.819723
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
14.953555
s
SD
17.192072
s
p50
15.171864
s
<
p95
60.556183
s
<
p99
73.750372
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.01064
s
SD
0.007087
s
p50
0.007354
s
<
p95
0.020721
s
<
p99
0.035427
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
0.003725
s
SD
0.002308
s
p50
0.00271
s
<
p95
0.007498
s
<
p99
0.008562
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
0.000233
s
SD
8.4e-05
s
p50
0.000213
s
<
p95
0.000406
s
<
p99
0.000457
s
Cache DB connection use time
Time spent holding cache database connections.
mean
0.013708
s
SD
0.007729
s
p50
0.010331
s
<
p95
0.022857
s
<
p99
0.036987
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000213
s
SD
0.000592
s
p50
9e-05
s
<
p95
0.000201
s
<
p99
0.003177
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.000179
s
SD
9.4e-05
s
p50
0.000157
s
<
p95
0.000401
s
<
p99
0.000445
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002636
s
SD
0.108217
s
p50
0.000407
s
<
p95
0.384211
s
<
p99
0.553663
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000255
s
SD
0.000118
s
p50
0.000275
s
<
p95
0.00046
s
<
p99
0.000496
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.118947
s
SD
5.97743
s
p50
0.097713
s
<
p95
0.165633
s
<
p99
60.000951
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.075235
s
SD
0.018539
s
p50
0.07559
s
<
p95
0.097972
s
≤
p99
0.097972
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
0.112465
s
SD
0.009189
s
p50
0.113508
s
<
p95
0.129809
s
≤
p99
0.129809
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.435257
s
SD
0.941605
s
p50
0.415268
s
<
p95
0.568224
s
<
p99
0.610559
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
21.54
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
315
B/s
<
mean
81.73
KiB/s
SD
245.30
KiB/s
<
p95
137.93
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
43
B/s
<
mean
92.79
KiB/s
SD
111.35
KiB/s
<
p95
275.76
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.83
GiB
mean
2.02
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
2.08
GiB
mean
2.29
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 206.53 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.08
%
<
mean
26.65
%
SD
21.56
%
<
p95
76.24
%
System
5.11
%
CPU percentiles
CPU usage percentiles
p50
21.48
%
p95
76.24
%
p99
88.43
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
6
hosts
mean time
0.16
s
Memory used percentage
Percentage of memory used
p5
8.06
%
<
mean
16.5
%
SD
13.79
%
<
p95
38
%
Memory available percentage
Percentage of available memory
p5
62
%
<
mean
83.5
%
SD
13.79
%
<
p95
91.94
%
Max host memory used
Maximum memory usage percentage across all hosts
max
78.85
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.01
%
Memory growth rate
Rate of memory growth over time
growth
206.53
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.12
MiB/s
Disk write throughput
Disk write throughput in MiB/s
116.24
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/8
hosts
Mount Point /efi-boot
0/6
hosts
Mount Point /etc/hostname
0/6
hosts
Mount Point /etc/hosts
0/6
hosts
Mount Point /etc/resolv.conf
0/6
hosts
Mount Point /nix/store
0/8
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.63
5 min
1.56
15 min
1.53
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
4.5256
%
SD
8.7435
%
<
p95
28.4
%
60 second average
4.4863
%
300 second average
4.3441
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
9.4476
%
SD
16.3823
%
<
p95
45.05
%
60 second average
9.1932
%
300 second average
8.0693
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
8.7169
%
SD
15.2245
%
<
p95
41.65
%
60 second average
8.4481
%
300 second average
7.2031
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.38
%
<
mean
24.81
%
SD
21.48
%
<
p95
74.23
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
434.19
KiB
<
mean
519.75
KiB
SD
75.01
KiB
<
p95
609.34
KiB
Holochain process threads
Number of threads in Holochain process
p5
13
threads
<
mean
39.27
threads
SD
13.1
threads
<
p95
58
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
51
file descriptors
<
mean
85.7
file descriptors
SD
16.73
file descriptors
<
p95
112
file descriptors

Zome Call, Single Value

↑ Back to index

Calls a zome function that returns a fixed value. This tests the maximum performance of zome calls when the zome function is not calling into Holochain other otherwise doing any work.

Started
Thu, 18 Jun 2026 01:36:06 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.6.1
Wind Tunnel version
0.7.0
Run ID
zome_call_single_value_27730453039_1
Call timing
The time taken for the call to complete.
mean
0.002536
s
SD
0.00035
s
p50
0.002453
s
<
p95
0.003099
s
<
p99
0.004227
s
Call rate
The number of zome calls completed per second.
mean
3904.07
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'return_single_value::get_value'
Metered usage count of the WASM ribosome for this zome function.
total
463734442
over 280.001986478s
mean rate
1.65618268e+06
/s
std
21346.75
/s
p5
1.63990684e+06
/s
p95
1.71161645e+06
/s
peak
1.71204085e+06
/s
Zome call duration: 'return_single_value::get_value'
Duration of this zome call as measured by Holochain internally.
mean
0.001348
s
SD
4e-06
s
p50
0.001347
s
<
p95
0.001349
s
≤
p99
0.001349
s
WASM call duration: 'return_single_value::get_value'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000846
s
SD
1e-06
s
p50
0.000846
s
<
p95
0.000847
s
<
p99
0.000848
s
Post-commit duration
Time spent executing post-commit workflows.
mean
9.6e-05
s
SD
0
s
p50
9.6e-05
s
≤
p95
9.6e-05
s
≤
p99
9.6e-05
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
17.46
s
<
mean
147.47
s
SD
83.67
s
<
p95
277.47
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001866513s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0.079777
s
SD
0
s
p50
0.079777
s
≤
p95
0.079777
s
≤
p99
0.079777
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
1
s
SD
0
s
p50
1
s
≤
p95
1
s
≤
p99
1
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000996
s
SD
0
s
p50
0.000996
s
≤
p95
0.000996
s
≤
p99
0.000996
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002503
s
SD
0
s
p50
0.002503
s
≤
p95
0.002503
s
≤
p99
0.002503
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.001171
s
SD
0
s
p50
0.001171
s
≤
p95
0.001171
s
≤
p99
0.001171
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.000884
s
SD
7.9e-05
s
p50
0.000885
s
<
p95
0.00104
s
≤
p99
0.00104
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000566
s
SD
0
s
p50
0.000566
s
≤
p95
0.000566
s
≤
p99
0.000566
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000956
s
SD
0
s
p50
0.000956
s
≤
p95
0.000956
s
≤
p99
0.000956
s
Authored DB connection use time
Time spent holding authored database connections.
mean
8.8e-05
s
SD
0
s
p50
8.8e-05
s
<
p95
8.9e-05
s
<
p99
9.1e-05
s
DHT DB connection use time
Time spent holding DHT database connections.
mean
4.6e-05
s
SD
0
s
p50
4.6e-05
s
≤
p95
4.6e-05
s
≤
p99
4.6e-05
s
Conductor DB connection use time
Time spent holding conductor database connections.
mean
6.8e-05
s
SD
1e-06
s
p50
6.8e-05
s
≤
p95
6.8e-05
s
<
p99
7.2e-05
s
Cache DB connection use time
Time spent holding cache database connections.
mean
8.3e-05
s
SD
0
s
p50
8.3e-05
s
≤
p95
8.3e-05
s
≤
p99
8.3e-05
s
WASM DB connection use time
Time spent holding WASM database connections.
mean
0.000212
s
SD
0
s
p50
0.000212
s
≤
p95
0.000212
s
≤
p99
0.000212
s
Peer meta store DB connection use time
Time spent holding peer meta store database connections.
mean
0.0001
s
SD
1.7e-05
s
p50
0.0001
s
<
p95
0.000114
s
<
p99
0.000116
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000134
s
SD
0.008884
s
p50
0.000138
s
<
p95
0.02236
s
≤
p99
0.02236
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000594
s
SD
0
s
p50
0.000594
s
≤
p95
0.000594
s
≤
p99
0.000594
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
37.25
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
163
B/s
<
mean
23.18
KiB/s
SD
28.30
KiB/s
<
p95
56.65
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
151
B/s
<
mean
19.24
KiB/s
SD
6.83
KiB/s
<
p95
23.93
KiB/s
Total bytes received
Total bytes received on primary network interface
count
6.56
MiB
mean
23.18
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
5.45
MiB
mean
19.24
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
54.74
%
<
mean
57.34
%
SD
4.03
%
≤
p95
57.08
%
System
20.09
%
CPU percentiles
CPU usage percentiles
p50
56.91
%
p95
57.08
%
p99
78.37
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
11.35
%
<
mean
14.67
%
SD
1.55
%
<
p95
15.76
%
Memory available percentage
Percentage of available memory
p5
84.24
%
<
mean
85.33
%
SD
1.55
%
<
p95
88.65
%
Max host memory used
Maximum memory usage percentage across all hosts
max
14.67
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
-291.44
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
1.57
MiB/s
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.51
5 min
0.88
15 min
0.42
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
7.1
%
<
mean
15.1067
%
SD
2.8079
%
<
p95
16.62
%
60 second average
12.9667
%
300 second average
6.9577
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
≤
mean
0
%
SD
0
%
≤
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0937
%
SD
0.2216
%
<
p95
0.73
%
60 second average
0.0833
%
300 second average
0.0590
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0213
%
SD
0.0561
%
<
p95
0.18
%
60 second average
0.0183
%
300 second average
0.0090
%
Holochain process CPU usage
CPU usage by Holochain process
p5
45.92
%
<
mean
47.21
%
SD
4.74
%
<
p95
47.69
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
226.78
KiB
≤
mean
224.09
KiB
SD
37.56
KiB
<
p95
231.17
KiB
Holochain process threads
Number of threads in Holochain process
p5
7
threads
<
mean
13.52
threads
SD
1.85
threads
<
p95
14
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
23
file descriptors
<
mean
47.52
file descriptors
SD
11.14
file descriptors
<
p95
64
file descriptors