App Install

↑ Back to index

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Thu, 09 Jul 2026 04:37:55 UTC
Peer count
1
Behaviours
  • minimal (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
app_install_minimal_28993172816_1
First install time
The time from conductor startup to completion of the first app installation attempt.
0.189379892
s
Install app timing
The time taken to install an app.
mean
0.051588
s
SD
0.007011
s
p50
0.049699
s
<
p95
0.066078
s
<
p99
0.090304
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'callback::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.001355817s
Not enough time data to show a trend.
WASM usage: 'callback_integrity::genesis_self_check_2'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.001355817s
Not enough time data to show a trend.
WASM call duration: 'callback::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000606
s
SD
8.2e-05
s
p50
0.000564
s
<
p95
0.000767
s
<
p99
0.000786
s
WASM call duration: 'callback_integrity::genesis_self_check_2'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00059
s
SD
0
s
p50
0.00059
s
p95
0.00059
s
p99
0.00059
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.005814
s
SD
0.000369
s
p50
0.00572
s
<
p95
0.006853
s
<
p99
0.007052
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.59
s
<
mean
148.59
s
SD
83.67
s
<
p95
278.59
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001425859s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000825
s
SD
0
s
p50
0.000825
s
p95
0.000825
s
p99
0.000825
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.00037
s
SD
0
s
p50
0.00037
s
p95
0.00037
s
p99
0.00037
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.0007
s
SD
0
s
p50
0.0007
s
p95
0.0007
s
p99
0.0007
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001178
s
SD
0
s
p50
0.001178
s
p95
0.001178
s
p99
0.001178
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001735
s
SD
0
s
p50
0.001735
s
p95
0.001735
s
p99
0.001735
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.002037
s
SD
0
s
p50
0.002037
s
p95
0.002037
s
p99
0.002037
s
Authored DB connection use time
Time spent holding authored database connections.
mean
6.6e-05
s
SD
7e-06
s
p50
6.5e-05
s
<
p95
7.6e-05
s
<
p99
8.4e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00023
s
SD
4.1e-05
s
p50
0.000183
s
<
p95
0.000265
s
<
p99
0.000399
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000111
s
SD
0
s
p50
0.000111
s
p95
0.000111
s
p99
0.000111
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
4.81
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
924
B/s
<
mean
7.95
KiB/s
SD
19.69
KiB/s
<
p95
15.76
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
813
B/s
<
mean
18.90
KiB/s
SD
43.12
KiB/s
<
p95
128.90
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.25
MiB
mean
7.95
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
5.35
MiB
mean
18.90
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (96.9% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
8.03
%
<
mean
8.16
%
SD
0.52
%
<
p95
8.61
%
System
3.34
%
CPU percentiles
CPU usage percentiles
p50
8.21
%
p95
8.61
%
p99
8.68
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
53.19
%
<
mean
54.11
%
SD
0.4
%
<
p95
54.59
%
Memory available percentage
Percentage of available memory
p5
45.41
%
<
mean
45.89
%
SD
0.4
%
<
p95
46.81
%
Max host memory used
Maximum memory usage percentage across all hosts
max
54.11
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
96.89
%
Memory growth rate
Rate of memory growth over time
growth
-163.40
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.19
MiB/s
Disk write throughput
Disk write throughput in MiB/s
3.78
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
1/1
hosts
Mount Point /etc/hosts
1/1
hosts
Mount Point /etc/nomad.d/client-meta.json
1/1
hosts
Mount Point /etc/resolv.conf
1/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.81
5 min
2.82
15 min
2.53
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.18
%
<
mean
0.6877
%
SD
0.2154
%
<
p95
0.94
%
60 second average
0.6017
%
300 second average
0.3850
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.021
%
SD
0.0792
%
<
p95
0.15
%
60 second average
0.0190
%
300 second average
0.0033
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.021
%
SD
0.0792
%
<
p95
0.15
%
60 second average
0.0190
%
300 second average
0.0033
%
Holochain process CPU usage
CPU usage by Holochain process
p5
5.4
%
<
mean
5.41
%
SD
0.25
%
<
p95
5.51
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
24.36
KiB
<
mean
706.66
KiB
SD
280.56
KiB
<
p95
939.53
KiB
Holochain process threads
Number of threads in Holochain process
p5
14
threads
<
mean
131.88
threads
SD
133.88
threads
<
p95
419
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
8
file descriptors
<
mean
196.21
file descriptors
SD
339.48
file descriptors
<
p95
934
file descriptors

App Install

↑ Back to index

Measure app installation speed. This scenario has two roles:

  • minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
  • large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started
Thu, 09 Jul 2026 04:31:11 UTC
Peer count
1
Behaviours
  • large (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
app_install_large_28993172816_1
First install time
The time from conductor startup to completion of the first app installation attempt.
0.182074737
s
Install app timing
The time taken to install an app.
mean
0.066859
s
SD
0.003372
s
p50
0.06621
s
<
p95
0.07339
s
<
p99
0.08234
s
Not enough time data to show a trend.
Holochain MetricsClick to toggle visibility.
WASM usage: 'large::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.001627911s
Not enough time data to show a trend.
WASM call duration: 'large::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002108
s
SD
0.000176
s
p50
0.002082
s
<
p95
0.002405
s
<
p99
0.00265
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.009459
s
SD
0.001203
s
p50
0.009056
s
<
p95
0.012275
s
<
p99
0.01456
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.32
s
<
mean
148.32
s
SD
83.67
s
<
p95
278.32
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001619436s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.001032
s
SD
6e-06
s
p50
0.001031
s
p95
0.001031
s
<
p99
0.001062
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000476
s
SD
1e-06
s
p50
0.000476
s
p95
0.000476
s
<
p99
0.000481
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000806
s
SD
2e-06
s
p50
0.000806
s
p95
0.000806
s
<
p99
0.000815
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001315
s
SD
4e-06
s
p50
0.001314
s
p95
0.001314
s
<
p99
0.001334
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.0025
s
SD
1.7e-05
s
p50
0.002497
s
p95
0.002497
s
<
p99
0.002589
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001834
s
SD
9e-06
s
p50
0.001832
s
p95
0.001832
s
<
p99
0.001882
s
Authored DB connection use time
Time spent holding authored database connections.
mean
8.4e-05
s
SD
1.2e-05
s
p50
8.1e-05
s
<
p95
0.000114
s
<
p99
0.000138
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000258
s
SD
4.2e-05
s
p50
0.000214
s
<
p95
0.000281
s
<
p99
0.000439
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000142
s
SD
0
s
p50
0.000142
s
p95
0.000142
s
p99
0.000142
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
8.08
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.11
KiB/s
<
mean
7.33
KiB/s
SD
19.15
KiB/s
<
p95
10.98
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
1.47
KiB/s
<
mean
11.40
KiB/s
SD
23.84
KiB/s
<
p95
39.00
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.15
MiB
mean
7.33
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
3.34
MiB
mean
11.40
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (96.9% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
8.05
%
<
mean
12.47
%
SD
4.16
%
<
p95
18.9
%
System
4.39
%
CPU percentiles
CPU usage percentiles
p50
11.89
%
p95
18.90
%
p99
19.02
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
53.81
%
<
mean
55.44
%
SD
1.25
%
<
p95
57.48
%
Memory available percentage
Percentage of available memory
p5
42.52
%
<
mean
44.56
%
SD
1.25
%
<
p95
46.19
%
Max host memory used
Maximum memory usage percentage across all hosts
max
55.44
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
96.89
%
Memory growth rate
Rate of memory growth over time
growth
-2369.05
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
20.52
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
1/1
hosts
Mount Point /etc/hosts
1/1
hosts
Mount Point /etc/nomad.d/client-meta.json
1/1
hosts
Mount Point /etc/resolv.conf
1/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.46
5 min
3.60
15 min
2.51
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.3471
%
SD
0.2797
%
<
p95
0.91
%
60 second average
0.2426
%
300 second average
0.0848
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0042
%
SD
0.0166
%
<
p95
0.03
%
60 second average
0.0023
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0042
%
SD
0.0166
%
<
p95
0.03
%
60 second average
0.0023
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
5.43
%
<
mean
5.54
%
SD
0.18
%
<
p95
5.56
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
24.54
KiB
<
mean
840.11
KiB
SD
287.53
KiB
<
p95
1.03
MiB
Holochain process threads
Number of threads in Holochain process
p5
15
threads
<
mean
137.72
threads
SD
138.84
threads
<
p95
425
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
8
file descriptors
<
mean
208.47
file descriptors
SD
350.64
file descriptors
<
p95
940
file descriptors

DHT Sync Lag

↑ Back to index

Measures the lag time between an agent publishing data and other peers being able to see it. This scenario has two roles:

  • write: Creates entries with a timestamp field, linked to a known base hash so that record_lag agents can discover them.
  • record_lag: Repeatedly queries for links from the known base hash. When a new entry is discovered, it calculates the time difference between the entry's timestamp and the current time, giving the sync lag for that entry.
Started
Thu, 09 Jul 2026 04:44:49 UTC
Peer count
30
Peer count at end
27
Behaviours
  • record_lag (1 agent)
  • write (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
dht_sync_lag_28993172816_1
Create rate
The average number of created records per agent.
Mean
mean
50.7
/s
Max
Highest per-partition mean rate
max
116.28
/s
Min
Lowest per-partition mean rate
min
9.31
/s
Sync lag timing
The average time between when a record was created and when it is first seen by an agent.
Mean
mean
821.245087
s
SD
480.504105
s
Max
Highest per-partition mean latency
max mean
1065.444176
s
Min
Lowest per-partition mean latency
min mean
571.027708
s
Sync lag rate
The average number of created records discovered per agent.
Mean
mean
49.23
/s
Max
Highest per-partition mean rate
max
65.04
/s
Min
Lowest per-partition mean rate
min
27.27
/s
Delivery ratio
The proportion of created entries successfully received by all record_lag agents.
0.0125
Sent count
The total number of entries sent (created) by write agents, by agent.
Total
186166
Agents affected
23 / 23
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
8094
Max
Highest count in any single partition
21029
Min
Lowest count in any single partition
1551
Received count
The total number of entries received by record_lag agents, by agent.
Total
11641
Agents affected
5 / 5
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
2328
Max
Highest count in any single partition
3420
Min
Lowest count in any single partition
1135
Error count
The number of errors encountered during the scenario.
1159
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000124
s
SD
5.3e-05
s
p50
0.000145
s
<
p95
0.000227
s
<
p99
0.00023
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
1
over 1996.21498139s
mean rate
154.68
/s
std
865
/s
p5
0
/s
p95
720.82
/s
peak
13107.83
/s
WASM usage: 'timed::created_timed_entry'
Metered usage count of the WASM ribosome for this zome function.
total
421287220
over 38370.260998541s
mean rate
8.22149035103e+09
/s
std
1.05775360289e+11
/s
p5
57206.73
/s
p95
1.97657339879e+10
/s
peak
3.108766873e+12
/s
WASM usage: 'timed::get_timed_entries_local'
Metered usage count of the WASM ribosome for this zome function.
total
340390019987
over 1792.121341936s
mean rate
1.85581402161e+11
/s
std
2.63788782225e+11
/s
p5
8.5883290955e+08
/s
p95
7.98692880395e+11
/s
peak
9.01360454583e+11
/s
WASM usage: 'timed_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
47590960
over 38370.260998541s
mean rate
1.07463752576e+09
/s
std
1.14487480053e+10
/s
p5
9693.51
/s
p95
2.43374190645e+09
/s
peak
3.51183688654e+11
/s
Zome call duration: 'timed::created_timed_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.039611
s
SD
0.030924
s
p50
0.032159
s
<
p95
0.118992
s
<
p99
0.145789
s
Zome call duration: 'timed::get_timed_entries_local'
Duration of this zome call as measured by Holochain internally.
mean
0.070473
s
SD
0.075052
s
p50
0.068763
s
<
p95
0.252698
s
<
p99
0.279091
s
WASM call duration: 'timed::created_timed_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.027855
s
SD
0.023558
s
p50
0.022096
s
<
p95
0.089374
s
<
p99
0.109478
s
WASM call duration: 'timed::get_timed_entries_local'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.068587
s
SD
0.074734
s
p50
0.066765
s
<
p95
0.25013
s
<
p99
0.276181
s
WASM call duration: 'timed_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001167
s
SD
0.000947
s
p50
0.001146
s
<
p95
0.003928
s
<
p99
0.004548
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.00108
s
SD
0.003099
s
p50
0.000426
s
<
p95
0.01014
s
<
p99
0.012117
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.001101
s
SD
0.00316
s
p50
0.00045
s
<
p95
0.010066
s
<
p99
0.012823
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000132
s
SD
5.8e-05
s
p50
0.000156
s
<
p95
0.000243
s
<
p99
0.000246
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.003422
s
SD
0.003102
s
p50
0.003643
s
<
p95
0.010969
s
<
p99
0.012859
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.010282
s
SD
0.008811
s
p50
0.008162
s
<
p95
0.029384
s
<
p99
0.040257
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.012311
s
SD
0.009854
s
p50
0.012028
s
<
p95
0.032147
s
<
p99
0.039077
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
95.18
s
<
mean
902.49
s
SD
519.73
s
<
p95
1715.19
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
47.70791
s
SD
51.351547
s
p50
21.233048
s
<
p95
148.525168
s
<
p99
248.760223
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
3.799788
s
SD
9.037021
s
p50
1.584461
s
<
p95
28.826301
s
<
p99
43.753256
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001341
s
SD
0.000925
s
p50
0.00112
s
<
p95
0.003634
s
<
p99
0.003792
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.043139
s
SD
0.130222
s
p50
0.043943
s
<
p95
0.353764
s
<
p99
0.633879
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.265974
s
SD
0.329365
s
p50
0.176535
s
<
p95
0.611767
s
<
p99
2.191129
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
26.82211
s
SD
36.953085
s
p50
23.84675
s
<
p95
121.169523
s
<
p99
159.366336
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
3.014297
s
SD
53.605154
s
p50
0.014228
s
<
p95
93.277579
s
<
p99
206.203239
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.005767
s
SD
0.004029
s
p50
0.003396
s
<
p95
0.012539
s
<
p99
0.014697
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.004282
s
SD
0.010837
s
p50
0.001163
s
<
p95
0.031216
s
<
p99
0.049723
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.001059
s
SD
0.00247
s
p50
0.000332
s
<
p95
0.008286
s
<
p99
0.011117
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
2.246219
s
SD
29.851959
s
p50
0.361042
s
<
p95
60.008776
s
<
p99
60.710971
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.144883
s
SD
3.466699
s
p50
0.203567
s
<
p95
8.950302
s
<
p99
10.261133
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
41.20
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
846
B/s
<
mean
317.26
KiB/s
SD
495.89
KiB/s
<
p95
1.06
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
253
B/s
<
mean
279.07
KiB/s
SD
334.04
KiB/s
<
p95
862.30
KiB/s
Total bytes received
Total bytes received on primary network interface
count
15.32
GiB
mean
7.62
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
13.48
GiB
mean
6.70
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.0%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 707.34 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/7 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (98.0% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 32% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
4.08
%
<
mean
50.56
%
SD
33.92
%
<
p95
97.4
%
System
9.36
%
CPU percentiles
CPU usage percentiles
p50
44.88
%
p95
97.40
%
p99
98.00
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
13
hosts
mean time
0.60
s
Memory used percentage
Percentage of memory used
p5
6.84
%
<
mean
14.81
%
SD
8.53
%
<
p95
25.97
%
Memory available percentage
Percentage of available memory
p5
74.03
%
<
mean
85.19
%
SD
8.53
%
<
p95
93.16
%
Max host memory used
Maximum memory usage percentage across all hosts
max
54.24
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
97.98
%
Memory growth rate
Rate of memory growth over time
growth
707.34
MiB/s
Disk read throughput
Disk read throughput in MiB/s
3.26
MiB/s
Disk write throughput
Disk write throughput in MiB/s
208.95
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/5
hosts
Mount Point /efi-boot
0/4
hosts
Mount Point /etc/hostname
1/7
hosts
Mount Point /etc/hosts
1/7
hosts
Mount Point /etc/nomad.d/client-meta.json
1/8
hosts
Mount Point /etc/resolv.conf
1/7
hosts
Mount Point /nix/store
0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.78
5 min
3.29
15 min
2.29
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
32.14
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
21.3119
%
SD
26.8191
%
<
p95
76.93
%
60 second average
20.6755
%
300 second average
17.8335
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
16.2959
%
SD
24.5546
%
<
p95
68.58
%
60 second average
15.9000
%
300 second average
13.5885
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
13.8863
%
SD
23.5666
%
<
p95
65.86
%
60 second average
13.5542
%
300 second average
11.5900
%
Holochain process CPU usage
CPU usage by Holochain process
p5
3.24
%
<
mean
47.05
%
SD
32.74
%
<
p95
94.83
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
277.65
KiB
<
mean
468.85
KiB
SD
213.94
KiB
<
p95
756.48
KiB
Holochain process threads
Number of threads in Holochain process
p5
33
threads
<
mean
46.21
threads
SD
22.07
threads
<
p95
74
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
76
file descriptors
<
mean
101.15
file descriptors
SD
24.79
file descriptors
<
p95
129
file descriptors

First Call

↑ Back to index

This scenario installs a simple app which implements the init callback, and measures the time elapsed between start of install and calling init. It will uninstall the app it installed so that it can re-install it on the next iteration. This is required to re-run the initialisation callback.

Started
Thu, 09 Jul 2026 04:04:41 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
first_call_28993172816_1
Zome call timing
The time elapsed between start of install and calling init.
mean
0.0122
s
SD
0.000937
s
p50
0.012041
s
<
p95
0.013186
s
<
p99
0.017586
s
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.001824072s
Not enough time data to show a trend.
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.001824072s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.001824072s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.009073
s
SD
0
s
p50
0.009073
s
p95
0.009073
s
p99
0.009073
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002658
s
SD
0.000505
s
p50
0.002521
s
<
p95
0.003247
s
<
p99
0.005441
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000758
s
SD
8.6e-05
s
p50
0.000718
s
<
p95
0.000967
s
<
p99
0.001023
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000559
s
SD
0
s
p50
0.000559
s
p95
0.000559
s
p99
0.000559
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000146
s
SD
2.4e-05
s
p50
0.000171
s
p95
0.000171
s
p99
0.000171
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.001776
s
SD
0
s
p50
0.001776
s
p95
0.001776
s
p99
0.001776
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.003286
s
SD
0.000163
s
p50
0.003243
s
<
p95
0.00356
s
<
p99
0.003754
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.66
s
<
mean
148.66
s
SD
83.67
s
<
p95
278.66
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001881541s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000774
s
SD
0
s
p50
0.000774
s
p95
0.000774
s
p99
0.000774
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000336
s
SD
0
s
p50
0.000336
s
p95
0.000336
s
p99
0.000336
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000578
s
SD
0
s
p50
0.000578
s
p95
0.000578
s
p99
0.000578
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.001153
s
SD
0
s
p50
0.001153
s
p95
0.001153
s
p99
0.001153
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001769
s
SD
0
s
p50
0.001769
s
p95
0.001769
s
p99
0.001769
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001667
s
SD
0
s
p50
0.001667
s
p95
0.001667
s
p99
0.001667
s
Authored DB connection use time
Time spent holding authored database connections.
mean
6.8e-05
s
SD
6e-06
s
p50
6.7e-05
s
<
p95
7.7e-05
s
<
p99
8.1e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000211
s
SD
2.6e-05
s
p50
0.000207
s
<
p95
0.000266
s
<
p99
0.00031
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000107
s
SD
0
s
p50
0.000107
s
p95
0.000107
s
p99
0.000107
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
3.89
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.90
KiB/s
<
mean
1.65
MiB/s
SD
4.19
MiB/s
<
p95
15.85
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
1.68
KiB/s
<
mean
24.13
KiB/s
SD
45.29
KiB/s
<
p95
148.36
KiB/s
Total bytes received
Total bytes received on primary network interface
count
477.58
MiB
mean
1.65
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
6.83
MiB
mean
24.13
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1554.80 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (97.3% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
6.08
%
<
mean
6.92
%
SD
1.09
%
<
p95
9.67
%
System
3.03
%
CPU percentiles
CPU usage percentiles
p50
6.39
%
p95
9.67
%
p99
10.72
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
52.68
%
<
mean
53.57
%
SD
0.79
%
<
p95
55.04
%
Memory available percentage
Percentage of available memory
p5
44.96
%
<
mean
46.43
%
SD
0.79
%
<
p95
47.32
%
Max host memory used
Maximum memory usage percentage across all hosts
max
53.57
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
97.34
%
Memory growth rate
Rate of memory growth over time
growth
1554.80
MiB/s
Disk read throughput
Disk read throughput in MiB/s
2.74
MiB/s
Disk write throughput
Disk write throughput in MiB/s
10.43
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
1/1
hosts
Mount Point /etc/hosts
1/1
hosts
Mount Point /etc/nomad.d/client-meta.json
1/1
hosts
Mount Point /etc/resolv.conf
1/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.29
5 min
1.16
15 min
0.61
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0.32
%
<
mean
0.93
%
SD
0.222
%
<
p95
1.12
%
60 second average
0.7720
%
300 second average
0.3637
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0043
%
SD
0.0169
%
<
p95
0.03
%
60 second average
0.0023
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0043
%
SD
0.0169
%
<
p95
0.03
%
60 second average
0.0023
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.01
%
<
mean
1.83
%
SD
2.05
%
<
p95
4.27
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
457.43
KiB
<
mean
564.72
KiB
SD
109.57
KiB
<
p95
706.13
KiB
Holochain process threads
Number of threads in Holochain process
p5
80
threads
<
mean
153.1
threads
SD
126.61
threads
<
p95
421
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
43
file descriptors
<
mean
247.73
file descriptors
SD
334.33
file descriptors
<
p95
951
file descriptors

Local Signals

↑ Back to index

This scenario is for testing the speed and reliability of local signals. It uses a zome with a function that will emit 10,000 signals. The scenario measures how long it takes to send the signals and how many have been received by the time the zome call ends.

Started
Thu, 09 Jul 2026 04:06:38 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
local_signals_28993172816_1
Send timing
The time taken to emit a batch of 10,000 signals.
mean
0.829328
s
SD
0.403804
s
p50
0.957353
s
<
p95
1.452943
s
p99
1.452943
s
Receive timing
The time taken to receive the completed batch, to the nearest 250ms.
mean
28.971995
s
SD
3.086943
s
p50
30.000904
s
<
p95
30.001548
s
p99
30.001548
s
Success ratio
The proportion of signals successfully received in a batch.
min
0.948099970817566
<
mean
0.9865
SD
0.0137
<
max
0.9965999722480774
Holochain MetricsClick to toggle visibility.
WASM usage: 'signal::emit_10k_signals'
Metered usage count of the WASM ribosome for this zome function.
total
301963473
over 280.001773222s
mean rate
1.07843381e+06
/s
std
1.56692799e+06
/s
p5
0
/s
p95
3.35512922e+06
/s
peak
3.35513035e+06
/s
Zome call duration: 'signal::emit_10k_signals'
Duration of this zome call as measured by Holochain internally.
mean
0.072674
s
SD
0.001685
s
p50
0.072382
s
<
p95
0.076773
s
p99
0.076773
s
WASM call duration: 'signal::emit_10k_signals'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.069146
s
SD
0.00051
s
p50
0.069102
s
<
p95
0.069815
s
p99
0.069815
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
5e-06
s
SD
0
s
p50
5e-06
s
p95
5e-06
s
p99
5e-06
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
90000
over 280.0017826s
mean rate
321.43
/s
std
467.02
/s
p5
0
/s
p95
999.99
/s
peak
999.99
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.010338
s
SD
0
s
p50
0.010338
s
p95
0.010338
s
p99
0.010338
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.59
s
<
mean
148.59
s
SD
83.67
s
<
p95
278.6
s
Dropped WebSocket signals
Count of signals dropped from the app WebSocket due to channel overload.
total
70
over 280.001773042s
mean rate
0.25
/s
std
0.43
/s
p5
0
/s
p95
1.2
/s
peak
1.6
/s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001774114s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.014928
s
SD
0
s
p50
0.014928
s
p95
0.014928
s
p99
0.014928
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000545
s
SD
0
s
p50
0.000545
s
p95
0.000545
s
p99
0.000545
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000724
s
SD
0
s
p50
0.000724
s
p95
0.000724
s
p99
0.000724
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.003652
s
SD
0.00052
s
p50
0.003769
s
<
p95
0.004613
s
p99
0.004613
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.014644
s
SD
0
s
p50
0.014644
s
p95
0.014644
s
p99
0.014644
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.014672
s
SD
0
s
p50
0.014672
s
p95
0.014672
s
p99
0.014672
s
Authored DB connection use time
Time spent holding authored database connections.
mean
7.9e-05
s
SD
2e-06
s
p50
7.9e-05
s
<
p95
8.5e-05
s
p99
8.5e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
4.1e-05
s
SD
8e-05
s
p50
0.0002
s
p95
0.0002
s
p99
0.0002
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000137
s
SD
0
s
p50
0.000137
s
p95
0.000137
s
p99
0.000137
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
3.21
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
2.24
KiB/s
<
mean
1.59
MiB/s
SD
4.20
MiB/s
<
p95
15.84
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
2.73
KiB/s
<
mean
71.82
KiB/s
SD
68.29
KiB/s
<
p95
162.76
KiB/s
Total bytes received
Total bytes received on primary network interface
count
462.49
MiB
mean
1.59
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
20.34
MiB
mean
71.82
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 221.80 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (97.1% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
1.79
%
<
mean
5.64
%
SD
2.53
%
<
p95
9.67
%
System
2.43
%
CPU percentiles
CPU usage percentiles
p50
6.41
%
p95
9.67
%
p99
10.72
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
53.56
%
<
mean
53.93
%
SD
0.52
%
<
p95
55.04
%
Memory available percentage
Percentage of available memory
p5
44.96
%
<
mean
46.07
%
SD
0.52
%
<
p95
46.44
%
Max host memory used
Maximum memory usage percentage across all hosts
max
53.93
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
97.11
%
Memory growth rate
Rate of memory growth over time
growth
221.80
MiB/s
Disk read throughput
Disk read throughput in MiB/s
6.22
MiB/s
Disk write throughput
Disk write throughput in MiB/s
13.25
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
1/1
hosts
Mount Point /etc/hosts
1/1
hosts
Mount Point /etc/nomad.d/client-meta.json
1/1
hosts
Mount Point /etc/resolv.conf
1/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.25
5 min
1.53
15 min
0.81
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.6677
%
SD
0.4529
%
<
p95
1.12
%
60 second average
0.7657
%
300 second average
0.5087
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.01
%
<
mean
0.33
%
SD
0.74
%
<
p95
0.35
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
20.77
KiB
<
mean
381.52
KiB
SD
210.49
KiB
<
p95
522.64
KiB
Holochain process threads
Number of threads in Holochain process
p5
14
threads
<
mean
72.8
threads
SD
34
threads
<
p95
100
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
8
file descriptors
<
mean
65.93
file descriptors
SD
36.83
file descriptors
<
p95
105
file descriptors

Remote Call Rate

↑ Back to index

Test the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

Started
Thu, 09 Jul 2026 04:08:34 UTC
Peer count
10
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
remote_call_rate_28993172816_1
Dispatch timing
The time between sending a remote call and the remote handler being invoked.
Mean
mean
0.046445
s
SD
0.045261
s
Max
Highest per-partition mean latency
max mean
0.064879
s
Min
Lowest per-partition mean latency
min mean
0.027
s
Round-trip timing
The total elapsed time to get a response to the client.
Mean
mean
0.097315
s
SD
0.072371
s
Max
Highest per-partition mean latency
max mean
0.140965
s
Min
Lowest per-partition mean latency
min mean
0.066932
s
Error count
The total number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_call::call_echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
230815804
over 894.455715192s
mean rate
1.22713655958e+09
/s
std
1.64428518928e+09
/s
p5
1.84358862e+07
/s
p95
5.03575404297e+09
/s
peak
5.67582694582e+09
/s
WASM usage: 'remote_call::echo_timestamp'
Metered usage count of the WASM ribosome for this zome function.
total
69765624
over 894.455715192s
mean rate
2.79014932e+06
/s
std
2.83028107e+06
/s
p5
154843.92
/s
p95
8.57534088e+06
/s
peak
1.00970183e+07
/s
WASM usage: 'remote_call::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 894.455715192s
Not enough time data to show a trend.
Zome call duration: 'remote_call::call_echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.09364
s
SD
0.034976
s
p50
0.105842
s
<
p95
0.147981
s
<
p99
0.191254
s
Zome call duration: 'remote_call::echo_timestamp'
Duration of this zome call as measured by Holochain internally.
mean
0.007132
s
SD
0.00372
s
p50
0.007809
s
<
p95
0.014527
s
<
p99
0.015743
s
WASM call duration: 'remote_call::call_echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.089432
s
SD
0.034048
s
p50
0.096836
s
<
p95
0.143227
s
<
p99
0.178446
s
WASM call duration: 'remote_call::echo_timestamp'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002338
s
SD
0.000997
s
p50
0.002363
s
<
p95
0.003755
s
<
p99
0.003761
s
WASM call duration: 'remote_call::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.009427
s
SD
0.006343
s
p50
0.006863
s
<
p95
0.01844
s
p99
0.01844
s
Host function call duration: '__hc__call_1'
Duration of this host function call invoked from within WASM.
mean
0.083617
s
SD
0.033328
s
p50
0.084429
s
<
p95
0.135931
s
<
p99
0.167045
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000265
s
SD
5.4e-05
s
p50
0.000268
s
<
p95
0.000356
s
p99
0.000356
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
2.5e-05
s
SD
1.5e-05
s
p50
2.4e-05
s
<
p95
6.5e-05
s
p99
6.5e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.003583
s
SD
0.00522
s
p50
0.004066
s
<
p95
0.017125
s
p99
0.017125
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.015848
s
SD
0.01524
s
p50
0.011517
s
<
p95
0.043513
s
p99
0.043513
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.02
s
<
mean
447.27
s
SD
256.91
s
<
p95
847.03
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
57
over 894.455777314s
mean rate
33.66
/s
std
213.15
/s
p5
0
/s
p95
38.44
/s
peak
1984.07
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
1.422292
s
SD
0.86367
s
p50
1.164563
s
<
p95
2.644562
s
<
p99
3.036031
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.062341
s
SD
0.138033
s
p50
0.070936
s
<
p95
0.196851
s
<
p99
0.935915
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001833
s
SD
0.000816
s
p50
0.001665
s
<
p95
0.003088
s
p99
0.003088
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.049599
s
SD
0.035159
s
p50
0.063999
s
<
p95
0.119352
s
p99
0.119352
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.005151
s
SD
0.001641
s
p50
0.004612
s
<
p95
0.007914
s
<
p99
0.009308
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.169372
s
SD
0.181861
s
p50
0.029154
s
<
p95
0.449373
s
<
p99
0.819661
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.160579
s
SD
0.152545
s
p50
0.065192
s
<
p95
0.417008
s
<
p99
0.518791
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000266
s
SD
0.000118
s
p50
0.000285
s
<
p95
0.000448
s
<
p99
0.000449
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000155
s
SD
0.000597
s
p50
0.000369
s
<
p95
0.001993
s
<
p99
0.002693
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000442
s
SD
0.000208
s
p50
0.000463
s
<
p95
0.0008
s
<
p99
0.000802
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.042772
s
SD
0.038345
s
p50
0.031559
s
<
p95
0.121664
s
<
p99
0.142504
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.104655
s
SD
0.050188
s
p50
0.102088
s
<
p95
0.218765
s
p99
0.218765
s
P2P request roundtrip: 'call_remote'
Time spent sending a call_remote request and awaiting its response.
mean
0.083015
s
SD
0.033285
s
p50
0.083545
s
<
p95
0.135117
s
<
p99
0.166038
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
11.78
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
12.94
KiB/s
<
mean
158.37
KiB/s
SD
1.08
MiB/s
p95
30.58
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
10.83
KiB/s
<
mean
19.78
KiB/s
SD
21.89
KiB/s
<
p95
45.75
KiB/s
Total bytes received
Total bytes received on primary network interface
count
1.08
GiB
mean
1.22
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
138.14
MiB
mean
155.45
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 2984.87 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (96.9% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2
%
<
mean
20.55
%
SD
12.21
%
<
p95
38.28
%
System
8.77
%
CPU percentiles
CPU usage percentiles
p50
17.29
%
p95
38.28
%
p99
62.94
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
4
hosts
mean time
0.01
s
Memory used percentage
Percentage of memory used
p5
11.48
%
<
mean
19.43
%
SD
13.77
%
<
p95
55.69
%
Memory available percentage
Percentage of available memory
p5
44.31
%
<
mean
80.57
%
SD
13.77
%
<
p95
88.52
%
Max host memory used
Maximum memory usage percentage across all hosts
max
54.89
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
96.90
%
Memory growth rate
Rate of memory growth over time
growth
2984.87
MiB/s
Disk read throughput
Disk read throughput in MiB/s
1.28
MiB/s
Disk write throughput
Disk write throughput in MiB/s
28.55
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
1/1
hosts
Mount Point /etc/hosts
1/1
hosts
Mount Point /etc/nomad.d/client-meta.json
1/5
hosts
Mount Point /etc/resolv.conf
1/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.03
5 min
0.81
15 min
0.54
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
4.5943
%
SD
6.3878
%
<
p95
10.56
%
60 second average
4.3841
%
300 second average
3.1959
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0781
%
SD
0.2696
%
<
p95
0.44
%
60 second average
0.0707
%
300 second average
0.0437
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0623
%
SD
0.223
%
<
p95
0.37
%
60 second average
0.0559
%
300 second average
0.0347
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.3
%
<
mean
8.34
%
SD
6.99
%
<
p95
16.49
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
215.15
KiB
<
mean
266.94
KiB
SD
102.97
KiB
<
p95
524.02
KiB
Holochain process threads
Number of threads in Holochain process
p5
32
threads
<
mean
42.67
threads
SD
20.06
threads
<
p95
100
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
72
file descriptors
<
mean
88.73
file descriptors
SD
16.64
file descriptors
<
p95
107
file descriptors

Remote Signals

↑ Back to index

This scenario tests the throughput of remote_signals operations.

Started
Thu, 09 Jul 2026 04:15:17 UTC
Peer count
10
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
remote_signals_28993172816_1
Round trip time
The time from origin signal dispatch to origin receive of the remote side's response signal.
mean
0.116012
s
SD
0.288309
s
p50
0.066069
s
<
p95
0.233919
s
<
p99
0.296255
s
Timeout rate
The proportion of remote signal round-trips that timed out.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'remote_signal::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 895.551963521s
Not enough time data to show a trend.
WASM usage: 'remote_signal::recv_remote_signal'
Metered usage count of the WASM ribosome for this zome function.
total
36727175
over 887.579953181s
mean rate
5.436925151e+07
/s
std
4.311629015e+08
/s
p5
0
/s
p95
1.7203760892e+08
/s
peak
7.35538967611e+09
/s
WASM usage: 'remote_signal::signal_request'
Metered usage count of the WASM ribosome for this zome function.
total
15539070
over 895.551963521s
mean rate
4.18913365e+06
/s
std
1.356473222e+07
/s
p5
0
/s
p95
2.132580325e+07
/s
peak
7.105631674e+07
/s
Zome call duration: 'remote_signal::recv_remote_signal'
Duration of this zome call as measured by Holochain internally.
mean
0.008976
s
SD
0.007542
s
p50
0.010292
s
<
p95
0.027573
s
<
p99
0.034891
s
Zome call duration: 'remote_signal::signal_request'
Duration of this zome call as measured by Holochain internally.
mean
0.009261
s
SD
0.007672
s
p50
0.010566
s
<
p95
0.028034
s
<
p99
0.035493
s
WASM call duration: 'remote_signal::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.027639
s
SD
0.024157
s
p50
0.022868
s
<
p95
0.092797
s
p99
0.092797
s
WASM call duration: 'remote_signal::recv_remote_signal'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002358
s
SD
0.00094
s
p50
0.002425
s
<
p95
0.003437
s
<
p99
0.003535
s
WASM call duration: 'remote_signal::signal_request'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.002286
s
SD
0.000914
s
p50
0.002348
s
<
p95
0.003337
s
<
p99
0.003402
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.00033
s
SD
0.000172
s
p50
0.000257
s
<
p95
0.000677
s
p99
0.000677
s
Host function call duration: '__hc__emit_signal_1'
Duration of this host function call invoked from within WASM.
mean
0.000101
s
SD
4.7e-05
s
p50
0.000109
s
<
p95
0.000168
s
<
p99
0.000201
s
Host function call duration: '__hc__send_remote_signal_1'
Duration of this host function call invoked from within WASM.
mean
0.000123
s
SD
6.2e-05
s
p50
0.000137
s
<
p95
0.000206
s
<
p99
0.00025
s
Host function call duration: '__hc__sys_time_1'
Duration of this host function call invoked from within WASM.
mean
1.1e-05
s
SD
4e-06
s
p50
1.1e-05
s
<
p95
1.5e-05
s
p99
1.5e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.02613
s
SD
0.023965
s
p50
0.021255
s
<
p95
0.091087
s
p99
0.091087
s
Emitted local signals
Count of local signals emitted via the emit_signal host function.
total
1732
over 887.579812689s
mean rate
4759.51
/s
std
37739.23
/s
p5
0
/s
p95
6063.85
/s
peak
650195.06
/s
Sent remote signals
Count of remote signals sent via the send_remote_signal host function.
total
1738
over 895.551869851s
mean rate
4774.85
/s
std
36364.89
/s
p5
0
/s
p95
7995.62
/s
peak
641848.52
/s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.019151
s
SD
0.020304
s
p50
0.006738
s
<
p95
0.058768
s
p99
0.058768
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.44
s
<
mean
451.81
s
SD
259.8
s
<
p95
856.45
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
117
over 897.580008786s
mean rate
291.51
/s
std
1637.66
/s
p5
0
/s
p95
22.22
/s
peak
16670.6
/s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
2.342833
s
SD
0.913688
s
p50
2.402015
s
<
p95
3.560729
s
<
p99
5.043056
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.257127
s
SD
0.456531
s
p50
0.297406
s
<
p95
1.492844
s
<
p99
1.991523
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.004926
s
SD
0.003107
s
p50
0.005438
s
<
p95
0.010082
s
p99
0.010082
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.025343
s
SD
0.023418
s
p50
0.019184
s
<
p95
0.087358
s
p99
0.087358
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.005709
s
SD
0.002625
s
p50
0.00566
s
<
p95
0.010591
s
<
p99
0.012494
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.216307
s
SD
0.581638
s
p50
0.204076
s
<
p95
1.699
s
<
p99
3.38805
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.281903
s
SD
0.285164
s
p50
0.284983
s
<
p95
1.034137
s
<
p99
1.240776
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.00025
s
SD
0.000106
s
p50
0.000289
s
<
p95
0.000374
s
<
p99
0.000451
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000137
s
SD
0.000468
s
p50
0.000514
s
<
p95
0.001332
s
<
p99
0.001918
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000568
s
SD
0.000227
s
p50
0.000607
s
<
p95
0.000792
s
<
p99
0.000807
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.035598
s
SD
0.030463
s
p50
0.031795
s
<
p95
0.091284
s
p99
0.091284
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.071692
s
SD
0.036293
s
p50
0.057829
s
<
p95
0.139618
s
p99
0.139618
s
P2P received remote signals
Count of remote signals received.
total
1734
over 887.579905953s
mean rate
1702.19
/s
std
11600.24
/s
p5
0
/s
p95
8104.91
/s
peak
193817.23
/s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
11.10
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
4.91
KiB/s
<
mean
101.44
KiB/s
SD
664.72
KiB/s
p95
29.08
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
4.39
KiB/s
<
mean
16.63
KiB/s
SD
15.62
KiB/s
<
p95
44.64
KiB/s
Total bytes received
Total bytes received on primary network interface
count
441.81
MiB
mean
502.69
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
72.43
MiB
mean
82.41
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (96.9% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
4.83
%
<
mean
16.08
%
SD
12.86
%
<
p95
28.79
%
System
4.98
%
CPU percentiles
CPU usage percentiles
p50
11.67
%
p95
28.79
%
p99
75.40
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
4
hosts
mean time
0.01
s
Memory used percentage
Percentage of memory used
p5
14.18
%
<
mean
24.51
%
SD
15.61
%
<
p95
56.73
%
Memory available percentage
Percentage of available memory
p5
43.27
%
<
mean
75.49
%
SD
15.61
%
<
p95
85.82
%
Max host memory used
Maximum memory usage percentage across all hosts
max
55.54
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
96.90
%
Memory growth rate
Rate of memory growth over time
growth
-283.49
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.62
MiB/s
Disk write throughput
Disk write throughput in MiB/s
33.29
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
1/1
hosts
Mount Point /etc/hosts
1/1
hosts
Mount Point /etc/nomad.d/client-meta.json
1/3
hosts
Mount Point /etc/resolv.conf
1/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
1.09
5 min
0.99
15 min
0.66
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
5.3913
%
SD
7.808
%
<
p95
11.14
%
60 second average
5.6098
%
300 second average
5.5460
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0702
%
SD
0.1915
%
<
p95
0.44
%
60 second average
0.0668
%
300 second average
0.0532
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.052
%
SD
0.1502
%
<
p95
0.36
%
60 second average
0.0490
%
300 second average
0.0384
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.17
%
<
mean
3.43
%
SD
4.25
%
<
p95
6.32
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
215.80
KiB
<
mean
290.74
KiB
SD
163.82
KiB
<
p95
563.48
KiB
Holochain process threads
Number of threads in Holochain process
p5
33
threads
<
mean
46.07
threads
SD
23.02
threads
<
p95
85
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
72
file descriptors
<
mean
90.55
file descriptors
SD
17.18
file descriptors
<
p95
115
file descriptors

Single-write, many-read

↑ Back to index

Creates an entry in the agent setup, then read one's own record back. This tests the maximum read performance for reading back local data when the chain is short.

Started
Thu, 09 Jul 2026 04:17:09 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
single_write_many_read_28993172816_1
read call timing
The time it takes to complete the zome call that retrieves the record.
mean
0.002463
s
SD
0.002267
s
p50
0.002324
s
<
p95
0.003062
s
<
p99
0.003836
s
read call rate
The number of read zome calls completed per second.
mean
4048.03
/s
Error count
The number of errors collected.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000114
s
SD
5e-06
s
p50
0.000111
s
<
p95
0.000121
s
p99
0.000121
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.00159246s
Not enough time data to show a trend.
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
5421888232
over 280.00159246s
mean rate
1.936377626e+07
/s
std
1.78701831e+06
/s
p5
1.68661701e+07
/s
p95
2.214700917e+07
/s
peak
2.27258041e+07
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.00159246s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.00159246s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.013147
s
SD
0
s
p50
0.013147
s
p95
0.013147
s
p99
0.013147
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.001655
s
SD
6.9e-05
s
p50
0.001614
s
<
p95
0.001738
s
<
p99
0.001745
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003586
s
SD
0
s
p50
0.003586
s
p95
0.003586
s
p99
0.003586
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000735
s
SD
2.2e-05
s
p50
0.000724
s
<
p95
0.000759
s
<
p99
0.000761
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000832
s
SD
0
s
p50
0.000832
s
p95
0.000832
s
p99
0.000832
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000561
s
SD
0
s
p50
0.000561
s
p95
0.000561
s
p99
0.000561
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000177
s
SD
5e-06
s
p50
0.000182
s
p95
0.000182
s
p99
0.000182
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000133
s
SD
6e-06
s
p50
0.000129
s
<
p95
0.000141
s
<
p99
0.000142
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002546
s
SD
0
s
p50
0.002546
s
p95
0.002546
s
p99
0.002546
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.003822
s
SD
0
s
p50
0.003822
s
p95
0.003822
s
p99
0.003822
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.51
s
<
mean
148.51
s
SD
83.67
s
<
p95
278.51
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001601477s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000742
s
SD
0
s
p50
0.000742
s
p95
0.000742
s
p99
0.000742
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000492
s
SD
0
s
p50
0.000492
s
p95
0.000492
s
p99
0.000492
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000542
s
SD
0
s
p50
0.000542
s
p95
0.000542
s
p99
0.000542
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.003655
s
SD
0.000443
s
p50
0.003747
s
<
p95
0.00446
s
p99
0.00446
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.018772
s
SD
0
s
p50
0.018772
s
p95
0.018772
s
p99
0.018772
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.01891
s
SD
0
s
p50
0.01891
s
p95
0.01891
s
p99
0.01891
s
Authored DB connection use time
Time spent holding authored database connections.
mean
3.9e-05
s
SD
2e-06
s
p50
3.8e-05
s
<
p95
4.1e-05
s
p99
4.1e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
2.7e-05
s
SD
7.7e-05
s
p50
0.000181
s
p95
0.000181
s
p99
0.000181
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000125
s
SD
0
s
p50
0.000125
s
p95
0.000125
s
p99
0.000125
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
6.86
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
18.30
KiB/s
<
mean
639.00
KiB/s
SD
1.82
MiB/s
<
p95
6.48
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
19.50
KiB/s
<
mean
30.20
KiB/s
SD
20.30
KiB/s
<
p95
92.14
KiB/s
Total bytes received
Total bytes received on primary network interface
count
187.21
MiB
mean
639.00
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
8.85
MiB
mean
30.20
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1855.77 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (96.9% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
4.67
%
<
mean
9.61
%
SD
4.22
%
<
p95
16.48
%
System
2.75
%
CPU percentiles
CPU usage percentiles
p50
9.68
%
p95
16.48
%
p99
17.52
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
55.56
%
<
mean
56.62
%
SD
0.92
%
<
p95
57.96
%
Memory available percentage
Percentage of available memory
p5
42.04
%
<
mean
43.38
%
SD
0.92
%
<
p95
44.44
%
Max host memory used
Maximum memory usage percentage across all hosts
max
56.62
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
96.90
%
Memory growth rate
Rate of memory growth over time
growth
1855.77
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.06
MiB/s
Disk write throughput
Disk write throughput in MiB/s
41.94
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
1/1
hosts
Mount Point /etc/hosts
1/1
hosts
Mount Point /etc/nomad.d/client-meta.json
1/1
hosts
Mount Point /etc/resolv.conf
1/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.45
5 min
1.42
15 min
0.99
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0158
%
SD
0.0429
%
<
p95
0.16
%
60 second average
0.0187
%
300 second average
0.1006
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0916
%
SD
0.2743
%
<
p95
1.03
%
60 second average
0.1190
%
300 second average
0.0910
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0874
%
SD
0.2699
%
<
p95
1.02
%
60 second average
0.1145
%
300 second average
0.0868
%
Holochain process CPU usage
CPU usage by Holochain process
p5
2.85
%
<
mean
4.17
%
SD
1.37
%
<
p95
6.2
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
484.15
KiB
<
mean
519.80
KiB
SD
81.51
KiB
<
p95
569.24
KiB
Holochain process threads
Number of threads in Holochain process
p5
83
threads
<
mean
84.68
threads
SD
4.87
threads
<
p95
85
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
66
file descriptors
<
mean
73.65
file descriptors
SD
9.16
file descriptors
<
p95
75
file descriptors

Validation Receipts

↑ Back to index

Creates an entry, wait for required validation receipts, then repeat. Records the amount of time it took to accumulate the required number of receipts for all DHT operations. This is measured to the nearest 20ms so that we don't keep the agent too busy checking for receipts.

Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

By default, this scenario will wait for a complete set of validation receipts before committing the next record. If the NO_VALIDATION_COMPLETE environment variable is set, it will instead publish new records on every round, building up an ever-growing list of action hashes to check on.

Started
Thu, 09 Jul 2026 05:15:27 UTC
Peer count
20
Peer count at end
15
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
validation_receipts_28993172816_1
Receipts complete timing
The amount of time between publishing a record and receiving the required number of validation receipts.
Mean
mean
5.248957
s
SD
1.005731
s
Max
Highest per-partition mean latency
max mean
5.36911
s
Min
Lowest per-partition mean latency
min mean
5.094611
s
Receipts complete rate
The number of complete validation receipt sets collected per second.
Mean
mean
1.84
/s
Max
Highest per-partition mean rate
max
1.9
/s
Min
Lowest per-partition mean rate
min
1.69
/s
Error count
The total number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
0
over 700.007793164s
Not enough time data to show a trend.
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37470.530019769s
Not enough time data to show a trend.
WASM usage: 'crud::get_sample_entry_validation_receipts'
Metered usage count of the WASM ribosome for this zome function.
total
1079048
over 37470.530019769s
mean rate
4.77324089e+07
/s
std
1.5499290453e+08
/s
p5
0
/s
p95
4.583128661e+08
/s
peak
7.7965210981e+08
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37470.530019769s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37470.530019769s
Not enough time data to show a trend.
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.012783
s
SD
0.011945
s
p50
0.018115
s
<
p95
0.052014
s
p99
0.052014
s
Zome call duration: 'crud::get_sample_entry_validation_receipts'
Duration of this zome call as measured by Holochain internally.
mean
0.016415
s
SD
0.006536
s
p50
0.014966
s
<
p95
0.027733
s
<
p99
0.038689
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.007028
s
SD
0.005997
s
p50
0.006666
s
<
p95
0.026805
s
p99
0.026805
s
WASM call duration: 'crud::get_sample_entry_validation_receipts'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00888
s
SD
0.004671
s
p50
0.005116
s
<
p95
0.014927
s
<
p99
0.016865
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001319
s
SD
0.000198
s
p50
0.001318
s
<
p95
0.001841
s
p99
0.001841
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001405
s
SD
0.000416
s
p50
0.001237
s
<
p95
0.001786
s
<
p99
0.002011
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000394
s
SD
0.000113
s
p50
0.000327
s
<
p95
0.000536
s
<
p99
0.000764
s
Host function call duration: '__hc__get_validation_receipts_1'
Duration of this host function call invoked from within WASM.
mean
0.007023
s
SD
0.004558
s
p50
0.001943
s
<
p95
0.012971
s
<
p99
0.01482
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.005007
s
SD
0.005975
s
p50
0.004892
s
<
p95
0.024828
s
p99
0.024828
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.003997
s
SD
0.00822
s
p50
0.005416
s
<
p95
0.029558
s
p99
0.029558
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
46.6
s
<
mean
451.54
s
SD
260.01
s
<
p95
857.01
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
1.215019
s
SD
1.558643
s
p50
0.780258
s
<
p95
4.802354
s
<
p99
8.617625
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.010452
s
SD
0.062469
s
p50
0.005156
s
<
p95
0.061171
s
<
p99
0.329905
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001452
s
SD
0.000898
s
p50
0.001218
s
<
p95
0.004216
s
p99
0.004216
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.042281
s
SD
0.025653
s
p50
0.045994
s
<
p95
0.091732
s
<
p99
0.11178
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.025638
s
SD
0.015661
s
p50
0.008722
s
<
p95
0.043173
s
<
p99
0.096433
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.046341
s
SD
0.255291
s
p50
0.037236
s
<
p95
0.422896
s
<
p99
1.376692
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.578906
s
SD
0.453965
s
p50
0.53609
s
<
p95
1.161007
s
<
p99
2.699438
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000273
s
SD
6.7e-05
s
p50
0.000251
s
<
p95
0.000374
s
<
p99
0.000461
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001419
s
SD
0.014442
s
p50
0.000582
s
<
p95
0.01358
s
<
p99
0.102777
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000401
s
SD
0.000111
s
p50
0.000358
s
<
p95
0.000636
s
<
p99
0.00064
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.633798
s
SD
13.487982
s
p50
0.025697
s
<
p95
60.001506
s
p99
60.001506
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.186709
s
SD
0.046435
s
p50
0.183035
s
<
p95
0.231358
s
<
p99
0.243553
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
4.19
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.04
KiB/s
<
mean
31.78
KiB/s
SD
259.73
KiB/s
p95
26.76
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
445
B/s
<
mean
11.30
KiB/s
SD
9.08
KiB/s
<
p95
25.32
KiB/s
Total bytes received
Total bytes received on primary network interface
count
418.91
MiB
mean
471.39
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
149.03
MiB
mean
167.70
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 88.02 MiB/s

Disk full anomaly
Disk full anomaly was detected
NotDetected
Swap thrashing anomaly
Swap thrashing anomaly was detected
NotDetected
System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.7
%
<
mean
7.74
%
SD
9.22
%
<
p95
35.88
%
System
3.55
%
CPU percentiles
CPU usage percentiles
p50
5.55
%
p95
35.88
%
p99
36.42
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
10.74
%
<
mean
12.15
%
SD
1.19
%
<
p95
14.34
%
Memory available percentage
Percentage of available memory
p5
85.66
%
<
mean
87.85
%
SD
1.19
%
<
p95
89.26
%
Max host memory used
Maximum memory usage percentage across all hosts
max
14.27
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
0.00
%
Memory growth rate
Rate of memory growth over time
growth
88.02
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.00
MiB/s
Disk write throughput
Disk write throughput in MiB/s
18.03
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/4
hosts
Mount Point /efi-boot
0/3
hosts
Mount Point /etc/hostname
0/3
hosts
Mount Point /etc/hosts
0/3
hosts
Mount Point /etc/nomad.d/client-meta.json
0/6
hosts
Mount Point /etc/resolv.conf
0/3
hosts
Mount Point /nix/store
0/4
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
0.81
5 min
1.55
15 min
2.26
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.829
%
SD
1.2681
%
<
p95
3.25
%
60 second average
1.7664
%
300 second average
6.5409
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
8.5308
%
SD
14.3115
%
<
p95
43.62
%
60 second average
9.2185
%
300 second average
12.7181
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
8.0951
%
SD
13.5383
%
<
p95
41.22
%
60 second average
8.6344
%
300 second average
11.3110
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.35
%
<
mean
4.41
%
SD
4.5
%
<
p95
10.17
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
236.83
KiB
<
mean
261.89
KiB
SD
30.95
KiB
<
p95
312.75
KiB
Holochain process threads
Number of threads in Holochain process
p5
28
threads
<
mean
36.48
threads
SD
6.39
threads
<
p95
49
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
68
file descriptors
<
mean
86.3
file descriptors
SD
11.54
file descriptors
<
p95
97
file descriptors

Write/get_agent_activity

↑ Back to index

A scenario where write peers write entries, while get_agent_activity peers each query a single write agent's activity with get_agent_activity.

Before a target write peer and the requesting get_agent_activity peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started
Thu, 09 Jul 2026 05:30:53 UTC
Peer count
30
Peer count at end
27
Behaviours
  • get_agent_activity (1 agent)
  • write (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
write_get_agent_activity_28993172816_1
Observed chain advancement
The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
5197.75
Max
Highest chain head value observed for any single write agent.
8671
Write agents observed
4
get_agent_activity_full zome call timing
The time taken to call the zome function that retrieves information on a write peer's source chain.
Mean
mean
0.088301
s
SD
0.138372
s
Max
Highest per-partition mean latency
max mean
0.234845
s
Min
Lowest per-partition mean latency
min mean
0.03074
s
Error count
The number of errors accumulated.
38
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.027889
s
SD
3.000878
s
p50
0.016262
s
<
p95
12.012895
s
<
p99
15.217895
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
5
over 828.703647116s
mean rate
4
/s
std
7.35
/s
p5
0
/s
p95
22.26
/s
peak
49.19
/s
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 37470.35301291s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
286034121
over 37470.35301291s
mean rate
1.0646407263e+08
/s
std
1.6040752807e+08
/s
p5
114260.05
/s
p95
4.9216108972e+08
/s
peak
5.6820135376e+08
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
1708087639
over 905.564865122s
mean rate
7.61286885885e+09
/s
std
1.9147049569e+10
/s
p5
4.456703821e+07
/s
p95
4.13766549136e+10
/s
peak
1.18516474011e+11
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
3374671258
over 33090.426197169s
mean rate
5.4927197118e+08
/s
std
9.9018245988e+08
/s
p5
45235.41
/s
p95
3.16908784329e+09
/s
peak
3.98919461524e+09
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
29172373
over 37470.638038126s
mean rate
5.450724447e+07
/s
std
7.092679684e+07
/s
p5
0
/s
p95
2.0589564849e+08
/s
peak
2.6525610955e+08
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.029944
s
SD
0.007662
s
p50
0.025213
s
<
p95
0.038747
s
p99
0.038747
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.037227
s
SD
0.0274
s
p50
0.029778
s
<
p95
0.095961
s
<
p99
0.10958
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.041245
s
SD
0.064497
s
p50
0.040309
s
<
p95
0.208544
s
<
p99
0.227531
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.008299
s
SD
4.068373
s
p50
0.009432
s
<
p95
12.023824
s
<
p99
15.251274
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00988
s
SD
0.005489
s
p50
0.007493
s
<
p95
0.020345
s
p99
0.020345
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.020898
s
SD
0.016306
s
p50
0.016638
s
<
p95
0.056332
s
<
p99
0.063953
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.038185
s
SD
0.061443
s
p50
0.036854
s
<
p95
0.191482
s
<
p99
0.215545
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005839
s
SD
4.065397
s
p50
0.00587
s
<
p95
12.016151
s
<
p99
15.225751
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001061
s
SD
0.000469
s
p50
0.000932
s
<
p95
0.002322
s
<
p99
0.00294
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.8e-05
s
SD
5e-06
s
p50
2.7e-05
s
<
p95
3.9e-05
s
p99
3.9e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.001092
s
SD
0.001781
s
p50
0.000433
s
<
p95
0.005643
s
<
p99
0.006486
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000361
s
SD
0.000122
s
p50
0.000305
s
<
p95
0.000574
s
p99
0.000574
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.036475
s
SD
0.061215
s
p50
0.035187
s
<
p95
0.18987
s
<
p99
0.212037
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.001161
s
SD
4.065631
s
p50
0.000291
s
<
p95
12.012921
s
<
p99
15.217974
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1e-05
s
SD
1.2e-05
s
p50
1e-05
s
<
p95
6e-05
s
p99
6e-05
s
Host function call duration: '__hc__trace_1'
Duration of this host function call invoked from within WASM.
mean
7.8e-05
s
SD
2.5e-05
s
p50
7.5e-05
s
<
p95
0.000134
s
<
p99
0.000194
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.009595
s
SD
0.009194
s
p50
0.004311
s
<
p95
0.021213
s
<
p99
0.048759
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.015558
s
SD
0.009395
s
p50
0.018796
s
<
p95
0.04087
s
<
p99
0.047128
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.06
s
<
mean
452.86
s
SD
260.12
s
<
p95
857.78
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
124.635428
s
SD
129.96509
s
p50
40.456426
s
<
p95
444.512898
s
<
p99
526.195708
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.325009
s
SD
5.093126
s
p50
0.717136
s
<
p95
15.222602
s
<
p99
21.506331
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001648
s
SD
0.001678
s
p50
0.001114
s
<
p95
0.004386
s
<
p99
0.008674
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.050789
s
SD
0.3155
s
p50
0.117807
s
<
p95
0.988168
s
<
p99
1.086391
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.165509
s
SD
0.116315
s
p50
0.031533
s
<
p95
0.382073
s
<
p99
0.536177
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
2.321279
s
SD
26.076775
s
p50
10.845864
s
<
p95
76.864646
s
<
p99
102.298999
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
13.573919
s
SD
26.80018
s
p50
1.150012
s
<
p95
72.894048
s
<
p99
89.422169
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000904
s
SD
0.001319
s
p50
0.000231
s
<
p95
0.004245
s
<
p99
0.005584
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002462
s
SD
0.015681
s
p50
0.000695
s
<
p95
0.026463
s
<
p99
0.066548
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000829
s
SD
0.000837
s
p50
0.000319
s
<
p95
0.003005
s
<
p99
0.004413
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
4.303573
s
SD
29.793757
s
p50
2.59017
s
<
p95
60.004012
s
<
p99
60.030436
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
3.533667
s
SD
5.380313
s
p50
0.381331
s
<
p95
15.212319
s
p99
15.212319
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.050221
s
SD
27.791427
s
p50
0.058073
s
<
p95
60.001589
s
<
p99
60.004263
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.301026
s
SD
3.25237
s
p50
0.412888
s
<
p95
10.110112
s
<
p99
12.332733
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
44.08
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.59
KiB/s
<
mean
479.76
KiB/s
SD
412.15
KiB/s
<
p95
1.19
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
324
B/s
<
mean
458.14
KiB/s
SD
404.84
KiB/s
<
p95
1.21
MiB/s
Total bytes received
Total bytes received on primary network interface
count
11.53
GiB
mean
12.98
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
11.01
GiB
mean
12.39
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.3%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 620.32 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/7 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (96.4% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 36% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
6.76
%
<
mean
53.91
%
SD
29.17
%
<
p95
97.69
%
System
9.83
%
CPU percentiles
CPU usage percentiles
p50
48.98
%
p95
97.69
%
p99
98.30
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
13
hosts
mean time
0.55
s
Memory used percentage
Percentage of memory used
p5
6.94
%
<
mean
14.28
%
SD
8.52
%
<
p95
25.85
%
Memory available percentage
Percentage of available memory
p5
74.15
%
<
mean
85.72
%
SD
8.52
%
<
p95
93.06
%
Max host memory used
Maximum memory usage percentage across all hosts
max
53.87
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
96.40
%
Memory growth rate
Rate of memory growth over time
growth
620.32
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.01
MiB/s
Disk write throughput
Disk write throughput in MiB/s
196.21
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/5
hosts
Mount Point /efi-boot
0/4
hosts
Mount Point /etc/hostname
1/7
hosts
Mount Point /etc/hosts
1/7
hosts
Mount Point /etc/nomad.d/client-meta.json
1/8
hosts
Mount Point /etc/resolv.conf
1/7
hosts
Mount Point /nix/store
0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.25
5 min
3.25
15 min
2.54
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
35.71
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
23.6569
%
SD
27.626
%
<
p95
92.12
%
60 second average
22.2040
%
300 second average
16.6456
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
12.0052
%
SD
17.052
%
<
p95
45.25
%
60 second average
11.4706
%
300 second average
9.6989
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
8.4599
%
SD
13.2973
%
<
p95
34.19
%
60 second average
8.1472
%
300 second average
7.2144
%
Holochain process CPU usage
CPU usage by Holochain process
p5
5.52
%
<
mean
50.32
%
SD
28.35
%
<
p95
95.58
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
255.34
KiB
<
mean
405.54
KiB
SD
149.93
KiB
<
p95
644.57
KiB
Holochain process threads
Number of threads in Holochain process
p5
29
threads
<
mean
44.26
threads
SD
21.88
threads
<
p95
68
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
72
file descriptors
<
mean
97.2
file descriptors
SD
24.59
file descriptors
<
p95
118
file descriptors

Write/get_agent_activity with volatile conductors

↑ Back to index

A scenario where write peers write entries, while get_agent_activity_volatile peers each query a single write agents activity with get_agent_activity but shutdown and restart their conductors at semi-random intervals.

Before a target write peer and the requesting get_agent_activity_volatile peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started
Thu, 09 Jul 2026 05:46:43 UTC
Peer count
30
Peer count at end
23
Behaviours
  • get_agent_activity_volatile (1 agent)
  • write (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
write_get_agent_activity_volatile_28993172816_1
Highest observed action_seq
The rate at which zero-arc readers observe new chain heads on the writers' chains via get_agent_activity. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.
Mean
mean
118.63
/s
Max
Highest per-partition mean rate
max
375.73
/s
Min
Lowest per-partition mean rate
min
22.12
/s
get_agent_activity_full zome call timing
The time taken to call the zome function that retrieves information on a write peer's source chain.
Mean
mean
0.11431
s
SD
0.19614
s
Max
Highest per-partition mean latency
max mean
0.306804
s
Min
Lowest per-partition mean latency
min mean
0.018558
s
Running volatile conductors count
The number of conductors running by get_agent_activity_volatile peers.
p5
10
conductors
<
mean
13.41
conductors
SD
1.92
conductors
<
p95
16
conductors
Volatile conductor total running duration
The total running duration of a get_agent_activity_volatile conductor.
Mean
mean
1477.66935
s
SD
870.578802
s
Max
Highest per-partition mean latency
max mean
2754.3
s
Min
Lowest per-partition mean latency
min mean
852.909091
s
Volatile conductor running duration
The duration that a get_agent_activity_volatile conductor was running before being stopped.
Mean
mean
82.172013
s
SD
74.311047
s
Max
Highest per-partition mean latency
max mean
142.893406
s
Min
Lowest per-partition mean latency
min mean
47.181051
s
Volatile conductor stopped duration
The duration that a get_agent_activity_volatile conductor was stopped before being started again.
Mean
mean
48.38366
s
SD
76.425632
s
Max
Highest per-partition mean latency
max mean
75.991572
s
Min
Lowest per-partition mean latency
min mean
8.162287
s
Reached target arc
Did get_agent_activity_volatile peer reach their target arc in the moment before they were shutdown.
  • get_agent_activity_volatile_agent: uhCAk1ty-qGWRJtkVAtHqzWOz2LUTmo9ipy8znq19gj71ICKbrT7J
p5
0
mean
0
SD
0
p95
0
  • get_agent_activity_volatile_agent: uhCAk2wx-jVgQb3M5ct7rH-6RHhphNfxtzyd6pEWEbNUnkYpAjkIJ
p5
0
<
mean
0.35
SD
0.48
<
p95
1
  • get_agent_activity_volatile_agent: uhCAk2xja5iwukcTD82PfNpjFfZrmlQUUFUetBtwYcZ4rBwETnfl7
p5
0
mean
0
SD
0
p95
0
  • get_agent_activity_volatile_agent: uhCAk5bilHTA8R_ZRHpPq2SNTpR1Y5rqIpwujZYOQnrzWsgkRKlD1
p5
0
<
mean
0.27
SD
0.44
<
p95
1
  • get_agent_activity_volatile_agent: uhCAk75vcTW4hE35xplPwSsxYJZlFQ-0iVAAQEN-am9_EbMsNj7zj
p5
0
<
mean
0.38
SD
0.49
<
p95
1
  • get_agent_activity_volatile_agent: uhCAk7CWtYkygpMI53fXkJNkMj2cuzm0niCTwbhOgm76MntVDEzmy
p5
0
<
mean
0.14
SD
0.35
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkAfpWL2oibbl1WhGKjk9V68WfbFHuzJ1LfAZEK9DXLRxk90dY
p5
0
<
mean
0.22
SD
0.42
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkB98FpYHtXBhO7DcAiBZlvzYn8zjMxiYtjw2dzAJDHPk2KzxK
p5
0
<
mean
0.44
SD
0.5
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkFyI_NIKSjCyoUigA14ayLHZYUXctOO2G5-bbztI4ub8XGc1f
p5
0
<
mean
0.25
SD
0.43
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkHr1tWZdQIMltK9roDC5MAFKiHU90Xb1iMiyWgnlZwWK0dX_t
p5
0
<
mean
0.21
SD
0.41
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkIGikrC8TtLyAL5Xfa6GNXv9m6_tMprozErOpcFBMjmlTTxk2
p5
0
<
mean
0.15
SD
0.36
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkLNRnciScU3wD-YKb4WpNMwKNrHmT8DpQLkF3SWO7WuQVxPs_
p5
0
<
mean
0.45
SD
0.5
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkO-5easFtJnaJvV5q9Rcu11vHIbN6O-8s0fYNzp-2WWnEZYpl
p5
0
<
mean
0.39
SD
0.49
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkTXIONDeSuzMshGQIwTOoXNr7_BZ1v4lkHoIZTTXaH4U4_1n4
p5
0
<
mean
0.48
SD
0.5
<
p95
1
  • get_agent_activity_volatile_agent: uhCAke3_eT-l8lNWdZEDCN8FRSr4DSO9JqY-oVBr1rSyjdOUlTg9v
p5
0
<
mean
0.28
SD
0.45
<
p95
1
  • get_agent_activity_volatile_agent: uhCAklxCWWgbYJ6_e2pszp4QzzQE9fZ5TsN89caosihkL_oHuLobb
p5
0
mean
0
SD
0
p95
0
  • get_agent_activity_volatile_agent: uhCAktYPChdLmKL-uXuGaQ4Km1A-wf9T_7F9yT28OkVJfGewneuEi
p5
0
<
mean
0.42
SD
0.49
<
p95
1
  • get_agent_activity_volatile_agent: uhCAktgZFWGUdvZlw3w5W-RhfLShht91jWDSObYOIznpGI-cZRO_q
p5
0
<
mean
0.24
SD
0.43
<
p95
1
  • get_agent_activity_volatile_agent: uhCAkup0yQpdSJAzbWIBDBQxwVanBSBBLYaFLyHXw-VPUwfU1zTg2
p5
0
<
mean
0.39
SD
0.49
<
p95
1
Error count
The number of errors accumulated.
115
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.049107
s
SD
0.323102
s
p50
0.119144
s
<
p95
0.561253
s
<
p99
1.802494
s
Cascade fetch errors
Count of network fetch errors during cascade calls.
total
4
over 1904.959418683s
mean rate
0.38
/s
std
0.87
/s
p5
0
/s
p95
2.36
/s
peak
5.29
/s
WASM usage: 'agent_activity::announce_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 1825.322329683s
Not enough time data to show a trend.
WASM usage: 'agent_activity::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
350909148
over 1825.322329683s
mean rate
1.7694937485e+08
/s
std
1.7190463026e+08
/s
p5
3.08929742e+06
/s
p95
5.426828362e+08
/s
peak
5.926949737e+08
/s
WASM usage: 'agent_activity::get_agent_activity_full'
Metered usage count of the WASM ribosome for this zome function.
total
32508062
over 2785.696447254s
mean rate
7.1907495009e+08
/s
std
1.96661262894e+09
/s
p5
1.22045023e+06
/s
p95
4.46566287026e+09
/s
peak
1.60238743625e+10
/s
WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'
Metered usage count of the WASM ribosome for this zome function.
total
67189094
over 38345.489219346s
mean rate
5.3086951187e+08
/s
std
3.1182196164e+09
/s
p5
0
/s
p95
6.743656087e+07
/s
peak
2.32358615729e+10
/s
WASM usage: 'agent_activity_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
6779007
over 38345.686355624s
mean rate
2.089015217e+07
/s
std
5.45127306e+07
/s
p5
110127.07
/s
p95
5.980612906e+07
/s
peak
1.54425042058e+09
/s
Zome call duration: 'agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.032765
s
SD
0.020982
s
p50
0.022511
s
<
p95
0.073756
s
p99
0.073756
s
Zome call duration: 'agent_activity::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.052556
s
SD
0.039942
s
p50
0.036992
s
<
p95
0.156827
s
<
p99
0.171848
s
Zome call duration: 'agent_activity::get_agent_activity_full'
Duration of this zome call as measured by Holochain internally.
mean
0.048837
s
SD
0.214434
s
p50
0.147328
s
<
p95
0.513447
s
<
p99
0.886403
s
Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.008394
s
SD
0.129844
s
p50
0.008958
s
<
p95
0.480027
s
<
p99
0.596441
s
WASM call duration: 'agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.0159
s
SD
0.012303
s
p50
0.008843
s
<
p95
0.037112
s
p99
0.037112
s
WASM call duration: 'agent_activity::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.028426
s
SD
0.021939
s
p50
0.020286
s
<
p95
0.085359
s
<
p99
0.093649
s
WASM call duration: 'agent_activity::get_agent_activity_full'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.056397
s
SD
0.327849
s
p50
0.134837
s
<
p95
0.564164
s
<
p99
1.894156
s
WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.005432
s
SD
0.124995
s
p50
0.005577
s
<
p95
0.427228
s
<
p99
0.579659
s
WASM call duration: 'agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001654
s
SD
0.000891
s
p50
0.001581
s
<
p95
0.003979
s
<
p99
0.004252
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
3.5e-05
s
SD
1.9e-05
s
p50
2.8e-05
s
<
p95
8.5e-05
s
p99
8.5e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000732
s
SD
0.000594
s
p50
0.000784
s
<
p95
0.002334
s
<
p99
0.002709
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000409
s
SD
0.000196
s
p50
0.000362
s
<
p95
0.00083
s
p99
0.00083
s
Host function call duration: '__hc__get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.05399
s
SD
0.326979
s
p50
0.132402
s
<
p95
0.561304
s
<
p99
1.890059
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.000488
s
SD
0.122926
s
p50
0.000318
s
<
p95
0.383766
s
<
p99
0.575659
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1e-05
s
SD
4e-06
s
p50
9e-06
s
<
p95
2e-05
s
p99
2e-05
s
Host function call duration: '__hc__trace_1'
Duration of this host function call invoked from within WASM.
mean
0.000103
s
SD
2.2e-05
s
p50
9.8e-05
s
<
p95
0.000151
s
p99
0.000151
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.025557
s
SD
0.017524
s
p50
0.014405
s
<
p95
0.048283
s
<
p99
0.085136
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.018598
s
SD
0.017071
s
p50
0.013467
s
<
p95
0.063806
s
<
p99
0.071183
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
6.52
s
<
mean
384.96
s
SD
510.01
s
<
p95
1567.79
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 38345.68634827s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
100.162217
s
SD
92.120085
s
p50
15.135243
s
<
p95
240.869811
s
<
p99
417.923742
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.576393
s
SD
3.328947
s
p50
0.107623
s
<
p95
8.491393
s
<
p99
16.993534
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.002135
s
SD
0.001998
s
p50
0.00144
s
<
p95
0.005727
s
<
p99
0.009646
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.09399
s
SD
0.080521
s
p50
0.018883
s
<
p95
0.214765
s
<
p99
0.395308
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.183832
s
SD
0.120553
s
p50
0.071081
s
<
p95
0.330602
s
<
p99
0.630951
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
4.199282
s
SD
61.863812
s
p50
10.732764
s
<
p95
130.008804
s
<
p99
310.522008
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
65.716718
s
SD
73.230069
s
p50
0.46757
s
<
p95
218.614013
s
<
p99
284.156915
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.003138
s
SD
0.001727
s
p50
0.000265
s
<
p95
0.005439
s
<
p99
0.007628
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.002906
s
SD
0.025332
s
p50
0.000583
s
<
p95
0.033685
s
<
p99
0.159671
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000605
s
SD
0.000462
s
p50
0.00046
s
<
p95
0.001715
s
<
p99
0.002577
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
4.62384
s
SD
28.763846
s
p50
0.356556
s
<
p95
60.002471
s
<
p99
60.006998
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.352403
s
SD
0.208428
s
p50
0.331862
s
<
p95
0.908753
s
p99
0.908753
s
P2P request roundtrip: 'get_agent_activity'
Time spent sending a get_agent_activity request and awaiting its response.
mean
0.082754
s
SD
16.083306
s
p50
0.154064
s
<
p95
60.001475
s
<
p99
60.00187
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.414223
s
SD
25.764182
s
p50
0.402265
s
<
p95
60.001654
s
<
p99
60.002367
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
21.76
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
930
B/s
<
mean
189.37
KiB/s
SD
348.53
KiB/s
<
p95
764.75
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
566
B/s
<
mean
172.43
KiB/s
SD
299.81
KiB/s
<
p95
772.09
KiB/s
Total bytes received
Total bytes received on primary network interface
count
9.15
GiB
mean
5.01
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
8.34
GiB
mean
4.56
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 98.6%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 898.93 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/7 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (96.4% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 29% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
0.8
%
<
mean
27.88
%
SD
33.81
%
<
p95
97.64
%
System
6.12
%
CPU percentiles
CPU usage percentiles
p50
12.59
%
p95
97.64
%
p99
98.60
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
11
hosts
mean time
0.41
s
Memory used percentage
Percentage of memory used
p5
5.46
%
<
mean
13.05
%
SD
8.71
%
<
p95
20.61
%
Memory available percentage
Percentage of available memory
p5
79.39
%
<
mean
86.95
%
SD
8.71
%
<
p95
94.54
%
Max host memory used
Maximum memory usage percentage across all hosts
max
54.26
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
96.39
%
Memory growth rate
Rate of memory growth over time
growth
898.93
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.08
MiB/s
Disk write throughput
Disk write throughput in MiB/s
93.74
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/5
hosts
Mount Point /efi-boot
0/4
hosts
Mount Point /etc/hostname
1/7
hosts
Mount Point /etc/hosts
1/7
hosts
Mount Point /etc/nomad.d/client-meta.json
1/8
hosts
Mount Point /etc/resolv.conf
1/7
hosts
Mount Point /nix/store
0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.47
5 min
2.63
15 min
2.73
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
28.57
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
14.2805
%
SD
27.951
%
<
p95
88.27
%
60 second average
14.2901
%
300 second average
14.9285
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
5.7008
%
SD
13.1332
%
<
p95
43.03
%
60 second average
5.8783
%
300 second average
6.8049
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
4.2642
%
SD
10.1989
%
<
p95
32.37
%
60 second average
4.4041
%
300 second average
5.0732
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0
%
<
mean
24.05
%
SD
31.72
%
<
p95
95.35
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
51.70
KiB
<
mean
275.04
KiB
SD
229.45
KiB
<
p95
540.39
KiB
Holochain process threads
Number of threads in Holochain process
p5
7
threads
<
mean
36.41
threads
SD
24.8
threads
<
p95
50
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
23
file descriptors
<
mean
88.24
file descriptors
SD
33.07
file descriptors
<
p95
111
file descriptors

Write/Query

↑ Back to index

Creates an entry, then queries the source chain and performs a simple operation on the entries, then repeats.

Started
Thu, 09 Jul 2026 04:19:00 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
write_query_28993172816_1
Write timing
The time it takes to complete the zome function call that writes the entry.
mean
0.01346
s
SD
0.005298
s
p50
0.014523
s
<
p95
0.020929
s
<
p99
0.029431
s
Write rate
The number of writes completed per second.
mean
156.52
/s
Query timing
The time it takes to complete the chain_query_count_len zome call that queries the source chain.
mean
0.049639
s
SD
0.029083
s
p50
0.046416
s
<
p95
0.091779
s
<
p99
0.098206
s
Query rate
The number of chain queries completed per second.
mean
156.52
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'crud::chain_query_count_len'
Metered usage count of the WASM ribosome for this zome function.
total
372636214316
over 280.00165505s
mean rate
1.3308357542e+09
/s
std
9.718916255e+07
/s
p5
1.21134745527e+09
/s
p95
1.45016954874e+09
/s
peak
1.46157626054e+09
/s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
176966685
over 280.00165505s
mean rate
632020.04
/s
std
351094.6
/s
p5
390896.68
/s
p95
1.42337412e+06
/s
peak
1.81002059e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 280.00165505s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
38717840
over 280.00165505s
mean rate
138277.16
/s
std
76794.4
/s
p5
85057.97
/s
p95
310949.59
/s
peak
396007.23
/s
Zome call duration: 'crud::chain_query_count_len'
Duration of this zome call as measured by Holochain internally.
mean
0.033259
s
SD
0.010774
s
p50
0.030725
s
<
p95
0.043941
s
<
p99
0.044775
s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.005738
s
SD
0.001079
s
p50
0.005525
s
<
p95
0.006809
s
<
p99
0.006869
s
WASM call duration: 'crud::chain_query_count_len'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.030035
s
SD
0.009799
s
p50
0.027755
s
<
p95
0.039654
s
<
p99
0.040417
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.0028
s
SD
9.9e-05
s
p50
0.002791
s
<
p95
0.00288
s
<
p99
0.002883
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000909
s
SD
0
s
p50
0.000909
s
p95
0.000909
s
p99
0.000909
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000612
s
SD
7e-06
s
p50
0.000611
s
<
p95
0.000618
s
<
p99
0.000619
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000159
s
SD
1.2e-05
s
p50
0.000182
s
p95
0.000182
s
p99
0.000182
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.009441
s
SD
0.003221
s
p50
0.008817
s
<
p95
0.012483
s
<
p99
0.01273
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002039
s
SD
0.000147
s
p50
0.001988
s
<
p95
0.002225
s
<
p99
0.002233
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.00113
s
SD
7e-05
s
p50
0.001134
s
<
p95
0.001171
s
<
p99
0.001172
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.41
s
<
mean
148.41
s
SD
83.67
s
<
p95
278.41
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001648858s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.014447
s
SD
0
s
p50
0.014447
s
p95
0.014447
s
p99
0.014447
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000399
s
SD
0
s
p50
0.000399
s
p95
0.000399
s
p99
0.000399
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000628
s
SD
5e-05
s
p50
0.000616
s
<
p95
0.000676
s
<
p99
0.000677
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.015609
s
SD
0.004978
s
p50
0.014742
s
<
p95
0.020162
s
<
p99
0.020523
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.000762
s
SD
0
s
p50
0.000762
s
p95
0.000762
s
p99
0.000762
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.000347
s
SD
0
s
p50
0.000347
s
p95
0.000347
s
p99
0.000347
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.001141
s
SD
0.000368
s
p50
0.001074
s
<
p95
0.00148
s
<
p99
0.001507
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.000409
s
SD
7.6e-05
s
p50
0.000458
s
<
p95
0.000489
s
<
p99
0.000492
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000133
s
SD
2e-06
s
p50
0.000133
s
<
p95
0.000135
s
p99
0.000135
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
9.24
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
13.90
KiB/s
<
mean
241.57
KiB/s
SD
1.16
MiB/s
p95
30.58
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
17.57
KiB/s
<
mean
32.58
KiB/s
SD
27.55
KiB/s
<
p95
98.29
KiB/s
Total bytes received
Total bytes received on primary network interface
count
70.77
MiB
mean
241.57
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
9.54
MiB
mean
32.58
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (96.9% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
9.62
%
<
mean
12.49
%
SD
2.5
%
<
p95
16.49
%
System
3.25
%
CPU percentiles
CPU usage percentiles
p50
12.56
%
p95
16.49
%
p99
17.51
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
55.64
%
<
mean
56.92
%
SD
0.71
%
<
p95
57.96
%
Memory available percentage
Percentage of available memory
p5
42.04
%
<
mean
43.08
%
SD
0.71
%
<
p95
44.36
%
Max host memory used
Maximum memory usage percentage across all hosts
max
56.92
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
96.90
%
Memory growth rate
Rate of memory growth over time
growth
-558.07
MiB/s
Disk read throughput
Disk read throughput in MiB/s
1.77
MiB/s
Disk write throughput
Disk write throughput in MiB/s
51.11
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
1/1
hosts
Mount Point /etc/hosts
1/1
hosts
Mount Point /etc/nomad.d/client-meta.json
1/1
hosts
Mount Point /etc/resolv.conf
1/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.93
5 min
2.29
15 min
1.37
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0297
%
SD
0.0654
%
<
p95
0.18
%
60 second average
0.0168
%
300 second average
0.0639
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0245
%
300 second average
0.0603
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0239
%
300 second average
0.0571
%
Holochain process CPU usage
CPU usage by Holochain process
p5
4.23
%
<
mean
5.53
%
SD
0.94
%
<
p95
6.35
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
25.17
KiB
<
mean
507.18
KiB
SD
146.56
KiB
<
p95
569.24
KiB
Holochain process threads
Number of threads in Holochain process
p5
16
threads
<
mean
80.39
threads
SD
16.37
threads
<
p95
85
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
8
file descriptors
<
mean
68.94
file descriptors
SD
15.55
file descriptors
<
p95
75
file descriptors

Write/Read

↑ Back to index

Creates an entry and reads it back, then repeats.

Started
Thu, 09 Jul 2026 04:20:55 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
write_read_28993172816_1
Write timing
The time taken to write the entry.
mean
0.018456
s
SD
0.007863
s
p50
0.017815
s
<
p95
0.033526
s
<
p99
0.039462
s
Write rate
The number of writes completed per second.
mean
292.07
/s
Read timing
The time taken to read the entry.
mean
0.014175
s
SD
0.006741
s
p50
0.013612
s
<
p95
0.023561
s
<
p99
0.032532
s
Read rate
The number of reads completed per second.
mean
292.07
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.000302
s
SD
2.1e-05
s
p50
0.000306
s
<
p95
0.000309
s
<
p99
0.00031
s
WASM usage: 'crud::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
360859077
over 290.001675844s
mean rate
1.2443345e+06
/s
std
462487.83
/s
p5
875268.65
/s
p95
2.50683306e+06
/s
peak
2.96572009e+06
/s
WASM usage: 'crud::get_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
410104156
over 290.001675844s
mean rate
1.41414414e+06
/s
std
525111.65
/s
p5
994830.4
/s
p95
2.8492666e+06
/s
peak
3.36600835e+06
/s
WASM usage: 'crud::init'
Metered usage count of the WASM ribosome for this zome function.
total
0
over 290.001675844s
Not enough time data to show a trend.
WASM usage: 'crud_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
39475464
over 290.001675844s
mean rate
136121.51
/s
std
50593.97
/s
p5
95748.28
/s
p95
274230.04
/s
peak
324429.07
/s
Zome call duration: 'crud::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.007364
s
SD
0.001292
s
p50
0.007338
s
<
p95
0.008177
s
<
p99
0.008209
s
Zome call duration: 'crud::get_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.006377
s
SD
0.001402
s
p50
0.006472
s
<
p95
0.007037
s
<
p99
0.007059
s
WASM call duration: 'crud::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.00317
s
SD
0.000116
s
p50
0.003184
s
<
p95
0.003214
s
<
p99
0.003215
s
WASM call duration: 'crud::get_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001097
s
SD
3.1e-05
s
p50
0.001101
s
<
p95
0.001108
s
<
p99
0.00111
s
WASM call duration: 'crud::init'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000972
s
SD
0
s
p50
0.000972
s
p95
0.000972
s
p99
0.000972
s
WASM call duration: 'crud_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000623
s
SD
6e-06
s
p50
0.000624
s
<
p95
0.000626
s
p99
0.000626
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000166
s
SD
1.2e-05
s
p50
0.000191
s
p95
0.000191
s
p99
0.000191
s
Host function call duration: '__hc__get_1'
Duration of this host function call invoked from within WASM.
mean
0.000338
s
SD
2.2e-05
s
p50
0.000341
s
<
p95
0.000345
s
<
p99
0.000346
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002258
s
SD
0.000105
s
p50
0.00227
s
<
p95
0.002296
s
<
p99
0.002298
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.001277
s
SD
6.4e-05
s
p50
0.001285
s
<
p95
0.001317
s
<
p99
0.00132
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.31
s
<
mean
153.31
s
SD
86.55
s
<
p95
288.31
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 290.001680502s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.000935
s
SD
0
s
p50
0.000935
s
p95
0.000935
s
p99
0.000935
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000638
s
SD
0
s
p50
0.000638
s
p95
0.000638
s
p99
0.000638
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000676
s
SD
4e-05
s
p50
0.000684
s
<
p95
0.000689
s
<
p99
0.00069
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.026629
s
SD
0.008855
s
p50
0.025033
s
<
p95
0.034881
s
<
p99
0.035549
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.00137
s
SD
0
s
p50
0.00137
s
p95
0.00137
s
p99
0.00137
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001683
s
SD
0
s
p50
0.001683
s
p95
0.001683
s
p99
0.001683
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000781
s
SD
0.000284
s
p50
0.000696
s
<
p95
0.00109
s
<
p99
0.001121
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00052
s
SD
0.000111
s
p50
0.000479
s
<
p95
0.000647
s
<
p99
0.000648
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000139
s
SD
3e-06
s
p50
0.000141
s
<
p95
0.000143
s
p99
0.000143
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
9.07
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
5.97
KiB/s
<
mean
16.48
KiB/s
SD
7.27
KiB/s
<
p95
27.44
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
6.15
KiB/s
<
mean
27.01
KiB/s
SD
27.68
KiB/s
<
p95
98.29
KiB/s
Total bytes received
Total bytes received on primary network interface
count
4.67
MiB
mean
16.48
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
7.65
MiB
mean
27.01
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (96.9% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
7.49
%
<
mean
11.85
%
SD
3.33
%
<
p95
16.49
%
System
2.78
%
CPU percentiles
CPU usage percentiles
p50
12.56
%
p95
16.49
%
p99
17.52
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
54.44
%
<
mean
56.13
%
SD
1.38
%
<
p95
57.96
%
Memory available percentage
Percentage of available memory
p5
42.04
%
<
mean
43.87
%
SD
1.38
%
<
p95
45.56
%
Max host memory used
Maximum memory usage percentage across all hosts
max
56.13
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
96.90
%
Memory growth rate
Rate of memory growth over time
growth
-2796.43
MiB/s
Disk read throughput
Disk read throughput in MiB/s
1.81
MiB/s
Disk write throughput
Disk write throughput in MiB/s
44.93
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
1/1
hosts
Mount Point /etc/hosts
1/1
hosts
Mount Point /etc/nomad.d/client-meta.json
1/1
hosts
Mount Point /etc/resolv.conf
1/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.05
5 min
2.84
15 min
1.67
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.022
%
SD
0.0603
%
<
p95
0.16
%
60 second average
0.0157
%
300 second average
0.0423
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0010
%
300 second average
0.0303
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0010
%
300 second average
0.0280
%
Holochain process CPU usage
CPU usage by Holochain process
p5
5.91
%
<
mean
6.26
%
SD
0.2
%
<
p95
6.35
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
25.17
KiB
<
mean
509.46
KiB
SD
149.58
KiB
<
p95
565.87
KiB
Holochain process threads
Number of threads in Holochain process
p5
16
threads
<
mean
80.63
threads
SD
16.69
threads
<
p95
85
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
8
file descriptors
<
mean
68.53
file descriptors
SD
15.67
file descriptors
<
p95
75
file descriptors

Write validated

↑ Back to index

Creates an entry, updates it and links the create to the update, then repeats. Each of the three actions is validated by the included hApp.

Started
Thu, 09 Jul 2026 04:27:43 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
write_validated_28993172816_1
Write timing
The time it takes to complete the zome function call that writes the entry, updates it, and links to the update.
mean
0.041644
s
SD
0.015945
s
p50
0.046003
s
<
p95
0.063208
s
<
p99
0.073433
s
Write rate
The number of write zome function calls that complete per second.
mean
83.28
/s
Read timing
The time it takes to complete the zome function call that reads the data.
mean
0.078858
s
SD
0.029966
s
p50
0.078065
s
<
p95
0.128922
s
<
p99
0.140987
s
Read rate
The number of read zome function calls that complete per second.
mean
83.28
/s
Error count
The number of errors accumulated over the run.
0
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.003189
s
SD
0.001449
s
p50
0.003002
s
<
p95
0.005496
s
<
p99
0.00575
s
WASM usage: 'validated::create_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
95607779
over 290.001711137s
mean rate
329680.06
/s
std
127191.68
/s
p5
213464.52
/s
p95
644495.2
/s
peak
714285.68
/s
WASM usage: 'validated::update_sample_entry'
Metered usage count of the WASM ribosome for this zome function.
total
112111073
over 290.001711137s
mean rate
386587.64
/s
std
148937.74
/s
p5
250311.6
/s
p95
755744.45
/s
peak
837581.79
/s
WASM usage: 'validated_integrity::entry_defs'
Metered usage count of the WASM ribosome for this zome function.
total
150318270
over 290.001711137s
mean rate
518335.82
/s
std
199601.01
/s
p5
337910.47
/s
p95
1.01326936e+06
/s
peak
1.11930531e+06
/s
WASM usage: 'validated_integrity::validate'
Metered usage count of the WASM ribosome for this zome function.
total
1889238778
over 290.001711137s
mean rate
6.51457822e+06
/s
std
2.50880723e+06
/s
p5
4.25854876e+06
/s
p95
1.273434977e+07
/s
peak
1.406736922e+07
/s
Zome call duration: 'validated::create_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.011332
s
SD
0.002997
s
p50
0.011075
s
<
p95
0.013684
s
<
p99
0.013804
s
Zome call duration: 'validated::update_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.017295
s
SD
0.004542
s
p50
0.016832
s
<
p95
0.020685
s
<
p99
0.020917
s
WASM call duration: 'validated::create_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.006052
s
SD
0.001263
s
p50
0.005894
s
<
p95
0.007082
s
<
p99
0.007135
s
WASM call duration: 'validated::update_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.011094
s
SD
0.002761
s
p50
0.010619
s
<
p95
0.013406
s
<
p99
0.013579
s
WASM call duration: 'validated_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000584
s
SD
1.2e-05
s
p50
0.000581
s
<
p95
0.000595
s
<
p99
0.000596
s
WASM call duration: 'validated_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.003616
s
SD
0.0006
s
p50
0.003441
s
<
p95
0.004239
s
<
p99
0.0043
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000162
s
SD
8e-06
s
p50
0.000159
s
<
p95
0.000174
s
p99
0.000174
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.00014
s
SD
1.1e-05
s
p50
0.000137
s
<
p95
0.000151
s
<
p99
0.000152
s
Host function call duration: '__hc__must_get_valid_record_1'
Duration of this host function call invoked from within WASM.
mean
0.002708
s
SD
0.001092
s
p50
0.002237
s
<
p95
0.003908
s
<
p99
0.004016
s
Host function call duration: '__hc__update_1'
Duration of this host function call invoked from within WASM.
mean
0.004376
s
SD
0.00147
s
p50
0.00395
s
<
p95
0.005821
s
<
p99
0.005948
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.002741
s
SD
0.001713
s
p50
0.003975
s
<
p95
0.0065
s
<
p99
0.006702
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.004468
s
SD
0.001303
s
p50
0.004347
s
<
p95
0.005407
s
<
p99
0.00544
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.54
s
<
mean
153.54
s
SD
86.55
s
<
p95
288.54
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 290.001718521s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.00062
s
SD
0
s
p50
0.00062
s
p95
0.00062
s
p99
0.00062
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000432
s
SD
0
s
p50
0.000432
s
p95
0.000432
s
p99
0.000432
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000813
s
SD
5.9e-05
s
p50
0.000796
s
<
p95
0.000864
s
<
p99
0.000868
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.029481
s
SD
0.011156
s
p50
0.026047
s
<
p95
0.04122
s
<
p99
0.042353
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.001817
s
SD
0
s
p50
0.001817
s
p95
0.001817
s
p99
0.001817
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.001276
s
SD
0
s
p50
0.001276
s
p95
0.001276
s
p99
0.001276
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000866
s
SD
0.000326
s
p50
0.000766
s
<
p95
0.001208
s
<
p99
0.001239
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.00065
s
SD
0.000321
s
p50
0.00061
s
<
p95
0.000806
s
<
p99
0.000811
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000126
s
SD
6e-06
s
p50
0.000125
s
<
p95
0.000133
s
p99
0.000133
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
8.35
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
2.80
KiB/s
<
mean
469.83
KiB/s
SD
1.49
MiB/s
<
p95
4.99
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
2.26
KiB/s
<
mean
14.43
KiB/s
SD
19.73
KiB/s
<
p95
74.42
KiB/s
Total bytes received
Total bytes received on primary network interface
count
133.06
MiB
mean
469.83
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
4.09
MiB
mean
14.43
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 1076.82 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (96.9% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
5.62
%
<
mean
11.52
%
SD
4.78
%
<
p95
18.9
%
System
3.17
%
CPU percentiles
CPU usage percentiles
p50
10.47
%
p95
18.90
%
p99
19.02
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
54.95
%
<
mean
56.11
%
SD
0.84
%
<
p95
57.48
%
Memory available percentage
Percentage of available memory
p5
42.52
%
<
mean
43.89
%
SD
0.84
%
<
p95
45.05
%
Max host memory used
Maximum memory usage percentage across all hosts
max
56.11
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
96.89
%
Memory growth rate
Rate of memory growth over time
growth
1076.82
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.04
MiB/s
Disk write throughput
Disk write throughput in MiB/s
40.36
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
1/1
hosts
Mount Point /etc/hosts
1/1
hosts
Mount Point /etc/nomad.d/client-meta.json
1/1
hosts
Mount Point /etc/resolv.conf
1/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
3.17
5 min
2.64
15 min
1.98
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.0327
%
SD
0.0761
%
<
p95
0.16
%
60 second average
0.0160
%
300 second average
0.0010
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0043
%
SD
0.0169
%
<
p95
0.03
%
60 second average
0.0023
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0043
%
SD
0.0169
%
<
p95
0.03
%
60 second average
0.0023
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
3.2
%
<
mean
4.53
%
SD
1.05
%
<
p95
5.56
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
26.05
KiB
<
mean
744.39
KiB
SD
300.99
KiB
<
p95
1.03
MiB
Holochain process threads
Number of threads in Holochain process
p5
39
threads
<
mean
145.52
threads
SD
137.48
threads
<
p95
425
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
31
file descriptors
<
mean
234.65
file descriptors
SD
344.88
file descriptors
<
p95
940
file descriptors

Write Validated must_get_agent_activity

↑ Back to index

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Mixed-Arc must_get_agent_activity, but all agents are full-arc.

Started
Thu, 09 Jul 2026 06:17:35 UTC
Peer count
30
Peer count at end
27
Behaviours
  • must_get_agent_activity (1 agent)
  • write (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
write_validated_must_get_agent_activity_28993172816_1
Highest observed action_seq
The maximum chain length observed per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.
Mean max (across write agents)
Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.
1525.2
Max
Highest chain head value observed for any single write agent.
1787
Write agents observed
5
Chain batch delay timing
The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.
Mean
mean
173.668051
s
SD
54.187083
s
Max
Highest per-partition mean latency
max mean
1031.285182
s
Min
Lowest per-partition mean latency
min mean
2.975981
s
Chain batch delay rate
The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.
Mean
mean
2.41
/s
Max
Highest per-partition mean rate
max
4.33
/s
Min
Lowest per-partition mean rate
min
1.46
/s
create_validated_sample_entry zome call timing
The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.
Mean
mean
0.743899
s
SD
0.663773
s
Max
Highest per-partition mean latency
max mean
3.403371
s
Min
Lowest per-partition mean latency
min mean
0.058077
s
Retrieval errors
A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.
Total
2192
Agents affected
19 / 19
Mean per agent
Total count divided by number of partitions, rounded to nearest whole number
115
Max
Highest count in any single partition
545
Min
Lowest count in any single partition
1
Final error count
The total number of all types of error accumulated over the run by all agents.
80543
Holochain MetricsClick to toggle visibility.
Cascade duration
Time taken to execute a cascade (get) query inside Holochain.
mean
0.011903
s
SD
0.061924
s
p50
0.001046
s
<
p95
0.068786
s
<
p99
0.4679
s
Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.054513
s
SD
0.021349
s
p50
0.058938
s
<
p95
0.098787
s
p99
0.098787
s
Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.206762
s
SD
0.060641
s
p50
0.20282
s
<
p95
0.284112
s
<
p99
0.362657
s
Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of this zome call as measured by Holochain internally.
mean
0.026522
s
SD
0.015935
s
p50
0.021243
s
<
p95
0.057838
s
<
p99
0.087655
s
Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of this zome call as measured by Holochain internally.
mean
0.050195
s
SD
0.055992
s
p50
0.036997
s
<
p95
0.226643
s
<
p99
0.252225
s
Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of this zome call as measured by Holochain internally.
mean
0.062058
s
SD
0.106597
s
p50
0.066039
s
<
p95
0.512297
s
p99
0.512297
s
WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.03041
s
SD
0.016597
s
p50
0.031874
s
<
p95
0.066085
s
p99
0.066085
s
WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.188037
s
SD
0.056046
s
p50
0.182511
s
<
p95
0.258243
s
<
p99
0.323194
s
WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.015843
s
SD
0.009531
s
p50
0.012298
s
<
p95
0.033652
s
<
p99
0.053215
s
WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.018263
s
SD
0.022983
s
p50
0.016839
s
<
p95
0.052753
s
<
p99
0.188411
s
WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.037743
s
SD
0.10809
s
p50
0.031533
s
<
p95
0.492009
s
p99
0.492009
s
WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.001078
s
SD
0.000286
s
p50
0.001106
s
<
p95
0.001705
s
<
p99
0.002071
s
WASM call duration: 'validated_must_get_agent_activity_integrity::validate'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.009681
s
SD
0.009554
s
p50
0.008562
s
<
p95
0.030647
s
<
p99
0.059489
s
Host function call duration: '__hc__agent_info_1'
Duration of this host function call invoked from within WASM.
mean
2.8e-05
s
SD
1e-05
s
p50
2.7e-05
s
<
p95
6.2e-05
s
p99
6.2e-05
s
Host function call duration: '__hc__create_1'
Duration of this host function call invoked from within WASM.
mean
0.000437
s
SD
0.000171
s
p50
0.000413
s
<
p95
0.000663
s
<
p99
0.001237
s
Host function call duration: '__hc__create_link_1'
Duration of this host function call invoked from within WASM.
mean
0.000437
s
SD
0.00018
s
p50
0.000383
s
<
p95
0.001009
s
p99
0.001009
s
Host function call duration: '__hc__get_links_1'
Duration of this host function call invoked from within WASM.
mean
0.001059
s
SD
0.078984
s
p50
0.000521
s
<
p95
0.138016
s
<
p99
0.467957
s
Host function call duration: '__hc__must_get_agent_activity_1'
Duration of this host function call invoked from within WASM.
mean
0.016902
s
SD
0.017919
s
p50
0.012921
s
<
p95
0.045812
s
<
p99
0.103588
s
Host function call duration: '__hc__query_1'
Duration of this host function call invoked from within WASM.
mean
0.006401
s
SD
0.003007
s
p50
0.004497
s
<
p95
0.010534
s
<
p99
0.013068
s
Host function call duration: '__hc__random_bytes_1'
Duration of this host function call invoked from within WASM.
mean
1e-05
s
SD
3e-06
s
p50
1e-05
s
<
p95
1.8e-05
s
p99
1.8e-05
s
Host function call duration: '__hc__zome_info_1'
Duration of this host function call invoked from within WASM.
mean
0.006325
s
SD
0.012112
s
p50
0.011176
s
<
p95
0.040632
s
<
p99
0.062081
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.018346
s
SD
0.018533
s
p50
0.01392
s
<
p95
0.042301
s
<
p99
0.102588
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
47.01
s
<
mean
452.2
s
SD
259.81
s
<
p95
857.05
s
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
19.097018
s
SD
22.430245
s
p50
12.376273
s
<
p95
76.503508
s
<
p99
91.257626
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
1.215712
s
SD
4.965036
s
p50
3.370741
s
<
p95
15.417298
s
<
p99
22.105948
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.001809
s
SD
0.001398
s
p50
0.001268
s
<
p95
0.003801
s
<
p99
0.007108
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.013995
s
SD
0.032219
s
p50
0.015056
s
<
p95
0.098531
s
<
p99
0.146266
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.084074
s
SD
0.061042
s
p50
0.04795
s
<
p95
0.161814
s
<
p99
0.307976
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.220435
s
SD
3.076919
s
p50
0.284945
s
<
p95
9.147274
s
<
p99
13.334696
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
20.124182
s
SD
24.067933
s
p50
18.340565
s
<
p95
57.933547
s
<
p99
91.266755
s
Authored DB connection use time
Time spent holding authored database connections.
mean
0.000333
s
SD
0.000237
s
p50
0.000279
s
<
p95
0.000951
s
<
p99
0.001298
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
0.001946
s
SD
0.01291
s
p50
0.000407
s
<
p95
0.025457
s
<
p99
0.067823
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000345
s
SD
9.8e-05
s
p50
0.000348
s
<
p95
0.000499
s
<
p99
0.000709
s
P2P request roundtrip: 'get'
Time spent sending a get request and awaiting its response.
mean
0.901318
s
SD
28.722101
s
p50
0.124698
s
<
p95
60.002415
s
<
p99
60.257019
s
P2P request roundtrip: 'get_links'
Time spent sending a get_links request and awaiting its response.
mean
0.108634
s
SD
0.342809
s
p50
0.464184
s
<
p95
0.955782
s
p99
0.955782
s
P2P request roundtrip: 'must_get_agent_activity'
Time spent sending a must_get_agent_activity request and awaiting its response.
mean
0.155678
s
SD
0.011763
s
p50
0.154407
s
<
p95
0.161313
s
<
p99
0.162194
s
P2P request roundtrip: 'send_validation_receipts'
Time spent sending a send_validation_receipts request and awaiting its response.
mean
0.250194
s
SD
4.393436
s
p50
0.265052
s
<
p95
10.126088
s
<
p99
10.187722
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
29.02
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.52
KiB/s
<
mean
100.96
KiB/s
SD
322.40
KiB/s
<
p95
142.02
KiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
386
B/s
<
mean
66.59
KiB/s
SD
65.52
KiB/s
<
p95
201.07
KiB/s
Total bytes received
Total bytes received on primary network interface
count
2.42
GiB
mean
2.69
MiB/s
Total bytes sent
Total bytes sent on primary network interface
count
1.60
GiB
mean
1.78
MiB/s
CPU spike anomaly
CPU spike anomaly was detected
Detected

Warning CPU p99 reached 97.7%

Memory leak anomaly
Memory leak anomaly was detected
Detected

Warning Memory growing at 748.54 MiB/s

Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/7 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (96.4% swap used)

System overload anomaly
System overload anomaly was detected
Detected

Warning 21% of hosts overloaded (load5/ncpus > 1.0)

CPU usage
Total CPU usage and kernel CPU usage
Total
p5
2.67
%
<
mean
37
%
SD
28.22
%
<
p95
90.67
%
System
7.99
%
CPU percentiles
CPU usage percentiles
p50
32.13
%
p95
90.67
%
p99
97.74
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
7
hosts
mean time
0.45
s
Memory used percentage
Percentage of memory used
p5
7.73
%
<
mean
16.02
%
SD
8.64
%
<
p95
28.71
%
Memory available percentage
Percentage of available memory
p5
71.29
%
<
mean
83.98
%
SD
8.64
%
<
p95
92.27
%
Max host memory used
Maximum memory usage percentage across all hosts
max
54.98
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
96.38
%
Memory growth rate
Rate of memory growth over time
growth
748.54
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.01
MiB/s
Disk write throughput
Disk write throughput in MiB/s
112.35
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /
0/5
hosts
Mount Point /efi-boot
0/4
hosts
Mount Point /etc/hostname
1/7
hosts
Mount Point /etc/hosts
1/7
hosts
Mount Point /etc/nomad.d/client-meta.json
1/8
hosts
Mount Point /etc/resolv.conf
1/7
hosts
Mount Point /nix/store
0/5
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
2.29
5 min
2.39
15 min
2.48
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
21.43
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
11.2979
%
SD
17.1512
%
<
p95
47.62
%
60 second average
11.1776
%
300 second average
12.1823
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
10.1827
%
SD
18.1646
%
<
p95
49.3
%
60 second average
9.8588
%
300 second average
8.5118
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
8.7744
%
SD
16.2582
%
<
p95
44.55
%
60 second average
8.4839
%
300 second average
7.1429
%
Holochain process CPU usage
CPU usage by Holochain process
p5
0.55
%
<
mean
31.02
%
SD
25.46
%
<
p95
84.66
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
396.67
KiB
<
mean
515.89
KiB
SD
141.76
KiB
<
p95
718.33
KiB
Holochain process threads
Number of threads in Holochain process
p5
27
threads
<
mean
43.4
threads
SD
17.97
threads
<
p95
73
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
68
file descriptors
<
mean
95.01
file descriptors
SD
23.78
file descriptors
<
p95
125
file descriptors

Zome Call, Single Value

↑ Back to index

Calls a zome function that returns a fixed value. This tests the maximum performance of zome calls when the zome function is not calling into Holochain other otherwise doing any work.

Started
Thu, 09 Jul 2026 04:29:24 UTC
Peer count
1
Behaviours
  • default (1 agent)
Holochain version
0.7.0-dev.31
Wind Tunnel version
0.7.0
Run ID
zome_call_single_value_28993172816_1
Call timing
The time taken for the call to complete.
mean
0.002335
s
SD
0.000891
s
p50
0.002217
s
<
p95
0.002848
s
<
p99
0.003839
s
Call rate
The number of zome calls completed per second.
mean
4276.55
/s
Error count
The number of errors accumulated during the run.
0
Holochain MetricsClick to toggle visibility.
WASM usage: 'return_single_value::get_value'
Metered usage count of the WASM ribosome for this zome function.
total
507959231
over 280.001616397s
mean rate
1.81412969e+06
/s
std
105744.79
/s
p5
1.65347987e+06
/s
p95
1.96833591e+06
/s
peak
1.97552822e+06
/s
Zome call duration: 'return_single_value::get_value'
Duration of this zome call as measured by Holochain internally.
mean
0.001592
s
SD
5.4e-05
s
p50
0.001594
s
<
p95
0.00163
s
<
p99
0.001831
s
WASM call duration: 'return_single_value::get_value'
Duration of inner WASM calls for this function, excluding Holochain overhead.
mean
0.000586
s
SD
1e-05
s
p50
0.000583
s
<
p95
0.000592
s
p99
0.000592
s
Post-commit duration
Time spent executing post-commit workflows.
mean
0.009948
s
SD
0
s
p50
0.009948
s
p95
0.009948
s
p99
0.009948
s
Conductor uptime
Conductor uptime gauge. A drop in the trend indicates a restart during the run.
p5
18.47
s
<
mean
148.47
s
SD
83.67
s
<
p95
278.48
s
Integrated ops
Count of DHT ops integrated since the conductor started. Resets on restart.
total
0
over 280.001659739s
Not enough time data to show a trend.
Integration delay
Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
Validation attempts per op
Number of validation attempts required per op. Values consistently above 1 indicate retries.
mean
0
s
SD
0
s
p50
0
s
p95
0
s
p99
0
s
App validation workflow duration
Time spent running the app validation workflow.
mean
0.00059
s
SD
0
s
p50
0.00059
s
p95
0.00059
s
p99
0.00059
s
Countersigning workflow duration
Time spent running the countersigning workflow.
mean
0.000508
s
SD
0
s
p50
0.000508
s
p95
0.000508
s
p99
0.000508
s
Integrate DHT ops workflow duration
Time spent running the integration workflow.
mean
0.000568
s
SD
0
s
p50
0.000568
s
p95
0.000568
s
p99
0.000568
s
Publish DHT ops workflow duration
Time spent running the publish workflow.
mean
0.003998
s
SD
0.00058
s
p50
0.004122
s
<
p95
0.005074
s
p99
0.005074
s
System validation workflow duration
Time spent running the sys validation workflow.
mean
0.017128
s
SD
0
s
p50
0.017128
s
p95
0.017128
s
p99
0.017128
s
Validation receipt workflow duration
Time spent running the validation receipt workflow.
mean
0.01666
s
SD
0
s
p50
0.01666
s
p95
0.01666
s
p99
0.01666
s
Authored DB connection use time
Time spent holding authored database connections.
mean
4.2e-05
s
SD
2e-06
s
p50
4.1e-05
s
<
p95
4.3e-05
s
p99
4.3e-05
s
Write transaction duration
Duration of exclusive write transactions across all databases.
mean
2.8e-05
s
SD
9.1e-05
s
p50
0.000211
s
p95
0.000211
s
p99
0.000211
s
Lair keystore: signing
Duration of Ed25519 signing requests to the Lair keystore.
mean
0.000133
s
SD
0
s
p50
0.000133
s
p95
0.000133
s
p99
0.000133
s
Host MetricsClick to toggle visibility.
User CPU usage
CPU usage by user space
9.27
%
Network receive rate (primary)
Rate of bytes received on primary network interface
p5
1.23
KiB/s
<
mean
282.54
KiB/s
SD
1.20
MiB/s
<
p95
1.49
MiB/s
Network send rate (primary)
Rate of bytes sent on primary network interface
p5
1.51
KiB/s
<
mean
10.91
KiB/s
SD
16.75
KiB/s
<
p95
41.71
KiB/s
Total bytes received
Total bytes received on primary network interface
count
82.78
MiB
mean
282.54
KiB/s
Total bytes sent
Total bytes sent on primary network interface
count
3.20
MiB
mean
10.91
KiB/s
CPU spike anomaly
CPU spike anomaly was detected
NotDetected
Memory leak anomaly
Memory leak anomaly was detected
NotDetected
Disk full anomaly
Disk full anomaly was detected
Detected

Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity

Swap thrashing anomaly
Swap thrashing anomaly was detected
Detected

Critical Heavy swap usage (96.9% swap used)

System overload anomaly
System overload anomaly was detected
NotDetected
CPU usage
Total CPU usage and kernel CPU usage
Total
p5
10.2
%
<
mean
13.46
%
SD
3.27
%
<
p95
18.89
%
System
4.18
%
CPU percentiles
CPU usage percentiles
p50
11.95
%
p95
18.89
%
p99
19.03
%
CPU usage above 80%
Number of hosts above 80% CPU and mean time spent above threshold for those hosts
count
0
hosts
mean time
0.00
s
Memory used percentage
Percentage of memory used
p5
54.93
%
<
mean
56.08
%
SD
0.86
%
<
p95
57.48
%
Memory available percentage
Percentage of available memory
p5
42.52
%
<
mean
43.92
%
SD
0.86
%
<
p95
45.07
%
Max host memory used
Maximum memory usage percentage across all hosts
max
56.08
%
Max host swap used percentage
Maximum swap space usage percentage across all hosts
max
96.89
%
Memory growth rate
Rate of memory growth over time
growth
-453.83
MiB/s
Disk read throughput
Disk read throughput in MiB/s
0.03
MiB/s
Disk write throughput
Disk write throughput in MiB/s
34.16
MiB/s
Disk space utilization risk
Number of hosts nearing disk space capacity by mount point
Mount Point /etc/hostname
1/1
hosts
Mount Point /etc/hosts
1/1
hosts
Mount Point /etc/nomad.d/client-meta.json
1/1
hosts
Mount Point /etc/resolv.conf
1/1
hosts
System load average
System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.
1 min
4.26
5 min
3.18
15 min
2.25
CPU overloaded hosts
Percentage of hosts that experienced CPU overload
0.00
%
CPU pressure
CPU pressure over 10, 60, and 300 second averages
10 second average
p5
0
%
<
mean
0.1242
%
SD
0.1504
%
<
p95
0.4
%
60 second average
0.0774
%
300 second average
0.0190
%
Memory pressure some
Memory pressure (some tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
Memory pressure full
Memory pressure (all tasks stalled) over 10, 60, and 300 second averages
10 second average
p5
0
%
mean
0
%
SD
0
%
p95
0
%
60 second average
0.0000
%
300 second average
0.0000
%
I/O pressure some
I/O pressure (some tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0042
%
SD
0.0166
%
<
p95
0.03
%
60 second average
0.0023
%
300 second average
0.0000
%
I/O pressure full
I/O pressure (all tasks stalled) over 10, 60 and 300 second averages
10 second average
p5
0
%
<
mean
0.0042
%
SD
0.0166
%
<
p95
0.03
%
60 second average
0.0023
%
300 second average
0.0000
%
Holochain process CPU usage
CPU usage by Holochain process
p5
3.2
%
<
mean
4.78
%
SD
1.13
%
<
p95
5.56
%
Holochain process memory (PSS)
Proportional Set Size memory of Holochain process
p5
24.90
KiB
<
mean
736.64
KiB
SD
295.85
KiB
<
p95
1.03
MiB
Holochain process threads
Number of threads in Holochain process
p5
38
threads
<
mean
141.53
threads
SD
136.68
threads
<
p95
425
threads
Holochain process file descriptors
Number of file descriptors used by Holochain process
p5
30
file descriptors
<
mean
218.94
file descriptors
SD
345.84
file descriptors
<
p95
940
file descriptors