App Install

Measure app installation speed. This scenario has two roles:

minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started

Thu, 16 Jul 2026 03:45:42 UTC

Peer count

1

Behaviours

minimal (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

app_install_minimal_29468960194_1

First install time

The time from conductor startup to completion of the first app installation attempt.

0.398450052

s

Install app timing

The time taken to install an app.

mean

0.086299

s

SD

0.031126

s

p50

0.076607

s

<

p95

0.126006

s

<

p99

0.24314

s

Holochain MetricsClick to toggle visibility.

WASM usage: 'callback::init'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 280.003932352s

Not enough time data to show a trend.

WASM usage: 'callback_integrity::genesis_self_check_2'

Metered usage count of the WASM ribosome for this zome function.

total

146268

over 280.003932352s

mean rate

522.37

/s

std

2268.65

/s

p5

0

/s

p95

2581.19

/s

peak

12045.22

/s

WASM call duration: 'callback::init'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001045

s

SD

0.000307

s

p50

0.000948

s

<

p95

0.001253

s

<

p99

0.002669

s

WASM call duration: 'callback_integrity::genesis_self_check_2'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001099

s

SD

1.3e-05

s

p50

0.001098

s

<

p95

0.001114

s

<

p99

0.001169

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.007038

s

SD

0.006564

s

p50

0.003149

s

<

p95

0.018959

s

<

p99

0.019699

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

16.66

s

<

mean

146.66

s

SD

83.67

s

<

p95

276.66

s

Integrated ops

Count of DHT ops integrated since the conductor started. Resets on restart.

total

0

over 280.003958535s

Not enough time data to show a trend.

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.001759

s

SD

0.00016

s

p50

0.001753

s

<

p95

0.001758

s

<

p99

0.002629

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.00239

s

SD

4e-05

s

p50

0.00239

s

≤

p95

0.00239

s

<

p99

0.002442

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.002579

s

SD

4.2e-05

s

p50

0.002574

s

<

p95

0.002692

s

<

p99

0.002773

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.004094

s

SD

8.7e-05

s

p50

0.004086

s

<

p95

0.004232

s

<

p99

0.004543

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

0.003256

s

SD

0.00012

s

p50

0.003248

s

<

p95

0.003373

s

<

p99

0.003897

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

0.002384

s

SD

0.000236

s

p50

0.002369

s

<

p95

0.00259

s

<

p99

0.003651

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.000308

s

SD

9.7e-05

s

p50

0.00028

s

<

p95

0.000531

s

<

p99

0.000576

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.000565

s

SD

0.000125

s

p50

0.000501

s

<

p95

0.00078

s

<

p99

0.000909

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000421

s

SD

6e-06

s

p50

0.000422

s

≤

p95

0.000422

s

≤

p99

0.000422

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

61.08

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

0

B/s

≤

mean

0

B/s

SD

0

B/s

≤

p95

0

B/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

0

B/s

≤

mean

0

B/s

SD

0

B/s

≤

p95

0

B/s

Total bytes received

Total bytes received on primary network interface

count

0

B

mean

0

B/s

Total bytes sent

Total bytes sent on primary network interface

count

0

B

mean

0

B/s

CPU spike anomaly

CPU spike anomaly was detected

Detected

Warning CPU p99 reached 91.1%

Memory leak anomaly

Memory leak anomaly was detected

NotDetected

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

Detected

Warning 100% of hosts overloaded (load5/ncpus > 1.0)

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

66.2

%

<

mean

81.45

%

SD

9.37

%

<

p95

90.84

%

System

20.37

%

CPU percentiles

CPU usage percentiles

p50

86.54

%

p95

90.84

%

p99

91.10

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

1

hosts

mean time

0.66

s

Memory used percentage

Percentage of memory used

p5

14.05

%

<

mean

15.74

%

SD

1.64

%

<

p95

18.07

%

Memory available percentage

Percentage of available memory

p5

81.93

%

<

mean

84.26

%

SD

1.64

%

<

p95

85.95

%

Max host memory used

Maximum memory usage percentage across all hosts

max

15.74

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

-480.90

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.01

MiB/s

Disk write throughput

Disk write throughput in MiB/s

40.18

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /etc/hostname

0/1

hosts

Mount Point /etc/hosts

0/1

hosts

Mount Point /etc/resolv.conf

0/1

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

6.45

5 min

4.41

15 min

2.49

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

100.00

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

17.31

%

<

mean

50.0517

%

SD

20.2678

%

<

p95

71.92

%

60 second average

42.9420

%

300 second average

27.0827

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.616

%

SD

0.5092

%

<

p95

1.42

%

60 second average

0.5117

%

300 second average

0.2487

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.027

%

SD

0.0611

%

<

p95

0.18

%

60 second average

0.0263

%

300 second average

0.0017

%

Holochain process CPU usage

CPU usage by Holochain process

p5

19.57

%

<

mean

45.57

%

SD

17.03

%

<

p95

60.47

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

83.14

KiB

<

mean

314.33

KiB

SD

86.87

KiB

<

p95

396.66

KiB

Holochain process threads

Number of threads in Holochain process

p5

17

threads

<

mean

109.26

threads

SD

137.55

threads

<

p95

410

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

43

file descriptors

<

mean

269.65

file descriptors

SD

348.72

file descriptors

<

p95

1022

file descriptors

App Install

↑ Back to index

Measure app installation speed. This scenario has two roles:

minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.
large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.

These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.

Started

Thu, 16 Jul 2026 03:44:02 UTC

Peer count

1

Behaviours

large (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

app_install_large_29468960194_1

First install time

The time from conductor startup to completion of the first app installation attempt.

0.129512001

s

Install app timing

The time taken to install an app.

mean

0.064156

s

SD

0.025032

s

p50

0.056374

s

<

p95

0.111623

s

<

p99

0.170075

s

Holochain MetricsClick to toggle visibility.

WASM usage: 'large::init'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 271.323600013s

Not enough time data to show a trend.

WASM call duration: 'large::init'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.003549

s

SD

0.000959

s

p50

0.003145

s

<

p95

0.005304

s

<

p99

0.008259

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.026598

s

SD

0.00434

s

p50

0.026679

s

<

p95

0.033133

s

<

p99

0.038945

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

16.75

s

<

mean

146.94

s

SD

83.93

s

<

p95

278.07

s

Integrated ops

Count of DHT ops integrated since the conductor started. Resets on restart.

total

0

over 281.323650399s

Not enough time data to show a trend.

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.001031

s

SD

2.3e-05

s

p50

0.001032

s

≤

p95

0.001032

s

≤

p99

0.001032

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.002934

s

SD

0.000276

s

p50

0.002938

s

≤

p95

0.002938

s

≤

p99

0.002938

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.002348

s

SD

0.000126

s

p50

0.002348

s

≤

p95

0.002348

s

≤

p99

0.002348

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.003744

s

SD

0.00018

s

p50

0.003752

s

≤

p95

0.003752

s

≤

p99

0.003752

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

0.002466

s

SD

0.000211

s

p50

0.002471

s

≤

p95

0.002471

s

≤

p99

0.002471

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

0.001447

s

SD

0.000181

s

p50

0.001456

s

≤

p95

0.001456

s

≤

p99

0.001456

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.000269

s

SD

0.000115

s

p50

0.000235

s

<

p95

0.00047

s

<

p99

0.000713

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.000407

s

SD

0.000273

s

p50

0.000428

s

<

p95

0.000887

s

<

p99

0.001804

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000277

s

SD

1.1e-05

s

p50

0.000277

s

≤

p95

0.000277

s

≤

p99

0.000277

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

65.64

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

4.88

KiB/s

<

mean

398.42

KiB/s

SD

1.18

MiB/s

<

p95

768.85

KiB/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

4.39

KiB/s

<

mean

117.29

KiB/s

SD

148.62

KiB/s

<

p95

359.44

KiB/s

Total bytes received

Total bytes received on primary network interface

count

112.83

MiB

mean

398.42

KiB/s

Total bytes sent

Total bytes sent on primary network interface

count

33.22

MiB

mean

117.29

KiB/s

CPU spike anomaly

CPU spike anomaly was detected

Detected

Warning CPU p99 reached 96.8%

Memory leak anomaly

Memory leak anomaly was detected

NotDetected

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

Detected

Warning 100% of hosts overloaded (load5/ncpus > 1.0)

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

85.2

%

<

mean

89.27

%

SD

5.44

%

<

p95

95.5

%

System

23.62

%

CPU percentiles

CPU usage percentiles

p50

89.45

%

p95

95.50

%

p99

96.81

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

1

hosts

mean time

0.97

s

Memory used percentage

Percentage of memory used

p5

19.93

%

<

mean

23.02

%

SD

2.87

%

<

p95

28.75

%

Memory available percentage

Percentage of available memory

p5

71.25

%

<

mean

76.98

%

SD

2.87

%

<

p95

80.07

%

Max host memory used

Maximum memory usage percentage across all hosts

max

23.02

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

-603.46

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.00

MiB/s

Disk write throughput

Disk write throughput in MiB/s

4.37

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /etc/nomad.d/client-meta.json

0/1

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

6.12

5 min

3.33

15 min

1.59

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

100.00

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

24.7

%

<

mean

72.6447

%

SD

20.4903

%

<

p95

97.65

%

60 second average

59.0027

%

300 second average

30.5260

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.5513

%

SD

0.7825

%

<

p95

2.15

%

60 second average

0.4163

%

300 second average

0.2490

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.0053

%

SD

0.0159

%

<

p95

0.03

%

60 second average

0.0187

%

300 second average

0.0657

%

Holochain process CPU usage

CPU usage by Holochain process

p5

41.19

%

<

mean

53.76

%

SD

8.03

%

<

p95

71.07

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

24.17

KiB

<

mean

356.91

KiB

SD

188.04

KiB

<

p95

572.37

KiB

Holochain process threads

Number of threads in Holochain process

p5

7

threads

<

mean

99.42

threads

SD

149.71

threads

<

p95

434

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

8

file descriptors

<

mean

258.15

file descriptors

SD

388.03

file descriptors

<

p95

1121

file descriptors

DHT Sync Lag

↑ Back to index

Measures the lag time between an agent publishing data and other peers being able to see it. This scenario has two roles:

write: Creates entries with a timestamp field, linked to a known base hash so that record_lag agents can discover them.
record_lag: Repeatedly queries for links from the known base hash. When a new entry is discovered, it calculates the time difference between the entry's timestamp and the current time, giving the sync lag for that entry.

Started

Thu, 16 Jul 2026 03:47:21 UTC

Peer count

30

Peer count at end

27

Behaviours

record_lag (1 agent)
write (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

dht_sync_lag_29468960194_1

Create rate

The average number of created records per agent.

Mean

mean

39.31

/s

Max

Highest per-partition mean rate

max

82.96

/s

Min

Lowest per-partition mean rate

min

9.44

/s

Sync lag timing

The average time between when a record was created and when it is first seen by an agent.

Mean

mean

1.85556659814e+30

s

SD

1.24262231228e+31

s

Max

Highest per-partition mean latency

max mean

7.42226639257e+30

s

Min

Lowest per-partition mean latency

min mean

50.016352

s

Sync lag rate

The average number of created records discovered per agent.

Mean

mean

111.81

/s

Max

Highest per-partition mean rate

max

359

/s

Min

Lowest per-partition mean rate

min

2.67

/s

Delivery ratio

The proportion of created entries successfully received by all record_lag agents.

0.0043

Sent count

The total number of entries sent (created) by write agents, by agent.

Total

145450

Agents affected

22 / 22

Mean per agent

Total count divided by number of partitions, rounded to nearest whole number

6611

Max

Highest count in any single partition

15235

Min

Lowest count in any single partition

1004

Received count

The total number of entries received by record_lag agents, by agent.

Total

3143

Agents affected

4 / 5

Mean per agent

Total count divided by number of partitions, rounded to nearest whole number

629

Max

Highest count in any single partition

2384

Min

Lowest count in any single partition

0

Error count

The number of errors encountered during the scenario.

2442

Holochain MetricsClick to toggle visibility.

Cascade duration

Time taken to execute a cascade (get) query inside Holochain.

mean

0.001009

s

SD

0.000684

s

p50

0.00052

s

<

p95

0.002357

s

<

p99

0.002589

s

Cascade fetch errors

Count of network fetch errors during cascade calls.

total

4

over 2511.878995428s

mean rate

21.2

/s

std

52.58

/s

p5

0

/s

p95

172.25

/s

peak

175.55

/s

WASM usage: 'timed::created_timed_entry'

Metered usage count of the WASM ribosome for this zome function.

total

421780464

over 38372.329543261s

mean rate

2.75512758886e+09

/s

std

2.79489420505e+10

/s

p5

102174.41

/s

p95

6.04784087595e+09

/s

peak

9.44903025187e+11

/s

WASM usage: 'timed::get_timed_entries_local'

Metered usage count of the WASM ribosome for this zome function.

total

4370984371

over 33982.294853514s

mean rate

7.08448257613e+09

/s

std

9.64356957305e+09

/s

p5

1.65935957e+06

/s

p95

2.63932873709e+10

/s

peak

2.75103097016e+10

/s

WASM usage: 'timed_integrity::entry_defs'

Metered usage count of the WASM ribosome for this zome function.

total

53791752

over 38372.329543261s

mean rate

3.4121809639e+08

/s

std

3.163791236e+09

/s

p5

16941.5

/s

p95

8.7256510238e+08

/s

peak

1.20517895427e+11

/s

Zome call duration: 'timed::created_timed_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.0532

s

SD

0.037323

s

p50

0.038097

s

<

p95

0.134728

s

<

p99

0.163791

s

Zome call duration: 'timed::get_timed_entries_local'

Duration of this zome call as measured by Holochain internally.

mean

0.022033

s

SD

0.194894

s

p50

0.020604

s

<

p95

0.539056

s

<

p99

0.676353

s

WASM call duration: 'timed::created_timed_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.038675

s

SD

0.029399

s

p50

0.028409

s

<

p95

0.104132

s

<

p99

0.129396

s

WASM call duration: 'timed::get_timed_entries_local'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.017088

s

SD

0.191876

s

p50

0.013382

s

<

p95

0.527414

s

<

p99

0.664369

s

WASM call duration: 'timed_integrity::entry_defs'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001279

s

SD

0.001303

s

p50

0.001616

s

<

p95

0.004603

s

<

p99

0.006759

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.002417

s

SD

0.004977

s

p50

0.001015

s

<

p95

0.014435

s

<

p99

0.01789

s

Host function call duration: '__hc__create_link_1'

Duration of this host function call invoked from within WASM.

mean

0.002501

s

SD

0.005168

s

p50

0.000993

s

<

p95

0.014916

s

<

p99

0.018771

s

Host function call duration: '__hc__get_1'

Duration of this host function call invoked from within WASM.

mean

0.001077

s

SD

0.000666

s

p50

0.000574

s

<

p95

0.002415

s

<

p99

0.002597

s

Host function call duration: '__hc__get_links_1'

Duration of this host function call invoked from within WASM.

mean

0.000811

s

SD

0.006988

s

p50

0.000676

s

<

p95

0.021352

s

<

p99

0.024815

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.010585

s

SD

0.009406

s

p50

0.011756

s

<

p95

0.035205

s

<

p99

0.043715

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.015155

s

SD

0.009328

s

p50

0.01466

s

<

p95

0.035311

s

<

p99

0.037723

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

95.58

s

<

mean

904.24

s

SD

520.81

s

<

p95

1716.99

s

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

66.78191

s

SD

106.957207

s

p50

4.649985

s

<

p95

134.227048

s

<

p99

793.901597

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

1.823334

s

SD

8.866079

s

p50

2.891962

s

<

p95

30.547756

s

<

p99

39.710967

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.001792

s

SD

0.001221

s

p50

0.001348

s

<

p95

0.004408

s

<

p99

0.00445

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.166979

s

SD

0.413275

s

p50

0.120762

s

<

p95

1.157245

s

<

p99

1.568013

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.395816

s

SD

2.111774

s

p50

0.22623

s

<

p95

4.227037

s

<

p99

12.168968

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

13.615982

s

SD

47.786608

s

p50

24.159806

s

<

p95

140.184599

s

<

p99

179.991446

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

32.859335

s

SD

73.210204

s

p50

0.003384

s

<

p95

106.628866

s

<

p99

487.695683

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.003813

s

SD

0.00403

s

p50

0.00296

s

<

p95

0.012263

s

<

p99

0.014519

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.00397

s

SD

0.01343

s

p50

0.001319

s

<

p95

0.035768

s

<

p99

0.057603

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.002307

s

SD

0.003969

s

p50

0.000672

s

<

p95

0.01175

s

<

p99

0.015495

s

P2P request roundtrip: 'get'

Time spent sending a get request and awaiting its response.

mean

1.522094

s

SD

29.411161

s

p50

0.542105

s

<

p95

60.023969

s

<

p99

60.192312

s

P2P request roundtrip: 'send_validation_receipts'

Time spent sending a send_validation_receipts request and awaiting its response.

mean

0.923727

s

SD

10.095332

s

p50

1.303403

s

<

p95

22.660035

s

<

p99

60.000979

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

54.25

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

85

B/s

<

mean

556.73

KiB/s

SD

365.34

KiB/s

<

p95

1.14

MiB/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

43

B/s

<

mean

516.53

KiB/s

SD

500.11

KiB/s

<

p95

1.51

MiB/s

Total bytes received

Total bytes received on primary network interface

count

25.87

GiB

mean

14.64

MiB/s

Total bytes sent

Total bytes sent on primary network interface

count

24.00

GiB

mean

13.58

MiB/s

CPU spike anomaly

CPU spike anomaly was detected

Detected

Warning CPU p99 reached 97.9%

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 705.04 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

Detected

Warning 70% of hosts overloaded (load5/ncpus > 1.0)

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

11.52

%

<

mean

65.3

%

SD

29.27

%

<

p95

97.09

%

System

11.05

%

CPU percentiles

CPU usage percentiles

p50

77.57

%

p95

97.09

%

p99

97.90

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

15

hosts

mean time

0.84

s

Memory used percentage

Percentage of memory used

p5

7.02

%

<

mean

15.03

%

SD

5.11

%

<

p95

22.45

%

Memory available percentage

Percentage of available memory

p5

77.55

%

<

mean

84.97

%

SD

5.11

%

<

p95

92.98

%

Max host memory used

Maximum memory usage percentage across all hosts

max

31.96

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

705.04

MiB/s

Disk read throughput

Disk read throughput in MiB/s

2.32

MiB/s

Disk write throughput

Disk write throughput in MiB/s

242.43

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /

0/5

hosts

Mount Point /efi-boot

0/4

hosts

Mount Point /etc/hostname

0/6

hosts

Mount Point /etc/hosts

0/6

hosts

Mount Point /etc/nomad.d/client-meta.json

0/16

hosts

Mount Point /etc/resolv.conf

0/6

hosts

Mount Point /nix/store

0/5

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

4.92

5 min

4.32

15 min

3.02

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

70.37

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

0.09

%

<

mean

30.0691

%

SD

23.5842

%

<

p95

69.22

%

60 second average

29.2929

%

300 second average

25.8369

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

<

mean

0.0002

%

SD

0.0143

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

15.5488

%

SD

21.8781

%

<

p95

59.7

%

60 second average

15.0875

%

300 second average

12.8856

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

10.4374

%

SD

17.3927

%

<

p95

43.83

%

60 second average

10.1306

%

300 second average

8.6799

%

Holochain process CPU usage

CPU usage by Holochain process

p5

10.71

%

<

mean

60.57

%

SD

28.48

%

<

p95

94.63

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

247.19

KiB

<

mean

571.52

KiB

SD

190.45

KiB

<

p95

850.37

KiB

Holochain process threads

Number of threads in Holochain process

p5

30

threads

<

mean

44.25

threads

SD

8.56

threads

<

p95

57

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

73

file descriptors

<

mean

100.4

file descriptors

SD

13.81

file descriptors

<

p95

114

file descriptors

First Call

↑ Back to index

This scenario installs a simple app which implements the init callback, and measures the time elapsed between start of install and calling init. It will uninstall the app it installed so that it can re-install it on the next iteration. This is required to re-run the initialisation callback.

Started

Thu, 16 Jul 2026 03:26:47 UTC

Peer count

1

Behaviours

default (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

first_call_29468960194_1

Zome call timing

The time elapsed between start of install and calling init.

mean

0.063956

s

SD

0.01108

s

p50

0.065554

s

<

p95

0.082655

s

<

p99

0.093521

s

Holochain MetricsClick to toggle visibility.

WASM usage: 'crud::create_sample_entry'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 270.009652732s

Not enough time data to show a trend.

WASM usage: 'crud::init'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 270.009652732s

Not enough time data to show a trend.

WASM usage: 'crud_integrity::entry_defs'

Metered usage count of the WASM ribosome for this zome function.

total

347758

over 280.009751724s

mean rate

1241.97

/s

std

3850.21

/s

p5

0

/s

p95

13205.87

/s

peak

15846.88

/s

Zome call duration: 'crud::create_sample_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.049452

s

SD

0.001085

s

p50

0.049556

s

≤

p95

0.049556

s

≤

p99

0.049556

s

WASM call duration: 'crud::create_sample_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.024758

s

SD

0.008603

s

p50

0.02831

s

<

p95

0.032911

s

<

p99

0.034928

s

WASM call duration: 'crud::init'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.002277

s

SD

0.001122

s

p50

0.001913

s

<

p95

0.005877

s

<

p99

0.006299

s

WASM call duration: 'crud_integrity::entry_defs'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001398

s

SD

2.6e-05

s

p50

0.001397

s

<

p95

0.001407

s

<

p99

0.001436

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.000578

s

SD

9.2e-05

s

p50

0.000651

s

<

p95

0.000658

s

<

p99

0.000863

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.02256

s

SD

0.001011

s

p50

0.02266

s

≤

p95

0.02266

s

≤

p99

0.02266

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.027568

s

SD

0.00615

s

p50

0.029464

s

<

p95

0.033919

s

<

p99

0.043524

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

15.93

s

<

mean

145.94

s

SD

83.67

s

<

p95

275.94

s

Integrated ops

Count of DHT ops integrated since the conductor started. Resets on restart.

total

0

over 280.010901303s

Not enough time data to show a trend.

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.00185

s

SD

7.7e-05

s

p50

0.001845

s

<

p95

0.002042

s

<

p99

0.002227

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.003664

s

SD

0.00019

s

p50

0.003665

s

≤

p95

0.003665

s

<

p99

0.003806

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.006654

s

SD

0.0009

s

p50

0.0068

s

≤

p95

0.0068

s

≤

p99

0.0068

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.010675

s

SD

0.001526

s

p50

0.01092

s

≤

p95

0.01092

s

≤

p99

0.01092

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

0.026995

s

SD

0.007377

s

p50

0.028099

s

≤

p95

0.028099

s

≤

p99

0.028099

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

0.025358

s

SD

0.007534

s

p50

0.026477

s

≤

p95

0.026477

s

≤

p99

0.026477

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.000375

s

SD

0.000102

s

p50

0.000353

s

<

p95

0.000631

s

<

p99

0.000644

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.000722

s

SD

0.00014

s

p50

0.0007

s

<

p95

0.000968

s

<

p99

0.001096

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000465

s

SD

1e-05

s

p50

0.000465

s

≤

p95

0.000465

s

<

p99

0.000507

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

45.10

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

162

B/s

<

mean

450.97

KiB/s

SD

1.58

MiB/s

<

p95

6.23

MiB/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

318

B/s

<

mean

9.79

KiB/s

SD

13.32

KiB/s

<

p95

44.92

KiB/s

Total bytes received

Total bytes received on primary network interface

count

127.72

MiB

mean

450.97

KiB/s

Total bytes sent

Total bytes sent on primary network interface

count

2.77

MiB

mean

9.79

KiB/s

CPU spike anomaly

CPU spike anomaly was detected

Detected

Warning CPU p99 reached 98.0%

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 849.00 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

NotDetected

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

62.38

%

<

mean

73.74

%

SD

10.09

%

<

p95

97.84

%

System

28.64

%

CPU percentiles

CPU usage percentiles

p50

69.69

%

p95

97.84

%

p99

98.00

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

1

hosts

mean time

0.17

s

Memory used percentage

Percentage of memory used

p5

13.07

%

<

mean

17.86

%

SD

3.32

%

<

p95

22.46

%

Memory available percentage

Percentage of available memory

p5

77.54

%

<

mean

82.14

%

SD

3.32

%

<

p95

86.93

%

Max host memory used

Maximum memory usage percentage across all hosts

max

17.86

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

849.00

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.00

MiB/s

Disk write throughput

Disk write throughput in MiB/s

6.45

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /etc/hostname

0/1

hosts

Mount Point /etc/hosts

0/1

hosts

Mount Point /etc/resolv.conf

0/1

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

3.23

5 min

1.33

15 min

0.50

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

0.00

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

7.65

%

<

mean

48.5557

%

SD

16.6496

%

<

p95

73.03

%

60 second average

38.7953

%

300 second average

17.3673

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.506

%

SD

0.8486

%

<

p95

1.85

%

60 second average

0.3753

%

300 second average

0.1597

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.2307

%

SD

0.4616

%

<

p95

1.26

%

60 second average

0.1783

%

300 second average

0.0797

%

Holochain process CPU usage

CPU usage by Holochain process

p5

0.5

%

<

mean

22.16

%

SD

21.7

%

<

p95

56.85

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

95.24

KiB

<

mean

227.26

KiB

SD

69.98

KiB

<

p95

323.16

KiB

Holochain process threads

Number of threads in Holochain process

p5

5

threads

<

mean

100.2

threads

SD

137.62

threads

<

p95

402

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

11

file descriptors

<

mean

265.03

file descriptors

SD

349.4

file descriptors

<

p95

1020

file descriptors

Local Signals

↑ Back to index

This scenario is for testing the speed and reliability of local signals. It uses a zome with a function that will emit 10,000 signals. The scenario measures how long it takes to send the signals and how many have been received by the time the zome call ends.

Started

Thu, 16 Jul 2026 03:28:26 UTC

Peer count

1

Behaviours

default (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

local_signals_29468960194_1

Send timing

The time taken to emit a batch of 10,000 signals.

mean

4.625571

s

SD

2.142468

s

p50

4.928589

s

<

p95

7.882872

s

≤

p99

7.882872

s

Receive timing

The time taken to receive the completed batch, to the nearest 250ms.

mean

26.719316

s

SD

9.2829

s

p50

30.00138

s

<

p95

30.00178

s

≤

p99

30.00178

s

Success ratio

The proportion of signals successfully received in a batch.

min

0.7782999873161316

<

mean

0.9204

SD

0.0624

<

max

0.9972000122070312

Holochain MetricsClick to toggle visibility.

WASM usage: 'signal::emit_10k_signals'

Metered usage count of the WASM ribosome for this zome function.

total

215918451

over 270.00638798s

mean rate

799678.82

/s

std

1.35170392e+06

/s

p5

0

/s

p95

3.08453042e+06

/s

peak

3.08454186e+06

/s

Zome call duration: 'signal::emit_10k_signals'

Duration of this zome call as measured by Holochain internally.

mean

1.460287

s

SD

0.138779

s

p50

1.467479

s

<

p95

1.623694

s

≤

p99

1.623694

s

WASM call duration: 'signal::emit_10k_signals'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

1.44299

s

SD

0.141431

s

p50

1.449527

s

<

p95

1.606918

s

≤

p99

1.606918

s

Host function call duration: '__hc__emit_signal_1'

Duration of this host function call invoked from within WASM.

mean

0.000105

s

SD

1.2e-05

s

p50

0.000106

s

<

p95

0.000117

s

≤

p99

0.000117

s

Emitted local signals

Count of local signals emitted via the emit_signal host function.

total

70000

over 270.006389237s

mean rate

259.25

/s

std

417.93

/s

p5

0

/s

p95

999.99

/s

peak

1000

/s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.046684

s

SD

0

s

p50

0.046684

s

≤

p95

0.046684

s

≤

p99

0.046684

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

15.24

s

<

mean

145.24

s

SD

83.67

s

<

p95

275.24

s

Dropped WebSocket signals

Count of signals dropped from the app WebSocket due to channel overload.

total

556

over 270.006389503s

mean rate

2.06

/s

std

6.04

/s

p5

0

/s

p95

12.3

/s

peak

29.9

/s

Integrated ops

Count of DHT ops integrated since the conductor started. Resets on restart.

total

0

over 280.006455251s

Not enough time data to show a trend.

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.001142

s

SD

0

s

p50

0.001142

s

≤

p95

0.001142

s

≤

p99

0.001142

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.005626

s

SD

0

s

p50

0.005626

s

≤

p95

0.005626

s

≤

p99

0.005626

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.005161

s

SD

0.000337

s

p50

0.00514

s

≤

p95

0.00514

s

<

p99

0.006987

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.007173

s

SD

0.000572

s

p50

0.007541

s

<

p95

0.007574

s

<

p99

0.008997

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

0.004108

s

SD

0

s

p50

0.004108

s

≤

p95

0.004108

s

≤

p99

0.004108

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

0.009658

s

SD

0

s

p50

0.009658

s

≤

p95

0.009658

s

≤

p99

0.009658

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.000564

s

SD

0.00017

s

p50

0.000563

s

<

p95

0.000801

s

<

p99

0.001374

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.000128

s

SD

0.000255

s

p50

0.000635

s

≤

p95

0.000635

s

<

p99

0.000736

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000997

s

SD

6.6e-05

s

p50

0.000989

s

≤

p95

0.000989

s

<

p99

0.001352

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

35.29

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

294

B/s

<

mean

229.32

KiB/s

SD

1.14

MiB/s

≤

p95

20.18

KiB/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

1.37

KiB/s

<

mean

16.65

KiB/s

SD

27.96

KiB/s

<

p95

106.93

KiB/s

Total bytes received

Total bytes received on primary network interface

count

64.94

MiB

mean

229.32

KiB/s

Total bytes sent

Total bytes sent on primary network interface

count

4.72

MiB

mean

16.65

KiB/s

CPU spike anomaly

CPU spike anomaly was detected

Detected

Warning CPU p99 reached 98.0%

Memory leak anomaly

Memory leak anomaly was detected

NotDetected

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

Detected

Warning 100% of hosts overloaded (load5/ncpus > 1.0)

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

12.25

%

<

mean

60.43

%

SD

27.2

%

<

p95

97.85

%

System

25.14

%

CPU percentiles

CPU usage percentiles

p50

69.46

%

p95

97.85

%

p99

98.00

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

1

hosts

mean time

0.21

s

Memory used percentage

Percentage of memory used

p5

17.3

%

<

mean

19.21

%

SD

2.04

%

<

p95

22.46

%

Memory available percentage

Percentage of available memory

p5

77.54

%

<

mean

80.79

%

SD

2.04

%

<

p95

82.7

%

Max host memory used

Maximum memory usage percentage across all hosts

max

19.21

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

-31.73

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.00

MiB/s

Disk write throughput

Disk write throughput in MiB/s

5.32

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /etc/hostname

0/1

hosts

Mount Point /etc/hosts

0/1

hosts

Mount Point /etc/resolv.conf

0/1

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

4.21

5 min

2.20

15 min

0.90

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

100.00

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

7.71

%

<

mean

45.764

%

SD

20.3716

%

<

p95

73.03

%

60 second average

46.4260

%

300 second average

26.5737

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.4003

%

SD

0.8507

%

<

p95

1.85

%

60 second average

0.3813

%

300 second average

0.2237

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.1427

%

SD

0.4091

%

<

p95

0.87

%

60 second average

0.1410

%

300 second average

0.0917

%

Holochain process CPU usage

CPU usage by Holochain process

p5

0.5

%

<

mean

10.29

%

SD

14.52

%

<

p95

48.93

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

23.38

KiB

<

mean

204.14

KiB

SD

66.58

KiB

<

p95

272.57

KiB

Holochain process threads

Number of threads in Holochain process

p5

5

threads

<

mean

29.78

threads

SD

11.19

threads

<

p95

39

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

8

file descriptors

<

mean

78.84

file descriptors

SD

29.36

file descriptors

<

p95

103

file descriptors

Mixed Arc `get_agent_activity`

↑ Back to index

A mixed-arc scenario that measures the DHT's ability to propagate agent activity and make it available via get_agent_activity calls. The scenario has three roles:

zero_write: A zero-arc conductor that creates entries on its source chain.
full_write: A full-arc conductor that creates entries on its source chain.
zero_read: A zero-arc conductor that picks a random writer and repeatedly calls get_agent_activity to observe new entries appearing on the writer's chain, measuring the lag between creation and discovery.

Started

Thu, 16 Jul 2026 07:25:48 UTC

Peer count

30

Peer count at end

25

Behaviours

full_write (1 agent)
zero_read (1 agent)
zero_write (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

mixed_arc_get_agent_activity_29468960194_1

Entry created count

The total number of entries created by write agents over the run, partitioned by agent and behaviour.

Total

284822

Agents affected

17 / 17

Mean per agent

Total count divided by number of partitions, rounded to nearest whole number

16754

Max

Highest count in any single partition

38178

Min

Lowest count in any single partition

1762

Observed chain advancement

The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.

Mean max (across write agents)

Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.

8587.33

Max

Highest chain head value observed for any single write agent.

10108

Write agents observed

3

Chain head delay timing

The time lag between when a writer creates a new entry and when a reader discovers it via get_agent_activity. This is measured per new action in the chain.

Mean

mean

0.00175

s

SD

0.085098

s

Max

Highest per-partition mean latency

max mean

0.012002

s

Min

Lowest per-partition mean latency

min mean

-0.001865

s

Chain head delay rate

The rate at which readers detect new chain heads appearing on writers' chains.

Mean

mean

33.82

/s

Max

Highest per-partition mean rate

max

50.58

/s

Min

Lowest per-partition mean rate

min

21.07

/s

get_agent_activity_full zome call timing

The time taken to complete the get_agent_activity_full zome call that queries a writer's chain.

Mean

mean

0.121192

s

SD

0.09508

s

Max

Highest per-partition mean latency

max mean

0.242078

s

Min

Lowest per-partition mean latency

min mean

0.031197

s

Retrieval errors

A running accumulation of errors encountered by read agents when calling get_agent_activity.

Total

20

Agents affected

8 / 9

Mean per agent

Total count divided by number of partitions, rounded to nearest whole number

2

Max

Highest count in any single partition

4

Min

Lowest count in any single partition

0

Open connections

The number of currently open connections to other conductors, partitioned by agent behaviour.

behaviour: full_write

p5

22

<

mean

24.72

SD

1.2

<

p95

25

behaviour: zero_read

p5

9

<

mean

13.96

SD

3.41

<

p95

19

behaviour: zero_write

p5

0

<

mean

14.6

SD

5.56

<

p95

21

Final error count

The total number of errors accumulated across all agents over the run.

27

Holochain MetricsClick to toggle visibility.

Cascade duration

Time taken to execute a cascade (get) query inside Holochain.

mean

0.052085

s

SD

0.141029

s

p50

0.146275

s

<

p95

0.487831

s

≤

p99

0.487831

s

Cascade fetch errors

Count of network fetch errors during cascade calls.

total

1

over 835.013000968s

mean rate

3.26

/s

std

18.14

/s

p5

0

/s

p95

2.2

/s

peak

150.05

/s

Zome call duration: 'agent_activity::announce_write_behaviour'

Duration of this zome call as measured by Holochain internally.

mean

0.035395

s

SD

0.022375

s

p50

0.034423

s

<

p95

0.093288

s

≤

p99

0.093288

s

Zome call duration: 'agent_activity::create_sample_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.01386

s

SD

0.015367

s

p50

0.015461

s

<

p95

0.048299

s

<

p99

0.060541

s

Zome call duration: 'agent_activity::get_agent_activity_full'

Duration of this zome call as measured by Holochain internally.

mean

0.050339

s

SD

0.067643

s

p50

0.076198

s

<

p95

0.212433

s

<

p99

0.233807

s

Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'

Duration of this zome call as measured by Holochain internally.

mean

0.065756

s

SD

0.149887

s

p50

0.190157

s

<

p95

0.518989

s

≤

p99

0.518989

s

WASM call duration: 'agent_activity::announce_write_behaviour'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.014249

s

SD

0.018609

s

p50

0.007831

s

<

p95

0.082921

s

≤

p99

0.082921

s

WASM call duration: 'agent_activity::create_sample_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.008313

s

SD

0.008538

s

p50

0.009902

s

<

p95

0.027008

s

<

p99

0.03433

s

WASM call duration: 'agent_activity::get_agent_activity_full'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.053423

s

SD

0.082054

s

p50

0.084741

s

<

p95

0.273986

s

<

p99

0.30132

s

WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.363089

s

SD

0.132254

s

p50

0.328906

s

<

p95

0.504434

s

≤

p99

0.504434

s

WASM call duration: 'agent_activity_integrity::entry_defs'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001048

s

SD

0.000471

s

p50

0.000962

s

<

p95

0.001977

s

<

p99

0.002475

s

Host function call duration: '__hc__agent_info_1'

Duration of this host function call invoked from within WASM.

mean

4e-05

s

SD

1.4e-05

s

p50

3.9e-05

s

<

p95

7.1e-05

s

≤

p99

7.1e-05

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.000462

s

SD

0.000463

s

p50

0.000585

s

<

p95

0.001683

s

<

p99

0.002126

s

Host function call duration: '__hc__create_link_1'

Duration of this host function call invoked from within WASM.

mean

0.000467

s

SD

0.000232

s

p50

0.00039

s

<

p95

0.001127

s

≤

p99

0.001127

s

Host function call duration: '__hc__get_agent_activity_1'

Duration of this host function call invoked from within WASM.

mean

0.051226

s

SD

0.081986

s

p50

0.082154

s

<

p95

0.272049

s

<

p99

0.299285

s

Host function call duration: '__hc__get_links_1'

Duration of this host function call invoked from within WASM.

mean

0.358081

s

SD

0.129695

s

p50

0.323582

s

<

p95

0.487887

s

≤

p99

0.487887

s

Host function call duration: '__hc__random_bytes_1'

Duration of this host function call invoked from within WASM.

mean

1.2e-05

s

SD

9e-06

s

p50

1.7e-05

s

<

p95

3.5e-05

s

≤

p99

3.5e-05

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.006701

s

SD

0.01251

s

p50

0.005391

s

<

p95

0.029262

s

<

p99

0.077397

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.004441

s

SD

0.007738

s

p50

0.0107

s

<

p95

0.022821

s

<

p99

0.023322

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

47.01

s

<

mean

449.66

s

SD

258.28

s

<

p95

848.59

s

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

22.61082

s

SD

14.498084

s

p50

0

s

<

p95

16.19849

s

<

p99

29.673779

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.106379

s

SD

1.044051

s

p50

0.001858

s

<

p95

1.268729

s

<

p99

4.547247

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.001708

s

SD

0.001791

s

p50

0.001262

s

<

p95

0.003828

s

<

p99

0.010101

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.020778

s

SD

0.202767

s

p50

0.001953

s

<

p95

0.470209

s

<

p99

1.082457

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.198386

s

SD

3.42294

s

p50

0.052794

s

<

p95

9.110356

s

<

p99

17.723577

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

0.478655

s

SD

5.568902

s

p50

0.009129

s

<

p95

4.625188

s

<

p99

33.437133

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

13.373968

s

SD

19.442226

s

p50

0.003209

s

<

p95

43.310188

s

<

p99

88.006077

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.001611

s

SD

0.001308

s

p50

0.000762

s

<

p95

0.004136

s

<

p99

0.00568

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.001897

s

SD

0.020353

s

p50

0.000596

s

<

p95

0.01939

s

<

p99

0.125875

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000424

s

SD

0.00032

s

p50

0.000352

s

<

p95

0.001036

s

<

p99

0.001651

s

P2P request roundtrip: 'get'

Time spent sending a get request and awaiting its response.

mean

3.865672

s

SD

27.929975

s

p50

0.11838

s

<

p95

60.004061

s

≤

p99

60.004061

s

P2P request roundtrip: 'get_links'

Time spent sending a get_links request and awaiting its response.

mean

0.976924

s

SD

17.479149

s

p50

0.154939

s

<

p95

60.001209

s

≤

p99

60.001209

s

P2P request roundtrip: 'get_agent_activity'

Time spent sending a get_agent_activity request and awaiting its response.

mean

0.064013

s

SD

27.414237

s

p50

0.113779

s

<

p95

60.001647

s

<

p99

60.00273

s

P2P request roundtrip: 'send_validation_receipts'

Time spent sending a send_validation_receipts request and awaiting its response.

mean

0.191244

s

SD

1.530133

s

p50

0.122868

s

<

p95

0.588158

s

<

p99

10.003259

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

32.22

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

90

B/s

<

mean

501.13

KiB/s

SD

702.07

KiB/s

<

p95

1.94

MiB/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

56

B/s

<

mean

464.40

KiB/s

SD

718.23

KiB/s

<

p95

2.08

MiB/s

Total bytes received

Total bytes received on primary network interface

count

11.99

GiB

mean

13.64

MiB/s

Total bytes sent

Total bytes sent on primary network interface

count

11.11

GiB

mean

12.64

MiB/s

CPU spike anomaly

CPU spike anomaly was detected

Detected

Warning CPU p99 reached 96.6%

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 495.68 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

Detected

Warning 32% of hosts overloaded (load5/ncpus > 1.0)

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

0.68

%

<

mean

40.97

%

SD

34.52

%

<

p95

94.9

%

System

8.75

%

CPU percentiles

CPU usage percentiles

p50

41.20

%

p95

94.90

%

p99

96.59

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

11

hosts

mean time

0.53

s

Memory used percentage

Percentage of memory used

p5

6.49

%

<

mean

12.46

%

SD

4.02

%

<

p95

19.12

%

Memory available percentage

Percentage of available memory

p5

80.88

%

<

mean

87.54

%

SD

4.02

%

<

p95

93.51

%

Max host memory used

Maximum memory usage percentage across all hosts

max

25.83

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

495.68

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.00

MiB/s

Disk write throughput

Disk write throughput in MiB/s

142.65

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /

0/5

hosts

Mount Point /efi-boot

0/4

hosts

Mount Point /etc/hostname

0/6

hosts

Mount Point /etc/hosts

0/6

hosts

Mount Point /etc/nomad.d/client-meta.json

0/17

hosts

Mount Point /etc/resolv.conf

0/6

hosts

Mount Point /nix/store

0/5

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

3.13

5 min

2.60

15 min

1.93

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

32.14

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

0

%

<

mean

18.8546

%

SD

24.687

%

<

p95

72.45

%

60 second average

17.8024

%

300 second average

14.0088

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

7.3252

%

SD

14.365

%

<

p95

42.51

%

60 second average

7.2136

%

300 second average

6.8797

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

4.9755

%

SD

10.2167

%

<

p95

27.07

%

60 second average

4.9921

%

300 second average

5.2115

%

Holochain process CPU usage

CPU usage by Holochain process

p5

0.3

%

<

mean

36.64

%

SD

33.46

%

<

p95

92.01

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

207.73

KiB

<

mean

348.51

KiB

SD

151.79

KiB

<

p95

656.94

KiB

Holochain process threads

Number of threads in Holochain process

p5

25

threads

<

mean

36.56

threads

SD

8.94

threads

<

p95

45

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

58

file descriptors

<

mean

84.72

file descriptors

SD

17.61

file descriptors

<

p95

103

file descriptors

Mixed Arc `must_get_agent_activity`

↑ Back to index

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Write Validated must_get_agent_activity, but some write agents are zero-arc and all must_get_agent_activity agents are zero-arc. This forces the must_get_agent_activity host call to go to the network.

Started

Thu, 16 Jul 2026 07:41:38 UTC

Peer count

30

Peer count at end

26

Behaviours

full_write (1 agent)
zero_must_get_agent_activity (1 agent)
zero_write (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

mixed_arc_must_get_agent_activity_29468960194_1

Highest observed action_seq

The maximum chain length observed per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.

Mean max (across write agents)

Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.

1691.67

Max

Highest chain head value observed for any single write agent.

1732

Write agents observed

3

Chain batch delay timing

The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.

Mean

mean

63.234318

s

SD

49.466026

s

Max

Highest per-partition mean latency

max mean

172.02676

s

Min

Lowest per-partition mean latency

min mean

5.713059

s

Chain batch delay rate

The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.

Mean

mean

1.84

/s

Max

Highest per-partition mean rate

max

2.07

/s

Min

Lowest per-partition mean rate

min

1.54

/s

create_validated_sample_entry zome call timing

The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.

Mean

mean

0.436915

s

SD

0.342487

s

Max

Highest per-partition mean latency

max mean

1.065368

s

Min

Lowest per-partition mean latency

min mean

0.17067

s

Retrieval errors

A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.

Total

27098

Agents affected

8 / 8

Mean per agent

Total count divided by number of partitions, rounded to nearest whole number

3387

Max

Highest count in any single partition

8729

Min

Lowest count in any single partition

14

Open connections

The average number of open connections maintained by an agent over the run, broken down by behaviour.

behaviour: full_write

p5

19

<

mean

24.53

SD

1.66

<

p95

25

behaviour: zero_must_get_agent_activity

p5

11

<

mean

15.48

SD

4.02

<

p95

24

behaviour: zero_write

p5

0

<

mean

11.75

SD

5.21

<

p95

19

Final error count

The total number of all types of error accumulated over the run by all agents.

39688

Holochain MetricsClick to toggle visibility.

Cascade duration

Time taken to execute a cascade (get) query inside Holochain.

mean

0.073151

s

SD

0.097275

s

p50

0.039445

s

<

p95

0.282636

s

<

p99

0.358979

s

Cascade fetch errors

Count of network fetch errors during cascade calls.

total

2

over 773.613944083s

mean rate

9.12

/s

std

16.57

/s

p5

0

/s

p95

47.23

/s

peak

47.6

/s

Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'

Duration of this zome call as measured by Holochain internally.

mean

0.043032

s

SD

0.018289

s

p50

0.034673

s

<

p95

0.082589

s

≤

p99

0.082589

s

Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'

Duration of this zome call as measured by Holochain internally.

mean

0.208843

s

SD

0.125425

s

p50

0.161096

s

<

p95

0.427292

s

<

p99

0.788173

s

Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.013463

s

SD

0.007633

s

p50

0.019545

s

<

p95

0.025142

s

<

p99

0.030481

s

Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'

Duration of this zome call as measured by Holochain internally.

mean

0.126194

s

SD

0.077565

s

p50

0.089642

s

<

p95

0.29316

s

<

p99

0.303598

s

Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'

Duration of this zome call as measured by Holochain internally.

mean

0.051776

s

SD

0.09506

s

p50

0.046769

s

<

p95

0.320068

s

≤

p99

0.320068

s

WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.017061

s

SD

0.01047

s

p50

0.013994

s

<

p95

0.043281

s

≤

p99

0.043281

s

WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.191187

s

SD

0.117382

s

p50

0.143584

s

<

p95

0.389554

s

<

p99

0.736503

s

WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.009626

s

SD

0.004852

s

p50

0.013529

s

<

p95

0.017395

s

<

p99

0.01797

s

WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.185901

s

SD

0.090322

s

p50

0.204099

s

<

p95

0.300383

s

<

p99

0.384259

s

WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.038311

s

SD

0.089743

s

p50

0.033428

s

<

p95

0.300434

s

≤

p99

0.300434

s

WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001335

s

SD

0.000671

s

p50

0.00113

s

<

p95

0.003136

s

<

p99

0.003239

s

WASM call duration: 'validated_must_get_agent_activity_integrity::validate'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.011529

s

SD

0.021497

s

p50

0.007481

s

<

p95

0.068398

s

<

p99

0.122602

s

Host function call duration: '__hc__agent_info_1'

Duration of this host function call invoked from within WASM.

mean

3.3e-05

s

SD

1.2e-05

s

p50

2.8e-05

s

<

p95

5.1e-05

s

<

p99

8.3e-05

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.000511

s

SD

0.000185

s

p50

0.000457

s

<

p95

0.000881

s

<

p99

0.00107

s

Host function call duration: '__hc__create_link_1'

Duration of this host function call invoked from within WASM.

mean

0.000486

s

SD

0.000197

s

p50

0.000338

s

<

p95

0.00093

s

<

p99

0.001145

s

Host function call duration: '__hc__get_links_1'

Duration of this host function call invoked from within WASM.

mean

0.158622

s

SD

0.105028

s

p50

0.094239

s

<

p95

0.28585

s

<

p99

0.323857

s

Host function call duration: '__hc__must_get_agent_activity_1'

Duration of this host function call invoked from within WASM.

mean

0.041989

s

SD

0.079971

s

p50

0.031435

s

<

p95

0.242234

s

<

p99

0.360658

s

Host function call duration: '__hc__query_1'

Duration of this host function call invoked from within WASM.

mean

0.008065

s

SD

0.004452

s

p50

0.005479

s

<

p95

0.014923

s

<

p99

0.021361

s

Host function call duration: '__hc__random_bytes_1'

Duration of this host function call invoked from within WASM.

mean

1e-05

s

SD

8e-06

s

p50

1e-05

s

<

p95

3.3e-05

s

≤

p99

3.3e-05

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.006842

s

SD

0.008524

s

p50

0.008741

s

<

p95

0.030054

s

<

p99

0.041348

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.011574

s

SD

0.010558

s

p50

0.00714

s

<

p95

0.029323

s

<

p99

0.05431

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

47.02

s

<

mean

451.16

s

SD

259.3

s

<

p95

856.67

s

Integrated ops

Count of DHT ops integrated since the conductor started. Resets on restart.

total

0

over 37469.954847999s

Not enough time data to show a trend.

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

72.690116

s

SD

35.857282

s

p50

0

s

<

p95

106.465074

s

<

p99

150.518558

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

2.176643

s

SD

1.839641

s

p50

0.001598

s

<

p95

4.341473

s

<

p99

8.481753

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.001748

s

SD

0.001567

s

p50

0.001186

s

<

p95

0.004674

s

<

p99

0.007857

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.060996

s

SD

0.055915

s

p50

0.001987

s

<

p95

0.103762

s

<

p99

0.27948

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.146588

s

SD

0.073631

s

p50

0.02893

s

<

p95

0.215899

s

<

p99

0.325387

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

1.033511

s

SD

3.269142

s

p50

0.008722

s

<

p95

4.940106

s

<

p99

20.105449

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

15.886308

s

SD

22.492777

s

p50

0.008823

s

<

p95

42.03591

s

<

p99

147.061775

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.000415

s

SD

0.000301

s

p50

0.00046

s

<

p95

0.000977

s

<

p99

0.001723

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.000763

s

SD

0.001414

s

p50

0.00022

s

<

p95

0.002341

s

<

p99

0.006328

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000402

s

SD

0.000137

s

p50

0.000361

s

<

p95

0.000696

s

<

p99

0.000751

s

P2P request roundtrip: 'get'

Time spent sending a get request and awaiting its response.

mean

5.819119

s

SD

29.870761

s

p50

0.188389

s

<

p95

60.002835

s

<

p99

60.003449

s

P2P request roundtrip: 'get_links'

Time spent sending a get_links request and awaiting its response.

mean

0.094864

s

SD

26.155645

s

p50

0.08856

s

<

p95

60.001414

s

<

p99

60.001503

s

P2P request roundtrip: 'must_get_agent_activity'

Time spent sending a must_get_agent_activity request and awaiting its response.

mean

0.039685

s

SD

22.791603

s

p50

0.064026

s

<

p95

60.001392

s

<

p99

60.001439

s

P2P request roundtrip: 'send_validation_receipts'

Time spent sending a send_validation_receipts request and awaiting its response.

mean

0.124897

s

SD

0.048038

s

p50

0.11297

s

<

p95

0.207544

s

<

p99

0.218742

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

21.13

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

93

B/s

<

mean

95.29

KiB/s

SD

393.60

KiB/s

<

p95

243.30

KiB/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

50

B/s

<

mean

64.66

KiB/s

SD

162.63

KiB/s

<

p95

244.56

KiB/s

Total bytes received

Total bytes received on primary network interface

count

2.29

GiB

mean

2.57

MiB/s

Total bytes sent

Total bytes sent on primary network interface

count

1.55

GiB

mean

1.75

MiB/s

CPU spike anomaly

CPU spike anomaly was detected

Detected

Warning CPU p99 reached 95.4%

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 281.07 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

Detected

Warning 18% of hosts overloaded (load5/ncpus > 1.0)

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

0.88

%

<

mean

27.47

%

SD

31.44

%

<

p95

85.88

%

System

6.34

%

CPU percentiles

CPU usage percentiles

p50

6.97

%

p95

85.88

%

p99

95.36

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

9

hosts

mean time

0.25

s

Memory used percentage

Percentage of memory used

p5

7.04

%

<

mean

13.86

%

SD

4.43

%

<

p95

18.17

%

Memory available percentage

Percentage of available memory

p5

81.83

%

<

mean

86.14

%

SD

4.43

%

<

p95

92.96

%

Max host memory used

Maximum memory usage percentage across all hosts

max

28.90

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

281.07

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.00

MiB/s

Disk write throughput

Disk write throughput in MiB/s

100.17

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /

0/5

hosts

Mount Point /efi-boot

0/4

hosts

Mount Point /etc/hostname

0/6

hosts

Mount Point /etc/hosts

0/6

hosts

Mount Point /etc/nomad.d/client-meta.json

0/17

hosts

Mount Point /etc/resolv.conf

0/6

hosts

Mount Point /nix/store

0/5

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

1.44

5 min

1.84

15 min

2.03

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

17.86

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

0

%

<

mean

9.6726

%

SD

16.78

%

<

p95

52.77

%

60 second average

9.7119

%

300 second average

11.3967

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

1.8358

%

SD

3.5581

%

<

p95

7.63

%

60 second average

2.0697

%

300 second average

3.4391

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

1.1757

%

SD

2.4472

%

<

p95

4.86

%

60 second average

1.3868

%

300 second average

2.4095

%

Holochain process CPU usage

CPU usage by Holochain process

p5

0.3

%

<

mean

24.11

%

SD

29.24

%

<

p95

83.35

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

379.54

KiB

<

mean

453.93

KiB

SD

76.44

KiB

<

p95

601.59

KiB

Holochain process threads

Number of threads in Holochain process

p5

26

threads

<

mean

35.51

threads

SD

6.79

threads

<

p95

44

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

61

file descriptors

<

mean

83.83

file descriptors

SD

14.58

file descriptors

<

p95

102

file descriptors

Remote Call Rate

↑ Back to index

Test the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

Started

Thu, 16 Jul 2026 03:30:16 UTC

Peer count

10

Behaviours

default (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

remote_call_rate_29468960194_1

Dispatch timing

The time between sending a remote call and the remote handler being invoked.

Mean

mean

0.074339

s

SD

0.078507

s

Max

Highest per-partition mean latency

max mean

0.096599

s

Min

Lowest per-partition mean latency

min mean

0.032274

s

Round-trip timing

The total elapsed time to get a response to the client.

Mean

mean

0.151774

s

SD

0.110561

s

Max

Highest per-partition mean latency

max mean

0.191767

s

Min

Lowest per-partition mean latency

min mean

0.06865

s

Error count

The total number of errors accumulated during the run.

0

Holochain MetricsClick to toggle visibility.

WASM usage: 'remote_call::call_echo_timestamp'

Metered usage count of the WASM ribosome for this zome function.

total

165083260

over 893.45903495s

mean rate

5.3278555934e+08

/s

std

1.11494295792e+09

/s

p5

303869.05

/s

p95

3.4755058203e+09

/s

peak

4.17632647338e+09

/s

WASM usage: 'remote_call::echo_timestamp'

Metered usage count of the WASM ribosome for this zome function.

total

39531567

over 893.45903495s

mean rate

2.8513262e+06

/s

std

3.70599262e+06

/s

p5

10934.37

/s

p95

1.061139869e+07

/s

peak

1.776204334e+07

/s

WASM usage: 'remote_call::init'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 893.45903495s

Not enough time data to show a trend.

Zome call duration: 'remote_call::call_echo_timestamp'

Duration of this zome call as measured by Holochain internally.

mean

0.149849

s

SD

0.100907

s

p50

0.178186

s

<

p95

0.233087

s

<

p99

0.516092

s

Zome call duration: 'remote_call::echo_timestamp'

Duration of this zome call as measured by Holochain internally.

mean

0.006998

s

SD

0.002766

s

p50

0.005955

s

<

p95

0.012613

s

<

p99

0.013764

s

WASM call duration: 'remote_call::call_echo_timestamp'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.145514

s

SD

0.100139

s

p50

0.173947

s

<

p95

0.228771

s

<

p99

0.510499

s

WASM call duration: 'remote_call::echo_timestamp'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.002426

s

SD

0.000684

s

p50

0.002308

s

<

p95

0.003689

s

<

p99

0.003701

s

WASM call duration: 'remote_call::init'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.009757

s

SD

0.006562

s

p50

0.004407

s

<

p95

0.019242

s

≤

p99

0.019242

s

Host function call duration: '__hc__call_1'

Duration of this host function call invoked from within WASM.

mean

0.139237

s

SD

0.10033

s

p50

0.167395

s

<

p95

0.222834

s

<

p99

0.505656

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.000397

s

SD

0.000376

s

p50

0.000281

s

<

p95

0.001471

s

≤

p99

0.001471

s

Host function call duration: '__hc__sys_time_1'

Duration of this host function call invoked from within WASM.

mean

2.9e-05

s

SD

1.2e-05

s

p50

2.5e-05

s

<

p95

6.1e-05

s

<

p99

6.2e-05

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.003737

s

SD

0.004743

s

p50

0.002972

s

<

p95

0.01551

s

≤

p99

0.01551

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.020111

s

SD

0.037264

s

p50

0.002952

s

<

p95

0.124321

s

≤

p99

0.124321

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

47.02

s

<

mean

446.76

s

SD

256.91

s

<

p95

847.03

s

Integrated ops

Count of DHT ops integrated since the conductor started. Resets on restart.

total

71

over 893.458955463s

mean rate

7.28

/s

std

51.1

/s

p5

0

/s

p95

10.34

/s

peak

943.69

/s

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

1.928296

s

SD

1.845879

s

p50

1.393486

s

<

p95

6.095422

s

<

p99

6.989547

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.087942

s

SD

0.423968

s

p50

0.07462

s

<

p95

1.135467

s

<

p99

2.489731

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.004212

s

SD

0.006707

s

p50

0.00163

s

<

p95

0.023007

s

≤

p99

0.023007

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.055314

s

SD

0.018484

s

p50

0.062503

s

<

p95

0.088046

s

≤

p99

0.088046

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.006096

s

SD

0.006496

s

p50

0.004025

s

<

p95

0.024528

s

<

p99

0.029228

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

0.153655

s

SD

0.170483

s

p50

0.0669

s

<

p95

0.456202

s

<

p99

0.587307

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

0.253793

s

SD

0.149845

s

p50

0.229153

s

<

p95

0.515289

s

<

p99

0.650313

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.000291

s

SD

8.7e-05

s

p50

0.000283

s

<

p95

0.000426

s

<

p99

0.000427

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.000176

s

SD

0.000841

s

p50

0.000553

s

<

p95

0.002512

s

<

p99

0.002786

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000521

s

SD

0.000155

s

p50

0.000456

s

<

p95

0.000855

s

<

p99

0.000882

s

P2P request roundtrip: 'get'

Time spent sending a get request and awaiting its response.

mean

0.12896

s

SD

0.081164

s

p50

0.123651

s

<

p95

0.309195

s

<

p99

0.336976

s

P2P request roundtrip: 'send_validation_receipts'

Time spent sending a send_validation_receipts request and awaiting its response.

mean

0.181132

s

SD

0.068834

s

p50

0.225784

s

<

p95

0.325906

s

≤

p99

0.325906

s

P2P request roundtrip: 'call_remote'

Time spent sending a call_remote request and awaiting its response.

mean

0.138526

s

SD

0.100362

s

p50

0.166651

s

<

p95

0.222318

s

<

p99

0.505129

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

16.51

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

0

B/s

<

mean

88.87

KiB/s

SD

608.74

KiB/s

≤

p95

25.65

KiB/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

0

B/s

<

mean

13.15

KiB/s

SD

14.13

KiB/s

<

p95

24.60

KiB/s

Total bytes received

Total bytes received on primary network interface

count

698.63

MiB

mean

794.89

KiB/s

Total bytes sent

Total bytes sent on primary network interface

count

103.34

MiB

mean

117.58

KiB/s

CPU spike anomaly

CPU spike anomaly was detected

Detected

Warning CPU p99 reached 90.4%

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 1388.36 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

NotDetected

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

8.21

%

<

mean

22.4

%

SD

21.91

%

<

p95

79.39

%

System

5.89

%

CPU percentiles

CPU usage percentiles

p50

13.08

%

p95

79.39

%

p99

90.37

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

6

hosts

mean time

0.07

s

Memory used percentage

Percentage of memory used

p5

10.67

%

<

mean

15.06

%

SD

3.49

%

<

p95

21.68

%

Memory available percentage

Percentage of available memory

p5

78.32

%

<

mean

84.94

%

SD

3.49

%

<

p95

89.33

%

Max host memory used

Maximum memory usage percentage across all hosts

max

17.81

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

1388.36

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.01

MiB/s

Disk write throughput

Disk write throughput in MiB/s

27.74

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /etc/hostname

0/2

hosts

Mount Point /etc/hosts

0/2

hosts

Mount Point /etc/nomad.d/client-meta.json

0/7

hosts

Mount Point /etc/resolv.conf

0/2

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

0.97

5 min

0.73

15 min

0.40

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

0.00

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

0

%

<

mean

7.3328

%

SD

11.7425

%

<

p95

34.59

%

60 second average

7.1019

%

300 second average

5.7164

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.2778

%

SD

1.0623

%

<

p95

1.41

%

60 second average

0.2438

%

300 second average

0.1598

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.1551

%

SD

0.6309

%

<

p95

0.8

%

60 second average

0.1330

%

300 second average

0.0914

%

Holochain process CPU usage

CPU usage by Holochain process

p5

1.75

%

<

mean

10.98

%

SD

15.57

%

<

p95

45.58

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

181.95

KiB

<

mean

215.81

KiB

SD

50.78

KiB

<

p95

263.79

KiB

Holochain process threads

Number of threads in Holochain process

p5

27

threads

<

mean

35.2

threads

SD

31.81

threads

<

p95

39

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

67

file descriptors

<

mean

88.42

file descriptors

SD

82.23

file descriptors

<

p95

96

file descriptors

Remote Signals

↑ Back to index

This scenario tests the throughput of remote_signals operations.

Started

Thu, 16 Jul 2026 03:32:18 UTC

Peer count

10

Behaviours

default (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

remote_signals_29468960194_1

Round trip time

The time from origin signal dispatch to origin receive of the remote side's response signal.

mean

0.164112

s

SD

0.149245

s

p50

0.216305

s

<

p95

0.25447

s

<

p99

0.377925

s

Timeout rate

The proportion of remote signal round-trips that timed out.

0

Holochain MetricsClick to toggle visibility.

WASM usage: 'remote_signal::init'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 895.170465217s

Not enough time data to show a trend.

WASM usage: 'remote_signal::recv_remote_signal'

Metered usage count of the WASM ribosome for this zome function.

total

31393445

over 887.330218334s

mean rate

2.208478528e+07

/s

std

6.100300036e+07

/s

p5

0

/s

p95

1.1149406478e+08

/s

peak

6.0248684053e+08

/s

WASM usage: 'remote_signal::signal_request'

Metered usage count of the WASM ribosome for this zome function.

total

13546750

over 895.170465217s

mean rate

7.51634574e+06

/s

std

3.864359165e+07

/s

p5

0

/s

p95

3.682735719e+07

/s

peak

5.5886652829e+08

/s

Zome call duration: 'remote_signal::recv_remote_signal'

Duration of this zome call as measured by Holochain internally.

mean

0.006926

s

SD

0.004045

s

p50

0.006954

s

<

p95

0.01463

s

<

p99

0.028385

s

Zome call duration: 'remote_signal::signal_request'

Duration of this zome call as measured by Holochain internally.

mean

0.006805

s

SD

0.003755

s

p50

0.006789

s

<

p95

0.014955

s

<

p99

0.026015

s

WASM call duration: 'remote_signal::init'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.017367

s

SD

0.011596

s

p50

0.014921

s

<

p95

0.038199

s

≤

p99

0.038199

s

WASM call duration: 'remote_signal::recv_remote_signal'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.002394

s

SD

0.000609

s

p50

0.002158

s

<

p95

0.00354

s

<

p99

0.00357

s

WASM call duration: 'remote_signal::signal_request'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.002328

s

SD

0.00062

s

p50

0.002062

s

<

p95

0.003483

s

<

p99

0.003541

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.000463

s

SD

0.000277

s

p50

0.000343

s

<

p95

0.001055

s

≤

p99

0.001055

s

Host function call duration: '__hc__emit_signal_1'

Duration of this host function call invoked from within WASM.

mean

0.000108

s

SD

2.6e-05

s

p50

0.000103

s

<

p95

0.00015

s

<

p99

0.000159

s

Host function call duration: '__hc__send_remote_signal_1'

Duration of this host function call invoked from within WASM.

mean

0.00013

s

SD

5e-05

s

p50

0.000122

s

<

p95

0.000198

s

<

p99

0.000215

s

Host function call duration: '__hc__sys_time_1'

Duration of this host function call invoked from within WASM.

mean

1.3e-05

s

SD

4e-06

s

p50

1.1e-05

s

<

p95

2e-05

s

<

p99

2.2e-05

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.015612

s

SD

0.011471

s

p50

0.013361

s

<

p95

0.035207

s

≤

p99

0.035207

s

Emitted local signals

Count of local signals emitted via the emit_signal host function.

total

1730

over 887.330012063s

mean rate

1030.44

/s

std

3188.38

/s

p5

0

/s

p95

5123.63

/s

peak

43905.04

/s

Sent remote signals

Count of remote signals sent via the send_remote_signal host function.

total

1740

over 895.170587354s

mean rate

1058.13

/s

std

3169.37

/s

p5

0

/s

p95

5489.33

/s

peak

37680.63

/s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.017298

s

SD

0.018075

s

p50

0.011879

s

<

p95

0.060841

s

≤

p99

0.060841

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

46.58

s

<

mean

451.59

s

SD

259.8

s

<

p95

856.61

s

Integrated ops

Count of DHT ops integrated since the conductor started. Resets on restart.

total

117

over 897.330325478s

mean rate

9464.14

/s

std

214796.33

/s

p5

0

/s

p95

4400.87

/s

peak

6.03448276e+06

/s

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

2.871921

s

SD

1.481407

s

p50

3.372691

s

<

p95

5.079245

s

<

p99

6.665924

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.165621

s

SD

0.44687

s

p50

0.172243

s

<

p95

1.132194

s

<

p99

2.644488

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.004209

s

SD

0.002602

s

p50

0.004036

s

<

p95

0.008937

s

≤

p99

0.008937

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.040932

s

SD

0.025383

s

p50

0.045326

s

<

p95

0.095962

s

≤

p99

0.095962

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.006885

s

SD

0.004919

s

p50

0.005535

s

<

p95

0.01397

s

<

p99

0.030666

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

0.455122

s

SD

0.840957

s

p50

0.496359

s

<

p95

1.870413

s

<

p99

5.83875

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

0.46035

s

SD

0.353736

s

p50

0.525413

s

<

p95

1.137396

s

<

p99

1.441319

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.000276

s

SD

9e-05

s

p50

0.000256

s

<

p95

0.000374

s

<

p99

0.000679

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.000137

s

SD

0.000482

s

p50

0.000405

s

<

p95

0.001654

s

<

p99

0.001709

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000585

s

SD

0.00013

s

p50

0.000521

s

<

p95

0.000841

s

<

p99

0.000848

s

P2P request roundtrip: 'get'

Time spent sending a get request and awaiting its response.

mean

0.053493

s

SD

0.025757

s

p50

0.056722

s

<

p95

0.087444

s

<

p99

0.096917

s

P2P request roundtrip: 'send_validation_receipts'

Time spent sending a send_validation_receipts request and awaiting its response.

mean

0.122513

s

SD

0.056261

s

p50

0.145075

s

<

p95

0.185485

s

≤

p99

0.185485

s

P2P received remote signals

Count of remote signals received.

total

1730

over 887.330094328s

mean rate

993.28

/s

std

2869.39

/s

p5

0

/s

p95

5718.47

/s

peak

36753.9

/s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

24.65

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

0

B/s

<

mean

61.87

KiB/s

SD

510.38

KiB/s

≤

p95

25.61

KiB/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

0

B/s

<

mean

14.14

KiB/s

SD

16.09

KiB/s

<

p95

26.98

KiB/s

Total bytes received

Total bytes received on primary network interface

count

269.49

MiB

mean

306.62

KiB/s

Total bytes sent

Total bytes sent on primary network interface

count

61.60

MiB

mean

70.09

KiB/s

CPU spike anomaly

CPU spike anomaly was detected

Detected

Warning CPU p99 reached 91.0%

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 606.36 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

NotDetected

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

7.06

%

<

mean

33.06

%

SD

26.66

%

<

p95

87.42

%

System

8.42

%

CPU percentiles

CPU usage percentiles

p50

21.54

%

p95

87.42

%

p99

91.03

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

5

hosts

mean time

0.10

s

Memory used percentage

Percentage of memory used

p5

13.11

%

<

mean

17.65

%

SD

2.6

%

<

p95

21.96

%

Memory available percentage

Percentage of available memory

p5

78.04

%

<

mean

82.35

%

SD

2.6

%

<

p95

86.89

%

Max host memory used

Maximum memory usage percentage across all hosts

max

18.72

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

606.36

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.01

MiB/s

Disk write throughput

Disk write throughput in MiB/s

25.78

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /etc/hostname

0/1

hosts

Mount Point /etc/hosts

0/1

hosts

Mount Point /etc/nomad.d/client-meta.json

0/4

hosts

Mount Point /etc/resolv.conf

0/1

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

1.49

5 min

1.04

15 min

0.54

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

0.00

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

1.1

%

<

mean

12.6122

%

SD

15.1042

%

<

p95

42.81

%

60 second average

11.7349

%

300 second average

8.3090

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.3272

%

SD

1.1623

%

<

p95

1.62

%

60 second average

0.3261

%

300 second average

0.2537

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.1303

%

SD

0.4306

%

<

p95

0.77

%

60 second average

0.1374

%

300 second average

0.1217

%

Holochain process CPU usage

CPU usage by Holochain process

p5

1.65

%

<

mean

14.05

%

SD

21.59

%

<

p95

71.94

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

180.41

KiB

<

mean

212.04

KiB

SD

80.47

KiB

<

p95

339.53

KiB

Holochain process threads

Number of threads in Holochain process

p5

17

threads

<

mean

40.61

threads

SD

59.12

threads

≤

p95

35

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

43

file descriptors

<

mean

104.24

file descriptors

SD

151.26

file descriptors

≤

p95

95

file descriptors

Single-write, many-read

↑ Back to index

Creates an entry in the agent setup, then read one's own record back. This tests the maximum read performance for reading back local data when the chain is short.

Started

Thu, 16 Jul 2026 03:34:17 UTC

Peer count

1

Behaviours

default (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

single_write_many_read_29468960194_1

read call timing

The time it takes to complete the zome call that retrieves the record.

mean

0.007286

s

SD

0.002381

s

p50

0.007023

s

<

p95

0.010877

s

<

p99

0.015032

s

read call rate

The number of read zome calls completed per second.

mean

1362.45

/s

Error count

The number of errors collected.

0

Holochain MetricsClick to toggle visibility.

Cascade duration

Time taken to execute a cascade (get) query inside Holochain.

mean

0.000413

s

SD

1.9e-05

s

p50

0.000407

s

<

p95

0.000426

s

<

p99

0.000427

s

WASM usage: 'crud::create_sample_entry'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 280.005177161s

Not enough time data to show a trend.

WASM usage: 'crud::get_sample_entry'

Metered usage count of the WASM ribosome for this zome function.

total

1451299132

over 280.005177161s

mean rate

5.18311197e+06

/s

std

242692.5

/s

p5

4.69919348e+06

/s

p95

5.54587385e+06

/s

peak

5.6035179e+06

/s

WASM usage: 'crud::init'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 280.005177161s

Not enough time data to show a trend.

WASM usage: 'crud_integrity::entry_defs'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 280.005177161s

Not enough time data to show a trend.

Zome call duration: 'crud::create_sample_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.026206

s

SD

0

s

p50

0.026206

s

≤

p95

0.026206

s

≤

p99

0.026206

s

Zome call duration: 'crud::get_sample_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.004684

s

SD

0.000148

s

p50

0.004766

s

<

p95

0.004953

s

<

p99

0.005375

s

WASM call duration: 'crud::create_sample_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.005779

s

SD

0

s

p50

0.005779

s

≤

p95

0.005779

s

≤

p99

0.005779

s

WASM call duration: 'crud::get_sample_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.002005

s

SD

4.5e-05

s

p50

0.002052

s

<

p95

0.002074

s

<

p99

0.00208

s

WASM call duration: 'crud::init'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001363

s

SD

0

s

p50

0.001363

s

≤

p95

0.001363

s

≤

p99

0.001363

s

WASM call duration: 'crud_integrity::entry_defs'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.000973

s

SD

0

s

p50

0.000973

s

≤

p95

0.000973

s

≤

p99

0.000973

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.000321

s

SD

6e-06

s

p50

0.000327

s

≤

p95

0.000327

s

≤

p99

0.000327

s

Host function call duration: '__hc__get_1'

Duration of this host function call invoked from within WASM.

mean

0.000491

s

SD

1.8e-05

s

p50

0.000487

s

<

p95

0.000504

s

<

p99

0.000511

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.004374

s

SD

0

s

p50

0.004374

s

≤

p95

0.004374

s

≤

p99

0.004374

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.008596

s

SD

0

s

p50

0.008596

s

≤

p95

0.008596

s

≤

p99

0.008596

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

17.12

s

<

mean

147.12

s

SD

83.67

s

<

p95

277.12

s

Integrated ops

Count of DHT ops integrated since the conductor started. Resets on restart.

total

0

over 280.005141864s

Not enough time data to show a trend.

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.001077

s

SD

0

s

p50

0.001077

s

≤

p95

0.001077

s

≤

p99

0.001077

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.001125

s

SD

0

s

p50

0.001125

s

≤

p95

0.001125

s

≤

p99

0.001125

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.001747

s

SD

0

s

p50

0.001747

s

≤

p95

0.001747

s

≤

p99

0.001747

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.001912

s

SD

0.000147

s

p50

0.001991

s

<

p95

0.002129

s

≤

p99

0.002129

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

0.001391

s

SD

0

s

p50

0.001391

s

≤

p95

0.001391

s

≤

p99

0.001391

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

0.000638

s

SD

0

s

p50

0.000638

s

≤

p95

0.000638

s

≤

p99

0.000638

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.000155

s

SD

3e-06

s

p50

0.000155

s

<

p95

0.000157

s

≤

p99

0.000157

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.000107

s

SD

0.000158

s

p50

0.000424

s

≤

p95

0.000424

s

≤

p99

0.000424

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000241

s

SD

0

s

p50

0.000241

s

≤

p95

0.000241

s

≤

p99

0.000241

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

42.80

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

0

B/s

≤

mean

0

B/s

SD

0

B/s

≤

p95

0

B/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

0

B/s

≤

mean

0

B/s

SD

0

B/s

≤

p95

0

B/s

Total bytes received

Total bytes received on primary network interface

count

0

B

mean

0

B/s

Total bytes sent

Total bytes sent on primary network interface

count

0

B

mean

0

B/s

CPU spike anomaly

CPU spike anomaly was detected

NotDetected

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 545.89 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

NotDetected

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

39.02

%

<

mean

56.68

%

SD

13.64

%

<

p95

68.59

%

System

13.88

%

CPU percentiles

CPU usage percentiles

p50

67.28

%

p95

68.59

%

p99

72.11

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

0

hosts

mean time

0.00

s

Memory used percentage

Percentage of memory used

p5

16.68

%

<

mean

18.51

%

SD

1.63

%

<

p95

20.12

%

Memory available percentage

Percentage of available memory

p5

79.88

%

<

mean

81.49

%

SD

1.63

%

<

p95

83.32

%

Max host memory used

Maximum memory usage percentage across all hosts

max

18.51

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

545.89

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.01

MiB/s

Disk write throughput

Disk write throughput in MiB/s

21.07

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /etc/hostname

0/1

hosts

Mount Point /etc/hosts

0/1

hosts

Mount Point /etc/resolv.conf

0/1

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

2.20

5 min

1.13

15 min

0.52

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

0.00

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

3.77

%

<

mean

12.867

%

SD

7.9117

%

<

p95

20.93

%

60 second average

10.2257

%

300 second average

4.9373

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.081

%

SD

0.1086

%

<

p95

0.31

%

60 second average

0.0527

%

300 second average

0.0117

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.012

%

SD

0.036

%

<

p95

0.08

%

60 second average

0.0063

%

300 second average

0.0000

%

Holochain process CPU usage

CPU usage by Holochain process

p5

22.64

%

<

mean

28.73

%

SD

6.33

%

<

p95

33.47

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

194.17

KiB

<

mean

231.15

KiB

SD

24.33

KiB

<

p95

258.87

KiB

Holochain process threads

Number of threads in Holochain process

p5

28

threads

<

mean

29.73

threads

SD

1.69

threads

<

p95

31

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

67

file descriptors

<

mean

72.4

file descriptors

SD

3.34

file descriptors

<

p95

77

file descriptors

Validation Receipts

↑ Back to index

Creates an entry, wait for required validation receipts, then repeat. Records the amount of time it took to accumulate the required number of receipts for all DHT operations. This is measured to the nearest 20ms so that we don't keep the agent too busy checking for receipts.

Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.

By default, this scenario will wait for a complete set of validation receipts before committing the next record. If the NO_VALIDATION_COMPLETE environment variable is set, it will instead publish new records on every round, building up an ever-growing list of action hashes to check on.

Started

Thu, 16 Jul 2026 04:17:46 UTC

Peer count

20

Peer count at end

20

Behaviours

default (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

validation_receipts_29468960194_1

Receipts complete timing

The amount of time between publishing a record and receiving the required number of validation receipts.

Mean

mean

5.681911

s

SD

1.844826

s

Max

Highest per-partition mean latency

max mean

6.248743

s

Min

Lowest per-partition mean latency

min mean

5.318449

s

Receipts complete rate

The number of complete validation receipt sets collected per second.

Mean

mean

1.69

/s

Max

Highest per-partition mean rate

max

1.83

/s

Min

Lowest per-partition mean rate

min

1.39

/s

Error count

The total number of errors accumulated during the run.

0

Holochain MetricsClick to toggle visibility.

WASM usage: 'crud::create_sample_entry'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 37475.242935709s

Not enough time data to show a trend.

WASM usage: 'crud::get_sample_entry_validation_receipts'

Metered usage count of the WASM ribosome for this zome function.

total

994500

over 37475.242935709s

mean rate

1.511622082e+07

/s

std

3.012974787e+07

/s

p5

0

/s

p95

9.213976394e+07

/s

peak

1.6148594705e+08

/s

WASM usage: 'crud::init'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 37475.242935709s

Not enough time data to show a trend.

WASM usage: 'crud_integrity::entry_defs'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 37475.242935709s

Not enough time data to show a trend.

Zome call duration: 'crud::create_sample_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.013809

s

SD

0.009985

s

p50

0.019606

s

<

p95

0.036884

s

≤

p99

0.036884

s

Zome call duration: 'crud::get_sample_entry_validation_receipts'

Duration of this zome call as measured by Holochain internally.

mean

0.017181

s

SD

0.00728

s

p50

0.015153

s

<

p95

0.028793

s

<

p99

0.038699

s

WASM call duration: 'crud::create_sample_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.007335

s

SD

0.004282

s

p50

0.007211

s

<

p95

0.017529

s

≤

p99

0.017529

s

WASM call duration: 'crud::get_sample_entry_validation_receipts'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.009299

s

SD

0.005334

s

p50

0.005216

s

<

p95

0.017873

s

<

p99

0.020093

s

WASM call duration: 'crud::init'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001886

s

SD

0.001839

s

p50

0.001388

s

<

p95

0.009621

s

≤

p99

0.009621

s

WASM call duration: 'crud_integrity::entry_defs'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001343

s

SD

0.000375

s

p50

0.001087

s

<

p95

0.001816

s

<

p99

0.002154

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.0004

s

SD

0.000313

s

p50

0.000311

s

<

p95

0.001535

s

<

p99

0.00159

s

Host function call duration: '__hc__get_validation_receipts_1'

Duration of this host function call invoked from within WASM.

mean

0.007481

s

SD

0.005302

s

p50

0.001879

s

<

p95

0.015903

s

<

p99

0.018355

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.005376

s

SD

0.004301

s

p50

0.005247

s

<

p95

0.016204

s

≤

p99

0.016204

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.004191

s

SD

0.006934

s

p50

0.005599

s

<

p95

0.023437

s

<

p99

0.028148

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

47.01

s

<

mean

451.92

s

SD

259.8

s

<

p95

857.03

s

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

0.888091

s

SD

0.821482

s

p50

0.844231

s

<

p95

2.712213

s

<

p99

3.963133

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.007878

s

SD

0.064351

s

p50

0.005122

s

<

p95

0.161155

s

<

p99

0.269492

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.001727

s

SD

0.001142

s

p50

0.001252

s

<

p95

0.004876

s

≤

p99

0.004876

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.037425

s

SD

0.026443

s

p50

0.044773

s

<

p95

0.09003

s

<

p99

0.105212

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.023154

s

SD

0.01392

s

p50

0.009207

s

<

p95

0.044533

s

<

p99

0.075399

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

0.037287

s

SD

0.296724

s

p50

0.03217

s

<

p95

0.26617

s

<

p99

1.842403

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

1.379775

s

SD

7.209475

s

p50

1.103403

s

<

p95

22.510575

s

<

p99

37.687067

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.000266

s

SD

7.4e-05

s

p50

0.000255

s

<

p95

0.00039

s

<

p99

0.000413

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.001112

s

SD

0.009171

s

p50

0.000488

s

<

p95

0.013575

s

<

p99

0.074505

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000417

s

SD

0.000143

s

p50

0.000343

s

<

p95

0.000698

s

<

p99

0.00071

s

P2P request roundtrip: 'get'

Time spent sending a get request and awaiting its response.

mean

0.0691

s

SD

0.066747

s

p50

0.058696

s

<

p95

0.201075

s

<

p99

0.205332

s

P2P request roundtrip: 'send_validation_receipts'

Time spent sending a send_validation_receipts request and awaiting its response.

mean

0.210874

s

SD

0.052923

s

p50

0.194687

s

<

p95

0.301096

s

<

p99

0.321352

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

4.91

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

9

B/s

<

mean

37.57

KiB/s

SD

319.71

KiB/s

≤

p95

34.02

KiB/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

0

B/s

<

mean

13.62

KiB/s

SD

15.10

KiB/s

<

p95

32.44

KiB/s

Total bytes received

Total bytes received on primary network interface

count

660.45

MiB

mean

743.19

KiB/s

Total bytes sent

Total bytes sent on primary network interface

count

239.46

MiB

mean

269.46

KiB/s

CPU spike anomaly

CPU spike anomaly was detected

NotDetected

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 88.49 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

NotDetected

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

0.68

%

<

mean

9.65

%

SD

11.1

%

<

p95

37.18

%

System

4.74

%

CPU percentiles

CPU usage percentiles

p50

6.33

%

p95

37.18

%

p99

38.74

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

0

hosts

mean time

0.00

s

Memory used percentage

Percentage of memory used

p5

10.22

%

<

mean

12.37

%

SD

3.04

%

<

p95

21.96

%

Memory available percentage

Percentage of available memory

p5

84.68

%

<

mean

87.63

%

SD

3.04

%

<

p95

89.78

%

Max host memory used

Maximum memory usage percentage across all hosts

max

24.75

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

88.49

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.02

MiB/s

Disk write throughput

Disk write throughput in MiB/s

24.79

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /

0/3

hosts

Mount Point /efi-boot

0/2

hosts

Mount Point /etc/hostname

0/6

hosts

Mount Point /etc/hosts

0/6

hosts

Mount Point /etc/nomad.d/client-meta.json

0/11

hosts

Mount Point /etc/resolv.conf

0/6

hosts

Mount Point /nix/store

0/3

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

0.89

5 min

1.96

15 min

2.97

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

0.00

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

0

%

<

mean

1.5247

%

SD

2.3033

%

<

p95

4.89

%

60 second average

3.1463

%

300 second average

9.9657

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

<

mean

0.0002

%

SD

0.0068

%

≤

p95

0

%

60 second average

0.0002

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

<

mean

0.0002

%

SD

0.0068

%

≤

p95

0

%

60 second average

0.0002

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

5.9636

%

SD

13.4254

%

<

p95

42.61

%

60 second average

6.6860

%

300 second average

9.3033

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

5.5905

%

SD

12.5733

%

<

p95

39.53

%

60 second average

6.0629

%

300 second average

7.5090

%

Holochain process CPU usage

CPU usage by Holochain process

p5

0.33

%

<

mean

5.07

%

SD

5.13

%

<

p95

13.3

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

210.96

KiB

<

mean

247.11

KiB

SD

41.05

KiB

<

p95

311.79

KiB

Holochain process threads

Number of threads in Holochain process

p5

26

threads

<

mean

37.31

threads

SD

9.74

threads

<

p95

49

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

63

file descriptors

<

mean

87.16

file descriptors

SD

16.86

file descriptors

<

p95

103

file descriptors

Write/`get_agent_activity`

↑ Back to index

A scenario where write peers write entries, while get_agent_activity peers each query a single write agent's activity with get_agent_activity.

Before a target write peer and the requesting get_agent_activity peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started

Thu, 16 Jul 2026 04:33:18 UTC

Peer count

30

Peer count at end

28

Behaviours

get_agent_activity (1 agent)
write (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

write_get_agent_activity_29468960194_1

Observed chain advancement

The maximum highest-observed action sequence per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any reader successfully tracking that point counts as propagation). Captures how far readers tracked writers’ chains during the run.

Mean max (across write agents)

Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.

5057.8

Max

Highest chain head value observed for any single write agent.

9213

Write agents observed

5

get_agent_activity_full zome call timing

The time taken to call the zome function that retrieves information on a write peer's source chain.

Mean

mean

0.084962

s

SD

0.084393

s

Max

Highest per-partition mean latency

max mean

0.292281

s

Min

Lowest per-partition mean latency

min mean

0.015469

s

Error count

The number of errors accumulated.

30

Holochain MetricsClick to toggle visibility.

Cascade duration

Time taken to execute a cascade (get) query inside Holochain.

mean

0.011871

s

SD

0.243529

s

p50

0.004325

s

<

p95

0.68607

s

<

p99

1.1711

s

Cascade fetch errors

Count of network fetch errors during cascade calls.

total

9

over 851.859422997s

mean rate

26.39

/s

std

74.43

/s

p5

0

/s

p95

206.5

/s

peak

425.99

/s

WASM usage: 'agent_activity::announce_write_behaviour'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 33086.724640138s

Not enough time data to show a trend.

WASM usage: 'agent_activity::create_sample_entry'

Metered usage count of the WASM ribosome for this zome function.

total

140469504

over 33086.724640138s

mean rate

1.8545316763e+08

/s

std

2.9164293009e+08

/s

p5

78354.34

/s

p95

7.783235149e+08

/s

peak

1.41751858082e+09

/s

WASM usage: 'agent_activity::get_agent_activity_full'

Metered usage count of the WASM ribosome for this zome function.

total

8334496038

over 913.960546374s

mean rate

1.17114809155e+10

/s

std

2.49153753827e+10

/s

p5

3.429696776e+07

/s

p95

8.01006340359e+10

/s

peak

1.32842289004e+11

/s

WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'

Metered usage count of the WASM ribosome for this zome function.

total

4548714615

over 37461.011726418s

mean rate

1.39835073333e+10

/s

std

3.1526952102e+10

/s

p5

5.79675941e+06

/s

p95

1.0163674982e+11

/s

peak

1.5842134648e+11

/s

WASM usage: 'agent_activity_integrity::entry_defs'

Metered usage count of the WASM ribosome for this zome function.

total

323189225

over 37461.011726418s

mean rate

6.2494671242e+08

/s

std

1.77179643992e+09

/s

p5

0

/s

p95

4.54976574593e+09

/s

peak

1.12564291089e+10

/s

Zome call duration: 'agent_activity::announce_write_behaviour'

Duration of this zome call as measured by Holochain internally.

mean

0.028617

s

SD

0.012456

s

p50

0.024284

s

<

p95

0.056815

s

≤

p99

0.056815

s

Zome call duration: 'agent_activity::create_sample_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.040637

s

SD

0.024581

s

p50

0.033262

s

<

p95

0.09557

s

<

p99

0.106967

s

Zome call duration: 'agent_activity::get_agent_activity_full'

Duration of this zome call as measured by Holochain internally.

mean

0.027532

s

SD

0.070384

s

p50

0.031273

s

<

p95

0.239542

s

<

p99

0.27179

s

Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'

Duration of this zome call as measured by Holochain internally.

mean

0.01308

s

SD

0.313535

s

p50

0.009493

s

<

p95

1.19446

s

≤

p99

1.19446

s

WASM call duration: 'agent_activity::announce_write_behaviour'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.010147

s

SD

0.006944

s

p50

0.006598

s

<

p95

0.026611

s

≤

p99

0.026611

s

WASM call duration: 'agent_activity::create_sample_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.022849

s

SD

0.01359

s

p50

0.019078

s

<

p95

0.052791

s

<

p99

0.059546

s

WASM call duration: 'agent_activity::get_agent_activity_full'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.024484

s

SD

0.061913

s

p50

0.021497

s

<

p95

0.211598

s

<

p99

0.225172

s

WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.008114

s

SD

0.309244

s

p50

0.006494

s

<

p95

1.177987

s

≤

p99

1.177987

s

WASM call duration: 'agent_activity_integrity::entry_defs'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001143

s

SD

0.000484

s

p50

0.001044

s

<

p95

0.00226

s

<

p99

0.003032

s

Host function call duration: '__hc__agent_info_1'

Duration of this host function call invoked from within WASM.

mean

3.1e-05

s

SD

7e-06

s

p50

3e-05

s

<

p95

4.7e-05

s

≤

p99

4.7e-05

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.000906

s

SD

0.000801

s

p50

0.000726

s

<

p95

0.002939

s

<

p99

0.003301

s

Host function call duration: '__hc__create_link_1'

Duration of this host function call invoked from within WASM.

mean

0.000407

s

SD

0.00021

s

p50

0.000309

s

<

p95

0.000901

s

≤

p99

0.000901

s

Host function call duration: '__hc__get_agent_activity_1'

Duration of this host function call invoked from within WASM.

mean

0.023116

s

SD

0.061456

s

p50

0.019537

s

<

p95

0.208232

s

<

p99

0.220899

s

Host function call duration: '__hc__get_links_1'

Duration of this host function call invoked from within WASM.

mean

0.000387

s

SD

0.309143

s

p50

0.00041

s

<

p95

1.171142

s

≤

p99

1.171142

s

Host function call duration: '__hc__random_bytes_1'

Duration of this host function call invoked from within WASM.

mean

1.6e-05

s

SD

9e-06

s

p50

1.6e-05

s

<

p95

3.6e-05

s

<

p99

3.8e-05

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.008635

s

SD

0.008454

s

p50

0.005002

s

<

p95

0.023813

s

<

p99

0.047495

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.016413

s

SD

0.016225

s

p50

0.019177

s

<

p95

0.06558

s

<

p99

0.068008

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

47.03

s

<

mean

452.05

s

SD

259.71

s

<

p95

857.06

s

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

140.053688

s

SD

146.11908

s

p50

34.511961

s

<

p95

436.624982

s

<

p99

531.791379

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.940977

s

SD

3.336444

s

p50

1.372785

s

<

p95

11.188763

s

<

p99

15.657828

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.001895

s

SD

0.001538

s

p50

0.001254

s

<

p95

0.005352

s

<

p99

0.006633

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.088666

s

SD

0.410982

s

p50

0.226233

s

<

p95

1.100303

s

<

p99

1.236469

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.210954

s

SD

0.120706

s

p50

0.037431

s

<

p95

0.331805

s

<

p99

0.640275

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

5.293444

s

SD

25.990931

s

p50

12.633973

s

<

p95

75.65328

s

<

p99

131.782285

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

9.297545

s

SD

28.732402

s

p50

0.012309

s

<

p95

47.091616

s

<

p99

139.492879

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.000642

s

SD

0.001496

s

p50

0.000243

s

<

p95

0.004966

s

<

p99

0.006289

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.002315

s

SD

0.019411

s

p50

0.000562

s

<

p95

0.027161

s

<

p99

0.091694

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000651

s

SD

0.000487

s

p50

0.000381

s

<

p95

0.000965

s

<

p99

0.003035

s

P2P request roundtrip: 'get'

Time spent sending a get request and awaiting its response.

mean

4.691772

s

SD

29.92605

s

p50

0.197663

s

<

p95

60.027478

s

<

p99

60.251715

s

P2P request roundtrip: 'get_links'

Time spent sending a get_links request and awaiting its response.

mean

0.615683

s

SD

0.324433

s

p50

0.67527

s

<

p95

1.168004

s

≤

p99

1.168004

s

P2P request roundtrip: 'get_agent_activity'

Time spent sending a get_agent_activity request and awaiting its response.

mean

0.03202

s

SD

27.237123

s

p50

0.035373

s

<

p95

60.001664

s

<

p99

60.002019

s

P2P request roundtrip: 'send_validation_receipts'

Time spent sending a send_validation_receipts request and awaiting its response.

mean

0.394184

s

SD

3.826893

s

p50

0.379057

s

<

p95

10.146788

s

<

p99

10.213897

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

48.84

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

91

B/s

<

mean

585.30

KiB/s

SD

629.85

KiB/s

<

p95

1.68

MiB/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

50

B/s

<

mean

533.51

KiB/s

SD

602.81

KiB/s

<

p95

1.70

MiB/s

Total bytes received

Total bytes received on primary network interface

count

14.03

GiB

mean

15.96

MiB/s

Total bytes sent

Total bytes sent on primary network interface

count

12.79

GiB

mean

14.55

MiB/s

CPU spike anomaly

CPU spike anomaly was detected

Detected

Warning CPU p99 reached 98.3%

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 288.95 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

Detected

Warning 50% of hosts overloaded (load5/ncpus > 1.0)

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

8.67

%

<

mean

59.8

%

SD

30.16

%

<

p95

96.52

%

System

10.95

%

CPU percentiles

CPU usage percentiles

p50

68.01

%

p95

96.52

%

p99

98.30

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

16

hosts

mean time

0.65

s

Memory used percentage

Percentage of memory used

p5

6.52

%

<

mean

12.38

%

SD

4.04

%

<

p95

17.15

%

Memory available percentage

Percentage of available memory

p5

82.85

%

<

mean

87.62

%

SD

4.04

%

<

p95

93.48

%

Max host memory used

Maximum memory usage percentage across all hosts

max

27.19

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

288.95

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.02

MiB/s

Disk write throughput

Disk write throughput in MiB/s

211.13

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /

0/5

hosts

Mount Point /efi-boot

0/4

hosts

Mount Point /etc/hostname

0/6

hosts

Mount Point /etc/hosts

0/6

hosts

Mount Point /etc/nomad.d/client-meta.json

0/17

hosts

Mount Point /etc/resolv.conf

0/6

hosts

Mount Point /nix/store

0/5

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

4.42

5 min

3.40

15 min

2.80

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

50.00

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

0

%

<

mean

29.5704

%

SD

28.1153

%

<

p95

85.46

%

60 second average

28.0319

%

300 second average

21.3181

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

12.0896

%

SD

18.2436

%

<

p95

48.51

%

60 second average

11.6217

%

300 second average

9.6788

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

8.3331

%

SD

14.5183

%

<

p95

40.3

%

60 second average

8.0883

%

300 second average

7.0152

%

Holochain process CPU usage

CPU usage by Holochain process

p5

7.69

%

<

mean

56.03

%

SD

29.61

%

<

p95

95.29

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

234.10

KiB

<

mean

358.38

KiB

SD

82.73

KiB

<

p95

509.54

KiB

Holochain process threads

Number of threads in Holochain process

p5

28

threads

<

mean

41.08

threads

SD

8.54

threads

<

p95

54

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

72

file descriptors

<

mean

94.59

file descriptors

SD

13.76

file descriptors

<

p95

108

file descriptors

Write/`get_agent_activity` with volatile conductors

↑ Back to index

A scenario where write peers write entries, while get_agent_activity_volatile peers each query a single write agents activity with get_agent_activity but shutdown and restart their conductors at semi-random intervals.

Before a target write peer and the requesting get_agent_activity_volatile peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.

Started

Thu, 16 Jul 2026 04:49:11 UTC

Peer count

30

Peer count at end

27

Behaviours

get_agent_activity_volatile (1 agent)
write (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

write_get_agent_activity_volatile_29468960194_1

Highest observed action_seq

The rate at which zero-arc readers observe new chain heads on the writers' chains via get_agent_activity. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.

Mean

mean

103.79

/s

Max

Highest per-partition mean rate

max

346.04

/s

Min

Lowest per-partition mean rate

min

18.48

/s

get_agent_activity_full zome call timing

The time taken to call the zome function that retrieves information on a write peer's source chain.

Mean

mean

0.133737

s

SD

0.180123

s

Max

Highest per-partition mean latency

max mean

0.300883

s

Min

Lowest per-partition mean latency

min mean

0.019583

s

Running volatile conductors count

The number of conductors running by get_agent_activity_volatile peers.

p5

10

conductors

<

mean

13.15

conductors

SD

2.09

conductors

<

p95

16

conductors

Volatile conductor total running duration

The total running duration of a get_agent_activity_volatile conductor.

Mean

mean

1076.37156

s

SD

539.821824

s

Max

Highest per-partition mean latency

max mean

2652.809524

s

Min

Lowest per-partition mean latency

min mean

750.612903

s

Volatile conductor running duration

The duration that a get_agent_activity_volatile conductor was running before being stopped.

Mean

mean

62.217807

s

SD

47.515162

s

Max

Highest per-partition mean latency

max mean

141.643236

s

Min

Lowest per-partition mean latency

min mean

36.243732

s

Volatile conductor stopped duration

The duration that a get_agent_activity_volatile conductor was stopped before being started again.

Mean

mean

38.398125

s

SD

51.401644

s

Max

Highest per-partition mean latency

max mean

62.562113

s

Min

Lowest per-partition mean latency

min mean

7.552329

s

Reached target arc

Did get_agent_activity_volatile peer reach their target arc in the moment before they were shutdown.

get_agent_activity_volatile_agent: uhCAk-jcixXPAfAQkYqyZXKtp9l7cIRmGoHUcUPQX-ykShua0w8an

p5

0

<

mean

0.26

SD

0.44

<

p95

1

get_agent_activity_volatile_agent: uhCAk6BNOVyCa_OKDxGNNOXcgxG8IqnceQbrKFda3EI8C6FZTg-eJ

p5

0

<

mean

0.37

SD

0.48

<

p95

1

get_agent_activity_volatile_agent: uhCAk6xoPAhlt8aUzI2RXSeeYEzbr7oeq86GH3ciK9ZzKGiSmoeuY

p5

0

<

mean

0.32

SD

0.47

<

p95

1

get_agent_activity_volatile_agent: uhCAk8OJSFYtvmgJHHm0yfPObKl56UTC5dH9N90ISZw0-yMU2rjIM

p5

0

<

mean

0.16

SD

0.37

<

p95

1

get_agent_activity_volatile_agent: uhCAk8Y6dZLrYxmZtq6cEt7f5tcbBru11rjW_bDFhd364VNV9lD34

p5

0

<

mean

0.18

SD

0.38

<

p95

1

get_agent_activity_volatile_agent: uhCAk9NVL6AJzYSiL0fnD1nok5wD0RTWPVi1dx5F6pSb8nGb60EON

p5

0

<

mean

0.05

SD

0.21

≤

p95

0

get_agent_activity_volatile_agent: uhCAkDTYqImbUFnpgv-7kiLKFD6h78DYMYhjUcldbFX34ke1gEZT0

p5

0

<

mean

0.17

SD

0.37

<

p95

1

get_agent_activity_volatile_agent: uhCAkIe1Kd0g95Pp3LnrWngZkTXjAkmt7R1IPaOgYnFw8RhT1JTjK

p5

0

≤

mean

0

SD

0

≤

p95

0

get_agent_activity_volatile_agent: uhCAkRk1uQoY9l1wOiIz_2wmeMFopdmRA8kMmmOcCr0azW_wdoouu

p5

0

<

mean

0.3

SD

0.46

<

p95

1

get_agent_activity_volatile_agent: uhCAkSUJ5DpnM-wP5sv4QyEH1A7R3qkpV4EJ9T7Ftz8esxMS0b2wI

p5

0

<

mean

0.29

SD

0.45

<

p95

1

get_agent_activity_volatile_agent: uhCAkVgepd3MEWO2j73JcYPV7z_bdlDYPITZlwymTLQ4yPrJjjC_X

p5

0

<

mean

0.31

SD

0.46

<

p95

1

get_agent_activity_volatile_agent: uhCAkYziRAg5FyyFXU2EUk0fIYQyyIPgVa7U1dDX1iAtHknPOvYYT

p5

0

<

mean

0.22

SD

0.41

<

p95

1

get_agent_activity_volatile_agent: uhCAkabSQF6DGxrXHjwSiOiRtGhm0jOiKd9gpFovBP4qstPOEXryf

p5

0

<

mean

0.22

SD

0.42

<

p95

1

get_agent_activity_volatile_agent: uhCAkdF0MmSOc2fN3Pl59s0JJkgum7JwJtfrec7pjvslDj3c0LTFs

p5

0

≤

mean

0

SD

0

≤

p95

0

get_agent_activity_volatile_agent: uhCAkdZyppTVL1vRAusVl8vwzmj3tqTfAQJP4KRbBschU1YOJGWyt

p5

0

<

mean

0.3

SD

0.46

<

p95

1

get_agent_activity_volatile_agent: uhCAke6MKXvfOnguBWt37zg_l_7nDEIWulsE4LeNWhIuu_f0jfkjT

p5

0

<

mean

0.26

SD

0.44

<

p95

1

get_agent_activity_volatile_agent: uhCAkfWwAdKSV7hHOZcUnlsBzkNbrqXSCiVgEbWB8ymR1whfQiPhc

p5

0

≤

mean

0

SD

0

≤

p95

0

get_agent_activity_volatile_agent: uhCAkizrk73dAeEweTGdZw_klIoLMXEsN5vMvtjoDd6ZsVTR8Fowb

p5

0

<

mean

0.22

SD

0.41

<

p95

1

get_agent_activity_volatile_agent: uhCAkxvmdJtA6IItRZY1g8xZpxaT25lrcxbcCtI2ruOLC9wtNgQZ7

p5

0

<

mean

0.36

SD

0.48

<

p95

1

Error count

The number of errors accumulated.

152

Holochain MetricsClick to toggle visibility.

Cascade duration

Time taken to execute a cascade (get) query inside Holochain.

mean

0.044744

s

SD

8.275612

s

p50

0.178947

s

<

p95

0.652607

s

<

p99

1.220972

s

Cascade fetch errors

Count of network fetch errors during cascade calls.

total

0

over 1963.575962436s

Not enough time data to show a trend.

WASM usage: 'agent_activity::announce_write_behaviour'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 1828.190458142s

Not enough time data to show a trend.

WASM usage: 'agent_activity::create_sample_entry'

Metered usage count of the WASM ribosome for this zome function.

total

250416096

over 1828.190458142s

mean rate

3.6751658044e+08

/s

std

4.4759801927e+08

/s

p5

767650.95

/s

p95

1.34446400457e+09

/s

peak

1.40061079482e+09

/s

WASM usage: 'agent_activity::get_agent_activity_full'

Metered usage count of the WASM ribosome for this zome function.

total

17053089

over 2816.652773922s

mean rate

1.5760958882e+08

/s

std

7.1877859703e+08

/s

p5

372857.87

/s

p95

5.0938131099e+08

/s

peak

1.71618093559e+10

/s

WASM usage: 'agent_activity::get_random_agent_with_write_behaviour'

Metered usage count of the WASM ribosome for this zome function.

total

120594438

over 38344.899129006s

mean rate

1.103838803e+07

/s

std

3.350622936e+07

/s

p5

0

/s

p95

6.262427607e+07

/s

peak

2.1518674324e+08

/s

WASM usage: 'agent_activity_integrity::entry_defs'

Metered usage count of the WASM ribosome for this zome function.

total

8909246

over 38345.419014064s

mean rate

4.146139569e+07

/s

std

5.393543154e+07

/s

p5

12793.55

/s

p95

1.642698239e+08

/s

peak

1.9840709707e+08

/s

Zome call duration: 'agent_activity::announce_write_behaviour'

Duration of this zome call as measured by Holochain internally.

mean

0.027952

s

SD

0.015701

s

p50

0.02225

s

<

p95

0.071157

s

≤

p99

0.071157

s

Zome call duration: 'agent_activity::create_sample_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.049989

s

SD

0.025193

s

p50

0.035836

s

<

p95

0.095194

s

<

p99

0.101232

s

Zome call duration: 'agent_activity::get_agent_activity_full'

Duration of this zome call as measured by Holochain internally.

mean

0.048778

s

SD

0.234559

s

p50

0.185589

s

<

p95

0.650042

s

<

p99

0.933948

s

Zome call duration: 'agent_activity::get_random_agent_with_write_behaviour'

Duration of this zome call as measured by Holochain internally.

mean

0.008604

s

SD

0.197467

s

p50

0.009635

s

<

p95

0.403412

s

<

p99

0.811175

s

WASM call duration: 'agent_activity::announce_write_behaviour'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.008596

s

SD

0.004467

s

p50

0.006416

s

<

p95

0.019129

s

≤

p99

0.019129

s

WASM call duration: 'agent_activity::create_sample_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.026812

s

SD

0.014205

s

p50

0.019382

s

<

p95

0.05243

s

<

p99

0.055909

s

WASM call duration: 'agent_activity::get_agent_activity_full'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.050626

s

SD

8.458803

s

p50

0.185864

s

<

p95

0.65917

s

<

p99

1.222713

s

WASM call duration: 'agent_activity::get_random_agent_with_write_behaviour'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.005452

s

SD

0.187452

s

p50

0.005842

s

<

p95

0.393336

s

<

p99

0.696848

s

WASM call duration: 'agent_activity_integrity::entry_defs'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001518

s

SD

0.000606

s

p50

0.001349

s

<

p95

0.002545

s

<

p99

0.002718

s

Host function call duration: '__hc__agent_info_1'

Duration of this host function call invoked from within WASM.

mean

3.8e-05

s

SD

1.8e-05

s

p50

2.8e-05

s

<

p95

7.5e-05

s

≤

p99

7.5e-05

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.000729

s

SD

0.00039

s

p50

0.000572

s

<

p95

0.001577

s

<

p99

0.001834

s

Host function call duration: '__hc__create_link_1'

Duration of this host function call invoked from within WASM.

mean

0.000508

s

SD

0.000396

s

p50

0.000347

s

<

p95

0.001595

s

≤

p99

0.001595

s

Host function call duration: '__hc__get_agent_activity_1'

Duration of this host function call invoked from within WASM.

mean

0.048834

s

SD

8.458881

s

p50

0.183796

s

<

p95

0.657336

s

<

p99

1.221015

s

Host function call duration: '__hc__get_links_1'

Duration of this host function call invoked from within WASM.

mean

0.00047

s

SD

0.184401

s

p50

0.000317

s

<

p95

0.387603

s

<

p99

0.638028

s

Host function call duration: '__hc__random_bytes_1'

Duration of this host function call invoked from within WASM.

mean

9e-06

s

SD

6e-06

s

p50

9e-06

s

<

p95

2.8e-05

s

<

p99

3.2e-05

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.024278

s

SD

0.012221

s

p50

0.007927

s

<

p95

0.041665

s

<

p99

0.050947

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.019318

s

SD

0.012508

s

p50

0.013265

s

<

p95

0.041571

s

<

p99

0.04432

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

5.78

s

<

mean

374.46

s

SD

523.73

s

<

p95

1577.82

s

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

131.30913

s

SD

98.64075

s

p50

15.496491

s

<

p95

216.886135

s

<

p99

441.04494

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

1.341471

s

SD

4.544925

s

p50

0.060509

s

<

p95

14.841629

s

<

p99

19.99632

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.002562

s

SD

0.002102

s

p50

0.001975

s

<

p95

0.007009

s

<

p99

0.01104

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.096148

s

SD

0.154966

s

p50

0.030732

s

<

p95

0.224641

s

<

p99

1.018343

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.268982

s

SD

0.219273

s

p50

0.081538

s

<

p95

0.56331

s

<

p99

1.146737

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

8.478609

s

SD

43.041298

s

p50

16.35976

s

<

p95

94.158352

s

<

p99

190.123763

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

71.884396

s

SD

66.532262

s

p50

36.599486

s

<

p95

157.696877

s

<

p99

276.368294

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.003371

s

SD

0.001612

s

p50

0.000298

s

<

p95

0.005081

s

<

p99

0.00654

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.003203

s

SD

0.026905

s

p50

0.000581

s

<

p95

0.036427

s

<

p99

0.118376

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000582

s

SD

0.000309

s

p50

0.000459

s

<

p95

0.001131

s

<

p99

0.001619

s

P2P request roundtrip: 'get'

Time spent sending a get request and awaiting its response.

mean

5.433138

s

SD

28.581184

s

p50

0.350578

s

<

p95

60.004506

s

<

p99

60.08134

s

P2P request roundtrip: 'get_links'

Time spent sending a get_links request and awaiting its response.

mean

0.365345

s

SD

0.219878

s

p50

0.380428

s

<

p95

0.585219

s

<

p99

1.036415

s

P2P request roundtrip: 'get_agent_activity'

Time spent sending a get_agent_activity request and awaiting its response.

mean

0.073642

s

SD

12.037944

s

p50

0.192626

s

<

p95

1.177158

s

<

p99

60.001836

s

P2P request roundtrip: 'send_validation_receipts'

Time spent sending a send_validation_receipts request and awaiting its response.

mean

0.352334

s

SD

23.654078

s

p50

0.354151

s

<

p95

60.001454

s

<

p99

60.00334

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

26.70

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

110

B/s

<

mean

169.27

KiB/s

SD

293.13

KiB/s

<

p95

605.71

KiB/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

149

B/s

<

mean

165.56

KiB/s

SD

267.60

KiB/s

<

p95

698.78

KiB/s

Total bytes received

Total bytes received on primary network interface

count

8.16

GiB

mean

4.57

MiB/s

Total bytes sent

Total bytes sent on primary network interface

count

7.98

GiB

mean

4.47

MiB/s

CPU spike anomaly

CPU spike anomaly was detected

Detected

Warning CPU p99 reached 98.8%

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 445.81 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

Detected

Warning 25% of hosts overloaded (load5/ncpus > 1.0)

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

1

%

<

mean

33.13

%

SD

34.96

%

<

p95

98.17

%

System

6.43

%

CPU percentiles

CPU usage percentiles

p50

17.75

%

p95

98.17

%

p99

98.75

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

10

hosts

mean time

0.54

s

Memory used percentage

Percentage of memory used

p5

5.31

%

<

mean

11.49

%

SD

3.98

%

<

p95

18.35

%

Memory available percentage

Percentage of available memory

p5

81.65

%

<

mean

88.51

%

SD

3.98

%

<

p95

94.69

%

Max host memory used

Maximum memory usage percentage across all hosts

max

23.34

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

445.81

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.00

MiB/s

Disk write throughput

Disk write throughput in MiB/s

65.59

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /

0/5

hosts

Mount Point /efi-boot

0/4

hosts

Mount Point /etc/hostname

0/6

hosts

Mount Point /etc/hosts

0/6

hosts

Mount Point /etc/nomad.d/client-meta.json

0/17

hosts

Mount Point /etc/resolv.conf

0/6

hosts

Mount Point /nix/store

0/5

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

2.81

5 min

2.91

15 min

2.93

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

25.00

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

0

%

<

mean

17.0617

%

SD

30.6623

%

<

p95

93.51

%

60 second average

16.9413

%

300 second average

17.4543

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

6.0171

%

SD

13.6121

%

<

p95

45.46

%

60 second average

6.1462

%

300 second average

7.0272

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

4.4423

%

SD

10.7668

%

<

p95

35

%

60 second average

4.5563

%

300 second average

5.1877

%

Holochain process CPU usage

CPU usage by Holochain process

p5

0

%

<

mean

28.96

%

SD

34.81

%

<

p95

97.11

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

51.52

KiB

<

mean

253.62

KiB

SD

157.96

KiB

<

p95

531.00

KiB

Holochain process threads

Number of threads in Holochain process

p5

5

threads

<

mean

32.04

threads

SD

12.31

threads

<

p95

54

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

11

file descriptors

<

mean

83.1

file descriptors

SD

25.63

file descriptors

<

p95

112

file descriptors

Write/Query

↑ Back to index

Creates an entry, then queries the source chain and performs a simple operation on the entries, then repeats.

Started

Thu, 16 Jul 2026 03:36:20 UTC

Peer count

1

Behaviours

default (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

write_query_29468960194_1

Write timing

The time it takes to complete the zome function call that writes the entry.

mean

0.021289

s

SD

0.007268

s

p50

0.018735

s

<

p95

0.036779

s

<

p99

0.049955

s

Write rate

The number of writes completed per second.

mean

103.82

/s

Query timing

The time it takes to complete the chain_query_count_len zome call that queries the source chain.

mean

0.071825

s

SD

0.038227

s

p50

0.067344

s

<

p95

0.14247

s

<

p99

0.180209

s

Query rate

The number of chain queries completed per second.

mean

103.82

/s

Error count

The number of errors accumulated during the run.

0

Holochain MetricsClick to toggle visibility.

WASM usage: 'crud::chain_query_count_len'

Metered usage count of the WASM ribosome for this zome function.

total

131137273863

over 290.006776513s

mean rate

4.5218598397e+08

/s

std

1.1506714748e+08

/s

p5

2.0697377798e+08

/s

p95

6.0934703413e+08

/s

peak

6.1430091995e+08

/s

WASM usage: 'crud::create_sample_entry'

Metered usage count of the WASM ribosome for this zome function.

total

109827872

over 290.006776513s

mean rate

378708.09

/s

std

155512.79

/s

p5

196502.94

/s

p95

710982.75

/s

peak

814593.6

/s

WASM usage: 'crud::init'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 290.006776513s

Not enough time data to show a trend.

WASM usage: 'crud_integrity::entry_defs'

Metered usage count of the WASM ribosome for this zome function.

total

27063496

over 290.006776513s

mean rate

93320.26

/s

std

38306.93

/s

p5

48421.74

/s

p95

175198.5

/s

peak

200730.02

/s

Zome call duration: 'crud::chain_query_count_len'

Duration of this zome call as measured by Holochain internally.

mean

0.047443

s

SD

0.014371

s

p50

0.043615

s

<

p95

0.061103

s

<

p99

0.062379

s

Zome call duration: 'crud::create_sample_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.008073

s

SD

0.000485

s

p50

0.008139

s

<

p95

0.009166

s

<

p99

0.010181

s

WASM call duration: 'crud::chain_query_count_len'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.040991

s

SD

0.012746

s

p50

0.038313

s

<

p95

0.052295

s

<

p99

0.053401

s

WASM call duration: 'crud::create_sample_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.005385

s

SD

0.000247

s

p50

0.005452

s

<

p95

0.006046

s

<

p99

0.006122

s

WASM call duration: 'crud::init'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.003114

s

SD

0

s

p50

0.003114

s

≤

p95

0.003114

s

≤

p99

0.003114

s

WASM call duration: 'crud_integrity::entry_defs'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001173

s

SD

3.7e-05

s

p50

0.001196

s

<

p95

0.001245

s

<

p99

0.001246

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.000366

s

SD

0.000413

s

p50

0.001199

s

≤

p95

0.001199

s

≤

p99

0.001199

s

Host function call duration: '__hc__query_1'

Duration of this host function call invoked from within WASM.

mean

0.0161

s

SD

0.005812

s

p50

0.015073

s

<

p95

0.020931

s

<

p99

0.021384

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.004358

s

SD

0.000582

s

p50

0.004339

s

<

p95

0.005097

s

<

p99

0.005098

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.003223

s

SD

0.000184

s

p50

0.003263

s

<

p95

0.003651

s

<

p99

0.003999

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

16.68

s

<

mean

151.68

s

SD

86.56

s

<

p95

286.69

s

Integrated ops

Count of DHT ops integrated since the conductor started. Resets on restart.

total

0

over 290.006785617s

Not enough time data to show a trend.

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.001972

s

SD

0

s

p50

0.001972

s

≤

p95

0.001972

s

≤

p99

0.001972

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.001647

s

SD

0

s

p50

0.001647

s

≤

p95

0.001647

s

≤

p99

0.001647

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.002947

s

SD

7.7e-05

s

p50

0.003012

s

<

p95

0.003053

s

<

p99

0.003064

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.029741

s

SD

0.009238

s

p50

0.028044

s

<

p95

0.037642

s

<

p99

0.038336

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

0.00375

s

SD

0

s

p50

0.00375

s

≤

p95

0.00375

s

≤

p99

0.00375

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

0.002124

s

SD

0

s

p50

0.002124

s

≤

p95

0.002124

s

≤

p99

0.002124

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.001987

s

SD

0.000618

s

p50

0.001879

s

<

p95

0.002503

s

<

p99

0.002552

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.000871

s

SD

0.000114

s

p50

0.000825

s

<

p95

0.001052

s

<

p99

0.001058

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000304

s

SD

1.5e-05

s

p50

0.00031

s

<

p95

0.000341

s

<

p99

0.000344

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

50.25

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

0

B/s

≤

mean

0

B/s

SD

0

B/s

≤

p95

0

B/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

0

B/s

≤

mean

0

B/s

SD

0

B/s

≤

p95

0

B/s

Total bytes received

Total bytes received on primary network interface

count

0

B

mean

0

B/s

Total bytes sent

Total bytes sent on primary network interface

count

0

B

mean

0

B/s

CPU spike anomaly

CPU spike anomaly was detected

NotDetected

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 40.67 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

NotDetected

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

45.37

%

<

mean

64.45

%

SD

10

%

<

p95

72.11

%

System

14.20

%

CPU percentiles

CPU usage percentiles

p50

67.86

%

p95

72.11

%

p99

86.56

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

1

hosts

mean time

0.03

s

Memory used percentage

Percentage of memory used

p5

17.23

%

<

mean

19.73

%

SD

1.43

%

<

p95

21.68

%

Memory available percentage

Percentage of available memory

p5

78.32

%

<

mean

80.27

%

SD

1.43

%

<

p95

82.77

%

Max host memory used

Maximum memory usage percentage across all hosts

max

19.73

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

40.67

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.00

MiB/s

Disk write throughput

Disk write throughput in MiB/s

27.12

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /etc/hostname

0/1

hosts

Mount Point /etc/hosts

0/1

hosts

Mount Point /etc/resolv.conf

0/1

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

2.95

5 min

1.79

15 min

0.85

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

0.00

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

4.36

%

<

mean

17.158

%

SD

6.1214

%

<

p95

22.27

%

60 second average

15.0343

%

300 second average

8.5923

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.1063

%

SD

0.1138

%

<

p95

0.31

%

60 second average

0.0677

%

300 second average

0.0187

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.012

%

SD

0.036

%

<

p95

0.08

%

60 second average

0.0047

%

300 second average

0.0000

%

Holochain process CPU usage

CPU usage by Holochain process

p5

24.89

%

<

mean

32.2

%

SD

7.28

%

<

p95

36.41

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

134.99

KiB

<

mean

253.99

KiB

SD

73.28

KiB

<

p95

397.31

KiB

Holochain process threads

Number of threads in Holochain process

p5

9

threads

<

mean

29.19

threads

SD

7.01

threads

<

p95

35

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

8

file descriptors

<

mean

69.47

file descriptors

SD

18.28

file descriptors

<

p95

83

file descriptors

Write/Read

↑ Back to index

Creates an entry and reads it back, then repeats.

Started

Thu, 16 Jul 2026 03:38:19 UTC

Peer count

1

Behaviours

default (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

write_read_29468960194_1

Write timing

The time taken to write the entry.

mean

0.033284

s

SD

0.022281

s

p50

0.029483

s

<

p95

0.058326

s

<

p99

0.08186

s

Write rate

The number of writes completed per second.

mean

173.82

/s

Read timing

The time taken to read the entry.

mean

0.023669

s

SD

0.015656

s

p50

0.022425

s

<

p95

0.044488

s

<

p99

0.055879

s

Read rate

The number of reads completed per second.

mean

173.82

/s

Error count

The number of errors accumulated over the run.

0

Holochain MetricsClick to toggle visibility.

Cascade duration

Time taken to execute a cascade (get) query inside Holochain.

mean

0.001038

s

SD

8.2e-05

s

p50

0.001002

s

<

p95

0.001091

s

<

p99

0.001092

s

WASM usage: 'crud::create_sample_entry'

Metered usage count of the WASM ribosome for this zome function.

total

180426400

over 290.008820967s

mean rate

622142.85

/s

std

249986.19

/s

p5

432306.35

/s

p95

1.18616274e+06

/s

peak

1.35765656e+06

/s

WASM usage: 'crud::get_sample_entry'

Metered usage count of the WASM ribosome for this zome function.

total

195064869

over 290.008820967s

mean rate

672618.97

/s

std

269559.89

/s

p5

467577.65

/s

p95

1.28294018e+06

/s

peak

1.4601979e+06

/s

WASM usage: 'crud::init'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 290.008820967s

Not enough time data to show a trend.

WASM usage: 'crud_integrity::entry_defs'

Metered usage count of the WASM ribosome for this zome function.

total

22230100

over 290.008820967s

mean rate

76653.41

/s

std

30800.04

/s

p5

53263.9

/s

p95

146145.55

/s

peak

167275.08

/s

Zome call duration: 'crud::create_sample_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.013197

s

SD

0.002697

s

p50

0.012704

s

<

p95

0.015445

s

<

p99

0.015566

s

Zome call duration: 'crud::get_sample_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.009871

s

SD

0.002377

s

p50

0.00949

s

<

p95

0.011825

s

<

p99

0.011921

s

WASM call duration: 'crud::create_sample_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.006261

s

SD

0.000478

s

p50

0.006219

s

<

p95

0.006571

s

<

p99

0.006598

s

WASM call duration: 'crud::get_sample_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.002383

s

SD

0.000115

s

p50

0.00235

s

<

p95

0.002438

s

<

p99

0.00244

s

WASM call duration: 'crud::init'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001278

s

SD

0

s

p50

0.001278

s

≤

p95

0.001278

s

≤

p99

0.001278

s

WASM call duration: 'crud_integrity::entry_defs'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001066

s

SD

4.3e-05

s

p50

0.00107

s

<

p95

0.001077

s

<

p99

0.001078

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.000355

s

SD

3.5e-05

s

p50

0.000305

s

<

p95

0.000359

s

≤

p99

0.000359

s

Host function call duration: '__hc__get_1'

Duration of this host function call invoked from within WASM.

mean

0.001097

s

SD

8.5e-05

s

p50

0.001062

s

<

p95

0.001151

s

<

p99

0.001152

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.004675

s

SD

0.000432

s

p50

0.004631

s

<

p95

0.004981

s

<

p99

0.005007

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.004947

s

SD

0.001048

s

p50

0.004639

s

<

p95

0.005964

s

<

p99

0.006038

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

16.86

s

<

mean

151.86

s

SD

86.56

s

<

p95

286.87

s

Integrated ops

Count of DHT ops integrated since the conductor started. Resets on restart.

total

0

over 290.008793709s

Not enough time data to show a trend.

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.000965

s

SD

0

s

p50

0.000965

s

≤

p95

0.000965

s

≤

p99

0.000965

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.001772

s

SD

0

s

p50

0.001772

s

≤

p95

0.001772

s

≤

p99

0.001772

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.002963

s

SD

0.00023

s

p50

0.002893

s

<

p95

0.003113

s

<

p99

0.003116

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.042806

s

SD

0.01507

s

p50

0.039355

s

<

p95

0.056034

s

<

p99

0.057178

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

0.002262

s

SD

0

s

p50

0.002262

s

≤

p95

0.002262

s

≤

p99

0.002262

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

0.000752

s

SD

0

s

p50

0.000752

s

≤

p95

0.000752

s

≤

p99

0.000752

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.001134

s

SD

0.000342

s

p50

0.001032

s

<

p95

0.001449

s

<

p99

0.001479

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.000821

s

SD

0.000198

s

p50

0.000775

s

<

p95

0.001028

s

<

p99

0.001033

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000311

s

SD

1e-05

s

p50

0.000311

s

<

p95

0.000315

s

≤

p99

0.000315

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

71.40

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

15.84

KiB/s

<

mean

221.79

KiB/s

SD

1.07

MiB/s

≤

p95

24.91

KiB/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

12.75

KiB/s

<

mean

19.77

KiB/s

SD

30.00

KiB/s

<

p95

19.80

KiB/s

Total bytes received

Total bytes received on primary network interface

count

64.98

MiB

mean

221.79

KiB/s

Total bytes sent

Total bytes sent on primary network interface

count

5.79

MiB

mean

19.77

KiB/s

CPU spike anomaly

CPU spike anomaly was detected

Detected

Warning CPU p99 reached 91.2%

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 97.39 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

NotDetected

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

65.71

%

<

mean

83.63

%

SD

10.43

%

<

p95

91.03

%

System

12.24

%

CPU percentiles

CPU usage percentiles

p50

86.72

%

p95

91.03

%

p99

91.15

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

1

hosts

mean time

0.80

s

Memory used percentage

Percentage of memory used

p5

21.13

%

<

mean

21.64

%

SD

0.63

%

<

p95

21.98

%

Memory available percentage

Percentage of available memory

p5

78.02

%

<

mean

78.36

%

SD

0.63

%

<

p95

78.87

%

Max host memory used

Maximum memory usage percentage across all hosts

max

21.64

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

97.39

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.00

MiB/s

Disk write throughput

Disk write throughput in MiB/s

2.80

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /etc/nomad.d/client-meta.json

0/1

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

2.80

5 min

1.45

15 min

0.63

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

0.00

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

8.63

%

<

mean

34.2839

%

SD

8.7775

%

<

p95

45.35

%

60 second average

29.5210

%

300 second average

16.1855

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

2.9765

%

SD

2.6171

%

<

p95

9.08

%

60 second average

2.3994

%

300 second average

1.0958

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

1.1065

%

SD

1.1118

%

<

p95

2.63

%

60 second average

0.8903

%

300 second average

0.4335

%

Holochain process CPU usage

CPU usage by Holochain process

p5

54.66

%

<

mean

72.77

%

SD

14.65

%

<

p95

81.65

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

1.75

KiB

<

mean

246.44

KiB

SD

65.25

KiB

<

p95

281.35

KiB

Holochain process threads

Number of threads in Holochain process

p5

1

threads

<

mean

26.6

threads

SD

10.08

threads

<

p95

32

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

6

file descriptors

<

mean

68.74

file descriptors

SD

24.8

file descriptors

<

p95

81

file descriptors

Write validated

↑ Back to index

Creates an entry, updates it and links the create to the update, then repeats. Each of the three actions is validated by the included hApp.

Started

Thu, 16 Jul 2026 03:40:21 UTC

Peer count

1

Behaviours

default (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

write_validated_29468960194_1

Write timing

The time it takes to complete the zome function call that writes the entry, updates it, and links to the update.

mean

0.078933

s

SD

0.031059

s

p50

0.073365

s

<

p95

0.130914

s

<

p99

0.168938

s

Write rate

The number of write zome function calls that complete per second.

mean

42.14

/s

Read timing

The time it takes to complete the zome function call that reads the data.

mean

0.158513

s

SD

0.045323

s

p50

0.155373

s

<

p95

0.229985

s

<

p99

0.268561

s

Read rate

The number of read zome function calls that complete per second.

mean

42.11

/s

Error count

The number of errors accumulated over the run.

0

Holochain MetricsClick to toggle visibility.

Cascade duration

Time taken to execute a cascade (get) query inside Holochain.

mean

0.005814

s

SD

0.001893

s

p50

0.005282

s

<

p95

0.007634

s

<

p99

0.007899

s

WASM usage: 'validated::create_sample_entry'

Metered usage count of the WASM ribosome for this zome function.

total

39992120

over 280.004664666s

mean rate

142826.89

/s

std

41856.2

/s

p5

92685.4

/s

p95

209399.17

/s

peak

216263.3

/s

WASM usage: 'validated::update_sample_entry'

Metered usage count of the WASM ribosome for this zome function.

total

47045030

over 280.004664666s

mean rate

168015.49

/s

std

49509.16

/s

p5

109030.16

/s

p95

246328.28

/s

peak

258441.1

/s

WASM usage: 'validated_integrity::entry_defs'

Metered usage count of the WASM ribosome for this zome function.

total

73699468

over 290.004768914s

mean rate

254132.39

/s

std

73312

/s

p5

164276.93

/s

p95

371145.5

/s

peak

388526.83

/s

WASM usage: 'validated_integrity::validate'

Metered usage count of the WASM ribosome for this zome function.

total

730473106

over 280.004664666s

mean rate

2.60879403e+06

/s

std

766904.76

/s

p5

1.69272143e+06

/s

p95

3.82431026e+06

/s

peak

4.00613458e+06

/s

Zome call duration: 'validated::create_sample_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.016763

s

SD

0.002665

s

p50

0.015015

s

<

p95

0.020554

s

<

p99

0.02091

s

Zome call duration: 'validated::update_sample_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.026697

s

SD

0.005161

s

p50

0.02552

s

<

p95

0.032252

s

<

p99

0.032783

s

WASM call duration: 'validated::create_sample_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.009069

s

SD

0.000262

s

p50

0.009016

s

<

p95

0.009589

s

<

p99

0.009681

s

WASM call duration: 'validated::update_sample_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.015065

s

SD

0.002103

s

p50

0.014122

s

<

p95

0.017599

s

<

p99

0.01795

s

WASM call duration: 'validated_integrity::entry_defs'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001115

s

SD

6e-05

s

p50

0.001111

s

<

p95

0.001132

s

<

p99

0.001134

s

WASM call duration: 'validated_integrity::validate'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.008056

s

SD

0.000755

s

p50

0.007679

s

<

p95

0.008872

s

<

p99

0.008938

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.000437

s

SD

1.8e-05

s

p50

0.000434

s

<

p95

0.000448

s

≤

p99

0.000448

s

Host function call duration: '__hc__create_link_1'

Duration of this host function call invoked from within WASM.

mean

0.000441

s

SD

1.7e-05

s

p50

0.000435

s

<

p95

0.00046

s

<

p99

0.000461

s

Host function call duration: '__hc__must_get_valid_record_1'

Duration of this host function call invoked from within WASM.

mean

0.005743

s

SD

0.001874

s

p50

0.005151

s

<

p95

0.007258

s

<

p99

0.007414

s

Host function call duration: '__hc__update_1'

Duration of this host function call invoked from within WASM.

mean

0.006586

s

SD

0.001906

s

p50

0.005923

s

<

p95

0.008253

s

<

p99

0.008415

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.005486

s

SD

0.000924

s

p50

0.006461

s

<

p95

0.007479

s

<

p99

0.007969

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.00557

s

SD

0.00129

s

p50

0.004608

s

<

p95

0.007661

s

<

p99

0.007924

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

16.8

s

<

mean

151.81

s

SD

86.56

s

<

p95

286.81

s

Integrated ops

Count of DHT ops integrated since the conductor started. Resets on restart.

total

0

over 290.004753521s

Not enough time data to show a trend.

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.004454

s

SD

0

s

p50

0.004454

s

≤

p95

0.004454

s

≤

p99

0.004454

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.007762

s

SD

0

s

p50

0.007762

s

≤

p95

0.007762

s

≤

p99

0.007762

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.003308

s

SD

0.000539

s

p50

0.003245

s

<

p95

0.003521

s

<

p99

0.006055

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.04039

s

SD

0.015096

s

p50

0.035184

s

<

p95

0.054268

s

<

p99

0.055535

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

0.004352

s

SD

0

s

p50

0.004352

s

≤

p95

0.004352

s

≤

p99

0.004352

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

0.004715

s

SD

0

s

p50

0.004715

s

≤

p95

0.004715

s

≤

p99

0.004715

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.001321

s

SD

0.000468

s

p50

0.001088

s

<

p95

0.001807

s

<

p99

0.001856

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.001145

s

SD

0.000525

s

p50

0.001048

s

<

p95

0.001287

s

<

p99

0.001322

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000349

s

SD

2.1e-05

s

p50

0.00035

s

<

p95

0.000367

s

<

p99

0.000436

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

52.85

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

0

B/s

≤

mean

0

B/s

SD

0

B/s

≤

p95

0

B/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

0

B/s

≤

mean

0

B/s

SD

0

B/s

≤

p95

0

B/s

Total bytes received

Total bytes received on primary network interface

count

0

B

mean

0

B/s

Total bytes sent

Total bytes sent on primary network interface

count

0

B

mean

0

B/s

CPU spike anomaly

CPU spike anomaly was detected

NotDetected

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 88.06 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

NotDetected

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

48.07

%

<

mean

67.43

%

SD

9.52

%

<

p95

79.52

%

System

14.58

%

CPU percentiles

CPU usage percentiles

p50

70.40

%

p95

79.52

%

p99

86.56

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

1

hosts

mean time

0.03

s

Memory used percentage

Percentage of memory used

p5

18.61

%

<

mean

21.01

%

SD

1.12

%

<

p95

22.04

%

Memory available percentage

Percentage of available memory

p5

77.96

%

<

mean

78.99

%

SD

1.12

%

<

p95

81.39

%

Max host memory used

Maximum memory usage percentage across all hosts

max

21.01

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

88.06

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.00

MiB/s

Disk write throughput

Disk write throughput in MiB/s

28.37

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /etc/hostname

0/1

hosts

Mount Point /etc/hosts

0/1

hosts

Mount Point /etc/resolv.conf

0/1

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

3.42

5 min

2.60

15 min

1.40

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

0.00

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

6.95

%

<

mean

19.8073

%

SD

6.1079

%

<

p95

27.45

%

60 second average

17.6857

%

300 second average

13.1720

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.1117

%

SD

0.0973

%

<

p95

0.3

%

60 second average

0.1043

%

300 second average

0.0517

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.0123

%

SD

0.0289

%

<

p95

0.08

%

60 second average

0.0107

%

300 second average

0.0000

%

Holochain process CPU usage

CPU usage by Holochain process

p5

20.98

%

<

mean

26.54

%

SD

7.6

%

<

p95

38.33

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

135.45

KiB

<

mean

260.82

KiB

SD

104.58

KiB

<

p95

410.25

KiB

Holochain process threads

Number of threads in Holochain process

p5

9

threads

<

mean

28.03

threads

SD

6.67

threads

<

p95

35

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

11

file descriptors

<

mean

68.65

file descriptors

SD

17.85

file descriptors

<

p95

83

file descriptors

Write Validated `must_get_agent_activity`

↑ Back to index

A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.

The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.

This test is similar to Mixed-Arc must_get_agent_activity, but all agents are full-arc.

Started

Thu, 16 Jul 2026 05:19:56 UTC

Peer count

30

Peer count at end

28

Behaviours

must_get_agent_activity (1 agent)
write (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

write_validated_must_get_agent_activity_29468960194_1

Highest observed action_seq

The maximum chain length observed per write agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.

Mean max (across write agents)

Mean of the highest chain head value observed per write agent. Each write agent contributes its maximum — the value seen by any reader.

1447.38

Max

Highest chain head value observed for any single write agent.

1820

Write agents observed

8

Chain batch delay timing

The time between a write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.

Mean

mean

178.820001

s

SD

69.099168

s

Max

Highest per-partition mean latency

max mean

1051.174448

s

Min

Lowest per-partition mean latency

min mean

7.983435

s

Chain batch delay rate

The rate at which a must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.

Mean

mean

2.66

/s

Max

Highest per-partition mean rate

max

6.21

/s

Min

Lowest per-partition mean rate

min

1.19

/s

create_validated_sample_entry zome call timing

The time taken to complete the zome function call that creates the entry that depends on a write agent's source chain.

Mean

mean

0.580616

s

SD

0.489344

s

Max

Highest per-partition mean latency

max mean

3.311461

s

Min

Lowest per-partition mean latency

min mean

0.095628

s

Retrieval errors

A running accumulation of the errors encountered by an agent when attempting to self-validate actions that depend on must_get_agent_activity calls.

Total

4481

Agents affected

18 / 18

Mean per agent

Total count divided by number of partitions, rounded to nearest whole number

249

Max

Highest count in any single partition

785

Min

Lowest count in any single partition

10

Final error count

The total number of all types of error accumulated over the run by all agents.

61363

Holochain MetricsClick to toggle visibility.

Cascade duration

Time taken to execute a cascade (get) query inside Holochain.

mean

0.015859

s

SD

0.090449

s

p50

0.00128

s

<

p95

0.143654

s

<

p99

0.664783

s

Cascade fetch errors

Count of network fetch errors during cascade calls.

total

0

over 470.005140046s

Not enough time data to show a trend.

WASM usage: 'validated_must_get_agent_activity::announce_write_behaviour'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 907.500413819s

Not enough time data to show a trend.

WASM usage: 'validated_must_get_agent_activity::create_sample_entries_batch'

Metered usage count of the WASM ribosome for this zome function.

total

1002608617

over 907.500413819s

mean rate

5.76099497138e+09

/s

std

1.28840591757e+10

/s

p5

98486.93

/s

p95

3.8074935338e+10

/s

peak

5.42913406534e+10

/s

WASM usage: 'validated_must_get_agent_activity::create_validated_sample_entry'

Metered usage count of the WASM ribosome for this zome function.

total

35541550

over 1894.744251936s

mean rate

1.6300126622e+08

/s

std

7.1706483071e+08

/s

p5

39303.44

/s

p95

8.6795973476e+08

/s

peak

9.00634003911e+09

/s

WASM usage: 'validated_must_get_agent_activity::get_chain_top_for_batch'

Metered usage count of the WASM ribosome for this zome function.

total

4490075

over 1894.744251936s

mean rate

4.2099319707e+08

/s

std

2.24159267911e+09

/s

p5

0

/s

p95

6.1164661956e+08

/s

peak

3.66030557886e+10

/s

WASM usage: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'

Metered usage count of the WASM ribosome for this zome function.

total

50099840

over 37470.258537327s

mean rate

8.03538055e+06

/s

std

6.491892478e+07

/s

p5

0

/s

p95

4.40651901e+06

/s

peak

6.3456203446e+08

/s

WASM usage: 'validated_must_get_agent_activity_integrity::entry_defs'

Metered usage count of the WASM ribosome for this zome function.

total

4405996

over 37470.258537327s

mean rate

1.00497318345e+09

/s

std

3.88337010255e+09

/s

p5

5937.91

/s

p95

5.20863439643e+09

/s

peak

4.28397911021e+10

/s

WASM usage: 'validated_must_get_agent_activity_integrity::validate'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 37470.258537327s

Not enough time data to show a trend.

Zome call duration: 'validated_must_get_agent_activity::announce_write_behaviour'

Duration of this zome call as measured by Holochain internally.

mean

0.053568

s

SD

0.012273

s

p50

0.057713

s

<

p95

0.07256

s

≤

p99

0.07256

s

Zome call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'

Duration of this zome call as measured by Holochain internally.

mean

0.271881

s

SD

0.140238

s

p50

0.225859

s

<

p95

0.620969

s

<

p99

0.731839

s

Zome call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.029749

s

SD

0.011378

s

p50

0.023962

s

<

p95

0.046595

s

<

p99

0.05303

s

Zome call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'

Duration of this zome call as measured by Holochain internally.

mean

0.044342

s

SD

0.036126

s

p50

0.035773

s

<

p95

0.171217

s

<

p99

0.174534

s

Zome call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'

Duration of this zome call as measured by Holochain internally.

mean

0.026378

s

SD

0.155761

s

p50

0.041859

s

<

p95

0.713966

s

≤

p99

0.713966

s

WASM call duration: 'validated_must_get_agent_activity::announce_write_behaviour'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.026167

s

SD

0.011463

s

p50

0.029754

s

<

p95

0.043434

s

≤

p99

0.043434

s

WASM call duration: 'validated_must_get_agent_activity::create_sample_entries_batch'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.245954

s

SD

0.130249

s

p50

0.199185

s

<

p95

0.569268

s

<

p99

0.671429

s

WASM call duration: 'validated_must_get_agent_activity::create_validated_sample_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.017092

s

SD

0.00591

s

p50

0.01415

s

<

p95

0.026358

s

<

p99

0.029459

s

WASM call duration: 'validated_must_get_agent_activity::get_chain_top_for_batch'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.017263

s

SD

0.036181

s

p50

0.017374

s

<

p95

0.165553

s

<

p99

0.170986

s

WASM call duration: 'validated_must_get_agent_activity::get_random_agent_with_write_behaviour'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.015996

s

SD

0.154984

s

p50

0.019242

s

<

p95

0.692208

s

≤

p99

0.692208

s

WASM call duration: 'validated_must_get_agent_activity_integrity::entry_defs'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001088

s

SD

0.000336

s

p50

0.001117

s

<

p95

0.001886

s

<

p99

0.002294

s

WASM call duration: 'validated_must_get_agent_activity_integrity::validate'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.010644

s

SD

0.006368

s

p50

0.009558

s

<

p95

0.022472

s

<

p99

0.029502

s

Host function call duration: '__hc__agent_info_1'

Duration of this host function call invoked from within WASM.

mean

4.1e-05

s

SD

2.6e-05

s

p50

2.7e-05

s

<

p95

9.8e-05

s

<

p99

0.00016

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.000551

s

SD

0.000195

s

p50

0.000459

s

<

p95

0.000744

s

<

p99

0.001357

s

Host function call duration: '__hc__create_link_1'

Duration of this host function call invoked from within WASM.

mean

0.000636

s

SD

0.000365

s

p50

0.000476

s

<

p95

0.001509

s

<

p99

0.001663

s

Host function call duration: '__hc__get_links_1'

Duration of this host function call invoked from within WASM.

mean

0.000895

s

SD

0.116209

s

p50

0.000536

s

<

p95

0.237658

s

<

p99

0.664834

s

Host function call duration: '__hc__must_get_agent_activity_1'

Duration of this host function call invoked from within WASM.

mean

0.019895

s

SD

0.017849

s

p50

0.015714

s

<

p95

0.045151

s

<

p99

0.106201

s

Host function call duration: '__hc__query_1'

Duration of this host function call invoked from within WASM.

mean

0.009759

s

SD

0.005828

s

p50

0.006117

s

<

p95

0.017877

s

<

p99

0.028481

s

Host function call duration: '__hc__random_bytes_1'

Duration of this host function call invoked from within WASM.

mean

1.4e-05

s

SD

4e-06

s

p50

1.5e-05

s

<

p95

2.1e-05

s

≤

p99

2.1e-05

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.00632

s

SD

0.008809

s

p50

0.011084

s

<

p95

0.030075

s

<

p99

0.038048

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.020553

s

SD

0.011814

s

p50

0.018346

s

<

p95

0.041985

s

<

p99

0.0625

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

47.02

s

<

mean

452.35

s

SD

259.9

s

<

p95

857.05

s

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

18.753475

s

SD

16.647829

s

p50

10.527604

s

<

p95

59.450977

s

<

p99

67.878428

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

2.094557

s

SD

5.752886

s

p50

2.884174

s

<

p95

20.166802

s

<

p99

24.286007

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.001365

s

SD

0.000836

s

p50

0.001172

s

<

p95

0.003144

s

<

p99

0.004822

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.015715

s

SD

0.032132

s

p50

0.014805

s

<

p95

0.093004

s

<

p99

0.160086

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.109878

s

SD

0.139214

s

p50

0.06335

s

<

p95

0.214716

s

<

p99

0.725069

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

0.215713

s

SD

2.734562

s

p50

0.291687

s

<

p95

6.365127

s

<

p99

15.946523

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

20.916564

s

SD

24.058868

s

p50

12.042879

s

<

p95

75.088497

s

<

p99

128.733871

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.000397

s

SD

0.000363

s

p50

0.000266

s

<

p95

0.001031

s

<

p99

0.002303

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.001734

s

SD

0.018261

s

p50

0.000383

s

<

p95

0.026769

s

<

p99

0.089708

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000386

s

SD

0.000132

s

p50

0.000358

s

<

p95

0.000559

s

<

p99

0.001001

s

P2P request roundtrip: 'get'

Time spent sending a get request and awaiting its response.

mean

0.528629

s

SD

26.275467

s

p50

0.097557

s

<

p95

60.002071

s

<

p99

60.002297

s

P2P request roundtrip: 'get_links'

Time spent sending a get_links request and awaiting its response.

mean

0.131483

s

SD

0.135938

s

p50

0.233057

s

<

p95

0.476593

s

≤

p99

0.476593

s

P2P request roundtrip: 'must_get_agent_activity'

Time spent sending a must_get_agent_activity request and awaiting its response.

mean

0.14245

s

SD

0.008753

s

p50

0.140374

s

<

p95

0.146352

s

<

p99

0.147488

s

P2P request roundtrip: 'send_validation_receipts'

Time spent sending a send_validation_receipts request and awaiting its response.

mean

0.322272

s

SD

4.54964

s

p50

0.342567

s

<

p95

10.217646

s

<

p99

10.349305

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

33.56

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

116

B/s

<

mean

97.35

KiB/s

SD

320.03

KiB/s

<

p95

145.40

KiB/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

50

B/s

<

mean

69.42

KiB/s

SD

69.02

KiB/s

<

p95

205.61

KiB/s

Total bytes received

Total bytes received on primary network interface

count

2.34

GiB

mean

2.63

MiB/s

Total bytes sent

Total bytes sent on primary network interface

count

1.67

GiB

mean

1.87

MiB/s

CPU spike anomaly

CPU spike anomaly was detected

Detected

Warning CPU p99 reached 97.7%

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 262.29 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

Detected

Warning 32% of hosts overloaded (load5/ncpus > 1.0)

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

1.36

%

<

mean

42.23

%

SD

29.82

%

<

p95

93.38

%

System

8.67

%

CPU percentiles

CPU usage percentiles

p50

41.02

%

p95

93.38

%

p99

97.74

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

8

hosts

mean time

0.54

s

Memory used percentage

Percentage of memory used

p5

7.4

%

<

mean

14.14

%

SD

4.63

%

<

p95

19.58

%

Memory available percentage

Percentage of available memory

p5

80.42

%

<

mean

85.86

%

SD

4.63

%

<

p95

92.6

%

Max host memory used

Maximum memory usage percentage across all hosts

max

30.37

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

262.29

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.02

MiB/s

Disk write throughput

Disk write throughput in MiB/s

107.33

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /

0/5

hosts

Mount Point /efi-boot

0/4

hosts

Mount Point /etc/hostname

0/6

hosts

Mount Point /etc/hosts

0/6

hosts

Mount Point /etc/nomad.d/client-meta.json

0/17

hosts

Mount Point /etc/resolv.conf

0/6

hosts

Mount Point /nix/store

0/5

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

2.49

5 min

2.63

15 min

2.78

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

32.14

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

0

%

<

mean

14.0341

%

SD

19.7216

%

<

p95

56.44

%

60 second average

14.1444

%

300 second average

15.3235

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

8.9164

%

SD

17.6087

%

<

p95

50.25

%

60 second average

8.6963

%

300 second average

7.7307

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

7.5036

%

SD

15.7255

%

<

p95

44.8

%

60 second average

7.3092

%

300 second average

6.3107

%

Holochain process CPU usage

CPU usage by Holochain process

p5

0.28

%

<

mean

33.8

%

SD

28.2

%

<

p95

90.57

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

279.49

KiB

<

mean

470.31

KiB

SD

93.43

KiB

<

p95

629.51

KiB

Holochain process threads

Number of threads in Holochain process

p5

13

threads

<

mean

39.63

threads

SD

12.44

threads

<

p95

57

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

41

file descriptors

<

mean

90.5

file descriptors

SD

24.05

file descriptors

<

p95

113

file descriptors

Zero-Arc Create and Read

↑ Back to index

A zero-arc/full-arc mixed scenario with two types of zero-arc nodes -- ones that create data and ones that read data -- as well as full arc nodes to "relay" the data. The scenario has three roles:

zero_write: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so that zero_read nodes can retrieve them.
zero_read: A zero-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.
full: A full-arc conductor that is just here to serve entries to zero arc nodes.

Started

Thu, 16 Jul 2026 06:38:34 UTC

Peer count

30

Peer count at end

27

Behaviours

full (1 agent)
zero_read (1 agent)
zero_write (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

zero_arc_create_and_read_29468960194_1

Create rate

The number of timed entries created by the zero-arc write node(s) per second.

Mean

mean

203.1

/s

Max

Highest per-partition mean rate

max

295.05

/s

Min

Lowest per-partition mean rate

min

50.83

/s

Fetch lag timing

For each entry, the time lag between when it was created and when a zero-arc read node fetched it from the network via the get_timed_entries_network zome function.

Mean

mean

129.56805

s

SD

14.532566

s

Max

Highest per-partition mean latency

max mean

217.681803

s

Min

Lowest per-partition mean latency

min mean

107.685046

s

Fetch lag rate

The number of entries per second fetched by zero-arc read nodes.

Mean

mean

3.21

/s

Max

Highest per-partition mean rate

max

14.5

/s

Min

Lowest per-partition mean rate

min

0

/s

Delivery ratio

The proportion of created entries successfully fetched by all zero-arc read nodes.

0.0002

Entry created count

Total number of entries created by zero-arc write nodes, by agent.

Total

180399

Agents affected

10 / 10

Mean per agent

Total count divided by number of partitions, rounded to nearest whole number

18040

Max

Highest count in any single partition

26354

Min

Lowest count in any single partition

4569

Received count

Total number of entries fetched by zero-arc read nodes, by agent.

Total

307

Agents affected

7 / 11

Mean per agent

Total count divided by number of partitions, rounded to nearest whole number

28

Max

Highest count in any single partition

169

Min

Lowest count in any single partition

0

Open connections

The number of currently open connections to other conductors.

full-arc

p5

0

<

mean

14.38

SD

11.96

<

p95

25

zero-arc

p5

4

<

mean

10.37

SD

4.16

<

p95

17

Error count

The number of errors accumulated across all nodes.

134

Holochain MetricsClick to toggle visibility.

Cascade duration

Time taken to execute a cascade (get) query inside Holochain.

mean

0.317864

s

SD

0.117326

s

p50

0.268876

s

<

p95

0.4787

s

<

p99

0.55393

s

Cascade fetch errors

Count of network fetch errors during cascade calls.

total

5

over 601.603451031s

mean rate

1.75

/s

std

1.49

/s

p5

0

/s

p95

3.15

/s

peak

3.15

/s

WASM usage: 'timed::created_timed_entry'

Metered usage count of the WASM ribosome for this zome function.

total

308025074

over 1887.715426251s

mean rate

3.19632761821e+10

/s

std

3.1414635933e+11

/s

p5

252030.53

/s

p95

1.4870198845e+09

/s

peak

4.65678995195e+12

/s

WASM usage: 'timed::get_timed_entries_network'

Metered usage count of the WASM ribosome for this zome function.

total

60786093

over 888.334089724s

mean rate

1.0092126555e+08

/s

std

1.6666123387e+08

/s

p5

700493.41

/s

p95

3.969958069e+08

/s

peak

1.42881976651e+09

/s

WASM usage: 'timed_integrity::entry_defs'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 37461.799301503s

Not enough time data to show a trend.

Zome call duration: 'timed::created_timed_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.011269

s

SD

0.006842

s

p50

0.010868

s

<

p95

0.026968

s

<

p99

0.030299

s

Zome call duration: 'timed::get_timed_entries_network'

Duration of this zome call as measured by Holochain internally.

mean

0.571837

s

SD

0.547861

s

p50

0.416051

s

<

p95

1.808175

s

<

p99

2.440935

s

WASM call duration: 'timed::created_timed_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.00887

s

SD

0.005457

s

p50

0.00856

s

<

p95

0.021294

s

<

p99

0.024032

s

WASM call duration: 'timed::get_timed_entries_network'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.567174

s

SD

0.547644

s

p50

0.412796

s

<

p95

1.803697

s

<

p99

2.432534

s

WASM call duration: 'timed_integrity::entry_defs'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001001

s

SD

0.000781

s

p50

0.000967

s

<

p95

0.002948

s

<

p99

0.00336

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.000333

s

SD

0.000178

s

p50

0.000325

s

<

p95

0.000736

s

<

p99

0.000833

s

Host function call duration: '__hc__create_link_1'

Duration of this host function call invoked from within WASM.

mean

0.00035

s

SD

0.000199

s

p50

0.000341

s

<

p95

0.000795

s

<

p99

0.000904

s

Host function call duration: '__hc__get_1'

Duration of this host function call invoked from within WASM.

mean

0.353289

s

SD

0.126953

s

p50

0.30699

s

<

p95

0.505827

s

<

p99

0.580481

s

Host function call duration: '__hc__get_links_1'

Duration of this host function call invoked from within WASM.

mean

0.174703

s

SD

0.085687

s

p50

0.199619

s

<

p95

0.333646

s

<

p99

0.341337

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.003565

s

SD

0.002073

s

p50

0.004711

s

<

p95

0.008389

s

<

p99

0.009074

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.00241

s

SD

0.008634

s

p50

0.013796

s

<

p95

0.024897

s

<

p99

0.035337

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

47.01

s

<

mean

449.13

s

SD

258.06

s

<

p95

848.45

s

Integrated ops

Count of DHT ops integrated since the conductor started. Resets on restart.

total

0

over 37461.799359354s

Not enough time data to show a trend.

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

218.620747

s

SD

82.69729

s

p50

0

s

<

p95

70.481068

s

<

p99

380.766706

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.043204

s

SD

0.024997

s

p50

0.001481

s

<

p95

0.05651

s

<

p99

0.076209

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.001643

s

SD

0.001395

s

p50

0.00116

s

<

p95

0.005268

s

<

p99

0.005997

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.009472

s

SD

0.294853

s

p50

0.001923

s

<

p95

0.989567

s

<

p99

1.068544

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

1.580184

s

SD

3.059386

s

p50

0.009049

s

<

p95

8.833202

s

<

p99

14.154389

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

0.332879

s

SD

0.19064

s

p50

0.004272

s

<

p95

0.398541

s

<

p99

1.034468

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

2.32765

s

SD

0.9524

s

p50

0.002412

s

<

p95

1.676507

s

<

p99

4.835626

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.002289

s

SD

0.001019

s

p50

0.000284

s

<

p95

0.00306

s

<

p99

0.003892

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.001237

s

SD

0.002652

s

p50

0.000189

s

<

p95

0.00344

s

<

p99

0.017878

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.00029

s

SD

0.000252

s

p50

0.000294

s

<

p95

0.000624

s

<

p99

0.001633

s

P2P request roundtrip: 'get'

Time spent sending a get request and awaiting its response.

mean

0.276369

s

SD

29.851763

s

p50

0.150049

s

<

p95

60.002084

s

<

p99

60.002295

s

P2P request roundtrip: 'get_links'

Time spent sending a get_links request and awaiting its response.

mean

0.093915

s

SD

27.752031

s

p50

0.129609

s

<

p95

60.001519

s

≤

p99

60.001519

s

P2P request roundtrip: 'send_validation_receipts'

Time spent sending a send_validation_receipts request and awaiting its response.

mean

0.119289

s

SD

0.181909

s

p50

0.165646

s

<

p95

0.545428

s

≤

p99

0.545428

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

23.04

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

90

B/s

<

mean

154.32

KiB/s

SD

505.52

KiB/s

<

p95

909.19

KiB/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

129

B/s

<

mean

123.67

KiB/s

SD

360.88

KiB/s

<

p95

805.97

KiB/s

Total bytes received

Total bytes received on primary network interface

count

3.70

GiB

mean

4.21

MiB/s

Total bytes sent

Total bytes sent on primary network interface

count

2.96

GiB

mean

3.37

MiB/s

CPU spike anomaly

CPU spike anomaly was detected

Detected

Warning CPU p99 reached 97.2%

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 395.43 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

Detected

Warning 14% of hosts overloaded (load5/ncpus > 1.0)

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

0.93

%

<

mean

30.18

%

SD

30.11

%

<

p95

93.97

%

System

7.14

%

CPU percentiles

CPU usage percentiles

p50

26.80

%

p95

93.97

%

p99

97.17

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

7

hosts

mean time

0.42

s

Memory used percentage

Percentage of memory used

p5

5.86

%

<

mean

12.08

%

SD

3.96

%

<

p95

17

%

Memory available percentage

Percentage of available memory

p5

83

%

<

mean

87.92

%

SD

3.96

%

<

p95

94.14

%

Max host memory used

Maximum memory usage percentage across all hosts

max

25.21

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

395.43

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.00

MiB/s

Disk write throughput

Disk write throughput in MiB/s

119.30

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /

0/5

hosts

Mount Point /efi-boot

0/4

hosts

Mount Point /etc/hostname

0/6

hosts

Mount Point /etc/hosts

0/6

hosts

Mount Point /etc/nomad.d/client-meta.json

0/17

hosts

Mount Point /etc/resolv.conf

0/6

hosts

Mount Point /nix/store

0/5

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

1.71

5 min

1.32

15 min

1.12

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

14.29

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

0

%

<

mean

10.598

%

SD

19.5045

%

<

p95

60.58

%

60 second average

9.9577

%

300 second average

7.3040

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

4.5185

%

SD

10.5057

%

<

p95

30.09

%

60 second average

4.3041

%

300 second average

3.5012

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

3.2122

%

SD

9.2081

%

<

p95

16.64

%

60 second average

3.0991

%

300 second average

2.6468

%

Holochain process CPU usage

CPU usage by Holochain process

p5

0.31

%

<

mean

24.65

%

SD

26.93

%

<

p95

87.02

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

207.97

KiB

<

mean

309.61

KiB

SD

96.74

KiB

<

p95

528.26

KiB

Holochain process threads

Number of threads in Holochain process

p5

25

threads

<

mean

33.2

threads

SD

6.12

threads

<

p95

41

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

58

file descriptors

<

mean

77.59

file descriptors

SD

13.68

file descriptors

<

p95

97

file descriptors

Zero-Arc Create Data

↑ Back to index

A zero-arc/full-arc mixed scenario where zero-arc nodes create data and full-arc nodes read the data. The scenario has two roles:

zero: A zero-arc conductor that just creates entries with a timestamp field. Those entries are linked to a known base hash so that full-arc nodes can retrieve them.
full: A full-arc conductor that reads the entries created by the zero-arc node(s) and records the time lag between when the entry had been created and when it was first discovered.

Started

Thu, 16 Jul 2026 05:51:34 UTC

Peer count

30

Peer count at end

26

Behaviours

full (1 agent)
zero (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

zero_arc_create_data--high_zero_29468960194_1

Create rate

The number of timed entries created by the zero-arc node(s) per second.

Mean

mean

181.21

/s

Max

Highest per-partition mean rate

max

315.04

/s

Min

Lowest per-partition mean rate

min

39.71

/s

Sync lag timing

For each entry, the time lag between when it was created and when the full-arc node could read it via the get_timed_local_entries zome function.

Mean

mean

474.74425

s

SD

206.648324

s

Max

Highest per-partition mean latency

max mean

554.167786

s

Min

Lowest per-partition mean latency

min mean

395.320713

s

Sync lag rate

The number of entries per second received by full nodes.

Mean

mean

184.13

/s

Max

Highest per-partition mean rate

max

368.25

/s

Min

Lowest per-partition mean rate

min

0

/s

Delivery ratio

The proportion of created entries successfully received by all full-arc nodes.

0.0088

Entry created count

Total number of entries created by zero-arc nodes, by agent.

Total

373684

Agents affected

24 / 24

Mean per agent

Total count divided by number of partitions, rounded to nearest whole number

15570

Max

Highest count in any single partition

25688

Min

Lowest count in any single partition

3596

Received count

Total number of entries received by full-arc nodes, by agent.

Total

6551

Agents affected

2 / 2

Mean per agent

Total count divided by number of partitions, rounded to nearest whole number

3276

Max

Highest count in any single partition

3603

Min

Lowest count in any single partition

2948

Open connections

The number of currently open connections to other conductors.

full-arc

p5

12

<

mean

23.04

SD

4.17

<

p95

25

zero-arc

p5

2

<

mean

7

SD

4.13

<

p95

14

Error count

The number of errors accumulated across all nodes.

799

Holochain MetricsClick to toggle visibility.

Cascade duration

Time taken to execute a cascade (get) query inside Holochain.

mean

0.001253

s

SD

0.000467

s

p50

0.001108

s

<

p95

0.001431

s

<

p99

0.001445

s

WASM usage: 'timed::created_timed_entry'

Metered usage count of the WASM ribosome for this zome function.

total

307548255

over 1870.054240618s

mean rate

4.22785554739e+09

/s

std

8.29181380558e+09

/s

p5

401885.83

/s

p95

2.74850036681e+10

/s

peak

3.95004043808e+10

/s

WASM usage: 'timed::get_timed_entries_local'

Metered usage count of the WASM ribosome for this zome function.

total

19423579468

over 899.688271976s

mean rate

4.4645464151e+08

/s

std

2.4826429946e+08

/s

p5

1.362785131e+07

/s

p95

7.2619092056e+08

/s

peak

7.4483106384e+08

/s

WASM usage: 'timed_integrity::entry_defs'

Metered usage count of the WASM ribosome for this zome function.

total

0

over 37470.145626886s

Not enough time data to show a trend.

Zome call duration: 'timed::created_timed_entry'

Duration of this zome call as measured by Holochain internally.

mean

0.010692

s

SD

0.006274

s

p50

0.010549

s

<

p95

0.02856

s

<

p99

0.035799

s

Zome call duration: 'timed::get_timed_entries_local'

Duration of this zome call as measured by Holochain internally.

mean

0.029103

s

SD

0.023741

s

p50

0.02387

s

<

p95

0.082757

s

<

p99

0.090099

s

WASM call duration: 'timed::created_timed_entry'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.008418

s

SD

0.004958

s

p50

0.008308

s

<

p95

0.022997

s

<

p99

0.028252

s

WASM call duration: 'timed::get_timed_entries_local'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.024585

s

SD

0.023527

s

p50

0.018939

s

<

p95

0.078412

s

<

p99

0.085718

s

WASM call duration: 'timed_integrity::entry_defs'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.000959

s

SD

0.000575

s

p50

0.000888

s

<

p95

0.002935

s

<

p99

0.003185

s

Host function call duration: '__hc__create_1'

Duration of this host function call invoked from within WASM.

mean

0.000303

s

SD

0.000167

s

p50

0.000289

s

<

p95

0.000827

s

<

p99

0.000958

s

Host function call duration: '__hc__create_link_1'

Duration of this host function call invoked from within WASM.

mean

0.000325

s

SD

0.000184

s

p50

0.00032

s

<

p95

0.000895

s

<

p99

0.001041

s

Host function call duration: '__hc__get_1'

Duration of this host function call invoked from within WASM.

mean

0.001333

s

SD

0.000138

s

p50

0.001332

s

<

p95

0.001504

s

<

p99

0.001546

s

Host function call duration: '__hc__get_links_1'

Duration of this host function call invoked from within WASM.

mean

0.000916

s

SD

0.000738

s

p50

0.000771

s

<

p95

0.002471

s

<

p99

0.002737

s

Host function call duration: '__hc__zome_info_1'

Duration of this host function call invoked from within WASM.

mean

0.003483

s

SD

0.001973

s

p50

0.003331

s

<

p95

0.008762

s

<

p99

0.011164

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.00222

s

SD

0.005798

s

p50

0.002495

s

<

p95

0.017765

s

<

p99

0.019183

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

47

s

<

mean

448.75

s

SD

257.96

s

<

p95

848.2

s

Integrated ops

Count of DHT ops integrated since the conductor started. Resets on restart.

total

0

over 37470.145536534s

Not enough time data to show a trend.

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

300.04744

s

SD

63.786944

s

p50

0

s

<

p95

4.544273

s

<

p99

362.522153

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.094086

s

SD

0.027354

s

p50

0.001326

s

<

p95

0.063861

s

<

p99

0.140794

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.001445

s

SD

0.000851

s

p50

0.001266

s

<

p95

0.003084

s

<

p99

0.004023

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.003675

s

SD

0.260631

s

p50

0.001172

s

<

p95

0.920305

s

<

p99

1.142798

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

1.721159

s

SD

2.089034

s

p50

0.69678

s

<

p95

7.412399

s

<

p99

8.664122

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

1.049148

s

SD

0.344846

s

p50

0.003072

s

<

p95

0.532117

s

<

p99

2.271233

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

3.215777

s

SD

4.522006

s

p50

0.004646

s

<

p95

0.163414

s

<

p99

29.481672

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.002128

s

SD

0.001111

s

p50

0.001049

s

<

p95

0.003335

s

<

p99

0.004003

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.001929

s

SD

0.006131

s

p50

0.000216

s

<

p95

0.021678

s

<

p99

0.023947

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000264

s

SD

0.000278

s

p50

0.000238

s

<

p95

0.000779

s

<

p99

0.00139

s

P2P request roundtrip: 'get'

Time spent sending a get request and awaiting its response.

mean

0.210317

s

SD

0.019758

s

p50

0.201972

s

<

p95

0.249014

s

<

p99

0.280036

s

P2P request roundtrip: 'send_validation_receipts'

Time spent sending a send_validation_receipts request and awaiting its response.

mean

0.114732

s

SD

0.064479

s

p50

0.112967

s

<

p95

0.320223

s

≤

p99

0.320223

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

24.11

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

97

B/s

<

mean

84.94

KiB/s

SD

505.10

KiB/s

<

p95

154.74

KiB/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

135

B/s

<

mean

56.74

KiB/s

SD

166.97

KiB/s

<

p95

413.68

KiB/s

Total bytes received

Total bytes received on primary network interface

count

2.04

GiB

mean

2.29

MiB/s

Total bytes sent

Total bytes sent on primary network interface

count

1.36

GiB

mean

1.53

MiB/s

CPU spike anomaly

CPU spike anomaly was detected

Detected

Warning CPU p99 reached 96.2%

Memory leak anomaly

Memory leak anomaly was detected

Detected

Warning Memory growing at 409.32 MiB/s

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

Detected

Warning 7% of hosts overloaded (load5/ncpus > 1.0)

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

0.85

%

<

mean

30.48

%

SD

25.81

%

<

p95

86.35

%

System

6.37

%

CPU percentiles

CPU usage percentiles

p50

27.17

%

p95

86.35

%

p99

96.18

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

7

hosts

mean time

0.29

s

Memory used percentage

Percentage of memory used

p5

6.05

%

<

mean

11.97

%

SD

4.03

%

<

p95

16.53

%

Memory available percentage

Percentage of available memory

p5

83.47

%

<

mean

88.03

%

SD

4.03

%

<

p95

93.95

%

Max host memory used

Maximum memory usage percentage across all hosts

max

26.24

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

409.32

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.00

MiB/s

Disk write throughput

Disk write throughput in MiB/s

174.59

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /

0/5

hosts

Mount Point /efi-boot

0/4

hosts

Mount Point /etc/hostname

0/6

hosts

Mount Point /etc/hosts

0/6

hosts

Mount Point /etc/nomad.d/client-meta.json

0/17

hosts

Mount Point /etc/resolv.conf

0/6

hosts

Mount Point /nix/store

0/5

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

1.69

5 min

1.66

15 min

1.82

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

7.14

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

0

%

<

mean

7.1508

%

SD

14.1375

%

<

p95

40.35

%

60 second average

6.9440

%

300 second average

6.5214

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

11.7787

%

SD

19.5091

%

<

p95

53.51

%

60 second average

11.6607

%

300 second average

11.5613

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

10.9724

%

SD

19.1945

%

<

p95

52.63

%

60 second average

10.8591

%

300 second average

10.6786

%

Holochain process CPU usage

CPU usage by Holochain process

p5

0.32

%

<

mean

26.83

%

SD

23.13

%

<

p95

78.54

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

208.08

KiB

<

mean

308.96

KiB

SD

87.14

KiB

<

p95

488.33

KiB

Holochain process threads

Number of threads in Holochain process

p5

26

threads

<

mean

35

threads

SD

5.69

threads

<

p95

46

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

60

file descriptors

<

mean

83.48

file descriptors

SD

12.18

file descriptors

<

p95

99

file descriptors

Zome Call, Single Value

↑ Back to index

Calls a zome function that returns a fixed value. This tests the maximum performance of zome calls when the zome function is not calling into Holochain other otherwise doing any work.

Started

Thu, 16 Jul 2026 03:42:16 UTC

Peer count

1

Behaviours

default (1 agent)

Holochain version

0.7.0-dev.31

Wind Tunnel version

0.7.0

Run ID

zome_call_single_value_29468960194_1

Call timing

The time taken for the call to complete.

mean

0.006448

s

SD

0.0021

s

p50

0.006108

s

<

p95

0.009418

s

<

p99

0.013496

s

Call rate

The number of zome calls completed per second.

mean

1547.5

/s

Error count

The number of errors accumulated during the run.

0

Holochain MetricsClick to toggle visibility.

WASM usage: 'return_single_value::get_value'

Metered usage count of the WASM ribosome for this zome function.

total

173225344

over 280.001828016s

mean rate

618657.89

/s

std

23463.72

/s

p5

600897.52

/s

p95

655269.17

/s

peak

676855.24

/s

Zome call duration: 'return_single_value::get_value'

Duration of this zome call as measured by Holochain internally.

mean

0.003709

s

SD

0.000885

s

p50

0.003702

s

<

p95

0.004409

s

<

p99

0.008545

s

WASM call duration: 'return_single_value::get_value'

Duration of inner WASM calls for this function, excluding Holochain overhead.

mean

0.001161

s

SD

1.2e-05

s

p50

0.001155

s

<

p95

0.001176

s

<

p99

0.001181

s

Post-commit duration

Time spent executing post-commit workflows.

mean

0.018747

s

SD

0

s

p50

0.018747

s

≤

p95

0.018747

s

≤

p99

0.018747

s

Conductor uptime

Conductor uptime gauge. A drop in the trend indicates a restart during the run.

p5

16.64

s

<

mean

146.64

s

SD

83.67

s

<

p95

276.64

s

Integrated ops

Count of DHT ops integrated since the conductor started. Resets on restart.

total

0

over 280.001798124s

Not enough time data to show a trend.

Integration delay

Delay between an op being stored and being integrated. High values indicate the pipeline is falling behind.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

Validation attempts per op

Number of validation attempts required per op. Values consistently above 1 indicate retries.

mean

0

s

SD

0

s

p50

0

s

≤

p95

0

s

≤

p99

0

s

App validation workflow duration

Time spent running the app validation workflow.

mean

0.001123

s

SD

0

s

p50

0.001123

s

≤

p95

0.001123

s

≤

p99

0.001123

s

Countersigning workflow duration

Time spent running the countersigning workflow.

mean

0.00219

s

SD

0

s

p50

0.00219

s

≤

p95

0.00219

s

≤

p99

0.00219

s

Integrate DHT ops workflow duration

Time spent running the integration workflow.

mean

0.002428

s

SD

0

s

p50

0.002428

s

≤

p95

0.002428

s

≤

p99

0.002428

s

Publish DHT ops workflow duration

Time spent running the publish workflow.

mean

0.004713

s

SD

0.00053

s

p50

0.004914

s

<

p95

0.005621

s

≤

p99

0.005621

s

System validation workflow duration

Time spent running the sys validation workflow.

mean

0.00205

s

SD

0

s

p50

0.00205

s

≤

p95

0.00205

s

≤

p99

0.00205

s

Validation receipt workflow duration

Time spent running the validation receipt workflow.

mean

0.00336

s

SD

0

s

p50

0.00336

s

≤

p95

0.00336

s

≤

p99

0.00336

s

Authored DB connection use time

Time spent holding authored database connections.

mean

0.000168

s

SD

1e-06

s

p50

0.000168

s

<

p95

0.000171

s

≤

p99

0.000171

s

Write transaction duration

Duration of exclusive write transactions across all databases.

mean

0.0001

s

SD

0.000172

s

p50

0.000446

s

≤

p95

0.000446

s

≤

p99

0.000446

s

Lair keystore: signing

Duration of Ed25519 signing requests to the Lair keystore.

mean

0.000296

s

SD

0

s

p50

0.000296

s

≤

p95

0.000296

s

≤

p99

0.000296

s

Host MetricsClick to toggle visibility.

User CPU usage

CPU usage by user space

51.41

%

Network receive rate (primary)

Rate of bytes received on primary network interface

p5

0

B/s

≤

mean

0

B/s

SD

0

B/s

≤

p95

0

B/s

Network send rate (primary)

Rate of bytes sent on primary network interface

p5

0

B/s

≤

mean

0

B/s

SD

0

B/s

≤

p95

0

B/s

Total bytes received

Total bytes received on primary network interface

count

0

B

mean

0

B/s

Total bytes sent

Total bytes sent on primary network interface

count

0

B

mean

0

B/s

CPU spike anomaly

CPU spike anomaly was detected

NotDetected

Memory leak anomaly

Memory leak anomaly was detected

NotDetected

Disk full anomaly

Disk full anomaly was detected

NotDetected

Swap thrashing anomaly

Swap thrashing anomaly was detected

NotDetected

System overload anomaly

System overload anomaly was detected

NotDetected

CPU usage

Total CPU usage and kernel CPU usage

Total

p5

48.46

%

<

mean

68.24

%

SD

8.33

%

<

p95

77.88

%

System

16.84

%

CPU percentiles

CPU usage percentiles

p50

69.91

%

p95

77.88

%

p99

79.50

%

CPU usage above 80%

Number of hosts above 80% CPU and mean time spent above threshold for those hosts

count

0

hosts

mean time

0.00

s

Memory used percentage

Percentage of memory used

p5

14.8

%

<

mean

19.96

%

SD

2.16

%

<

p95

22.04

%

Memory available percentage

Percentage of available memory

p5

77.96

%

<

mean

80.04

%

SD

2.16

%

<

p95

85.2

%

Max host memory used

Maximum memory usage percentage across all hosts

max

19.96

%

Max host swap used percentage

Maximum swap space usage percentage across all hosts

max

0.00

%

Memory growth rate

Rate of memory growth over time

growth

-640.41

MiB/s

Disk read throughput

Disk read throughput in MiB/s

0.00

MiB/s

Disk write throughput

Disk write throughput in MiB/s

23.71

MiB/s

Disk space utilization risk

Number of hosts nearing disk space capacity by mount point

Mount Point /etc/hostname

0/1

hosts

Mount Point /etc/hosts

0/1

hosts

Mount Point /etc/resolv.conf

0/1

hosts

System load average

System load averages over 1, 5, and 15 minutes. This is an unnormalised value not divided by number of CPUs, so it is only meaningful if all machines have the same core count.

1 min

3.70

5 min

2.94

15 min

1.66

CPU overloaded hosts

Percentage of hosts that experienced CPU overload

0.00

%

CPU pressure

CPU pressure over 10, 60, and 300 second averages

10 second average

p5

8.09

%

<

mean

22.1903

%

SD

5.9751

%

<

p95

29.81

%

60 second average

20.1970

%

300 second average

15.3927

%

Memory pressure some

Memory pressure (some tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

Memory pressure full

Memory pressure (all tasks stalled) over 10, 60, and 300 second averages

10 second average

p5

0

%

≤

mean

0

%

SD

0

%

≤

p95

0

%

60 second average

0.0000

%

300 second average

0.0000

%

I/O pressure some

I/O pressure (some tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.108

%

SD

0.1324

%

<

p95

0.35

%

60 second average

0.1120

%

300 second average

0.0683

%

I/O pressure full

I/O pressure (all tasks stalled) over 10, 60 and 300 second averages

10 second average

p5

0

%

<

mean

0.021

%

SD

0.0499

%

<

p95

0.12

%

60 second average

0.0207

%

300 second average

0.0013

%

Holochain process CPU usage

CPU usage by Holochain process

p5

19.51

%

<

mean

22.88

%

SD

5.14

%

<

p95

38.41

%

Holochain process memory (PSS)

Proportional Set Size memory of Holochain process

p5

83.14

KiB

<

mean

227.95

KiB

SD

73.27

KiB

<

p95

339.49

KiB

Holochain process threads

Number of threads in Holochain process

p5

10

threads

<

mean

98.87

threads

SD

142.68

threads

<

p95

410

threads

Holochain process file descriptors

Number of file descriptors used by Holochain process

p5

11

file descriptors

<

mean

249.16

file descriptors

SD

359.1

file descriptors

<

p95

1022

file descriptors

App Install

App Install

DHT Sync Lag

First Call

Local Signals

Mixed Arc get_agent_activity

Mixed Arc must_get_agent_activity

Remote Call Rate

Remote Signals

Single-write, many-read

Validation Receipts

Write/get_agent_activity

Write/get_agent_activity with volatile conductors

Write/Query

Write/Read

Write validated

Write Validated must_get_agent_activity

Zero-Arc Create and Read

Zero-Arc Create Data

Zome Call, Single Value

Mixed Arc `get_agent_activity`

Mixed Arc `must_get_agent_activity`

Write/`get_agent_activity`

Write/`get_agent_activity` with volatile conductors

Write Validated `must_get_agent_activity`