App Install
↑ Back to indexMeasure app installation speed. This scenario has two roles:
minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.
These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.
-
minimal(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity
Critical Heavy swap usage (96.9% swap used)
/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.confApp Install
↑ Back to indexMeasure app installation speed. This scenario has two roles:
minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.
These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.
-
large(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity
Critical Heavy swap usage (96.9% swap used)
/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.confDHT Sync Lag
↑ Back to indexMeasures the lag time between an agent publishing data and other peers being able to see it. This scenario has two roles:
write: Creates entries with a timestamp field, linked to a known base hash so thatrecord_lagagents can discover them.record_lag: Repeatedly queries for links from the known base hash. When a new entry is discovered, it calculates the time difference between the entry's timestamp and the current time, giving the sync lag for that entry.
-
record_lag(1 agent) -
write(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning CPU p99 reached 98.0%
Warning Memory growing at 707.34 MiB/s
Critical Disk /etc/resolv.conf: 1/7 hosts above 90% capacity
Critical Heavy swap usage (98.0% swap used)
Warning 32% of hosts overloaded (load5/ncpus > 1.0)
//efi-boot/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.conf/nix/storeFirst Call
↑ Back to indexThis scenario installs a simple app which implements the init callback, and measures the time elapsed between start of install and calling init. It will uninstall the app it installed so that it can re-install it on the next iteration. This is required to re-run the initialisation callback.
-
default(1 agent)
init.Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning Memory growing at 1554.80 MiB/s
Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity
Critical Heavy swap usage (97.3% swap used)
/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.confLocal Signals
↑ Back to indexThis scenario is for testing the speed and reliability of local signals. It uses a zome with a function that will emit 10,000 signals. The scenario measures how long it takes to send the signals and how many have been received by the time the zome call ends.
-
default(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning Memory growing at 221.80 MiB/s
Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity
Critical Heavy swap usage (97.1% swap used)
/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.confRemote Call Rate
↑ Back to indexTest the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.
-
default(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning Memory growing at 2984.87 MiB/s
Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity
Critical Heavy swap usage (96.9% swap used)
/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.confRemote Signals
↑ Back to indexThis scenario tests the throughput of remote_signals operations.
-
default(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity
Critical Heavy swap usage (96.9% swap used)
/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.confSingle-write, many-read
↑ Back to indexCreates an entry in the agent setup, then read one's own record back. This tests the maximum read performance for reading back local data when the chain is short.
-
default(1 agent)
read call timingread call rateHolochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning Memory growing at 1855.77 MiB/s
Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity
Critical Heavy swap usage (96.9% swap used)
/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.confValidation Receipts
↑ Back to indexCreates an entry, wait for required validation receipts, then repeat. Records the amount of time it took to accumulate the required number of receipts for all DHT operations. This is measured to the nearest 20ms so that we don't keep the agent too busy checking for receipts.
Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.
By default, this scenario will wait for a complete set of validation receipts before committing the next record. If the NO_VALIDATION_COMPLETE environment variable is set, it will instead publish new records on every round, building up an ever-growing list of action hashes to check on.
-
default(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning Memory growing at 88.02 MiB/s
//efi-boot/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.conf/nix/storeWrite/get_agent_activity
↑ Back to index
A scenario where write peers write entries, while get_agent_activity peers each query a single write agent's activity with get_agent_activity.
Before a target write peer and the requesting get_agent_activity peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.
-
get_agent_activity(1 agent) -
write(1 agent)
get_agent_activity_full zome call timingwrite peer's source chain.Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning CPU p99 reached 98.3%
Warning Memory growing at 620.32 MiB/s
Critical Disk /etc/resolv.conf: 1/7 hosts above 90% capacity
Critical Heavy swap usage (96.4% swap used)
Warning 36% of hosts overloaded (load5/ncpus > 1.0)
//efi-boot/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.conf/nix/storeWrite/get_agent_activity with volatile conductors
↑ Back to index
A scenario where write peers write entries, while get_agent_activity_volatile peers each query a single write agents activity with get_agent_activity but shutdown and restart their conductors at semi-random intervals.
Before a target write peer and the requesting get_agent_activity_volatile peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.
-
get_agent_activity_volatile(1 agent) -
write(1 agent)
action_seqget_agent_activity. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.get_agent_activity_full zome call timingwrite peer's source chain.get_agent_activity_volatile peers.get_agent_activity_volatile conductor.get_agent_activity_volatile conductor was running before being stopped.get_agent_activity_volatile conductor was stopped before being started again.get_agent_activity_volatile peer reach their target arc in the moment before they were shutdown.get_agent_activity_volatile_agent:uhCAk1ty-qGWRJtkVAtHqzWOz2LUTmo9ipy8znq19gj71ICKbrT7J
get_agent_activity_volatile_agent:uhCAk2wx-jVgQb3M5ct7rH-6RHhphNfxtzyd6pEWEbNUnkYpAjkIJ
get_agent_activity_volatile_agent:uhCAk2xja5iwukcTD82PfNpjFfZrmlQUUFUetBtwYcZ4rBwETnfl7
get_agent_activity_volatile_agent:uhCAk5bilHTA8R_ZRHpPq2SNTpR1Y5rqIpwujZYOQnrzWsgkRKlD1
get_agent_activity_volatile_agent:uhCAk75vcTW4hE35xplPwSsxYJZlFQ-0iVAAQEN-am9_EbMsNj7zj
get_agent_activity_volatile_agent:uhCAk7CWtYkygpMI53fXkJNkMj2cuzm0niCTwbhOgm76MntVDEzmy
get_agent_activity_volatile_agent:uhCAkAfpWL2oibbl1WhGKjk9V68WfbFHuzJ1LfAZEK9DXLRxk90dY
get_agent_activity_volatile_agent:uhCAkB98FpYHtXBhO7DcAiBZlvzYn8zjMxiYtjw2dzAJDHPk2KzxK
get_agent_activity_volatile_agent:uhCAkFyI_NIKSjCyoUigA14ayLHZYUXctOO2G5-bbztI4ub8XGc1f
get_agent_activity_volatile_agent:uhCAkHr1tWZdQIMltK9roDC5MAFKiHU90Xb1iMiyWgnlZwWK0dX_t
get_agent_activity_volatile_agent:uhCAkIGikrC8TtLyAL5Xfa6GNXv9m6_tMprozErOpcFBMjmlTTxk2
get_agent_activity_volatile_agent:uhCAkLNRnciScU3wD-YKb4WpNMwKNrHmT8DpQLkF3SWO7WuQVxPs_
get_agent_activity_volatile_agent:uhCAkO-5easFtJnaJvV5q9Rcu11vHIbN6O-8s0fYNzp-2WWnEZYpl
get_agent_activity_volatile_agent:uhCAkTXIONDeSuzMshGQIwTOoXNr7_BZ1v4lkHoIZTTXaH4U4_1n4
get_agent_activity_volatile_agent:uhCAke3_eT-l8lNWdZEDCN8FRSr4DSO9JqY-oVBr1rSyjdOUlTg9v
get_agent_activity_volatile_agent:uhCAklxCWWgbYJ6_e2pszp4QzzQE9fZ5TsN89caosihkL_oHuLobb
get_agent_activity_volatile_agent:uhCAktYPChdLmKL-uXuGaQ4Km1A-wf9T_7F9yT28OkVJfGewneuEi
get_agent_activity_volatile_agent:uhCAktgZFWGUdvZlw3w5W-RhfLShht91jWDSObYOIznpGI-cZRO_q
get_agent_activity_volatile_agent:uhCAkup0yQpdSJAzbWIBDBQxwVanBSBBLYaFLyHXw-VPUwfU1zTg2
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning CPU p99 reached 98.6%
Warning Memory growing at 898.93 MiB/s
Critical Disk /etc/resolv.conf: 1/7 hosts above 90% capacity
Critical Heavy swap usage (96.4% swap used)
Warning 29% of hosts overloaded (load5/ncpus > 1.0)
//efi-boot/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.conf/nix/storeWrite/Query
↑ Back to indexCreates an entry, then queries the source chain and performs a simple operation on the entries, then repeats.
-
default(1 agent)
chain_query_count_len zome call that queries the source chain.Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity
Critical Heavy swap usage (96.9% swap used)
/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.confWrite/Read
↑ Back to indexCreates an entry and reads it back, then repeats.
-
default(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity
Critical Heavy swap usage (96.9% swap used)
/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.confWrite validated
↑ Back to indexCreates an entry, updates it and links the create to the update, then repeats. Each of the three actions is validated by the included hApp.
-
default(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning Memory growing at 1076.82 MiB/s
Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity
Critical Heavy swap usage (96.9% swap used)
/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.confWrite Validated must_get_agent_activity
↑ Back to index
A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.
The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.
This test is similar to Mixed-Arc must_get_agent_activity, but all agents are full-arc.
-
must_get_agent_activity(1 agent) -
write(1 agent)
action_seqwrite agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.create_validated_sample_entry zome call timingwrite agent's source chain.must_get_agent_activity calls.Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning CPU p99 reached 97.7%
Warning Memory growing at 748.54 MiB/s
Critical Disk /etc/resolv.conf: 1/7 hosts above 90% capacity
Critical Heavy swap usage (96.4% swap used)
Warning 21% of hosts overloaded (load5/ncpus > 1.0)
//efi-boot/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.conf/nix/storeZome Call, Single Value
↑ Back to indexCalls a zome function that returns a fixed value. This tests the maximum performance of zome calls when the zome function is not calling into Holochain other otherwise doing any work.
-
default(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Critical Disk /etc/resolv.conf: 1/1 hosts above 90% capacity
Critical Heavy swap usage (96.9% swap used)
/etc/hostname/etc/hosts/etc/nomad.d/client-meta.json/etc/resolv.conf