App Install
↑ Back to indexMeasure app installation speed. This scenario has two roles:
minimal: Installs a simple app which implements initialisation callbacks but otherwise doesn't contain a lot of code.large: Installs a larger app that contains some dependencies and some generated data as padding to make the bundle larger.
These are intended to catch a compilation slowdown or issues with copying around large WASMs (e.g. accidental cloning or tracing). In each case, the behaviour will uninstall the app it installed so that it can re-install it on the next iteration.
-
large(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning Memory growing at 1583.21 MiB/s
//efi-boot/nix/storeDHT Sync Lag
↑ Back to indexMeasures the lag time between an agent publishing data and other peers being able to see it. This scenario has two roles:
write: Creates entries with a timestamp field, linked to a known base hash so thatrecord_lagagents can discover them.record_lag: Repeatedly queries for links from the known base hash. When a new entry is discovered, it calculates the time difference between the entry's timestamp and the current time, giving the sync lag for that entry.
-
record_lag(1 agent) -
write(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning CPU p99 reached 97.1%
Warning Memory growing at 612.14 MiB/s
Warning 67% of hosts overloaded (load5/ncpus > 1.0)
//efi-boot/etc/hostname/etc/hosts/etc/resolv.conf/nix/storeFirst Call
↑ Back to indexThis scenario installs a simple app which implements the init callback, and measures the time elapsed between start of install and calling init. It will uninstall the app it installed so that it can re-install it on the next iteration. This is required to re-run the initialisation callback.
-
default(1 agent)
init.Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning Memory growing at 1166.90 MiB/s
//efi-boot/nix/storeLocal Signals
↑ Back to indexThis scenario is for testing the speed and reliability of local signals. It uses a zome with a function that will emit 10,000 signals. The scenario measures how long it takes to send the signals and how many have been received by the time the zome call ends.
-
default(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning Memory growing at 347.50 MiB/s
//efi-boot/nix/storeMixed Arc get_agent_activity
↑ Back to index
A mixed-arc scenario that measures the DHT's ability to propagate agent activity and make it available via get_agent_activity calls. The scenario has three roles:
zero_write: A zero-arc conductor that creates entries on its source chain.full_write: A full-arc conductor that creates entries on its source chain.zero_read: A zero-arc conductor that picks a random writer and repeatedly callsget_agent_activityto observe new entries appearing on the writer's chain, measuring the lag between creation and discovery.
-
full_write(1 agent) -
zero_read(1 agent) -
zero_write(1 agent)
get_agent_activity. This is measured per new action in the chain.get_agent_activity_full zome call timingget_agent_activity_full zome call that queries a writer's chain.get_agent_activity.behaviour:full_write
behaviour:zero_read
behaviour:zero_write
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning CPU p99 reached 97.4%
Warning Memory growing at 232.42 MiB/s
Warning 14% of hosts overloaded (load5/ncpus > 1.0)
//efi-boot/etc/hostname/etc/hosts/etc/resolv.conf/nix/storeMixed Arc must_get_agent_activity
↑ Back to index
A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.
The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.
This test is similar to Write Validated must_get_agent_activity, but some write agents are zero-arc and all must_get_agent_activity agents are zero-arc. This forces the must_get_agent_activity host call to go to the network.
-
full_write(1 agent) -
zero_must_get_agent_activity(1 agent) -
zero_write(1 agent)
action_seqwrite agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.create_validated_sample_entry zome call timingwrite agent's source chain.must_get_agent_activity calls.behaviour:full_write
behaviour:zero_must_get_agent_activity
behaviour:zero_write
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning Memory growing at 190.81 MiB/s
Critical Disk /etc/resolv.conf: 1/6 hosts above 90% capacity
Critical Heavy swap usage (34.5% swap used)
Warning 3% of hosts overloaded (load5/ncpus > 1.0)
//efi-boot/etc/hostname/etc/hosts/etc/resolv.conf/nix/storeRemote Call Rate
↑ Back to indexTest the throughput of remote_call operations. Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.
-
default(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning Memory growing at 890.45 MiB/s
//efi-boot/etc/hostname/etc/hosts/etc/resolv.conf/nix/storeRemote Signals
↑ Back to indexThis scenario tests the throughput of remote_signals operations.
-
default(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning Memory growing at 522.35 MiB/s
Warning 20% of hosts overloaded (load5/ncpus > 1.0)
//efi-boot/etc/hostname/etc/hosts/etc/resolv.conf/nix/storeSingle-write, many-read
↑ Back to indexCreates an entry in the agent setup, then read one's own record back. This tests the maximum read performance for reading back local data when the chain is short.
-
default(1 agent)
read call timingread call rateHolochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning Memory growing at 4.91 MiB/s
//efi-boot/nix/storeTwo-party countersigning
↑ Back to indexThis scenario tests the performance of countersigning operations. There are two roles: initiate and participate. The participants commit an entry to advertise that they are willing to participate in sessions. They listen for sessions and participate in one at a time.
-
initiate(1 agent) -
participate(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning Memory growing at 50.21 MiB/s
//efi-boot/nix/storeUnyt Chain Transaction
↑ Back to indexTests Unyt chain transaction system performance with credit ledger and smart agreement primitives. The scenario has three roles:
initiate: Progenitor agent that initializes the network with system templates, global configuration, and foundational smart agreementsspend: Transaction agents that accept incoming commitments and create spend transactions distributed among participantssmart_agreements: Smart agreement agents that collect RAVEs, execute agreements, and create parked link spending transactions
-
initiate(1 agent) -
smart_agreements(1 agent) -
spend(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning CPU p99 reached 99.2%
Warning Memory growing at 1652.91 MiB/s
Critical Disk /etc/resolv.conf: 1/6 hosts above 90% capacity
Critical Heavy swap usage (34.5% swap used)
Warning 3% of hosts overloaded (load5/ncpus > 1.0)
//boot/efi-boot/etc/hostname/etc/hosts/etc/resolv.conf/nix/storeUnyt Chain Transaction Zero Arc
↑ Back to indexTests Unyt chain transaction system performance where some agents operate with a 0-arc DHT configuration. Measures data propagation between zero-arc and full-arc nodes. The scenario has five roles:
initiate: Progenitor agent that initializes the network with system templates, global configuration, and foundational smart agreementszero_spend: Zero-arc transaction agents that accept commitments and create spend transactionszero_smart_agreements: Zero-arc agents that collect RAVEs and execute smart agreementsfull_observer: Full-arc observer agents that passively monitor data propagationzero_observer: Zero-arc observer agents that passively monitor data propagation for comparison
-
full_observer(1 agent) -
initiate(1 agent) -
zero_observer(1 agent) -
zero_smart_agreements(1 agent) -
zero_spend(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning CPU p99 reached 99.4%
Warning Memory growing at 61.68 MiB/s
Warning 17% of hosts overloaded (load5/ncpus > 1.0)
//efi-boot/etc/hostname/etc/hosts/etc/resolv.conf/nix/storeValidation Receipts
↑ Back to indexCreates an entry, wait for required validation receipts, then repeat. Records the amount of time it took to accumulate the required number of receipts for all DHT operations. This is measured to the nearest 20ms so that we don't keep the agent too busy checking for receipts.
Each agent in this scenario waits for a certain number of peers to be available or for up to two minutes, whichever happens first, before starting its behaviour.
By default, this scenario will wait for a complete set of validation receipts before committing the next record. If the NO_VALIDATION_COMPLETE environment variable is set, it will instead publish new records on every round, building up an ever-growing list of action hashes to check on.
-
default(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning CPU p99 reached 95.4%
Warning Memory growing at 347.84 MiB/s
Warning 60% of hosts overloaded (load5/ncpus > 1.0)
//efi-boot/etc/hostname/etc/hosts/etc/resolv.conf/nix/storeWrite/get_agent_activity
↑ Back to index
A scenario where write peers write entries, while get_agent_activity peers each query a single write agent's activity with get_agent_activity.
Before a target write peer and the requesting get_agent_activity peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.
-
get_agent_activity(1 agent) -
write(1 agent)
get_agent_activity_full zome call timingwrite peer's source chain.Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning CPU p99 reached 97.9%
Warning Memory growing at 347.50 MiB/s
Critical Disk /etc/resolv.conf: 1/6 hosts above 90% capacity
Critical Heavy swap usage (34.5% swap used)
Warning 30% of hosts overloaded (load5/ncpus > 1.0)
//boot/efi-boot/etc/hostname/etc/hosts/etc/resolv.conf/nix/storeWrite/get_agent_activity with volatile conductors
↑ Back to index
A scenario where write peers write entries, while get_agent_activity_volatile peers each query a single write agents activity with get_agent_activity but shutdown and restart their conductors at semi-random intervals.
Before a target write peer and the requesting get_agent_activity_volatile peer are in sync, this will measure the get_agent_activity call performance over a network. Once a write peer reaches sync with a get_agent_activity peer, the write peer will publish their actions and entries, and so the get_agent_activity calls will likely have most of the data they need locally. At that point this measures the database query performance and code paths through host functions.
-
get_agent_activity_volatile(1 agent) -
write(1 agent)
action_seqget_agent_activity. This reflects the DHT's ability to propagate agent activity ops and make them available to querying peers.get_agent_activity_full zome call timingwrite peer's source chain.get_agent_activity_volatile peers.get_agent_activity_volatile conductor.get_agent_activity_volatile conductor was running before being stopped.get_agent_activity_volatile conductor was stopped before being started again.get_agent_activity_volatile peer reach their target arc in the moment before they were shutdown.get_agent_activity_volatile_agent:uhCAk14qBt9ArGFJIhp4Lej5zMohnVyV97cKZQA476UiffaxvzxQP
get_agent_activity_volatile_agent:uhCAk5W_81HkYYo1AAqMdGLqieyHBgYg1FrdUsDSLnot4c3Mu6yj_
get_agent_activity_volatile_agent:uhCAk7KWk_qEYsC4o_WW3JevecPFpm48OiaxITAZ5WoD2lWGRXCEx
get_agent_activity_volatile_agent:uhCAk8zKAAw8tKVd_GSyc3-CVC4hkvj19DxNJ21fI5ONck_grPYNg
get_agent_activity_volatile_agent:uhCAkCcGNps_k1FRxszgmhMJOZp-UpohL7CyMq4vkCgOj51Kgl6CU
get_agent_activity_volatile_agent:uhCAkEBqFBkdJjnrQGDH95LeAhGLa_l97jRnz9Z6bdUrGnSGLJUfB
get_agent_activity_volatile_agent:uhCAkFVHBQT_IIAakJVSm_wkneml229y7MyZVSFWJif4MQYeUe9jc
get_agent_activity_volatile_agent:uhCAkFdnBclJYpNURcHFoiWXs1t_kTtvfTALkk7lQ0FxWfsL_sAK8
get_agent_activity_volatile_agent:uhCAkIQ8UBeBKEY5D2Xmy8M2TxmMv0YxW3c42-d6FbfAVQzxXVOeu
get_agent_activity_volatile_agent:uhCAkKCfGg_2fACs5pQ0HzhzltGslg8ksvvlXSSiAG45ornl3Vu5D
get_agent_activity_volatile_agent:uhCAkVzC5VxwEQRE13Gk6YF7x8roR5VCQ_D8PlLFpm1INypPqX0kQ
get_agent_activity_volatile_agent:uhCAkW0K3sFEO0VR-NP1EeH6htmCfhNESD_Iie44Cg2tYN3wGloUu
get_agent_activity_volatile_agent:uhCAkX7ne6PwVDiyDfXZT1pwwXikahJxeyr8fLSF_BcHop5Vbl5Jr
get_agent_activity_volatile_agent:uhCAkaJksaeKYDFVGmsowTKpHV5SvmF8z1u53ttsHC2Itjl348_Ag
get_agent_activity_volatile_agent:uhCAkfFLBAbVFb4svw6ilM-Sh3l5590kK0KtJ8sk04mWWwHIJXddu
get_agent_activity_volatile_agent:uhCAkk5NblAXAlzZzBTGNUUpzrTesfaSr6FhvxU2TJPGEuZCcylek
get_agent_activity_volatile_agent:uhCAknE5qsyCnAF6dgFUMGArcIJa3h9a9U9nnR3tASeIkSozbjl6T
get_agent_activity_volatile_agent:uhCAksYK0319juXLXQ8ob7Yv7x3ylhidIYXmyaA0wPvz3kVrhJX5n
get_agent_activity_volatile_agent:uhCAkzppQAWzBrKtm76XXyQgQup35GuHdkZGf-Fi2_zUIRnZZ49AM
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning CPU p99 reached 94.3%
Warning Memory growing at 303.25 MiB/s
//efi-boot/etc/hostname/etc/hosts/etc/resolv.conf/nix/storeWrite/Query
↑ Back to indexCreates an entry, then queries the source chain and performs a simple operation on the entries, then repeats.
-
default(1 agent)
chain_query_count_len zome call that queries the source chain.Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
//efi-boot/nix/storeWrite/Read
↑ Back to indexCreates an entry and reads it back, then repeats.
-
default(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
//efi-boot/nix/storeWrite validated
↑ Back to indexCreates an entry, updates it and links the create to the update, then repeats. Each of the three actions is validated by the included hApp.
-
default(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
/etc/hostname/etc/hosts/etc/resolv.confWrite Validated must_get_agent_activity
↑ Back to index
A scenario where write agents create entries in batches of 10, while must_get_agent_activity agents each pick a random write agent and repeatedly attempt to create an entry that references the chain top of their latest batch. This reference means that the entry's validation function needs to make a must_get_agent_activity call.
The purpose of this scenario is to measure the time it takes for published agent activity data to be gossiped among authorities and become available to peers that query it via must_get_agent_activity.
This test is similar to Mixed-Arc must_get_agent_activity, but all agents are full-arc.
-
must_get_agent_activity(1 agent) -
write(1 agent)
action_seqwrite agent, aggregated across all reading agents. The reading dimension is collapsed by taking the maximum observed value for each write agent (any successful read counts as propagation). This reflects the DHT’s ability to propagate agent activity ops and make them available to querying peers.write agent's creation of a batch and a must_get_agent_activity agent's successful discovery of the batch and creation/self-validation of a new entry that depends on it.must_get_agent_activity agent was able to discover batches and create/self-validate new entries that depend on them.create_validated_sample_entry zome call timingwrite agent's source chain.must_get_agent_activity calls.Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning Memory growing at 151.28 MiB/s
Critical Disk /etc/resolv.conf: 1/5 hosts above 90% capacity
Critical Heavy swap usage (34.5% swap used)
//efi-boot/etc/hostname/etc/hosts/etc/resolv.conf/nix/storeZome Call, Single Value
↑ Back to indexCalls a zome function that returns a fixed value. This tests the maximum performance of zome calls when the zome function is not calling into Holochain other otherwise doing any work.
-
default(1 agent)
Holochain MetricsClick to toggle visibility.
Host MetricsClick to toggle visibility.
Warning CPU p99 reached 91.7%
Warning Memory growing at 101.78 MiB/s
Warning 100% of hosts overloaded (load5/ncpus > 1.0)
/etc/hostname/etc/hosts/etc/resolv.conf