This document is the complete specification of the consensus-layer peer-to-peer networking protocol as of Electra. It covers the libp2p transport profile, the gossipsub configuration and topics, the Req/Resp protocols, and the discv5 integration. The application-level validation of gossip messages is specified as executable Python in consensus-specs and is linked from the relevant sections rather than repeated here. Non-normative design rationale lives in p2p-rationale.md.
- Network fundamentals
- Configuration
- Types
- Containers
- Fork digest
- Maximum message sizes
- MetaData
- The gossip domain: gossipsub
- The Req/Resp domain
- The discovery domain: discv5
- Subnet subscription
- Light client networking
- Change log
Network fundamentals
This section outlines the specification for the networking stack in Ethereum consensus-layer clients.
Transport
Even though libp2p is a multi-transport stack (designed to listen on multiple simultaneous transports and endpoints transparently), we hereby define a profile for basic interoperability.
All implementations MUST support the QUIC (UDP) libp2p transport and the TCP libp2p transport. Any supported transport MUST be enabled for both dialing and listening (i.e. outbound and inbound connections). The libp2p QUIC (UDP) and TCP transports support listening on IPv4 and IPv6 addresses (and on multiple simultaneously).
QUIC is the primary transport. When a peer is reachable over both TCP and QUIC, clients SHOULD prioritise peer’s QUIC addresses.
Clients must support listening on at least one of IPv4 or IPv6. Clients that do not have support for listening on IPv4 SHOULD be cognizant of the potential disadvantages in terms of Internet-wide routability/support. Clients MAY choose to listen only on IPv6, but MUST be capable of dialing both IPv4 and IPv6 addresses.
All listening endpoints must be publicly dialable, and thus not rely on libp2p circuit relay, AutoNAT, or AutoRelay facilities. (Usage of circuit relay, AutoNAT, or AutoRelay will be specifically re-examined soon.)
Nodes operating behind a NAT, or otherwise undialable by default (e.g. container runtime, firewall, etc.), MUST have their infrastructure configured to enable inbound traffic on the announced public listening endpoint.
Encryption and identification
The QUIC transport is secured using TLS 1.3, configured according to the libp2p TLS specification.
For the TCP fallback transport, the
Libp2p-noise secure channel
handshake with secp256k1 identities will be used for encryption. As specified
in the libp2p specification, clients MUST support the XX handshake pattern.
Protocol negotiation
Clients MUST use exact equality when negotiating protocol versions to use and MAY use the version to give priority to higher version numbers.
Clients MUST support multistream-select 1.0 and MAY support multiselect 2.0 when the specification solidifies. Once all clients have implementations for multiselect 2.0, multistream-select 1.0 MAY be phased out.
Multiplexing
During connection bootstrapping, libp2p dynamically negotiates a mutually supported multiplexing method to conduct parallel conversations. This applies to transports that are natively incapable of multiplexing (e.g. TCP, WebSockets, WebRTC), and is omitted for capable transports (e.g. QUIC).
Two multiplexers are commonplace in libp2p implementations:
mplex and
yamux. Their
protocol IDs are, respectively: /mplex/6.7.0 and /yamux/1.0.0.
Because the primary QUIC transport multiplexes natively, a stream multiplexer is only required for the TCP fallback transport. Clients that support the TCP transport MUST support mplex and MAY support yamux. If both are supported by the client, yamux MUST take precedence during negotiation. See the rationale for tradeoffs.
Configuration
Constants
| Name | Value |
|---|---|
NODE_ID_BITS | Uint64(256) |
Presets
| Name | Value | Description |
|---|---|---|
KZG_COMMITMENT_INCLUSION_PROOF_DEPTH | Uint64(floorlog2(get_generalized_index(BeaconBlockBody, 'blob_kzg_commitments')) + 1 + ceillog2(MAX_BLOB_COMMITMENTS_PER_BLOCK)) (= 17) | Merkle proof depth for blob_kzg_commitments list item |
Configs
This section outlines configurations that are used in this specification.
| Name | Value | Description |
|---|---|---|
MAX_PAYLOAD_SIZE | Uint64(10 * 2**20) (= 10,485,760, 10 MiB) | Maximum allowed size of uncompressed payload in gossipsub messages and RPC chunks |
MAX_REQUEST_BLOCKS | Uint64(2**10) (= 1,024) | Maximum number of blocks in a single request |
EPOCHS_PER_SUBNET_SUBSCRIPTION | Epoch(2**8) (= 256) | Number of epochs on a subnet subscription |
ATTESTATION_PROPAGATION_SLOT_RANGE | Slot(32) | Maximum number of slots during which an attestation can be propagated |
MAXIMUM_GOSSIP_CLOCK_DISPARITY | Uint64(500) | Maximum milliseconds of clock disparity assumed between honest nodes |
MESSAGE_DOMAIN_INVALID_SNAPPY | DomainType('0x00000000') | 4-byte domain for gossip message-id isolation of invalid snappy messages |
MESSAGE_DOMAIN_VALID_SNAPPY | DomainType('0x01000000') | 4-byte domain for gossip message-id isolation of valid snappy messages |
SUBNETS_PER_NODE | Uint64(2) | Number of long-lived subnets a beacon node should be subscribed to |
ATTESTATION_SUBNET_COUNT | Uint64(2**6) (= 64) | Number of attestation subnets used in the gossipsub protocol |
ATTESTATION_SUBNET_EXTRA_BITS | Uint64(0) | Number of extra bits of a NodeId to use when mapping to a subscribed subnet |
MAX_CONCURRENT_REQUESTS | Uint64(2) | Maximum number of concurrent requests per protocol ID that a client may issue |
MAX_REQUEST_LIGHT_CLIENT_UPDATES | Uint64(2**7) (= 128) | Maximum number of LightClientUpdate instances in a single request |
MAX_REQUEST_BLOCKS_DENEB | Uint64(2**7) (= 128) | Maximum number of blocks in a single request (supersedes MAX_REQUEST_BLOCKS) |
MIN_EPOCHS_FOR_BLOB_SIDECARS_REQUESTS | Epoch(2**12) (= 4,096) | Minimum epoch range over which a node must serve blob sidecars |
BLOB_SIDECAR_SUBNET_COUNT | Uint64(6) | Number of blob sidecar subnets used in the gossipsub protocol before Electra |
BLOB_SIDECAR_SUBNET_COUNT_ELECTRA | Uint64(9) | Number of blob sidecar subnets used in the gossipsub protocol |
The number of sync committee subnets, SYNC_COMMITTEE_SUBNET_COUNT (= 4), is a
preset defined in the
Altair validator specification.
MAX_BLOBS_PER_BLOCK_ELECTRA is defined in the
Electra beacon chain specification.
Derived request limits
compute_max_request_blob_sidecars
def compute_max_request_blob_sidecars() -> Uint64:
"""
Return the maximum number of blob sidecars in a single request.
"""
return MAX_REQUEST_BLOCKS_DENEB * MAX_BLOBS_PER_BLOCK_ELECTRATypes
The following SSZ types are used on the wire in addition to the consensus types defined in the beacon chain and validator specifications.
Attnets
class Attnets(BitVector):
"""
The attestation subnets a node is subscribed to, one bit per subnet.
"""
LENGTH = ATTESTATION_SUBNET_COUNTBeaconBlockRoots
class BeaconBlockRoots(List[Root]):
"""
Beacon block roots requested in a ``BeaconBlocksByRoot`` request.
"""
LIMIT = MAX_REQUEST_BLOCKS_DENEBBlobIdentifiers
class BlobIdentifiers(List[BlobIdentifier]):
"""
The identifiers of the blob sidecars requested in a
``BlobSidecarsByRoot`` request.
"""
LIMIT = compute_max_request_blob_sidecars()BlobSidecars
class BlobSidecars(List[BlobSidecar]):
"""
Blob sidecars returned in a ``BlobSidecarsByRange`` or
``BlobSidecarsByRoot`` response.
"""
LIMIT = compute_max_request_blob_sidecars()KZGCommitmentInclusionProof
class KZGCommitmentInclusionProof(Vector[Bytes32]):
"""
A Merkle branch proving a blob's KZG commitment within
``BeaconBlockBody``.
"""
LENGTH = KZG_COMMITMENT_INCLUSION_PROOF_DEPTHErrorMessage
class ErrorMessage(List[Byte]):
"""
The error message of an unsuccessful response chunk.
"""
LIMIT = 256NodeID
class NodeID(Uint256):
"""
A node identifier on the discovery network.
"""SignedBeaconBlocks
class SignedBeaconBlocks(List[SignedBeaconBlock]):
"""
Signed beacon blocks returned in a ``BeaconBlocksByRange`` or
``BeaconBlocksByRoot`` response.
"""
LIMIT = MAX_REQUEST_BLOCKS_DENEBSubnetID
class SubnetID(Uint64):
"""
The identifier of a gossip subnet, like an attestation subnet.
"""Syncnets
class Syncnets(BitVector):
"""
The sync committee subnets a node is subscribed to, one bit per subnet.
"""
LENGTH = SYNC_COMMITTEE_SUBNET_COUNTLightClientUpdates
class LightClientUpdates(List[LightClientUpdate]):
"""
Light client updates returned in a ``LightClientUpdatesByRange`` response.
"""
LIMIT = MAX_REQUEST_LIGHT_CLIENT_UPDATESContainers
BlobSidecar
Note: index is the index of the blob in the block.
class BlobSidecar(Container):
index: BlobIndex
blob: Blob
kzg_commitment: KZGCommitment
kzg_proof: KZGProof
signed_block_header: SignedBeaconBlockHeader
kzg_commitment_inclusion_proof: KZGCommitmentInclusionProofBlobIdentifier
class BlobIdentifier(Container):
block_root: Root
index: BlobIndexFork digest
Gossip topics, the Status handshake and the ENR eth2 entry are all
parametrised by a 4-byte fork digest which separates networks and forks from
each other.
compute_fork_version(epoch) returns the fork version in effect at epoch
according to the network’s fork schedule: ELECTRA_FORK_VERSION from
ELECTRA_FORK_EPOCH on, then DENEB_FORK_VERSION, CAPELLA_FORK_VERSION,
BELLATRIX_FORK_VERSION, ALTAIR_FORK_VERSION from their respective fork
epochs, and GENESIS_FORK_VERSION before. Every later fork adds a branch to
this function. The authoritative definition is
compute_fork_version
in consensus-specs.
compute_fork_digest
def compute_fork_digest(
genesis_validators_root: Root,
epoch: Epoch,
) -> ForkDigest:
"""
Return the 4-byte fork digest for the ``genesis_validators_root`` at a given ``epoch``.
This is a digest primarily used for domain separation on the p2p layer.
4-bytes suffices for practical separation of forks/chains.
"""
fork_version = compute_fork_version(epoch)
base_digest = compute_fork_data_root(fork_version, genesis_validators_root)
return ForkDigest(base_digest[:4])Maximum message sizes
Maximum message sizes are derived from the maximum payload size that the network can carry according to the following functions:
max_compressed_len
def max_compressed_len(n: Uint64) -> Uint64:
# Worst-case compressed length for a given payload of size n when using snappy:
# https://github.com/google/snappy/blob/32ded457c0b1fe78ceb8397632c416568d6714a0/snappy.cc#L218C1-L218C47
return 32 + n + n // 6max_message_size
def max_message_size() -> Uint64:
# Allow 1024 bytes for framing and encoding overhead but at least 1MiB in case MAX_PAYLOAD_SIZE is small.
return max(max_compressed_len(MAX_PAYLOAD_SIZE) + 1024, Uint64(1024 * 1024))MetaData
Clients MUST locally store the following MetaData:
(
seq_number: Uint64
attnets: Attnets
syncnets: Syncnets
)Where
seq_numberis aUint64starting at0used to version the node’s metadata. If any other field in the localMetaDatachanges, the node MUST incrementseq_numberby 1.attnetsis aBitVectorrepresenting the node’s persistent attestation subnet subscriptions.syncnetsis aBitVectorrepresenting the node’s sync committee subnet subscriptions. This field should mirror the data in the node’s ENR as outlined in the validator guide.
Note: MetaData.seq_number is used for versioning of the node’s metadata, is
entirely independent of the ENR sequence number, and will in most cases be out
of sync with the ENR sequence number.
The gossip domain: gossipsub
Clients MUST support the gossipsub v1 libp2p Protocol including the gossipsub v1.1 extension.
Protocol ID: /meshsub/1.1.0
Gossipsub parameters
The following gossipsub parameters will be used:
D(topic stable mesh target count): 8D_low(topic stable mesh low watermark): 6D_high(topic stable mesh high watermark): 12D_lazy(gossip target): 6heartbeat_interval(frequency of heartbeat, seconds): 0.7fanout_ttl(ttl for fanout maps for topics we are not subscribed to but have published to, seconds): 60mcache_len(number of windows to retain full messages in cache forIWANTresponses): 6mcache_gossip(number of windows to gossip about): 3seen_ttl(expiry time for cache of seen message ids, seconds): SLOT_DURATION_MS * SLOTS_PER_EPOCH * 2 // 1000
Note: Gossipsub v1.1 introduces a number of additional parameters for peer scoring and other attack mitigations. These are currently under investigation and will be specified and released to mainnet when they are ready.
Topics and messages
Topics are plain UTF-8 strings and are encoded on the wire as determined by
protobuf (gossipsub messages are enveloped in protobuf messages). Topic strings
have form: /eth2/ForkDigestValue/Name/Encoding. This defines both the type of
data being sent on the topic and how the data field of the message is encoded.
ForkDigestValue- the lowercase hex-encoded (no “0x” prefix) bytes ofcompute_fork_digest(genesis_validators_root, epoch)wheregenesis_validators_rootis the staticRootfound instate.genesis_validators_rootepochis the context epoch of the message to be sent on the topic
Name- see table belowEncoding- the encoding strategy describes a specific representation of bytes that will be transmitted over the wire. See the Encodings section for further details.
Clients MUST reject messages with an unknown topic.
Note: ForkDigestValue is composed of values that are not known until the
genesis block/state are available. Due to this, clients SHOULD NOT subscribe to
gossipsub topics until these genesis values are known.
The optional from (1), seqno (3), signature (5) and key (6) protobuf
fields are omitted from the message, since messages are identified by content,
anonymous, and signed where necessary in the application layer. Starting from
Gossipsub v1.1, clients MUST enforce this by applying the StrictNoSign
signature policy.
Message ID
The message-id of a gossipsub message incorporates the message topic along
with the message data. These are fields of the Message Protobuf, and
interpreted as empty byte strings if missing. The message-id MUST be the
following 20 byte value computed from the message:
- If
message.datahas a valid snappy decompression, setmessage-idto the first 20 bytes of theSHA256hash of the concatenation of the following data:MESSAGE_DOMAIN_VALID_SNAPPY, the length of the topic byte string (encoded as little-endianUint64), the topic byte string, and the snappy decompressed message data: i.e.SHA256(MESSAGE_DOMAIN_VALID_SNAPPY + uint_to_bytes(Uint64(len(message.topic))) + message.topic + snappy_decompress(message.data))[:20]. - Otherwise, set
message-idto the first 20 bytes of theSHA256hash of the concatenation of the following data:MESSAGE_DOMAIN_INVALID_SNAPPY, the length of the topic byte string (encoded as little-endianUint64), the topic byte string, and the raw message data: i.e.SHA256(MESSAGE_DOMAIN_INVALID_SNAPPY + uint_to_bytes(Uint64(len(message.topic))) + message.topic + message.data)[:20].
Where relevant, clients MUST reject messages with message-id sizes other than
20 bytes.
Note: The above logic handles two exceptional cases: (1) multiple snappy
data can decompress to the same value, and (2) some message data can fail to
snappy decompress altogether.
Note: Messages on topics with the Phase 0 fork digest use the
version 0 message-id procedure, which
does not include the topic. Messages on topics with the Altair (or a later)
fork digest use the procedure defined here. If an implementation only supports
a single message-id function, it can define a switch inline; for example,
if topic in phase0_topics: return phase0_msg_id_fn(message) else return altair_msg_id_fn(message).
Topic table
The payload is carried in the data field of a gossipsub message, and varies
depending on the topic. The last column links to the gossip validation function
for the topic in consensus-specs.
| Name | Message Type | Gossip validation |
|---|---|---|
beacon_block | SignedBeaconBlock | validate_beacon_block_gossip |
beacon_aggregate_and_proof | SignedAggregateAndProof | validate_beacon_aggregate_and_proof_gossip |
beacon_attestation_{subnet_id} | SingleAttestation | validate_beacon_attestation_gossip |
voluntary_exit | SignedVoluntaryExit | validate_voluntary_exit_gossip |
proposer_slashing | ProposerSlashing | validate_proposer_slashing_gossip |
attester_slashing | AttesterSlashing | validate_attester_slashing_gossip |
sync_committee_contribution_and_proof | SignedContributionAndProof | validate_sync_committee_contribution_and_proof_gossip |
sync_committee_{subnet_id} | SyncCommitteeMessage | validate_sync_committee_message_gossip |
bls_to_execution_change | SignedBLSToExecutionChange | validate_bls_to_execution_change_gossip |
blob_sidecar_{subnet_id} | BlobSidecar | validate_blob_sidecar_gossip |
The light client topics light_client_finality_update and
light_client_optimistic_update are listed in the
light client networking section.
Note that the ForkDigestValue path segment of the topic separates the
pre-fork and post-fork variants of a topic whose payload type changes at a fork
(e.g. beacon_block, whose SignedBeaconBlock payload changes in Altair).
Clients MUST reject (fail validation) messages containing an incorrect type, or invalid payload.
When processing incoming gossip, clients MAY descore or disconnect peers who fail to observe these constraints.
For any optional queueing, clients SHOULD maintain maximum queue sizes to avoid DoS vectors.
Gossipsub v1.1 introduces
Extended Validators
for the application to aid in the gossipsub peer-scoring scheme. We utilize
ACCEPT, REJECT, and IGNORE. For each gossipsub topic, there are
application specific validations, specified as validate_*_gossip functions in
consensus-specs and linked from the table above and from each topic below. If
all validations pass, return ACCEPT. If one or more validations fail while
processing the items in order, return either REJECT or IGNORE as specified
by the failing condition.
Global topics
There are two primary global topics used to propagate beacon blocks
(beacon_block) and aggregate attestations (beacon_aggregate_and_proof) to
all nodes on the network.
There are four additional global topics that are used to propagate lower
frequency validator messages (voluntary_exit, proposer_slashing,
attester_slashing, and bls_to_execution_change), and one global topic to
propagate partially aggregated sync committee messages
(sync_committee_contribution_and_proof) to all potential proposers of beacon
blocks.
beacon_block
The beacon_block topic is used solely for propagating new signed beacon blocks
to all nodes on the networks. Signed blocks are sent in their entirety. The
payload type is the SignedBeaconBlock of the fork identified by the topic’s
fork digest.
Note: Since Bellatrix, blocks with execution enabled are permitted to propagate regardless of the validity of the execution payload. This prevents network segregation between optimistic and non-optimistic nodes.
Validation:
validate_beacon_block_gossip
beacon_aggregate_and_proof
The beacon_aggregate_and_proof topic is used to propagate aggregated
attestations (as SignedAggregateAndProofs) to subscribing nodes (typically
validators) to be included in future blocks.
Since Deneb (EIP-7045), aggregates
created in epoch N are propagated throughout all of epoch N+1, rather than
only for ATTESTATION_PROPAGATION_SLOT_RANGE slots.
Since Electra (EIP-7549), the
committee index is encoded in aggregate.committee_bits and
aggregate.data.index MUST be zero.
Validation:
validate_beacon_aggregate_and_proof_gossip
voluntary_exit
The voluntary_exit topic is used solely for propagating signed voluntary
validator exits to proposers on the network. Signed voluntary exits are sent in
their entirety.
Since Deneb (EIP-7044), the
signature domain of voluntary exits is locked to CAPELLA_FORK_VERSION so that
exits remain valid across fork boundaries.
Validation:
validate_voluntary_exit_gossip
proposer_slashing
The proposer_slashing topic is used solely for propagating proposer slashings
to proposers on the network. Proposer slashings are sent in their entirety.
Validation:
validate_proposer_slashing_gossip
attester_slashing
The attester_slashing topic is used solely for propagating attester slashings
to proposers on the network. Attester slashings are sent in their entirety.
Since Electra (EIP-7549), the
AttesterSlashing type wraps IndexedAttestations sized for
MAX_VALIDATORS_PER_COMMITTEE * MAX_COMMITTEES_PER_SLOT attesting indices.
Validation:
validate_attester_slashing_gossip
bls_to_execution_change
The bls_to_execution_change topic is used solely for propagating signed BLS to
execution change messages on the network. Signed messages are sent in their
entirety.
Validation:
validate_bls_to_execution_change_gossip
sync_committee_contribution_and_proof
This topic is used to propagate partially aggregated sync committee messages to be included in future blocks.
Validation:
validate_sync_committee_contribution_and_proof_gossip
Attestation subnets
Attestation subnets are used to propagate unaggregated attestations to subsections of the network.
beacon_attestation_{subnet_id}
The beacon_attestation_{subnet_id} topics are used to propagate unaggregated
attestations to the subnet subnet_id (typically beacon and persistent
committees) to be aggregated before being gossiped to
beacon_aggregate_and_proof.
Since Deneb (EIP-7045),
attestations from the previous epoch are propagated through the entire current
epoch rather than only the next ATTESTATION_PROPAGATION_SLOT_RANGE slots.
Since Electra (EIP-7549), the topic
propagates SingleAttestation objects: the attesting validator’s index is
carried directly in the message, the committee index is read from
attestation.committee_index, and attestation.data.index MUST be zero.
Validation:
validate_beacon_attestation_gossip
Attestations and Aggregation
Attestation broadcasting is grouped into subnets defined by a topic. The number
of subnets is defined via ATTESTATION_SUBNET_COUNT. The correct subnet for an
attestation can be calculated with
compute_subnet_for_attestation.
beacon_attestation_{subnet_id} topics, are rotated through throughout the
epoch in a similar fashion to rotating through shards in committees (future
beacon-chain upgrade). The subnets are rotated through with
committees_per_slot = get_committee_count_per_slot(state, attestation.data.target.epoch)
subnets per slot.
Unaggregated attestations are sent as SingleAttestations to the subnet topic,
beacon_attestation_{compute_subnet_for_attestation(committees_per_slot, attestation.data.slot, attestation.committee_index)}.
Aggregated attestations are sent to the beacon_aggregate_and_proof topic as
AggregateAndProofs.
Sync committee subnets
Sync committee subnets are used to propagate unaggregated sync committee messages to subsections of the network.
sync_committee_{subnet_id}
The sync_committee_{subnet_id} topics are used to propagate unaggregated sync
committee messages to the subnet subnet_id to be aggregated before being
gossiped to the global sync_committee_contribution_and_proof topic.
Validation:
validate_sync_committee_message_gossip
Sync committees and aggregation
The aggregation scheme closely follows the design of the attestation aggregation
scheme. Sync committee messages are broadcast into “subnets” defined by a topic.
The number of subnets is defined by SYNC_COMMITTEE_SUBNET_COUNT in the
Altair validator guide. Sync committee
members are divided into “subcommittees” which are then assigned to a subnet
for the duration of tenure in the sync committee. Individual validators can be
duplicated in the broader sync committee such that they are included multiple
times in a given subcommittee or across multiple subcommittees.
Unaggregated messages (along with metadata) are sent as SyncCommitteeMessages
on the sync_committee_{subnet_id} topics. The subnets for a validator are
given by
compute_subnets_for_sync_committee.
Aggregated sync committee messages are packaged into (signed)
SyncCommitteeContribution along with proofs and gossiped to the
sync_committee_contribution_and_proof topic.
Blob subnets
blob_sidecar_{subnet_id}
The blob_sidecar_{subnet_id} topics, where each blob index maps to some
subnet_id, are used solely for propagating new blob sidecars to all nodes on
the networks. BlobSidecars are sent in their entirety. The subnet for a sidecar
is compute_subnet_for_blob_sidecar(blob_sidecar.index), defined in the
Electra validator guide;
since Electra (EIP-7691) there are
BLOB_SIDECAR_SUBNET_COUNT_ELECTRA subnets and the sidecar index is bounded by
MAX_BLOBS_PER_BLOCK_ELECTRA.
Validation:
validate_blob_sidecar_gossip
The ForkDigest context epoch is determined by
compute_epoch_at_slot(blob_sidecar.signed_block_header.message.slot).
Per fork_version = compute_fork_version(epoch):
fork_version | Chunk SSZ type |
|---|---|
DENEB_FORK_VERSION and later | deneb.BlobSidecar |
Blob retrieval via local execution-layer client
In addition to BlobSidecarsByRoot requests, recent blobs MAY be retrieved by
querying the execution layer (i.e. via engine_getBlobsV1). Honest nodes SHOULD
query engine_getBlobsV1 as soon as they receive a valid gossip block that
contains data, and import the returned blobs.
When clients use the local execution layer to retrieve blobs, they MUST behave
as if the corresponding blob_sidecar had been received via gossip. In
particular they MUST:
- Publish the corresponding
blob_sidecaron theblob_sidecar_{subnet_id}subnet. - Update gossip rule related data structures (i.e. update the anti-equivocation cache).
Transitioning the gossip
With any fork, the fork version, and thus the ForkDigestValue, change. Message
types are unique per topic, and so for a smooth transition a node must
temporarily subscribe to both the old and new topics.
The topics that are not removed in a fork are updated with a new
ForkDigestValue. In advance of the fork, a node SHOULD subscribe to the
post-fork variants of the topics.
Subscriptions are expected to be well-received, all updated nodes should subscribe as well. Topic-meshes can be grafted quickly as the nodes are already connected and exchanging gossip control messages.
Messages SHOULD NOT be re-broadcast from one fork to the other. A node’s behavior before the fork and after the fork are as follows:
Pre-fork:
- Peers who propagate messages on the post-fork topics MAY be scored negatively proportionally to time till fork, to account for clock discrepancy.
- Messages can be IGNORED on the post-fork topics, with a
MAXIMUM_GOSSIP_CLOCK_DISPARITYmargin.
Post-fork:
- Peers who propagate messages on the pre-fork topics MUST NOT be scored negatively. Lagging IWANT may force them to.
- Messages on pre and post-fork variants of topics share application-level caches. E.g. an attestation on the both the old and new topic is ignored like any duplicate.
- Two epochs after the fork, pre-fork topics SHOULD be unsubscribed from. This
is well after the configured
seen_ttl.
Encodings
Topics are post-fixed with an encoding. Encodings define how the payload of a gossipsub message is encoded.
ssz_snappy- All objects are SSZ-encoded and then compressed with Snappy block compression. Example: The beacon aggregate attestation topic string is/eth2/446a7232/beacon_aggregate_and_proof/ssz_snappy, the fork digest is446a7232and the data field of a gossipsub message is anAggregateAndProofthat has been SSZ-encoded and then compressed with Snappy.
Snappy has two formats: “block” and “frames” (streaming). Gossip messages remain relatively small (100s of bytes to 100s of kilobytes) so basic snappy block compression is used to avoid the additional overhead associated with snappy frames.
Implementations MUST use a single encoding for gossip. Changing an encoding will require coordination between participating implementations.
Gossipsub size limits
Size limits are placed both on the
RPCMsg
frame as well as the encoded payload in each
Message.
Clients MUST reject and MUST NOT emit or propagate messages whose size exceed the following limits:
- The size of the encoded
RPCMsg(including control messages, framing, topics, etc) must not exceedmax_message_size(). - The size of the compressed payload in the
Message.datafield must not exceedmax_compressed_len(MAX_PAYLOAD_SIZE). - The size of the uncompressed payload must not exceed
MAX_PAYLOAD_SIZEor the type-specific SSZ bound, whichever is lower.
The Req/Resp domain
Protocol identification
Each message type is segregated into its own libp2p protocol ID, which is a case-sensitive UTF-8 string of the form:
/ProtocolPrefix/MessageName/SchemaVersion/EncodingWith:
ProtocolPrefix- messages are grouped into families identified by a shared libp2p protocol name prefix. In this case, we use/eth2/beacon_chain/req.MessageName- each request is identified by a name consisting of English alphabet, digits and underscores (_).SchemaVersion- an ordinal version number (e.g. 1, 2, 3…). Each schema is versioned to facilitate backward and forward-compatibility when possible.Encoding- while the schema defines the data types in more abstract terms, the encoding strategy describes a specific representation of bytes that will be transmitted over the wire. See the Encodings section for further details.
This protocol segregation allows libp2p multistream-select 1.0 /
multiselect 2.0 to handle the request type, version, and encoding negotiation
before establishing the underlying streams.
Req/Resp interaction
We use ONE stream PER request/response interaction. Streams are closed when the interaction finishes, whether in success or in error.
Request/response messages MUST adhere to the encoding specified in the protocol name and follow this structure (relaxed BNF grammar):
request ::= <encoding-dependent-header> | <encoded-payload>
response ::= <response_chunk>*
response_chunk ::= <result> | <context-bytes> | <encoding-dependent-header> | <encoded-payload>
result ::= “0” | “1” | “2” | "3" | [“128” ... ”255”]The encoding-dependent header may carry metadata or assertions such as the encoded payload length, for integrity and attack proofing purposes. Because req/resp streams are single-use and stream closures implicitly delimit the boundaries, it is not strictly necessary to length-prefix payloads; however, certain encodings like SSZ do, for added security.
The <context-bytes> field functions as a short meta-data, defined per
req-resp method, and can parametrize the payload decoder. For the version 0
methods (/1/ schema versions) <context-bytes> is empty. On a non-zero
<result> with ErrorMessage payload, the <context-bytes> is also empty.
ForkDigest-context
SSZ type definitions may change from fork to fork. For this common case, we
define the ForkDigest-context:
A fixed-width 4 byte <context-bytes>, set to the ForkDigest matching the
chunk: compute_fork_digest(genesis_validators_root, epoch). The method
definitions below state how the context epoch is derived for each chunk, and
which SSZ type is selected by each fork version.
A response is formed by zero or more response_chunks. Responses that consist
of a single SSZ-list (such as BlocksByRange and BlocksByRoot) send each list
item as a response_chunk. All other response types (non-Lists) send a single
response_chunk.
For both requests and responses, the encoding-dependent-header MUST be
valid, and the encoded-payload must be valid within the constraints of the
encoding-dependent-header. This includes type-specific bounds on payload size
for some encoding strategies. Regardless of these type specific bounds, a global
maximum uncompressed byte size of MAX_PAYLOAD_SIZE MUST be applied to all
method response chunks.
Clients MUST ensure that lengths are within these bounds; if not, they SHOULD reset the stream immediately. Clients tracking peer reputation MAY decrement the score of the misbehaving peer under this circumstance.
Requesting side
Once a new stream with the protocol ID for the request type has been negotiated, the full request message SHOULD be sent immediately. The request MUST be encoded according to the encoding strategy.
The requester MUST close the write side of the stream once it finishes writing the request message. At this point, the stream will be half-closed.
The requester MUST NOT make more than MAX_CONCURRENT_REQUESTS concurrent
requests with the same protocol ID.
If a timeout occurs or the response is no longer relevant, the requester SHOULD reset the stream.
A requester SHOULD read from the stream until either:
- An error result is received in one of the chunks (the error payload MAY be read before stopping).
- The responder closes the stream.
- Any part of the
response_chunkfails validation. - The maximum number of requested chunks are read.
For requests consisting of a single valid response_chunk, the requester SHOULD
read the chunk fully, as defined by the encoding-dependent-header, before
closing the stream.
Responding side
Once a new stream with the protocol ID for the request type has been negotiated, the responder SHOULD process the incoming request and MUST validate it before processing it. Request processing and validation MUST be done according to the encoding strategy, until EOF (denoting stream half-closure by the requester).
The responder MUST:
- Use the encoding strategy to read the optional header.
- If there are any length assertions for length
N, it should read exactlyNbytes from the stream, at which point an EOF should arise (no more bytes). Should this not be the case, it should be treated as a failure. - Deserialize the expected type, and process the request.
- Write the response which may consist of zero or more
response_chunks (result, optional header, payload). - Close their write side of the stream. At this point, the stream will be fully closed.
If steps (1), (2), or (3) fail due to invalid, malformed, or inconsistent data, the responder MUST respond in error. Clients tracking peer reputation MAY record such failures, as well as unexpected events, e.g. early stream resets.
The responder MAY rate-limit chunks by withholding each chunk until capacity is available. The responder MUST NOT respond with an error or close the stream when rate limiting.
When rate limiting, the responder MUST send each response_chunk in full
promptly but may introduce delays between each chunk.
Chunks start with a single-byte response code which determines the contents
of the response_chunk (result particle in the BNF grammar above). For
multiple chunks, only the last chunk is allowed to have a non-zero error code
(i.e. The chunk stream is terminated once an error occurs).
The response code can have one of the following values, encoded as a single unsigned byte:
- 0: Success — a normal response follows, with contents matching the expected message schema and encoding specified in the request.
- 1: InvalidRequest — the contents of the request are semantically invalid, or the payload is malformed, or could not be understood. The response payload adheres to the schema (described below).
- 2: ServerError — the responder encountered an error while processing the request. The response payload adheres to the schema (described below).
- 3: ResourceUnavailable — the responder does not have requested resource. The response payload adheres to the schema (described below). Note: This response code is only valid as a response where specified.
Clients MAY use response codes above 128 to indicate alternative, erroneous
request-specific responses.
The range [4, 127] is RESERVED for future usages, and should be treated as
error if not recognized expressly.
(
error_message: ErrorMessage
)Note: By convention, the error_message is a sequence of bytes that MAY be
interpreted as a UTF-8 string (for debugging purposes). Clients MUST treat as
valid any byte sequences.
The responder MAY penalise peers that concurrently open more than
MAX_CONCURRENT_REQUESTS streams for the same request type, for the protocol
IDs defined in this specification.
Encoding strategies
The token of the negotiated protocol ID specifies the type of encoding to be used for the req/resp interaction. Only one value is possible at this time:
ssz_snappy: The contents are first SSZ-encoded and then compressed with Snappy frames compression. For objects containing a single field, only the field is SSZ-encoded not a container with a single field. For example, theBeaconBlocksByRootrequest is an SSZ-encoded list ofRoot’s. This encoding type MUST be supported by all clients.
SSZ-snappy encoding strategy
The SimpleSerialize (SSZ) specification outlines how objects are SSZ-encoded.
To achieve snappy encoding on top of SSZ, we feed the serialized form of the object to the Snappy compressor on encoding. The inverse happens on decoding.
Snappy has two formats: “block” and “frames” (streaming). To support large requests and response chunks, snappy-framing is used.
Since snappy frame contents
have a maximum size of 65536 bytes
and frame headers are just identifier (1) + checksum (4) bytes, the expected
buffering of a single frame is acceptable.
Encoding-dependent header: Req/Resp protocols using the ssz_snappy
encoding strategy MUST encode the length of the raw SSZ bytes, encoded as an
unsigned
protobuf varint.
Writing: By first computing and writing the SSZ byte length, the SSZ encoder can then directly write the chunk contents to the stream. When Snappy is applied, it can be passed through a buffered Snappy writer to compress frame by frame.
Reading: After reading the expected SSZ byte length, the SSZ decoder can directly read the contents from the stream. When snappy is applied, it can be passed through a buffered Snappy reader to decompress frame by frame.
Before reading the payload, the header MUST be validated:
- The length-prefix MUST be encoded as an unsigned protobuf varint. It SHOULD be
minimally encoded (i.e., without any redundant bytes) and MUST not exceed 10
bytes in length, which is sufficient to represent any
Uint64value. The length-prefix MUST be decoded into a type which supports the full range ofUint64values. - The length-prefix is within the expected
size bounds derived from the payload SSZ type
or
MAX_PAYLOAD_SIZE, whichever is smaller.
After reading a valid header, the payload MAY be read, while maintaining the size constraints from the header.
A reader MUST NOT read more than max_compressed_len(n) bytes after reading the
SSZ length-prefix n from the header.
A reader MUST consider the following cases as invalid input:
- Any remaining bytes, after having read the
nSSZ bytes. An EOF is expected if more bytes are read than required. - An early EOF, before fully reading the declared length-prefix worth of SSZ bytes.
In case of an invalid input (header or payload), a reader MUST:
- From requests: send back an error message, response code
InvalidRequest. The request itself is ignored. - From responses: ignore the response, the response MUST be considered bad server behavior.
All messages that contain only a single field MUST be encoded directly as the type of that field and MUST NOT be encoded as an SSZ container.
Responses that are SSZ-lists (for example SignedBeaconBlocks) send their
constituents individually as response_chunks. For example, the
SignedBeaconBlocks response type sends zero or more response_chunks. Each
successful response_chunk contains a single SignedBeaconBlock payload.
Messages
Non-faulty, optimistic nodes may send blocks which result in an INVALID response from an execution engine. To prevent network segregation between optimistic and non-optimistic nodes, transmission of an INVALID execution payload via the Req/Resp domain SHOULD NOT cause a node to be down-scored or disconnected. Transmission of a block which is invalid due to any consensus-layer rules (i.e., not execution-layer rules) MAY result in down-scoring or disconnection.
Status v1
Protocol ID: /eth2/beacon_chain/req/status/1/
Request, Response Content:
(
fork_digest: ForkDigest
finalized_root: Root
finalized_epoch: Epoch
head_root: Root
head_slot: Slot
)As seen by the client at the time of sending the message:
fork_digest: The node’sForkDigest(compute_fork_digest(genesis_validators_root, epoch)) wheregenesis_validators_rootis the staticRootfound instate.genesis_validators_rootepochis the node’s current epoch defined by the wall-clock time (not necessarily the epoch to which the node is sync).
finalized_root:store.finalized_checkpoint.rootaccording to fork choice. (Note this defaults toRoot(b'\x00' * 32)for the genesis finalized checkpoint).finalized_epoch:store.finalized_checkpoint.epochaccording to fork choice.head_root: Thehash_tree_rootroot of the current head block (BeaconBlock).head_slot: The slot of the block corresponding to thehead_root.
The dialing client MUST send a Status request upon connection.
The request/response MUST be encoded as an SSZ-container.
The response MUST consist of a single response_chunk.
Clients SHOULD immediately disconnect from one another following the handshake above under the following conditions:
- If
fork_digestdoes not match the node’s localfork_digest, since the client’s chain is on another fork. - If the (
finalized_root,finalized_epoch) shared by the peer is not in the client’s chain at the expected epoch. For example, if Peer 1 sends (root, epoch) of (A, 5) and Peer 2 sends (B, 3) but Peer 1 has root C at epoch 3, then Peer 1 would disconnect because it knows that their chains are irreparably disjoint.
Once the handshake completes, the client with the lower finalized_epoch or
head_slot (if the clients have equal finalized_epochs) SHOULD request beacon
blocks from its counterparty via the BeaconBlocksByRange request.
Note: Under abnormal network condition or after some rounds of
BeaconBlocksByRange requests, the client might need to send Status request
again to learn if the peer has a higher head. Implementers are free to implement
such behavior in their own way.
Goodbye v1
Protocol ID: /eth2/beacon_chain/req/goodbye/1/
Request, Response Content:
(
Uint64
)Client MAY send goodbye messages upon disconnection. The reason field MAY be one of the following values:
- 1: Client shut down.
- 2: Irrelevant network.
- 3: Fault/error.
Clients MAY use reason codes above 128 to indicate alternative, erroneous
request-specific responses.
The range [4, 127] is RESERVED for future usage.
The request/response MUST be encoded as a single SSZ-field.
The response MUST consist of a single response_chunk.
BeaconBlocksByRange v2
Protocol ID: /eth2/beacon_chain/req/beacon_blocks_by_range/2/
Request Content:
(
start_slot: Slot
count: Uint64
step: Uint64 # Deprecated, must be set to 1
)Response Content:
(
SignedBeaconBlocks
)Requests beacon blocks in the slot range [start_slot, start_slot + count),
leading up to the current head block as selected by fork choice. For example,
requesting blocks starting at start_slot=2 and count=4 would return the
blocks at slots [2, 3, 4, 5]. In cases where a slot is empty for a given slot
number, no block is returned. For example, if slot 4 were empty in the previous
example, the returned array would contain [2, 3, 5].
step is deprecated and must be set to 1. Clients may respond with a single
block if a larger step is returned during the deprecation transition period.
BeaconBlocksByRange is primarily used to sync historical blocks.
The request MUST be encoded as an SSZ-container.
The response MUST consist of zero or more response_chunk. Each successful
response_chunk MUST contain a single SignedBeaconBlock payload.
Clients MUST keep a record of signed blocks seen on the epoch range
[max(GENESIS_EPOCH, current_epoch - compute_min_epochs_for_block_requests()), current_epoch]
where current_epoch is defined by the current wall-clock time, and clients
MUST support serving requests of blocks on this range.
compute_min_epochs_for_block_requests
def compute_min_epochs_for_block_requests() -> Uint64:
"""
Return the minimum epoch range over which a node must serve blocks.
"""
return Uint64(MIN_VALIDATOR_WITHDRAWABILITY_DELAY + CHURN_LIMIT_QUOTIENT // 2)Peers that are unable to reply to block requests within the
compute_min_epochs_for_block_requests() epoch range SHOULD respond with error
code 3: ResourceUnavailable. Such peers that are unable to successfully reply
to this range of requests MAY get descored or disconnected at any time.
Note: The above requirement implies that nodes that start from a recent weak
subjectivity checkpoint MUST backfill the local block database to at least epoch
current_epoch - compute_min_epochs_for_block_requests() to be fully compliant
with BlocksByRange requests. To safely perform such a backfill of blocks to
the recent state, the node MUST validate both (1) the proposer signatures and
(2) that the blocks form a valid chain up to the most recent block referenced in
the weak subjectivity state.
Note: Although clients that bootstrap from a weak subjectivity checkpoint can begin participating in the networking immediately, other peers MAY disconnect and/or temporarily ban such an un-synced or semi-synced client.
Clients MUST respond with at least the first block that exists in the range, if
they have it, and no more than MAX_REQUEST_BLOCKS_DENEB blocks.
The following blocks, where they exist, MUST be sent in consecutive order.
Clients MAY limit the number of blocks in the response.
The response MUST contain no more than count blocks.
Clients MUST respond with blocks from their view of the current fork choice —
that is, blocks from the single chain defined by the current head. Of note,
blocks from slots before the finalization MUST lead to the finalized block
reported in the Status handshake.
Clients MUST respond with blocks that are consistent from a single chain within
the context of the request. This applies to any step value. In particular when
step == 1, each parent_root MUST match the hash_tree_root of the preceding
block.
After the initial block, clients MAY stop in the process of responding if their fork choice changes the view of the chain in the context of the request.
A ForkDigest-context is used to select the fork namespace of the Response
type. For each successful response_chunk, the ForkDigest context epoch is
determined by compute_epoch_at_slot(signed_beacon_block.message.slot).
Per fork_version = compute_fork_version(epoch):
fork_version | Chunk SSZ type |
|---|---|
GENESIS_FORK_VERSION | phase0.SignedBeaconBlock |
ALTAIR_FORK_VERSION | altair.SignedBeaconBlock |
BELLATRIX_FORK_VERSION | bellatrix.SignedBeaconBlock |
CAPELLA_FORK_VERSION | capella.SignedBeaconBlock |
DENEB_FORK_VERSION | deneb.SignedBeaconBlock |
ELECTRA_FORK_VERSION | electra.SignedBeaconBlock |
BeaconBlocksByRoot v2
Protocol ID: /eth2/beacon_chain/req/beacon_blocks_by_root/2/
Request Content:
(
BeaconBlockRoots
)Response Content:
(
SignedBeaconBlocks
)Requests blocks by block root (= hash_tree_root(SignedBeaconBlock.message)).
The response is a list of SignedBeaconBlock whose length is less than or equal
to the number of requested blocks. It may be less in the case that the
responding peer is missing blocks.
No more than MAX_REQUEST_BLOCKS_DENEB may be requested at a time.
BeaconBlocksByRoot is primarily used to recover recent blocks (e.g. when
receiving a block or attestation whose parent is unknown).
The request MUST be encoded as an SSZ-field.
The response MUST consist of zero or more response_chunk. Each successful
response_chunk MUST contain a single SignedBeaconBlock payload.
Clients MUST support requesting blocks on the epoch range
[max(GENESIS_EPOCH, current_epoch - compute_min_epochs_for_block_requests()), current_epoch].
If any root in the request content references a block earlier than this range,
peers MAY respond with error code 3: ResourceUnavailable or not include the
block in the response.
Clients MUST respond with at least one block, if they have it. Clients MAY limit the number of blocks in the response.
Clients SHOULD include a block in the response as soon as it passes the gossip validation rules. Clients SHOULD NOT respond with blocks that fail the beacon-chain state transition.
A ForkDigest-context is used to select the fork namespace of the Response
type. For each successful response_chunk, the ForkDigest context epoch is
determined by compute_epoch_at_slot(signed_beacon_block.message.slot).
Per fork_version = compute_fork_version(epoch):
fork_version | Chunk SSZ type |
|---|---|
GENESIS_FORK_VERSION | phase0.SignedBeaconBlock |
ALTAIR_FORK_VERSION | altair.SignedBeaconBlock |
BELLATRIX_FORK_VERSION | bellatrix.SignedBeaconBlock |
CAPELLA_FORK_VERSION | capella.SignedBeaconBlock |
DENEB_FORK_VERSION | deneb.SignedBeaconBlock |
ELECTRA_FORK_VERSION | electra.SignedBeaconBlock |
BlobSidecarsByRange v1
Protocol ID: /eth2/beacon_chain/req/blob_sidecars_by_range/1/
Request Content:
(
start_slot: Slot
count: Uint64
)Response Content:
(
BlobSidecars
)Requests blob sidecars in the slot range [start_slot, start_slot + count),
leading up to the current head block as selected by fork choice.
Before consuming the next response chunk, the response reader SHOULD verify the
blob sidecar is well-formatted, has valid inclusion proof, and is correct w.r.t.
the expected KZG commitments through kzg.verify_blob_kzg_proof.
BlobSidecarsByRange is primarily used to sync blobs that may have been missed
on gossip and to sync within the MIN_EPOCHS_FOR_BLOB_SIDECARS_REQUESTS window.
The request MUST be encoded as an SSZ-container.
The response MUST consist of zero or more response_chunk. Each successful
response_chunk MUST contain a single BlobSidecar payload.
Let blob_serve_range be
[max(current_epoch - MIN_EPOCHS_FOR_BLOB_SIDECARS_REQUESTS, DENEB_FORK_EPOCH), current_epoch].
Clients MUST keep a record of blob sidecars seen on the epoch range
blob_serve_range where current_epoch is defined by the current wall-clock
time, and clients MUST support serving requests of blobs on this range.
Peers that are unable to reply to blob sidecar requests within the range
blob_serve_range SHOULD respond with error code 3: ResourceUnavailable. Such
peers that are unable to successfully reply to this range of requests MAY get
descored or disconnected at any time.
Note: The above requirement implies that nodes that start from a recent weak
subjectivity checkpoint MUST backfill the local blobs database to at least the
range blob_serve_range to be fully compliant with BlobSidecarsByRange
requests.
Note: Although clients that bootstrap from a weak subjectivity checkpoint can begin participating in the networking immediately, other peers MAY disconnect and/or temporarily ban such an un-synced or semi-synced client.
Clients MUST respond with at least the blob sidecars of the first blob-carrying
block that exists in the range, if they have it, and no more than
compute_max_request_blob_sidecars() sidecars.
Clients MUST include all blob sidecars of each block from which they include blob sidecars.
The following blob sidecars, where they exist, MUST be sent in consecutive
(slot, index) order.
Slots that do not contain known blobs MUST be skipped, mimicking the behaviour
of the BlocksByRange request. Only response chunks with known blobs should
therefore be sent.
Clients MAY limit the number of blob sidecars in the response.
The response MUST contain no more than count * MAX_BLOBS_PER_BLOCK_ELECTRA
blob sidecars.
Clients MUST respond with blob sidecars from their view of the current fork
choice — that is, blob sidecars as included by blocks from the single chain
defined by the current head. Of note, blocks from slots before the finalization
MUST lead to the finalized block reported in the Status handshake.
Clients MUST respond with blob sidecars that are consistent from a single chain within the context of the request.
After the initial blob sidecar, clients MAY stop in the process of responding if their fork choice changes the view of the chain in the context of the request.
For each successful response_chunk, the ForkDigest context epoch is
determined by
compute_epoch_at_slot(blob_sidecar.signed_block_header.message.slot).
Per fork_version = compute_fork_version(epoch):
fork_version | Chunk SSZ type |
|---|---|
DENEB_FORK_VERSION and later | deneb.BlobSidecar |
BlobSidecarsByRoot v1
Protocol ID: /eth2/beacon_chain/req/blob_sidecars_by_root/1/
Request Content:
(
BlobIdentifiers
)Response Content:
(
BlobSidecars
)Requests sidecars by block root and index. The response is a list of
BlobSidecar whose length is less than or equal to the number of requests. It
may be less in the case that the responding peer is missing blocks or sidecars.
Before consuming the next response chunk, the response reader SHOULD verify the
blob sidecar is well-formatted, has valid inclusion proof, and is correct w.r.t.
the expected KZG commitments through kzg.verify_blob_kzg_proof.
No more than compute_max_request_blob_sidecars() may be requested at a time.
BlobSidecarsByRoot is primarily used to recover recent blobs (e.g. when
receiving a block with a transaction whose corresponding blob is missing).
The response MUST consist of zero or more response_chunk. Each successful
response_chunk MUST contain a single BlobSidecar payload.
Clients MUST support requesting sidecars since minimum_request_epoch, where
minimum_request_epoch = max(current_epoch - MIN_EPOCHS_FOR_BLOB_SIDECARS_REQUESTS, DENEB_FORK_EPOCH).
If any root in the request content references a block earlier than
minimum_request_epoch, peers MAY respond with error code
3: ResourceUnavailable or not include the blob sidecar in the response.
Clients MUST respond with at least one sidecar, if they have it. Clients MAY limit the number of blocks and sidecars in the response.
Clients SHOULD include a sidecar in the response as soon as it passes the gossip validation rules. Clients SHOULD NOT respond with sidecars related to blocks that fail gossip validation rules. Clients SHOULD NOT respond with sidecars related to blocks that fail the beacon-chain state transition
For each successful response_chunk, the ForkDigest context epoch is
determined by
compute_epoch_at_slot(blob_sidecar.signed_block_header.message.slot).
Per fork_version = compute_fork_version(epoch):
fork_version | Chunk SSZ type |
|---|---|
DENEB_FORK_VERSION and later | deneb.BlobSidecar |
Ping v1
Protocol ID: /eth2/beacon_chain/req/ping/1/
Request Content:
(
Uint64
)Response Content:
(
Uint64
)Sent intermittently, the Ping protocol checks liveness of connected peers.
Peers request and respond with their local metadata sequence number
(MetaData.seq_number).
If the peer does not respond to the Ping request, the client MAY disconnect
from the peer.
A client can then determine if their local record of a peer’s MetaData is up to
date and MAY request an updated version via the MetaData RPC method if not.
The request MUST be encoded as an SSZ-field.
The response MUST consist of a single response_chunk.
GetMetaData v2
Protocol ID: /eth2/beacon_chain/req/metadata/2/
No Request Content.
Response Content:
(
MetaData
)Requests the MetaData of a peer, using the MetaData definition
given above. The request opens and negotiates the stream without sending any
request content. Once established the receiving peer responds with it’s local
most up-to-date MetaData.
The response MUST be encoded as an SSZ-container.
The response MUST consist of a single response_chunk.
The discovery domain: discv5
Discovery Version 5 (discv5) (Protocol version v5.1) is used for peer discovery.
discv5 is a standalone protocol, running on UDP on a dedicated port, meant for
peer discovery only. discv5 supports self-certified, flexible peer records
(ENRs) and topic-based advertisement, both of which are (or will be)
requirements in this context.
Integration into libp2p stacks
discv5 SHOULD be integrated into the client’s libp2p stack by implementing an
adaptor to make it conform to the
service discovery
and
peer routing
abstractions and interfaces (go-libp2p links provided).
Inputs to operations include peer IDs (when locating a specific peer) or capabilities (when searching for peers with a specific capability), and the outputs will be multiaddrs converted from the ENR records returned by the discv5 backend.
This integration enables the libp2p stack to subsequently form connections and streams with discovered peers.
ENR structure
The Ethereum Node Record (ENR) for an Ethereum consensus client MUST contain the following entries (exclusive of the sequence number and signature, which MUST be present in an ENR):
- The compressed secp256k1 publickey, 33 bytes (
secp256k1field).
The ENR MAY contain the following entries:
- An IPv4 address (
ipfield) and/or IPv6 address (ip6field). - An IPv4 QUIC port (
quicfield) representing the local libp2p QUIC (UDP) listening port and/or the corresponding IPv6 port (quic6field). - An IPv4 TCP port (
tcpfield) representing the local libp2p TCP listening port and/or the corresponding IPv6 port (tcp6field). - An IPv4 UDP port (
udpfield) representing the local discv5 listening port and/or the corresponding IPv6 port (udp6field).
Specifications of these parameters can be found in the ENR Specification.
In addition, the ENR carries the consensus-layer specific entries described below.
| Key | Value | Requirement |
|---|---|---|
eth2 | ENRForkID | MUST |
attnets | Attnets | see below |
syncnets | Syncnets | see below |
Attestation subnet bitfield
The ENR attnets entry signifies the attestation subnet bitfield with the
following form to more easily discover peers participating in particular
attestation gossip subnets.
| Key | Value |
|---|---|
attnets | Attnets |
If a node’s MetaData.attnets has any non-zero bit, the ENR MUST include the
attnets entry with the same value as MetaData.attnets.
If a node’s MetaData.attnets is composed of all zeros, the ENR MAY optionally
include the attnets entry or leave it out entirely.
Sync committee bitfield
An additional bitfield is added to the ENR under the key syncnets to
facilitate sync committee subnet discovery. The length of this bitfield is
SYNC_COMMITTEE_SUBNET_COUNT where each bit corresponds to a distinct
subnet_id for a specific sync committee subnet. The ith bit is set in this
bitfield if the validator is currently subscribed to the sync_committee_{i}
topic.
| Key | Value |
|---|---|
syncnets | Syncnets |
See the validator document for further details on how the new bits are used.
eth2 field
ENRs MUST carry a generic eth2 key with an 16-byte value of the node’s current
fork digest, next fork version, and next fork epoch to ensure connections are
made with peers on the intended Ethereum network.
| Key | Value |
|---|---|
eth2 | ENRForkID |
Specifically, the value of the eth2 key MUST be the following SSZ encoded
object (ENRForkID)
(
fork_digest: ForkDigest
next_fork_version: Version
next_fork_epoch: Epoch
)The fields of ENRForkID are defined as
fork_digestiscompute_fork_digest(genesis_validators_root, epoch)where:genesis_validators_rootis the staticRootfound instate.genesis_validators_root.epochis the node’s current epoch defined by the wall-clock time (not necessarily the epoch to which the node is sync).
next_fork_versionis the fork version corresponding to the next planned hard fork at a future epoch. If no future fork is planned, setnext_fork_version = current_fork_versionto signal this factnext_fork_epochis the epoch at which the next fork is planned and thecurrent_fork_versionwill be updated. If no future fork is planned, setnext_fork_epoch = FAR_FUTURE_EPOCHto signal this fact
Note: fork_digest is composed of values that are not known until the genesis
block/state are available. Due to this, clients SHOULD NOT form ENRs and begin
peer discovery until genesis values are known. One notable exception to this
rule is the distribution of bootnode ENRs prior to genesis. In this case,
bootnode ENRs SHOULD be initially distributed with eth2 field set as
ENRForkID(fork_digest=compute_fork_digest(b'\x00'*32, GENESIS_EPOCH), next_fork_version=GENESIS_FORK_VERSION, next_fork_epoch=FAR_FUTURE_EPOCH).
After genesis values are known, the bootnodes SHOULD update ENRs to participate
in normal discovery operations.
Clients SHOULD connect to peers with fork_digest, next_fork_version, and
next_fork_epoch that match local values.
Clients MAY connect to peers with the same fork_digest but a different
next_fork_version/next_fork_epoch. Unless ENRForkID is manually updated to
matching prior to the earlier next_fork_epoch of the two clients, these
connecting clients will be unable to successfully interact starting at the
earlier next_fork_epoch.
Subnet subscription
Attestation subnet subscription
Because Phase 0 does not have shards and thus does not have Shard Committees,
there is no stable backbone to the attestation subnets
(beacon_attestation_{subnet_id}). To provide this stability, each beacon node
should:
- Remain subscribed to
SUBNETS_PER_NODEforEPOCHS_PER_SUBNET_SUBSCRIPTIONepochs. - Maintain advertisement of the selected subnets in their node’s ENR
attnetsentry by setting the selectedsubnet_idbits toTrue(e.g.ENR["attnets"][subnet_id] = True) for all persistent attestation subnets. - Select these subnets based on their node-id as specified by the following
compute_subscribed_subnets(node_id, epoch)function.
def compute_attestation_subnet_prefix_bits() -> Uint64:
"""
Return the number of NodeId bits to use when mapping to a subscribed subnet.
"""
return ceillog2(ATTESTATION_SUBNET_COUNT) + ATTESTATION_SUBNET_EXTRA_BITSdef compute_subscribed_subnet(node_id: NodeID, epoch: Epoch, index: int) -> SubnetID:
prefix_bits = int(compute_attestation_subnet_prefix_bits())
node_id_prefix = node_id >> int(NODE_ID_BITS - prefix_bits)
node_offset = Uint64(node_id % Uint256(EPOCHS_PER_SUBNET_SUBSCRIPTION))
permutation_seed = sha256(
uint_to_bytes(Uint64((epoch + node_offset) // EPOCHS_PER_SUBNET_SUBSCRIPTION))
)
permutated_prefix = compute_shuffled_index(
Uint64(node_id_prefix),
Uint64(1 << prefix_bits),
permutation_seed,
)
return SubnetID((permutated_prefix + index) % ATTESTATION_SUBNET_COUNT)def compute_subscribed_subnets(node_id: NodeID, epoch: Epoch) -> Sequence[SubnetID]:
return [compute_subscribed_subnet(node_id, epoch, index) for index in range(SUBNETS_PER_NODE)]Note: When preparing for an upgrade, a node must select and subscribe to
subnets of the future fork versioning at least EPOCHS_PER_SUBNET_SUBSCRIPTION
epochs in advance of the upgrade. These new subnets for the fork are maintained
in addition to those for the current fork until the fork occurs. After the fork
occurs, let the subnets from the previous fork reach the end of life with no
replacements.
Sync committee subnet subscription
Nodes with validators in the current or next sync committee subscribe to the
sync_committee_{subnet_id} topics of their subcommittees and advertise them
in the ENR syncnets entry, as specified in
Sync committee subnet stability
of the Altair validator guide.
Light client networking
This section is optional. It extends the networking specification with additional messages, topics and data in the Req/Resp and gossip domains that allow light clients to stay in sync with the network. Full nodes SHOULD support it; light clients using libp2p MUST.
Light client gossip topics
Gossip meshes are added to allow light clients to stay in sync with the network. New global topics are added to provide light clients with the latest updates.
| Name | Message Type |
|---|---|
light_client_finality_update | LightClientFinalityUpdate |
light_client_optimistic_update | LightClientOptimisticUpdate |
light_client_finality_update
This topic is used to propagate the latest LightClientFinalityUpdate to light
clients, allowing them to keep track of the latest finalized_header.
The following validations MUST pass before forwarding the finality_update on
the network.
- [IGNORE] The
finalized_header.beacon.slotis greater than that of all previously forwardedfinality_updates, or it matches the highest previously forwarded slot and also has async_aggregateindicating supermajority (> 2/3) sync committee participation while the previously forwardedfinality_updatefor that slot did not indicate supermajority - [IGNORE] The
finality_updateis received after the block atsignature_slotwas given enough time to propagate through the network — i.e. validatate thatget_sync_message_due_ms()milliseconds (with aMAXIMUM_GOSSIP_CLOCK_DISPARITYallowance) has transpired since the start ofsignature_slot.
For full nodes, the following validations MUST additionally pass before
forwarding the finality_update on the network.
- [IGNORE] The received
finality_updatematches the locally computed one exactly (as defined increate_light_client_finality_update)
For light clients, the following validations MUST additionally pass before
forwarding the finality_update on the network.
- [REJECT] The
finality_updateis valid — i.e. validate thatprocess_light_client_finality_updatedoes not indicate errors - [IGNORE] The
finality_updateadvances thefinalized_headerof the localLightClientStore— i.e. validate that processingfinality_updateincreasesstore.finalized_header.beacon.slot
Light clients SHOULD call process_light_client_finality_update even if the
message is ignored.
The ForkDigest context epoch is determined by
compute_epoch_at_slot(finality_update.attested_header.beacon.slot).
Per fork_version = compute_fork_version(epoch):
fork_version | Message SSZ type |
|---|---|
GENESIS_FORK_VERSION | n/a |
ALTAIR_FORK_VERSION through BELLATRIX_FORK_VERSION | altair.LightClientFinalityUpdate |
CAPELLA_FORK_VERSION | capella.LightClientFinalityUpdate |
DENEB_FORK_VERSION | deneb.LightClientFinalityUpdate |
ELECTRA_FORK_VERSION and later | electra.LightClientFinalityUpdate |
light_client_optimistic_update
This topic is used to propagate the latest LightClientOptimisticUpdate to
light clients, allowing them to keep track of the latest optimistic_header.
The following validations MUST pass before forwarding the optimistic_update on
the network.
- [IGNORE] The
attested_header.beacon.slotis greater than that of all previously forwardedoptimistic_updates - [IGNORE] The
optimistic_updateis received after the block atsignature_slotwas given enough time to propagate through the network — i.e. validatate thatget_sync_message_due_ms()milliseconds (with aMAXIMUM_GOSSIP_CLOCK_DISPARITYallowance) has transpired since the start ofoptimistic_update.signature_slot.
For full nodes, the following validations MUST additionally pass before
forwarding the optimistic_update on the network.
- [IGNORE] The received
optimistic_updatematches the locally computed one exactly (as defined increate_light_client_optimistic_update)
For light clients, the following validations MUST additionally pass before
forwarding the optimistic_update on the network.
- [REJECT] The
optimistic_updateis valid — i.e. validate thatprocess_light_client_optimistic_updatedoes not indicate errors - [IGNORE] The
optimistic_updateeither matches corresponding fields of the most recently forwardedLightClientFinalityUpdate(if any), or it advances theoptimistic_headerof the localLightClientStore— i.e. validate that processingoptimistic_updateincreasesstore.optimistic_header.beacon.slot
Light clients SHOULD call process_light_client_optimistic_update even if the
message is ignored.
The ForkDigest context epoch is determined by
compute_epoch_at_slot(optimistic_update.attested_header.beacon.slot).
Per fork_version = compute_fork_version(epoch):
fork_version | Message SSZ type |
|---|---|
GENESIS_FORK_VERSION | n/a |
ALTAIR_FORK_VERSION through BELLATRIX_FORK_VERSION | altair.LightClientOptimisticUpdate |
CAPELLA_FORK_VERSION | capella.LightClientOptimisticUpdate |
DENEB_FORK_VERSION | deneb.LightClientOptimisticUpdate |
ELECTRA_FORK_VERSION and later | electra.LightClientOptimisticUpdate |
Light client Req/Resp methods
GetLightClientBootstrap v1
Protocol ID: /eth2/beacon_chain/req/light_client_bootstrap/1/
Request Content:
(
Root
)Response Content:
(
LightClientBootstrap
)Requests the LightClientBootstrap structure corresponding to a given
post-Altair beacon block root.
The request MUST be encoded as an SSZ-field.
Peers SHOULD provide results as defined in
create_light_client_bootstrap.
To fulfill a request, the requested block and its post state need to be known.
When a LightClientBootstrap instance cannot be produced for a given block
root, peers SHOULD respond with error code 3: ResourceUnavailable.
For each successful response_chunk, the ForkDigest context epoch is
determined by compute_epoch_at_slot(bootstrap.header.beacon.slot).
Per fork_version = compute_fork_version(epoch):
fork_version | Response SSZ type |
|---|---|
GENESIS_FORK_VERSION | n/a |
ALTAIR_FORK_VERSION through BELLATRIX_FORK_VERSION | altair.LightClientBootstrap |
CAPELLA_FORK_VERSION | capella.LightClientBootstrap |
DENEB_FORK_VERSION | deneb.LightClientBootstrap |
ELECTRA_FORK_VERSION and later | electra.LightClientBootstrap |
LightClientUpdatesByRange v1
Protocol ID: /eth2/beacon_chain/req/light_client_updates_by_range/1/
Request Content:
(
start_period: Uint64
count: Uint64
)Response Content:
(
LightClientUpdates
)Requests the LightClientUpdate instances in the sync committee period range
[start_period, start_period + count), leading up to the current head sync
committee period as selected by fork choice.
The request MUST be encoded as an SSZ-container.
The response MUST consist of zero or more response_chunk. Each successful
response_chunk MUST contain a single LightClientUpdate payload.
Peers SHOULD provide results as defined in
create_light_client_update.
They MUST respond with at least the earliest known result within the requested
range, and MUST send results in consecutive order (by period). The response
MUST NOT contain more than min(MAX_REQUEST_LIGHT_CLIENT_UPDATES, count)
results.
For each successful response_chunk, the ForkDigest context epoch is
determined by compute_epoch_at_slot(update.attested_header.beacon.slot). Note
that the context epoch may differ from the one used to verify the
update.sync_aggregate, which is based on update.signature_slot.
Per fork_version = compute_fork_version(epoch):
fork_version | Response chunk SSZ type |
|---|---|
GENESIS_FORK_VERSION | n/a |
ALTAIR_FORK_VERSION through BELLATRIX_FORK_VERSION | altair.LightClientUpdate |
CAPELLA_FORK_VERSION | capella.LightClientUpdate |
DENEB_FORK_VERSION | deneb.LightClientUpdate |
ELECTRA_FORK_VERSION and later | electra.LightClientUpdate |
GetLightClientFinalityUpdate v1
Protocol ID: /eth2/beacon_chain/req/light_client_finality_update/1/
No Request Content.
Response Content:
(
LightClientFinalityUpdate
)Requests the latest LightClientFinalityUpdate known by a peer.
Peers SHOULD provide results as defined in
create_light_client_finality_update.
When no LightClientFinalityUpdate is available, peers SHOULD respond with
error code 3: ResourceUnavailable.
For each successful response_chunk, the ForkDigest context epoch is
determined by
compute_epoch_at_slot(finality_update.attested_header.beacon.slot). Note that
the context epoch may differ from the one used to verify the
finality_update.sync_aggregate, which is based on
finality_update.signature_slot.
Per fork_version = compute_fork_version(epoch):
fork_version | Response SSZ type |
|---|---|
GENESIS_FORK_VERSION | n/a |
ALTAIR_FORK_VERSION through BELLATRIX_FORK_VERSION | altair.LightClientFinalityUpdate |
CAPELLA_FORK_VERSION | capella.LightClientFinalityUpdate |
DENEB_FORK_VERSION | deneb.LightClientFinalityUpdate |
ELECTRA_FORK_VERSION and later | electra.LightClientFinalityUpdate |
GetLightClientOptimisticUpdate v1
Protocol ID: /eth2/beacon_chain/req/light_client_optimistic_update/1/
No Request Content.
Response Content:
(
LightClientOptimisticUpdate
)Requests the latest LightClientOptimisticUpdate known by a peer.
Peers SHOULD provide results as defined in
create_light_client_optimistic_update.
When no LightClientOptimisticUpdate is available, peers SHOULD respond with
error code 3: ResourceUnavailable.
For each successful response_chunk, the ForkDigest context epoch is
determined by
compute_epoch_at_slot(optimistic_update.attested_header.beacon.slot). Note
that the context epoch may differ from the one used to verify the
optimistic_update.sync_aggregate, which is based on
optimistic_update.signature_slot.
Per fork_version = compute_fork_version(epoch):
fork_version | Response SSZ type |
|---|---|
GENESIS_FORK_VERSION | n/a |
ALTAIR_FORK_VERSION through BELLATRIX_FORK_VERSION | altair.LightClientOptimisticUpdate |
CAPELLA_FORK_VERSION | capella.LightClientOptimisticUpdate |
DENEB_FORK_VERSION | deneb.LightClientOptimisticUpdate |
ELECTRA_FORK_VERSION and later | electra.LightClientOptimisticUpdate |
Light client and full node behaviour
Light clients using libp2p to stay in sync with the network SHOULD subscribe to
the light_client_finality_update and
light_client_optimistic_update pubsub
topics and validate all received messages while the
light client sync process
supports processing LightClientFinalityUpdate and
LightClientOptimisticUpdate structures.
Light clients MAY also collect historic light client data and make it available
to other peers. If they do, they SHOULD advertise supported message endpoints in
the light client Req/Resp domain, and MAY also
update the contents of their Status message to reflect the
locally available light client data.
If only limited light client data is locally available, the light client SHOULD
use data based on genesis_block and GENESIS_SLOT in its Status message.
Hybrid peers that also implement full node functionality MUST only incorporate
data based on their full node sync progress into their Status message.
All full nodes SHOULD subscribe to and provide stability on the
light_client_finality_update and light_client_optimistic_update pubsub
topics by validating all received messages.
Whenever fork choice selects a new head block with a sync aggregate
participation >= MIN_SYNC_COMMITTEE_PARTICIPANTS and a post-Altair parent
block, full nodes with at least one validator assigned to the current sync
committee at the block’s slot SHOULD broadcast derived light client data as
follows:
- If
finalized_header.beacon.slotincreased, aLightClientFinalityUpdateSHOULD be broadcasted to the pubsub topiclight_client_finality_updateif no matching message has not yet been forwarded as part of gossip validation. - If
attested_header.beacon.slotincreased, aLightClientOptimisticUpdateSHOULD be broadcasted to the pubsub topiclight_client_optimistic_updateif no matching message has not yet been forwarded as part of gossip validation.
These messages SHOULD be broadcasted get_sync_message_due_ms() milliseconds
after the start of the slot. To ensure that the corresponding block was given
enough time to propagate through the network, they SHOULD NOT be sent earlier.
Note that this is different from how other messages are handled, e.g.,
attestations, which may be sent early.
Change log
Version 4 (Electra, May 2025)
Electra changes the attestation and blob gossip:
- EIP-7549: the
beacon_attestation_{subnet_id}payload becomesSingleAttestation; thebeacon_aggregate_and_proofandattester_slashingpayloads change to the ElectraSignedAggregateAndProofandAttesterSlashingtypes with the committee index moved out ofAttestationData. - EIP-7691: the number of blob
sidecar subnets increases from 6 to 9 (
BLOB_SIDECAR_SUBNET_COUNT_ELECTRA), andcompute_max_request_blob_sidecarsand theBlobSidecarsByRangeresponse bound useMAX_BLOBS_PER_BLOCK_ELECTRA. - The
beacon_blockpayload type changes to the ElectraSignedBeaconBlock; an Electra row is added to theForkDigest-context tables and the light client type tables.
Version 3 (Deneb, March 2024)
Deneb (EIP-4844, blobs) adds blob sidecar distribution and changes attestation propagation:
- New subnet topics
blob_sidecar_{subnet_id}(BLOB_SIDECAR_SUBNET_COUNT= 6) carryingBlobSidecarmessages, and theBlobSidecar,BlobIdentifierandKZGCommitmentInclusionProofwire types. - New methods
BlobSidecarsByRangev1 andBlobSidecarsByRootv1, served for at leastMIN_EPOCHS_FOR_BLOB_SIDECARS_REQUESTSepochs. MAX_REQUEST_BLOCKS_DENEB(128) replacesMAX_REQUEST_BLOCKS(1024) as the block request limit;BeaconBlockRootsandSignedBeaconBlocksare bounded accordingly.- Attestations and aggregates are propagated for the whole of the following epoch (EIP-7045); voluntary exit signatures are locked to the Capella domain (EIP-7044).
- Recent blobs MAY be retrieved from the local execution layer via
engine_getBlobsV1and republished as sidecars. - A Deneb row is added to the
ForkDigest-context tables and the light client type tables.
Version 2 (Bellatrix, September 2022; Capella, April 2023)
Bellatrix (EIP-3675, the Merge)
introduced no change to the set of topics, methods or configuration. The
beacon_block payload type changed to the Bellatrix SignedBeaconBlock
carrying an execution payload, blocks with invalid execution payloads are
allowed to propagate over gossip and Req/Resp, and a Bellatrix row was added to
the ForkDigest-context tables. See the
rationale for the message size discussion
around Bellatrix.
Capella (EIP-4895, withdrawals) adds:
- The global topic
bls_to_execution_changecarryingSignedBLSToExecutionChangemessages. - The
beacon_blockpayload type changes to the CapellaSignedBeaconBlock; a Capella row is added to theForkDigest-context tables ofBeaconBlocksByRangev2 andBeaconBlocksByRootv2 and to the light client type tables. - The version 0 methods deprecated in version 1 (
/1/variants ofBeaconBlocksByRange,BeaconBlocksByRootandGetMetaData) are removed from this specification.
Version 1 (Altair, October 2021)
Altair adds new messages, topics and data to the Req/Resp, gossip and discovery domains:
- The gossipsub
message-idnow covers the topic string in addition to the message data. - New global topic
sync_committee_contribution_and_proofand new subnet topicssync_committee_{subnet_id}carry the sync committee protocol. Thebeacon_blockpayload type changes to the AltairSignedBeaconBlock. - Req/Resp response chunks gain a
<context-bytes>field.BeaconBlocksByRangeandBeaconBlocksByRootmove to schema version 2 with aForkDigest-context selecting the block type per chunk;GetMetaDatamoves to version 2 to carry the extendedMetaData. The/1/variants are deprecated. MetaDataand the ENR gain asyncnetsbitfield.- Optional light client networking: topics
light_client_finality_updateandlight_client_optimistic_update, and theGetLightClientBootstrap,LightClientUpdatesByRange,GetLightClientFinalityUpdateandGetLightClientOptimisticUpdatemethods.