specific method · filed under model architecture
Identity Hyper-Connections
An identity form of Hyper-Connections used to expand inter-layer information flow.
Also called iHC (identity Hyper-Connections), Identity Hyper-Connections (iHC).
- sources
- 3
- model
- 1
- lab adopt it
- 1
- strongest
- core
How sources treat it
One count per evidence span, weakest treatment to strongest.
Documented in
Further reading
Picked by hand, not extracted: where to read more, not evidence for anything on this page.
- Hyper-Connections (Zhu et al., 2024) paper arxiv.orgthe hyper-connections that iHC builds on
Evidence
3 spans quoted from the sources, strongest treatment first.
The residual pathway uses iHC (identity Hyper-Connections) to expand inter-layer information flow
The residual pathway uses iHC (identity Hyper-Connections) to expand inter-layer information flow.
The residual pathway uses iHC (identity Hyper-Connections) to expand inter-layer information flow.
Filed alongside
Other methods under model architecture :: normalization & residual.