AI Explorer

Each position gathers information from the positions before it.

Tap a token: every arc runs to the left, never to the right.

Who looks back at whom

Simulated
  1. 1Score: how relevant?
  2. 2Weight: shares of 100%
  3. 3Mix: blend by share

"it" looks back at "dog" 94%, itself 3%, "because" 1%.

Pattern:

A word like "it" looks back at the noun it stands for. Found in: Vaswani et al. 2017, Figure 4