Back

AI

OV Circuits

Understanding the OV circuit from the famous "A Mathematical Framework for Transformer Circuits" paper.

OV Circuits
Unbatching Attention

Unbatching the attention mechanism so that each head is calculated individually

Unbatching Attention
Multi Arm Bandits

Article

Multi Arm Bandits
Exploring Object Detection

Exploring Object Detection
Deriving the Back Propagation of the Softmax Function in Matrix Form

Deriving the Back Propagation of the Softmax Function in Matrix Form
Deriving Back Propagation in Matrix Form

Article

Deriving Back Propagation in Matrix Form