Generating AI answer…
Arjun Kocher
. ♡ 1.6k ◉ 247.4k PyTorch Implementations Transformer Multi-Head Attention RoPE ALiBi Tran...
. ♡ 1.6k ◉ 247.4k PyTorch Implementations Transformer Multi-Head Attention RoPE ALiBi Transformer-XL RETRO Compressive Transformer miniGPT SwiGLU kNN-LM GLU Feedback Transformer Notes