f(θ) = ½ θᵀHθθ⋆κ(H) ≫ 1gradient descentmomentum∇θ L(θ)
x ∈ ℝⁿhθMθ = { hθ(x) : x ∈ X }∂hθ / ∂z₁∂hθ / ∂z₂hθ(x₀)
HomeWorkBlogNoteResearchProjects

llm

4 entries

  1. Tags
  2. llm

Residual Stream is Key to Transformer Interpretability

Jul 18, 2026
StableNearly slop

Why do we need KV caching?

May 17, 2026
StableSlop

Một chút về Transformers (Phần 2): Transformers

Jun 20, 2025
StableNonslop

Một chút về Transformers (Phần 1): Attention, Attention, Attention

Jun 19, 2025
StableNonslop