Skip to content

perf: reduce temporary memory when computing attention head results - #1854

Merged
jlarson4 merged 3 commits into
TransformerLensOrg:devfrom
kiteretsu903:perf-bound-head-result-memory
Oct 7, 2026
Merged

jlarson4 merged 3 commits into
TransformerLensOrg:devfrom
kiteretsu903:perf-bound-head-result-memory

perf: use einsum throughout for cached attention head results

7c48094
Select commit
Loading
Failed to load commit list.
Sign in for the full log view