From AI to ZI
Subscribe
Sign in
Share this discussion
Addendum: More Efficient FFNs via Attention
aizi.substack.com
Copy link
Facebook
Email
Note
Other
Addendum: More Efficient FFNs via Attention
Robert Huben
Feb 6, 2023
2
Share this post
Addendum: More Efficient FFNs via Attention
aizi.substack.com
Copy link
Facebook
Email
Note
Other
Plus a hot take: scale is all you need (for interpretability tools)
Read →
Comments
Share
Share
Copy link
Facebook
Email
Note
Other
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
Addendum: More Efficient FFNs via Attention
Addendum: More Efficient FFNs via Attention
Addendum: More Efficient FFNs via Attention
Plus a hot take: scale is all you need (for interpretability tools)