Read any paper without getting stuck.
or
Free account. Your papers are saved to it and open from anywhere.
attention head
The part of the model that decides which words to focus on.
A research paper titled “Sparse Attention for Long-Document Question Answering” with the term “attention head” highlighted and explained: The part of the model that decides which words to focus on.
How it works
Add a paper
Drop a PDF or paste a link. It opens right away.
Highlight what's confusing
Select any term or sentence and get a plain-English explanation in place.
Keep what you learn
Every explanation is saved to your library as you read.