Skip to content
Alex Novara

Learning Diary

1h 30m · 1 session

View statistics

Started the transformer explainer. Attention finally reads as a weighted lookup:

  • queries ask
  • keys answer
  • values carry the content

What I worked on