AI Roadmap
Learning Diary
What was studied each day, for how long, and the notes taken along the way.
- Evaluation evening · Meetup
Weekly review only: the course pace is fine, no changes to the plan.
- Fictional Retrieval Summit · Conference · Day 3 of 3
- Fictional Retrieval Summit · Conference · Day 2 of 3
Rewrote three fictional support prompts with explicit output schemas.
- Fictional Retrieval Summit · Conference · Day 1 of 3
First module of the prompt patterns course: roles, examples and output formats.
Compared token counts of the same paragraph in three languages.
Byte-pair encoding by hand on a toy vocabulary of eight words.
No study today; planned the week and picked the tokenization reading order.
Finished the explainer. Next up: tokenization.
Short session after the late night. Summarised the residual stream in my own words.
Went through positional encodings and stayed past midnight on the multi-head section.
Started the transformer explainer. Attention finally reads as a weighted lookup:
- queries ask
- keys answer
- values carry the content
- Year-end agents workshop · Workshop · Day 4 of 4
- Year-end agents workshop · Workshop · Day 3 of 4
- Year-end agents workshop · Workshop · Day 2 of 4
- Year-end agents workshop · Workshop · Day 1 of 4