Tag: nlp
All the articles with the tag "nlp".
Attention Mechanism: A Simple Intuition
A beginner-friendly explanation of the attention mechanism using intuition, analogy, and the core ideas from the NLP-from-Scratch notebook.
Byte Pair Encoding (BPE)
A practical introduction to BPE using the code examples from the NLP-from-Scratch notebook.
A tiny tokenizer from scratch
A short, beginner-friendly walkthrough of tokenization, vocabulary building, and encoding words as IDs in NLP.
Machine translation when there's barely any data
Notes from a practicum on low-resource machine translation — why the usual playbook stops working, and what you do instead.