One-hot encoding

Representing a word as a vector the length of the whole vocabulary, all zeros except a single 1 at that word's position.

See it explained in full