https://zhangchitc.github.io/tags/positional-encoding/Recent content in Positional-Encoding on Chi's BlogHugoen-usSun, 01 Nov 2026 00:00:00 +0000https://zhangchitc.github.io/posts/positional-encoding/Sun, 01 Nov 2026 00:00:00 +0000https://zhangchitc.github.io/posts/positional-encoding/Attention can’t tell “dog bites man” from “man bites dog”. We try integer, fractional and binary encodings, see where each one breaks, and arrive at sines and cosines: a set of clock hands spinning at different speeds.