I was curious what different people worked on in Linux, so I tried grabb…

While working on my recent paper with Ben Green, I was introduced to the…

从“模型到底在预测什么最小单位”这个问题出发，把 tokenization 讲清楚：按词为什么 OOV 爆炸，按字节或字符为什么序列太长，BPE…

Earlier this year, I interviewed with a well-known tech startup, one of …

I’m continuing my series of articles for the Princeton Companion to Math…

把《Attention Is All You Need》的实验结果拆开看：WMT14 英德与英法任务上的 headline number 到底意…

Every once in awhile, you hear a story like “there was a case of a 1-Gbp…

In my discussion of the Oppenheim conjecture in my recent post on Ratner…

把 2017 年 Transformer 原论文的训练配方完整复现一遍——数据集、硬件、优化器、学习率公式、warmup、label smoot…

Tavish Armstrong has a great document where he describes how and when he…