I’ve just uploaded to the arXiv the paper “The cubic nonlinear Schröding…

CLIP 靠 batch 负样本和温度做对比学习，不是拼 caption；projector、Flamingo cross-attention、…

Troll? That’s how people write Verilog 1 . At my old company, we had a t…

One of the oldest and most fundamental concepts in mathematics is the li…

ViT 把图像切成 patch 再当 token，但 patch size 和分辨率一旦定下来，序列长度、attention 的显存和算力也同时…

This somewhat widely cited post (I keep seeing it cited, anyway) suggest…

Almost a year ago today, I was in Madrid attending the 2006 Internationa…

MoE 把参数量和每 token 计算量解耦，但代价从模型结构转移到了路由：过载丢 token、专家塌缩、路由抖动是训练现场的三种症状，All-…

Perf is probably the most widely used general purpose performance debugg…

[This post is authored by Emmanuel Kowalski.] This post may be seen as c…