Joel Spolsky has a classic blog post on “Finding Great Developers” where…

Ben Green and I have just uploaded our joint paper, “The distribution of…

信息检索类比 → Bahdanau 到 Q/K/V 的演化 → 为什么要分开 Q/K/V → softmax($QK^\top$/$\sqrt{…

扫地机器人创造者、MIT 前 AI 实验室负责人，提出的人工智能三定律，跳出了科幻式 AGI 畅想，完全立足于真实商业部署，揭示了当下大模型、智…

In CPU design, most successful teams have a fairly long lineage and rely…

I had occasion recently to look up the proof of Hilbert’s nullstellensat…

把 Bahdanau, Cho, Bengio 2014 那篇「Neural Machine Translation by Jointly Le…

TIL that Bell Labs and a whole lot of other websites block archive.org, …

ChatGPT等大语言模型的落地普及，彻底打破了AI领域沿用数十年的三大经典理论体系：图灵测试已彻底失去机器智能判定价值，塞尔中文屋思想实验从理…

In the previous post, I discussed how an induction on dimension approach…