陶哲轩博客写数学问题时,通常先把对象定义清楚,再给直觉、反例和证明轮廓。把「Benford’s law, Zipf’s law, and the Pareto distribution」改写成可阅读的中文笔记,重点是:问题在问什么、已知到哪一步、下一步最容易走偏在哪。原站广告、分享条和导航已去掉。

问题在问什么

A remarkable phenomenon in probability theory is that of universality – that many seemingly unrelated probability distributions, which ostensibly involve large numbers of unknown parameters, can end up converging to a universal law that may only depend on a small handful of parameters. One of the most famous examples of the universality phenomenon is the central limit theorem ; another rich source of examples comes from random matrix theory , which is one of the areas of my o

Analogous universality phenomena also show up in empirical distributions – the distributions of a statistic from a large population of “real-world” objects. Examples include Benford’s law , Zipf’s law , and the Pareto distribution (of which the Pareto principle or 80-20 law is a special case). These laws govern the asymptotic distribution of many statistics which

已知结果和反例

Examples here include the population of countries or cities, the frequency of occurrence of words in a language, the mass of astronomical objects, or the net worth of individuals or corporations. The laws are then as follows:

Benford’s law and Pareto distribution are stated here for base , which is what we are most familiar with, but the laws hold for any base (after replacing all the occurrences of in the above laws with the new base, of course). The laws tend to break down if the hypotheses (i)-(iv) are dropped. For instance, if the statistic concentrates around its mean (as opposed to being spread over many orders of magnitude), then the normal distribution tends to be a much better model (as i

证明或构造的主线

To illustrate these laws, let us take as a data set the populations of 235 countries and regions of the world in 2007 (using the CIA world factbook ); I have put the raw data here . This is a relatively small sample (cf. my previous post ), but is already enough to discern these laws in action. For instance, here is how the data set tracks with Benford’s law (rounded to three significant figures):

Here is how the same data tracks Zipf’s law for the first twenty values of , with the parameters and (selected by log-linear regression), again rounding to three significant figures:

阅读时建议盯住的点

As one sees, Zipf’s law is not particularly precise at the extreme edge of the statistics (when is very small), but becomes reasonably accurate (given the small sample size, and given that we are fitting twenty data points using only two parameters) for moderate sizes of .

This data set has too few scales in base to illustrate the Pareto distribution effectively – over half of the country populations are either seven or eight digits in that base. But if we instead work in base , then country populations range in a decent number of scales (the majority of countries have population between and ), and we begin to see the law emerge, where is now the number of digits in binary, the best-fit parameters are and :

值得单独记下的条目

  • (i) take values as positive numbers;
  • (ii) range over many different orders of magnitude;
  • (iiii) arise from a complicated combination of largely independent factors (with different samples of arising from different independent factors); and
  • (iv) have not been artificially rounded, truncated, or otherwise constrained in size.
  • Benford’s law: For , the proportion of whose first digit is is approximately . Thus, for instance, should have a first digit of about of the time, but a first digit of only about of the time.
  • Zipf’s law: The largest value of should obey an approximate power law, i.e. it should be approximately for the first few and some parameters . In many cases, is close to .
  • Pareto distribution: The proportion of with at least digits (before the decimal point), where is above the median number of digits, should obey an approximate exponential law, i.e. be approximately of the form for some . Again, in many case

阅读和落地时建议先做的 5 件事

  1. 用自己的语言重写定义和结论,不看原文能不能说清对象是什么。
  2. 找一个最小反例或边界情形,确认假设少一条会怎样。
  3. 把证明拆成可独立检验的引理,每步只保留一个新想法。
  4. 若涉及计算或形式化,先写可复现的小例子,再谈一般情形。
  5. 记下尚未解决的缺口:缺估计、缺构造,还是缺正确的范畴。

和智能体、形式化工具怎么接

龙虾PRO做 OpenClaw 落地时,数学笔记最有用的部分往往是「可检验的步骤」:定义、反例、引理边界。智能体适合帮忙展开计算和检索,不适合代替你决定哪条假设能扔。

本文侧重全链路风控方法论。落地时请用自身业务单据做回放验证,不要把示例阈值直接当生产策略。 相关:风控体检 · 方案资源

常见问题 FAQ

什么是AI智能系统?

「AI智能系统」可概括为:A remarkable phenomenon in probability theory is that of universality – that many seemingly unrelated probability distributions, which ostensibly involve large numbers of unknown p 本文从定义、方法与实践要点展开说明。

为什么要关注AI智能系统?

关注AI智能系统,是因为它直接影响效率、风险与可复制性。文中指出:A remarkable phenomenon in probability theory is that of universality – that many seemingly unrelated probability distributions, which ostensibly involve large numbers of unknown parameters, can end up converging to a universal law that may only …

如何落地AI智能系统?有哪些关键步骤?

建议按以下路径推进AI智能系统:1) (i) take values as positive numbers;;2) (ii) range over many different orders of magnitude;;3) (iiii) arise from a complicated combination of largely independent factors (wit…;4) (iv) have not been artificially rounded, truncated, or otherwise constrained in…;5) 用自己的语言重写定义和结论,不看原文能不能说清对象是什么。。细节见正文对应…

AI智能系统适合哪些人或团队?

AI智能系统更适合:产品/技术负责人、运营与增长团队、需要落地智能体或自动化的中小团队、关注「AI智能系统」方向的读者。若你只需要单次聊天式问答,可先读概念;若要上生产,请重点看步骤、权限与风控相关段落。

关于「问题在问什么」,本文给出了什么结论?

在「问题在问什么」部分,要点是:that many seemingly unrelated probability distributions, which ostensibly involve large numbers of unknown parameters, can end up converging to a universal law that may only depend on a small handful of parameters. One o

关于「已知结果和反例」,本文给出了什么结论?

在「已知结果和反例」部分,要点是:follows: Benford’s law and Pareto distribution are stated here for base , which is what we are most familiar with, but the laws hold for any base (after replacing all the occurrences of in the above laws with the new bas