# 是时候结束 BERTology了

2020-11-07 20:15:54 InfoQ

{"type":"doc","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"italic"},{"type":"color","attrs":{"color":"#494949","name":"user"}},{"type":"strong"}],"text":"本文最初发表于 Medium 博客，经原作者 Walid Saba 博士授权，InfoQ 中文站翻译并分享。"}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"背景"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"基于三个技术（理论上的、科学上的）原因，由数据驱动 \/ 定量 \/ 统计 \/ 机器学习的方法（我统称为 BERT 学（BERTology）），是完全毫无希望的、徒劳的努力，至少在语言"},{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}},{"type":"strong"}],"text":"理解"},{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"方面是如此。我明白，这是个很大的主张，特别是鉴于当前的趋势、媒体的误导性宣传，以及科技巨头们在这一完全有缺陷的范式上花费了巨额资金。正如我在自己的出版物、研讨会和帖子中所反复提到的那样，人们常常跟我说：“但是，所有那些人真的都错了吗？”好吧，现在我要统一地回答：“是的，他们确实可能都错了。”我是以伟大的数学家 \/ 逻辑学家波特兰·罗素（Bertrand Russell）的智慧说出这番话的。罗素曾经这样说过："}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"blockquote","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"一个观点已被广泛持有的事实并不能证明它不是荒谬绝伦的。（"},{"type":"text","marks":[{"type":"italic"}],"text":"The fact that an opinion has been widely held is no evidence whatsoever that it is not utterly absurd."},{"type":"text","text":"）"}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]}]}