@KamaDevGroup I think it requires some discipline, often implicit, to ensure that any nontrivial program remains possible to reason about. common programming patterns perhaps correspond vaguely to proof techniques
https://t.co/hFWDzrEsxl
add some code, the docstrings and tests get longer. remove some code, the docstrings and tests get longer. "please improve", the code, docstrings, and tests get longer. "please patch", all longer. "please deduplicate", somehow code still gets longer. what is going on
@KamaDevGroup this is a deep question. I think line count is a decent one-glance metric of complexity. yes there's a lot more to consider. code golf exists.
best I've got rn: path count and state size are roughly exponential in line count. reasoning about a large program is therefore hard.
@utsav_khairnar gradient descent ✅
handling data ✅
running good experiments ✅
kernel optimizations ✅
also CPU and other perf stuff ✅
frontend (for tooling) ✅
database wrangling ✅
distributed systems ✅
networking ✅
security ✅
OS stuff (mostly containers) ✅
genuinely there are so many interesting problems in the ai infra world. it just so happens that now inference is trendy. but there are a ton of other ones. you aren’t bullish enough of infrastructure jobs.
We've received several questions about the Opus 5 FrontierCode results, where scores decline as reasoning effort increases. In fact, the behavior is expected under the benchmark design. FrontierCode evaluates merge-ability rather than correctness alone, incorporating criteria that reflect user experience.
One such verifier is a scope criterion, which penalizes modifications to the codebase beyond what the task requires. We observe this effect across all frontier models we evaluated, though it is most pronounced in Opus 5: at higher reasoning efforts, the model shows a stronger tendency to refactor code unprompted.
636606729769440499166579950236036751749912014371509557713570027508971809534551913252252094954941974952859310861988904737359709200557919
is a factor of RSA-896
https://t.co/yGWyEC8RpZ
@olegakbarov@viemccoy or like less glibly: many persistent things are the result of some autocatalysis with exponentially growing rate, and every time/place the ingredients for this particular loop exist, there soon arises a mini version of it going there too