Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Question: What do you think the word "effectively" means in the comment above?


Not OP, but it means nothing, because it's not "effectively" becoming a compiler.

Think about it from an information theory standpoint:

A compiler takes at least the exact amount of information it needs to produce a result, and produces exactly that result every time (unless it's bad at its job or has a bug).

An LLM always takes far less information than would actually be needed to fully describe the desired output, and extrapolates from that. It fetches contexts and such to give itself a glut of assumedly relevant information, but the prompt always contains less information than necessary to produce the code it generates. If it did fully contain enough information, then you've just written a far more verbose version of the program in human language.


You're rebutting a comment that says something like: "LLMs are literally becoming compilers"

No one said that


I interpret it as "in practice", "now". Non-native English speaker here, so I may have missed your meaning.

If you meant they’re now better at mimicking compilers, sure, but they’re only mimicks.


Yes, I am saying there's no functional difference (for practical purposes) between a deterministic transformation like a compiler and a perfect probabilistic transformation like an LLM.

We do not have "perfect" probabilistic transformation, and we probably never will (in part because it's hard to know what exactly that even means), but the gap between the two is shrinking every day.

Ergo:

> they're becoming (effectively) more and more similar every day.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: