Hey! Just asking you because I’m not sure where else to direct this energy at the moment.
I spent a while trying to understand the argument this paper was making, and for the most part I think I’ve got it. But there’s a kind of obvious, knee-jerk rebuttal to throw at it, seen elsewhere under this post, even:
If producing an AGI is intractable, why does the human meat-brain exist?
Evolution “may be thought of” as a process that samples a distribution of situation-behaviors, though that distribution is entirely abstract. And the decision process for whether the “AI” it produces matches this distribution of successful behaviors is yada yada darwinism. The answer we care about, because this is the inspiration I imagine AI engineers took from evolution in the first place, is whether evolution can (not inevitably, just can) produce an AGI (us) in reasonable time (it did).
The question is, where does this line of thinking fail?
Going by the proof, it should either be:
- That evolution is an intractable method. 60 million years is a long time, but it still feels quite short for this answer.
- Something about it doesn’t fit within this computational paradigm. That is, I’m stretching the definition.
- The language “no better than chance” for option 2 is actually more significant than I’m thinking. Evolution is all chance. But is our existence really just extreme luck? I know that it is, but this answer is really unsatisfying.
I’m not sure how to formalize any of this, though.
The thought that we could “encode all of biological evolution into a program of at most size K” did made me laugh.
Aww :D