Just as amoebas move across gradients in their environments - food potential, heat differential, an LLM amoeba would move - well, in a problem space.
Buy that only leads to the question what the problem space is. For embodied living organisms, the problem is survival (and/or the survival of their genes).
Does it need to be the same for any kind of AGI?
I'm thinking that LLMs cannot be the AGI of our SF stories, but are probably a part of one. An AGI would probably have an LLM as the engine of its internal monologue, blended with sensory information.