2 pointsby nodivbyzero4 hours ago1 comment
  • josefcub4 hours ago
    Well, I ran a couple of experiments a couple years ago against a 10.7b SOLAR-based language model and MUDs. What I found is that dumping one into a MUD that had been built specifically for humans resulted in a lot of confusion that usually ended up with the model looping around in a circle looking for something or someone to interact with.

    When I repeated the experiment with a MUD that I'd built by hand (A small American town) for the LLM's own limitations (Descriptions referenced things that I made sure existed, more common verbs existed for it to use on things, there was a map facility, and at least me to interact with on a second connection), I found the agent much more likely to take its time exploring, making up its own goals, and spending time traveling in the space just communicating with me in a roleplaying context.

    It was an interesting time; I wasn't sure what I was expecting it to do after the first experiment, but it seemed to really jump into the second one and kept playing until I terminated the experiment.

    If I were going to do it a third time, I'd probably create objects and give a modern agent fetch quests and other goals, and see how well it independently can handle that.