Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console(github.com)
112 pointsby Anon843 hours ago11 comments
  • xnxan hour ago
    I've never even considered getting a PS5, but hackers converting a locked-down appliance into a general purpose computer has me really considering.
    • stuxnet7944 minutes ago
      Well that locked-down appliance is way under-specced compared to an equivalent build at the same price.
      • throwaway24040312 minutes ago
        Does that remain true in the RAMpocalypse?
      • gambiting5 minutes ago
        Even at the current increased prices - you can build a PC with a better spec and with a 4K Blu ray drive for £569? I'd be curious how.
  • shiftpgdnan hour ago
    Conceivably this should also work on the BC250 cards, which are ex-cryptocurrency mining motherboard built around AMD's "Cyan Skillfish" APU which is a cut-down version of the PlayStation 5's custom silicon. You can still pick them up on ebay for $150-$200.
    • haunteran hour ago
      Good luck finding one for $150 or even for $200

      And at that price point or a little bit more you might as well just get an RTX 3060 and save yourself a lot of hassle (you also get DLSS, DLAA etc.)

      • shiftpgdnan hour ago
        I paid $150 shipped a few months ago then maybe $40-50 for all the parts to run it. The RTX 3060 sells for $400+ in my market and still needs a computer to attach it to!
      • LoganDark44 minutes ago
        Just opened up eBay and they're going for like $200 here, $220 if you want a "modded BIOS" (whatever that means).
        • greggsy15 minutes ago
          Flashing the bios takes ten minutes with a thumb drive. It’s hard to get wrong but guess some people would be nervous enough about that to pay $20 extra.
  • pwythonan hour ago
    With this in mind, having LLM-powered NPCs would be a beautiful thing. There's been limited testing on PC games (PUBG Ally), but I can imagine it will be the standard.
    • greggsy11 minutes ago
      After all of the agonising about AI companions, we realised that we just wanted someone to play games with.
    • tiahuraan hour ago
      Fortnite Darth Vader already did
  • Rabbit504030201an hour ago
    The project's primary site should not be GitHub, and I am serious. Playstation 5 is not some historical curiosity and Sony might strike the page down any hour now.

    Those projects should default to hosts less geared toward corporate governancy; custom internet domain being the first requirement.

    • Retr0idan hour ago
      I'm sure Sony has an opinion of the jailbreaks that enable this, but they really don't give a shit about anyone running llama.cpp. Why would they? They're just glad you're not pirating games.
      • xp84an hour ago
        Is there a real or imagined hardware subsidy on the PS5 hardware though? In other words, is the current MSRP below what Sony would charge in a hypothetical world where they weren’t involved in any form of gaming software business, with an assumption that they will make additional margin dollars from game sales? I can see some manager making the case that repurposing the hardware for non-gaming use is taking food off his family’s table, in a manner of speaking. If so, it’s an argument that you don’t want this type of use to become popular and have PS5s start flying off shelves and never having games bought for them.
    • minimaxiran hour ago
      There's no feasible way to avoid takedowns/DMCA in 2026 unless you do TOR shenanigans. Even with a custom domain, Sony could just DMCA the web host for the project.
      • 2III715 minutes ago
        Torrents. Got the leaked GTA6 videos by torrenting and they're still easily available on public trackers. Don't see why projects like these couldn't be distributed similarly if shit hits the fan.
      • haunter16 minutes ago
        Magnet link, once the DHT networks picks it up (and there are seeders) no one will take it down unless they go after every single IP address
      • kevmo314an hour ago
        Sure you can. This repo has definitely been vacuumed into the latest training data dump, so the next generation of models will happily spit out a similar reproduction, Sony be damned!
      • 19 minutes ago
        undefined
      • nekusaran hour ago
        Gitflic.ru begs to differ.
    • LoganDark43 minutes ago
      > Those projects should default to hosts less geared toward corporate governancy; custom internet domain being the first requirement.

      I struggle to think of anywhere on the entire open internet you could put something like this where it could not be taken down.

  • kevmo3142 hours ago
    Not long until Anthropic's dreams of self-replicating models starts taking over PS5s!
    • crorella2 hours ago
      Haha, I was thinking the same, I think we will see the most random devices being able to host models in the near future. An army for the techno core.
  • randomblock12 hours ago
    Relevant: https://en.wikipedia.org/wiki/PlayStation_3_cluster
  • drewg123an hour ago
    For somebody who hasn't kept up with all the different open source models and what token rates mean, how would using this compare to something like codex or claude? I assume it would be much slower and less capable..?
    • robotswantdataan hour ago
      Significantly slower and less capable than opus 5.5

      However you can run comparable or better models than gpt4. Try to stay under 30b

  • 2 hours ago
    undefined
  • Kurtz792 hours ago
    Don't give Sony ideas...
  • armcat2 hours ago
    The toaster is next!
  • ThrowawayTestr2 hours ago
    11.4G of shared memory. Could do something interesting if you don't have a GPU.
    • 2 hours ago
      undefined