Show HN: Replacing my OS process scheduler with an LLM(github.com)
10 pointsby ImPrajyoth4 hours ago3 comments
  • ImPrajyoth4 hours ago
    OP here. this is a cursed project lol, but i wanted to see: What happens if you replace the OS scheduler with an LLM?

    With Groq speed (Llama 3 @ 800t/s), inference is finally fast enough to be in the system loop.

    i built this TUI to monitor my process tree. instead of just showing CPU %, it checks the context (parent process, disk I/O) to decide if a process is compiling code or bloatware. It roasts, throttles, or kills based on that.

    Its my experiment in "Intelligent Kernels" how they would be. i used Delta Caching to keep overhead low.

  • p_ing4 hours ago
    You can't replace the NTOS scheduler. This is more of an automated (?) process manager.
    • ImPrajyoth4 hours ago
      you are technically right (the best kind of right). i am running in userspace, so i cant replace the actual thread scheduling logic in Ring 0 without writing a driver and BSODing my machine.

      think of this more as a High-Level Governor. The NTOS scheduler decides which thread runs next, but this LLM decides if that process deserves to exist at all.

      basically; NTOS tries to be fair to every process. BrainKernel overrides that fairness with judgment. if i suspend a process, i have effectively vetoed the scheduler.

      • p_ing37 minutes ago
        > NTOS tries to be fair to every process

        This is a super simplification of the NTOS scheduler. It's not that dumb!

        > if i suspend a process, i have effectively vetoed the scheduler.

        I mean, I suppose? It's the NTOS scheduler doing the suspension. It's like changing the priority level -- sure, you can do it, but it's generally to your detriment outside of corner cases.

  • devmor2 hours ago
    This is a pretty funny project, you've outsourced the neurotic developers that keep their task manager open and kill off processes they don't like.

    I wouldn't call it replacing the scheduler though - more that you've made a scheduler manager.