Apple Can Create Smaller On-Device AI Models from Google's Gemini(www.macrumors.com)
13 pointsby thm3 hours ago3 comments
  • ZeroGravitas12 minutes ago
    Does it make sense for a single model to be used for all on device LLM tasks or for each app to provide its own customized one?

    My gut feel is the former but not sure if that's actually true.

  • MBCook3 hours ago
    Wouldn’t it be interesting if Apple provided different models to different iPhones?

    So due to hardware capabilities the iPhone 20 Pro gets an X billion parameter version but the regular 20 gets only gets (2/3 * X) billion?

    That would provide an interesting point of hardware differentiation between the regular and pro models, as well as between each model year.

    • nullpoint4202 hours ago
      I could 100% see this, and ironically it makes sense. I can totally envision an Apple exec announcing this at a keynote.

      “We’re proud to announce that the iPhone 21 is our most performant iPhone yet - capable of running models of up to 20 billion parameters. That’s over 2x the amount on iPhone 20.”

      Or something like that.

      • MBCook15 minutes ago
        If you could find a good way to communicate it to people that they would believe (X billion whatever is pretty abstract) it could also really help with upgrades.

        All of us know phones are basically fast enough and have been for a long time. The screens are already great. The cameras are great. It’s gotten harder and harder to get people to break their cycle of when they upgrade.

        I don’t work in AI, I don’t know the parameter thing well myself. Like I know what it is abstractly, but I have no idea if doubling the number makes things 0.3% better, 12% better, or 2000% better. You could try to turn it into just some generic benchmark like the old megahertz race of “bitness” of consoles. But I suspect it means about as much to the average person as saying how many BOGOMIPS a phone has.

      • kingleopold2 hours ago
        I see %100 that model connected to siri and siri being siri in 5 years is the reality here. Would be incredible claude reaches to AGI and siri with all local hardware and local LLM just can't do few things right.
  • wenldev32 minutes ago
    [dead]