Show HN: I got PyTorch models running on WebGPU without ONNX export(github.com)

1 pointby yu3zhou46 hours ago1 comment

reena_signalhq6 hours ago
This is really impressive! Running PyTorch models in the browser without ONNX export is a game-changer for web-based ML apps.
Quick question: What's the performance like compared to native PyTorch? Are there specific model types that work better than others on WebGPU?
Would love to try this with some smaller models I've been working with!
- yu3zhou45 hours ago
  Performance is not there yet, honestly. I haven’t focus on running things fast, but it’s one of next directs steps I’ll take. The problem with running it in a browser is that we need to find a way to run the PyTorch itself in a browser and to my best knowledge it’s not there yet. I’m looking at it to close the gap, feel welcome to reach out to collaborate if you’re interested!