Don't wanna waste your time, I created flutter_pilot, basically makes you have a pilot agent that controls your app from natural language using LLMs ,it manages everything by compressing your Flutter widget tree as JSON (not screenshots, not description of app, it literally shares your widget tree), and use LLMs to understand your app components and use tool calling to perform actions and control the app, demo video for the example app:
https://github.com/user-attachments/assets/7dcb8504-00b3-4f6...
Want honest thoughts from u about it, is this something you would use in your apps to give your users native AI support in your apps?, making users say "go to this Feature X, and remove this, and add this, then reload this..." and just by that, the agent navigates, clicks, types, validate, check.... autonomously
this is it if you wanna check:
- https://github.com/anasfik/flutter_copilot/
- https://pub.dev/packages/flutter_copilot
think this is worth building and making even better?