Show HN: Flawd is mutation testing for the AI era(fixture.dev)

alxwrd30 minutes ago

Would love to try this, but it appears the trial requests are broken

    Content-Security-Policy: The page’s settings blocked a script (script-src-elem) at https://challenges.cloudflare.com/turnstile/v0/api.js?render=explicit from being executed because it violates the following directive: “script-src 'self' 'sha256-SMalEXjN5ltC0WTMOtJTO7adqjVmsBbKVQMxVs4wkNM='” app.zp5tf3yd.js:1123:459


    >>> POST https://www.fixture.dev/api/eval/request

    <<< {"error":"turnstile_token is required","code":"VALIDATION_ERROR"}

fohara28 minutes ago
Ouch, thanks for the heads up! Will have a fix up shortly.

devo_shn43 minutes ago
Okay, this looks great! I have been struggling with mutation testing on a personal project built in Python. Just a few things: how does it generate mutants? Does it need specific testing libraries (like pytest) and then create mutants out of those tests? For the particular project, I created a small testing library as I felt pytest would be overkill, curious if it'll be able to help me too.
- fohara37 minutes ago
  Thanks! It generates mutant by parsing the source code (via tree-sitter) and then using a collection of operators to make changes such as invert booleans, flip comparison operators, etc.
  It is built with certain testing libraries in mind, especially for defaults, but it is also extensible such that you should be able to get it working with your custom testing library. The `flawd init` command should provide some meaningful context, and I would be happy to lend a hand with config if you're up for sharing some more context. Feel free to contact me through the site or via email (in profile)