1 pointby ahW8iyz6 hours ago1 comment
  • ahW8iyz6 hours ago
    I have built a free and open source A/B tests analysis tool called ExpLab and would love to share it with anyone interested, feel free to fork, change and use it however you want.

    I have been in the experimentation and A/B testing space for a bit of time and there are two realities I have seen in the field: Either you pay a lot of money for a tool like Amplitude, Statsig, Eppo, Optimizely etc. or you need to rely on a spaghetti of python notebooks, google sheets that aren't replicable or centralized and lacking some crucial best-practices and diagnostic checks.

    This is not a feature flagging tool, it's an analysis tool that relies on having the experiment data in a database. Schema requirements are in the Documentation section of the tool.

    I currently have support for Postgres and MySql but I am working on extending it to Snowflake and Bigquery.

    Note: I am not a SWE by trade so I relied on LLMs (Codex+Gemini Pro) to build this but the stats engine has been tested extensively to ensure the results are sound and correct.

    Let me know what you think of this. ExpLab - getexplab.com