A meta-analysis calculator for combining two or more a/b tests together.
- For making better decisions with aggregate data from retests or tests deemed similar enough
- For more accurate estimates of future experiments
- To enable decisions if you don't have enough statistical power to run your own experiments
A big thanks to the following indivduals for making this little project possible:
- Ron Kohavi for guidance and input on weighing of p-values and inspring this project with his own meta-analysis spreadsheet.
- Simon Dhala from whom I took the cumnormdist PHP function.
- Tyler Buffington for multiple discussions and input about various meta analysis approaches.
- Ryan Thomas for finding that the initial p-values were not being properly calculating upon the initial release. :)
I'm hosting this code here for a functional preview of the calculator.
- PHP
- BCMath PHP Extension
Ping me on LinkedIn if you find something odd or would like to collaborate. This is an ongoing project and I'm sure it can be improved.