Thanks for that article Barry-- am reading through it now and it is
indeed a great resource. Timely too since I'm going through a
complete tear down/rebuild of an ecommerce site.
Hello everyone. I'm curious to see how you gauge the success of an A/B or multivariate test? What are the metrics that are measured? What are the things that...
If the test led to an increase in conversions by a statistical significant amount then I would call the test a success. Sent via BlackBerry from T-Mobile ... ...
Hi Kevin, How will you decide that an increase in conversions by a statistical significant amount? Is it by proportion test? Thanks, Bhagawat. Kevin Rogers...
I am a fan of the Teasley Statistical significance calculator. http://www.teasley.net/statcalc.xls ... statistical significant amount? ... increase in...
adam, can you be more specific or elaborate with an example? i'm not clear on what you're asking... michael ... A/B or multivariate test? What are the metrics...
Hello Adam, You are best using the metrics that matter most to your business! Lots of businesses use Visits, Page Views or (dare I use it) the dreaded metric, ...
Avinash tackled this subject a few months ago, so it's worth taking a look at his thoughts: http://tinyurl.com/2tvkoe. His post actually inspired our senior...
Daniel S. just pointed out to me that the tinyurl links are busted. Ugh. The link to Avinash's post is because it wound up with a "." tacked on. This should...
How do most organizations measure the success of site "A" vs. "B." Thanks, Adam http://analyticsbyadam.blogspot.com ... From: mbchoe <mbchoe@...> To:...
Actually, let me re-phrase. Once you have performaned an A/B or multivarite test...how do you determine that your results have not been influenced by a...
If you are doing a simultaneous A/B test, what I call a split test, then performance issues should impact both pages equally and so should not be a factor of...
Make sure you don't spend so much time setting up, refining, testing, and analyzing the A/B results that the cost of doing the test far outweighs the...
Ed, I agree with you on two counts. Our experience is that is better to chuck a load of stuff in the multivariate bucket, stop bickering and just put it to the...
Having problems with message search?
Fill out this form to ensure your group is one of the first to be migrated to the new message search system.
Offline 
Send Email