Search the web
Sign In
New User? Sign Up
webanalytics · The Web Analytics Forum
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Want to share photos of your group with the world? Add a group photo to Flickr.

Best of Y! Groups

   Check them out and nominate your group.

Messages

  Messages Help
Advanced
A/B Test Question   Message List  
Reply Message #16546 of 25087 |
Re: A/B Test Question

--- In webanalytics@yahoogroups.com, "johnnydeptford"
<barrysholloway@...> wrote:
>
> Hi Adam
>
> There's an excellent article on A/B and multivariate testing here -
> http://exp-platform.com/hippo_long.aspx.
>
> Hope that helps
>
> Barry
>

Thanks for that article Barry-- am reading through it now and it is
indeed a great resource. Timely too since I'm going through a
complete tear down/rebuild of an ecommerce site.

FYI the period got caught in the URL.
http://exp-platform.com/hippo_long.aspx should work.

Alex




Sun Apr 13, 2008 12:30 pm

alexbrasil489
Offline Offline
Send Email Send Email

Message #16546 of 25087 |
Expand Messages Author Sort by Date

Hello everyone. I'm curious to see how you gauge the success of an A/B or multivariate test? What are the metrics that are measured? What are the things that...
Adam Berlinger
aberlinger1
Offline Send Email
Apr 13, 2008
7:41 am

If the test led to an increase in conversions by a statistical significant amount then I would call the test a success. Sent via BlackBerry from T-Mobile ... ...
Kevin Rogers
vabeachkevin
Offline Send Email
Apr 13, 2008
12:24 pm

Hi Kevin, How will you decide that an increase in conversions by a statistical significant amount? Is it by proportion test? Thanks, Bhagawat. Kevin Rogers...
bhagawat jadhav
bhagawat_jadhav
Online Now Send Email
Apr 14, 2008
7:29 am

I am a fan of the Teasley Statistical significance calculator. http://www.teasley.net/statcalc.xls ... statistical significant amount? ... increase in...
vabeachkevin
Offline Send Email
Apr 14, 2008
12:09 pm

adam, can you be more specific or elaborate with an example? i'm not clear on what you're asking... michael ... A/B or multivariate test? What are the metrics...
mbchoe
Offline Send Email
Apr 13, 2008
12:25 pm

Hi Adam There's an excellent article on A/B and multivariate testing here - http://exp-platform.com/hippo_long.aspx. Hope that helps Barry...
johnnydeptford
Offline Send Email
Apr 13, 2008
12:25 pm

... Thanks for that article Barry-- am reading through it now and it is indeed a great resource. Timely too since I'm going through a complete tear...
alexbrasil489
Offline Send Email
Apr 13, 2008
8:33 pm

Hello Adam, You are best using the metrics that matter most to your business! Lots of businesses use Visits, Page Views or (dare I use it) the dreaded metric, ...
Iain Murphy
iain.murphy
Offline Send Email
Apr 14, 2008
9:15 am

Avinash tackled this subject a few months ago, so it's worth taking a look at his thoughts: http://tinyurl.com/2tvkoe. His post actually inspired our senior...
Tim Wilson
tgwilsonmit
Offline Send Email
Apr 14, 2008
5:32 pm

Daniel S. just pointed out to me that the tinyurl links are busted. Ugh. The link to Avinash's post is because it wound up with a "." tacked on. This should...
Tim Wilson
tgwilsonmit
Offline Send Email
Apr 14, 2008
7:11 pm

tim, the last 2 links you posted don't work. i can get to avinash's site but not the other 2 tinyurl's. -mc...
mbchoe
Offline Send Email
Apr 15, 2008
9:41 am

How do most organizations measure the success of site "A" vs. "B." Thanks, Adam http://analyticsbyadam.blogspot.com ... From: mbchoe <mbchoe@...> To:...
Adam Berlinger
aberlinger1
Offline Send Email
Apr 14, 2008
7:11 pm

Here is a good "how to" on determining when/how to A/B test. Apologies for promoting my own content, but should be relevant: ...
jeffcarolinecampbell
jeffcaroline...
Offline Send Email
Apr 14, 2008
9:24 pm

Actually, let me re-phrase. Once you have performaned an A/B or multivarite test...how do you determine that your results have not been influenced by a...
Adam Berlinger
aberlinger1
Offline Send Email
Apr 14, 2008
9:25 pm

If you are doing a simultaneous A/B test, what I call a split test, then performance issues should impact both pages equally and so should not be a factor of...
widemilebs
Offline Send Email
Apr 14, 2008
11:10 pm

Make sure you don't spend so much time setting up, refining, testing, and analyzing the A/B results that the cost of doing the test far outweighs the...
Edward Vielmetti
evielmet
Offline Send Email
Apr 15, 2008
1:56 pm

Ed, I agree with you on two counts. Our experience is that is better to chuck a load of stuff in the multivariate bucket, stop bickering and just put it to the...
Craig Sullivan
wa_liveboy
Offline Send Email
Apr 21, 2008
8:03 pm
Advanced

Copyright © 2010 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines - Help