Hi,

For those of us that are wondering about this in A/B tests, there is a nice
short paragraph about assigning equal users to treatments.

It is located in section 6.2.4, of the paper located here:
http://exp-platform.com/hippo_long.aspx

This paper is a great read!

Thanks,

Dylan
(Moderator, Analyst@Intuit)





On Wed, Oct 15, 2008 at 8:47 AM, JT Buser <jbuser@...> wrote:

> Dave,
>
> Agree about bringing in someone to design, analyze and interperet the
> test. I always say, about 95% (I am a stats guy, I can make up
> numbers) of the work in doing an analysis lies within setting it up
> correctly (identifying factors, controlling for extraneous factors,
> etc.) so that you are getting the answer you want. Always comes down
> to Should I vs. Can I....Yes, I CAN always do an analysis. SHOULD I,
> is a whole different ball game. In order to do so, one must
> understand exactly what models are available, but letting the question
> dictate the model, not the other way around.
>
> JT
>
>
> --- In webanalytics@yahoogroups.com <webanalytics%40yahoogroups.com>,
> "\"Wandering\" Dave Rhee"
> <wdaveonline@...> wrote:
> >
> > Hey, JT -- awesome demo videos for your A/B calculators! I
> especially
> > like the power analysis setting in the advanced calculator, very
> nice,
> > as is the backwards-calculation of the actual confidence interval.
> > (Ophir -- I see your calculator also has this feature -- nice to
> have
> > it in an easy-to-bookmark web page!)
> >
> > JT -- good points about using the vendor's MVT tools -- one would
> hope
> > that they're already using an appropriate analysis for web data
> (e.g.,
> > one-tailed, appropriate distribution curve, etc.), but it's always
> > nice to have an independent pair of eyes validate the tool, if you
> > have access to such a resource. I think for something like MVT,
> it's
> > well worth hiring an outside consultant to help design, analyze, and
> > interpret the first few tests, just to help you step past some of
> the
> > most obvious mistakes. I think beyond that, it's relatively simple
> to
> > do "another test like the last one" on one's own.
> >
> > WDave
> >
>
>
>


[Non-text portions of this message have been removed]