4 ms·

B testing plugin for WordPress

28 points by arcware 16y ago

Encosia 16y ago
This looks great. I'm helping a friend with a site where this would be perfect for improving his conversions without as much work on my part. One question though. Do the visitors get a cookie to maintain the split on return visits?
- arcware 16y ago
  Yes, visitors get a cookie that has the value of the page they should see on return visits. For instance, if a visitor ends up on variation page #2, they will see variation page #2 from now on. Or at least until they reach the conversion page or the cookie expires in 30 days.
acangiano 16y ago
Good example of effective marketing. They give you a free, useful plugin, but related plugins are available for a substantial fee. Given that you have to sign up to download the free plugin, they also have a way to propose an upsell in the future (I pretty much expect emails from them).
- rmc 16y ago
  I'm diluted they are/have A/B tested that. So it depends if your in the control or test group :P
Metapony 16y ago
Couldn't log in under two browsers. Was able to register but no luck after that.
- arcware 16y ago
  Which two browsers?
  - acangiano 16y ago
    Not Metapony, but I had to login twice to download the plugin. I'm using Chrome 8.0.552.237 on Mac OS X 10.6.6.
  - radley 16y ago
    any browser - tried Firefox, Safari, and Chrome [edit] - confirmed - took 2+ tries to get it to work in Chrome
    - arcware 16y ago
      Should be fixed now guys, sorry about that.
radley 16y ago
@arcware we can't stay logged in to actually download - we only see the "sign-up" landing page.
- arcware 16y ago
  I see the problem, working on the fix now. I swear everything worked a half hour ago...
ccollins 16y ago
I think it is irresponsible to put tools like this into the hands of non-technical users. The lack of statistical Significance or recommended sample size will cause a lot of people to make uninformed decisions.
- paraschopra 16y ago
  Yes, I noticed lack of statistical significance. If the developer is reading this, I would seriously recommend adding statistical significance. It should be quite easy to implement. I had made on excel sheet for calculating statistical significance so you can use those formulas directly: http://visualwebsiteoptimizer.com/split-testing-blog/ab-testing-significance-calculator-spreadsheet-in-excel/ http://visualwebsiteoptimizer.com/split-testing-blog/ab-test... That said, I commend the team in bringing easy to use split testing solution for Wordpress!
  - javery 16y ago
    Perfect, that will make it into the next release.
- javery 16y ago
  That's a more irresponsible stance to take - witholding tools and knowledge because you fear people are ignorant is a sure fire way to keep those people ignorant. Part of our goal with this plugin is to educate users about these things - look for much more of that coming in the future.
  - paraschopra 16y ago
    Are you trying to say it is better to have A/B testing without statistical significant as compared no A/B testing at all? I'd disagree with you completely and since you are taking this stance, I am actually worried now about recommending the plugin. Not caring about statistical significance is equivalent to taking decisions at random. You may better flip a coin, why bother A/B testing? You are letting your users take decisions not knowing if those are real or just random.

28 points by arcware 16y ago

This looks great. I'm helping a friend with a site where this would be perfect for improving his conversions without as much work on my part. One question though. Do the visitors get a cookie to maintain the split on return visits?

arcware 16y ago
Yes, visitors get a cookie that has the value of the page they should see on return visits. For instance, if a visitor ends up on variation page #2, they will see variation page #2 from now on. Or at least until they reach the conversion page or the cookie expires in 30 days.

acangiano 16y ago

Good example of effective marketing. They give you a free, useful plugin, but related plugins are available for a substantial fee. Given that you have to sign up to download the free plugin, they also have a way to propose an upsell in the future (I pretty much expect emails from them).

rmc 16y ago
I'm diluted they are/have A/B tested that. So it depends if your in the control or test group :P

Metapony 16y ago

Couldn't log in under two browsers. Was able to register but no luck after that.

arcware 16y ago
Which two browsers?
- acangiano 16y ago
  Not Metapony, but I had to login twice to download the plugin. I'm using Chrome 8.0.552.237 on Mac OS X 10.6.6.
- radley 16y ago
  any browser - tried Firefox, Safari, and Chrome [edit] - confirmed - took 2+ tries to get it to work in Chrome
  - arcware 16y ago
    Should be fixed now guys, sorry about that.

radley 16y ago

@arcware we can't stay logged in to actually download - we only see the "sign-up" landing page.

arcware 16y ago
I see the problem, working on the fix now. I swear everything worked a half hour ago...

ccollins 16y ago

I think it is irresponsible to put tools like this into the hands of non-technical users. The lack of statistical Significance or recommended sample size will cause a lot of people to make uninformed decisions.

paraschopra 16y ago
Yes, I noticed lack of statistical significance. If the developer is reading this, I would seriously recommend adding statistical significance. It should be quite easy to implement. I had made on excel sheet for calculating statistical significance so you can use those formulas directly: http://visualwebsiteoptimizer.com/split-testing-blog/ab-testing-significance-calculator-spreadsheet-in-excel/ http://visualwebsiteoptimizer.com/split-testing-blog/ab-test... That said, I commend the team in bringing easy to use split testing solution for Wordpress!
- javery 16y ago
  Perfect, that will make it into the next release.
javery 16y ago
That's a more irresponsible stance to take - witholding tools and knowledge because you fear people are ignorant is a sure fire way to keep those people ignorant. Part of our goal with this plugin is to educate users about these things - look for much more of that coming in the future.
- paraschopra 16y ago
  Are you trying to say it is better to have A/B testing without statistical significant as compared no A/B testing at all? I'd disagree with you completely and since you are taking this stance, I am actually worried now about recommending the plugin. Not caring about statistical significance is equivalent to taking decisions at random. You may better flip a coin, why bother A/B testing? You are letting your users take decisions not knowing if those are real or just random.