8 ms·

A/B testing for the masses. Here's an example: Say a someone is deciding which shirt to wear. They whip out their smartphone, launch the A/B app, takes a pictu

by Fizzer 12y ago

A/B testing for the masses. Here's an example: Say a someone is deciding which shirt to wear. They whip out their smartphone, launch the A/B app, takes a picture of themselves wearing each of two shirts. Within 30 seconds, they have an answer of which shirt hundreds of people liked better. While they're waiting for the reply, they're prompted to rate other people's pictures. This is as simple as seeing two pictures and tapping the one that they like more. The number of use cases is endless. You could be shopping for eyeglasses and trying to figure out which look better - just try on both right there in the store and get a response from the A/B app. It's not limited to fashion, as people could use it for any subjective comparison.

wdrevno 12y ago
This sounds a lot like what http://thumb.it/ http://thumb.it/ does. It works pretty well actually and the responses are within a couple minutes
- Fizzer 12y ago
  It does sound similar. Just from watching the video, it looks like thumb.it just has up/down votes on one image, with optional additional feedback. The advantage of having two images is the voter doesn't even need to read a description or know what part of the image they're supposed to up/down vote. They should be able to easily see the difference between the two and just make a snap decision in less than a second. Not having to read text makes it more fun, I would think, and also provides a lot more results for the picture-taker.
KnightHawk3 12y ago
What happens if both of them are told they are bad? (or you are just not very attractive)
- Fizzer 12y ago
  Voters just select which picture is better, so the only thing being tested is the difference between the two photos.
  - trentmb 12y ago
    Eating two turds is worse than eating one turd. I'd rather not eat any turds at all.
lpolovets 12y ago
One of my friends started a website that mostly fits what you're describing: http://www.pickfu.com/ http://www.pickfu.com/
- Fizzer 12y ago
  It does seem somewhat similar. However Pickfu is going for written feedback from a one (or a small number) of people, whereas the A/B testing idea would simply compare two photos and aggregate the results within seconds. Pickfu also charges for their service, which I don't think would work for someone wanting to simply choose their wardrobe. It'd have to monetize in other ways (ads, or charging for getting gender/age breakdowns of the results, more results, allowing to compare more than 2 photos, etc.)
  - fudged71 12y ago
    >within seconds This is the part I don't understand. You would need to have a whole lot of scale and incentive for people to give their feedback this fast and often. Jelly can take a while to get a response, for instance.
    - Fizzer 12y ago
      Every time you upload your own photos, you are forced to rate other people's photos before you get your own response. This is the incentive. Rating photos is very fast -- just look at two photos and tap one. All network lag can be eliminated by pre-caching the images. I'd bet the average rating speed is one per second (it's all snap judgements). As long as the app has 30+ people using it at every moment of the day, you'll always get a response of at least 30 responses within 30 seconds. Plus I suspect people would enjoy voting and would spend time doing it even while not waiting on their own response, meaning you'd get more than you put in.
      - User9821 12y ago
        You don't want to force people to do anything, otherwise it skews the results. Force someone to vote for 30 seconds, or to vote 10 times, and they'll just sit there tapping the first picture until they reach their target. You'll get lots of votes, they'll just be useless. I think you'd get enough votes if the app was in the right format. It would have to be like hot or not, where you have 2 photos, pick one, and instantly get another 2 photos along with the results from the first set. This gets people trapped in the just one more click mindset. Focus it on fashion and clothing, people will vote to see more photos, to judge the outfits of others (a lot of people enjoy doing this for fun), and to get inspiration for themselves. Also, allow users to select what gender and age groups can vote on their photo.
minimaxir 12y ago
There was a startup that followed your example called Fashism. (yes, really) It received venture capital, but died a painful death. http://www.crunchbase.com/organization/fashism http://www.crunchbase.com/organization/fashism
- Fizzer 12y ago
  Interesting. Sounds like it does share some ideas, but with a different goal. This blurb says it was trying to get people to complete for a spot on a leaderboard, whereas A/B testing is about helping people make every-day decisions.
  - minimaxir 12y ago
    I think the leaderboard was the original idea, but then they later pivoted. http://betabeat.com/2013/09/fashism-struts-off-to-startup-graveyard/ http://betabeat.com/2013/09/fashism-struts-off-to-startup-gr...
    - Fizzer 12y ago
      That's closer! But the devil is in the details. They have you looking at one image, reading the question, and rating up/down and even commenting. In the image, they have a full body shot, with simply "Does this work?" Does what work? The glasses, the shoes, the dress? This takes a lot more effort than simply tapping one of two photos without reading anything. A/B responses can be given in less than a second. It's all snap judgements -- no reading is necessary.
- sebastianconcpt 12y ago
  Disturbing naming ethos. Not even Demi Moore charming backing them up could stand that. Suddenly... #HopeInHumanityRestored
ctb9 12y ago
There is a strong assumption here that you could encourage hundreds of people to express their opinion on this someone's shirts. The value for the poster is clear; what is the value for the voter?
- Fizzer 12y ago
  Every time someone uses the service, they spend 30 seconds rating other people's images. There can be a countdown (i.e. rate 10 more to see your results). It would also be important to make it very fast. Cache all the images before the voter gets there, and send the results asynchronously so they don't need to wait. One could easily do a rating in less than a second. It's all snap judgements.
travisfischer 12y ago
This is actually pretty interesting. I think many people have thought of a product along these lines and, as mentioned by others, there have been several versions of this tried. I think the key is in the constraints you have outlined. Obviously it's a mobile app. You take two pics and post. You then vote on other's ABs. Every vote you make on someone else's AB earns you a vote on your own. If you want a bunch of opinions on your AB you keep voting on other's. You can post to your social networks to get your friend's opinions as well. Maybe it ties into the social APIs and reads comments to extract out votes for A or B. Maybe some viral growth potential there. I like this. I might use actually use it. Wondering if it is important to be able to choose a target segment of voters for your own AB or if the classification of "human" is good enough in most cases.
- Fizzer 12y ago
  I've thought about segmenting as well. For example, teenagers don't want to rate pictures of grandmothers all day -- they want to see people their own age. You could segment it by age and region for starters.
- wingerlang 12y ago
  I mentioned this idea to a client some time ago, exactly like this. Each vote gives you a vote on your own pictures. It was not in the scope of the product but I do still like the idea.
lukejduncan 12y ago
There (was) an app for that. They were around for a few years based out of NYC but it looks like they didn't get much traction. http://gotryiton.com/ http://gotryiton.com/
eurleif 12y ago
It's limited to pictures of people, but MyBestFace sounds like what you're describing. https://www.okcupid.com/mybestface https://www.okcupid.com/mybestface
- Fizzer 12y ago
  You're right, the methodology is similar, just for different goals. That one is trying to figure out which picture to use for your profile, whereas this app is trying to help you in making every-day decisions such as what to wear or what to buy. A key element is the response time -- I'm not sure how fast this service gets you an answer but I'm assuming it's not within seconds.
  - eurleif 12y ago
    Well, their slow response time is presumably because that's the best they can do.... how would you improve on it?
    - Fizzer 12y ago
      The idea as I presented it would require a certain amount of traction to get started. It only would take about a second to look at two photos and tap one, so assuming 30+ people are using it at any given moment, you could get 30 votes within 30 seconds.
- DanBC 12y ago
  Mybestface uses a really small number of responses. I'd pay to use something that gave me a sample of 500 or 1000 responses.
utunga 12y ago
I'm just some guy, you know? But this sounds awesome to me. Maybe the trick, compared with Fashism (really?), which seems to have been about feedback on your Fashion more generally and pickfu which seems to address feedback more generally, the trick would be to really narrow it down. To just an app for two photos, which is better, and let people make of it what they will. Would need decent facebook integration, so you can ask your friends, not just random strangers.

by Fizzer 12y ago

wdrevno 12y ago

This sounds a lot like what http://thumb.it/ http://thumb.it/ does. It works pretty well actually and the responses are within a couple minutes

Fizzer 12y ago
It does sound similar. Just from watching the video, it looks like thumb.it just has up/down votes on one image, with optional additional feedback. The advantage of having two images is the voter doesn't even need to read a description or know what part of the image they're supposed to up/down vote. They should be able to easily see the difference between the two and just make a snap decision in less than a second. Not having to read text makes it more fun, I would think, and also provides a lot more results for the picture-taker.

KnightHawk3 12y ago

What happens if both of them are told they are bad? (or you are just not very attractive)

Fizzer 12y ago
Voters just select which picture is better, so the only thing being tested is the difference between the two photos.
- trentmb 12y ago
  Eating two turds is worse than eating one turd. I'd rather not eat any turds at all.

lpolovets 12y ago

One of my friends started a website that mostly fits what you're describing: http://www.pickfu.com/ http://www.pickfu.com/

Fizzer 12y ago
It does seem somewhat similar. However Pickfu is going for written feedback from a one (or a small number) of people, whereas the A/B testing idea would simply compare two photos and aggregate the results within seconds. Pickfu also charges for their service, which I don't think would work for someone wanting to simply choose their wardrobe. It'd have to monetize in other ways (ads, or charging for getting gender/age breakdowns of the results, more results, allowing to compare more than 2 photos, etc.)
- fudged71 12y ago
  >within seconds This is the part I don't understand. You would need to have a whole lot of scale and incentive for people to give their feedback this fast and often. Jelly can take a while to get a response, for instance.
  - Fizzer 12y ago
    Every time you upload your own photos, you are forced to rate other people's photos before you get your own response. This is the incentive. Rating photos is very fast -- just look at two photos and tap one. All network lag can be eliminated by pre-caching the images. I'd bet the average rating speed is one per second (it's all snap judgements). As long as the app has 30+ people using it at every moment of the day, you'll always get a response of at least 30 responses within 30 seconds. Plus I suspect people would enjoy voting and would spend time doing it even while not waiting on their own response, meaning you'd get more than you put in.
    - User9821 12y ago
      You don't want to force people to do anything, otherwise it skews the results. Force someone to vote for 30 seconds, or to vote 10 times, and they'll just sit there tapping the first picture until they reach their target. You'll get lots of votes, they'll just be useless. I think you'd get enough votes if the app was in the right format. It would have to be like hot or not, where you have 2 photos, pick one, and instantly get another 2 photos along with the results from the first set. This gets people trapped in the just one more click mindset. Focus it on fashion and clothing, people will vote to see more photos, to judge the outfits of others (a lot of people enjoy doing this for fun), and to get inspiration for themselves. Also, allow users to select what gender and age groups can vote on their photo.

minimaxir 12y ago

There was a startup that followed your example called Fashism. (yes, really) It received venture capital, but died a painful death. http://www.crunchbase.com/organization/fashism http://www.crunchbase.com/organization/fashism

Fizzer 12y ago
Interesting. Sounds like it does share some ideas, but with a different goal. This blurb says it was trying to get people to complete for a spot on a leaderboard, whereas A/B testing is about helping people make every-day decisions.
- minimaxir 12y ago
  I think the leaderboard was the original idea, but then they later pivoted. http://betabeat.com/2013/09/fashism-struts-off-to-startup-graveyard/ http://betabeat.com/2013/09/fashism-struts-off-to-startup-gr...
  - Fizzer 12y ago
    That's closer! But the devil is in the details. They have you looking at one image, reading the question, and rating up/down and even commenting. In the image, they have a full body shot, with simply "Does this work?" Does what work? The glasses, the shoes, the dress? This takes a lot more effort than simply tapping one of two photos without reading anything. A/B responses can be given in less than a second. It's all snap judgements -- no reading is necessary.
sebastianconcpt 12y ago
Disturbing naming ethos. Not even Demi Moore charming backing them up could stand that. Suddenly... #HopeInHumanityRestored

ctb9 12y ago

There is a strong assumption here that you could encourage hundreds of people to express their opinion on this someone's shirts. The value for the poster is clear; what is the value for the voter?

Fizzer 12y ago
Every time someone uses the service, they spend 30 seconds rating other people's images. There can be a countdown (i.e. rate 10 more to see your results). It would also be important to make it very fast. Cache all the images before the voter gets there, and send the results asynchronously so they don't need to wait. One could easily do a rating in less than a second. It's all snap judgements.

travisfischer 12y ago

This is actually pretty interesting. I think many people have thought of a product along these lines and, as mentioned by others, there have been several versions of this tried. I think the key is in the constraints you have outlined. Obviously it's a mobile app. You take two pics and post. You then vote on other's ABs. Every vote you make on someone else's AB earns you a vote on your own. If you want a bunch of opinions on your AB you keep voting on other's. You can post to your social networks to get your friend's opinions as well. Maybe it ties into the social APIs and reads comments to extract out votes for A or B. Maybe some viral growth potential there. I like this. I might use actually use it. Wondering if it is important to be able to choose a target segment of voters for your own AB or if the classification of "human" is good enough in most cases.

Fizzer 12y ago
I've thought about segmenting as well. For example, teenagers don't want to rate pictures of grandmothers all day -- they want to see people their own age. You could segment it by age and region for starters.
wingerlang 12y ago
I mentioned this idea to a client some time ago, exactly like this. Each vote gives you a vote on your own pictures. It was not in the scope of the product but I do still like the idea.

lukejduncan 12y ago

There (was) an app for that. They were around for a few years based out of NYC but it looks like they didn't get much traction. http://gotryiton.com/ http://gotryiton.com/

eurleif 12y ago

It's limited to pictures of people, but MyBestFace sounds like what you're describing. https://www.okcupid.com/mybestface https://www.okcupid.com/mybestface

Fizzer 12y ago
You're right, the methodology is similar, just for different goals. That one is trying to figure out which picture to use for your profile, whereas this app is trying to help you in making every-day decisions such as what to wear or what to buy. A key element is the response time -- I'm not sure how fast this service gets you an answer but I'm assuming it's not within seconds.
- eurleif 12y ago
  Well, their slow response time is presumably because that's the best they can do.... how would you improve on it?
  - Fizzer 12y ago
    The idea as I presented it would require a certain amount of traction to get started. It only would take about a second to look at two photos and tap one, so assuming 30+ people are using it at any given moment, you could get 30 votes within 30 seconds.
DanBC 12y ago
Mybestface uses a really small number of responses. I'd pay to use something that gave me a sample of 500 or 1000 responses.

utunga 12y ago

I'm just some guy, you know? But this sounds awesome to me. Maybe the trick, compared with Fashism (really?), which seems to have been about feedback on your Fashion more generally and pickfu which seems to address feedback more generally, the trick would be to really narrow it down. To just an app for two photos, which is better, and let people make of it what they will. Would need decent facebook integration, so you can ask your friends, not just random strangers.