eWallet Open Beta: The Results Are In!

beta.pngWhen I announced our open beta I promised that I’d let everyone know how it went. I mean this is a ‘behind the scenes at Ilium Software’ blog after all! I’ll start by saying that overall, this was a great experience. We got some really excellent insights into how people reacted to changes, caught a number of bugs, and found out how folks liked the new features. Without question I plan to run additional Open Betas in the future.

Statistics
Here are a few statistics about the Open Beta:

     Number of People Who Viewed the Page: 4000
     Number of People Who Downloaded the Beta: 1500
     Number of People Who emailed Comments: 28

Although I don’t have much to compare it to, this struck me as a pretty good response! Particularly considering how short a time the beta ran. While we didn’t get many email comments, what we did get proved very useful. Those 28 emails alone were worth the effort of setting this up!

A few more interesting statistics for you number crunchers out there:

     Pocket PC Downloads: 912
     Smartphone Downloads: 266
     Palm OS Downloads: 172
     Windows Only Downloads: 167

Duration
What about the length? Well we knew from the start that this was going to be quick. In the future I’d like to run a longer open beta. One of the things we weighed was just how “beta” of a version we wanted to send out there. We’re sort of perfectionists over here and we hate to send out broken software. Still working on this one but I’m thinking at least three weeks next time. We’ll see!

Conclusions
The conclusions I draw about the Open Beta in general is that I’m really glad we did it. Not sure that it would work for other developers but it certainly worked for us. My thanks to everyone who downloaded and especially to those that sent us comments!

Looking at the other numbers (the fact that Smartphone downloads well outnumbered Palm downloads for instance, when we have very strong sales for both platforms) leaves one wondering as well. Does it mean something? Is it a sign of use patterns? Or maybe Palm people are just less likely to try betas? Feel free to throw in your 2 cents! We’d be happy to hear it!

2 thoughts on “eWallet Open Beta: The Results Are In!

  1. Taccy

    Maybe palm users are just more busy, which is why they chose the more streamlined, quicker OS. (joking)

    I would guess that the pocket Pcs are at the stage that Palm users reached a few years ago with an increasing user base trying out new software to see whats right for them.

    A lot of palm owners have been Palm OS users for a while now, so they are happy with the software that they already have, and are less likely to be enticed by new downloads, and it’s only when they need additional functionality, or upgrade their device, that they start to look at the application market.

    Alternatively evryone is waiting for a new Treo 680 form Mr S. Claus before they try out new stuff.

  2. Marc Post author

    I have to say, the “settled in” theory certainly has merit. Enough Palm software was released and enough time has passed that most users probably have had the opportunity to do all the exploring they needed to. I’d say this could definitely be one of the factors.

Comments are closed.