Suggestion to create a beta testing program

[CreativeLeahG]

<mod edit: I split this out from our ongoing discussion about instant downloads>

I am not sure if you already have such a thing, but I wonder re future innovations and newly introduced features Zazzle could have a board of ' creator members' whose questions, thoughts and advice have proved helpful in previous forum discussions. Before things 'go live', feedback, suggestions and trouble shooting concerns could be discussed and opinions sought.

Having the feedback after things go live is costly I feel (time, productivity etc.). 

I always assumed such a group did exist (perhaps with Diamond members) because it seems logical and practical, but on the off chance it doesn't, this could be something helpful to Zazzle and members going forward. I appreciate we can't all be involved in 'pre-live' feature discussions.

Thank you for considering this if it's not already a thing.

[Barbara]

For a software company, I was one of twenty or so permanent beta testers for anything new that was slated to be launched. The company chose the testers according to their experience, from novice to expert, and we spent from one to three months where we worked with one another and with the company to smooth out everything from big bugs to little annoyances. The interesting thing was that those of us with high experience weren't any more valuable than the novices, and the array of experience ended up creating new versions and products that, at most, had one or two small glitches.

The above experience makes me think that your idea, @CreativeLeahG , is good along with the addition of testers with less experience. They can illuminate problems that more experienced people won't even notice.

Colorwash's Home

[CreativeLeahG]

Absolutely,

I think the fact our collective 'feedback' resulted in the beta testing delay, illustrates the value of such a consortium. And designer level shouldn't factor. We have an amazing array of skill sets here on Zazzle. Creatives with backgrounds in law, software development like yourself, website design, marketing and so on. AND some very talented people who can pick through a contract with a level of vigor and precision that astounds me to highlight any omissions.

What a massive resource Zazzle has (for no fee) at its fingertips to consult with!

@James 

[Brownielocks]

Years ago, I was part of a Beta testing team for Yahoo Games (card games.)  It was fun but frustrating.  They seriously considered all our input.  

[Scott]

Super important that we keep the Instant Downloads discussion on-topic since theres 10+ pages of content there, so I've split this conversation out into its own discussion.

[albamarie]

I think forming a group of beta testers is an excellent idea, and I would love to take part in it if it is formed. I think the digital download idea has a lot of merit based on market conditions. If it is done the right way, it could be amazing for customers, designers and Zazzle.

[Connie]

Why shouldn't everybody have input? We all have a stake in the future success of Zazzle, as well as our own stores. You get a lot more unbiased honest feedback from the community at large than you would get from just a few select privileged people.

However, Zazzle already gives some members a head start on new products before they go live. And they also already do regularly run beta tests with only a few designers, for example, the "Replace Product" feature, and the Cover Photo feature, which were in beta tests for a long time before everybody got the use of those features.

[CreativeLeahG]

@Scott 

Thank you for creating a new thread but title I feel is misleading as I'm not suggesting beta testing. @James I am suggesting a consultation group that includes creators as part of the team that throws the ideas around of how this (or other innovations) can be implemented. The part that begins long before beta testing.

How to choose that group of creators? Zazzle could discretely choose from those creators they believe offered the best suggestions or asked the best questions, OR we as a forum could vote in our own group to be part of those discussions. Though I suspect people would rather be anonymous else they'd be getting the blame if the masses disagreed with the final decisions.

All I am saying is it could be helpful to involve some creators in the process at the idea stage, BEFORE beta testing and implementation of innovations. 

[CrazyMermaid]

Zazzle already does most of what you are suggesting. As @Connie has already stated they did recent Betas on Cover Photos and the Replace feature. I can think of many more, but I don't see the value in listing them. I also think it is great that they include a wide range of Zazzlers - not just the people who participate in the forums or who are Diamonds.

It spoke volumes to me, when they did open up the discussion of Digital Downloads to the entire community and sent out emails so not just forum users would know about it. I hope this continues on this matter, because of the existential impact it could have on many of us. 

I am not sure a permanent board would give them the information they need. Depending on the project, they  
would probably need the viewpoints of people with certain products, traffic etc. It would also give these few an undue advantage over the rest of us. Just speaking as a very competitive person. 

[albamarie]

@CrazyMermaid I don't think we should think about the idea of enlisting the help of a creative board as giving some Zazzlers a competitive advantage, especially if it included all different levels of creatives working in very different areas. It would merely provide valuable feedback on whether an idea was good, bad or somewhere in between before opening it up to thousands and thousands of viewpoints. That gets confusing fast. I am not sure how much testing and opinion taking Zazzle does with consumers, but that is extremely important data for any business and would trump even the suggestions of creatives in my opinion. If consumers are demanding something and you aren't giving it to them, they will quickly take their cash elsewhere. The modern marketplace evolves at lighting speed, and we all need to be willing to adapt to consumer demand. If we work together as designers, rather than thinking of each other as the competition, we all win. That may sound Pollyanna, but I think it is the best way to go about business.

[CreativeLeahG]

To reiterate as I think the title is misleading and I was perhaps not clear enough, although the post being separated from the topic it related to also increases that ambiguity.

This is about creating a FOCUS GROUP ( I couldn't recall the official name before, Scott please can you amend title to reflect FOCUS group, thank you)

Definition of Focus Group

Focus groups use group dynamics to get shared experiences of people with similar characteristics. This is different from an interview study, where the focus is on individuals.

Focus groups can be used to get feedback before your product is developed (formative or summative evaluations).

Use focus groups when:

• you want to get a breadth of understanding of the thoughts and experiences of users
• you have open-ended questions about your product"

As you know re digital downloads the beta has NOT been released yet, it was postponed after feedback despite having a release date of the 31st October. This to me seems to be a costly (time and money) approach. Hence my suggested focus group.

As a NON beta, non live item, a Focus Group would require the signing of NDA's. 

It is also possible such a Focus group already exists ....... Zazzlers or non Zazzlers with experience of digital downloads AND ideally consumers! This has not been confirmed or denied and Zazzle have no reason to do so. Hence I was just putting the idea out there for them to consider if it was in fact not already something that takes place.  

Regarding some being afraid of the edge or competition others may have if they are involved in this Focus Group .... I have no reason to suspect nor have I suggested, any Focus Group members get preferential treatment in the marketplace for offering insight. 

I hope that makes it clearer. 

@James @Scott @albamarie @CrazyMermaid @Connie @Brownielocks