Reviews AB test

Scott
Community Manager
Community Manager

Hi Zazzle Creators,

We want to inform you about an upcoming A/B test aimed at improving the product review process. These changes result from thorough research and are designed to enhance customer trust and overall experience on the Zazzle marketplace.

Our commitment to transparency and integrity remains a top priority. We strive to ensure that all reviews are fair, honest, and trustworthy. As we refine this experience, we welcome your constructive feedback within this thread.

Here are a few key points to keep in mind:

  • The updated review process will align with the guidelines outlined on our Review Process Page. These guidelines are in place to ensure that all reviews on Zazzle are fair, honest, and trustworthy, while ensuring compliance with relevant guidelines.
  • Reviews can only be removed for reasons specified on our Review Process Page.
  • We recognize that you may have feedback, and we want you to know that these updates are being rolled out in phases to allow for careful testing and adjustments.

We believe these improvements will benefit our entire community—Customers, Creators, and third-party Manufacturers—by promoting open communication and fostering continuous improvement.

Thank you for your continued support.

Creator Team

62 REPLIES 62

PGCo
New Contributor II

I agree with this 100%. Has anyone reached out to you regarding this matter?

I am dealing with customer support, the content team, and I just emailed the team.creator@zazzle.com email to see if anyone is actually willing to help.  I am astounded by how absurdly unjust this is to the designer. I have 3 reviews which I am trying to get removed from my store/profile which are clearly about print quality - not the design. Everyone in customer support agrees with me that the reviews are not my fault or my responsibility, yet no one is able to remove them....? It makes no sense.  I am hoping someone will get back to me on this....so disappointing. 

whimsywhim
Valued Contributor

It is inexplicable how anyone can try to justify keeping reviews on designers' stores that have to do with print quality, mailing issues, etc - all issues that have nothing to do with the design or designer.  Zazzle needs to take a hard look at their review policy.  Unjust reviews really harm the designer.

CLC
New Contributor III

The review system makes no sense. I received a 2 star review because the customer ordered milk chocolate covered oreos when they wanted white chocolate. I don't do cover photos as I think they are confusing and do not represent the products accurately, so the product picture was the standard marketplace sideways photo of a milk chocolate covered cookie, nothing but brown showing, no way the customer did not know it was milk chocolate, so the review itself was just ridiculous, but I was so upset that I deleted the product as it only had a few views and posted it again with a small change. The review stayed on my account for about 6 weeks then disappeared, which was awesome, but it should have never posted to my store as it was not about the artwork.

If that alone wasn't bad enough, it now also directly affects the collection ranking. Imagine having a collection with 30+ items which customers keep purchasing time after time without leaving any reviews, but then only one person isn't satisfied with the print quality/shipping/size etc. and they give you 1 star - it is now publicly displayed as an official collection ranking. Would you purchase an item from a collection that has a 1 star ranking? I would not. I also do not understand why our items/collections should take a hit when in 99% of cases the review has absolutely nothing to do with the design.

Holy moly!  I didn't know that about the collection.  Good grief.  There needs to be a massive revamping of the review process.

I got a one star review from a customer for a locket that was defective.  When I reached out to customer service asking them if they could make this right with the customer and remove the review since it had nothing to do with the design, I got an email back saying they will look into it and haven't heard anything since.  In the mean time, my store z-rank and sales have tanked.  I will try removing the listing all together and see if that helps.  It's very alarming as a seller that we cannot do anything about negative reviews especially when the negative feedback has nothing to do with anything we have control over.

The entire review system needs to be overhauled.  It is ludicrous and egregiously unfair to sellers that we can't respond to openly unfair reviews.  Either Zazzle needs to take them off or give us a chance to respond.  Ideally, they need to be taken off.

Liya
New Contributor II

It is really bad! All bad reviews I have are for print issues, shipping delays or defective items. These reviews should go to zazzle or the production partner etc. not stay in my store as they are clearly not reviews that have anything to do with my design skills or service! Yesterday I also noticed one of my collections had 2 star average rating which doesn't make any sense.

Totally agree! I have a 1 star review because the item never arrived (somehow this review JUST appeared from September). So now that ENTIRE collection has a 1 star review on it publicly because that is the only review so far. The customer takes it out on our designs and gives us a negative review across the board because of issues we can't control.   I've gotten a star knocked off for an item that the customer loved because the envelope didn't fit the invitation correctly.  And more.  This definitely needs to change!

Laura
Contributor III

So strange! I discovered a review from December 30, 2020 which wasn't there before. I know because I downloaded my reviews in May of 2024 and it is obviously not there in my download so it was added after May 2024. It's a 1-star review (of one of my bestsellers) stating they never received their order (nothing I can do about that). Also, it hurt my collection rank.

Laura
Contributor III

And I just received another bad review (for a Zippo lighter) which has nothing to do with my design. Again, it indicates that customers do not understand how Zazzle operates.

"I'm having trouble with it lighting. I know zippo has a lifetime warranty, so I emailed them asking about the wick. Got no response. I thought your products had a warranty also. Could you please email me back to explain my options? Disappointed."

There's no way for me to repond  to her.

whimsywhim
Valued Contributor

Exactly - there is no way for us to respond.  That is one of the biggest problems with the review process.  Either Zazzle needs to review the reviews and delete the egregiously unfair ones like what you just received and/or give us a chance to respond.

LMGildersleeve
Valued Contributor III

Zazzle does check the reviews. I know because on one of my one star reviews the customer said she'd like her money back. I personally wrote to Z and pointed the review out and they said they'd already reached out to her.

Yes, I'm sure they review the reviews.  My point is they need to delete the patently unfair ones like blaming the seller for printing, mailing, etc issues that are completely out of our control.

ColsCreations
Honored Contributor II

That's actually a fair review, and they gave it 4 stars anyways. They received a product that didn't work, reached out to the manufacturer with no response, so are turning to the retailer they bought it from for help. Totally reasonable. They are not giving you a bad review. That Zazzle figures review scores in to ranking Collections, that's messed up but is none of the customer's concern. Ordering issues, shipping delays, product & print quality - none of that has to do with the designer but it's standard things people mention in reviews. If you think about it, there's really nothing of importance they can say about the design itself. "I didn't like this design"? Then why did they order it? "I love this design"? Of course they do, that's why they ordered it. Unless you were communicating behind the scenes to make them a custom design or something, there's really nothing meaningful they can say about the design/designer. So it is totally unfair that Zazzle factors reviews that generally aren't ever going to reflect on the individual designer into their Collection scores. It does however go both ways. This is a 5-star Zippo review as example:

"Zippo works great .always have a lighter for around the house ... Custom so never gets borrowed lol... and easy to refill... Came out good for such a small item.... Print is durable so far."

None of that has anything to do with the design/designer either, but it factors into the designer's Collection score (4.8) too.

On Amazon, they want reviews to be only about the product itself. Mention issues with shipping or the seller, that'll usually get your review denied. They have separate places to report/rate on those things. Zazzle's review form used to have distinctly different fields prompting for feedback on Product and Printing. Last I did a review, there was only one field to enter your thoughts in, and a box to check as to whether it shipped on time and another I think for whether you'd recommend it. Even if Z implemented a review form with different sections that could be individually rated and included one specifically for design/Designer, see above ... what could people say there that would be meaningful or helpful to other shoppers? You either like a design or you don't, if you don't than you wouldn't have ordered it.

I don't know what the answer is here but 1) I think Z def needs to abandon the practice of ranking collections based on individual product reviews as that's not sensible or fair and 2) Z should publish responses to reviews like the one you posted, saying "we got you covered, will send replacement, do refund ..."  Whatever the wording. Just so other shoppers scrolling reviews can see that Z steps-up to make things right when there is an issue. 

Store IconStore IconWebsite IconFacebook IconDiscord IconPinterest IconInstagram IconNight Cafe IconOut of Stock List

I agree Colleen.

It was the customer's last word: Disappointed. To me, that is a bad review, I was surprised she gave it 4 stars.

I can 100% understand why there is a review attached to the product itself and all the things related to production... but it should really be reviews attached to say 'invitations' in general for example, rather than the specific invitation and it's design. If it is truly a design related issue (ie. poor or low quality art or image used by us as designers/creators), that's obviously another story and should effect the design review.  I don't know the answer either, but it seems like 95% of reviews are not the design's fault.

CrazyMermaid
Valued Contributor II

I wonder if we delete the item with a bad review from the collection and replace it with a newer unsullied version, it will delete the one-star review from the collection. 

CrazyMermaid
Valued Contributor II

I agree about the scope of the review. It needs to be made clear that designers aren't responsible for printing and shipping errors. This isn't etsy where designers are responsible for that. Since etsy is so much larger and does so much more advertising than Zazzle (compounded by Zazzle persisting in calling us "creators"), it is easy to understand why customers think we are. 

Marcia
Valued Contributor III

My last 2 reviews were 1 star. The customers were complaining about the printing both times. The business card had 34 previous sales. The enclosure card had 4 previous sales but the matching invites, save the dates & thank you cards have had many mores sales than that in the past. Unfortunately, the enclosure card return had me lose $44.20 today. To say I'm not happy is an understatement. And now both reviews are attached to those 2 products. How is that even fair?

Jermolinaart
New Contributor III

It doesn't seem fair at all. Three 1-star reviews from the same person for an item never delivered is a problem. I’ve never seen those reviews before—they just appeared out of nowhere a few weeks ago, and as a result, my collection rating dropped to 2.8. review.png

Looking at the dates and comments of three reviews of the same item never received by the same customer is odd.  How can someone leave more than one review of only one item ordered?  Saying they reached out to the seller, instead of knowing it is a separate Zazzle customer service concern and they should contact them instead, is a problem too, like I pointed out in my earlier post, that we're not like Etsy, etc., yet some customers aren't aware of that it seems.  So it needs to be made much clearer by Zazzle. 

Maybe at the top of the page underneath Zazzle's Logo I've been thinking they could put a small Tagline to stand out to any customers visiting the Zazzle site saying something like Zazzle is a Marketplace with a vast array of items to personalize, with independent designer's applying their designs, and Zazzle prints, packages and ships orders to customers.  Just a thought.

ana_garza
New Contributor II

There should be a review of the product and others for the design or designer. It is not fair to get a 1-star review for the quality of the product and have it posted on the designer storefront.