Book Cover A/B Testing vs Hiring a Designer or Running a Cover Contest
A designer or a cover contest produces files. A reader A/B test records which of those files voters prefer. Here is how the jobs differ, when to commission art, and when to put the finalists in front of readers.
By The CoverCrush team · Editorial
A designer or a cover contest gives you files. A reader A/B test records which of those files voters like better. Here is how the three jobs differ, when to commission art, and when to put your finalists in front of readers.
By The CoverCrush team · Editorial
Hiring a designer, running a cover contest, and A/B testing a book cover are three separate jobs. A designer makes a cover. A contest asks several makers to send in concepts so you can choose among their files. A reader A/B test does neither of those things. It takes images you already have and records which one voters pick. CoverCrushing is the testing site. It isn't a design studio, and it doesn't run design contests.
Authors run into trouble when they treat these jobs as if one could stand in for another. A beautiful file from a skilled designer can still send the wrong signal for the genre. A contest can leave you with a pile of options and still have you guessing which one a reader would click. A vote test can't invent a cover you haven't uploaded. The sensible order is to get real cover files first, and then test the ones you would be willing to publish.
What you hire a designer to do
A cover designer turns a brief into a file: typography, image, color, and a composition that still reads at thumbnail size. CoverCrushing's cover cost calculator treats hiring a designer as a way to produce that file, apart from any vote. It puts mid-range marketplace routes such as 99designs and Reedsy in one group, and it puts premium custom work in a separate group. Those calculator ranges are estimates for making a cover. They aren't CoverCrushing test prices.
You still need a brief. The genre, your comp titles, whether the book belongs to a series, and whether the title has to stay readable at search-result size all go in that brief. The designer's job is done when you have files you can actually publish. Their taste is informed, but it is still one person's taste. It isn't a tally of how readers voted.
CoverCrushing doesn't replace that hire. The upload step expects a cover that already looks like a cover. The title and author name should be readable, because a blank title area changes how people vote. Testing finished or nearly finished options gives you a clearer comparison than testing rough sketches. Many authors commission two or three near-final directions and then test those files, instead of asking the designer to guess.
What a cover contest usually produces
A cover contest is a way to buy several concepts in one go. You post a brief, designers send in entries, and you choose a winner, sometimes after a round of revisions. CoverCrushing's own design notes describe 99designs as one place where authors run that kind of contest, with quality that varies and with you serving as the creative director. A contest is useful when you don't have a designer yet and you want to see more than one visual idea before you spend money on a final.
A contest vote, when the marketplace offers one, is not the same as a CoverCrushing reader vote. Contest feedback often comes from other designers, from friends you invite, or from people judging the craft. CoverCrushing voters choose the genres they read and then pick a cover on the public vote page. Those are different audiences. A design that wins a contest because the illustration is skillful can still lose a reader test because its genre signal turns muddy at thumbnail size.
Use a contest to gather candidate files. Use a reader test on the two, three, or four finalists you would really ship. Don't upload every sketch from a long contest. An A/B test compares two covers. An A/B/C test compares three or four. Tests of more than four covers aren't offered.
What a reader A/B test measures
On CoverCrushing, an A/B test compares two images for the same book. You sign in, upload Cover A and Cover B, name the book, and pick a genre. Readers who choose A/B Compare see both covers and pick the one they prefer. Whichever cover has more recorded votes is in the lead. The same test also gets a five-perspective AI panel score, and that panel output is labeled separately from the reader votes.
The leading cover is a comparison of the files in that one test. It isn't a certificate, and it isn't a promise of sales. The Crush Score is a 0 to 100 figure based on the leading cover's share of the votes. A wide margin scores higher than a near tie. It doesn't measure how long anyone looked, and it doesn't forecast rank.
First Crush, an A/B test of two covers, is $5 for your first paid test, then $12. Hard Crush is $29, and Crush It is $59. New authors get one free A/B test during the 48 hours after signup. That free test is two covers with a target of 200 votes, and it does not ask for a card while the trial is still open and unused. Prices are in US dollars and are charged through Stripe. The full list is on the pricing page.
CrushPass is $19 per month and includes one A/B test credit per paid invoice. It isn't an unlimited-test plan. Pro Monthly is $29 per month and adds two A/B test credits every month you're subscribed. A membership is a way to run repeat tests across a series. It isn't a substitute for paying a designer to draw the covers.
When to design first, then test
Design first when you don't have two publishable files yet. A reader can't vote on a mood board that only exists in your head. Commission the designer, or run the contest, until you have two to four covers with the title and author name on them. Then start a cover test.
Test before you pay for a full paperback wrap, a hardback jacket, and a set of ads that all rely on one image. Changing direction after the ebook front cover is picked costs less than changing it after the printer already has the wrap. The test still won't tell the designer how to illustrate. It will tell you which of the directions readers chose, and the AI panel will tell you, separately, how the rubric scored typography, thumbnail legibility, genre signal, and the other criteria.
Take the report back to the designer as a brief, not as a put-down. If readers split evenly, the covers may be too alike, or both may be fine. If one cover leads by a wide margin and the panel also flags a weak thumbnail on the losing cover, that gives you a concrete revision note: hierarchy, contrast, or genre cue. The panel comment is labeled as AI. The vote count is the reader result. Don't average the two into a single “truth,” and don't ask the designer to chase a score the test never produced.
What neither path owes you
A designer doesn't owe you a bestseller. A contest doesn't owe you a reader's click. A CoverCrushing test doesn't owe you a sales lift, and it doesn't send the winner to Amazon. The test doesn't change your KDP dashboard. You keep the copyright in the files you upload. You can ship the leader, revise, or keep the cover you liked better. The report is there to support your decision. The cover you publish is still your call.
If the test doesn't reach its vote target within 72 hours, you choose a free re-run or a full refund; request it within 14 days, and a person reviews it. A finished test isn't refunded because you didn't like the winner.
Frequently asked questions
Q: Should I hire a cover designer or run a CoverCrush A/B test? A: Hire a designer when you need a cover file made. Run a CoverCrushing A/B test when you already have two images and want reader votes on them. The test doesn't draw the cover. First Crush is $5 for your first paid test, then $12. Hard Crush is $29, and Crush It is $59.
Q: Is a cover contest the same as reader A/B testing? A: No. A cover contest asks designers to send in concepts. A CoverCrushing A/B test shows the images you upload to readers who choose a genre and pick a cover. Contest feedback and reader votes come from different audiences. Use a contest to get files, then test the finalists you would publish.
Q: Can I test rough sketches? A: You can upload a cover before the book is finished, but a missing title or a stand-in author name will change the votes. Testing finished or nearly finished options gives you a clearer comparison than testing rough sketches.
Q: Does the winning test cover replace my designer's judgment? A: No. The winner is the cover with the most recorded votes in that test, shown next to a separate AI panel score. You can ship it, use the split to brief a revision, or keep a different cover. The report doesn't take the design decision off your desk.
Related reading
What CoverCrush is explains the vote page, the AI panel, and the prices. How to choose a book cover with reader votes walks through how to read a finished report. Product rules are on the FAQ.