YouTube Test & Compare: 3 Title + Thumbnail Pairs

"Packaging" is what YouTubers call the title and thumbnail together: the two things a viewer sees before deciding to click. YouTube Studio's Test & compare lets you test up to three versions against each other on real viewers. What slows most creators down is making three genuinely different versions. SceneGen's packaging pack makes those three pairs from your finished video and bundles them in a ZIP that's ready to upload.

How YouTube's Test & compare works

According to YouTube's help page on A/B testing titles and thumbnails:

• You can test up to three titles, thumbnails, or title + thumbnail combinations on one video.
• It is desktop only, in YouTube Studio on a computer, and your channel needs advanced features enabled.
• YouTube picks the winner by watch time share, not by click-through rate alone. If the result is inconclusive, the first version you uploaded is kept.
• A test takes from a few days up to about two weeks, depending on impressions.
• Some videos can't be tested, including Shorts, private videos, and videos set as made for kids.

Two facts matter for tools like SceneGen. First, there is no API for Test & compare. The YouTube Data API can set one thumbnail (thumbnails.set), but it can't start a test. So any honest tool can prepare the variants, and you still upload them in Studio. Second, since the winner is chosen by watch time share, a clickbait title that viewers abandon doesn't win. The packaging has to match the video.

What the packaging pack builds

For each finished video, the pack makes three title + thumbnail pairs that differ in more than colour. Each one tests a different idea:

• A: Curiosity. The subject and a headline. The title opens a question the video answers, and the subject's reaction sells it.
• B: Benefit. Text-led, no subject. The title says what the viewer gets, and big words carry the thumbnail.
• C: Direct. The image alone, with no text. A clear, searchable title does the talking, and the frame has to earn the click by itself.

"Subject" means the person or object cut out of your video's own frame. There is no face detector, so SceneGen says subject, not face. Each pack is an ordinary Thumbnail Studio design, so you can open any pair in the editor and change it.

Titles come from what the project already has, its SEO title and video title, plus one short AI call when capacity allows. If the AI isn't available, a deterministic fallback writes them, so a pack never sits waiting. Packs can also be queued automatically when a video finishes rendering.

The pack score: a heuristic, not a CTR prediction

Each pair gets a score out of 100. Half of it is the thumbnail readability check, which renders the design at phone size and checks contrast, text size, word count and safe zones. The other half is a title check, a rule-of-thumb score with the reasons shown:

• Length: about 40–60 characters reads fully, and phones cut titles off near 70.
• Keyword: the topic's keyword is in the title, ideally in the first ~40 characters.
• Pull: a number, a curiosity gap or a clear benefit, and one or two strong words.
• Penalties: ALL-CAPS shouting, "!!!", piles of emoji and stock clickbait phrases.
• Repeats: near-duplicates of your channel's other titles, which viewers skip.

The word-level checks are English-only, and other languages get the language-neutral ones. This score is not a click-through prediction. Use it to catch obvious problems before the test, then let the real test decide.

How to run the test, step by step

1. Finish a video in SceneGen, then open the Packaging pack on the project page, or open it from Thumbnail Studio.
2. Review the three pairs, and edit any title or thumbnail you'd change.
3. Click download. The ZIP contains three YouTube-ready JPGs (each under 2 MB), three 4K PNGs for your archive and other platforms, and titles.txt.
4. Open studio.youtube.com on a computer. Test & compare isn't in the mobile app.
5. Go to Content, pick the video and open Details. Upload the video first if you haven't. If you chose Use as video thumbnail, SceneGen's upload already set thumbnail A.
6. In the Thumbnail section, choose Test & compare. If you don't see it, check that your channel has advanced features (Settings, then Channel, then Feature eligibility).
7. Upload the A, B and C JPGs. If your Studio offers title testing too, paste each pair's title from titles.txt.
8. Save and leave it running. Don't change the title or thumbnail during the test.

Reading the result

When YouTube declares a winner, note which angle won: curiosity, benefit or direct. Over several videos, that tells you more about your audience than any single result. Feed it back into your next thumbnail and your YouTube SEO. Remember that Shorts can't be tested this way. For Shorts, the cover and the first three seconds do the work.

Try it on your next video

Every finished SceneGen video can get a packaging pack, and thumbnails cost no credits. Start free, see the plans, or read how to match a thumbnail layout from a reference.

Frequently asked questions

Can SceneGen start a YouTube Test & compare automatically?

No. YouTube has no API for Test & compare. SceneGen prepares the three pairs and a ZIP, and you upload them in YouTube Studio on a computer. SceneGen can set a single thumbnail on upload.

Can I A/B test thumbnails on YouTube Shorts?

Not with Test & compare. YouTube's help page lists Shorts among the videos that can't be tested.

How does YouTube pick the winner?

By watch time share, according to YouTube's help page. It isn't click-through rate alone, so a title that gets clicks but loses viewers won't win.

Is the pack score a CTR prediction?

No. It is a heuristic: half thumbnail readability, half title rules (length, keyword, clarity, clickbait penalties). Only the real test measures what viewers do.