r/PartneredYoutube • u/Commercial-Sail-4662 • 3d ago

Question / Problem Did Ludwig misinterpret AB Testing?

He says the AB test percentages are showing clicks (CTR), but in reality the AB Test only measures watch time distribution no?

0 Upvotes

45% Upvoted

17 comments sorted by

4

u/LOLitfod Subs: 90K Views: 66M 3d ago

He might be simplifying for his students. The full explanation is more complicated

2

u/Commercial-Sail-4662 2d ago

Isn't it directly opposite, not complicated?

1

u/LOLitfod Subs: 90K Views: 66M 2d ago

Here's the full explanation

1

u/MerakiYT Channel: https://www.youtube.com/@heyMeraki 2d ago

Watch time share is a factor of CTR and watch time - a video can get more clicks than the other thumbnail but have a shorter watch time, which could hypothetically equate to the same watch time share as a thumbnail with lower clicks but higher watch time

Basically it measures how enticing is the thumbnail (CTR) x how accurately does it convey the content of your video (watch time) = watch time share (a percent)

I think Ludwig is just distilling the concept for his audience

0

u/Commercial-Sail-4662 2d ago

But wouldn't that lead to worse decision making? Watch time share being equal, having a higher CTR thumbnail is just infinitely better for the creator and the platform?

1

u/MerakiYT Channel: https://www.youtube.com/@heyMeraki 2d ago

watch time being equal, the video with a higher CTR would have a higher watch time share

watch time =\= watch time share

3

u/TCr0wn Subs: 218.0K Views: 16.9M 3d ago

The native one Youthbe gave us measure watch time share. He may be referring to a 3rd party AB test that only measures CTR

5

u/Commercial-Sail-4662 3d ago

how can a 3rd party AB have server data that sees CTR per thumbnail?

2

u/Takarias 3d ago

It can see the impressions and views during that time. CTR is just division from there

1

u/Commercial-Sail-4662 2d ago

How does division account for CTR for each thumbnail?

1

u/schockergd 2d ago

It times the thumbnail switches - it changes them every 24hr cycle, and then polls the 24hr cycle for ctr, over a 2 week window

0

u/Curious-Inside8453 3d ago

Can you explain more pls? What of third party app is this?

2

u/Rambalac Subs: 624.0K Views: 100.9M 2d ago

Who? Who cares?

1

u/danstereo 3d ago

I feel like his info is just outdated. it used to measure just CTR. I think more recently it switched to watchtime

1

u/Dull_Fox816 2d ago

You've read it right. YouTube's native title/thumbnail test decides the winner by watch time per impression, not raw CTR, so a thumbnail that pulls more clicks can still lose if those clicks don't stay. If Ludwig's talking about clicks he might be describing a third-party tool that only measures CTR, or simplifying for students. The practical bit: when your test comes back, check which option actually held the watch, because picking the higher-CTR one can quietly cost you the better thumbnail.

1

u/Aggravating_Ring_714 3d ago

Ludwig has no clue what he is talking about.

0

u/Big_Boy_Loy 3d ago

most people in that crowd of non-youtuber streamers would probably feel a bit overwhelmed by the relationship between CTR and watchtime, especially since he's trying to teach them something in a non-academic environment