SUBJECT LINE A/B TEST
01 / 05

weekly job summary

Scope
Content design
Company
Indeed
For
Employers across all monetization streams
With
UX, product, marketing

Hitting 49% more clicks with two lines of copy.

The Weekly Job Summary is a core lifecycle email reaching 550K+ employers per week. It drives ~1,700 lifecycle-spender conversions per month across upsell and reactivation streams. But according to UXR, employers wanted a more action-oriented and personalized subject line.

So we built an A/B test variant incorporating both.

I led the subject line and preheader, from feedback synthesis to the final test copy.

what employers asked for

Likelihood-to-open was low. A concrete subject line would earn the open, not a generic "weekly update."
PREDICTION
Expect a lift
Hypothesis
Adding action-oriented and personalized language to the subject line will increase the open rate. Since the change reflects direct employer feedback, a neutral result also warrants rollout as a CX improvement.
Metric
Email open rate
Audience split
Control: 50% · Test: 50%
Winner criteria
A neutral or positive result after 1 weekly send will be enough to declare a winner.

workshopping the line

Feedback
Employers
Prefer a subject line that includes a problem or something they need to take action on (e.g. 6 candidates waiting)
Claude
Personalization boosts open rate; numbers and specifics outperform vague language
SENIOR PM
Personalization aligns with direction from leadership
UXD
Use “jobs,” not “roles,” and be careful with using “perform”
Current
Weekly Job Summary
Ideas from the team
⚠️ Your weekly job status — recommended next steps inside
Advised not to use the warning icon
Hiring update: Here’s where you stand and what to do next
Too many alts to choose: Job update, jobs update, job post updates
This week in hiring at {Company Name}: results + next steps
Personalized, but not yet right
{Company Name}, check in on your job status
My idea
For an evergreen email like this with a high open rate, will a new subject line confuse them?
— SENIOR PRODUCT MANAGER

The neutral or better winner criteria were the answer, because if habit kept open rates flat, the change still rolled out as a CX improvement. Later, the results showed employers weren’t confused.

…and the preheader

Our international lifecycle marketing manager offered three alt options, each giving a preview of what to expect from the email. I pulled the most important bits from each into one.

Track your job activity and posts on Indeed
Catch up on your applications and key insights
Job performance and recommended next steps are inside
MY VERSION
Catch up on job activity, key insights, and next steps

what changed

Only the subject line and preheader differed, while the email body stayed the same.
The test adds the two elements employers asked for.

Control
Indeed
Weekly Job Summary
This is what your week looked like on Indeed
Descriptive and static, w/o personalization or a call to action
Test
Indeed
{Company Name}, check in on your job status
Catch up on job activity, key insights, and next steps
Personalized and action-oriented, exactly what they wanted

exceeding expectations

44.61%
+6.9% vs. control · open rate
6.85%
+39.7% vs. control · click-to-open (CTOR)
3.05%
+49.3% vs. control · click-through (CTR)

Those who opened the email were far likelier to click. A clearer, action-oriented subject line set accurate expectations of what's inside. Catchier subjects were usually risky at Indeed, but here, it resulted in more clicks. 

the lift landed on the CTA
+35.3%
+1,252 vs. control · clicks on View candidates
~48%
Share of the clicks from 1 CTA
–17.8%
Unsubscribe clicks: fewer opt-outs

View candidates rose 4–5× the other main CTAs. The test specifically pushed more employers to review their applicants, the action “check in on your job status” invites. The framing delivered on its promise.

setting new defaults in my first month

Each lift was steady with a clear business impact: 49% more clicks per email. My versions are now the default for Weekly Job Summary campaigns.

Throughout my work, you’ll find me as the first or founding content designer and teaching partners how to work with me. Indeed didn't have email-specific content design, so I made an email-specific framework. The Weekly Job Summary was the most significant campaign I partnered on, and altogether they formed how I structured Indeed’s email content framework, then trained its internal content MCP.

NEXT
trusted friends
Read →