Did this do its job? Measuring engagement with longform stories
Longform content is meant to deliver results, not just attention. So why are we still treating pageviews as the win?
by Karen Robinson
by Karen Robinson
Longform content is often measured as if attention were the goal. It isn’t.
If you work in content, you’ll recognise the metrics — pageviews, time on page, scroll depth. They’re easy to report and easy to point to as proof something worked. But they don’t tell you much about what the content actually did.
That becomes more obvious the more substantial the work is. A longform article might hold attention, get shared, even outperform expectations — and still leave you struggling to explain what changed, or what you got back for the investment.
In this piece, we’ll argue for an intent-first approach to measuring the success of longform content. We’ll look at which signals matter, how to connect engagement to business outcomes, and how teams like ours at Shorthand measure impact.
We'll cover:
We'll cover:
Start creating with Shorthand
It's the fastest way to publish beautifully engaging longform stories, reports, internal comms, and more.
Defining success before you publish
If engagement matters most when it’s combined with intent, the key question to answer before you think about measurement is: What is this piece meant to do?
That sounds obvious, but it’s where most content measurement goes wrong. Teams publish longform stories with a vague sense of purpose — thought leadership, brand, engagement — and then try to reverse-engineer success from whatever metrics are easiest to pull.
A more useful approach is to be explicit about intent upfront. Not at the level of KPIs yet, but at the level of outcomes.
Is your piece meant to:
- influence how a specific audience thinks about a problem?
- build trust and credibility over time?
- align or inform an internal audience?
- encourage readers to take a next step?
Different answers lead to different definitions of success. And that, in turn, determines what signals are worth paying attention to — and which ones are just noise.
A common mistake: measuring longform like shortform
Most analytics frameworks weren’t built with longform storytelling in mind. They were designed to evaluate pages that are meant to be scanned quickly, clicked through, or converted from.
Apply those same frameworks to longform, and suddenly partial reading counts as failure and detail becomes a liability.
A longform story doesn’t need everyone to reach the final paragraph to be effective. It needs the right people to engage with the right parts and to come away with something that matters.
Judging longform by shortform standards misrepresents performance and, worse, it actively discourages the kinds of stories that create long-term value.
Intent signals: what actually tells you a story is working
If engagement isn’t the ultimate goal, what should you measure instead?
You don’t need a whole new toolset to understand outcomes — just a more deliberate way of using what you already have. The signals that matter most are the ones that show whether reader behaviour actually matches the intent you defined upfront.
Here are some of the most common intent signals and what they actually tell you.
Progression through key sections
Instead of looking at how far people scrolled, focus on where they spent time.
If readers consistently reach the sections where your core argument lives, that’s a signal of relevance. If they drop out before then, the issue may be framing, structure, or expectation-setting — not lack of interest.
Time spent where it matters
Overall time on page is rarely helpful. Time spent in specific sections is far more revealing.
It tells you where attention concentrates, where it dissipates, and whether readers are engaging with the parts of the story that are meant to do the heavy lifting.
Intentional interactions
Clicks, media plays, navigation use, and other interactions are valuable because they show choice.
They indicate moments where readers decide to explore further, seek clarification, or go deeper — all signals of intent, not just activity.
Downstream behaviour
The clearest intent signals often happen after the story itself.
That might be:
- a click through to a product or explainer page
- a newsletter signup
- an app signup
- a purchase or enquiry
Downstream behaviour is one of your clearest signals of business impact, and is how we measure success for The Craft here at Shorthand — more on that below.
Return visits and sharing
When readers come back to a longform piece, or share it with others, they’re signalling that it has value beyond the initial read. Not every story needs this outcome — but when it happens, it’s a strong indicator of resonance.
Used together, these signals help answer a more meaningful question than Did people engage? They help answer: Did the story do what it was meant to do?
Intent signals: what actually tells you a story is working
If engagement isn’t the goal, what should you measure instead?
The answer isn’t a new set of engagement metrics, it’s a shift in how the metrics are interpreted. The most useful signals are the ones that help you understand whether reader behaviour aligns with the intent you defined upfront.
Here are some of the most common intent signals — and what they actually tell you.
Progression through key sections
Not how far did people scroll?, but where did they choose to spend time?
If readers consistently reach the sections where your core argument lives, that’s a signal of relevance. If they drop out before then, the issue may be framing, structure, or expectation-setting — not lack of interest.
Time spent where it matters
Overall time on page is rarely helpful. Time spent in specific sections is far more revealing.
It tells you where attention concentrates, where it dissipates, and whether readers are engaging with the parts of the story that are meant to do the heavy lifting.
Intentional interactions
Clicks, media plays, navigation use, and other interactions are valuable because they show choice.
They indicate moments where readers decide to explore further, seek clarification, or go deeper — all signals of intent, not just activity.
Downstream behaviour
The clearest intent signals often happen after the story itself.
That might be:
- a click through to a product or explainer page
- a newsletter signup
- an app signup
- a purchase or enquiry
Downstream behaviour is one of your clearest signals of business impact, and is how we measure success for The Craft here at Shorthand — more on that below.
Return visits and sharing
When readers come back to a longform piece, or share it with others, they’re signalling that it has value beyond the initial read. Not every story needs this outcome — but when it happens, it’s a strong indicator of resonance.
Used together, these signals help answer a more meaningful question than Did people engage? They help answer: Did the story do what it was meant to do?
From signals to decisions
The goal of measuring intent signals is to make better decisions about what to publish and how to optimise your content design.
That might mean:
- restructuring future stories so key ideas appear earlier
- clarifying framing to better match reader expectations
- doubling down on formats or themes that consistently drive meaningful outcomes
- pivoting your content strategy when things aren’t working, to better serve the audience you’re looking to attract and the results you’d like to achieve
Case study: How The Craft measures success
Shorthand’s digital magazine, The Craft, is measured on business contribution, not traffic.
Its core goals are to:
- attract and engage a clearly defined ICP audience
- convert readers into Shorthand app and newsletter signups
- support long-term growth in paying Shorthand customers
To track performance, we monitor both on-page and downstream metrics — including product usage and purchasing behaviour — using Mixpanel.
We also use A/B testing with Convert to make evidence-based decisions about how content and calls to action are presented. As outlined in our A/B testing guide, this approach has contributed to 50% year-on-year growth in qualified signups, even as traffic from traditional search engines has declined.
What we learn from these metrics and test results doesn’t just inform on-page tweaks — it feeds directly into our content strategy.
We actively monitor which stories resonate most with ICP readers and drive downstream behaviour. Those insights shape what we publish next and how we frame future pieces.
Shorthand’s longform strategy for The Craft aligns with top-level brand and revenue goals, guided by data.
Shorthand’s longform strategy for The Craft aligns with top-level brand and revenue goals, guided by data.
How other teams define success
If you’re outside B2B marketing, content success can look quite different. Let's look at examples from internal comms and B2C.
RELX: engagement as organisational impact
RELX uses longform storytelling to support internal communication across a global workforce of more than 33,000 people. For RELX, success isn’t defined by clicks or traffic, but by whether content helps:
- inform employees
- build advocacy
- strengthen organisational alignment
RELX has a sophisticated internal comms strategy designed to strengthen company culture and performance.
RELX has a sophisticated internal comms strategy designed to strengthen company culture and performance.
As Paul Abrahams, Chief Communications Officer at RELX, explains:
Net Promoter Scores within RELX have soared. Across the businesses, we’ve had a 20 point increase in people saying they would recommend RELX as a place to work. Those are record levels. At the same time, we’ve seen readership of our internal communications increase by more than ten times.
Rather than focusing on individual page-level metrics, RELX evaluates engagement in terms of broader outcomes, including readership, advocacy, and employee sentiment. These signals help the team understand whether their internal stories are landing and contributing to wider cultural objectives.
Learn more about RELX's strategy in our case study.
Honda: engagement as a path to commercial impact
Honda uses longform storytelling to support brand engagement and marketing objectives, with a clear focus on how content contributes to commercial outcomes.
For Honda, engagement is valuable when it leads to movement — deeper exploration, stronger interest, and progress towards a purchase decision.
Honda’s brand publishing strategy focuses on serving loyal audiences with high-quality content and turning them into advocates.
Honda’s brand publishing strategy focuses on serving loyal audiences with high-quality content and turning them into advocates.
As Nick Bennett, Digital Content and Social Media Section Manager at Honda UK, notes, this kind of intent often shows up in how audiences move between stories:
We know that most people look at two or more articles. They may be coming through via a story that interests them, but the quality means they are more likely to stay longer and look at others.
Honda’s longform stories are designed to immerse readers in the brand and encourage meaningful next steps. Success is measured through a combination of signals — including dwell time, click-throughs to Honda’s main site, and return on investment — that help connect storytelling to downstream impact.
Rather than treating the story itself as the end goal, Honda evaluates how longform content supports broader marketing objectives. Engagement data is used to understand whether stories are prompting deeper exploration and movement further along the path to purchase.
Read more about Honda's digital publishing strategy in the case study.
Checklist: are you measuring the right things?
To pressure-test your own approach to measuring engagement and impact, it helps to step back and ask a few simple questions.
|
1. Have you defined success before you publish? If you can’t clearly articulate what a piece is meant to achieve — beyond engagement — your metrics won’t tell you much. Define the intended outcome first, then decide which signals matter. |
|
2. Are you measuring intent, not just interaction? Scroll depth and time on page are only useful when they help explain reader intent. Look for signals that show progression, choice, and follow-through — especially what happens after the story. |
|
3. Do your metrics connect to real business outcomes? The most meaningful engagement data is tied to something that matters outside the page: signups, subscriptions, enquiries, or movement towards purchase. |
|
4. Are you using data to guide decisions, not just optimise pages? Measurement should influence what you publish next, not just how you tweak what’s already live. If engagement insights aren’t shaping your content strategy, you’re leaving value on the table. |
|
5. Are you comfortable with different definitions of success? Not every longform story should behave the same way. A piece that builds trust may look worse on paper than one designed to convert — and still be doing exactly what it was meant to do. |
Longform content should be measured against what it was meant to do. The metrics you choose don’t just track performance — they shape it.
Built with Shorthand