Click here to monitor SSC

Roger Hart

Technical Author - Red Gate Software

Pub banter - content strategy at the ballot box?

Published Friday, May 14, 2010 10:18 AM

Last night, I was challenged to explain (and defend) content strategy. Three sheets to the wind after a pub quiz, this is no simple task, but I hope I acquitted myself passably. I say "hope" because there was a really interesting question I couldn't answer to my own satisfaction. I wonder if any of you folks out there in the ethereal internet hive-mind can help me out?

A friend - a rather concrete thinker who mathematically models complex biological systems for a living - pointed out that my examples were largely routed in business-to-business web sales and support. He challenged me with:

Say you've got a political website, so your goal is to have somebody read it and vote for you - how do you measure the effectiveness of that content?

Well, you would... umm... Oh dear.

I guess what we're talking about here, to yank it back to my present comfort zone, is a sales process where your point of conversion is off the site. The political example is perhaps a little below the belt, since what you can and can't do, and what data you can and can't collect is so restricted. You can't throw up a "How did you hear about this election?" questionnaire in the polling booth. Exit polls don't pull in your browsing history and site session information. Not everyone fatuously tweets and geo-tags each moment of their lives. Oh, and folks lie.

The business example might be easier to attack. You could have, say, a site for a farm shop that only did over the counter sales. Either way, it's tricky.

I fell back on some of the work I've done usability testing and benchmarking documentation, and suggested similar, quick and dirty, small sample qualitative UX trials. I'm not wholly sure that was right.

Any thoughts? How might we measure and curate for this kind of discontinuous conversion?

Comment Notification

If you would like to receive an email when updates are made to this post, please register here

Subscribe to this post's comments using RSS

Comments

 

Zoe said:

Could be on the wrong track/stating the obvious, but...

The conversion points for voting and for over-the-counter sales have a fundamental difference - one is private, and one is public.

I'd say that, in any situation where the conversion is private (or more specifically - secret), you can't measure the level of *actual* conversion by definition. The only information about conversion that you can gather is information that people choose to disclose, and as noted, there's problems with that.

With the farm store the scenario is different - we know a customer has chosen to use the store, because they are physically, publicly present in the store.

With the store example, there are site-users, store-users, and a smaller subset of site-and-store users. The site-and-store users are the interesting ones, but they're hard to identify, because a physically present person in a store doesn't wear an 'I visited your website' badge.

In the store there's a nice friendly shop assistant but (probably) no computers. Capturing data automatically+electronically isn't available in the store because the communication is exclusively person-to-person. So it may well be that the only real option is having the nice friendly shop assistant say 'and how did you find out about us? Was it through our website?' (and then recording the answer electronically).

The only other thing I can think of that would help identify a site-and-store-user would be some form of unique-id membership card/discount vouchers that were obtained online but used in the physical store - but that would only ever tell you about the customers that were gained, not the ones that were lost.
May 14, 2010 6:29 AM
 

Roger Hart said:

Good points.

The site metrics problem actually reminds me of something we were wrestling with a while ago from a technical communication perspective. We couldn't work out if documentation actually had anything analogous to a conversion, and came up with the idea - amongst others - that a documentation conversion was a specific support call that didn't get made.

That's equally hard to measure without talking to people. Even if we had a "Wow, I was going to call, but I didn't" button, I doubt anybody would click it. We do, however, have support surveys and call logs, so some feedback is available.

I think I agree, then. For discontinuous conversion, you probably have to actually ask people what got them to the point of conversion. If you want richer responses, when content is still fresh in people's minds, you probably do have to sit them down with it, and ask them questions afterwards.
May 14, 2010 7:31 AM
 

Giles said:

Using tools like google news and technorati it might be possible to track your traffic relative to the news cycle; and, if you wanted to influence framing etc, you could look for particular terms, ideas, phrases appearing after you used them. It's not a measure of vote conversion, but it does measure political efficacy in a broader sense.

As far as I know at the moment this is probably more feasible for politics than business (at least using public data) but I guess in theory you could look at equivalent data for blogs (again), amazon searches, or even financial data when you tried to affect sales or other business-relevant stuff through content.
May 14, 2010 1:18 PM

What do you think?

(required) 
(optional)
(required) 
<May 2010>
SuMoTuWeThFrSa
2526272829301
2345678
9101112131415
16171819202122
23242526272829
303112345
How to Kill a Company in One Step or Save it in Three
 The majority of companies that suffer a major data loss subsequently go out of business. Wesley David... Read more...

Migrating from OCS 2007 R2 to Lync: Part 4
 Having migrated the rest of our users and legacy resources across and started getting ready to... Read more...

Automated Script-generation with Powershell and SMO
 In the first of a series of articles on automating the process of building, modifying and copying SQL... Read more...

Seth Godin: Big in the IT Business
 Seth Godin has transformed our understanding of marketing in IT. He invented the concept of 'permission... Read more...

Using SQL Test Database Unit Testing with TeamCity Continuous Integration
 With database applications, the process of test and integration can be frustratingly slow because so... Read more...