Takeouts on/off

Rethinking Questionnaires charting (part 1)

 

Rethinking Questionnaires - Live data charting

Continuing our series on Rethinking Questionnaires, this demonstration is a preliminary warm-up to support our next discussion looking at using questionnaire techniques to develop the reporting process.

We're calling it a warm-up because, although we assume that most researchers use live data reporting - that is turning survey data into a chart set for analysis and presentation straight from the data, we do know some survey packages only create tables, and others only create charts one-by-one and not slide sets. The aim of this pre-demonstration is to establish a shared perspective on current reporting methods before we look more deeply at new ideas around reporting.

Here we're using YouGov data captured before in May 2016, just before the Brexit vote, as it has to extremely interesting response data which we will focus on next time. The charts are 'live' - that is they are driven directly by survey data. That means we can set a filter and update the whole chart set, or click to see drill-down charts and do things like sort and filter the data.

Click our logo for the next slide

dobney.com

dobney.com

 

The charting process

With live data charting, researchers have tools to manage respondent quality checks, data edits and open-ended coding. Charts then draw directly from original survey questions, but include summary lines, aggregated charts or other calculations, take-out text, and obviously text slides like this one.

Charting is web-based and can drive sophisticated charting tools like d3. Data can be exported to SPSS or R, and chart sets printed to .pdf or exported to Excel or Powerpoint. And tables can also be generated on the fly (see here).

As the data is live, we can add filters and have the whole dataset instantly updated. For instance, filter the data by Male or Female .

In practice, we normally present straight from the live slide set. If required the charts can be set up with a full animated Prezi style display.

Click our logo for the next slide

dobney.com

dobney.com

 

The data source

The dataset for this presentation is taken from YouGov data in connection with the UK Brexit vote. The data actually comes from May 2016 prior to the vote as part of the pre-referendum polling. 2969 respondents were interviewed across the UK by phone and online.

Opinion polling is struggling to predict the outcome of popular votes and elections, and we'll show a little more on this in the next demonstration. Here we'll show voting intention per party and for the referendum from the Yougov data, before looking at a couple of interesting questions about response rates.

The data we show are unweighted.

Click our logo for the chart on voting intention...

dobney.com

dobney.com

 

Voting intention May 2016

Base: 2969

All

Conservative
24
Labour
25
Liberal Democrat
5
UKIP
13
SNP
4
Plaid Cymru
1
Some other party
5
Would not vote
12
Don't know/refused
9
Base: 913

South

Conservative
29
Labour
19
Liberal Democrat
7
UKIP
15
SNP
0
Plaid Cymru
0
Some other party
6
Would not vote
13
Don't know/refused
10
Base: 307

London

Conservative
21
Labour
38
Liberal Democrat
4
UKIP
7
SNP
0
Plaid Cymru
0
Some other party
6
Would not vote
11
Don't know/refused
13
Base: 502

Midlands

Conservative
28
Labour
24
Liberal Democrat
4
UKIP
17
SNP
0
Plaid Cymru
1
Some other party
4
Would not vote
12
Don't know/refused
12
Base: 792

North

Conservative
23
Labour
33
Liberal Democrat
5
UKIP
13
SNP
0
Plaid Cymru
1
Some other party
5
Would not vote
12
Don't know/refused
8
Base: 259

Scotland

Conservative
18
Labour
14
Liberal Democrat
5
UKIP
3
SNP
46
Plaid Cymru
2
Some other party
3
Would not vote
6
Don't know/refused
4
Base: 196

Wales

Conservative
16
Labour
28
Liberal Democrat
6
UKIP
15
SNP
3
Plaid Cymru
4
Some other party
6
Would not vote
17
Don't know/refused
5
X The first of our charts is voting intention from May 2016. The main chart is the UK as a whole and regional charts are shown to the right and can be scrolled through. Green and purple bars show significant differences. The box with [ + ] gives options for the chart. Click the title of a subgroup chart to see it in more detail.

Close this text box to see the slide...

dobney.com

If there was a general election held tomorrow, which party would you vote for? Or would you not vote at all
 

EU referendum preference

Base: 2969

All

Remain a member of the European Union
37
Leave the European Union
41
Undecided
18
Would not vote
4
Base: 913

South

Remain a member of the European Union
34
Leave the European Union
42
Undecided
20
Would not vote
4
Base: 307

London

Remain a member of the European Union
45
Leave the European Union
35
Undecided
17
Would not vote
4
Base: 502

Midlands

Remain a member of the European Union
33
Leave the European Union
47
Undecided
16
Would not vote
4
Base: 792

North

Remain a member of the European Union
36
Leave the European Union
43
Undecided
17
Would not vote
4
Base: 259

Scotland

Remain a member of the European Union
50
Leave the European Union
31
Undecided
17
Would not vote
2
Base: 196

Wales

Remain a member of the European Union
37
Leave the European Union
41
Undecided
17
Would not vote
5
X The crucial referendum question. When weighted, the data was pointing to a remain vote. The raw unweighted data was for leave.

Close this text box to access the chart...

dobney.com

As you may know the United Kingdom will have a referendum on its membership of the European Union on the 23rd of June this year. How will you vote on the question - Should the United Kingdom remain a member of the European Union or leave the European Union?
 

State of the world

Base: 2969

All

Getting worse
61
Getting better
8
Neither
26
Don't know
5
Base: 913

South

Getting worse
62
Getting better
7
Neither
26
Don't know
5
Base: 307

London

Getting worse
51
Getting better
10
Neither
33
Don't know
6
Base: 502

Midlands

Getting worse
63
Getting better
7
Neither
24
Don't know
6
Base: 792

North

Getting worse
61
Getting better
7
Neither
27
Don't know
5
Base: 259

Scotland

Getting worse
63
Getting better
9
Neither
23
Don't know
5
Base: 196

Wales

Getting worse
66
Getting better
8
Neither
24
Don't know
3

dobney.com

All things considered, do you think the world is getting better or worse, or neither?
 

Immigration view

Base: 2969

All

Mostly good
12
Mostly bad
42
Both good and bad
40
Don't know
5
Base: 913

South

Mostly good
12
Mostly bad
42
Both good and bad
41
Don't know
5
Base: 307

London

Mostly good
21
Mostly bad
33
Both good and bad
41
Don't know
6
Base: 502

Midlands

Mostly good
11
Mostly bad
47
Both good and bad
36
Don't know
6
Base: 792

North

Mostly good
9
Mostly bad
44
Both good and bad
40
Don't know
6
Base: 259

Scotland

Mostly good
15
Mostly bad
39
Both good and bad
43
Don't know
2
Base: 196

Wales

Mostly good
13
Mostly bad
42
Both good and bad
40
Don't know
5

dobney.com

And on balance, do you think the level of immigration into Britain over the last ten years has been mostly good or mostly bad for the country, or both good and bad?
 

Response rates

The charts we will want to draw attention to for next time are the two following on likelihood to answer the phone and likelihood to take a call on a mobile.

In the next demonstration we'll run some calculations to show how propensity to answer can cause problems with response rates and representativeness within samples.

You might want to think about how this might affect telephone research for next time...

dobney.com

dobney.com

 

Phone answering - landline

Base: 2244

All

Always answer
24
Mostly answer
31
Mostly do not answer
19
Never answer
10
Do not have a landline telephone
15
Don't know
1
Base: 718

South

Always answer
25
Mostly answer
33
Mostly do not answer
21
Never answer
7
Do not have a landline telephone
14
Don't know
1
Base: 245

London

Always answer
20
Mostly answer
29
Mostly do not answer
16
Never answer
9
Do not have a landline telephone
23
Don't know
2
Base: 340

Midlands

Always answer
24
Mostly answer
32
Mostly do not answer
19
Never answer
8
Do not have a landline telephone
14
Don't know
2
Base: 626

North

Always answer
23
Mostly answer
28
Mostly do not answer
19
Never answer
14
Do not have a landline telephone
15
Don't know
1
Base: 188

Scotland

Always answer
23
Mostly answer
34
Mostly do not answer
16
Never answer
15
Do not have a landline telephone
11
Don't know
1
Base: 127

Wales

Always answer
20
Mostly answer
37
Mostly do not answer
17
Never answer
13
Do not have a landline telephone
13
Don't know
1

dobney.com

How often, if ever, do you answer phone calls to your landline telephone? Do you always answer, mostly answer, mostly do not answer, or never answer. (Filter: Contacted by mobile or online)
 

Phone answering - mobile

Base: 2969

All

Always answer
10
Mostly answer
22
Mostly do not answer
28
Never answer
26
Do not have a mobile phone
4
Don't know
2
Base: 913

South

Always answer
9
Mostly answer
24
Mostly do not answer
31
Never answer
25
Do not have a mobile phone
4
Don't know
2
Base: 307

London

Always answer
12
Mostly answer
29
Mostly do not answer
26
Never answer
21
Do not have a mobile phone
3
Don't know
2
Base: 502

Midlands

Always answer
12
Mostly answer
18
Mostly do not answer
31
Never answer
28
Do not have a mobile phone
5
Don't know
1
Base: 792

North

Always answer
8
Mostly answer
20
Mostly do not answer
24
Never answer
24
Do not have a mobile phone
5
Don't know
1
Base: 259

Scotland

Always answer
9
Mostly answer
24
Mostly do not answer
29
Never answer
30
Do not have a mobile phone
1
Don't know
1
Base: 196

Wales

Always answer
13
Mostly answer
23
Mostly do not answer
20
Never answer
27
Do not have a mobile phone
3
Don't know
2

dobney.com

And how often, if ever, do you answer phone calls from telephone numbers you do not recognise on your mobile phone? Do you always answer, mostly answer, mostly do not answer, or never answer.
 

Age and Gender

Base: 2969

All

Male 18-24
5
Male 25-49
20
Male 50-64
12
Male 65+
12
Female 18-24
5
Female 25-49
19
Female 50-64
12
Female 65+
15
Age and Gender
 

Summary

This concludes our brief warm-up demonstration of live charting.

In the main Rethinking Questionnaire demonstration that will follow, we will move this much further to look at how Questionnaire techniques can be blended with charts and results and automated summaries to improve the reporting and communication process.

You can follow our full set of demonstrations on Rethinking Questionnaires at our website, or via LinkedIn .

dobney.com

dobney.com