When coding doesn’t work, or doesn’t make sense: Synoptic units in qualitative data analysis

You can download a full pdf of this blog post including the three examples here. Please feel free to share with others, though preferably direct them to this page to download it!

 

How do you analyse qualitative data? You code it, right? Not always. And even if you do, chances are coding has only taken you a few steps in the long journey to your most important analytical insights.

I’m not dismissing coding altogether. I’ve done it many times and blogged about it, and expect I will code again. But there are times when coding doesn’t work, or when it doesn’t make sense to code at all. Problems with coding are increasingly being recognised (see this paper by St Pierre and Jackson 2014).

I am often asked: if not coding, then what? This blog post offers a concrete answer to that in terms of a logic and principles, and the full pdf gives examples from three studies.

Whatever you do in qualitative analysis is fine, as long as you’re finding it helpful. I’m far more worried about reaching new insights, seeing new possible meanings, making new connections, exploring new juxtapositions, hearing silences I’d missed in the noise of busy-work etc than I am about following rules or procedures, or methodological dogma.

I’m not the only one saying this. Pat Thomson wrote beautifully about how we can feel compelled into ‘technique-led’ analysis, avoiding anything that might feel ‘dodgy’. Her advocacy for ‘data play’ brings us into the deliciously messy and murky realms where standard techniques might go out of the window: she suggests random associations, redactions, scatter gun, and side by side approaches.

 

An approach where you are a strength not a hazard

The best qualitative analyses are the ones where the unique qualities, interests, insights, hunches, understandings, and creativity of the analyst come to the fore. Yes, that’s right: it’s all about what humans can do and what a robot or algorithm can’t. And yes, it’s about what you can do that perhaps no-one else can.

Sound extreme? I’m not throwing all ideas of rigour out of the window. In fact, the first example below shows how the approach I’m advocating can work really well in a team scenario where we seek confirmation among analysts (akin to inter-rater reliability). I’m not saying ‘anything goes’. I am saying: let’s seek the analysis where the best of us shines through, and where the output isn’t just what is in the data, but reflects an interaction between us and the data – where that ‘us’ is a very human, subjective, insightful one. Otherwise we are not analysing, we are just reporting. My video on ‘the, any or an analysis’ says more about this.

You can also check out an #openaccess paper I wrote with Prachi Srivastava that highlights reflexivity in analysis by asking: (1) What are the data telling me? (2) What do I want to know? And (3) What is the changing relationship between 1 and 2? [There is a video about this paper too]

The process I am about to describe is one in which the analysts is not cast out in the search for objectivity. We work with ‘things’ that increasingly reflect interaction between data and the analyst, not the data itself.

 

An alternative to coding

The approach I’ve ended up using many times is outlined below. I don’t call it a technique because it can’t be mechanically applied from one study to another. It is more a logic that follows a series of principles and implies a progressive flow in analysis.

The essence is this:

  1. Get into the data – systematically and playfully (in the way that Pat Thomson means).
  2. Systematically construct synoptic units – extractive summaries of how certain bits of data relate to something you’re interested in. These are not selections of bits of data, but written in your own words. (You can keep track of juicy quotations or vignettes you might want to use later, but the point is this is your writing here).
  3. Work with the synoptic units. Now instead of being faced with all the raw data, you’ve got these lovely new blocks to work and play seriously with. You could:
    1. Look for patterns – commonalities, contrasts, connections
    2. Juxtapose what seems to be odd, different, uncomfortable
    3. Look again for silences
    4. Look for a prior concepts or theoretical ideas
    5. Use a priori concepts or theoretical ideas to see similarity where on the surface things look different, to see difference where on the surface things look the same, or to see significance where on the surface things seem unimportant
    6. Ask ‘What do these units tell me? What do I want to know?’
    7. Make a mess and defamiliarize yourself by looking again in a different order, with a different question in mind etc.
  4. Do more data play and keep producing artefacts as you go. This might be
    1. Freewriting after a session with the synoptic units
    2. Concept mapping key points and their relationships
    3. An outline view of an argument (eg. using PowerPoint)
    4. Anything that you find helpful!

 

In some cases you might create another layer of synoptic units to work at a greater analytical distance from the data. One of the examples below illustrates this.

The key is that we enable ourselves to reach new insights not by letting go of the data completely, but by creating things to work with that reflect both the data and our insights, determinations of relevance etc. We can be systematic as we go through all the data in producing the synoptic units. We remain rigourous in our ‘intellectual hygiene’ (confronting what doesn’t fit, what is less clear, our analytical doubts etc) . We do not close off on opportunities for serious data play – rather we expand them.

If you’d like to read more, including three examples from real, published research, download the full pdf.

Advertisements

8 thoughts on “When coding doesn’t work, or doesn’t make sense: Synoptic units in qualitative data analysis

  1. Patricia Alves

    Love it. When studying societies and humans, we should allow ourselves to be more human and our analysis too. thanks for sharing.

    Reply
  2. workademiablog

    Morning Nick from UK and Ireland
    It’s been an age since we communicated, feels like it anyway. I am at the writing up stage of my PhD into how midwifery faculty move from lecture led learning to practice based teaching and learning. During analysis, which never seems to stop, I found to that coding only gets you so far. I’m using an Actor. Network Theoretical design . However rarely articles exactly explain what an ANT analysis looks like, so Iv’e adopted Clarke 2007 situational Analisis advice about memoing and having memo threads which essentially what comes to mind when being emerged in the data. Thankyou for giving more academic credit to what could be seen as wayward. It will certainly help me defend my analytical points and how I arrived at them

    Reply
    1. nickhopwood Post author

      Hi! It’s lovely to hear from you. I know the feeling: once you leave coding behind, ‘wayward’ is often how it feels. Yet I reckon in reality heaps of studies involve analytical ‘steps’ or ‘mechanics’ that are just like what you and I are describing!

      Reply
  3. Pingback: Research & Scholarship Skills To code or not to code in qual data analysis

  4. Erin Burkett

    How are these synoptic units different than memos written during grounded theory analysis or some other type of analysis?

    Reply
    1. nickhopwood Post author

      Hi Erin

      What a good question! I think it would have been useful for me to mention memos in my blog post and the download pdf. I will need to think more about this over some time, but immediately:

      I understand that memos can take many forms, have different purposes, and be written at different stages of the analysis. The synoptic units I had in mind were quite specific in their form, purpose and stage. A memo might be a note to self that this particular section of data is interesting, ambiguous, perhaps connected to another. That wouldn’t be a synoptic unit as I understand the latter. It could be that synoptic units are one very specific kind of memo. But I’m not sure: I haven’t read much about memo-ing being systematically applied to all data in order to produce a new platform to work from. Maybe that shows I haven’t been reading enough about memos!

      Did this answer at least help a little bit?

      Nick

      Reply

Please join in and leave a reply!

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s