Software aware or software driven? When (not) to use QDA software

Software is a tool that helps us to accelerate, improve or even enable our research. However, as researchers trying to answer questions that are relevant in our fields, technology must not drive our research but rather be shaped by it. For this, it is important that we never use software for software’s sake and rather are aware how subtle yet strongly the digital transformation changes the way we work and think.

Software aware or software driven?

“Never use software beyond the point of usefulness” this advice I repeat in all my classes and workshops. In a rather digitally enthusiastic field it might sound out of place, yet lately I have stumbled upon several papers (especially the essay by Jarke 2018) that frequently warned against the (ab)use of software. As a last trigger, a comment by Susanne Friese (disagreeing with my article on QDA tools) pushed me to elaborate on my opinions in  detail. She wrote:
I do not agree with the basic premise of this article. You should never allow a software to drive your research. It is s matter of knowing the methodology that one wants to use and the tool (see Woolf and Silver, 5 level QDA).
A comment by Susanne Friese. Read the full comment here.

Friese is right, of course: The researcher must be in charge, not the software. A point that is made by her time and again (compare Friese 2019 and Friese 2016) and also shared by Marres (2018) who calls in his book “Digital Sociology” for “device aware” instead of “device driven” research.

Indeed, research must be software aware, not software driven! However, the argument that I was trying to make in my blog post was not about the ideal (software aware) but about my frequent observation (software driven). Especially as a software trainer I more often than not see many researchers being driven by the technology they use.

Using the “Digital” Label

The worst kind of being “driven by software” I met, are researchers that feel forced to adopt a specific tool just for the sake of framing themselves as “digital (enough)” for prestige or funding purposes. They hate to use software, but are forced to adopt it by their institutions. The result being, of course, digital topping on an “analogue” cake that does not match very well. In these cases, I prefer to discuss whether the software in question can indeed benefit their research.
Example of a simple decision tree I use to advice for or against using QDA software
In most cases, software (for QDA or not) can indeed be of great help. However, even then it is important to evaluate how much investment in time and resources is necessary to acquire the needed skills and technology. For example, when a dissertation is almost completed, adopting or changing research software might no longer be a viable strategy. Or: If a software with some benefits exists, yet is extremely tedious to adopt and apply, it might not be worth the expected return. In any case, I see myself as an adviser who must be at any time open and willing to advice against the services he offers and the software he knows well.

Digitised methods and the “neutrality” of data

When it comes to considering the appropriateness of research method Rogers (2013) makes an interesting distinction: He differentiates digital native methods and digitised methods. While digital native methods were created in an already digital environment,  digitised methods were “translated” into a digital software, yet are based on analogue forerunners. Although this distinction is not undisputed (see Jarke 2018), I think especially the transformation process is worth thinking about.

Whether we are aware of it or not: The digital transformation is changing our research and, I argue, even the way we think. What software tools we know and what data we have available will influence the way we design our research methods and even our research questions.

When it comes to the data side of the analysis, not even here we can hope for a method neutral or “objective” data base. As Kitchin (2014) points out: Data is never neutral. It is always framed by the technological, economic, ethnic, temporal, local and philosophical context in which it was created. A good example for this is a public database were people can report damages on the road. Due to the varying degree of response by the population in poor and rich areas, the rather wealthy districts are overrepresented. Relying on this data for road improvement would even strengthen the social inequality that created it.

Similar bias can influence our research: Neither the tools nor the data are ever objective, unbiased or methodologically neutral. The (pseudo) objectivity and strongly suggestive power of digital data and tools must not lure us into shutting down the most essential skill of any humanist or social scientist: contextualising our data and reflecting on our tools and methods. After all, the best tool and the best method are always those that allows us to answer our research question in the most appropriate and valid way.


3 thoughts on “Software aware or software driven? When (not) to use QDA software

  1. Really nice website and blog posts, Andreas! I found this very useful doing my first steps of software-based QDA. Thanks.

  2. Thank you, Andreas, as always I agree with much of your statement. Software must not determine the researcher and definitely not be used as an argument to raise research funds. There is only one aspect that is important to me which is missing out a little: As humanists we know terms like formation of insights, progress of knowledge and so on. We see ourselves as researchers on a path to a broader understanding. Shouldn’t digital humanists, who really mean “digital” seriously, also participate more in the development of tools and software? Historical-critical methods have also developed over the years. So why not reflect on tools (as methods), improve their usability and contribute to technical (not just intellectual) progress (of existing tools and software)? — In this case, the research questions will be equally digital and humanistic.

    1. You are right, of course, Stefan! If the software is part of the research question, this changes the entire situation. Yes, as a Digital Humanist one is not limited to reflecting on tools but can also change and improve them. However, I thinks this is limited to disciplines that have a strong affiliation towards IT and might not apply for a regular social scientist or humanist.

Leave a Reply

Your email address will not be published.

This site uses Akismet to reduce spam. Learn how your comment data is processed.