Posts tagged automation
The State of Marketing Research Innovation

What You Missed at IIEX 2018 – 3 Takeaways Walking the floor at the Insights Innovation Exchange (IIEX) for a day and a half with our new CEO, Andy Greenawalt, we spoke to several friends, client and supplier side partners, and ducked into quite a few exciting startup sessions.

Three things struck me this year:

-Insights Technology is Finally Getting More Innovative. By that I mean there are no longer just the slight immaterial modifications to existing ways of doing things, but actual innovation that has disruptive implications (passive monitoring, blockchain, image recognition, more intelligent automation…).

As expected most of this innovation is coming from startups, many of which, while they have interesting ideas, have little to no experience in marketing research - and have yet to prove their use cases.

-A Few Marketing Research Suppliers are picking up their consulting game. Surprisingly perhaps, in this area it seems that change is coming from the Qualitative side. For a while qualitative looked like a race to the bottom in terms of price, even more so than what was happening in Quantitative Research. But there are now a handful of Image/Brand/Ideation ‘Agencies’ whose primary methodologies are qualitative who are leading the way to a higher value proposition. There are a couple, but I will mention two I’ve been most impressed with specifically, Brandtrust and Shapiro+Raj, Bravo!

-The Opportunity. I think the larger opportunity if there is one, lies in the ability of the traditional players to partner with and help prove the use cases of some of these newer startup technologies. Incorporating them into consulting processes with higher end value propositions, similar to what the qualitative agencies I noted above have done.

This seems to be both an opportunity and a real challenge. Can Old help New, and New help Old? It may be more likely that the end clients, especially those that are more open to DIY processes will be the ones that select and prove the use cases of these new technologies offered by the next generation of startups, and therefore benefit the most.

While this too is good, I fear that by leaving some of the traditional companies behind we will lose some institutional thinking and sound methodology along the way.

Either way, I’m more optimistic on new Marketing Research Tech than I’ve ever been.

Keep in mind though, Innovation in Marketing Research should be about more than just speed and lower cost (automation). It should be even more about doing things better, giving the companies and clients we work for an information advantage!


Code by Hand? The Benefits of Automated and User-Guided Automated Customer Comment Coding

Text Analytics Tips - Branding Why you should not code text data by hand: Benefits of automated and user-guided automated coding Text Analytics Tips by Gosia

Most researchers know very well that the coding of text data manually (using human coders who read the text and mark different codes) is very expensive both in terms of time that coders need to take and money needed to compensate them for this effort.

However, the major advantage of using human coding is their high understanding of complex meaning of text including sarcasms or jokes.

Usually at least two coders are required to code any type of text data and the calculation of inter-rater reliability or inter-rater agreement is a must. This statistic enables us to see how similarly any number of coders has coded the data, i.e., how often they have agreed on using the exact same codes.

Often even with the simplest codes the accuracy of human coding is low. No two human coders consistently code larger amounts of data the same way because of different interpretations of text or simply due to error. The latter is a reason why no single coder will code the same text data identically when done for the second time (perfect reliability for a single coder could be achieved in theory though, e.g., for very small datasets that can be proofread multiple times).

Another limitation is that human coders can only keep in their working memory a limited number of codes while reading the text. Finally, any change to the code will require repeating the entire coding process from the beginning. Because the process of manual coding of larger datasets is expensive and unreliable automated coding using computer software was introduced.

Automated or algorithm-based text coding solves many of the issues of human coding:

  1. it is fast (thousands of text comments can be read in seconds)
  2. cost-effective (automated coding should be always cheaper than human coding as it requires much less time)
  3. offers perfect consistency (same rules are applied every time without errors)
  4. an unlimited number of codes can be used in theory (some software might have limitations)

However, this process does also have disadvantages. As already mentioned above, humans are the only ones who can perfectly understand the complex meaning of text and simple algorithms are likely going to fail when trying to understand it (even though some new algorithms are under development recently, which can be almost as good as humans). Moreover, most software available on the market has low flexibility as codes cannot be known to or changed by the user.

Figure 1. Comparison of OdinText with “human coding” and “automated coding” approaches.Figure 1. Comparison of OdinText with “human coding” and “automated coding” approaches.

Therefore, OdinText developers decided to let users guide the automated coding. Users can view and edit the default codes and dictionaries, create and upload their own, or build custom dictionaries based on the exploratory results provided by the automated analysis. The codes can be very complex and specific producing a good understanding of the meaning of text, which is the key goal of each text analytics software.

OdinText is a user-guided automated text analytics solution, which has aspects and benefits of both fully automated and human coding. It is fast, cost-effective, accurate, and allows for an unlimited number of codes like many other automated text analytics tools. However, OdinText surpasses the capabilities of other software by providing high flexibility and customization of codes/dictionaries and thus a better understanding of the meaning of text. Moreover, OdinText allows you to conduct statistical analyses and create visualizations of your data in the same software.

Try switching from human coding to user-guided automated coding and you will be pleasantly surprised how easy and powerful it is!


Text Analytics Tips with Gosi

[Gosia is a Data Scientist at OdinText Inc. Experienced in text mining and predictive analytics, she is a Ph.D. with extensive research experience in mass media’s influence on cognition, emotions, and behavior.  Please feel free to request additional information or an OdinText demo here.]

[NOTE: OdinText is NOT a tool for human assisted coding. It is a tool used by analysts for better and faster insights from mixed (structured and unstructured) data.]