AI

Sentiment Analysis for Bot Conversations

Customers are using channels such as Facebook Messenger as a place where to complain when their online order is delivered late. Therefore, companies have started to trust chatbots for handling these issues. Can you see the potential of applying sentiment analysis to chatbot conversations?

When customers have a particularly good or bad experience in a hotel, it used to be Facebook wall or Twitter timeline the place where to complain about it. Lately, they become used to doing it directly on the TripAdvisor page, Google sites or Amazon comments about the product. But now, if you are writing a complaint in the Facebook Messenger channel of a brand, you likely will see how a bot handles it. This is a terrific opportunity for chatbots and one of their strongest advantages.

 

Benefits of bots as a customer support channel

  • Data ownership: the complaints are now arriving to a channel the business can control, that is, they can check the logs, knowing they only talk about their product or service, unlike social media platforms where the message gets mixed with other conversations.
  • Avoiding blackmail: It is a private channel, so there’s no risk of other users taking advantage of the situation of one of them and complaining only to blackmail the business.
  • CRM connection: you will not have to manually check if a person is a client or not, their product reference number, or the status of their delivery… all those steps are automatic in the case of a bot. So, giving away compensation to someone who doesn’t deserve it is another avoided risk.

So, if human input in a human-chatbot conversation is the new complaint in social media, how about applying what we were applying to social media messages? That is, sentiment analysis for bots conversation analytics. 

Applying sentiment analysis to bot conversations

As a picture is worth a thousand words, we manually collected negative and positive reviews (not much, only 93 paragraphs) from TripAdvisor about a bunch of hotels in San Francisco and applied the Bitext sentiment API to see if some insight came up from the graphics with such a scarce dataset. The results are truly enlightening!

Score per topic

Sentiment analysis would be a powerful tool for a hotel manager to know their business’ strengths and weaknesses. For example, if these comments belonged to a single hotel and you were in charge of it, of course you shouldn’t  worry about the staff, the breakfast or the wifi, instead you should pay attention to whatever happens with the bathrooms (bathroom, toilet) and the maintenance (carpet, carpeting, bed cover), or think about soundproofing (area, street, noise, night, traffic).

 

Opinions per topic

Another interesting relation that can illustrate what customers think of a service, beyond negative and positive scores, is the opinions per topic. It allows to see what topics are more popular, no matter the score and the specific words used to describe each topic. 

This is gold for the hotel communication team to know if the message they’re sending corresponds with their customers’ real experiences.

The little circle shows the topics and the surrounding one shows the opinions per topic. Sizes respond to the frequency of both in the comments corpus

 

As you can see, these variables give you a lot of possibilities. We encourage you to try it with corpora representative of different activity fields, sizes, and languages (ES, CA, FR, DE, IT, PT, NL) and share the insights you extract

admin

Recent Posts

Bitext Linguistic Analyzer Improves Elasticsearch’s English Search Quality

Our earlier German MIRACL benchmark showed that linguistic analysis can substantially improve lexical search in…

18 hours ago

Hybrid Search Is the New Baseline: Better Lexical Search Is the Next Advantage

Vector search, also known as semantic search, has transformed enterprise search in the past few…

2 months ago

Bitext Linguistic Analyzer beats every Elasticsearch Configuration on German Search Quality

In a search benchmark for German, Bitext Linguistic Analysis SDK returned more relevant results and…

2 months ago

Stemming kills AI Accuracy: Why German Search Needs Lemmatization

Search systems have relied on stemming for decades. The reason is simple: stemming is fast,…

3 months ago

Some of your RAG-related issues have an easy & quick solution: decompounding

Most teams working with Elasticsearch, OpenSearch or RAG pipelines focus on ranking, embeddings or model…

5 months ago

Some of your RAG-related issues have an easy & quick solution: lemmatization

Some RAG issues have a simpler fix than people think: better text normalization. One common…

5 months ago