We are very happy to announce that our new sentiment system has just been pushed live.

As part of this update, we’ve made a number of changes to the way our system evaluates and scores sentiment on individual comments. This change will affect all previously logged data and new data. The update comes into the dashboard, therefore, affecting the overall average scores displayed on every game inside the system.

We understand that changes like this affect the analysis of our data so we are careful to not tweak this system as often as others. However, this update contains a number of changes to the underlying system. This increases the overall accuracy of the system and allows for certain edge cases we had found over the past 6 months.

To see the new system in action, let’s take a look at the following review about the recent release, Call of Duty: Black Ops 4…

“There is a massive problem with saving stats. Challenges for calling cards and Camos aren’t saving upon exiting the game, effectively erasing hours of progress. For a game completely focused on quality online services, the services sure are broken. Aside from that, the game is the best COD since BO2 Good game, but fix progress saving”

With our previous sentiment system, this review would have been classed as extremely positive. This is due to the clarity around the positive statement near the end – ‘Aside from that, the game is the best COD since BO2 Good game, but fix progress saving”. When compared to the other part of the review, where the user describes a distinctive problem they are having – with some negative terminology – the previous system would focus primarily on the clearer, second part of the review to score sentiment. This is obviously incorrect. Following the introduction of V2 of our Player XP Sentiment System, structures like this are now taken into account and corrected. The correction ensures both parts of the review are appropriately evaluated, and a more accurate score has been returned (-35 on a -100 to 100 scale).

This is just a single use case of where our system has been improved. Other areas we take into account include the ordering of words and double negatives. Many others have also seen significant improvement with this update and continue to provide an ever-improving analysis of more complicated statements.

The team is working extremely hard to continue to improve Player XP and we’ll be revealing more improvements over the coming weeks. We hope you like the latest update and as always, if you have any questions or would like to learn more about Player XP then do get in touch today.

Sentiment