We are very happy to announce that our new sentiment system has just been pushed live.
As part of this update, we’ve made a number of changes to the way our system evaluates and scores sentiment on individual comments. This change will affect all previously logged data and new data as it comes into the dashboard therefore affecting the overall average scores displayed on every game inside the system.
We understand that changes like this affect the analysis of our data so we are careful to not tweak this system as often as others, however this update contains a number of changes to the underlying system increasing the overall accuracy of the system and allowing for certain edge cases we had found over the past 6 months.
To see the new system in action, let’s take a look at the following review about the recent release, Call of Duty: Black Ops 4…
“There is a massive problem with saving stats. Challenges for calling cards and Camos aren’t saving upon exiting the game, effectively erasing hours of progress. For a game completely focused on quality online services, the services sure are broken. Aside from that, the game is the best COD since BO2 Good game, but fix progress saving”
With our previous sentiment system, this review would have been classed as an Extremely Positive review due to the clarity around the positive statement near the end – ‘Aside from that, the game is the best COD since BO2 Good game, but fix progress saving”. When compared to the other part of the review, where the user describes a distinctive problem they are having – with some negative terminology – the previous system would focus primarily on the clearer, second part of the review to score sentiment. This is obviously incorrect and following the introduction of V2 of our Player XP Sentiment System, structures like this are now taken into account and corrected for to ensure both parts of the review are appropriately evaluated and a more accurate score has been returned (-35 on a -100 to 100 scale).
This is just a single use case of where our system has been improved, other areas like taking into account of the ordering of words, double negatives and many others have also seen significant improvement with this update and continue to provide an ever improving analysis of more complicated statements.
The team are working extremely hard to continue to improve Player XP & we’ll be revealing more improvements over the coming weeks. We hope you like the latest update and as always, if you have any questions or would like to learn more about Player XP then do get in touch today.