Tips to choose an Online Reputation Monitoring vendor

19/06/2009

The Online Reputation Monitoring tools market is growing at a fast pace as more and more company understand and express the need to listen to what’s being said about their market, products and competitors online, evaluate the influence of these 1073926_security_cameraconversations and analyze the sentiment expressed.

There’s now a gazillion way to do it, from free mash-up techniques like the one described in my previous post to uber-expensive solutions from media company.

Before evaluating the solutions, one would need some parameters to do so. Here’s a short list half-mine, half-borrowed

  • Efficient filtering of queries based on language, country, source, date, topic
  • Depth of coverage
  • Real-time monitoring
  • Duplicate elimination
  • Smart Sentiment analysis (learning with time)
  • Ability to modify sentiment analysis
  • Sentiment plus (point in time, trend over time, compared with competitor, overlay with another issue etc.)
  • Ability to associate timeline with events
  • Identification, ranking and monitoring of influencers on multiple networks
  • Ranking based on “social popularity” or social engagement (PostRank)
  • Comparison to competitive information
  • Identification of entity and events within the conversation
  • Easy, dynamic ability to chart and graph analysis of queries
  • Self-service set up of queries
  • Multiple User Management
  • Backward trending (and not just for 30 days!)
  • Real-time threshold monitoring
  • Integration with CRM system
  • Analysis services by experts

I tend to put an heavy emphasis on the last point as so far from my experience, monitoring tools are only used as a first step to decipher the whole conversation and identify influencers while the real value lies in the results of the analysis services offered afterward. Despite great progress in technology, we still need a human with social science skills to make some sense out of all this.

1099993_medical_monitoringI have evaluated a few software in this field and was preparing some kind of report for a client when I stumbled on a coveted Forester Report : The Forrester Wave™: Listening Platforms Q1 2009. With my limited resources, I could hardly do better than their evaluation and I was lucky enough to get it for free. And you can get it too, courtesy of Visible Technologies, evaluated in the report.

Only top-tier applications with a minimum of 75% of entreprise-level clients are evaluated in the report. Although they see listening platforms has being in their infancy, I was surprised to see the much-talked about Radian6 platform at the bottom of the ladder. According to Forester’s report, this is due to a lack of

sentiment analysis, NLP, insight generation, and integration and consulting services.

Nielsen BuzzMetrics and Cymfony are given as industry leaders based on

sophisticated sentiment analysis capabilities, strong international coverage, and
multilingual support

for the former and on

comprehensive reporting and analysis capabilities [...] well complemented by
a strategic and consulting services organization that offers advanced support for understanding
sentiment and influence

for the second.

A slightly older but well-done and complimentary report (with pricing info) on 10 leading online conversation monitoring tool can be found on Ryan MacMillan blog.

What do the actual users/customers of these tools have to say about them ? The best place to look for this might be on … a blog. Read the comments following ReadWriteWeb : The Future of Social Media Monitoring post for some great insights.

The conclusion seems to be that no tool yet offers a complete solution and I would be tempted to think that the greatest tool would be a giant mash-up of many smaller tools and technologies out there. More to come…

Have a good read !

DISCLAIMER : Many of the evaluation points mentionned above come from Anna B. at Organic.

No TweetBacks yet. (Be the first to Tweet this post)

View Comments

  1. 19/06/2009Amber Naslund say:

    Morning!

    Thanks for sharing your takeaways from the Forrester report, as well as your criteria for a solid social media monitoring tool.

    Wanted to make mention that while we’ve always had user-generated sentiment capabilities, we’ll also be offering automated sentiment this summer to compliment that. (And to your point, both are going to require some human analysis in order to determine their relevance and impact on individual businesses).

    We also offer coverage in 10 international languages and regional/geographic filtering to assist our customers with global offices.

    We’re continuously improving our platform based on feedback from our community, and we’d welcome yours as well! Please feel free to reach out anytime, and stay tuned for more exciting enhancements from us in the near future.

    Cheers,
    Amber Naslund
    Director of Community, Radian6
    @ambercadabra

  2. 19/06/2009philgo20 say:

    Hi Amber, you sure are monitoring mention of Radian6 ;-)

    Seems like you guys have worked to fill in what was said to be missing from Radian6. Good work !

    Regarding automated sentiment analysis, although achieving over 60-65% accuracy seems pretty difficult, automating it still gives you a headstart and cut down on the time to review all reported items.

    Keep up the good work for the NB ORM startup !

  3. 19/06/2009ImpactWatch » Blog Archive » Top Social Media Monitoring & Measurement Posts of the Week say:

    [...] Tips to choose an Online Reputation Monitoring vendor – PhilGo20 [...]

  4. 21/06/2009Mike Spataro say:

    Thanks for the mention and the link to a free version of the Forrester Report on our Web site, which is the latest and most comprehensive independent analysis of the top providers in the industry today.

    I don’t where the 6o-65% sentiment accuracy rate claim comes from, but for a company like ours that has offered high quality sentiment analysis since we launched the TruCast platform in 2005, I can assure you that we, and many others in this industry, are well above that level.

    Our clients engage in online conversations every day through our platform and we would not be in business with a 65% sentiment rate, I can assure you of that. There have been dozens of recent blog posts about social media providers and all I can say is you shouldn’t believe everything you read.

    Mike Spataro
    SVP, Visible Technologies

  5. 21/06/2009PhilGo20 say:

    Hi Mike,
    Thanks for stopping by. And thanks to Visibile Technologies for making the Forester report easy to get, it’s very valuable.

    The 65% accuracy figure comes from some early experiment we have done internally with sentiment analysis, results from a search engine with basic sentiment analysis we use and our own tests with some of the ORM software available. Twitter sentiment analysis is much better ;-)

    We clearly do not have the resource yet to get beyond this figure on our own for large broad search/query/monitoring and I am very happy to see you are achieving much better results with TruCast, which we haven’t tested yet. On the other hand, the predictions generated by our in-house tools got us under a 1% margin of error for French, American and Quebec latest election which was very interesting, so it’s easy to believe your result are sensibly better. We try not to believe everything we read.

    It would be interesting to read some case study on ORM sentiment analysis accuracy. I will look for that.

  6. 30/08/2009Sélection de la semaine (weekly) | Demain la veille say:

    [...] Tips to choose an Online Reputation Monitoring vendor | PhilGo20 [...]

  7. 16/09/2009philgo20 say:

    Scoutlabs have a great blog post on “Questions to ask to your Social Media Monitoring Vendors”

    http://www.scoutlabs.com/2009/08/31/advanced-qu...

  8. 5/10/2009Jeff say:

    This is a Great article. Reputation Management can help restore your online reputation. I couldn’t agree more! There’s so much misinformation out there that people don’t really know what is and is not. It’s refreshing to see people that know what they’re talking about. You have an Informed commentary seems to be a rare commodity these days. Keep it coming.

    online reputation monitoring

  9. 24/11/2009digital signage say:

    Reputation Management can help restore your online reputation while the marketing expert can solve the problem and can lead you to better result.

  10. 15/05/2010vessel sinks say:

    Only top-tier applications with a minimum of 75% of entreprise-level clients are evaluated in the report while the graph is well describe in the blog.

  11. 28/05/2010dog fences say:

    I tend to put an heavy emphasis on the last point as so far from my experience, monitoring tools are only used as a first step to decipher the whole conversation and identify influencers while the real value lies in the results of the analysis services offered afterward.

  12. 4/06/2010medicus driver say:

    Thanks for the hint, I was looking for sth. like that for months :-)

  13. 7/06/2010nile cruises say:

    Ranking based on “social popularity” or social engagement is best to share in the blog while i think there should be better blog to share more information.

  14. 2/07/2010weight loss pills say:

    Despite great progress in technology, we still need a human with social science skills to make some sense out of all this while there are better view to be taken care of.

  15. 10/08/2010John say:

    Just like in any service, you should always ask for experience, sample works and a portfolio to be sure you are getting the right service. Thanks.
    ReputationManagementConsultants.com

  16. 13/08/2010Online Reputation Management say:

    The most important thing is to check their own reputation. Though i would say that any business could receive negative feedback that is done by competitor but managing it will be the best.

  17. 13/08/2010Online Reputation Management say:

    The most important thing is to check their own reputation. Though i would say that any business could receive negative feedback that is done by competitor but managing it will be the best.

Write a comment:

blog comments powered by Disqus