2014年10月3日星期五

About Sentiment Analysis

As an important part of Natural Language Processing, Sentiment Analysis, also known as orientation analysis, opinion extraction, opinion mining, emotional mining or subjective analysis is the process of analysis, management, induction and reasoning of emotional text with subjectivity.

Websites such as Taobao, Amazon, Douban are full of comments from the consumers on goods, books or movies. By analyzing the feelings most consumers convey, we can get the market response of a certain product. More intuitively, level of scores, for example 0.0~5.0 are used on the evaluation of a product. Higher scores are usually better evaluation. The movie “Dearest” by Peter Chan got a score of 8.6/10.0 which is the highest one of this year among Chinese movies, and we can know that this is a movie worth watching to some extent.


In May 2012, by analyzing Twitter users’ emotional trend to forecast stock trend, the world's first hedge fund based on social media-“Derwent Capital Markets” realized the rate of return 1.85% which is much higher than the average rate of 0.76% in this industry.

On Coursera, there is a course named “Natural Language Processing” by Stanford University. The 7th class of this course is just about sentiment analysis. We can learn about a baseline algorithm on sentiment analysis. This algorithm including three major steps, namely tokenization(text extraction), feature extraction and classification using different classifiers(Naïve Bayes). Below is the training process using Naïve Bayes.





6 条评论:

  1. I am really impressed by your blogs, looks like you are particularly good and interested in math, that is exactly my weakness, I am wondering could you give me some help with this? Thx!!!

    回复删除
    回复
    1. I'm flattered. Although not that good at math, I have some suggestions here for you. You can read the book I mentioned in my first blog "The beauty of Mathematics" to develop an interest first. Then the subject probability theory is of great importance in social media analysis as you can see in the past courses. Hope that you will improve rapidly!

      删除
  2. Sentiment Analysis is an applied conception for us analysts. It exists in many similar web sites. We do need to learn deeply about this.

    回复删除
    回复
    1. That's it! A better master of these basic methods of analysis can be of great help for us to analyze real topics.

      删除
  3. Sentiment Analysis is really an important topic in social media analytics. Texts in digital world include lots of information that are potentially meaning for us. Likes the score from recommendation system will always affect my decision in choosing movies to watch. But a question comes up in my mind that Is it good or bad to choose the movie that most people "like"? Social media is so powerful that can easily guide what we think. Keep learning something new ( like reading what you shared :) ) will definitely help us to learn better on what social media means! =]

    回复删除
  4. Thank you for your sharing and I am quite interested in baseline algorithm on sentiment analysis. If you have any time can you give me more details about it.

    回复删除