Market sentiment (also investor attention) is the general prevailing attitude of investors as to anticipated price development in a market. This attitude is the accumulation of a variety of fundamental and technical factors, including price history, economic reports, seasonal factors, and national and world events.
If investors expect upward price movement in the stock market, the sentiment is said to be bullish. On the contrary, if the market sentiment is bearish, most investors expect downward price movement. Market sentiment is usually considered as a contrarian indicator: what most people expect is a good thing to bet against. Market sentiment is used because it is believed to be a good predictor of market moves, especially when it is more extreme. Very bearish sentiment is usually followed by the market going up more than normal, and vice versa.
Market sentiment is monitored with a variety of technical and statistical methods such as the number of advancing versus declining stocks and new highs versus new lows comparisons. A large share of overall movement of an individual stock has been attributed to market sentiment The stock market's demonstration of the situation is often described as all boats float or sink with the tide, in the popular Wall Street phrase "the trend is your friend". In the last decade, investors are also known to measure market sentiment through the use of news analytics, which include sentiment analysis on textual stories about companies and sectors.
Theory of investor attention
A particular thread of scientific literature connects results from behavioural finance, changes of investor attention on financial markets, and fundamental principles of asset pricing: Barberis et al. (1998), Barberis & Thaler (2003), and Baker & Wurgler (2007). The authors argue that behavioral patterns of retail investors have a significant impact on market returns. At least five main approaches to measuring investor attention are known today in scientific literature: financial market-based measures, survey-based sentiment indexes, textual sentiment data from specialized on-line resources, Internet search behavior, and non-economic factors.
According to the first approach, investor attention can be approximated with particular financial market-based measures. According to Gervais et al. (2001) and Hou et al. (2009), trading volume is a good proxy for investor sentiment. High (low) trading volume on a particular stock leads to appreciating (depreciating) of its price. Extreme one-day returns are also reported to draw investors’ attention (Barber & Odean (2008)). Noise traders tend to buy (sell) stocks with high (low) returns. Whaley (2001) and Baker & Wurgler (2007) suggest Chicago Board Options Exchange (CBOE) Volatility Index (VIX) as an alternative market sentiment measure. Credit Suisse Fear Barometer (CSFB) is based on prices of zero-premium collars that expire in three months. This index is sometimes used as an alternative to VIX index. The Acertus Market Sentiment Indicator (AMSI) incorporates five variables (in descending order of weight in the indicator): Price/Earnings Ratio (a measure of stock market valuations); price momentum (a measure of market psychology); Realized Volatility (a measure of recent historical risk); High Yield Bond Returns (a measure of credit risk); and the TED spread (a measure of systemic financial risk). Each of these factors provides a measure of market sentiment through a unique lens, and together they may offer a more robust indicator of market sentiment. Closed-end fund discount (the case when net asset value of a mutual fund does not equal to its market price) reported to be possible measure of investor attention (Zweig (1973) and Lee et al. (1991)). The studies suggest an evidence that changes in discounts of closed-end funds are highly correlated with fluctuations in investor sentiment. Brown et al. (2003) investigate daily mutual fund flow as possible measure of investor attention. According to Da et al. (2014), "...individual investors switch from equity funds to bond funds when negative sentiment is high." Dividend premium (the difference between the average book-to-market ratios of dividend paying and not paying stocks) potentially can be a good predictor for investor sentiment (Baker & Wurgler (2004) and Vieira (2011)). Retail investor trades data is also reported to be able to represent investor attention (Kumar & Lee (2006)). The study shows that retail investor transactions "...are systematically correlated — that is, individuals buy (or sell) stocks in concert". Initial Public Offering (IPO) of a company generate a big amount of information that can potentially be used to proxy investor sentiment. Ljungqvist et al. (2006) and Baker & Wurgler (2007) report IPO first-day returns and IPO volume the most promising candidates for predicting investor attention to a particular stock. It is not surprising that high investments in advertisement of a particular company results in a higher investor attention to corresponding stock (Grullon et al. (2004)). The authors in Chemmanur & Yan (2009) provide an evidence that "...a greater amount of advertising is associated with a larger stock return in the advertising year but a smaller stock return in the year subsequent to the advertising year." Equity issues over total new issues ratio, insider trading data, and other financial indicators are reported in Baker & Wurgler (2007) to be useful in investor attention measurement procedure.
All mentioned above market-based measures have a one important drawback. In particular, according to Da et al. (2014): "Although market-based measures have the advantage of being readily available at a relatively high frequency, they have the disadvantage of being the equilibrium outcome of many economic forces other than investor sentiment." In other words, one can never be sure that a particular market-based indicator was driven due to investor attention. Moreover, some indicators can work pro-cyclical. For example, a high trading volume can draw an investor attention. As a result, the trading volume grows even higher. This, in turn, leads to even bigger investor attention. Overall, market-based indicators are playing a very important role in measuring investor attention. However, an investor should always try to make sure that no other variables can drive the result.
The second way to proxy for investor attention can be to use survey-based sentiment indexes. Among most known indexes should be mentioned University of Michigan Consumer Sentiment Index, The Conference Board Consumer Confidence Index, and UBS/Gallup Index of Investor Optimism. The University of Michigan Consumer Sentiment Index is based on at least 500 telephone interviews. The survey contains fifty core questions. The Consumer Confidence Index has ten times more respondents (5000 households). However, the survey consists of only five main questions concerning business, employment, and income conditions. The questions can be answered with only three options: "positive", "negative" or "neutral". A sample of 1000 households with total investments equal or higher than $10,000 are interviewed to construct UBS/Gallup Index of Investor Optimism. Mentioned above survey-based sentiment indexes were reported to be good predictors for financial market indicators (Brown & Cliff (2005)). However, according to Da et al. (2014), using such sentiment indexes can have significant restrictions. First, most of survey-based data sets are available at weekly or monthly frequency. At the same time, most of the alternative sentiment measures are available at daily frequency. Second, there is a little incentive for respondents to answer question in such surveys carefully and truthfully (Singer (2002)). To sum up, survey-based sentiment indexes can be helpful in predicting financial indicators. However, the usage of such indexes has specific drawbacks and can be limited in some cases.
Under the third direction, researchers propose to use text mining and sentiment analysis algorithms to extract information about investors’ mood from social networks, media platforms, blogs, newspaper articles, and other relevant sources of textual data (sometimes referred as news analytics). A thread of publications (Barber & Odean (2008), Dougal et al. (2012), and Ahern & Sosyura (2015)) report a significant influence of financial articles and sensational news on behavior of stock prices. It is also not surprising, that such popular sources of news as Wall Street Journal, New York Times or Financial Times have a profound influence on the market. The strength of the impact can vary between different columnists even inside a particular journal (Dougal et al. (2012)). Tetlock (2007) suggests a successful measure of investors’ mood by counting the amount of "negative" words in a popular Wall Street Journal column "Abreast of the market". Zhang et al. (2011) and Bollen et al. (2011) report Twitter to be an extremely important source of sentiment data, which helps to predict stock prices and volatility. The usual way to analyze the influence of the data from micro-blogging platforms on behavior of stock prices is to construct special mood tracking indexes. The easiest way would be to count the number of "positive" and "negative" words in each relevant tweet and construct a combined indicator based on this data. Nasseri et al. (2014) reports the predictive power of StockTwits (Twitter-like platform specialized on exchanging trading-related opinions) data with respect to behavior of stock prices. Karabulut (2013) reports Facebook to be a good source of information about investors’ mood. Overall, most popular social networks, finance-related media platforms, magazines, and journals can be a valuable source of sentiment data, summarized in Peterson (2016). However, important to notice that it is relatively more difficult to collect such type of data (in most cases a researcher needs a special software). In addition, analysis of such data can also require deep machine learning and data mining knowledge (Hotho et al. (2005)).
The fourth road is an important source of information about investor attention is the Internet search behavior of households. This approach is supported by results from Simon (1955), who concludes that people start their decision making process by gathering relevant information. Publicly available data on search volumes for most Internet search services starts from the year 2004. Since that time many authors showed the usefulness of such data in predicting investor attention and market returns (Da et al. (2014), Preis et al. (2013), and Curme et al. (2014)). Most studies are using Google Trends (GT) service in order to extract search volume data and investigate investor attention. The usefulness of Internet search data was also proved based on Yahoo! Corporation data (Bordino et al. (2012)). The application of Internet search data gives promising results in solving different financial problems. The authors in Kristoufek (2013b) discuss the application of GT data in portfolio diversification problem. Proposed in the paper diversification procedure is based on the assumption that the popularity of a particular stock in Internet queries is correlated with the riskiness of this stock. The author reports that such diversification procedure helps significantly improve portfolio returns. Da et al. (2014) and Dimpfl & Jank (2015) investigate a predictive power of GT data for two most popular volatility measures: realized volatility (RV) and CBOE daily market volatility index (VIX). Both studies report positive and significant dependence between Internet search data and volatility measures. Bordino et al. (2012) and Preis et al. (2010) reveal the ability of Internet search data to predict trading volumes in the US stock markets. According to Bordino et al. (2012), "...query volumes anticipate in many cases peaks of trading by one day or more." Some researchers find the usefulness of GT data in predicting volatility on foreign currency market (Smith (2012)). An increasingly important role of Internet search data is admitted in cryptocurrency (e.g BitCoin) prices forecasting (Kristoufek (2013a)). Google Trends data is also reported to be a good predictor for daily mutual fund flows. Da et al. (2014) concludes that such type of sentiment data "...has significant incremental predictive power for future daily fund flow innovations of both equity and bond funds." One more promising source of Internet search data is the amount of visits of finance-related Wikipedia pages (Wikipedia page statistics) (Moat et al. (2013) and Kristoufek (2013a)). To sum up, the Internet search behavior of households is relatively new and promising proxy for investor attention. Such type of sentiment data does not require additional information from other sources and can be used in scientific studies independently.
Finally the fifth source of investor attention can also depend on some non-economic factors. Every day many non-economic events (e.g. news, weather, health condition, etc.) influence our mood, which, in term, influence the level of our risk aversion and trading behavior. Edmans et al. (2007) discuss the influence of sport events on investors’ trading behavior. The authors report a strong evidence of abnormally negative stock returns after losses in major soccer competitions. The loss effect is also valid after international cricket, rugby, and basketball games. Kaplanski & Levy (2010) investigate the influence of bad news (aviation disasters) on stock prices. The authors conclude that a bad piece of news (e.g. about aviation disaster) can cause significant drop in stock returns (especially for small and risky stocks). The evidence that the amount of sunlight minutes in a particular day influence the behavior of a trader is presented in Akhtari (2011) and Hirshleifer & Shumway (2003). The authors conclude that the "sunshine effect" is statistically significant and robust to different model specifications. The influence of temperature on stock returns is discussed in Cao & Wei (2005). According to the results in the mentioned study, there is a negative dependence between temperature and stock returns on the whole range of temperature (i.e. the returns are higher when the weather is cold). A seasonal affective disorder (SAD) is also known to be a predictor of investors’ mood (Kamstra et al. (2003)). This is an expected result because SAD incorporates the information about weather conditions. Some researchers go even further and reveal the dependence between lunar phases and stock market returns (Yuan et al. (2006)). According to Dichev & Janes (2001): "...returns in the 15 days around new moon dates are about double the returns in the 15 days around full moon dates". Even geomagnetic activity is reported to have an influence (negatively correlated) on stock returns (C. Robotti (2003)). To sum up, non-economic events have a significant influence on trader’s behavior. An investor would expect high market returns on a sunny, but cool day, fifteen days around a new moon, with no significant geomagnetic activity, preferably the day after a victory on a significant sport event. In most cases such data should be treated as supplemental in measuring investor attention, but not as totally independent one.
Additional indicators exist to measure the sentiment specifically on Forex markets. Though the Forex market is decentralized (not traded on a central exchange), various retail Forex brokerage firms publish positioning ratios (similar to the Put/Call ratio) and other data regarding their own clients' trading behavior. Since most retail currency traders are unsuccessful, measures of Forex market sentiment are typically used as contrarian indicators. Some researchers report Internet search data (e.g. Google Trends) to be useful in predicting volatility on foreign currency markets. Internet search data and (relevant) Wikipedia page views data are reported to be useful in cryptocurrency (e.g BitCoin) prices forecasting.
- Acertus Market Sentiment Indicator (AMSI)
- Market trend
- Pivot point (stock market)
- Sentiment analysis
- Behavioral economics
- Behavioral analysis of markets
- Behavioral portfolio theory
- "Market Sentiment Definition". Investopedia.
- Sentiment: A Meaningful Shift For Stock Bulls? | Seeking Alpha Seeking Alpha
- "| AAII: The American Association of Individual Investors". American Association of Individual Investors.
- Thomas Dorsey, Point and Figure Charting, Sentiment has a "66% influence on the overall movement of an individual stock"
- Barberis, Nicholas; Shleifer, Andrei; Vishny, Robert W. (1997-02-01). "A Model of Investor Sentiment". National Bureau of Economic Research.
- Barberis, Nicholas; Thaler, Richard (2003-01-01). Finance, BT - Handbook of the Economics of, ed. Chapter 18 A survey of behavioral finance. Financial Markets and Asset Pricing. 1, Part B. Elsevier. pp. 1053–1128.
- Baker, Malcolm; Wurgler, Jeffrey (2007-06-01). "Investor Sentiment in the Stock Market". National Bureau of Economic Research.
- Gervais, Simon; Kaniel, Ron; Mingelgrin, Dan H. (2001-06-01). "The High-Volume Return Premium". The Journal of Finance. 56 (3): 877–919. doi:10.1111/0022-1082.00349. ISSN 1540-6261.
- Hou, Kewei; Xiong, Wei; Peng, Lin (2009-01-16). "A Tale of Two Anomalies: The Implications of Investor Attention for Price and Earnings Momentum". Rochester, NY: Social Science Research Network.
- Barber, Brad M.; Odean, Terrance (2008-04-01). "All That Glitters: The Effect of Attention and News on the Buying Behavior of Individual and Institutional Investors". Review of Financial Studies. 21 (2): 785–818. doi:10.1093/rfs/hhm079. ISSN 0893-9454.
- Whaley, Robert E (2000-03-01). "The Investor Fear Gauge". The Journal of Portfolio Management. 26 (3): 12–17. doi:10.3905/jpm.2000.319728. ISSN 0095-4918.
- Da, Zhi; Engelberg, Joseph; Gao, Pengjie (2014-10-17). "The Sum of All FEARS Investor Sentiment and Asset Prices". Review of Financial Studies: hhu072. doi:10.1093/rfs/hhu072. ISSN 0893-9454.
- "A New Market Sentiment Indicator". Journal of Indexes.
- "An Investor Expectations Stock Price Predictive Model Using Closed-End Fund Premiums on JSTOR". JSTOR 2978169.
- Lee, Charles; Shleifer, Andrei; Thaler, Richard (1990-10-01). "Investor Sentiment and the Closed-End Fund Puzzle". National Bureau of Economic Research.
- Brown, Stephen J.; Goetzmann, William N.; Hiraki, Takato; Shirishi, Noriyoshi; Watanabe, Masahiro (2003-02-01). "Investor Sentiment in Japanese and U.S. Daily Mutual Fund Flows". National Bureau of Economic Research.
- Gloomy fund investors - MarketWatch
- Baker, Malcolm; Wurgler, Jeffrey (2003-09-01). "Appearing and Disappearing Dividends: The Link to Catering Incentives". National Bureau of Economic Research.
- Elisabete Simões Vieira (2011-10-18). "Investor sentiment and the market reaction to dividend news: European evidence". Managerial Finance. 37 (12): 1213–1245. doi:10.1108/03074351111175100. ISSN 0307-4358.
- Kumar, Alok; Lee, Charles M.c. (2006-10-01). "Retail Investor Sentiment and Return Comovements". The Journal of Finance. 61 (5): 2451–2486. doi:10.1111/j.1540-6261.2006.01063.x. ISSN 1540-6261.
- Ljungqvist, Alexander; Singh, Rajdeep; Nanda, Vikram K. (2003-11-06). "Hot Markets, Investor Sentiment, and IPO Pricing". Rochester, NY: Social Science Research Network.
- Grullon, Gustavo; Kanatas, George; Weston, James P. (2004-04-01). "Advertising, Breadth of Ownership, and Liquidity". Review of Financial Studies. 17 (2): 439–461. doi:10.1093/rfs/hhg039. ISSN 0893-9454.
- Chemmanur, Thomas J.; Yan, An (2010-01-14). "Advertising, Investor Recognition, and Stock Returns". SSRN Electronic Journal. doi:10.2139/ssrn.1536753. ISSN 1556-5068.
- "Surveys of Consumers". www.sca.isr.umich.edu. Retrieved 2016-04-26.
- "Consumer Confidence Index® | The Conference Board". www.conference-board.org. Retrieved 2016-04-26.
- "UBS / Gallup Investor Optimism Index". ciser.cornell.edu. Retrieved 2016-04-26.
- Brown, Gregory W.; Cliff, Michael T. (2005-01-01). "Investor Sentiment and Asset Valuation". The Journal of Business. 78 (2): 405–440. doi:10.1086/427633. JSTOR 10.1086/427633.
- Singer, Eleanor (2002-01-01). "The Use of Incentives to Reduce Nonresponse in Household Surveys".
- Dougal, Casey; Engelberg, Joseph; García, Diego; Parsons, Christopher A. (2012-03-01). "Journalists and the Stock Market". Review of Financial Studies. 25 (3): 639–679. doi:10.1093/rfs/hhr133. ISSN 0893-9454.
- Ahern, Kenneth R.; Sosyura, Denis (2015-01-24). "Rumor Has It: Sensationalism in Financial Media". Review of Financial Studies: hhv006. doi:10.1093/rfs/hhv006. ISSN 0893-9454.
- Tetlock, Paul C. (2007-06-01). "Giving Content to Investor Sentiment: The Role of Media in the Stock Market". The Journal of Finance. 62 (3): 1139–1168. doi:10.1111/j.1540-6261.2007.01232.x. ISSN 1540-6261.
- Zhang, Xue; Fuehres, Hauke; Gloor, Peter A. (2011-01-01). "Predicting Stock Market Indicators Through Twitter "I hope it is not as bad as I fear"". Procedia - Social and Behavioral Sciences. The 2nd Collaborative Innovation Networks Conference - COINs2010. 26: 55–62. doi:10.1016/j.sbspro.2011.10.562.
- Bollen, Johan; Mao, Huina; Zeng, Xiao-Jun. "Twitter mood predicts the stock market". Journal of Computational Science. 2 (1): 1–8. arXiv: . doi:10.1016/j.jocs.2010.12.007. ISSN 1877-7503.
- Nasseri, Alya Al; Tucker, Allan; Cesare, Sergio de (2014-10-08). Džeroski, Sašo; Panov, Panče; Kocev, Dragi; Todorovski, Ljupčo, eds. Big Data Analysis of StockTwits to Predict Sentiments in the Stock Market. Lecture Notes in Computer Science. Springer International Publishing. pp. 13–24. ISBN 9783319118116.
- Karabulut, Yigitcan (2013-08-13). "Can Facebook Predict Stock Market Activity?". Rochester, NY: Social Science Research Network.
- Peterson, Richard (2016-03-21). Trading on Sentiment: The Power of Minds Over Markets. John Wiley & Sons. ISBN 9781119122760.
- Hotho, Andreas; Nürnberger, Andreas; Paaß, Gerhard (2005-01-01). "A brief survey of text mining". LDV Forum - GLDV Journal for Computational Linguistics and Language Technology.
- Simon, Herbert A. (1955-01-01). "A Behavioral Model of Rational Choice". The Quarterly Journal of Economics. 69 (1): 99–118. doi:10.2307/1884852. JSTOR 1884852.
- Preis, Tobias; Moat, Helen Susannah; Stanley, H. Eugene (2013-04-25). "Quantifying Trading Behavior in Financial Markets Using Google Trends". Scientific Reports. 3. doi:10.1038/srep01684. ISSN 2045-2322. PMC . PMID 23619126.
- Curme, Chester; Preis, Tobias; Stanley, H. Eugene; Moat, Helen Susannah (2014-08-12). "Quantifying the semantics of search behavior before stock market moves". Proceedings of the National Academy of Sciences. 111 (32): 11600–11605. doi:10.1073/pnas.1324054111. ISSN 0027-8424. PMC . PMID 25071193.
- Bordino, Ilaria; Battiston, Stefano; Caldarelli, Guido; Cristelli, Matthieu; Ukkonen, Antti; Weber, Ingmar (2012-07-19). "Web Search Queries Can Predict Stock Market Volumes". PLOS ONE. 7 (7): e40014. doi:10.1371/journal.pone.0040014. ISSN 1932-6203. PMC . PMID 22829871.
- Kristoufek, Ladislav (2013-09-19). "Can Google Trends search queries contribute to risk diversification?". Scientific Reports. 3. doi:10.1038/srep02713. ISSN 2045-2322. PMC . PMID 24048448.
- Dimpfl, Thomas; Jank, Stephan (2012-06-06). "Can Internet Search Queries Help to Predict Stock Market Volatility?". Rochester, NY: Social Science Research Network.
- Preis, Tobias; Reith, Daniel; Stanley, H. Eugene (2010-12-28). "Complex dynamics of our economic life on different scales: insights from search engine query data". Philosophical Transactions of the Royal Society of London A: Mathematical, Physical and Engineering Sciences. 368 (1933): 5707–5719. doi:10.1098/rsta.2010.0284. ISSN 1364-503X. PMID 21078644.
- Smith, Geoffrey Peter (2012-06-01). "Google Internet search activity and volatility prediction in the market for foreign currency". Finance Research Letters. 9 (2): 103–110. doi:10.1016/j.frl.2012.03.003.
- Kristoufek, Ladislav (2013-01-01). "BitCoin meets Google Trends and Wikipedia: quantifying the relationship between phenomena of the Internet era". Scientific Reports. 3: 3415. doi:10.1038/srep03415. ISSN 2045-2322. PMC . PMID 24301322.
- "Pageviews Analysis". tools.wmflabs.org. Retrieved 2016-04-26.
- Moat, Helen Susannah; Curme, Chester; Avakian, Adam; Kenett, Dror Y.; Stanley, H. Eugene; Preis, Tobias (2013-05-08). "Quantifying Wikipedia Usage Patterns Before Stock Market Moves". Scientific Reports. 3. doi:10.1038/srep01801. ISSN 2045-2322. PMC .
- Edmans, Alex; García, Diego; Norli, Øyvind (2007-08-01). "Sports Sentiment and Stock Returns". The Journal of Finance. 62 (4): 1967–1998. doi:10.1111/j.1540-6261.2007.01262.x. ISSN 1540-6261.
- Kaplanski, Guy; Levy, Haim (2010-02-01). "Sentiment and stock prices: The case of aviation disasters". Journal of Financial Economics. 95 (2): 174–201. doi:10.1016/j.jfineco.2009.10.002.
- "Reassessment of the Weather Effect: Stock Prices and Wall Street Weather". connection.ebscohost.com. Retrieved 2016-04-26.
- Hirshleifer, David; Shumway, Tyler (2003-01-01). "Good Day Sunshine: Stock Returns and the Weather". The Journal of Finance. 58 (3): 1009–1032. doi:10.1111/1540-6261.00556. JSTOR 3094570.
- Cao, Melanie; Wei, Jason (2005-06-01). "Stock market returns: A note on temperature anomaly". Journal of Banking & Finance. 29 (6): 1559–1573. doi:10.1016/j.jbankfin.2004.06.028.
- Kamstra, Mark J.; Kramer, Lisa A.; Levi, Maurice D. (2003-10-01). "Winter Blues: A SAD Stock Market Cycle". Rochester, NY: Social Science Research Network.
- Zheng, Lu; Yuan, Kathy; Zhu, Qiaoqiao (2001-09-05). "Are Investors Moonstruck? - Lunar Phases and Stock Returns". Rochester, NY: Social Science Research Network.
- Dichev, Ilia D.; Janes, Troy D. (2001-08-01). "Lunar Cycle Effects in Stock Returns". Rochester, NY: Social Science Research Network.
- Robotti, Cesare; Krivelyova, Anya (2003-10-01). "Playing the Field: Geomagnetic Storms and the Stock Market". Rochester, NY: Social Science Research Network.
- "Decentralized Market Definition".
- "Oanda Forex Open Position Ratios".
- "SWFX Sentiment Index".
- "ForexBold Realtime Brokers Sentiment Index".
- Finberg, Ron. "Final Q1 2014 US Retail Forex Profitability Report". forexmagnates.com. Forex Magnates. Retrieved 19 July 2014.
- "Sentiment Trading White Paper" (PDF).