Steam Spy
 | |
Type of site | Video game sales tracking |
|---|---|
| Owner | Sergey Galyonkin |
| Created by | Sergey Galyonkin |
| URL | www |
Steam Spy is a website created by Sergey Galyonkin launched in April 2015. The site uses an application programming interface (API) to the Steam software distribution service that is owned by Valve Corporation to estimate the number of sales of software titles offered on the service. Estimates are made based on the API polling user profiles from Steam to determine what software titles (primarily video games) they own and using statistics to estimate overall sales. Software developers have reported that Galyonkin's algorithms can provide sales numbers that are accurate to within 10%, though Galyonkin cautions about using his estimates in financial projections and other business-critical decisions.
Concept and history
Tracking of video game sales is of strong interest to the video game industry, but does not have the robustness of other industries, such as television with the Nielsen ratings system or music with Billboard charts.[2] Though the NPD Group does track retail and digital sales of video games, access to this data requires payment and it does not typically break down distribution of sales on various platforms.[2] Sites like VGChartz have attempted to collect more detailed sales figures based on external data, but there have been reported problems with how this data is aggregated.[2] Valve's Steam client is the largest outlet for digital sales of games for Microsoft Windows, OS X, and Linux platforms. Normally, sales of video games and other software offered by Steam are kept confidential between Valve and the publishers and developers of the titles; developers and publishers are free to offer these numbers to the public if they desired. Valve does offer statistics on the most bought and played games, but otherwise does not provide any sales figures publicly.[2] Galyonkin noted that whereas the film industry receives funding from financing companies which are more open about sharing their financial results, funding within the video game comes from a variety of non-traditional sources, leading to the market being coy to report on the sales of a game.[3]
The idea for Steam Spy originally came from a similar approach used by Kyle Orland and the website Ars Technica for their "Steam Gauge" feature starting in April 2014. Steam Gauge uses the Steam API to access publicly available user profiles to obtain a list of games that that user owns. At the time of its creation there were over 170 million Steam accounts, making the task of polling the entire list of games impractical. Instead, they opted to poll between 80,000 to 90,000 each day as to collect the game lists, and then used sampling statistics to estimate the total ownership of each game.[2] Ars Technica estimated at its onset that the margin of error was within 0.33%.[2]
Galyonkin was inspired by Steam Gauge to create Steam Spy. At the time, Galyonkin was a Senior Analyst at Wargaming.net.[3] Steam Spy uses the same approach of sampling a small percentage of Steam accounts, approximately 100,000 to 150,000 per day with a rolling sampling approach. The collected data is processed nightly to create visualizations used on the site, and thus offers historical trends for games as well.[4] As with Steam Gauge, Galyonkin notes that Steam Spy is subject to similar sampling errors, so that data for newly released games or for games with low sales will not likely have accurate estimates of numbers.[4] The polling approach is also prone to promotions that Valve runs, such as when a game is offered for free over a weekend; during this time, the game will appear owned on every Steam profile, and will artificially bump up the sales numbers.[4] Galyonkin's method also polls the amount of time that each profile has played a particular game, allowing him to collect estimated playtime statistics on a per-game basis.[5]
As of September 2016, Galyonkin continues to operate the site and has plans for several major features, alongside his current position as Head of Publishing for Eastern Europe for Epic Games.[3]
Impact
Galyonkin says that his estimates of sales have been confirmed as close with several developers.[4] Gamasutra says that developers that they have spoken to also agree that the numbers from Steam Spy are "in the right ballpark".[6] Several developers speaking to PCGamesN stated that Steam Spy is accurate to within 10% of actual sales figures for games with more than a few thousand sales, while the accuracy drops for low-selling titles; Galyonkin himself says data for games under 30,000 sales should be considered suspect.[7] Dave Gilbert of Wadjet Eye Games noted that developers should take caution towards using Steam Spy's data for financial projections as the analysis does not factor in the cost of the game when purchased or obtained, as it can fluctuate due to sales, gifts, developer promotions, and other situations.[8] An undisclosed video game publisher, speaking to Gamasutra, praised Steam Spy as a go-to tool used frequently in their industry to track trends, stating that "each game of ours tracks, broadly speaking, within its stated margin of error".[3] Galyonkin does warn of the accuracy of Steam Spy data, equating it to the accuracy of political surveys but believes it is sufficiently accurate for general analysis of trends and broad distributions.[9] The forementioned undisclosed publisher noted that Steam Spy data should never be used in isolation to make critical development or publishing decisions.[3]
Prior to August 2016, Galyonkin honored all requests from developers and publishers to remove games from his tracking system; examples include Kerbal Space Program and all games published by Paradox Interactive.[10] When Paradox had requested the removal in June 2016, Paradox's Shams Jorjani noted that they had seen "flawed" business plans from developers seeking their publisher support based solely on ownership data published by Steam Spy, prompting their request.[11] However, in August 2016, Galyonkin reversed this choice, retroactively reincluding the stats from games previously removed. Galyonkin opted for this when Techland requested him to remove their games from the site, prompting him to reassert that his site was meant to be a polling tool for game developers and not capture accurate sales data, and that "removing several important independent games from the service will hurt everyone else while not necessarily benefitting the publishers of the removed games".[11] Galyonkin noted there was no legal requirement for him to hide this otherwise-public and non-confidential data, and felt no developer was harmed for revealing this information.[3] One developer from a Latin American company did tell Gamasutra that they were concerned about Steam Spy's reporting of the high sales from their game, as it would potentially lead for their offices to become a target for theft in their region.[3]
Steam Spy has been used to help quantify certain trends in video game buying behaviors by both Galyonkin and other sources. For example, when Valve introduced the ability to allow buyers to request a refund for any game within certain time constraints in mid-2015, Galyonkin observed that most games received a small increase in sales, proposing that the refund policy enabled users to be more open to try games.[12] Galyonkin also observed that games using the Steam Early access program typically had their largest sales at the point of release for Early Access as opposed to on their completed release.[9] Galyonkin's data also shows that, based on a two-week period in August 2015, that Steam users spend the most time playing games published by Valve, specifically Dota 2, Counter-Strike: Global Offensive, and Team Fortress 2.[5] Galyonkin is able to track the number of concurrent players for a game over time, allowing him to determine a "Hype Factor" and "Surprise Factor" for games based on how much their player base shrunk or grew, respectively, after release, and correlate that to sales estimates.[13]
References
- ^ "steamspy.com Site Overview". Alexa Internet. Retrieved April 3, 2017.
- ^ a b c d e f Orland, Kyle (April 15, 2014). "Introducing Steam Gauge: Ars reveals Steam's most popular games". Ars Technica. Retrieved September 1, 2015.
- ^ a b c d e f g Parkin, Simon (September 2, 2016). "Steam Spy and the specter of game sales transparency". Gamasutra. Retrieved September 2, 2016.
- ^ a b c d Hall, Charlie (April 3, 2015). "Steam Spy scrapes Steam user accounts to estimate sales data". Polygon. Retrieved September 1, 2015.
- ^ a b Hussain, Tamoor (August 13, 2015). "Steam Users Spend Most Time Playing Dota, Counter-Strike, Team Fortress 2". GameSpot. Retrieved September 2, 2015.
- ^ Nutt, Christian (June 19, 2015). "Steam Spy creator analyzes the platform, shares his data". Gamasutra. Retrieved September 1, 2015.
- ^ Barrett, Ben (February 14, 2017). "What do developers and publishers really think of Steam Spy?". PCGamesN. Retrieved February 14, 2017.
- ^ Wawro, Alex (April 6, 2015). "The risks of using Steam Spy to evaluate a dev's performance". Gamasutra. Retrieved September 1, 2015.
- ^ a b Galyonkin, Sergey (August 15, 2015). "How To Be Successful On Steam". Making Games. Retrieved September 1, 2015.
- ^ Wawro, Alex (June 2, 2016). "Paradox games removed from Steam Spy tracker at company's request". Gamasutra. Retrieved June 2, 2016.
- ^ a b Frank, Allegra (August 26, 2016). "Steam Spy restores removed sales data despite developers' requests". Polygon. Retrieved August 26, 2016.
- ^ Orland, Kyle (June 11, 2015). "Developers express worry, appreciation for Steam's new return policy". Ars Technica. Retrieved September 2, 2015.
- ^ Good, Owen (August 27, 2016). "No Man's Sky, Firewatch make Steam Spy's ranking of the year's most-hyped games". Polygon. Retrieved September 2, 2016.