Crowdsource (app)

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search

Crowdsource
Google Crowdsource Icon.png
Android version of Google Crowdsource
Android version of Google Crowdsource
Developer(s)Google
Initial releaseAugust 29, 2016; 2 years ago (2016-08-29)
Operating systemAndroid, web
TypeCrowdsourcing platform

Crowdsource, also known as Google Crowdsource, is a crowdsourcing platform developed by Google intended to improve a host of Google services through the user-facing training of different algorithms.

Crowdsource was released for Android on the Google Play store on August 29, 2016, and is also available on the web. Crowdsource includes a variety of short tasks users can complete to improve many of Google's different services. Such tasks include image label verification, sentiment evaluation, and translation validation. By completing these tasks, users provide Google with data to improve services such as Google Maps, Google Translate, and Android.[1] As users complete tasks, they earn achievements including stats, badges, and certificates, which track their progress.

Crowdsource was released quietly on the Google Play store, with no marketing from Google.[2] It received mixed reviews on release, with many reviews stating that its lack of monetary rewards is unusual, as similar platforms, such as Google Opinion Rewards, often reward users with Play Store credits.[3][2][4]

Features[edit]

Crowdsource includes different types of tasks, and these each provide Google with different information that it can give as training data to its machine learning algorithms. In the app's description on Google Play, Google refers to these tasks as "microtasks" which should take "no more than 5-10 seconds" to complete.[5]

Tasks[edit]

Upon launch, the Crowdsource Android application presents users with 5 different tasks: image transcription, handwriting recognition, translation, translation validation, and map translation validation.[4] The most recent version of the app includes 7 tasks: translation, translation validation, maps translation validation, handwriting recognition, sentiment evaluation, landmarks, and image transcription.[5]

Translation and translation validation[edit]

Translation related tasks (translation and translation validation) are only shown to users who have selected more than one language they are fluent in.[5][3][2][4] While Maps Translation validation is no longer a task in the Crowdsource Android app, users can still complete translation and translation validation tasks.[5] Translation presents the user with one of the languages they listed themselves as fluent in, and asks them to translate it into another language they are fluent in.[5] Translation validation presents users with a list of translations submitted by other users, and asks them to categorize them as correct or incorrect.[5] Both of these tasks help improve Google's translating capabilities, most notably in Google Translate, and any other Google app with translated content, including Google Maps.[1][6]

Image transcription[edit]

Image transcription allows users to select a word from a list of topics, such as "Baseball", and then presents the user with a picture, asking the question "Can Baseball be one of the labels for this image?". Users can select "Yes", "No", or "Skip" if they are unsure.[5][1] The data gained from this task is used to help read text within images for services like Google Street View.[1]

Handwriting recognition[edit]

Handwriting recognition relies on users to read handwritten words and transcribe them to text. According to Google, completing this task helps improve Google Keyboard's handwriting feature.[1]

Sentiment evaluation[edit]

Sentiment evaluation presents the user with various reviews and comments, and asks them to describe the statement as "positive", "neutral", or "negative".[7] Alternatively, users can skip a question if they are unsure.[1] These evaluations by the users of Crowdsource help with various recommendation-based technologies that Google uses on platforms like Google Maps, the Google Play Store, and YouTube.[1][7]

Landmark identification[edit]

This task asks users to confirm if a specific landmark is visible in pictures shown in the app. This task is designed to help ensure businesses and landmarks are recognizable in applications such as Google Maps.[8]

Achievements[edit]

Beyond the tasks that users can complete, the Crowdsource app has an "Achievements" section that shows users stats and badges which they earn through completing different tasks in Crowdsource.[5][1][9][10]

Stats[edit]

When users contribute to Crowdsource by completing tasks, Crowdsource tracks their total number of contributions, as well as metrics like "upvotes" which show how many of a user's answers are "in agreement with answers from the Crowdsource community,"[9] and "accuracy" which shows what percentage of the user's answers have been accepted as correct.[9]

Badges[edit]

As users complete tasks, they also receive badges. There are badges for each type of task, which track progress along that particular task (such as translation validation), as well as badges for other milestones, like completing a task while offline or completing a task given through a push notification.[10][5]

Updates[edit]

An April 2018 update to Crowdsource included a new "Image Capture" task in which users can take photos, tag them, and upload them to Crowdsource.[2] Users can choose to open-source their images, as well, to share them with researchers and developers not exclusive to Google.[11] In an interview with Wired Magazine, Anurag Batra, a product manager at Google who leads the Crowdsource team, said that the data gained from users completing this image capture task could improve Google's image search, camera apps, and Google Lens.[12]

Platforms[edit]

Crowdsource is also available as a web application. It offers many of the same tasks, such as image transcription, translation, and translation validation, and includes a page for users to view their achievements, much like the Android application. Unlike the Android version, the Crowdsource website includes a task for validation image captions, but does not have the handwriting recognition, sentiment evaluation, and image capture tasks available.[5][13] The Crowdsource website also hosts a "Picture Quest Game", where two users see 2 pictures, only one of which is shared between the two users.[13] The two players must communicate, asking each other questions about the image to determine which image is "shared" between them.[13]

Reception[edit]

On release, many reviewers found the app's lack of monetary rewards unusual, due to the fact that Google has a similar app, Google Opinion Rewards, which offers Google Play store credits after completing short surveys.[4][2][3] An August 2016 review from Android Pit noted that "this reliance on altruism [is] a little strange given that Google already has an app, Google Opinion Rewards, which has a financial incentive for user feedback. It works slightly differently, but I don't see why the same reward scheme could not be applied." The review also expressed concern with this model, citing that users would be less likely to complete these tasks without more substantial rewards, writing that Crowdsource is "banking on the kind nature of its users", and asking "How are users, who generally want everything free and without adverts, going to respond to this in the long-term? Why would they rate this app highly, when the results are so nebulous?"[4] A review from Wired shared similar concerns, writing "while Google is being open about its motivations, it will be difficult for users to know what difference their contributions make."[12]

On Crowdsource's FAQ page, Google addresses this question of "Will I get paid for my answers?", answering, "No. Crowdsource is a community effort – we rely on the goodwill of community members to help improve the quality of services such as Google Maps, Google Translate, and others, so that everybody in the world can benefit".[14] In an August 2016 review, CNET noted that Google's statement in Crowdsource's description, "Every time you use it, you know that you've made the internet a better place for your community.", is not accurate, stating that Google does not offer free access to Google Maps and Google Translate data.[15] A review from TechCrunch also noted that Crowdsource is "solely focused on helping Google improve its own services," contrasting it with Amazon Mechanical Turk, which focuses on tasks from third parties.[2]

Applications[edit]

An April 2018 interview in Wired stated that Google's machine learning algorithms work best in the United States and Western Europe, but are less effective in less prosperous countries. In this interview Anurag Batra, a product manager at Google who leads the Crowdsource team, shared Google's motivations behind the Crowdsource app, stating that Google has "very sparse training data set from parts of the world that are not the United States and Western Europe,”[12] According to Wired, Google has a team that promotes the Crowdsource app in India and throughout Asia at colleges, and will likely expand to Latin America later in 2018.[12] In a blog post on Local Guides Connect, Batra explains why Crowdsource is helpful to Google, detailing that the questions that Crowdsource asks users are designed to collect better samples of data to feed their machine learning algorithms.[1]

Google uses the answers provided by users of Crowdsource, and validates them by showing them anonymously to other Crowdsource users.[16] According to Google, once answers are validated, they are used to "train computer algorithms that run services such as Google Translate, Google Maps, Android Keyboard, and others."[16]

A brief on Cio Dive stated that an "accurate data set is critical" to the success of new technologies such as voice assistants and autonomous vehicles.[17] The brief also notes that companies like Google and IBM are well positioned in the fields of Artificial Intelligence and Machine Learning due to the volume of data available to them to train and develop advanced AI.[17]

See also[edit]

References[edit]

  1. ^ a b c d e f g h i AnuragB (2017-02-06). "Try the new Crowdsource app for Android". Retrieved 2018-10-24.
  2. ^ a b c d e f Perez, Sarah (2016-08-29). "Google's new app Crowdsource asks users to help with translation, transcription & more". TechCrunch. Retrieved 2018-10-23.
  3. ^ a b c Whitwam, Ryan (2016-08-29). "New Google Crowdsource app asks you to help with translation and text transcription a few seconds at a time". Android Police. Retrieved 2018-10-23.
  4. ^ a b c d e Gordon, Scott (2016-09-06). "Google Crowdsource: what you need to know". AndroidPIT. Retrieved 2018-10-23.
  5. ^ a b c d e f g h i j "Crowdsource 1.2.0.215240185 APK Download by Google LLC". APKMirror. 2018-10-03. Retrieved 2018-10-23.
  6. ^ Google. "Translate words & phrases - Crowdsource Help". support.google.com. Retrieved 2018-10-26.
  7. ^ a b "Evaluate sentiment - Crowdsource Help". support.google.com. Retrieved 2018-10-26.
  8. ^ "Identify landmarks - Crowdsource Help". support.google.com. Retrieved 2018-11-08.
  9. ^ a b c "Achievements (Stats) - Crowdsource Help". support.google.com. Retrieved 2018-10-23.
  10. ^ a b "Achievements (Badges) - Crowdsource Help". support.google.com. Retrieved 2018-10-23.
  11. ^ "Choose & tag images - Crowdsource Help". support.google.com. Retrieved 2018-10-23.
  12. ^ a b c d Simonite, Tom (2018-04-05). "Google Turns to Users to Improve Its AI Chops Outside the US". WIRED. Retrieved 2018-10-23.
  13. ^ a b c "crowdsource.google.com". crowdsource.google.com. Retrieved 2018-10-26.
  14. ^ "FAQ - Crowdsource Help". support.google.com. Retrieved 2018-10-23.
  15. ^ Shankland, Stephen (2016-08-29). "New Crowdsource app lets your work for Google for free". CNET. Retrieved 2018-10-23.
  16. ^ a b "How does Google use my answers? - Crowdsource Help". support.google.com. Retrieved 2018-10-23.
  17. ^ a b Hickey, Alex (2018-04-06). "Google counters western bias with global image 'crowdsourcing'". CIO Dive. Retrieved 2018-10-24.

External links[edit]