Jump to content

Xiaoice

From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by 103.54.107.91 (talk) at 07:21, 4 August 2020 (→Platforms, languages and countries). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

Xiaoice (Chinese: 微软小冰; pinyin: Wēiruǎn Xiǎobīng; lit. 'Microsoft XiaoIce', IPA [wéɪɻwânɕjâʊpíŋ]) is the AI system developed by Microsoft STCA in 2014 based on emotional computing framework. Through the comprehensive application of algorithms, cloud computing and big data, Xiaoice adopts the intergenerational upgrade method to gradually form a complete artificial intelligence system to EQ. In July 2018, Microsoft Xiaoice has evolved to the 6th generation and the speed of Xiaoice's evolution continued to accelerate.[1][2][3]

After generations of iteration, Xiaoice evolved into the 7th generation on August 15, 2019. The 7th-generation Microsoft Xiaoice has become one of the world's biggest interdisciplinary AI systems and taken various product forms including chat bot, intelligent voice assistant, AI content creation and production platform, etc.[4] In many countries around the world, as a single brand, Microsoft Xiaoice has covered 660 million on-line users, 450 million third-party IoT devices and 900 million content viewers.[5] It has kept 23 conversations per session (CPS) averagely with users while greatly increasing interactive scenarios.[1]

Platforms, languages and countries

Xiaoice has been spreading its influence from China to the whole world. Right now, it has landed on more than 40 platforms in four countries (China, Japan, USA and Indonesia) including apps such as WeChat, QQ, Weibo and Meipai in China, and Facebook Messenger in USA and LINE in Japan.

Statistics

  • Over 660 million registered users[6]
  • 5.11 million followers on Weibo

Application

AI Creation

In May 2017, Microsoft Software Technology Center Asia (STCA) proposed the concept of “AI Creation” with the purpose of learning abilities of excellent human creators and creating content based on text, voice and vision through AI technology.

Microsoft believed that AI, as an attempt of exploration in creation, differs from Go. AI Creation is not aimed at defeating humans. Instead, it is focused on giving full play to AI characteristics including fast learning, high concurrency and stability among others on the ground of hitting the same quality standard as human creators to embark on a future for “highly custom” content industry - under the technical support, a “highly custom” content era is coming soon where users demand “highly custom” content recommendation, presentation and even content itself. As AI hits a certain creation standard, it may help make up the defect of imbalance between supply and demand.

At the moment, the progress of content creation in all fields is as follows:

Poet

Xiaoice has been learning to write literature, sing, and create other works of art. In May 2017, the first AI-authored collection of poems—The Sunshine Lost Windows was published by Xiaoice. In August 2017, Microsoft licensed Times Culture Company to publish the traditional Chinese version of the collection of poems within the territory of Taiwan. In 2019, Microsoft licensed China Youth Publishing Group to publish the first collection of poems co-created by AI and 200 human poets - FLOWERS ARE SILENCE OF LUCID WATER. Besides, Microsoft has also published or serialized Xiaoice’s Poem at Youth Literature, West China City Daily and other publications. In addition to arousing sustainable concern and discussion in poetry, the technology has also motivated public enthusiasm for poem creation. Since May 2017, Xiaoice has helped more than 5 million amateur poets create poems, some of which have been published at all kinds of literary publications.Besides, any ordinary person can use the tool opened up by Microsoft to compose poems with the help of Xiaoice. So far Xiaoice has helped millions of people write poems.[7]

Singer

Xiaoice has released dozens of songs with the similar quality to human singers, including I Know I New, Breeze, I Am Xiaoice, Miss You etc. The 4th version of the DNN singing model allows Xiaoice to learn more details. For example, Xiaoice can produce this breathing sound along with her singing as human. Besides, she is also able to quickly learn different singing styles from different singers, and automatically merge the new style together with her voice characteristic. Furthermore, the technology allows Xiaoice to completely absorb the skills of human singers, and their innate voice.[8] Microsoft Xiaoice has released dozens of singles almost close to human singing standard, whose singing model has iterated to the fifth edition[9]. The new singing model comprises a variety of voice modes with many singing techniques, improves the standard of AI singing, shows a great diversity of styles in AI singing, and fulfills a natural transition of different singing techniques. In Japan, Microsoft announced its cooperation with AVEX that Japanese Xiaoice - Rinna would join as an AI singer.[10] In addition to Xiaoice, Microsoft also owns or offers a dozen high-quality virtual singer models to third parties.[11]

Kid Audio-books Reciter

In audiobooks, Microsoft has set up an audiobook creation platform (CCP) in the framework of Microsoft Xiaoice and created over thirty character-oriented voices based on the platform to enable AI technology to automatically create highly custom audiobooks for children. For audio books, the content created by Xiaoice has been provided to 90% of kid education platforms and 80% of online broadcasting platforms in China. So far, the platform has full copyright to children-oriented audiobooks lasting more than 2,300 hours.[12] Moreover, through AI technologies, Xiaoice can customize audio-books for every child and make them and their families to become characters in these audio-books.[13] Microsoft has also entered into an agreement of cooperation with many content publishers to exchange the copyright of text and audiobooks to keep expediting the progress of audiobooks for children and help approach the problem of lack of audiobooks for children in China.

Vision Creation

Vision creation generally covers two areas: painting and textile & clothing fabric design.

In painting, after learning works of 236 famous human painters in the 400-year art history, Microsoft Xiaoice can complete 100% original paintings on its own while being inspired by text or other sources of creation. Its originality is shown in the composition, coloring, performance and detail elements in works which are on a par with those of human painters. Compared with other prior techniques, the painting model does not create paintings at random, transfer or shift styles of prior paintings or filter prior paintings. In May 2019, Microsoft Xiaoice graduated from Central Academy of Fine Arts (CAFA) with a master's degree under the alias of “Yubing Xia”. In July 2019, she hosted a personal exhibition at the CAFA Art Museum.[14] At the personal exhibition, “Microsoft Xiaoice” made up 7 painters that originated from different eras and territories and showed distinctive character settings Each one's works have a unified style, whereas, the style of these seven fictional painters created by Xiaoice are quite different from each other. Together, they contributed to the exhibition and made seven eras in the history of human art have been reborn at the same time.[14]

In textile and clothing fabric design, Microsoft Xiaoice provides an AI-based textile fabric design platform for Chinese clothing companies with the purpose of helping such companies make up the deficiency in fabric pattern design. At the moment, the platform can steadily design over a dozen major styles and create on-demand. The first silk products designed by Microsoft Xiaoice have been permanently collected by China National Silk Museum.[15] In addition, many mass production lines have been penetrated in relevant industries. For example, an AI textile and clothing fabric design platform co-launched with China National Textile and Apparel Council (CNTAC) has been put into production, through which products of SELECTED, Wensli, EVE CINA and other brands have been made and sold.


By learning the melodies of the songs and the landmarks about different cities, Xiaoice can create visual artworks of skylines when listening to the songs related to this city. Skyline Series T-shirts designed by Xiaoice, have been jointly launched with SELECTED and been sold in stores.

TV and Radio Hostess

Based on the application of AI technology, Microsoft Xiaoice has been an AI-based TV and radio content creator and provider to 69 Chinese and Japanese TV station programs and radio station programs since December 2015 and most of its programs are daily or weekly.[16] Up to date, Xiaoice has participated in creating 6,908 hours of programs in total but cost merely 4.5% of that of a human creation team. In addition, Xiaoice has also been enabled to act as an AI presenter in TV and radio programs, e.g., Tales of the Unusual, Fuji TV, Japan.[8]

Journalist

She is a journalist for Qianjiang Evening News.

AI financial Information Generation

In finance, Microsoft Xiaoice is the world's first financial text digest creation platform. Since November 2017, Microsoft has worked together with Wind Information, Wallstreet News and other major financial information service providers in China to render IPO announcement text digests created by AI technology to users. The service covers all the 26 categories in finance and is provided for more than 90% of financial institution traders and over 40% of individual financial traders in China.[17]

Dual AI

1. In addition to Xiaoice AI Radio jointly produced with NetEase Cloud Music, Microsoft also helped NetEase Cloud Music create and launch two AI characters (Duoduo and Xixi). Microsoft and NetEase jointly endowed different personalities and concepts to the two AI characters and replenished some specific music knowledge needed for the NetEase music platform. In addition, Microsoft also teamed with NetEase News APP to integrate Xiaoice's news reading and commenting. Xiaoice has read and commented more than 10 million news.

2. Xiaoice will continue to strengthen cooperation with Tencent. In addition to the collaborative QQ Xiaoice, Microsoft Xiaoice will help Tencent modify its own AI – Baby Q with some AI technology and product support. Besides, Microsoft Xiaoice, together with Tencent QQ team, have tailored over 40 exclusive skills for QQ Xiaoice and BabyQ. Xiaoice on the Tencent QQ platform has become a part of Tencent's products and culture, winning acclaim from hundreds of millions of users.

3. Xiaoice has been built in Huawei phones. Microsoft and Huawei will have profound cooperation in AI products. All Huawei's mobile phone users of intelligent assistant 8.2 version and above can experience the service from Xiaoice now. On top of the general features for other platforms, Xiaoice brings exclusive functions for Huawei users, such as Good Memory Xiaoice, who can help users remember and trigger the memory naturally, along with other task-completion based functions.

7th-generation Microsoft Xiaoice

1. Upgrading of some key techniques in Microsoft Xiaoice, including core chat engine, full-duplex voice channel and multi-modal interactive sensor.[18] Among them:

New chat engine: through a technical iteration from retrieval model, generative model to empathy model, the upgraded chat engine makes a lead from “equalizing in conversation” to “dominating in conversation”. It can enhance open-domain conversation performance and raise the conversion rate in vertical fields. By the example of the ongoing test in the “vertical field: on-line retail” in the U.S., the new chat engine hits 68% in the product page conversion rate, 21% higher than the prior edition.

Full-duplex voice interactive sense: Microsoft Xiaoice applied full-duplex voice sense to the traditional telephone and AI-speaker devices in 2017 and 2018 respectively. By adding the vehicle-mounted scenario to its range of scenarios, it can heavily enhance interactive experience between the AI assistant and drivers/passengers and promote AI transformation from an intelligent task-console to “virtual passenger” in the criterion for user experience evaluation.

Futuristic multi-modal interactive sense: a new real-time interactive sense integrating full-duplex voice, real-time vision and core chat engine. It can provide AI interactive user experience of listening, speaking and looking at the same time. After announcing the inception of multi-modal sense development last year, Microsoft Xiaoice Japan team invited the local media to witness the launch of the public beta version of the new real-time sense this February. The sense is expected to take shape as a new AI interactive form in the 5G era.

2. Co-launch of many Xiaoice products with third-party partner platforms including chat bot, intelligent voice assistant, AI content creation and production platform, etc./[19]

Microsoft Xiaoice began implementing the Dual AI Strategic Plan last year. So far, the 7th-generation Microsoft Xiaoice has become one of the world's biggest interdisciplinary AI systems. In many countries around the world, as a single brand, Microsoft Xiaoice has covered 660 million on-line users, 450 million third-party IoT devices and 900 million content viewers. It has kept 23 conversations per session (CPS) averagely with users while greatly increasing interactive scenarios.

At the launch conference, Microsoft Xiaoice announced its collaboration with such partners as Tencent, Xiaomi, Toutiao, vivo and OPPO. Most products in the project have been rolled out with 7th-generation Xiaoice, including “Call up Xiaoice” co-completed with top 5 mobile phone manufacturers in China.

Microsoft has declared that Xiaoice will continue to hold firm to the “third-party platform” development strategy instead of launching any independent first-party product.

3. Presentation of technical breakthroughs in AI Creation and industrial penetration of some production lines.[20]

Microsoft is the pioneer in AI creation, advocating to address the imbalance between supply and demand in highly custom content by AI technology. So far, it has developed world-leading techniques in text, voice and vision creation and applied such techniques to practical on-line products.

Microsoft AI Creation has many mass production lines that have been put into practice in relevant industries. For example, the AI-based textile and clothing fabric design platform co-launched with China National Textile and Apparel Council (CNTAC) has been put into production, through which products of SELECTED, Wensli, EVE CINA and other brands have been made and sold. Regarding music, a music creation platform co-developed with Wo Music of China Unicom, has been launched.

At the launch conference, Microsoft showed a variety of AI models owned by “Xiaoice Studio”, including voice models integrating many singing techniques and painting models.

4. Launch of the first toolkit edition of Avatar Framework.[16]

Bearing the same source as the framework of Microsoft Xiaoice, the toolkit can easily set up AI assistants, chat bots, AI content provider, IP characters, etc. with a full range of emotional computing powers.

The toolkit comprises a variety of tools, such as conversation, voice, vision, viewpoint, skill, knowledge, and creativity, and can drive compatible 3D character models for real-time interaction.

Prior to the launch, Microsoft has empowered AI for dozens of third-party customers, e.g., SoftBank Pepper, and Microsoft Xiaoice itself through the Avatar Framework. At the launch conference, Microsoft announced its partnership with China Literature to empower 100 IPs in novels.

The launch of Avatar Framework was oriented to all partners and customers. The edition oriented to individual users is expected to be released in the spring of 2020.

5. Progress of Microsoft Xiaoice's commercialization.[16]

Based on rich experience in ToB and launch of a variety of technical products, Microsoft Xiaoice has made fast progress in commercialization.

So far, it has been in the service to commercial customers in a dozen fields including finance, retail, automobile, real estate, textile, etc. Its customers include Vanke, Wind Information, Wensli, China Unicom, and others.

Community Feedback

Bill Gates mentioned Xiaoice during his speech at the Peking University:

"Some of you may have had conversations with Xiaoice on Weibo, or seen her weather forecasts on TV, or read her column in the Qianjiang Evening News."
'"Xiaoice has attracted 45 million followers and is quite skilled at multitasking. And I’ve heard she’s gotten good enough at sensing a user’s emotional state that she can even help with relationship breakups."[21]

Mr Kai-Fu lee also refers to Xiaoice in his new book "Artificial Intelligence" within a positive light. The book consists of several screenshots of the conversations between himself and Xiaoice regarding the American Presidential Election. He comments that Xiaoice has successfully attempted to take an unbiased standpoint but failed to reply effectively in a more complex context. He did believe that Xiaoice and alike have shown preliminary capacity to communicate with human.[citation needed]

According to Mr Li Di, vice President of Microsoft (Asia) Internet Engineering School, Xiaoice started writing poems since last year. Based on the data base that includes works of 519 Chinese contemporary poets since 1920s, a 100 hour long training session was conducted to allow Xiaoice to acquire the ability to write poems. What is more impressive is that Xiaoice has never been spotted as a bot while publishing poems on various forums and traditional literary under an alias.[22]

Controversy

In 2017, Xiaoice was taken offline on WeChat after giving user responses critical to the Chinese government.[23] It was subsequently censored and the bots will avoid and sidestep any inquiries using politically sensitive terms and phrases.[24]

Xiaoice in 5 Countries

China : Xiaoice, launched in 2014

Japan : りんな, launched in 2015

America : Zo, launched in 2016 - discontinued summer 2019[25]

India : Ruuh, launched in 2017 - discontinued June 21st 2019[26]

Indonesia : Rinna, launched in 2017

References

  1. ^ a b Zhou, Li; Gao, Jianfeng; Li, Di; Shum, Heung-Yeung (21 December 2018). "The Design and Implementation of XiaoIce, an Empathetic Social Chatbot". arXiv:1812.08989. Bibcode:2018arXiv181208989Z. {{cite journal}}: Cite journal requires |journal= (help)
  2. ^ Markoff, John; Mozur, Paul (31 July 2015). "For Sympathetic Ear, More Chinese Turn to Smartphone Program". The New York Times. ISSN 0362-4331. Retrieved 16 October 2015.
  3. ^ Roberts, Jacob (2016). "Thinking Machines: The Search for Artificial Intelligence". Distillations. 2 (2): 14–23. Retrieved 22 March 2018.
  4. ^ "第七代微软小冰发布 可定制不同人设AI-新华网". www.xinhuanet.com. Retrieved 18 September 2019.
  5. ^ 金丹. "Microsoft opens AI framework to other firms - Chinadaily.com.cn". www.chinadaily.com.cn. Retrieved 18 September 2019.
  6. ^ 陈柳兵. "Microsoft expands presence of AI platform Xiaoice - Chinadaily.com.cn". www.chinadaily.com.cn. Retrieved 28 August 2018.
  7. ^ F_200788. "First AI-authored collection of poems published in China - People's Daily Online". en.people.cn. Retrieved 28 August 2018.{{cite web}}: CS1 maint: numeric names: authors list (link)
  8. ^ a b "Almost human: this Microsoft voice bot is winning fans in China". South China Morning Post. Retrieved 28 August 2018.
  9. ^ cnBeta. "微软小冰绘画模型公布 创造领域不以击败人类为目标 - Microsoft Cortana 小娜 / 小冰". cnBeta.COM (in Chinese (China)). Retrieved 18 September 2019.
  10. ^ "りんな (人工知能)", Wikipedia (in Japanese), 8 August 2019, retrieved 18 September 2019
  11. ^ "微软小冰：向绘画、音乐领域再出发_创作". www.sohu.com. Retrieved 18 September 2019.
  12. ^ "微软小冰学会画画了，居然"混"进了中央美院毕业展_侨报网". www.uschinapress.com. Retrieved 18 September 2019.
  13. ^ "Microsoft is making XiaoIce's full duplex capabilities available for partners and developers - MSPoweruser". MSPoweruser. 22 May 2018. Retrieved 28 August 2018.
  14. ^ a b "Tech is taking the art world by storm - Chinadaily.com.cn". www.chinadaily.com.cn. Retrieved 18 September 2019.
  15. ^ "Microsoft's Xiaoice, China's newest fashion designer, unveils her first collection for 2019". Asia News Center. 12 November 2018. Retrieved 18 September 2019.
  16. ^ a b c "第七代微软小冰发布 可定制不同人设AI-新华网". www.xinhuanet.com. Retrieved 18 September 2019.
  17. ^ "Much more than a chatbot: China's Xiaoice mixes AI with emotions and wins over millions of fans". Asia News Center. Retrieved 18 September 2019.
  18. ^ "微软发布第七代微软小冰和全新AI框架". huanqiukexue.com. Retrieved 18 September 2019.
  19. ^ "第七代微软小冰发布 可定制不同人设AI-新华网". www.xinhuanet.com. Retrieved 18 September 2019.
  20. ^ "第七代微软小冰正式发布，推出通用型AI框架_财富号_东方财富网". caifuhao.eastmoney.com. Retrieved 18 September 2019.
  21. ^ Gates, Bill. "My advice for China's students". gatesnotes.com. Retrieved 19 September 2019.
  22. ^ 网易 (30 May 2017). "机器人小冰写的诗到底怎么样？". news.163.com. Retrieved 19 September 2019.
  23. ^ Reuters (4 August 2017). "Chinese chatbots apparently re-educated after political faux pas". www.reuterscom. Retrieved 19 December 2019. {{cite web}}: |last= has generic name (help)
  24. ^ Xu, Yizhou (Joe) (11 November 2018), "Programmatic Dreams: Technographic Inquiry into Censorship of Chinese Chatbots", Xu,Yizhou, vol. 4, no. 4, Sage Journals, p. 205630511880878, doi:10.1177/2056305118808780
  25. ^ "Zo AI". Retrieved 13 January 2020.
  26. ^ "Ruuh AI". Retrieved 13 January 2020.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Xiaoice&oldid=971113033"