Vocaloid

Vocaloid

Vocaloid 2 Editor (English version)
Developer(s)	Yamaha Corporation
Initial release	January 2004
Stable release	Vocaloid 2 (ver. 2.0.16.1)
Operating system	Windows XP / Vista / 7
Available in	English, Japanese
Type	Musical Synthesizer Application
License	proprietary
Website	www.vocaloid.com

Vocaloid (ボーカロイド, Bōkaroido) is a singing synthesizer application, with its signal processing part developed through a joint research project between the Pompeu Fabra University in Spain and Yamaha Corporation, who backed the development financially—and later developed the software into the commercial product "Vocaloid". The software enables users to synthesize singing by typing in lyrics and melody. It uses synthesizing technology with specially recorded vocals of voice actors or singers. To create a song, the user must input the melody and lyrics. A piano roll type interface is used to input the melody and the lyrics can be entered on each note. The software can change the stress of the pronunciations, add effects such as vibrato, or change the dynamics and tone of the voice. Each Vocaloid is sold as "a singer in a box" designed to act as a replacement for an actual singer. The software is available in English and Japanese, although a Chinese version was produced for Sonika.

The software is intended for professional musicians as well as light computer music users and has so far sold on the idea that the only limits are the users' own skills. Japanese musical groups Livetune of Victor Entertainment and Supercell of Sony Music Entertainment Japan have released their songs featuring Vocaloid as vocals. Japanese record label Exit Tunes of Quake Inc. also have released compilation albums featuring Vocaloids. Artists such as Mike Oldfield have also used Vocaloids within their work for back up singer vocals and sound samples.

Technology

The Vocaloid singing synthesizer technology is categorized as concatenative synthesis, which splices and processes vocal fragments extracted from human singing voices in the frequency domain. In singing synthesis, the system produces realistic voices by adding information of vocal expressions like vibrato to score information. The Vocaloid synthesis technology was initially called "Frequency-domain Singing Articulation Splicing and Shaping" (周波数ドメイン歌唱アーティキュレーション接続法, Shūhasū-domain Kashō Articulation Setsuzoku-hō), although Yamaha no longer uses this name on its websites. "Singing Articulation" is explained as "vocal expressions" such as vibrato and vocal fragments necessary for singing. The Vocaloid and Vocaloid 2 synthesis engines are designed for singing, not reading text aloud. They cannot naturally replicate singing expressions like hoarse voices or shouts, either.

System architecture

The main parts of the Vocaloid 2 system are the Score Editor (Vocaloid 2 Editor), the Singer Library, and the Synthesis Engine. The Synthesis Engine receives score information from the Score Editor, selects appropriate samples from the Singer Library, and concatenates them to output synthesized voices. There is basically no difference in the Score Editor and the Synthesis Engine provided by Yamaha among different Vocaloid 2 products. If a Vocaloid 2 product is already installed, the user can enable another Vocaloid 2 product by adding its library. The system supports two languages, Japanese and English, although other languages may be optional in the future. It works standalone (playback and export to WAV) and as a ReWire application or VSTi accessible from DAW.

Score Editor

The Score Editor is a piano roll style editor to input notes, lyrics, and some expressions. For a Japanese Singer Library, the user can input gojūon lyrics in hiragana, katakana or romaji writing. For an English library, the Editor automatically converts the lyrics into the IPA phonetic symbols using the built-in pronunciation dictionary. The user can directly edit the phonetic symbols of unregistered words. A Japanese library and an English library differ in the lyrics input method, but share the same platform. Therefore, the Japanese editor can load an English library and vice versa. As mentioned above, the lyrics input method is library-dependent, and so the Japanese and English editors differ only in the menus. The Score Editor offers various parameters to add expressions to singing voices. The user is supposed to optimize these parameters that best fit the synthesized tune when creating voices. This editor supports ReWire and can be synchronized with DAW. Real-time "playback" of songs with predefined lyrics using a MIDI keyboard is also supported.

Singer Library

Each Vocaloid licensee develops the Singer Library, or a database of vocal fragments sampled from real people. The database must have all possible combinations of phonemes of the target language, including diphones (a chain of two different phonemes) and sustained vowels, as well as polyphones with more than two phonemes if necessary. For example, the voice corresponding to the word "sing" ([sIN]) can be synthesized by concatenating the sequence of diphones "#-s, s-I, I-N, N-#" (# indicating a voiceless phoneme) with the sustained vowel ī. The Vocaloid system changes the pitch of these fragments so that it fits the melody. In order to get more natural sounds, three or four different pitch ranges are required to be stored into the library. Japanese requires 500 diphones per pitch, whereas English requires 2,500. Japanese has fewer diphones because it has fewer phonemes and most syllabic sounds are open syllables ending in a vowel. In Japanese, there are basically three patterns of diphones containing a consonant: voiceless-consonant, vowel-consonant, and consonant-vowel. On the other hand, English has many closed syllables ending in a consonant, and consonant-consonant and consonant-voiceless diphones as well. Thus, more diphones need to be recorded into an English library than into a Japanese one. Due to this linguistic difference, a Japanese library is not suitable for singing in English.

Synthesis Engine

The Synthesis Engine receives score information contained in dedicated MIDI messages called Vocaloid MIDI sent by the Score Editor, adjusts pitch and timbre of the selected samples in frequency domain, and splices them to synthesize singing voices. When Vocaloid runs as VSTi accessible from DAW, the bundled VST plug-in bypasses the Score Editor and directly sends these messages to the Synthesis Engine.

Timing adjustment

In singing voices, the consonant onset of a syllable is uttered before the vowel onset is uttered. The starting position of a note called "Note-On" must be the same as that of the vowel onset, not the start of the syllable. Vocaloid keeps the "synthesized score" in memory to adjust sample timing so that the vowel onset should be strictly on the "Note-On" position. No timing adjustment would result in delay.

Pitch conversion

Since the samples are recorded in different pitches, pitch conversion is required when concatenating the samples. The engine calculates a desired pitch from the notes and attack and vibrato parameters, and then selects the necessary samples from the library.

Timbre manipulation

The engine smooths the timbre around the junction of the samples. The timbre of a sustained vowel is generated by interpolating spectral envelopes of the surrounding samples. For example, when concatenating a sequence of diphones "s-e, e, e-t" of the English word "set", the spectral envelope of a sustained ē at each frame is generated by interpolating ē in the end of "s-e" and ē in the beginning of "e-t".

Transforms

After pitch conversion and timbre manipulation, the engine does transforms such as Inverse Fast Fourier transform (IFFT) to output synthesized voices.

Software history

Screenshot of the software interface for Vocaloid (English version)

Vocaloid

Yamaha started development of Vocaloid in March 2000 and announced it for the first time at the German fair Musikmesse on March 5-9, 2003. The first Vocaloids, Leon and Lola, were released by the studio Zero-G on March 3, 2004, both of which were sold as a "Virtual Soul Vocalist". Leon and Lola made their first appearance at the NAMM Show on January 15, 2004. Leon and Lola were also demonstrated at the Zero-G Limited booth during Wired Nextfestand won the 2005 Electronic Musician Editor's Choice Award. Zero-G later released Miriam, with her voice provided by Miriam Stockley, in July 2004. Later that year, Crypton Future Media also released their first Vocaloid Meiko. In June 2005, Yamaha upgraded the engine version to 1.1. A patch was later released to update all Vocaloid engines to Vocaloid 1.1.2, adding new features to the software, although there were differences between the output results of the engine. A total of five Vocaloid products were released from 2004 to 2006. Vocaloid had no previous rival technology to contend with at the time of its release, with the English version only having to face the later release of VirSyn's Cantor software during its original run.

Products

Product	Developer	Language	Sex	Voice sampled	Release date
Leon	Zero-G	English	Male		March 3, 2004
Lola			Female
Miriam			Female	Miriam Stockley	July 26, 2004
Meiko	Crypton Future Media	Japanese	Female	Meiko Haigō	November 5, 2004
Kaito			Male	Naoto Fūga	February 17, 2006

Vocaloid 2

Vocaloid 2 was announced in 2007. The synthesis engine and the user interface were completely revamped. New features such as note auditioning, transparent control track, toggling between playback and rendering, and expression control were implemented. One's breath noise and husky voice can be recorded into the library to make realistic sounds. This version is not backward compatible and its editor cannot load a library built for the previous version. Aside from the PC software. NetVocaloid services are offered.

Yamaha announced a version of the Vocaloid 2 software for the iPhone and iPad, which exhibited at the Y2 Autumn 2010 Digital Content Expo in Japan.Later, this version of the software was released using the voice of Yamaha's own Vocaloid called VY1.

As of 2011, there are seven studios involved with the production and distribution of Vocaloids with two involved solely in English, four solely in Japanese and one in both languages for which the software is developed.

Released products

Product	Developer	Language	Sex	Voice sampled	Release date
Sweet Ann	PowerFX	English	Female	Jody	2007-06-29June 29, 2007
Hatsune Miku (CV01)	Crypton Future Media	Japanese	Female	Saki Fujita	2007-08-31August 31, 2007
Kagamine Rin and Len (CV02)	Crypton Future Media	Japanese	Female (Rin) Male (Len)	Asami Shimoda	2007-12-27December 27, 2007
Prima	Zero-G	English	Female		2008-01-14January 14, 2008
Kagamine Rin and Len (CV02) Act 2	Crypton Future Media	Japanese	Female (Rin) Male (Len)	Asami Shimoda	2008-07-18July 18, 2008
Gackpoid: Kamui Gakupo	Internet Co., Ltd.	Japanese	Male	Gackt	2008-07-31July 31, 2008
Megurine Luka (CV03)	Crypton Future Media	Japanese and English	Female	Yū Asakawa	2009-01-30January 30, 2009
Megpoid: Gumi	Internet Co., Ltd.	Japanese	Female	Megumi Nakajima	2009-06-25June 25, 2009
Sonika	Zero-G	English	Female		2009-07-14July 14, 2009
SF-A2 Miki	AH Software	Japanese	Female	Miki Furukawa	2009-12-04December 4, 2009
Kaai Yuki	AH Software	Japanese	Female		2009-12-04December 4, 2009
Hiyama Kiyoteru	AH Software	Japanese	Male	Kiyoshi Hiyama	2009-12-04December 4, 2009
Big Al	PowerFX	English	Male	Michael King (original pre-release) Frank Sanderson (post-release)	2009-12-22December 22, 2009
Hatsune Miku Append	Crypton Future Media	Japanese	Female	Saki Fujita	2010-04-30April 30, 2010
Tonio	Zero-G	English	Male		2010-07-14July 14, 2010
Lily	Yamaha Corporation Avex Management Internet Co., Ltd.	Japanese	Female	Yūri Masuda (m.o.v.e.)	2010-08-25August 25, 2010
VY1 (codenamed: "Mizki")	Yamaha Corporation Bplats	Japanese	Unisex ("feminine" sounding vocal)		2010-09-01September 1, 2010
Gachapoid: Ryūto	Internet Co., Ltd.	Japanese	Male	Kuniko Amemiya	2010-10-08October 8, 2010
Nekomura Iroha	AH Software	Japanese	Female		2010-10-22October 22, 2010
Utatane Piko	Sony Music Entertainment Japan Ki/oon Records Inc.	Japanese	Male	Piko	2010-12-08December 8, 2010
Kagamine Rin and Len Append	Crypton Future Media	Japanese	Female (Rin) Male (Len)	Asami Shimoda	2010-12December 27, 2010
VY2 (codenamed: "Yuma")	Yamaha Corporation Bplats	Japanese	Unisex ("young masculine" sounding vocal)		2011-04-25April 25, 2011

Upcoming products

Product	Developer	Language	Sex	Voice sampled	Release date
VFS-01R Ring Suzune	Yamaha Corporation	Japanese	Female	MiKA	Autumn 2011
VFS-01L Lui Hibiki	Yamaha Corporation	Japanese	Male		Autumn 2011
Megpoid Extend	Internet Co., Ltd.	Japanese	Female	Megumi Nakajima	2011
Untitled	Zero-G	English			20112011
Meiko update	Crypton Future Media	Japanese	Female	Meiko Haigō	TBA
Megurine Luka Append	Crypton Future Media	Japanese and English	Female	Yū Asakawa	TBA
Kaito update	Crypton Future Media	Japanese	Male	Naoto Fūga	TBA
CV04	Crypton Future Media	Japanese	Male		TBA
Hatsune Miku	Crypton Future Media	English	Female	Saki Fujita	TBA
VY?	Bplats	English	Unisex ("masculine" sounding voice)		TBA
VY?	Bplats	English	Unisex ("feminine" sounding voice)		TBA
Untitled	AH Software	Japanese			TBA
Untitled	PowerFX	English	Male		TBA

• Crypton has a "Project if..." with a mysterious, child-like voice.

Vocaloid 3

Vocaloid 3 has been confirmed, and is said to be aimed to be Yamaha's most "realistic voice engine yet." Preparations are being made for the launch of the software, and release is expected in the near future.

Derivative products

Software

Vocaloid-flex

Yamaha developed Vocaloid-flex, a singing software application based on the Vocaloid engine, which contains a speech synthesizer. According to the official announcement, users can edit its phonological system more delicately than those of other Vocaloid series to get closer to the actual speech language; for example, it enables final devoicing, unvoicing vowel sounds or weakening/strengthening consonant sounds. It was used in a video game Metal Gear Solid: Peace Walker released on April 28, 2010. It is still a corporate product and a consumer version has not been announced. This software was also used for the robot model HRP-4C at CEATEC Japan 2009. Gachapoid has access to this engine and it is used through the software V-Talk.

VocaListener

Another Vocaloid tool that was developed was VocaListener, a software package that allows for realistic Vocaloid songs to be produced.

Miku Miku Dance

File:800px-MMD-Example 2.jpg

A screenshot of the program MikuMikuDance

To aid in the production of 3D animations, the program MikuMikuDance was developed as an independent program. The freeware software allowed a boom in fan-made and derivative characters to be developed, as well as acted in a boost for the promoting of the Vocaloid songs themselves. As of May 2011, no more updates to Miku Miku Dance are being released.

NetVocaloid

NetVocaloid is an online vocal synthesis service. Users can synthesize singing voices on a device connected to the Internet by executing the Vocaloid engine on the server. This service can be used even if the user does not actually own the Vocaloid software. The service is available in both English and Japanese.

MMDAgent

MMDAgent is a software developed by the International Voice Engineering Institute in the Nagoya Institute of Technology, and the Alpha version was released on December 25, 2010. This particular software allows users to interact with 3D models of the Vocaloid mascots. The software is made from 3D models and sound files that have already been made available on the internet and will be disputed as freeware for that reason.

NetVocalis

NetVocalis is a software being developed by Bplats, makers of the VY series, and is similar to VocaListener.

Hardware

Vocaloid is set to become a hardware version called Vocaloid-Board.

Marketing

Though developed by Yamaha, the marketing of each Vocaloid is left to the respective studios. Yamaha themselves do maintain a degree of promotional efforts in the actual Vocaloid software, as seen when the humanoid robot model HRP-4C of the National Institute of Advanced Industrial Science and Technology (AIST) was set up to react to three Vocaloids—Hatsune Miku, Megpoid and Crypton's noncommercial Vocaloid software "CV-4Cβ"—as part of promotions for both Yamaha and AIST at CEATEC in 2009. The prototype voice CV-4Cβ was created by sampling a Japanese voice actress, Eriko Nakamura.

Japanese magazines such as DTM magazine are responsible for the promotion and introduction for many of the Japanese Vocaloids to Japanese Vocaloid fans. It has featured Vocaloids such as Miku, Kagamine Rin and Len, and Lily, printing some of the sketches by artist Kei and reporting the latest news on the Vocaloids. Thirty-day trial versions of Miriam, Lily and Iroha have also contributed to the marketing success of those particular voices. After the success of A2-SF Miki's CD album, other Vocaloids such as VY1 and Iroha have also used promotional CDs as a marketing approach to selling their software. When Amazon MP3 in Japan opened on November 9, 2010, Vocaloid albums were featured as its free-of-charge contents.

File:Studie GLAD BMW Z4 2008 Super GT qualifying.jpg

The Hatsune Miku Studie Glad BMW Z4 competed in the 2008 Super GT season.

Crypton has been involved with the marketing of their Character Vocal Series, particularly Hatsune Miku, has been actively involved in the GT300 class of the Super GT since 2008 with the support of Good Smile Racing (a branch of Good Smile Company, mainly in charge of car-related products, especially itasha (cars featuring illustrations of anime-styled characters) stickers). Although Good Smile Company was not the first to bring the anime and manga culture to Super GT, it departs from others by featuring itasha directly rather than colorings onto vehicles.

Since the 2008 season, three different teams received their sponsorship under Good Smile Racing, and turned their cars to Vocaloid-related artwork:

• Studie, which participated in the 2008 and 2009 seasons with BMW Z4 E86, and BMW Z4 GT3 in the 2011 season. Their car was painted in official Hatsune Miku art in 2008 season, but started using fan-derivative versions of Hatsune Miku in some races since the 2009 season.
• Team MOLA, using a Nissan 350Z, and they received sponsors on the final race in Fuji in the 2008 season. Images of Kagamine Rin and Len was added on their original colorings. The Fuji round, in fact, is the first FIA race to feature two unique itasha cars competing in a single race.
• Team COX, participating in the 2010 season, which used a Porsche 996 GT3 RSR and a Porsche 997 GT3-R. Their car used Racing Miku (an official Hatsune Miku derivative, wearing an orange race queen suit) as their image.

As well as involvements with the GT series, Crypton also established the website Piapro. A number of games starting from Hatsune Miku: Project DIVA were produced by Sega under license using Hatsune Miku and other Crypton Vocaloids, as well as "fan made" Vocaloids. Later, a mobile phone game called Hatsune Miku Vocalo x Live was produced by Japanese mobile social gaming website Gree. TinierMe Gacha also made attire that looks like Miku for their services, allowing users to make their avatar resemble the Crypton Vocaloids.

Two unofficial manga were also produced for the series, Maker Unofficial: Hatsune Mix being the most well known of the two, which was released by Jive in their Comic Rush magazine; this series is drawn by Vocaloid artist Kei. The series features the Crypton Vocaloids in various different scenarios, a different one each week. The series focuses on the Crypton Vocaloids, although Internet Co., Ltd.'s Gackpoid Vocaloid makes a guest appearance in two chapters. The series also saw guest cameos of Vocaloid variants such as Hachune Miku, Yowane Haku, Akita Neru and the Utauloid Kasane Teto. The series comprises the original 28 chapters serialized in Comic Rush and a collection of the first 10 chapters in a single tankōbon volume. A manga was produced for Lily by Kei, who also drew the mascot. An anime music video titled "Schwarzgazer", which shows the world where Lily is, was produced and it was released with the album anim.o.v.e 02, however the song is sung by Move, not by Vocaloids. A yonkoma manga based on Hatsune Miku and drawn by Kentaro Hayashi, Shūkan Hajimete no Hatsune Miku!, began serialization in Weekly Young Jump on September 2, 2010. Hatsune Miku appeared in Weekly Playboy magazine.

Initially, Crypton Future Media were the only studio that was allowed the license of figurines to be produced for their Vocaloids. A number of figurines and plush dolls were also released under license to Max Factory and the Good Smile Company of Crypton's Vocaloids. Among these figures were also Figma models of the entire "Character Vocal Series" mascots as well as Nendoroid figures of various Crypton Vocaloids and variants. Pullip versions of Hatsune Miku, Kagamine Len and Rin have also been produced for release in April 2011; other Vocaloid dolls have since been announced from the Pullip doll line. As part of promotions for Vocaloid Lily, license for a figurine was given to Phat Company and Lily became the first non-Crypton Vocaloid to receive a figurine.

In regards to the English Vocaloid studios, Power FX's Sweet Ann was given her own MySpace page and Sonika her own Twitter account. In comparison to Japanese studios, Zero-G and PowerFX maintain a high level of contact with their fans. Zero-G in particular encourages fan feed back and, after adopting Sonika as a mascot for their studio, has run two competitions related to her. There was also talk from PowerFX of redoing their Sweet Ann box art and a competition would be included as part of the redesign. The Vocaloid Lily also had a competition held during her trial period. English Vocaloids have not sold enough to warrant extras, such as seen with Crypton's Miku Append. However, it has been confirmed if the English Vocaloids become more popular, then Appends would be an option in the future. Crypton plans to start an electronic magazine for English readers at the end of 2010 in order to encourage the growth of the English Vocaloid fanbase. Extracts of PowerFX's Sweet Ann and Big Al were included in Soundation Studio in their Christmas loops and sound release with a competition included.

Crypton and Toyota began working together to promote the launch of the 2011 Toyota Corolla using Hatsune Miku to promote the car. The launch of the car also marked the start of Miku's debut in the US alongside it. Crypton had always sold Hatsune Miku as a virtual instrument, but they decided to ask their own fanbase in Japan if it was okay with them to market her to the United States as a virtual singer instead.

Promotional events

The largest promotional event for Vocaloids is "The Voc@loid M@ster" (Vom@s) convention held four times a year in Tokyo or the neighboring Kanagawa Prefecture. The event brings producers and illustrators involved with the production of Vocaloid art and music together so they can sell their work to others. The original event was held in 2007 with 48 groups, or "circles", given permission to host stalls at the event for the selling of their goods. The event soon gained popularity and at the 14th event, nearly 500 groups had been chosen to have stalls. Additionally, Japanese companies involved with production of the software also have stalls at the events.

Vocaloids have also been promoted at events such as the NAMM show and the Musikmesse fair. In fact, it was the promotion of Zero-G's Lola and Leon at the NAMM trade show that would later introduce PowerFX to the Vocaloid program. These events have also become an opportunity for announcing new Vocaloids with Prima being announced at the NAMM event in 2007 and Tonio having been announced at the NAMM event in 2009. A customized, Chinese version of Sonika was released at the Fancy Frontier Develop Animation Festival, as well as with promotional versions with stickers and posters. Sanrio held a booth at Comiket 78 featuring the voice of an unreleased Vocaloid. AH Software in cooperation with Sanrio shared a booth and the event was used to advertise both the a Hello Kitty game and AH Software's new Vocaloid. At the Nico Nico Douga Daikaigi 2010 Summer: Egao no Chikara event, Internet Co., Ltd. announced their latest Vocaloid "Gachapoid" based on popular children's character Gachapin.

Originally, Hiroyuki Ito—President of Crypton Future Media—claimed that Hatsune Miku was not a virtual idol but a kind of the Virtual Studio Technology instrument. However, Hatsune Miku performed her first "live" concert like a virtual idol on a projection screen during Animelo Summer Live at the Saitama Super Arena on August 22, 2009. At the "MikuFes '09 (Summer)" event on August 31, 2009, her image was screened by rear projection on a mostly-transparent screen. Miku also performed her first overseas live concert on November 21, 2009, during Anime Festival Asia (AFA) in Singapore. On March 9, 2010, Miku's first solo live performance titled "Miku no Hi Kanshasai 39's Giving Day" was opened at the Zepp Tokyo in Odaiba, Tokyo. The tour was run as part of promotions for Sega's Hatsune Miku: Project Diva video game in March 2010. The success and possibility of these tours is owed to the popularity of Hatsune Miku and so far Crypton is the only studio to have established a world tour of their Vocaloids.

Later, the CEO of Crypton Future Media appeared in San Francisco at the start of the San Francisco tour where the first Hatsune Miku concert was hosted in North America on September 18, 2010, featuring songs provided by the Miku software voice. A second screening of the concert was on October 11, 2010 in the San Francisco Viz Cinema. A screening of the concert was also shown in New York City in the city's anime festival. Hiroyuki Ito, and planner/producer, Wataru Sasaki, who were responsible for Miku's creation, attended an event on October 8, 2010 at the festival. Videos of her performance are due to be released worldwide. Megpoid and Gackpoid were also featured in the 2010 King Run Anison Red and White concert. This event also used the same projector method to display Megpoid and Gackpoid on a large screen. Their appearance at the concert was done as a one-time event and both Vocaloids were featured singing a song originally sung by their respective voice provider.

The next live concert was set for Tokyo on March 9, 2011. Other events included the Vocarock Festival 2011 on January 11, 2011 and the Vocaloid Festa which was held on February 12, 2011. The Vocaloid Festa had also hosted a competition officially endorsed by Pixiv, with the winner seeing their creation unveiled at Vocafes2 on May 29, 2011. Miku will also be giving a "live" performance in Los Angeles on July 2, 2011 at the Nokia Theater during Anime Expo; the concert will be identical to the March 9, 2010 event except for a few improvements.

Cultural impact

Hatsune Miku is mostly responsible for Vocaloid's success.

The software became very popular in Japan upon the release of Crypton Future Media's Hatsune Miku Vocaloid 2 software and her success has led to the popularity of the Vocaloid software in general. Inside of Japan, the software has proven to be popular overall, with thousands of original songs by artists across Japan. Japanese video sharing website Nico Nico Douga played a fundamental role in the recognition and popularity of the software. A user of Hatsune Miku and an illustrator released a much-viewed video, in which "Hachune Miku", a super deformed Miku, held a Welsh onion (Negi in Japanese) and sang the Finnish song "Ievan Polkka" like the flash animation "Loituma Girl", on Nico Nico Douga. According to Crypton, they knew that users of Nico Nico Douga had started posting videos with songs created by the software before Hatsune Miku, but the video presented multifarious possibilities of applying the software in multimedia content creation—notably the dōjin culture. As the recognition and popularity of the software grew, Nico Nico Douga became a place for collaborative content creation. Popular original songs written by a user would generate illustrations, animation in 2D and 3D, and remixes by other users. Other creators would show their unfinished work and ask for ideas. The software has also been used to tell stories using song and verse and the Story of Evil series has become so popular that a manga, a book, and two theatre works were produced by the series creator. Another theatre production based on Cendrillion, a song sung by Kaito produced by Kurousa-P, was also set to hit the stage and will run Shibuya's Space Zero theater in Tokyo from August 3 to August 7.The website has become so influential that studios often post demos on Nico Nico Douga, as well as other websites such as YouTube, as part of the promotional effort of their Vocaloid products. The important role Nico Nico Douga has played in promoting the Vocaloids also sparked interest in the software and Kentaro Miura, the artist of Gakupo's mascot design, had offered his services for free because of his love for the website.

In September 2009, three figurines based on the derivative character "Hachune Miku" were launched in a rocket from the United States state of Nevada's Black Rock Desert, though it did not reach outer space. In late November 2009, a petition was launched in order to get a custom made Hatsune Miku aluminum plate (8 cm x 12 cm, 3.1" x 4.7") made that would be used as a balancing weight for the Japanese Venus space probe Akatsuki. Started by Hatsune Miku fan Sumio Morioka that goes by chodenzi-P, this project received the backing of Dr. Seiichi Sakamoto of the Japan Aerospace Exploration Agency (JAXA). The website of the petition written in Japanese was translated into other languages such as English, Russian, Chinese and Korean, and, the petition exceeded the needed 10,000 signatures necessary to have the plates made on December 22, 2009. On May 21, 2010 at 06:58:22 (JST), Akatsuki was launched on the rocket H-IIA 202 Fright 17 from the Japanese spaceport Tanegashima Space Center, having three plates depicting Hatsune Miku.

The Vocaloid software has also had a great influence on the character Black Rock Shooter, which looks like Hatsune Miku but is not linked to her by design. The character was made famous by the song "Black Rock Shooter", and a number of figurines have been made. An original video animation made by Ordet was streamed for free as part of a promotional campaign running from June 25 to August 31, 2010. The virtual idols "Meaw" have also been released aimed at the Vocaloid culture. The twin Taiwanese virtual idols released two singles, "Meaw Left ver." and "Meaw Right ver.", sung in Japanese.

A cafe for one day only was opened in Tokyo based on Hatsune Miku on August 31, 2010. A second event was arranged for all Japanese Vocaloids. "Snow Miku" was also featured on an event as a part of the 62nd Sapporo Snow Festival in February 2011. A Vocaloid-themed TV show on the Japanese Vocaloids called Vocalo Revolution began airing on Kyoto Broadcasting System on January 3, 2011. The show is part of a bid to make the Vocaloid culture more widely accepted and features a mascot known as "Cul", also mascot of the "Cul project". The show's first success story is a joint collaboration between Vocalo Revolution and the school fashion line "Cecil McBee" Music x Fashion x Dance. Piapro also held a competition with famous fashion brands with the winners seeing their Lolita-based designs reproduced for sale by the company Putumayo. A radio station set up a 1 hour program containing nothing but Vocaloid-based music.

The Vocaloid software had a great influence on the development of the freeware software Utau. Several products were produced for the Macne series (Mac音シリーズ) for intended use for the programs Reason 4 and GarageBand. These products were sold by Act2 and by converting their file format, were able to also work with the Utau program. The program Maidloid, developed for the character Acme Iku (阿久女イク), was also developed, which works in a similar way to Vocaloid, except produces erotic sounds rather than an actual singing voice. Other than Vocaloid, AH Software also developed Tsukuyomi Ai and Shouta for the software Voiceroid, and the sale of their Vocaloids gave AH software the chance to promote Voiceroid at the same time. The software is aimed for speaking rather than singing. Both AH Software's Vocaloids and Voiceroids went on sale on December 4, 2009. Crypton Future Media has been reported to openly welcome these additional software developments as it expands the market for synthesized voices.

During the events of the 2011 Tōhoku earthquake and tsunami, a number of Vocaloid related donation drives were produced. Crypton Future Media joined several other companies in a donation drive, with money spent on the sales of music from Crypton Future Media's KarenT label being donated to the Japanese Red Cross. In addition, a special Nendoroid of Hatsune Miku, Nendoroid Hatsune Miku: Support ver., was announced with a donation of 1,000 yen per sale to the Japanese Red Cross.

Featured music

It is difficult to know how many songs and albums are using the Vocaloid software since song writers must ask permission before being allowed to state specifically they are using a Vocaloid in their songs. However, the albums mentioned here only represent a fraction of the albums produced using the software and many more are found on Crypton's KarenT label website. The earliest use of Vocaloid related software used prototypes of Kaito and Meiko and were featured on the album History of Logic System by Hideki Matsutake released on July 24, 2003, and sang the song "Ano Subarashii Ai o Mō Ichido". The first album to be released using a full commercial Vocaloid was A Place in the Sun, which used Leon's voice for the vocals singing in both Russian and English. Miriam has also been featured in two albums, Light + Shade and Continua. Japanese electropop-artist Susumu Hirasawa used Vocaloid Lola in the original soundtrack of Paprika by Satoshi Kon. The softwares biggest asset is its ability to see continued usage even long after its initial release date. Leon was featured in the album 32bit Love by Muzehack and Lola in Operator's Manual by anaROBIK; both were featured in these albums six years after they were released. Even early on in the software's history, the music making progress proved to be a valuable asset to the Vocaloid development as it not only opened up the possibilities of how the software may be applied in practice, but led to the creation of further Vocaloids to fill in the missing roles the software had yet to cover. The album A Place in the Sun was noted to have songs that were designed for a male voice with a rougher timbre then the Vocaloid Leon could provide; this later led to the development of Big Al to fulfill this particular role.

Some of the most popular albums are a part of the Exit Tunes series, featuring the works of Vocaloid producers in Japan. One of the Vocaloid compilations, Exit Tunes Presents Vocalogenesis feat. Hatsune Miku, debuted at No. 1 on the Japanese weekly Oricon albums chart in May 2010, becoming the first Vocaloid album ever to top the charts. The album sold 23,000 copies in its first week and eventually sold 86,000 copies. The following released album, Exit Tunes Presents Vocalonexus feat. Hatsune Miku, became the second Vocaloid album to top the weekly charts in January 2011. Another album, Supercell, by the group Supercell also features a number of songs using Vocaloids. Other albums, such as 19's Sound Factory's First Sound Story and Livetune's Re:Repackage, and Re:Mikus also feature Miku's voice. Other uses of Miku include the albums Sakura no Ame (桜ノ雨) by Absorb and Miku no Kanzume (みくのかんづめ) by OSTER-project. Kagamine Len and Rin's songs were covered by Asami Shimoda in the album Prism credited to "Kagamine Rin/Len feat. Asami Shimoda". The compilation album Vocarock Collection 2 feat. Hatsune Miku was released by Farm Records on December 15, 2010, and was later featured on the Cool Japan Music iPhone app in February 2011. The record label Balloom became the first label to focus solely on Vocaloid-related works and their first release was Unhappy Refrain by the Vocaloid producer Wowaka. Hatsune Miku's North American debut song "World is Mine" ranked at No. 7 in the iTunes world singles ranking in the week of its release. Singer Gackt also challenged Gackpoid users to create a song, with the prize being 10 million yen, stating if the song was to his liking he would sing and include it in his next album. The winning song "Episode 0" and runner up song "Paranoid Doll" are set to be released by Gackt on July 13, 2011.

In the month prior to her release, SF-A2 Miki was featured in the album Vocaloids X'mas: Shiroi Yoru wa Seijaku o Mamotteru as part of her promotion. The album featured the Vocaloid singing Christmas songs. Miki was also featured singing the introduction of the game Hello Kitty to Issho! Block Crash 123!!. A young female prototype used for the "project if..." series was used in Sound Horizon's musical work "Ido e Itaru Mori e Itaru Ido", labeled as the "prologue maxi". The prototype sang alongside Miku for their music and is known only by the name "Junger März_Prototype β". For Yamaha's VY1 Vocaloid, an album featuring VY1 was created. The album was released with the deluxe version of the program. It includes various well known producers from Nico Nico Douga and YouTube and includes covers of various popular and well known Vocaloid songs using the VY1 product. The first press edition of Nekomura Iroha was released with a CD containing her two sample songs "Tsubasa" and "Abbey Fly", and the install disc also contained VSQ files of the two songs for use with her program. A number of Vocaloid related music, including songs starring Hatsune Miku, were featured in the arcade game Music Gun Gun! 2.

Legal implications

According to Crypton, because professional female singers refused to provide singing data, in fear that the software might create their singing voice's clones, Crypton changed their focus from imitating certain singers to creating characteristic vocals. This change of focus led to sampling vocals of voice actors and the Japanese voice actor agency Arts Vision supported the development. Similar concerns are expressed throughout the other studios using Vocaloid, with Zero-G refusing to release the names of their providers and Miriam Stockley (who provided the voice for Miriam) remains the only known Zero-G voice provider. PowerFX only hinted at Sweet Ann's voice provider and only Big Al's is known. AH Software named Miki's voice provider, but for legal reasons cannot name Kaai Yuki's as minors were the subject of the recordings.

Any rights or obligations arising from the vocals created by the software belong to the software user. Just like any music synthesizer, the software is treated as a musical instrument and the vocals as sound. Under the term of license, the mascots for the software can be used to create vocals for commercial or non-commercial use as long as the vocals do not offend public policy. In other words, the user is bound under the term of license of the software not to synthesize derogatory or disturbing lyrics. On the other hand, copyrights to the mascot image and name belong to their respective studios. Under the term of license, a user cannot commercially distribute a vocal as a song sung by the character, nor use the mascot image on commercial products, without the consent of the studio who owns them.

One of the most controversial uses of the legal agreements of any Vocaloid producing studio was from the Democratic Party of Japan, whose running candidate, Kenzo Fujisue, attempted to secure the use of Miku's image in the Japanese House of Councillors election of July 11, 2010. The hope was that the party could use her image to appeal to younger voters. Although Crypton Future Media rejected the party's use of her image or name for political purposes, Fujisue released the song "We Are the One" using her voice but not credited to her on YouTube, by replacing her image with the party's character in the music video.

Employees working within the studios are bound by legal implications not to repeat any details given to them from Yamaha on Vocaloid development without Yamaha's permission. They are also not allowed to disclose details of upcoming Vocaloids without permission of the Vocaloid studio nor reveal the identity of the singer if the studio does not make it public.

On November 29, 2010, Crypton started an independent music publication for seeking copyright royalties if songs are used for commercial purposes such as karaoke, because Vocaloid users hardly used the copyright collective Japanese Society for Rights of Authors, Composers and Publishers (JASRAC). Due to the fact songs using the software are made by independent users, the act of plagiarism has remained a highly controversial issue among Vocaloid users and their published works. This has been a heated issue on both illustrative and musical levels with songs and their publishers being targeted by allegations of stealing the works of others. In January 2011, Japanese boyband KAT-TUN were forced to admit plagiarism against their song "Never×Over~「-」Is Your Part~", after the producer of the song admitted it was influenced by the Vocaloid song "Dye" produced by AVTechNO, after fans expressed their outrage over the similarities of the two songs. However, AVTechNO also released a statement explaining that the members of the band were not to blame for this incident.

Reception

Despite the success of the software in Japan, overseas customers have been reluctant on the software overall. In contrast to the reaction overseas, reviewers such as Michael Stipe of R.E.M. praised when it was first announced in 2003. Stipe noted that one of the more useful aspects of the software was that is gave singers a method of preserving their voice for future use should they lose their own, but as the technology progressed it could also be used to bring back the voices of singers whose voices have already been lost. However, while the provider of "Miriam", Miriam Stockley, had accepted that there was little point in fighting progress, she had noted there was little control over how her voice was used once the software was in the hands of others. Reception to Vocaloid 2 was generally better. When Sweet Ann was first released, John Walden of Sound on Sound had reviewed Leon, Lola and Miriam and noted that Vocaloid itself had no previous rival technology to contend with, and praised Yamaha for their efforts as Vocaloid was an ambitious project to undertake, considering the human voice was more complex to synthesize than instruments such as the violin. In reviewing Vocaloid 2, he referred to the original software engine in a passing comment stating, "Undoubtedly a remarkable and innovative product and, with experience and patience, was capable of producing results that could be frighteningly realistic." While he congratulated the improvements made in Vocaloid 2, he noted the software was still far from being regarded as a top rate singer.

The CEO of Crypton Future Media noted the lack of interest in Vocaloids overall was put down to the lack of response in the initial Vocaloid software. In regards to the development of the English version of the software specifically, many studios when approached by Crypton Future Media for recommendations towards developing the English Vocaloids had no interest in the software initially, with one particular company representative calling it a "toy". A level of failure was put on Leon and Lola for lack of sales in the United States, putting the blame on their British accents. Crypton praised the value of the English Vocaloids and what they offered to the Japanese users for their capability of offering the English language to them, when it would otherwise be off limits. As Hatsune Miku was responsible for making the software famous, her voice has become the most commonly associated with the Vocaloid software and divides opinions of critics both overseas and within Japan on their opinions towards her and the software. Crypton blamed a fear of robots on part of the lack of response on the sale of the software overseas and expressed that there was also a general "anti-Vocaloid" point of view amongst some cultures and communities, although he also noted that he hoped in the future this would change as the software continued to be developed.

Even with the lack of success for the English version of the software in the United States, Crypton Future Media reported that about half of music downloads at the iTunes Store for songs of Crypton's label KarenT, published by Japanese producers, have been from overseas purchases, with sales from American consumers making up the majority of percentages of overseas sales. Despite experiencing good sales in Europe, it was reported the software is over failing to attract a satisfactory level of attention, and software developers are now setting their sights on trying to overturn the lack of interest in the software in Europe.

Hatsune Miku picked up second place in a 2010 Japanese Yahoo! poll on Japanese gamers' favorite characters, owed to her starring role in Hatsune Miku: Project DIVA 2nd. CNN's website CNNGo declared Hatsune Miku as one of Japan's best in their "Tokyo best and worst of 2010", listing her as the "Best new virtual singer for the otaku generation". Clash magazine labeled Hatsune Miku and the Vocaloid software as the future of music.

See also

• Cantor
• Computer music
• Macne series
• Software synthesizer
• Speech synthesis
• Utau
• Voiceroid

Further reading

• Hideki Kenmochi (2009). "Singing Synthesis and its Application". The Journal of the Information Processing Society of Japan (in Japanese). 2009 (8). The Information Processing Society of Japan: pp. 723–728. ISSN 0447-8053. {{cite journal}}: |pages= has extra text (help); Unknown parameter |month= ignored (help)
• "音楽情報処理最前線!VOCALOIDに歌を真似させるVocaListener" (PDF). DTM magazine (in Japanese). 15 (9). Terajima Joho Kikaku: pp. 72–73. 2008. {{cite journal}}: |pages= has extra text (help); Unknown parameter |month= ignored (help); Unknown parameter |trans_title= ignored (|trans-title= suggested) (help)

External links

• Official Vocaloid website
• Official Vocaloid 2 website Template:Ja icon
• Introduction of Vocaloid and NetVocaloid by Yamaha's Y2 Project