Today: 08/08/2022 03:03:29 (GMT+7)

Vietnamese engineer generates music with AI

Nguyen Hoang Bao Dai, a 27-year-old engineer based in Ho Chi Minh City, has become the third Vietnamese person to be recognised as a Google Developer Expert in Machine Learning for his music generation model, which can generate Vietnamese pop songs using Artificial Intelligence (AI).

Since graduating in computer science at the Ho Chi Minh City University of Natural Sciences, Nguyen Hoang Bao Dai has been working as an AI research engineer in natural language processing and computer vision. In addition to his passion for computer science, Bao Dai has also been interested in music since childhood. He is the composer and performer of the music video entitled ‘Dan IT’ (IT programmers) that has won much interest from viewers on YouTube.

Vietnamese engineer, generates music, AI,Nguyen Hoang Bao Dai, Google Developer Expert,  Artificial Intelligence

AI researcher Nguyen Hoang Bao Dai.

Bao Dai said that he often works on the melody first, then the chords and lyrics because he thinks that a good song must first have a beautiful melody. During the composition period, Dai finds that creating melody is the most time-consuming stage with many songs taking him months to complete after editing the melodies many times.

This fact brought him to the idea of his applying knowledge of AI to support his passion for music. 

He embarked on research for the project in early 2017. After two years of research, his music generation model with AI debuted and has surprised people by generating ten melodies within just one second. Under his model, the composer only needs to input a few notes, the system will process the data, convert it into a multi-digit vector and create longer melodies.

The AI's random algorithm allows the system to generate completely different versions of the tune so that composers can select and make adjustments as desired. This model helps musicians shorten their working time by suggesting melodies which they may find inspiring, so that musicians have more time to refine the remaining stages, such as writing harmony, lyrics, and the arrangement of the song.

According to Bao Dai, there have been researches on AI models in generating music around the world, but most of the models work on classical music, which is very different from the musical tastes of Vietnamese people.

Therefore, Dai had to build his own algorithms for his model generate pop ballads which win much favoured of Vietnamese people. The biggest challenge for the project is to collect an input data source which is abundant enough to “train” the model. 

In order for the model to be able to compose young music, it must have a data source about young music. However, this data cannot be extracted from YouTube songs or music websites because these are finished products, while the system can only read and understand input data in the form of MIDI files.

To solve this problem, Bao Dai had to play and record the tunes of popular Vietnamese songs on the electric piano by himself and then processed them into MIDI files. Among the 30,000 song files that the model has stored, only about 5,000 of them were sourced from music forums while the remaining 25,000 songs were played by Bao Dai himself.

Bao Dai also faced challenges regarding the operating system, because desktops or laptops do not have enough computing power to train AI, while his budget couldn’t afford to invest in a new powerful operating system. Therefore, Dai decided to rent a machine using cloud computing and paying fees according to usage.

Bao Dai revealed he will continue to conduct research to further develop the ability to make chords and write lyrics for his model so that it can become an effective assistant for musicians while fully optimising the features of the model.

Vietnam's first artificial intelligence robot
Vietnam’s first AI robot Tri Nhan, built for educational purposes, has five senses and can answer questions on many topics.
Many solutions taken to promote businesses’ digital transformation
(BGO) - In the trend of strong digital transformation, in order to maintain production and business activities and find development opportunities, enterprises must take advantage of the power of technology. One of the contents promoting digital transformation of Bac Giang province is to support small- and medium-sized enterprises (SMEs) in the work.
Digital transformation facilitates retail growth
According to General Statistic Office, in the first six months of 2021, total retail sales of goods and services went up 4.9% compared to the same period in 2020 to VND2,463.8 trillion (over US$107 billion), of which goods retail revenue hit VND1,985.4 trillion, up 6.2%.
Vietnam ‘promised land’ for digital banking
Vietnam is among the regional countries that are seeing new digital bank models, experts have said.
Bringing artwork into digital space
In order to meet the increasingly diverse needs of the public and contribute to exploiting the potential of various art forms, a group of artists, cultural experts and technology engineers have collaborated to implement the project "Sky Gate" which provides a platform to confirm and transfer the digital ownership of artwork. After the launch ceremonies in Ho Chi Minh City and Hanoi, the project received the attention and cooperation of many artists and art lovers.

Source: NDO

Vietnamese engineer, generates music, AI,Nguyen Hoang Bao Dai, Google Developer Expert, Artificial Intelligence
New comment has just been added. Click here
Sort:NewBest News