A New Model for Symbolic Music Generation Using Musical Metadata

By Jurassic JennOct 2, 2024 12:42 PMTech
Share:
Screenshot of the team's system demo showing its user interface.
Screenshot of the team's system demo showing its user interface. Source: https://techxplore.com/

Artificial intelligence (AI) is revolutionizing the music industry by enabling the creation of tools for automatic generation of musical compositions and specific instrument tracks. However, most current tools are designed exclusively for musicians, composers, and music producers, making them inaccessible to non-experts.

Researchers at LG AI Research have developed a novel interactive system that democratizes music creation, allowing any user to translate their ideas into music effortlessly. This system, described in a paper on the arXiv preprint server, integrates a decoder-only autoregressive transformer trained on extensive music datasets with an intuitive user interface.

In their paper, Sangjun Han, Jiwon Ham, and colleagues introduce symbolic music generation that focuses on providing short musical motifs as central themes. They utilize an autoregressive model which uses musical metadata inputs to generate 4 bars of multitrack MIDI sequences. The model is trained on the Lakh MIDI and MetaMIDI datasets, totaling over 400,000 MIDI files that encode various musical track details like notes played, their duration, and speed.

To enhance model training, the researchers converted each MIDI file into a musical event representation (REMI). This format encodes MIDI data into tokens representing music features like pitch and velocity, crucial for training AI in music generation favorably. "During training, we randomly drop tokens from the musical metadata to guarantee flexible control," they explain. This ensures users can select input types while maintaining generative performance, fostering flexibility in music creation.

Beyond its transformer-based model, the team developed a user-friendly interface apt for both experts and non-experts. It features a sidebar and a central interactive panel. Users can specify musical elements like instruments and tempo in the sidebar, and edit the generated track in the central panel, such as by adding or removing instruments or adjusting their entry times.

"We validate the strategy's effectiveness through experiments assessing model capacity, musical fidelity, diversity, and controllability," they report. A subjective test comparing it with other models confirmed its superiority in control and music quality. Their model reliably generates up to 4 bars of music based on user specifications.

Future enhancements may include extending the track duration their model can create, broadening user specifications, and further refining the user interface. Though their current model, trained to generate 4-bar sequences with global control, has some limitations in extending music length and controlling bar-level elements, their work is significant in generating high-quality musical themes suitable for looping.

Earlier, SSP wrote that HP introduced AI features to boost printer functionality.

Top Articles
What double rainbow means in spiritual sense

Meaning of double rainbow as a spiritual sign from above

Oct 16, 2024 13:27 PM
Symbolism and meaning of crickets

Symbolism and meaning of the cricket as a spirit animal

Oct 15, 2024 13:01 PM

Meaning of the yellow butterfly. Symbolism and spiritual meaning of the encounter

Oct 15, 2024 15:05 PM

Keep seeing the number of angel 2222? Read its spiritual meaning

Oct 14, 2024 17:01 PM
More News
Founder of Wood Trick - Dmitry Antonenko

Dmitry Antonenko: The Ukrainian Innovator Who Challenged LEGO

Apr 6, 2025 19:20 PM
Belly Button Piercing

Beyond Beauty: The Spiritual Symbolism of Belly Button Piercings

Apr 1, 2025 21:16 PM

What does a Palm Mean in Your Dream?

Apr 1, 2025 20:54 PM

Three zodiac signs are entering a period ripe for self-reflection and inner growth

Apr 1, 2025 19:52 PM
The Spiritual Meaning of Mushrooms in Your Yard

The Spiritual Meaning of Mushrooms in Your Yard

Apr 1, 2025 17:53 PM
Embracing life's pleasures while being mindful: horoscope for April

Embracing life's pleasures while being mindful: horoscope for April

Apr 1, 2025 17:42 PM
Three Zodiac Signs Facing Tests of Patience

Three Zodiac Signs Facing Tests of Patience

Apr 1, 2025 16:17 PM
Exploring new career paths and seek fresh opportunities: horoscope for April

Exploring new career paths and seek fresh opportunities: horoscope for April

Apr 1, 2025 14:29 PM
Three zodiac signs are set for transformative growth and fulfillment

Three zodiac signs are set for transformative growth and fulfillment

Apr 1, 2025 12:21 PM

The emotional highs and lows may happen more frequently: horoscope for April

Apr 1, 2025 11:18 AM

Three zodiac signs will find themselves imbued with a sense of adventure: horoscope for April 1

Apr 1, 2025 10:34 AM
 The Rotten Egg Smell in Your Home: A Spiritual Meaning

The Rotten Egg Smell in Your Home: A Spiritual Meaning

Apr 1, 2025 10:13 AM
Familial Conflicts Ahead for Three Zodiac Signs

Familial Conflicts Ahead for Three Zodiac Signs

Apr 1, 2025 09:51 AM
Three zodiac signs will experience a surge in humor: horoscope for April 1

Three zodiac signs will experience a surge in humor: horoscope for April 1

Apr 1, 2025 09:08 AM
Three zodiac signs are encouraged to tap into their visionary thinking: horoscope for April 1

Three zodiac signs are encouraged to tap into their visionary thinking: horoscope for April 1

Apr 1, 2025 08:26 AM

The Sacred Posture: The Spiritual Power of Kneeling Across Faiths

Apr 1, 2025 08:03 AM

Three zodiac signs will experience a surge of energy: horoscope for April 1

Apr 1, 2025 07:43 AM
What Does a Jackal Symbolize in Your Dream?

What Does a Jackal Symbolize in Your Dream?

Apr 1, 2025 07:22 AM
A sense of contentment and happiness: horoscope for April

A sense of contentment and happiness: horoscope for April

Apr 1, 2025 07:03 AM
Three zodiac signs can expect promising career developments

Three zodiac signs can expect promising career developments

Mar 31, 2025 21:37 PM
What does a Cobra mean in your dream?

What does a Cobra mean in your dream?

Mar 31, 2025 20:54 PM
Three zodiac signs are poised to embark on a transformative journey

Three zodiac signs are poised to embark on a transformative journey

Mar 31, 2025 20:33 PM

Helen Mirren Critiques James Bond Films for ‘Profound Sexism’

Mar 31, 2025 20:15 PM

Three zodiac signs should be ready for a life-altering surge in luck and success at the beginning of 2026

Mar 31, 2025 20:15 PM
 Kanye West States He Never Wanted Children with Kim Kardashian

Kanye West States He Never Wanted Children with Kim Kardashian

Mar 31, 2025 19:25 PM
Three zodiac signs expected to embrace spontaneity without fear: horoscope for March 31

Three zodiac signs expected to embrace spontaneity without fear: horoscope for March 31

Mar 31, 2025 19:08 PM