“Tiangong SkyMusic”: The fusion of poetry and music under the wave of AI music

“When will the bright moon come? I’ll ask the blue sky for my wine. I don’t know what year it is in the palace in the sky.”

How many people, when they see these words, will automatically bring the melody into their mind and hum it silently?

When poems are sung into songs, they are not only easier to remember, but also the various artistic conceptions and emotions of the poems can be expressed more vividly through the different melodies and styles of music. In fact, as early as the pre-Qin period, there was a form of artistic expression and cultural inheritance that combined “poetry and music” – “Wind” in the Book of Songs comes from ballads from various places, “Ya” is a formal song of elegant music, and “Song” is a song of Wang Songs and songs for sacrifices in the ancestral temples of court nobles; the creation of Song lyrics and Yuan songs can also be combined with music and lyrics to be sung… And in modern times, there are countless contemporary classic music created by classical poetry.

But for the general public, if they want to create a poem into a song, there will always be a professional threshold limit – whether it is music theory, arrangement or mixing, they are not easy skills to master. And with the emergence of large AI music models, people without professional background can finally explore the joy of “creating music”.

On April 2, Kunlun Wanwei’s “Tiangong SkyMusic”, China’s first and only publicly available large-scale AI music generation model, opened for testing. Its outstanding creative capabilities quickly attracted widespread attention, and it received dozens of responses in a short period of time. Thousands of users applied for testing, triggering a nationwide creative craze.

Among them, composing poems with music has unsurprisingly become one of the most popular directions for users.

Such as the rock version of “Like a Dream”, the classic verses are paired with strong drum rhythms, giving the lingering wine-drenched dream in “Rain and Wind” a more concrete perception, and even vaguely showing the relaxation after an intoxicated sigh. , actually has a different charm, but is it not the adapter’s sincere expression and unique interpretation of the poem’s artistic conception?

Or the rap version of “Farewell Cambridge”, which is different from the well-known affectionateness of the original “Swingers”. It uses a clean and youthful male voice, paired with a more tense rhythm, to express the youthful reluctance in a refreshing way, with affection but without entanglement. , just like the breeze under the sunset in early summer, blowing by suddenly, leaving ripples in the lake of my heart.

Let’s experience Mr. Mu Xin’s alternative “exciting romance”: Compared with the familiar “Once Upon a Time Slow”, this less popular song “Golden Divorce” is combined with the cheerful background sound of the trumpet and the brisk singing of a gentle male voice. In an instant, it became clear that this was the love of “clear divorce”, the love that was coquettish and proud, and the meaningless interest and teasing thoughts of the gentleman when he wrote.

Of course, the great poets Li Bai and Du Fu are the most popular among users – who wouldn’t want to create passionate works for timeless famous poems such as “The Wine Will Come in” and “The Song of Thatched Cottage Broken by the Autumn Wind”, and then happily share and discuss them with friends.

In particular, “Tiangong SkyMusic” is not limited to a specific music style. Whether it is fresh pop tunes, elegant jazz music, or tense rap rhythms, users can use this platform to unleash their imagination and combine their emotions with Understand, create uniquely creative and individual works, and let the poems stand out from the music.

Since “Tiangong SkyMusic” opened for beta testing, it has successfully ignited the enthusiasm of countless music lovers and ordinary users to experience music creation, ushered in the era of national music creation, and also inadvertently explored a new way of transmitting poetry and singing: Use AI technology to adapt ancient poems into musical works of various styles. Some people even believe that AI technology, which combines ancient poetry with music, will play an increasingly important role in poetry education. Because this method not only stimulates children’s interest in exploration, but is also an effective memory method. Especially when learning some long poems, it can greatly relieve their recitation pressure and stimulate their interest and enthusiasm for ancient poems.

On April 17, “Tiangong SkyMusic” will be free and open to the whole society. At that time, every user can participate in experiencing AI music creation and jointly write the future of the era of national music creation. “Tiangong SkyMusic” will also continue to be upgraded and optimized, striving to create an easy-to-use and professional music creation platform for all people, thereby stimulating the consumption vitality of the music market, innovating the fields of music production, education and treatment, and assisting the diversified development of the music industry.

About “Tiangong SkyMusic”

“Tiangong SkyMusic” is built on Kunlun Wanwei’s “Tiangong 3.0” and adopts a Sora-like model architecture in the music audio field. Large-scale Transformer is responsible for composing music to learn the contextual dependencies of Music Patches while achieving music controllability; Diffusion Transformer is responsible for singing, and uses LDM to restore Music Patches into high-quality audio, so that “Tiangong SkyMusic” can support the generation of 80-second 44100Hz sampling rate two-channel stereo songs. This model architecture works extremely well in the fields of video, audio, and music. The Kunlun Wanwei team will also gradually iterate and add new capabilities in the future, so that the model has multi-modal emotional understanding and expression capabilities.

Source link