Valerio Velardo - The Sound of AI
Valerio Velardo - The Sound of AI
  • Видео 206
  • Просмотров 3 396 987
5 Open Source Generative Music Models You Can't Miss
I introduce 5 open source generative music AI models. They are both in the symbolic and audio space. You can use them to streamline the development of your AI music systems.
Interested in music AI consulting?
thesoundofai.com/consulting.html
Interested in music AI recruitment?
thesoundofai.com/recruitment.html
======================================
MusicGen
Website: ai.honu.io/papers/musicgen/
Github: github.com/facebookresearch/audiocraft/blob/main/docs/MUSICGEN.md
MuseCoco
Website: ai-muzic.github.io/musecoco/
Github: github.com/microsoft/muzic/tree/main/musecoco
Museformer
Website: ai-muzic.github.io/museformer/
Github: github.com/microsoft/muzic/tree/main/museformer
RAVE
Github: github.com/acids-irca...
Просмотров: 3 952

Видео

I Created An A.I. To ROAST Pop Songs
Просмотров 1,8 тыс.5 месяцев назад
I implemented an AI music critic. It turned out to be more funny than I expected. Interested in music AI advisorship? thesoundofai.com/consulting.html Interested in music AI recruitment? thesoundofai.com/recruitment.html Code of the AI music critic on GitHub: github.com/musikalkemist/ai-music-critic Check The AI Leader's Blueprint website: the-sound-of-ai-academy.teachable.com/p/the-ai-leader-s...
3 Steps To SUCCEED At Any AI Project
Просмотров 1 тыс.5 месяцев назад
80% of AI projects fail. Learn how to maximise your success using a proven AI project lifecycle, that emphasizes customer discovery, strategic planning, and iterative development. Check The AI Leader's Blueprint website: the-sound-of-ai-academy.teachable.com/p/the-ai-leader-s-blueprint Interested in music AI advisorship? thesoundofai.com/consulting.html Interested in music AI recruitment? theso...
OpenAI Sora: Full Breakdown
Просмотров 4,3 тыс.5 месяцев назад
OpenAI released Sora, a state-of-the-art text-to-video deep learning model. In this video, I provide a complete breakdown of Sora. You can learn what Sora can do, how it works, its limitations, its emergent properties, its impact, and the safety threats it brings. Check The AI Leader's Blueprint website: the-sound-of-ai-academy.teachable.com/p/the-ai-leader-s-blueprint Interested in music AI co...
My new course. It's awesome!
Просмотров 4,3 тыс.6 месяцев назад
"The AI Leader's Blueprint" is a 3-day crash course on Zoom that helps you become an AI leader. Check The AI Leader's Blueprint website: the-sound-of-ai-academy.teachable.com/p/the-ai-leader-s-blueprint Interested in music AI consulting? thesoundofai.com/consulting.html Interested in music AI recruitment? thesoundofai.com/recruitment.html Become a Python ninja with my Advanced Python Programmin...
22. Text-To-Music Generation with Mustango - Generative Music AI
Просмотров 2,6 тыс.7 месяцев назад
Learn about text-to-music generation with Mustango. Get the lecture slides: github.com/musikalkemist/generativemusicaicourse/blob/main/22. Text-to-music generation with Mustango/Slides/22. Text-to-music generation with Mustango.pdf Iran's RUclips channel: www.youtube.com/@iran-r-roman/videos Website of the Generative Music AI Workshop in Barcelona: www.upf.edu/web/mtg/generative-music-ai-worksh...
21. Piano Generation with Compose and Embellish - Generative Music AI
Просмотров 1,5 тыс.7 месяцев назад
Learn about Composer & Embellish, a transformer model that generates expressive piano performances. We show the architecture of the model from a bird's eye-view first. Then, we teach you how you can create music with the pre-trained model in a notebook. Get code: github.com/musikalkemist/generativemusicaicourse/blob/main/21. Piano generation with Compose and Embellish/Code/Compose_and_Embelish....
20. Audio generation with RAVE - Generative Music AI
Просмотров 2,3 тыс.7 месяцев назад
Learn how to perform audio synthesis with the RAVE model (Realtime Audio Variational Autoencoder). We cover the architecture of this variational autoencoder. We also provide a practical session in a Jupyter notebook, where you can quickly generate sounds with RAVE. Get code: github.com/musikalkemist/generativemusicaicourse/blob/main/20. Audio generation with RAVE/Code/RAVE_demo.ipynb Get the le...
19. Melody generation with transformers - Generative Music AI
Просмотров 3,5 тыс.7 месяцев назад
Learn how to implement a transformer architecture in TensorFlow to generate melodies end to end. You’ll learn about melody encoding, dataset preprocessing, model building, training, and inference. Get code: github.com/musikalkemist/generativemusicaicourse/tree/main/19. Melody generation with transformers/Code Get the lecture slides: github.com/musikalkemist/generativemusicaicourse/blob/main/19....
18. Transformers Explained Easily: Part 2 - Generative Music AI
Просмотров 2,4 тыс.7 месяцев назад
Learn about the intuition, theory, and mathematics of the transformer. I focus on the decoder component. I dive deep into masked multi-head attention and all the other sublayers. Learn how to use transformers for music generation. I share tips and tricks from the trenches. I focus on the importance of music representation and music data for generation. I also offer insights into future research...
17. Transformers Explained Easily: Part 1 - Generative Music AI
Просмотров 4,3 тыс.7 месяцев назад
Learn the intuition, theory, and mathematical formalization of transformer architectures, Transformers are widely used in Deep Learning. They now dominate Natural Language Processing, computer vision, and are extensively used in audio and music processing. Get the lecture slides: github.com/musikalkemist/generativemusicaicourse/blob/main/17. Transformers - Part 1/Slides/17. Transformers - Part ...
16. Melody Harmonization with Genetic Algorithms - Generative Music AI Course
Просмотров 1,5 тыс.8 месяцев назад
Learn how to implement a genetic algorithm in Python that generates melody harmonizations automatically. Get code: github.com/musikalkemist/generativemusicaicourse/blob/main/16. Melody harmonization with genetic algorithms/Code/geneticmelodyharmonizer.py Get the lecture slides: github.com/musikalkemist/generativemusicaicourse/blob/main/16. Melody harmonization with genetic algorithms/Slides/16....
15. Genetic Algorithms - Generative Music AI Course
Просмотров 1,5 тыс.8 месяцев назад
Learn about Genetic Algorithms, and how they are used for music generation. Get the lecture slides: github.com/musikalkemist/generativemusicaicourse/blob/main/15. Genetic algorithms/Slides/15. Genetic algorithms.pdf Website of the Generative Music AI Workshop in Barcelona: www.upf.edu/web/mtg/generative-music-ai-workshop Sign up to The Sound of AI Slack Community to join the discussion: valerio...
14. Drum Generation with Cellular Automata - Generative Music AI Course
Просмотров 1,3 тыс.8 месяцев назад
Learn how to implement a cellular automaton that generates drum patterns in Python. Get code: github.com/musikalkemist/generativemusicaicourse/blob/main/14. Drum generation with cellular automata/Code/cellularautomaton.py Get the lecture slides: github.com/musikalkemist/generativemusicaicourse/blob/main/14. Drum generation with cellular automata/Slides/14. Drum generation with cellular automata...
13. Cellular Automata - Generative Music AI Course
Просмотров 1,3 тыс.8 месяцев назад
Learn how to use Cellular Automata to generate music, melodies, chords, and more. Get the lecture slides: github.com/musikalkemist/generativemusicaicourse/blob/main/13. Cellular automata/Slides/13. Cellular automata.pdf Website of the Generative Music AI Workshop in Barcelona: www.upf.edu/web/mtg/generative-music-ai-workshop Sign up to The Sound of AI Slack Community to join the discussion: val...
12. Melody Generation with Markov Chains - Generative Music AI
Просмотров 2 тыс.8 месяцев назад
12. Melody Generation with Markov Chains - Generative Music AI
11. Markov Chains - Generative Music AI Course
Просмотров 2 тыс.8 месяцев назад
11. Markov Chains - Generative Music AI Course
10. Chord Generation with Generative Grammars - Generative Music AI
Просмотров 2 тыс.8 месяцев назад
10. Chord Generation with Generative Grammars - Generative Music AI
9. Generative Grammars for Music Generation - Generative Music AI Course
Просмотров 2 тыс.8 месяцев назад
9. Generative Grammars for Music Generation - Generative Music AI Course
8. Limitations and Future Vision - Generative Music AI
Просмотров 1,8 тыс.8 месяцев назад
8. Limitations and Future Vision - Generative Music AI
7. Generative Techniques - Generative Music AI
Просмотров 3,2 тыс.8 месяцев назад
7. Generative Techniques - Generative Music AI
6. Symbolic Vs Audio Generation - Generative Music AI
Просмотров 2,8 тыс.8 месяцев назад
6. Symbolic Vs Audio Generation - Generative Music AI
5. Ethical Implications - Generative Music AI
Просмотров 1,9 тыс.8 месяцев назад
5. Ethical Implications - Generative Music AI
4. Use Cases - Generative Music AI
Просмотров 3,1 тыс.8 месяцев назад
4. Use Cases - Generative Music AI
3. History of Generative Music - Generative Music AI
Просмотров 3,4 тыс.8 месяцев назад
3. History of Generative Music - Generative Music AI
2. What's Generative Music? - Generative Music AI
Просмотров 4,9 тыс.8 месяцев назад
2. What's Generative Music? - Generative Music AI
1. Course Overview - Generative Music AI
Просмотров 12 тыс.8 месяцев назад
1. Course Overview - Generative Music AI
Demo Day - The Sound of AI Accelerator v1
Просмотров 3,6 тыс.Год назад
Demo Day - The Sound of AI Accelerator v1
GPT-4: The Good, the Bad and the Ugly [Paper Breakdown]
Просмотров 2 тыс.Год назад
GPT-4: The Good, the Bad and the Ugly [Paper Breakdown]
I Launch My Biggest Project.
Просмотров 5 тыс.Год назад
I Launch My Biggest Project.

Комментарии

  • @prof.ravindravyas3035
    @prof.ravindravyas3035 12 часов назад

    Absolutely no words to describe...........amazing❤

  • @apexlex1634
    @apexlex1634 21 час назад

    for future peeps if you get an error that says cannot convert x to shape i fixed it with this: return Input(shape = (self.latent_space_dim,), name = 'decoder_input')

  • @3bnuri
    @3bnuri День назад

    amazing content, keep up the good work bro!

  • @selahattinyardmc1340
    @selahattinyardmc1340 2 дня назад

    By far, this is one of the best series on deep learning. I've watched many videos on deep learning, but the information often felt jumbled in my head. With this series, I was able to link the concepts together, making everything more meaningful. Valerio, you are not only a good engineer but also an excellent tutor, a skill many people lack. I sincerely thank you for your videos.

  • @omkarbarve99
    @omkarbarve99 3 дня назад

    Thank you so much for this series. I want to know if there is any way I can convert the music files (may be .wav or .mp3) into .krn files? Kindly reply.

  • @OwoeyeChristian
    @OwoeyeChristian 4 дня назад

    Excellent course ! And thank you for teaching !

  • @mudassirkhan9054
    @mudassirkhan9054 5 дней назад

    Hey Valerio, This is just amazing content, i like the depth, the way you explain in so simple terms, you satisfied my curiosity for this whole topic.

  • @AbdelatifMariche
    @AbdelatifMariche 5 дней назад

    Greattt playlist!!

  • @ZhaokunJiang
    @ZhaokunJiang 5 дней назад

    Thanks a lot! This series is fantastic!

  • @nextaimillionaire
    @nextaimillionaire 5 дней назад

    I wish there was an Ai that i could upload an instrumental with the tempo and key and it generates the lyrics and voice and melodies to complete the song on top of the instrumental

  • @omarkhaled4686
    @omarkhaled4686 6 дней назад

    I can't believe that such a content exists for free! Thanks Mr. Velardo so much.

  • @janavanrooyen3798
    @janavanrooyen3798 7 дней назад

    Fantastic video! It's engaging all the way through and a wonderfully clear explanation of everything.

  • @MathStatsMe
    @MathStatsMe 9 дней назад

    Citing you in my master's thesis. Thank you for these videos!

  • @joshuahellauer2400
    @joshuahellauer2400 9 дней назад

    Great video. I was confused how the gradient descent function updates the weights for the MLP. As I was coding along, the functionality wasn't correct until I added ```self.weights[i] = weights``` to the bottom of the main loop of the gradient_descent function. How did your version work without this line? Is there something about python memory I am not realizing here?

  • @blackrose4493
    @blackrose4493 10 дней назад

    Thank you so much for this valuable tutorial!

  • @Ilya_4276
    @Ilya_4276 11 дней назад

    you should have a million subscription man, you deserve it among the all these trashes/

  • @vettofnbr
    @vettofnbr 12 дней назад

    thank you very much, this video was very useful

  • @kyleworrall680
    @kyleworrall680 13 дней назад

    Velario, I'm mid writing my PhD thesis on music generation and this video is incredibly useful for ensuring my explanations make sense and is a great source to cite. Thanks for making it! Also at 1:00:38, why is your dimension model 2 for the cos(pos/10000^2i / dimension model) examples? Just want to make sure if I'm misunderstanding something :) Thanks again!

  • @ashrafamad-ds8er
    @ashrafamad-ds8er 13 дней назад

    but the model has seen the data (the example you gave it for inference was itself used for training) is that normal ?!

  • @markktude
    @markktude 15 дней назад

    Hi , any AI generative tools or software suggestion that help just arrangement on the song, assume that already have the melody midi or wave file.. ???? the arrangment may be add back the drum pattern or chord match , intro, bridge fill in, and so on. ??? thanks!1

    • @ValerioVelardoTheSoundofAI
      @ValerioVelardoTheSoundofAI 15 дней назад

      Check out the Anticipatory Music Transformer for pitch-based accompaniment. Check out Drumify from the the Google Magenta Suite for drum accompaniment.

    • @markktude
      @markktude 15 дней назад

      thanks @@ValerioVelardoTheSoundofAI

  • @sharonmcgavin1666
    @sharonmcgavin1666 17 дней назад

    I notice in the librosa docs they don't square the magnitude but then use amplitude to db, does anyone know if this make any difference to the final results? Guess I'll have to try to understand everything properly later! Great video!

  • @Letslearntogetheruzh7
    @Letslearntogetheruzh7 19 дней назад

    It was in th description.................... LintIDE vs Jupyter Notebooks(pycharm) 2:43 Produce Claen Code 3:35 Lint your code(pylint) 3:57 Test, test, test! (pytest) 6:41 Track experiments (ml flow),model regsiter 8:06 Version data (DVC) 9:13 Use a pipeline(DVC) 11:01 Takeaways

  • @CortezLabs
    @CortezLabs 20 дней назад

    Thank you

  • @KiritoPanda
    @KiritoPanda 20 дней назад

    Bro outraged everyone with light theme on

  • @bilzebug
    @bilzebug 22 дня назад

    i believe you need to use python 3.10 to get that version 2.13 of tensorflow, otherwise the karas text preprocessor is deprecated.

  • @bilzebug
    @bilzebug 22 дня назад

    So is this correct?: We could use RAVE to encode a wav into a Z. Then, train a transformer with a bunch of Z's, and finally use a dataset of Z's to generate a new wav?

  • @MathStatsMe
    @MathStatsMe 22 дня назад

    Excellent video. Thank you for the explanation. I do have a concern about your sine wave formula, and maybe somebody has already mentioned this, or maybe you talked about it and I missed it. If you want phi to be equal to the phase shift in your sine function, the horizontal scale factor (2pi•f) must be shown as a coefficient on the binomial (t - phi), as horizontal dilation is done before horizontal translation (otherwise the dilation changes the translation), and when shown in with the variable, must be written in the opposite order (last transformation closest to the variable). The way you have represented your sine function in this problem, the true phase shift would be phi/(2pi•f). Contrary to most physics texts, I find it more straightforward mathematically to let phi represent the true phase shift and show the argument of the sine function as 2pi•f(t - phi). Some physics texts and math texts do this, but not many. Having taught college algebra many times, I think this format is more consistent with the logic of transformations of parent functions, and therefore more conducive to a deeper understanding of the geometry of the sine wave. But, to each their own, I suppose.

  • @tershire
    @tershire 22 дня назад

    Thank you!! Very helpful & clear!

  • @bilzebug
    @bilzebug 22 дня назад

    It appears the process of training is skimmed over. Is there another video/series that can help me learn how to train the transformer. Do I need to watch the other series from 4 years ago to learn this? "Deep Learning (for Audio) with Python"

  • @SeeUnKSH
    @SeeUnKSH 23 дня назад

    Excellent workshop. Question? I'm producing a Hip-hop track and am looking for a generative music system that can write a classical string arrangement for the song. Any suggestions?

  • @dariobasile2699
    @dariobasile2699 24 дня назад

    Ciao Valerio, ho una domanda. Se ho già acquisito un suono, campionato a una certa frequenza fs e avendo acquisito un certo numero di punti N, come funziona il time stretching ?

  • @cshorler
    @cshorler 24 дня назад

    Are the spikes in the ZCR for voice occuring when two people are speaking at the same time?

  • @cshorler
    @cshorler 25 дней назад

    I thought you glossed over vibrato a bit too quickly, perhaps it'll be expanded upon in later videos (phase function design). really good explanations other than that. I answered my immediate question by looking at this: ruclips.net/video/UcLTYwfDeaU/видео.html

  • @supershy-hl3cj
    @supershy-hl3cj 25 дней назад

    Hello! Thanks a lot for the videos, it helped me a lot to do my undergradute thesis c:

  • @bilzebug
    @bilzebug 26 дней назад

    Generative Music aside these are excellent videos for learning Python.

  • @ImGeneralJAckson
    @ImGeneralJAckson 27 дней назад

    This would have helped me in my last role

  • @adamlois5574
    @adamlois5574 27 дней назад

    The real strength of an audio model is its ability to be fine-tuned to hone down on the sound you want. I've been trying to fine-tune musicgen and trying to work with Dora and Hydra has been ridiculous. Have you tried fine-tuning the others on this list to see if they're easier?

  • @aaronlinneman4840
    @aaronlinneman4840 28 дней назад

    Shoutout Leanhard Euler

  • @laithswais7172
    @laithswais7172 29 дней назад

    ❤❤❤

  • @tomastellechea
    @tomastellechea Месяц назад

    in waiting for part 3 of the course!! thanks!!

  • @manamahani5263
    @manamahani5263 Месяц назад

    even though 2 years have passed I wanted to thank you. this video helped me lots!

  • @NikolozKordzakhia
    @NikolozKordzakhia Месяц назад

    thanks a lot, great work

  • @NikolozKordzakhia
    @NikolozKordzakhia Месяц назад

    i probably can say that this video is the best on whole RUclips about this topic, i searched really a lot and all i found was very superficial courses. Great job.

  • @abhishekgupta7719
    @abhishekgupta7719 Месяц назад

    Thanks Valerio

  • @jasminewilson-p7k
    @jasminewilson-p7k Месяц назад

    I was trying to understand the aspects related to perceptual attributes of sound when i found your videos. I should say that you are a true teacher and good communicator. I have tried many videos but yours is the best. I am able to understand the basics of sound now.

  • @EmmiFitz
    @EmmiFitz Месяц назад

    These video are helping me so much in understanding Audio Processing! Thank you so much! This has so so much value to me.

  • @gapixr
    @gapixr Месяц назад

    24:49 or you could use a higher order markov chain and decide how far back you want to track the previous states. Great presentation!

  • @sreemahigangadharan879
    @sreemahigangadharan879 Месяц назад

    Thankyou so much for this very well explained series, loved following along to every bit of it! Hoping to use all the knowledge for my personal projects :))

  • @adolfogilio
    @adolfogilio Месяц назад

    How do you get the users token in the new Spotify for developers i cant find it

  • @hamidmojarrad
    @hamidmojarrad Месяц назад

    You teach so well. I have a question. I’m going to detect phonological feathers of African American English from some interviews, and I want to make the detection process automated. What do you recommend?