![Valerio Velardo - The Sound of AI](/img/default-banner.jpg)
- Видео 206
- Просмотров 3 396 987
Valerio Velardo - The Sound of AI
Испания
Добавлен 16 дек 2019
The intersection of AI + leadership + music.
If you're interested in becoming an AI leader, check out The AI Leader's Blueprint the-sound-of-ai-academy.teachable.com/p/the-ai-leader-s-blueprint
If you're interested in my music AI services, please check out thesoundofai.com/consulting.html
Hope you stick around!
If you're interested in becoming an AI leader, check out The AI Leader's Blueprint the-sound-of-ai-academy.teachable.com/p/the-ai-leader-s-blueprint
If you're interested in my music AI services, please check out thesoundofai.com/consulting.html
Hope you stick around!
5 Open Source Generative Music Models You Can't Miss
I introduce 5 open source generative music AI models. They are both in the symbolic and audio space. You can use them to streamline the development of your AI music systems.
Interested in music AI consulting?
thesoundofai.com/consulting.html
Interested in music AI recruitment?
thesoundofai.com/recruitment.html
======================================
MusicGen
Website: ai.honu.io/papers/musicgen/
Github: github.com/facebookresearch/audiocraft/blob/main/docs/MUSICGEN.md
MuseCoco
Website: ai-muzic.github.io/musecoco/
Github: github.com/microsoft/muzic/tree/main/musecoco
Museformer
Website: ai-muzic.github.io/museformer/
Github: github.com/microsoft/muzic/tree/main/museformer
RAVE
Github: github.com/acids-irca...
Interested in music AI consulting?
thesoundofai.com/consulting.html
Interested in music AI recruitment?
thesoundofai.com/recruitment.html
======================================
MusicGen
Website: ai.honu.io/papers/musicgen/
Github: github.com/facebookresearch/audiocraft/blob/main/docs/MUSICGEN.md
MuseCoco
Website: ai-muzic.github.io/musecoco/
Github: github.com/microsoft/muzic/tree/main/musecoco
Museformer
Website: ai-muzic.github.io/museformer/
Github: github.com/microsoft/muzic/tree/main/museformer
RAVE
Github: github.com/acids-irca...
Просмотров: 3 952
Видео
I Created An A.I. To ROAST Pop Songs
Просмотров 1,8 тыс.5 месяцев назад
I implemented an AI music critic. It turned out to be more funny than I expected. Interested in music AI advisorship? thesoundofai.com/consulting.html Interested in music AI recruitment? thesoundofai.com/recruitment.html Code of the AI music critic on GitHub: github.com/musikalkemist/ai-music-critic Check The AI Leader's Blueprint website: the-sound-of-ai-academy.teachable.com/p/the-ai-leader-s...
3 Steps To SUCCEED At Any AI Project
Просмотров 1 тыс.5 месяцев назад
80% of AI projects fail. Learn how to maximise your success using a proven AI project lifecycle, that emphasizes customer discovery, strategic planning, and iterative development. Check The AI Leader's Blueprint website: the-sound-of-ai-academy.teachable.com/p/the-ai-leader-s-blueprint Interested in music AI advisorship? thesoundofai.com/consulting.html Interested in music AI recruitment? theso...
OpenAI Sora: Full Breakdown
Просмотров 4,3 тыс.5 месяцев назад
OpenAI released Sora, a state-of-the-art text-to-video deep learning model. In this video, I provide a complete breakdown of Sora. You can learn what Sora can do, how it works, its limitations, its emergent properties, its impact, and the safety threats it brings. Check The AI Leader's Blueprint website: the-sound-of-ai-academy.teachable.com/p/the-ai-leader-s-blueprint Interested in music AI co...
My new course. It's awesome!
Просмотров 4,3 тыс.6 месяцев назад
"The AI Leader's Blueprint" is a 3-day crash course on Zoom that helps you become an AI leader. Check The AI Leader's Blueprint website: the-sound-of-ai-academy.teachable.com/p/the-ai-leader-s-blueprint Interested in music AI consulting? thesoundofai.com/consulting.html Interested in music AI recruitment? thesoundofai.com/recruitment.html Become a Python ninja with my Advanced Python Programmin...
22. Text-To-Music Generation with Mustango - Generative Music AI
Просмотров 2,6 тыс.7 месяцев назад
Learn about text-to-music generation with Mustango. Get the lecture slides: github.com/musikalkemist/generativemusicaicourse/blob/main/22. Text-to-music generation with Mustango/Slides/22. Text-to-music generation with Mustango.pdf Iran's RUclips channel: www.youtube.com/@iran-r-roman/videos Website of the Generative Music AI Workshop in Barcelona: www.upf.edu/web/mtg/generative-music-ai-worksh...
21. Piano Generation with Compose and Embellish - Generative Music AI
Просмотров 1,5 тыс.7 месяцев назад
Learn about Composer & Embellish, a transformer model that generates expressive piano performances. We show the architecture of the model from a bird's eye-view first. Then, we teach you how you can create music with the pre-trained model in a notebook. Get code: github.com/musikalkemist/generativemusicaicourse/blob/main/21. Piano generation with Compose and Embellish/Code/Compose_and_Embelish....
20. Audio generation with RAVE - Generative Music AI
Просмотров 2,3 тыс.7 месяцев назад
Learn how to perform audio synthesis with the RAVE model (Realtime Audio Variational Autoencoder). We cover the architecture of this variational autoencoder. We also provide a practical session in a Jupyter notebook, where you can quickly generate sounds with RAVE. Get code: github.com/musikalkemist/generativemusicaicourse/blob/main/20. Audio generation with RAVE/Code/RAVE_demo.ipynb Get the le...
19. Melody generation with transformers - Generative Music AI
Просмотров 3,5 тыс.7 месяцев назад
Learn how to implement a transformer architecture in TensorFlow to generate melodies end to end. You’ll learn about melody encoding, dataset preprocessing, model building, training, and inference. Get code: github.com/musikalkemist/generativemusicaicourse/tree/main/19. Melody generation with transformers/Code Get the lecture slides: github.com/musikalkemist/generativemusicaicourse/blob/main/19....
18. Transformers Explained Easily: Part 2 - Generative Music AI
Просмотров 2,4 тыс.7 месяцев назад
Learn about the intuition, theory, and mathematics of the transformer. I focus on the decoder component. I dive deep into masked multi-head attention and all the other sublayers. Learn how to use transformers for music generation. I share tips and tricks from the trenches. I focus on the importance of music representation and music data for generation. I also offer insights into future research...
17. Transformers Explained Easily: Part 1 - Generative Music AI
Просмотров 4,3 тыс.7 месяцев назад
Learn the intuition, theory, and mathematical formalization of transformer architectures, Transformers are widely used in Deep Learning. They now dominate Natural Language Processing, computer vision, and are extensively used in audio and music processing. Get the lecture slides: github.com/musikalkemist/generativemusicaicourse/blob/main/17. Transformers - Part 1/Slides/17. Transformers - Part ...
16. Melody Harmonization with Genetic Algorithms - Generative Music AI Course
Просмотров 1,5 тыс.8 месяцев назад
Learn how to implement a genetic algorithm in Python that generates melody harmonizations automatically. Get code: github.com/musikalkemist/generativemusicaicourse/blob/main/16. Melody harmonization with genetic algorithms/Code/geneticmelodyharmonizer.py Get the lecture slides: github.com/musikalkemist/generativemusicaicourse/blob/main/16. Melody harmonization with genetic algorithms/Slides/16....
15. Genetic Algorithms - Generative Music AI Course
Просмотров 1,5 тыс.8 месяцев назад
Learn about Genetic Algorithms, and how they are used for music generation. Get the lecture slides: github.com/musikalkemist/generativemusicaicourse/blob/main/15. Genetic algorithms/Slides/15. Genetic algorithms.pdf Website of the Generative Music AI Workshop in Barcelona: www.upf.edu/web/mtg/generative-music-ai-workshop Sign up to The Sound of AI Slack Community to join the discussion: valerio...
14. Drum Generation with Cellular Automata - Generative Music AI Course
Просмотров 1,3 тыс.8 месяцев назад
Learn how to implement a cellular automaton that generates drum patterns in Python. Get code: github.com/musikalkemist/generativemusicaicourse/blob/main/14. Drum generation with cellular automata/Code/cellularautomaton.py Get the lecture slides: github.com/musikalkemist/generativemusicaicourse/blob/main/14. Drum generation with cellular automata/Slides/14. Drum generation with cellular automata...
13. Cellular Automata - Generative Music AI Course
Просмотров 1,3 тыс.8 месяцев назад
Learn how to use Cellular Automata to generate music, melodies, chords, and more. Get the lecture slides: github.com/musikalkemist/generativemusicaicourse/blob/main/13. Cellular automata/Slides/13. Cellular automata.pdf Website of the Generative Music AI Workshop in Barcelona: www.upf.edu/web/mtg/generative-music-ai-workshop Sign up to The Sound of AI Slack Community to join the discussion: val...
12. Melody Generation with Markov Chains - Generative Music AI
Просмотров 2 тыс.8 месяцев назад
12. Melody Generation with Markov Chains - Generative Music AI
11. Markov Chains - Generative Music AI Course
Просмотров 2 тыс.8 месяцев назад
11. Markov Chains - Generative Music AI Course
10. Chord Generation with Generative Grammars - Generative Music AI
Просмотров 2 тыс.8 месяцев назад
10. Chord Generation with Generative Grammars - Generative Music AI
9. Generative Grammars for Music Generation - Generative Music AI Course
Просмотров 2 тыс.8 месяцев назад
9. Generative Grammars for Music Generation - Generative Music AI Course
8. Limitations and Future Vision - Generative Music AI
Просмотров 1,8 тыс.8 месяцев назад
8. Limitations and Future Vision - Generative Music AI
7. Generative Techniques - Generative Music AI
Просмотров 3,2 тыс.8 месяцев назад
7. Generative Techniques - Generative Music AI
6. Symbolic Vs Audio Generation - Generative Music AI
Просмотров 2,8 тыс.8 месяцев назад
6. Symbolic Vs Audio Generation - Generative Music AI
5. Ethical Implications - Generative Music AI
Просмотров 1,9 тыс.8 месяцев назад
5. Ethical Implications - Generative Music AI
4. Use Cases - Generative Music AI
Просмотров 3,1 тыс.8 месяцев назад
4. Use Cases - Generative Music AI
3. History of Generative Music - Generative Music AI
Просмотров 3,4 тыс.8 месяцев назад
3. History of Generative Music - Generative Music AI
2. What's Generative Music? - Generative Music AI
Просмотров 4,9 тыс.8 месяцев назад
2. What's Generative Music? - Generative Music AI
1. Course Overview - Generative Music AI
Просмотров 12 тыс.8 месяцев назад
1. Course Overview - Generative Music AI
Demo Day - The Sound of AI Accelerator v1
Просмотров 3,6 тыс.Год назад
Demo Day - The Sound of AI Accelerator v1
GPT-4: The Good, the Bad and the Ugly [Paper Breakdown]
Просмотров 2 тыс.Год назад
GPT-4: The Good, the Bad and the Ugly [Paper Breakdown]
Absolutely no words to describe...........amazing❤
for future peeps if you get an error that says cannot convert x to shape i fixed it with this: return Input(shape = (self.latent_space_dim,), name = 'decoder_input')
amazing content, keep up the good work bro!
By far, this is one of the best series on deep learning. I've watched many videos on deep learning, but the information often felt jumbled in my head. With this series, I was able to link the concepts together, making everything more meaningful. Valerio, you are not only a good engineer but also an excellent tutor, a skill many people lack. I sincerely thank you for your videos.
Thank you so much for this series. I want to know if there is any way I can convert the music files (may be .wav or .mp3) into .krn files? Kindly reply.
Excellent course ! And thank you for teaching !
Hey Valerio, This is just amazing content, i like the depth, the way you explain in so simple terms, you satisfied my curiosity for this whole topic.
Greattt playlist!!
Thanks a lot! This series is fantastic!
I wish there was an Ai that i could upload an instrumental with the tempo and key and it generates the lyrics and voice and melodies to complete the song on top of the instrumental
I can't believe that such a content exists for free! Thanks Mr. Velardo so much.
Fantastic video! It's engaging all the way through and a wonderfully clear explanation of everything.
Citing you in my master's thesis. Thank you for these videos!
Great video. I was confused how the gradient descent function updates the weights for the MLP. As I was coding along, the functionality wasn't correct until I added ```self.weights[i] = weights``` to the bottom of the main loop of the gradient_descent function. How did your version work without this line? Is there something about python memory I am not realizing here?
Thank you so much for this valuable tutorial!
you should have a million subscription man, you deserve it among the all these trashes/
Thank you for the kind words!
thank you very much, this video was very useful
Velario, I'm mid writing my PhD thesis on music generation and this video is incredibly useful for ensuring my explanations make sense and is a great source to cite. Thanks for making it! Also at 1:00:38, why is your dimension model 2 for the cos(pos/10000^2i / dimension model) examples? Just want to make sure if I'm misunderstanding something :) Thanks again!
but the model has seen the data (the example you gave it for inference was itself used for training) is that normal ?!
Hi , any AI generative tools or software suggestion that help just arrangement on the song, assume that already have the melody midi or wave file.. ???? the arrangment may be add back the drum pattern or chord match , intro, bridge fill in, and so on. ??? thanks!1
Check out the Anticipatory Music Transformer for pitch-based accompaniment. Check out Drumify from the the Google Magenta Suite for drum accompaniment.
thanks @@ValerioVelardoTheSoundofAI
I notice in the librosa docs they don't square the magnitude but then use amplitude to db, does anyone know if this make any difference to the final results? Guess I'll have to try to understand everything properly later! Great video!
It was in th description.................... LintIDE vs Jupyter Notebooks(pycharm) 2:43 Produce Claen Code 3:35 Lint your code(pylint) 3:57 Test, test, test! (pytest) 6:41 Track experiments (ml flow),model regsiter 8:06 Version data (DVC) 9:13 Use a pipeline(DVC) 11:01 Takeaways
Thank you
Bro outraged everyone with light theme on
i believe you need to use python 3.10 to get that version 2.13 of tensorflow, otherwise the karas text preprocessor is deprecated.
So is this correct?: We could use RAVE to encode a wav into a Z. Then, train a transformer with a bunch of Z's, and finally use a dataset of Z's to generate a new wav?
Excellent video. Thank you for the explanation. I do have a concern about your sine wave formula, and maybe somebody has already mentioned this, or maybe you talked about it and I missed it. If you want phi to be equal to the phase shift in your sine function, the horizontal scale factor (2pi•f) must be shown as a coefficient on the binomial (t - phi), as horizontal dilation is done before horizontal translation (otherwise the dilation changes the translation), and when shown in with the variable, must be written in the opposite order (last transformation closest to the variable). The way you have represented your sine function in this problem, the true phase shift would be phi/(2pi•f). Contrary to most physics texts, I find it more straightforward mathematically to let phi represent the true phase shift and show the argument of the sine function as 2pi•f(t - phi). Some physics texts and math texts do this, but not many. Having taught college algebra many times, I think this format is more consistent with the logic of transformations of parent functions, and therefore more conducive to a deeper understanding of the geometry of the sine wave. But, to each their own, I suppose.
Thank you!! Very helpful & clear!
It appears the process of training is skimmed over. Is there another video/series that can help me learn how to train the transformer. Do I need to watch the other series from 4 years ago to learn this? "Deep Learning (for Audio) with Python"
In the next videos in this series, I implement and train a simple transformer model.
Excellent workshop. Question? I'm producing a Hip-hop track and am looking for a generative music system that can write a classical string arrangement for the song. Any suggestions?
Ciao Valerio, ho una domanda. Se ho già acquisito un suono, campionato a una certa frequenza fs e avendo acquisito un certo numero di punti N, come funziona il time stretching ?
Are the spikes in the ZCR for voice occuring when two people are speaking at the same time?
I thought you glossed over vibrato a bit too quickly, perhaps it'll be expanded upon in later videos (phase function design). really good explanations other than that. I answered my immediate question by looking at this: ruclips.net/video/UcLTYwfDeaU/видео.html
Hello! Thanks a lot for the videos, it helped me a lot to do my undergradute thesis c:
Generative Music aside these are excellent videos for learning Python.
Thanks!
This would have helped me in my last role
The real strength of an audio model is its ability to be fine-tuned to hone down on the sound you want. I've been trying to fine-tune musicgen and trying to work with Dora and Hydra has been ridiculous. Have you tried fine-tuning the others on this list to see if they're easier?
Shoutout Leanhard Euler
❤❤❤
in waiting for part 3 of the course!! thanks!!
even though 2 years have passed I wanted to thank you. this video helped me lots!
thanks a lot, great work
i probably can say that this video is the best on whole RUclips about this topic, i searched really a lot and all i found was very superficial courses. Great job.
Thank you :)
Thanks Valerio
I was trying to understand the aspects related to perceptual attributes of sound when i found your videos. I should say that you are a true teacher and good communicator. I have tried many videos but yours is the best. I am able to understand the basics of sound now.
These video are helping me so much in understanding Audio Processing! Thank you so much! This has so so much value to me.
24:49 or you could use a higher order markov chain and decide how far back you want to track the previous states. Great presentation!
Thankyou so much for this very well explained series, loved following along to every bit of it! Hoping to use all the knowledge for my personal projects :))
How do you get the users token in the new Spotify for developers i cant find it
You teach so well. I have a question. I’m going to detect phonological feathers of African American English from some interviews, and I want to make the detection process automated. What do you recommend?