Step 1

复现 YIN 算法
复现 CREPE

Step 2

渐进目标实现:

  1. 安静环境下(录音下), 单音识别
  2. 人声环境下(谐波干扰下), 单音识别
  3. 安静环境下, 和弦识别
  4. 音频流实时检测, 曲谱对比

相关项目

https://github.com/ZeroWeight/Signals-System
https://github.com/danielshu7/multi-pitch-detection
https://github.com/Seanitzel/Pitch-Class-Detection-using-ML
https://github.com/IvyZX/music-instrument-classifier
https://github.com/magenta/magenta/tree/main/magenta/models/onsets_frames_transcription/realtime

基础相关知识+经典论文

https://zhuanlan.zhihu.com/p/269107205
https://store.objccn.io/issue-24-1/
https://jackschaedler.github.io/circles-sines-signals/index.html
A_Smarter_Way_to_Find_Pitch.pdf
http://audition.ens.fr/adc/pdf/2002_JASA_YIN.pdf
https://www.cs.tut.fi/sgn/arg/klap/phd/klap_phd.pdf
https://www.katjaas.nl/helmholtz/helmholtz.html
https://github.com/patriceguyot/Yin
https://arxiv.org/abs/1802.06182
https://arxiv.org/pdf/2010.07061
https://arxiv.org/abs/2203.09893
https://github.com/spotify/basic-pitch
https://github.com/bytedance/GiantMIDI-Piano