I’m Yen-Tung (Arthur) Yeh, a first-year Ph.D. student in the Graduate Institute of Communication Engineering at National Taiwan University. I am a member of the Music and AI Lab, advised by Prof. Yi-Hsuan Yang. My research aims to augment musicians’ creativity in music production, particularly in the production workflow. I develop high-fidelity neural audio processing models that address current challenges in music production pipelines.
My research interests include:
- Audio effect modeling
- Audio effect timbre transfer
- Audio effect representation learning
- Automatic mixing and mastering
Previously, I was a research intern at Sony AI under the supervision of Junghyun (Tony) Koo during autumn 2024, where our research focused on audio effect representation learning. I completed a research internship at Positive Grid during spring 2024, focusing on neural amplifier modeling. Additionally, I maintain an ongoing collaboration with the Taipei Music Center, where I work on LLM-based music production understanding alongside my colleague Bo-Yu Chen.
Check my CV here.
🎓 Education
| National Taiwan University Ph.D. in Graduate Institute of Communication Engineering Advisor: Yi-Hsuan Yang | Feb. 2025 - Present |
| National Taiwan University M.S. in Graduate Institute of Communication Engineering Advisor: Yi-Hsuan Yang | Feb. 2024 - Dec. 2024 |
| National Taiwan University B.S. in Computer Science and Information Engineering | Sep. 2017 - Aug. 2022 |
Professional Experience
| Positive Grid Deep Learning Audio Intern Topic: Unified Framework for Guitar Tone Transfer | April. 2025 – Now |
| Sony AI Research intern Advisor: Junghyun (Tony) Koo Topic: Audio Effect Representation Learning | Sep. 2024 – Dec. 2024 |
| Positive Grid Deep Learning Audio Intern Topic: DDSP Guitar Amplifier Modeling | Mar. 2024 – Sep. 2024 |
| Taipei Music Center Research Scientist/Engineering Collaborator Project Leader: Bo-Yu Chen Topic: LLM-based Music Production Understanding | Oct. 2023 – Sep. 2024 |
| National Taiwan University Research Assistant Advisor: Yi-Hsuan Yang Topic: Neural Audio Effect Modeling | Aug. 2023 – Jan. 2024 |
| Research Center for IT Innovation, Academia Sinica Research Assistant Advisor: Yi-Hsuan Yang Topic: Neural Audio Effect Modeling | Aug. 2022 - Mar.2023 |
Honors & Awards
| NSTC Graduate Research Fellowship National Science and Technology Council | 2024-2027 |
| Telecom Industry Excellence Fellowship Graduate Institute of Communication Engineering, National Taiwan University | 2024-2028 |
Publications
Conference Papers
- DDSP Guitar Amp: Interpretable Guitar Amplifier Modeling
Yen-Tung Yeh, Yu-Hua Chen, Yuan-Chiao Cheng, Jui-Te Wu, Jun-Jie Fu, Yi-Fan Yeh, and Yi-Hsuan Yang.
International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2025
Oral Presentation
Audio Effects ModelingDDSPGuitar Tone Modeling - Towards Zero-Shot Amplifier Modeling: One-to-Many Amplifier Modeling via Tone Embedding Control
Yu-Hua Chen, Yen-Tung Yeh, Yuan-Chiao Cheng, Jui-Te Wu, Yu-Hsiang Ho, Jyh-Shing Roger Jang, and Yi-Hsuan Yang.
Proceedings of the 25th International Society for Music Information Retrieval Conference (ISMIR) 2024
Audio Effects ModelingGuitar Tone Transfer - Hyper Recurrent Neural Network: Condition Mechanisms for Black-box Audio Effect Modeling
Yen-Tung Yeh, Wen-Yi Hsiao, and Yi-Hsuan Yang.
27th International Conference on Digital Audio Effects (DAFx) 2024
Oral Presentation
Audio Effects Modeling - Exploiting Pre-Trained Feature Networks for Generative Adversarial Networks in Audio-Domain Loop Generation
Yen-Tung Yeh, Bo-Yu Chen and Yi-Hsuan Yang.
Proceedings of the 23rd International Society for Music Information Retrieval Conference (ISMIR) 2022
Loop Generation - A Benchmarking Initiative for Audio-Domain Music Generation Using the Freesound Loop Dataset
Tun-Min Hung, Bo-Yu Chen, Yen-Tung Yeh, and Yi-Hsuan Yang.
Proceedings of the 22nd International Society for Music Information Retrieval Conference (ISMIR) 2021
Loop Generation
Workshop Papers & Late-Breaking Demos
- AI TrackMate: Finally, Someone Who Will Give Your Music More Than Just ‘Sounds Great!’
Yi-Lin Jiang, Chia-Ho Hsiung, Yen-Tung Yeh, Lu-Rong Chen, Bo-Yu Chen.
NeurIPS Creativity AI Track 2024
LLM Music Production Understanding - PyNeuralFx: A Python Package for Neural Audio Effect Modeling
Yen-Tung Yeh, Wen-Yi Hsiao, and Yi-Hsuan Yang.
ISMIR LBD 2024
Audio Effects ModelingToolkit - Demo of Zero-Shot Guitar Amplifier Modelling: Enhancing Modeling with Hyper Neural Networks
Yu-Hua Chen, Yuan-Chiao Cheng, Yen-Tung Yeh, Jui-Te Wu, Yu-Hsiang Ho, Jyh-Shing Roger Jang, and Yi-Hsuan Yang.
ISMIR LBD 2024
Audio Effects ModelingAudio Plugin
Under Review
- Towards Generalizability to Tone and Content Variations in the Transcription of Amplifier Rendered Electric Guitar Audio
Yu-Hua Chen, Yuan-Chiao Cheng, Yen-Tung Yeh, Jui-Te Wu, Jyh-Shing Roger Jang, Yi-Hsuan Yang.
Under Review
Guitar Transcription