Face-to-Music Translation
CVPR Sight and Sound Workshop, 2021
Chelhwon Kim
Computer Vision Researcher
I am a computer vision researcher with 10 years of industry R&D experience at the intersection of 3D geometric vision, generative modeling, and applied perception for human-centered systems — spanning reconstruction and localization, digital human / 3DCG synthesis, and AR / spatial computing. I received my Ph.D. in Electrical Engineering from the University of California, Santa Cruz in 2016, advised by Professor Roberto Manduchi in the Computer Vision Lab.
Selected Projects
Toward Long Distance Hand-Document Telepresence
ACM ISS 2019 · Poster
Indoor Manhattan Spatial Layout Recovery from Monocular Videos via Line Matching
Computer Vision and Image Understanding (CVIU), 2017
Visual Saliency in Noisy Images
Journal of Vision, 2013
Dependable Statistical Fusion for 3D Object Recognition and Pose Estimation
Intelligent Systems Research Center, Sungkyunkwan University · 2009 – 2010
Publications
2021
- Face-to-Music Translation. C. Kim, A. Port, M. Patel. CVPR Sight and Sound Workshop, 2021.
2020
- Face-to-Music Translation Using a Distance-Preserving Generative Adversarial Network with an Auxiliary Discriminator. C. Kim, A. Port, M. Patel. arXiv:2006.13469.
- Earballs: Neural Transmodal Translation. A. Port, C. Kim, M. Patel. arXiv:2005.13291.
- Combining Deep Learning with Geometric Features for Image based Localization in the Gastrointestinal Tract. J. Song, M. Patel, A. Girgensohn, C. Kim. arXiv:2005.05481.
2019
- A Web-Based Remote Assistance System with Gravity-Aware 3D Hand Gesture Visualization. C. Kim, P. Chiu, Y. Tjahjadi. ACM ISS (Demo).
- Toward Long Distance Hand-Document Telepresence. C. Kim, P. Chiu, J. de la Pena, L. Denoue, J. Shingu, Y. Tjahjadi. ACM ISS (Poster).
- InFo: Indoor Localization using Fusion of Visual Information from Static and Dynamic Cameras. C. Kim, C. Bhatt, M. Patel, D. Kimber, Y. Tjahjadi. IPIN.
- CamaLeon: Smart Camera for Conferencing in the Wild. L. Denoue, S. Carter, C. Kim. ACM Multimedia (Demo).
2018
- Recognizing Gestures on Projected Button Widgets with an RGB-D Camera Using a CNN. P. Chiu, C. Kim, H. Oda. ACM ISS.
2017
- Capturing Handwritten Ink Strokes with a Fast Video Camera. C. Kim, P. Chiu, H. Oda. ICDAR.
- Lift: Using Projected Coded Light for Finger Tracking and Device Augmentation. S. Ma, Q. Liu, C. Kim, P. Sheu. PerCom.
2016
- Indoor Manhattan Spatial Layout Recovery from Monocular Videos via Line Matching. C. Kim, R. Manduchi. Computer Vision and Image Understanding (CVIU).
2015
- Evolution of a Tabletop Telepresence System through Art and Technology. T. Dunnigan, J. Doherty, D. Avrahami, J. Biehl, P. Chiu, C. Kim, Q. Liu, H. Tang, L. Wilcox. ACM Multimedia.
- High-Quality Capture of Documents on a Cluttered Tabletop with a 4K Video Camera. C. Kim, P. Chiu, H. Tang. ACM DocEng.
2014
- Planar Structures from Line Correspondences in a Manhattan World. C. Kim, R. Manduchi. ACCV.
2013
- Dewarping Book Page Spreads Captured with a Mobile Phone Camera. C. Kim, P. Chiu, S. Chandra. CBDAR.
- Visual Saliency in Noisy Images. C. Kim, P. Milanfar. Journal of Vision 13(4):5.
2012
- Finding Saliency in Noisy Images. C. Kim, P. Milanfar. SPIE Computational Imaging (8269).
2008 and earlier
- Using Structured Light for Efficient Depth Edge Detection. J. Y. Park, C. Kim, J. K. Na, J. H. Yi, M. Turk. Image and Vision Computing 26(11), 2008.
- Efficient Depth Edge Detection using Structured Light. J. Y. Park, C. Kim, J. H. Yi, M. Turk. LNCS 2869, 2005.
- Structured Light based Depth Edge Detection for Object Shape Recovery. C. Kim, J. Y. Park, J. H. Yi, M. Turk. IEEE CVPR Workshop on Projector-Camera Systems, 2005.
- A 2D Plane of RGB Color Space for Color Histogram based Skin Color Segmentation. J. H. Yi, D. Y. Lee, C. Kim. ACCV, 2003.