Chen Fang

Research Scientist
Adobe Research
Adobe Systems Incorporated

fangchen1988 [at] gmail [dot] com

I received my Ph.D. in Computer Science from Dartmouth College.

Research Interest

Computer Vision: image understanding, image search, image editing, generative models, NLP-related

Machine Learning: deep learning, personalization

News

[2018.07.24] 3 papers accepted to ECCV 2018. Stay tuned for details.

[2018.07.23] 1 paper accepted to BMVC 2018. Stay tuned for details.

[2018.07.22] 1 paper accepted to ACM Transactions on Intelligent Systems and Technology (TIST).

[2018.03.28] 2 papers accepted to CVPR 2018. Stay tuned for details.
[Past News]


[2017.12.09]  Two Minute Papers  featured our NIPS 2017 paper on  Universal Style Transfer .
[2017.11.28]  The Merkle, EurekAlert!,  UCSD CSE Newsletter, FOSSBYTES,  DailyMail,  Hindustan Times,  The Irish News,  BT,  Quartzy,  Gadgets Now,  Newswise,  TechXplore,  Yahoo Finance,  Tech You n Me,  Science Codex and  ScienceDaily featured our ICDM 2017 paper .
[2017.11.16] MIT Tech Review  featured our ICDM 2017 paper  on personalized fashion generation. 
[2017.09.05] 1 paper accepted to NIPS 2017.
[2017.09.05] 1 paper accepted to ICDM 2017. 
[2017.07.16] Our BAM dataset is released! Please try it with your favorioute vision and Learning problems.
[2017.07.16] 2 papers accepted to ICCV 2017.
[2017.07.15] 1 paper accepted to BMVC 2017.
[2017.05.23] 1 paper accepted to RepL4NLP@ACL 2017.
[2017.02.27] 4 papers accepted to CVPR 2017.
[2016.12.21] 1 paper accepted to WWW 2017.
[2016.08.25] 1 paper accepted to ACM MM 2016.
[2016.06.14] 1 paper accepted to RecSys 2016.
[2016.03.01] 1 paper accepted to CVPR 2016, describing an image captioning system that is among the top performers of Microsoft COCO Captioning Challenge since November 2015.
[2015.07.06] I joined Adobe Research as a research scientist.
[2015.03.01] 1 paper accpeted to CVPR 2015.
[2015.02.06] 1 paper accpeted to PAKDD 2015.
[2014.10.06] Thanks to NVIDIA Corporation for a hardware donation to support my research.
[2014.09.12] Automatic image cropping dataset of MM'14 paper is released. 
[2014.08.23] Thanks to Adobe Research for funding my research.
[2014.07.08] 1 paper accepted to ACM Multimedia 2014. 
[2014.04.14] Data of our iccv13 paper is released (deep learning features for some images in Caltech101, ImageNet, SUN09, VOC2007, LabelMe).
[2014.02.21] I will intern to Adobe Research (San Jose, CA) this summer.
[2013.11.21] Received Student Travel Grant for attending ICCV 2013.
[2013.09.24] Received Neukom Travel Grant for attending ICCV 2013 from Neukom Institute.
[2013.09.04] 1 paper accepted in ICCV 2013.
[2013.06.17] Started summer internship at Adobe Research (San Jose, CA).
[2012.10.15] I am working with Prof. Dan Rockmore now.
[2012.06.25] 1 paper accpeted to ECCV 2012.
[2012.09.25] Received Neukom Travel Grant for attending ICCV 2011 from Neukom Institute.
[2011.06.30] 1 paper accpeted to ICCV 2011.

Publications

	Visually Indicated Sound Generation by Perceptually Optimized Classification Kan Chen, Chuanxi Zhang, Chen Fang, Zhaowen Wang, Trung Bui and Ram Nevatia Multimodal Learning and Applications Workshop (MULA@ECCV 2018) (Best Paper) [preprint]
	Speeding up Context-based Sentence Representation Learning with Non-autoregressive Convolutional Decoding Shuai Tang, Hailin Jin, Chen Fang, Zhaowen Wang, and Virginia de Sa Workshop on Representation Learning for NLP (RepL4NLP@ACL 2018) [preprint]
	Flow-Grounded Spatial-Temporal Video Prediction from Still Images Yijun Li, Chen Fang, Jimei Yang, Zhaowen Wang, Xin Lu, and Ming-Hsuan Yang European Conference on Computer Vision (ECCV) 2018 [preprint]
	"Factual" or "Emotional": Stylized Image Captioning with Adaptive Learning and Attention Tianlang Chen, Zhongping Zhang, Quanzeng You, Chen Fang, Zhaowen Wang, Hailin Jin and Jiebo Luo European Conference on Computer Vision (ECCV) 2018 [preprint]
	Product Quantization Network for Fast Image Retrieval Tan Yu, Junsong Yuan, Chen Fang, and Hailin Jin European Conference on Computer Vision (ECCV) 2018 [preprint]
	Learning to Doodle with Deep Q-Networksand Demonstrated Strokes Tao Zhou, Chen Fang, Zhaowen Wang, Jimei Yang, Byungmoon Kim, Zhili Chen, Jonathan Brandt and Demetri Terzopoulos British Machine Vision Conference (BMVC) (Spotlight) 2018 [preprint]
	Characterizing User Skills from Application Usage Traces with Hierarchical Attention Recurrent Networks Longqi Yang, Chen Fang, Hailin Jin, Matthew D. Hoffman and Deborah Estrin ACM Transactions on Intelligent Systems and Technology (TIST) 2018 [to appear]
	TextureGAN: Controlling Deep Image Synthesis with Texture Patches Wenqi Xian, Patsorn Sangkloy, Varun Agrawal, Amit Raj, Jingwan Lu, Chen Fang, Fisher Yu and James Hays IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Spotlight) 2018 [preprint]
	Visual to Sound: Generating Natural Sound for Videos in the Wild Yipin Zhou, Zhaowen Wang, Chen Fang, Trung Bui and Tamara L. Berg IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018 [preprint] [Project Page]
	Universal Style Transfer via Feature Transforms Yijun Li, Chen Fang, Jimei Yang, Zhaowen Wang, Xin Lu and Ming-Hsuan Yang Neural Information Processing Systems (NIPS) 2017 [preprint] [Code] Media Coverages: [Two Minute Papers]
	Visually-Aware Fashion Recommendation and Design with Generative Image Models Wang-Cheng Kang, Chen Fang, Zhaowen Wang and Julian McAuley International Conference on Data Mining (ICDM) 2017 [preprint] Media Coverages: [MIT Technology Review] [The Merkle] [DailyMail] [EurekAlert!] [UCSD CSE Newsletter] [FOSSBYTES] [Hindustan Times] [The Irish News] [BT] [Quartzy] [Gadgets Now] [ScienceDaily] [Newswise] [TechXplore] [Yahoo Finance] [Tech You n Me] [Science Codex]
	BAM! The Behance Artistic Media Dataset for Recognition Beyond Photography Michael J. Wilber, Chen Fang, Hailin Jin, Aaron Hertzmann, John Collomosse and Serge Belongie International Conference on Computer Vision (ICCV) 2017 [preprint] [Dataset]
	Sketching with Style: Visual Search with Sketches and Aesthetic Context John Collomosse, Tu Bui, Michael Wilber, Chen Fang and Hailin Jin International Conference on Computer Vision (ICCV) 2017 [preprint]
	Multiple Instance Visual-Semantic Embedding Zhou Ren, Hailin Jin, Zhe Lin, Chen Fang, and Alan Yuille British Machine Vision Conference (BMVC) (Oral) 2017 [preprint]
	Rethinking Skip-thought: A Neighborhood based Approach Shuai Tang, Hailin Jin, Chen Fang, Zhaowen Wang, and Virginia de Sa Workshop on Representation Learning for NLP (RepL4NLP@ACL 2017) [preprint]
	Diversified Texture Synthesis with Feed-forward Networks Yijun Li, Chen Fang, Jimei Yang, Zhaowen Wang, Xin Lu and Ming-Hsuan Yang IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Spotlight) 2017 [preprint]
	Scribbler: Controlling Deep Image Synthesis with Sketch and Color Patsorn Sangkloy, Jingwan Lu, Chen Fang, Fisher Yu and James Hays IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017 [preprint]
	AMC: Attention guided Multi-modal Correlation Learning for Image Search Kan Chen, Trung Bui, Chen Fang, Zhaowen Wang and Ram Nevatia IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017 [preprint will be available soon]
	Spatial-Semantic Image Search by Visual Feature Synthesis Long Mai, Hailin Jin, Zhe Lin, Chen Fang, Jonathan Brandt and Feng Liu IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Spotlight) 2017 [preprint will be available soon]
	Personalizing Software and Web Services by Integrating Unstructured Application Usage Traces Longqi Yang, Chen Fang, Hailin Jin, Matthew D. Hoffman, and Deborah Estrin International World Wide Web Conference (WWW) 2017 [preprint]
	Joint Image-Text Representation by Gaussian Visual Semantic Embedding Zhou Ren, Hailin Jin, Zhe Lin, Chen Fang, and Alan Yuille ACM Multimedia (MM) 2016 [preprint]
	Vista: A visually, socially, and temporally-aware model for artistic recommendation Ruining He, Chen Fang, Zhaowen Wang, Julian McAuley ACM Conference on Recommender Systems (RecSys) 2016 [preprint]
	Image Captioning with Semantic Attention Quanzeng You, Hailin Jin, Zhaowen Wang, Chen Fang, Jiebo Luo IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016 [preprint] Media Coverages: [EurekAlert!] [UofR News Center]
	Collaborative Feature Learning from Social Media Chen Fang, Hailin Jin, Jianchao Yang and Zhe Lin IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015 [preprint] [BiBTex] @article{behance, title={Collaborative Feature Learning from Social Media}, author={Chen Fang and Hailin Jin and Jianchao Yang and Zhe Lin}, journal={arXiv preprint arXiv:1502.01423}, year={2015} }
	Multi-Task Metric Learning on Network Data Chen Fang, and Daniel N. Rockmore Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD) 2015 [preprint] [BiBTex] @article{MultiNetwork, title={Multi-Task Metric Learning on Network Data}, author={Fang, Chen and Rockmore, Daniel N}, booktitle={arXiv preprint arXiv:1411.2337}, year={2015} }
	Automatic Image Cropping using Visual Composition, Boundary Simplicity and Content Preservation Models Chen Fang, Zhe Lin, Radomir Mech, and Xiaohui Shen ACM Multimedia (MM) 2014 *Algorithm developed in this paper has been chosen to be shipped with couple of products in Photoshop, enabling new automatic image cropping feature! US patents pending.* (Dataset available) [PDF] [Supplemental] [Project Page] [Dataset:crops] [Dataset:images] [BiBTex] @inproceedings{FLMS_mm14, author = {Chen Fang and Zhe Lin and Radomir Mech and Xiaohui Shen}, title = {Automatic Image Cropping using Visual Composition, Boundary Simplicity and Content Preservation Models}, booktitle = {ACM Multimedia}, year = {2014} }
	Unbiased Metric Learning: On the Utilization of Multiple Datasets and Web Images for Softening Bias Chen Fang, Ye Xu, and Daniel N. Rockmore International Conference on Computer Vision (ICCV) 2013 [PDF] [Project Page] [BiBTex] @inproceedings{FXR_iccv13, author = {Chen Fang and Ye Xu and Daniel N. Rockmore}, title = {Unbiased Metric Learning: On the Utilization of Multiple Datasets and Web Images for Softening Bias}, booktitle = {International Conference on Computer Vision}, year = {2013} }
	Measuring Image Distances via Embedding in a Semantic Manifold Chen Fang, and Lorenzo Torresani European Conference on Computer Vision (ECCV) 2012 [PDF] [Project Page] [BiBTex] @InProceedings{FT_eccv12, author = {Chen Fang and Lorenzo Torresani}, title = {Measuring Image Distances via Embedding in a Semantic Manifold}, booktitle = {European Conference on Computer Vision ({ECCV})}, pages = {402--415}, year = 2012, month = oct, }
	Scalable Object-Class Retrieval with Approximate and Top-k Ranking Chen Fang, Mohammad Rastegari, and Lorenzo Torresani (*:equal contribution) International Conference on Computer Vision (ICCV) 2011 [PDF] [Project Page] [BiBTex] @InProceedings{FRT_iccv11, author = {Mohammad Rastegari and Chen Fang and Lorenzo Torresani}, title = {Scalable Object-Class Retrieval with Approximate and Top-k Ranking}, booktitle = {IEEE International Conference on Computer Vision ({ICCV})}, year = 2011, month = nov, }
	Analysis of Texture Images Generated by Olfactory System Bionic Model Chen Fang, Jin Zhang, Shangwu Zhu, Guang Li, and Rulong Wang International Symposium on Neural Networks (ISNN) 2010
	On Color Texture Generating Based on Simplified KIII Model Chen Jian-zhou, Zhang Jin, Chen Fang, Zhao Li-juan, Hans Liljenstrom IEEE/ACIS International Conference on Computer and Information Science (ICIS) 2009