Yong Rui 芮勇

  • Lenovo Group
  • No. 6, Shangdi West Road, Haidian District
  • Beijing
  • P. R. China
  • 100085
  • E-mail: my first name plus (no space) my last name at lenovo dot com

Dr. Yong Rui is currently the Chief Technology Officer and Senior Vice President of Lenovo Group. He is responsible for overseeing Lenovo’s corporate technical strategy, research and development directions, and Lenovo Research organization, which covers intelligent devices, big data analytics, artificial intelligence, cloud computing, 5G and smart lifestyle-related technologies.

Before joining Lenovo, Dr. Rui worked for Microsoft for 18 years. His roles included Senior Director and Deputy Managing Director of Microsoft Research Asia (MSRA) (2012-2016), GM of Microsoft Asia-Pacific R&D (ARD) Group (2010-2012), Director of Microsoft Education Product in China (2008-2010), Director of Strategy (2006-2008), and Researcher and Senior Researcher of the Multimedia Collaboration group at Microsoft Research, Redmond, USA (1999-2006).

A Fellow of ACM, IEEE, IAPR and SPIE, Dr. Rui is recognized as a leading expert in his fields of research. He is a recipient of many awards, including the 2017 IEEE SMC Society Andrew P. Sage Best Transactions Paper Award, the 2017 ACM TOMM Nicolas Georganas Best Paper Award, the 2016 IEEE Computer Society Technical Achievement Award, the 2016 IEEE Signal Processing Society Best Paper Award and the 2010 Most Cited Paper of the Decade Award from Journal of Visual Communication and Image Representation. He holds 65 US and international issued patents. He has published 4 books, 12 book chapters, and 260 referred journal and conference papers. With over 21,000 citations, and an h-Index of 64, his publications are among the most referenced.

Professional Activities

Dr. Rui is an Associate Editor of ACM Trans. on Multimedia Computing, Communication and Applications (TOMM), and a founding Editor of International Journal of Multimedia Information Retrieval. He was the Editor-in-Chief of IEEE MultiMedia magazine (2014-2017), an Associate Editor of IEEE Trans. on Multimedia (2004-2008), IEEE Trans. on Circuits and Systems for Video Technologies (2006-2010), ACM/Springer Multimedia Systems Journal (2004-2006), International Journal of Multimedia Tools and Applications (2004-2006) , and IEEE Access. He also serves on the Advisory Board of IEEE Trans. on Automation Science and Engineering.

Involved in many facets of the field, Dr. Rui is a member of numerous organizing and program committees for conferences including ACM Multimedia, ACM ICMR, IEEE ICME, SPIE ITCom, and ICPR. He was General Co-Chair of ACM Multimedia in 2009 and 2014, ACM ICMR in 2006 and 2012, and ICIMCS in 2010, and Program Co-Chair of ACM Multimedia in 2006, Pacific Rim Multimedia (PCM) in 2006, and IEEE ICME in 2009. He is on the Steering Committees of ACM Multimedia, ACM ICMR, IEEE ICME and PCM. He was an Executive Member of ACM SIGMM, and the founding Chair of its China Chapter.


PEOPLE OF ACM INTERVIEW--- https://www.acm.org/articles/people-of-acm/2018/yong-rui, March 1st, 2018

2017 China IT person of the year---Outstanding Contribution Award of Artificial Intelligence, 2018

ACM Fellow for contributions to image, video and multimedia analysis, understanding and retrieval, 2017

Andrew P. Sage Best Transactions Paper Award, IEEE SMC Society (Systems, Man and Cybernetics Society), 2017 Oct., J Yu, D. Tao, M. Wang and Y. Rui, Learning to Rank Using Clicks and Visual Features for Image Retrieval, IEEE Transactions on Cybernetics, Vol.45, No.4, April 2015

2017 ACM TOMM Nicolas Georganas Best Paper Award, X. Yang, T. Mei, Y. Xu, Y. Rui and S. Li, Automatic Generation of Visual-Textual Presentation Layout, ACM Trans. on Multimedia Computing Communications and Applications (TOMM), Vol. 12, Issue 2, 2016

2017 Industrial Distinguished Leaders, APSIPA, 2017

AI HERO, Netease, 2017

2016 IEEE Computer Society Technical Achievement Award, 2016

2016 IEEE Signal Processing Society Best Paper Award, J. Yu, Y. Rui and D. Tao, Click prediction for Web image re-ranking using multimodal sparse coding, IEEE Transactions on Image Processing, Volume 23, No. 5, May 2014

Most Cited Chinese Researchers (top 3 in Computer Science) by Elsevier, 2016, 2015, 2014

Most Influential Scholars in Multimedia (top 5) by AMiner, https://aminer.org/mostinfluentialscholar/mm

China IT Leader Award, 1st Wulin CTO Summit (2016), Hangzhou, China, 2017

2015 IEEE Trans. Multimedia Best Paper Award, J. Yu, Y. Rui and B. Chen, Exploiting click constraints and multi-view features for image re-ranking, 2015

IEEE CASS Distinguished Speaker, 2015

IT Leader Award, China Digital Business Times, 2014

ACM Distinguished Speaker, 2014

IAPR Fellow for contribution to visual pattern analysis, recognition and retrieval, 2012

SPIE Fellow for achievements in image processing, analysis and understanding, 2012

IEEE Fellow for contributions to image and video analysis, indexing and retrieval, 2010

Most Cited Paper of the Decade Award in 2010 from Journal of Visual Communication and Image Representation, Y. Rui, T. Huang and S.-F. Chang, “Image Retrieval: Current Techniques, Promising Directions, and Open Issues”

ACM Distinguished Scientist, 2009

IEEE CASS Certificate of Appreciation, 2008

ACM Recognition of Service Award, 2006, 2009, 2012

ACM Certificate of Appreciation, 2003

Best Paper Award, G. Qi, X. Hua, Y. Rui, J. Tang, T. Mei, H. Zhang, “Correlative multi-label video annotation,” ACM Multimedia, 2007

Outstanding Student Paper Award, Y. Chen (student), Y. Rui and T. Huang, JPDAF Based HMM for Real-Time Contour Tracking, IEEE Computer Vision and Pattern Recognition, pp.I-543 to 550, Kauai, Hawaii, December 11-13, 2001

2nd Place in 2016 MSCOCO image captioning competition, http://mscoco.org/dataset/#captions-leaderboard and then click on “Table C-5”, (team tag: MSRA)

2nd place in 2015 THUMOS video recognition competition, http://www.thumos.info/results.html, (team tag: MSR Asia)

1st Place in 2014 NIST TREC KBA (knowledge base acceleration) vital entity linking competition (579,838,246 documents), http://trec.nist.gov/pubs/trec23/papers/overview-kba.pdf (team tag: MSR_KMG)

Selected Publications

Kazutoshi Umemoto, Ruihua Song, Jian-Yun Nie, Xing Xie, Katsumi Tanaka, and Yong Rui, Search by Screenshots for Universal Article Clipping in Mobile Apps , ACM Transactions on Information Systems (TOIS), Vol. 35, No. 4, 2017

Jinhui Tang, Shiyu Chang, Guo-Jun Qi, Qi Tian, Yong Rui, and Thomas S Huang, LEGO-MM: LEarning structured model by probabilistic loGic Ontology tree for MultiMedia, IEEE Transactions on Image Processing, Vol. 26, No. 1, pp.196-207, 2017

Yue Wu, Xu Shen, Tao Mei, Xinmei Tian, Nenghai Yu, and Yong Rui, Monet: A system for reliving your memories by theme-based photo storytelling, IEEE Transactions on Multimedia, Vol. 18, No. 11, pp.2206-2216, 2016

Xuyong Yang, Tao Mei, Ying-Qing Xu, Yong Rui, and Shipeng Li, Automatic generation of visual-textual presentation layout, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 12, No. 2, Mar 2016

Fei Wu, Xinyan Lu, Jun Song, Shuicheng Yan, Zhongfei Mark Zhang, Yong Rui, and Yueting Zhuang, Learning of multimodal representations with random walks on the click graph, IEEE Transactions on Image Processing, Vol. 25, No.2, pp.630-642, 2016

Yingwei Pan, Tao Mei, Ting Yao, Houqiang Li and Yong Rui, Jointly modeling embedding and translation to bridge video and language, Proc. of IEEE CVPR 2016, pp.4594-4602, Seattle, WA, June 27-30, 2016

Jun Yu, Yong Rui and Dacheng Tao, Click Prediction for Web Image Reranking Using Multimodal Sparse Coding, (Best Paper Award of IEEE Signal Processing Society, 2016) IEEE Transactions on Image Processing, Vol. 23, No. 5, pp.2019-2032, May 2014.

Jun Yu, Yong Rui, and Bo Chen, Exploiting Click Constraints and Multiview Features for Image Reranking,(Best Paper Award of IEEE Trans. Multimedia, 2015) IEEE Transactions on Multimedia , vol. 16, no. 1, pp.159-168, 2014.

Lei Zhang and Yong Rui, Image Search – From Thousands to Billions in 20 Years, ACM Transactions on Multimedia Computing, Communications and Applications (TOMM) , Vol. 9, 2013.

Xinmei Tian, Dacheng Tao and Yong Rui, Sparse Transfer Learning for Interactive Video Search Reranking ACM Transactions on Multimedia Computing, Communications and Applications (TOMM), Vol. 8, No. 3, July 2012 [pdf]

Guo-Jun Qi, Xian-Sheng Hua, Yong Rui, Jinhui Tang, Hong-Jiang Zhang, Image Classification with Kernelized Spatial-Context IEEE Trans. Multimedia, Issue 4, Volume 12, page 278 - 287, June 2010. [pdf]

Yong Rui, MPEG-7 Enhanced Ubi-Multimedia Access -- Convergence of User Experience and Technology, Proc. of the First IEEE International Conference on Ubi-media Computing (U-Media 2008) , Lanzhou, China, July 15-16, 2008. [pdf]

Lu Liu, Yong Rui, Li-Feng Sun, Bo Yang, Jianwei Zhang, Shi-Qiang Yang, Topic mining on web-shared videos, (Lu was the Best Student Paper finalist) Proc. of IEEE ICASSP 2008 , pp. 2145-2148, March 30 - April 4, 2008, Las Vegas, Nevada, USA [pdf]

Mohan Kankanhalli and Yong Rui, Application potential of multimedia information retrieval Proc. of IEEE, Special Issue on Advances in multimedia information retrieval, Vol. 96, No. 4, pp. 712-720, Apr 2008.,[pdf]

Cha Zhang, Yong Rui, Jim Crawford and Li-wei He, An Automated End-to-End Lecture Capture and Broadcasting System ACM Trans. Multimedia Computing Communication and Appications (TOMM) , Vol. 4, No. 1, Jan. 2008, [pdf]

Guojun Qi, Xiansheng Hua, Yong Rui, Jinhui Tang, Tao Mei, HongJiang Zhang, Correlative multi-label video annocation, (Best Paper Award, 410+ citations) Proc. of ACM Multimedia 2007 , Sept. 24-29, 2007, Augsburg, Germany [pdf]

Cha Zhang, Pei Yin, Yong Rui, Ross Cutler and Paul Viola, Boosting-Based Multimodal Speaker Detection for Distributed Meetings, Proc. of IEEE MMSP 2006 , Oct 3-6, 2006, Victoria, BC, Canada [pdf]

Yong Rui, Anoop Gupta, Jonathan Grudin and Liwei He, Automating lecture capture and broadcast: technology and videography, ACM Multimedia Systems Journal (Springer), 10:3-15 (2004) [pdf]

Yong Rui and Zicheng Liu, ARTiFACIAL: Automated Reverse Turing test using FACIAL features, ACM Multimedia Systems Journal (Springer), May 2004 [pdf]

Yunqiang Chen and Yong Rui Real-time Speaker Tracking Using Particle Filter Sensor Fusion, Proceedings of the IEEE , vol. 92, no. 3, pp. 485-494, Mar. 2004. [pdf]

Tao Wang, Yong Rui, Jia-guang Sun, Constraint Based Region Matching for Image Retrieval, International Journal of Computer Vision (IJCV),, vol.56(1/2), 2004, pp.37-45 [pdf]

Yong Rui and Dinei Florencio, New direct approaches to robust sound source localization, Proc. of IEEE International Conf. on Multimedia Expo (ICME) 2003 , Baltimore, MD, July 6-9, pp. I: 737-740 [pdf]

Ross Cutler, Yong Rui, Anoop Gupta, JJ Cadiz, Ivan Tashev, Li-wei He, Alex Colburn, Zhengyou Zhang, Zicheng Liu, Steve Silverberg, Distributed Meetings: A Meeting Capture and Broadcasting System, (320+ citations) Proc. of ACM Mulitmedia 2002 , Dec. Juan-les-Pins, France [pdf]

Yong Rui and Yunqiang Chen, Better Proposal Distributions: Object Tracking Using Unscented Particle Filter, (370+ citations) Proc. of IEEE CVPR 2001 , pp. II-786 to 793, Kauai, Hawaii, December 11-13, 2001. [pdf]

Yunqiang Chen, Yong Rui and Thomas Huang, JPDAF Based HMM for Real-Time Contour Tracking, (Yunqiang received Outstanding Student Paper Award) , Proc. of IEEE CVPR 2001 , pp.I-543 to 550, Kauai, Hawaii, December 11-13, 2001. [pdf]

Yong Rui, Anoop Gupta and J.J. Cadiz, Viewing Meetings Captured by an Omni-Directional Carema, Proc. of ACM CHI 2001 , Seattle, WA, March, 2001. [pdf]

Qiong Liu, Yong Rui, Anoop Gupta and J.J. Cadiz, Automating Camera Management in Lecture Room Environments, Proc. of ACM CHI 2001 , Seattle, WA, March, 2001. [pdf]

Yong Rui, Anoop Gupta, and Alex Acero, Automatically Extracting Highlights for TV Baseball Programs, (530+ citations) Proc. of ACM conf on Multimedia , October 30 - November 4, 2000, Los Angeles, CA

Yong Rui and Thomas S. Huang, Optimizing Learning In Image Retrieval, (460+ citations) Proc. of IEEE Int Conf on Computer Vision and Pattern Recognition (CVPR) , Hilton Head, SC, June 2000 [pdf]

Yong Rui, Thomas S. Huang, and Sharad Mehrotra, Constructing Table-of-Content for Videos, (360+ citations) ACM Multimedia Systems Journal (Springer),, Special Issue Multimedia Systems on Video Libraries, Vol.7, No.5, Sept, 1999, pp 359-368 [pdf]

Yong Rui, Thomas S. Huang, and Shih-Fu Chang, Image Retrieval: Current Techniques, Promising Directions and Open Issues, (Most Cited Paper of the Decade Award, 2800+ citations) Journal of Visual Communication and Image Representation , Vol. 10, 39-62, March, 1999 [pdf]

Yong Rui, Thomas S. Huang, Michael Ortega, and Sharad Mehrotra, Relevance Feedback: A Power Tool in Interactive Content-Based Image Retrieval, (The most cited paper in T-CSVT 1998, 2200+ citations)IEEE Trans. on Circuits and Systems for Video Technology , Special Issue on Segmentation, Description, and Retrieval of Video Content, pp644-655, Vol 8, No. 5, Sept, 1998 [pdf]

Yong Rui, Thomas S. Huang, and Sharad Mehrotra, Content-based Image Retrieval with Relevance Feedback in MARS, (1000+ citations) Proc. of IEEE Int. Conf. on Image Processing '97 , October 26-29, 1997 Santa Barbara, California, USA, ppII815-818. [pdf]