Transfer active learning by querying committee

Hao SHAO; Feng TAO; Rui XU

doi:10.1631/jzus.C1300167

Your Location：

Home >

Browse articles >

Transfer active learning by querying committee

Computer & Automation | Updated：2022-05-19

- Transfer active learning by querying committee
- 采用专家问询方法的主动迁移学习算法研究
- Frontiers of Information Technology & Electronic Engineering Vol. 15, Issue 2, Pages: 107-118(2014)
- Affiliations：
  
  1.School of WTO Research & Education, Shanghai University of International Business and Economics, Shanghai 200336, China
  2.School of Business, East China University of Science and Technology, Shanghai 200237, China
  3.School of Computer Science and Technology, University of Science and Technology of China, Hefei 230026, China
- Author bio：
  
  [ "Hao SHAO, shaohao@suibe.edu.cn" ]
  [ "Feng TAO, ftao@ecust.edu.cn" ]
  [ "Rui XU, rxu@ustc.edu.cn" ]
- Funds：
- DOI：10.1631/jzus.C1300167
  CLC： TP3
- Received：20 June 2013，
  
  Revised：2014-1-15，
  
  Accepted：09 November 2013，
  
  Published：2014-02
- Accepted：
Scan QR Code
Hao SHAO, Feng TAO, Rui XU. Transfer active learning by querying committee[J]. Frontiers of Information Technology & Electronic Engineering, 2014, 15(2): 107-118.
DOI：

Hao SHAO, Feng TAO, Rui XU. Transfer active learning by querying committee[J]. Frontiers of Information Technology & Electronic Engineering, 2014, 15(2): 107-118. DOI： 10.1631/jzus.C1300167.

摘要

研究目的

在分类学习中，我们往往面临着匮乏的类标信息，而对无类标数据进行分类又会耗费大量人力物力，同时大量老旧信息得不到充分应用，造成资源浪费。一个典型例就是对突发新疾病的诊断，如H7N9禽流感病毒，从发现病症到确诊，需要经过很长时间，其中重要原因是，当新疾病出现时，往往只有极少数确诊病例，而且对病情信息所知甚少，由于没有经验数据，确诊新病症极为困难，导致大量病人被当作普通流感治疗，从而耽误了救治的黄金时间。因此，针对大量疑似病例，需要尽快做出正确诊断以挽救病人生命。如果依靠医生对每一个疑似病例进行详细分析诊断，将会浪费宝贵的医疗资源和时间，耽误亟待确诊患者的救治。我们注意到，医院保存了大量其他疾病的数据库。因此，探讨如何利用已有数据（例如普通流感或肺炎数据库），辅助医生进行未知的类似病症的诊断，具有更加重要的现实意义。本研究主要利用迁移学习理论，对旧数据进行信息提取，同时借助专家系统，进一步提升其精确性，从而在快速得到准确结果的同时节省大量稀缺资源。

创新要点

采用专家系统和混合模型，进一步优化迁移学习方法。在借助专家指导的过程中，主动学习（active learning）理论可以更好提供最有价值的数据集。因此，本研究引入专家系统对迁移算法的辅助方法设计，以及使用主动学习理论来进行未知数据的人工选择，以弥补迁移学习算法在初始数据集匮乏的情况下性能不足的弱点。

研究手段

将大量冗余数据（源数据）作为专家系统，在迭代过程中设置阈值，淘汰不符合条件的专家以及数据集合，可以大大提升算法性能。

重要结论

主动学习和迁移学习的结合，能够补偿迁移学习算法对初始数据集质量的高度依赖，避免负面迁移并大大提升算法性能。

Abstract

In real applications of inductive learning for classification

labeled instances are often deficient

and labeling them by an oracle is often expensive and time-consuming. Active learning on a single task aims to select only informative unlabeled instances for querying to improve the classification accuracy while decreasing the querying cost. However

an inevitable problem in active learning is that the informative measures for selecting queries are commonly based on the initial hypotheses sampled from only a few labeled instances. In such a circumstance

the initial hypotheses are not reliable and may deviate from the true distribution underlying the target task. Consequently

the informative measures will possibly select irrelevant instances. A promising way to compensate this problem is to borrow useful knowledge from other sources with abundant labeled information

which is called transfer learning. However

a significant challenge in transfer learning is how to measure the similarity between the source and the target tasks. One needs to be aware of different distributions or label assignments from unrelated source tasks; otherwise

they will lead to degenerated performance while transferring. Also

how to design an effective strategy to avoid selecting irrelevant samples to query is still an open question. To tackle these issues

we propose a hybrid algorithm for active learning with the help of transfer learning by adopting a divergence measure to alleviate the negative transfer caused by distribution differences. To avoid querying irrelevant instances

we also present an adaptive strategy which could eliminate unnecessary instances in the input space and models in the model space. Extensive experiments on both the synthetic and the real data sets show that the proposed algorithm is able to query fewer instances with a higher accuracy and that it converges faster than the state-of-the-art methods.

关键词

Keywords

references

A. Argyriou , , , A. Maurer , , , M. Pontil . . An algorithm for transfer learning in a heterogeneous environment . . Proc. European Conf. on Machine Learning and Knowledge Discovery in Databases , , 2008 . . p.71 - - 85 . . DOI: 10.1007/978-3-540-87479-9_23 http://doi.org/10.1007/978-3-540-87479-9_23 . .

M.F. Balcan , , , A. Beygelzimer , , , J. Langford . . Agnostic active learning . . Proc. 23rd Int. Conf. on Machine Learning , , 2006 . . p.65 - - 72 . . DOI: 10.1145/1143844.1143853 http://doi.org/10.1145/1143844.1143853 . .

B. Cao , , , S.J. Pan , , , Y. Zhang , , , 等 . . Adaptive transfer learning . . Proc. 24th AAAI Conf. on Artificial Intelligence , , 2010 . . p.407 - - 412 . . . .

R. Caruana . . Multitask learning . . Mach. Learn. , , 1997 . . 28 ( ( 1 ): ): 41 - - 75 . . DOI: 10.1023/A:1007379606734 http://doi.org/10.1023/A:1007379606734 . .

C.C. Chang , , , C.J. Lin . . LIBSVM: a library for support vector machines . . ACM Trans. Intell. Syst. Technol. , , 2001 . . 2 ( ( 3 ): ): 27 DOI: 10.1145/1961189.1961199 http://doi.org/10.1145/1961189.1961199 . .

R. Chattopadhyay , , , W. Fan , , , I. Davidson , , , 等 . . Joint transfer and batch-mode active learning . . Proc. 30th Int. Conf. on Machine Learning , , 2013 . . p.253 - - 261 . . . .

K.W. Church , , , W.A. Gale . . A comparison of the enhanced Good-Turing and deleted estimation methods for estimating probabilities of English bigrams . . Comput. Speech Lang. , , 1991 . . 5 ( ( 1 ): ): 19 - - 54 . . DOI: 10.1016/0885-2308(91)90016-J http://doi.org/10.1016/0885-2308(91)90016-J . .

D. Cohn , , , L. Atlas , , , R. Ladner . . Improving generalization with active learning . . Mach. Learn. , , 1994 . . 15 ( ( 2 ): ): 201 - - 221 . . DOI: 10.1007/BF00993277 http://doi.org/10.1007/BF00993277 . .

I. Dagan , , , S.P. Engelson . . Committee-based sampling for training probabilistic classifiers . . Proc. 12th Int. Conf. on Machine Learning, , , 1995 . . p.150 - - 157 . . . .

W. Dai , , , Q. Yang , , , G. Xue , , , 等 . . Boosting for transfer learning . . Proc. 24th Int. Conf. on Machine Learning , , 2007 . . p.193 - - 200 . . DOI: 10.1145/1273496.1273521 http://doi.org/10.1145/1273496.1273521 . .

Y. Freund , , , R.E. Schapire . . A decision-theoretic generalization of on-line learning and an application to boosting . . J. Comput. Syst. Sci. , , 1997 . . 55 ( ( 1 ): ): 119 - - 139 . . DOI: 10.1006/jcss.1997.1504 http://doi.org/10.1006/jcss.1997.1504 . .

A. Harpale , , , Y. Yang . . Active learning for multi-task adaptive filtering . . Proc. 27th Int. Conf. on Machine Learning , , 2010 . . p.431 - - 438 . . . .

A. Krause , , , C. Guestrin . . Optimal value of information in graphical models . . J. Artif. Intell. , , 2009 . . 35 557 - - 591 . . . .

D.D. Lewis , , , W.A. Gale . . A sequential algorithm for training text classifiers . . Proc. 17th Annual Int. ACM SIGIR Conf. on Research and Development in Information Retrieval , , 1994 . . p.3 - - 12 . . . .

H. Li , , , Y. Shi , , , M.Y. Chen , , , 等 . . Hybrid active learning for cross-domain video concept detection . . Proc. Int. Conf. on Multimedia , , 2010 . . p.1003 - - 1006 . . DOI: 10.1145/1873951.1874135 http://doi.org/10.1145/1873951.1874135 . .

L. Li , , , X. Jin , , , S. Pan , , , 等 . . Multi-domain active learning for text classification . . Proc. 18th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining, , , 2012 . . p.1086 - - 1094 . . DOI: 10.1145/2339530.2339701 http://doi.org/10.1145/2339530.2339701 . .

J.H. Lin . . Divergence measures based on the Shannon entropy . . IEEE Trans. Inform. Theory , , 1991 . . 37 ( ( 1 ): ): 145 - - 151 . . DOI: 10.1109/18.61115 http://doi.org/10.1109/18.61115 . .

C.Y. Luo , , , Y.S. Ji , , , X.Y. Dai , , , 等 . . Active learning with transfer learning . . Proc. ACL Student Research Workshop , , 2012 . . p.13 - - 18 . . . .

A.K. McCallum , , , K. Nigam . . Employing EM and pool-based active learning for text classification . . Proc. 15th Int. Conf. on Machine Learning , , 1998 . . p.350 - - 358 . . . .

I. Muslea , , , S. Minton , , , C.A. Knoblock . . Active+semi-supervised learning = robust multi-view learning . . Proc. 19th Int. Conf. on Machine Learning , , 2002 . . p.435 - - 442 . . . .

F. Pereira , , , N. Tishby , , , L. Lee . . Distributional clustering of English words . . Proc. 31st Annual Meeting of Association for Computational Linguistics , , 1993 . . p.183 - - 190 . . DOI: 10.3115/981574.981598 http://doi.org/10.3115/981574.981598 . .

S. Rajan , , , J. Ghosh , , , M.M. Crawford . . An active learning approach to knowledge transfer for hyperspectral data analysis . . Proc. IEEE Int. Conf. on Geoscience and Remote Sensing Symp. , , 2006 . . p.541 - - 544 . . DOI: 10.1109/IGARSS.2006.143 http://doi.org/10.1109/IGARSS.2006.143 . .

R. Reichart , , , K. Tomanek , , , U. Hahn , , , 等 . . Multi-task active learning for linguistic annotations . . Proc. Annual Meeting of Association for Computational Linguistics , , 2008 . . p.861 - - 869 . . . .

M.T. Rosenstein , , , Z. Marx , , , L.P. Kaelbling , , , 等 . . To transfer or not to transfer . . Proc. NIPS Workshop on Inductive Transfer: 10 Years Later , , 2005 . . .

N. Roy , , , A. McCallum . . Toward optimal active learning through sampling estimation of error reduction . . Proc. 18th Int. Conf. on Machine Learning , , 2001 . . p.441 - - 448 . . . .

B. Settles . . Active Learning Literature Survey . . Technical Report No. 1648, University of Wisconsin, Madison , , 2010 . . .

H.S. Seung , , , M. Opper , , , H. Sompolinsky . . Query by committee . . Proc. 5th Annual Workshop on Computational Learning Theory , , 1992 . . p.287 - - 294 . . DOI: 10.1145/130385.130417 http://doi.org/10.1145/130385.130417 . .

H. Shao , , , E. Suzuki . . Feature-based inductive transfer learning through minimum encoding . . Proc. SIAM Int. Conf. on Data Mining , , 2011 . . p.259 - - 270 . . . .

H. Shao , , , B. Tong , , , E. Suzuki . . Compact coding for hyperplane classifiers in heterogeneous environment . . Proc. European Conf. on Machine Learning and Knowledge Discovery in Databases , , 2011 . . p.207 - - 222 . . DOI: 10.1007/978-3-642-23808-6_14 http://doi.org/10.1007/978-3-642-23808-6_14 . .

X.X. Shi , , , W. Fan , , , J.T. Ren . . Actively transfer domain knowledge . . Proc. European Conf. on Machine Learning and Knowledge Discovery in Databases , , 2008 . . p.342 - - 357 . . DOI: 10.1007/978-3-540-87481-2_23 http://doi.org/10.1007/978-3-540-87481-2_23 . .

Y. Shi , , , Z.Z. Lan , , , W. Liu , , , 等 . . Extending semi-supervised learning methods for inductive transfer learning . . Proc. 9th IEEE Int. Conf. on Data Mining , , 2009 . . p.483 - - 492 . . DOI: 10.1109/ICDM.2009.75 http://doi.org/10.1109/ICDM.2009.75 . .

L. Yang , , , S. Hanneke , , , J. Carbonell . . A theory of transfer learning with applications to active learning . . Mach. Learn. , , 2013 . . 90 ( ( 2 ): ): 161 - - 189 . . DOI: 10.1007/s10994-012-5310-y http://doi.org/10.1007/s10994-012-5310-y . .

Y. Zhang . . Multi-task active learning with output constraints . . Proc. 24th AAAI Conf. on Artificial Intelligence , , 2010 . . p.667 - - 672 . . . .

Z. Zhu , , , X. Zhu , , , Y. Ye , , , 等 . . Transfer active learning . . Proc. 20th ACM Int. Conf. on Information and Knowledge Management , , 2011 . . p.2169 - - 2172 . . DOI: 10.1145/2063576.2063918 http://doi.org/10.1145/2063576.2063918 . .

F. Zhuang , , , P. Luo , , , Z. Shen , , , 等 . . Collaborative Dual-PLSA: mining distinction and commonality across multiple domains for text classification . . Proc. 19th ACM Int. Conf. on Information and Knowledge Management , , 2010 . . p.359 - - 368 . . DOI: 10.1145/1871437.1871486 http://doi.org/10.1145/1871437.1871486 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

Classification of EEG-based single-trial motor imagery tasks using a B-CSP method for BCI

Urban landscape classification using Chinese advanced high-resolution satellite imagery and an object-oriented multi-variable model*

Related Author

Zhi-chuan TANG

Chao LI

Jian-feng WU

Peng-cheng LIU

Shi-wei CHENG

Ma Li-gang

Deng Jin-song

Yang Huai

Related Institution

Industrial Design Institute, Zhejiang University of Technology

College of Computer Science and Technology, Zhejiang University

Lincoln Centre for Autonomous Systems, University of Lincoln, Lincoln LN57DH

College of Computer Science & Technology, Zhejiang University of Technology

Institute of Applied Remote Sensing & Information Technology, Zhejiang University

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰