Skip to Main content Skip to Navigation
Conference papers

Effectively Constructing Reliable Data for Cross-Domain Text Classification

Abstract : Traditional classification algorithms often fail when the independent and identical distributed (i.i.d.) assumption does not hold, and the cross-domain learning emerges recently is to deal with this problem. Actually, we observe that though the trained model from training data may not perform well over all test data, it can give much better prediction results on a subset of the test data with high prediction confidence. Also this subset of data from test data set may have more similar distribution with the test data. In this study, we propose to construct the reliable data set with high prediction confidence, and use this reliable data as training data. Furthermore, we develop an EM algorithm to refine the model trained from the reliable data. The extensive experiments on text classification verify the effectiveness and efficiency of our methods. It is worth to mention that the model trained from the reliable data achieves a significant performance improvement compared with the one trained from the original training data, and our methods outperform all the baseline algorithms.
Document type :
Conference papers
Complete list of metadata

Cited literature [30 references]  Display  Hide  Download
Contributor : Hal Ifip Connect in order to contact the contributor
Submitted on : Friday, May 19, 2017 - 10:43:43 AM
Last modification on : Thursday, March 5, 2020 - 5:41:55 PM


Files produced by the author(s)


Distributed under a Creative Commons Attribution 4.0 International License



Fuzhen Zhuang, Qing He, Zhongzhi Shi. Effectively Constructing Reliable Data for Cross-Domain Text Classification. 7th International Conference on Intelligent Information Processing (IIP), Oct 2012, Guilin, China. pp.16-27, ⟨10.1007/978-3-642-32891-6_6⟩. ⟨hal-01524990⟩



Record views


Files downloads