Skip to Main content Skip to Navigation
Conference papers

Effectively Constructing Reliable Data for Cross-Domain Text Classification

Abstract : Traditional classification algorithms often fail when the independent and identical distributed (i.i.d.) assumption does not hold, and the cross-domain learning emerges recently is to deal with this problem. Actually, we observe that though the trained model from training data may not perform well over all test data, it can give much better prediction results on a subset of the test data with high prediction confidence. Also this subset of data from test data set may have more similar distribution with the test data. In this study, we propose to construct the reliable data set with high prediction confidence, and use this reliable data as training data. Furthermore, we develop an EM algorithm to refine the model trained from the reliable data. The extensive experiments on text classification verify the effectiveness and efficiency of our methods. It is worth to mention that the model trained from the reliable data achieves a significant performance improvement compared with the one trained from the original training data, and our methods outperform all the baseline algorithms.
Document type :
Conference papers
Complete list of metadata

Cited literature [30 references]  Display  Hide  Download

https://hal.inria.fr/hal-01524990
Contributor : Hal Ifip <>
Submitted on : Friday, May 19, 2017 - 10:43:43 AM
Last modification on : Thursday, March 5, 2020 - 5:41:55 PM

File

978-3-642-32891-6_6_Chapter.pd...
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Fuzhen Zhuang, Qing He, Zhongzhi Shi. Effectively Constructing Reliable Data for Cross-Domain Text Classification. 7th International Conference on Intelligent Information Processing (IIP), Oct 2012, Guilin, China. pp.16-27, ⟨10.1007/978-3-642-32891-6_6⟩. ⟨hal-01524990⟩

Share

Metrics

Record views

128

Files downloads

198