TY - UNPB SN - 98 AU - Scherer Auberson, Kirsten T1 - Counteracting Concept Drift in Natural Language Classifiers T2 - Churer Schriften zur Informationswissenschaft. Arbeitsbereich Informationswissenschaft PY - 2018 CY - Chur PB - Hochschule für Technik und Wirtschaft HTW Chur. Schweizerisches Institut für Informationswissenschaft (SII) Y1 - 2018 UR - https://www.fhgr.ch/fhgr/angewandte-zukunftstechnologien/schweizerisches-institut-fuer-informationswissenschaft-sii/publikationen/churer-schriften/ VL - 98 AB - Natural Language Classifiers increasingly help Enterprises overcome the deluge of textual data coming their way. But these classifiers, once trained, lose their usefulness over time, as they remain static but the textual data’s underlying domain evolves: Their accuracy decreases in a phenomenon known as concept drift. Can this phenomenon be reliably detected in the classifier’s output? Once detected, can it be corrected through re-training, and if so, how? A proof-of-concept implementation of a system is presented, in which the classifier’s confi-dence metrics are used to detect concept drift. The classifier is then re-trained iteratively, by selecting test set samples with low confidence value, correcting them, and using them in the next iteration’s training set. The classifier’s performance is measured over time, and the system’s performance is observed. Finally, recommendations based on this implementation are made, which may prove useful in implementing such systems. TS - RIS T4 - Proposal for an Automated Method Y3 - 31.01.2019 M4 - Citavi ER -