TY - GEN
T1 - A Survey of Current Datasets for Code-Switching Research
AU - Jose, Navya
AU - Chakravarthi, Bharathi Raja
AU - Suryawanshi, Suryawanshi
AU - Sherly, Elizabeth
AU - McCrae, John Philip
N1 - Publisher Copyright:
© 2020 IEEE.
PY - 2020/3
Y1 - 2020/3
N2 - Code switching is a prevalent phenomenon in the multilingual community and social media interaction. In the past ten years, we have witnessed an explosion of code switched data in the social media that brings together languages from low resourced languages to high resourced languages in the same text, sometimes written in a non-native script. This increases the demand for processing code-switched data to assist users in various natural language processing tasks such as part-of-speech tagging, named entity recognition, sentiment analysis, conversational systems, and machine translation, etc. The available corpora for code switching research played a major role in advancing this area of research. In this paper, we propose a set of quality metrics to evaluate the dataset and categorize them accordingly.
AB - Code switching is a prevalent phenomenon in the multilingual community and social media interaction. In the past ten years, we have witnessed an explosion of code switched data in the social media that brings together languages from low resourced languages to high resourced languages in the same text, sometimes written in a non-native script. This increases the demand for processing code-switched data to assist users in various natural language processing tasks such as part-of-speech tagging, named entity recognition, sentiment analysis, conversational systems, and machine translation, etc. The available corpora for code switching research played a major role in advancing this area of research. In this paper, we propose a set of quality metrics to evaluate the dataset and categorize them accordingly.
KW - code switching
KW - dataset
KW - natural language processing
UR - http://hdl.handle.net/10379/16090
UR - https://www.scopus.com/pages/publications/85084660846
U2 - 10.13025/21015
DO - 10.13025/21015
M3 - Conference Publication
T3 - 2020 6th International Conference on Advanced Computing and Communication Systems, ICACCS 2020
SP - 136
EP - 141
BT - 2020 6th International Conference on Advanced Computing and Communication Systems, ICACCS 2020
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 6th International Conference on Advanced Computing and Communication Systems, ICACCS 2020
Y2 - 6 March 2020 through 7 March 2020
ER -