Benchmarking domain-specific expert search using workshop program committees

    Research output: Chapter in Book or Conference Publication/ProceedingConference Publicationpeer-review

    7 Citations (Scopus)

    Abstract

    Traditionally, relevance assessments for expert search have been gathered through self-assessment or based on the opinions of co-workers. We introduce three benchmark datasets for expert search that use conference workshops for relevance assessment. Our data sets cover entire research domains as opposed to single institutions. In addition, they provide a larger number of topic-person associations and allow a more objective and fine-grained evaluation of expertise than existing data sets do. We present and discuss baseline results for a language modelling and a topic-centric approach to expert search. We find that the topic-centric approach achieves the best results on domain-specific datasets.

    Original languageEnglish
    Title of host publicationCompSci 2013 - Proceedings of the 2013 Workshop on Computational Scientometrics
    Subtitle of host publicationTheory and Applications, Co-located with CIKM 2013
    Pages19-24
    Number of pages6
    DOIs
    Publication statusPublished - 2013
    Event2013 ACM Workshop on Computational Scientometrics: Theory and Applications, CompSci 2013 - Co-located with CIKM 2013 - San Francisco, CA, United States
    Duration: 28 Oct 201328 Oct 2013

    Publication series

    NameCompSci 2013 - Proceedings of the 2013 Workshop on Computational Scientometrics: Theory and Applications, Co-located with CIKM 2013

    Conference

    Conference2013 ACM Workshop on Computational Scientometrics: Theory and Applications, CompSci 2013 - Co-located with CIKM 2013
    Country/TerritoryUnited States
    CitySan Francisco, CA
    Period28/10/1328/10/13

    Keywords

    • expert finding
    • expertise search
    • workshop dataset

    Fingerprint

    Dive into the research topics of 'Benchmarking domain-specific expert search using workshop program committees'. Together they form a unique fingerprint.

    Cite this