2019 • In Farace, D.; Frantzen (Eds.) GL20 Proceedings Twentieth International Conference on Grey Literature “Research Data Fuels and Sustains Grey Literature”.
[en] Abstract:
Problem/Goal:
In GL19’s “Indexing grey literature in General Practice: Family Medicine in the Eraof Semantic Web,” Jamoulle and colleagues(Jamoulle et al., 2018) propose the use of a relatively new terminology (3CGP) to allow for the indexing and retrieval of (GP/FM) knowledge which otherwise would be lost, or difficult to locate. Though designed to meet Cimino’s (Cimino, 1998) twelve desiderata for the design of a controlled healthcare vocabulary, Jamoulle and colleagues (Jamoulle et al., 2018) acknowledge that a detailed requirement by requirement evaluation of 3CGP was not performed. The goal of this paper is to evaluate the Q-Codes component of the 3CGP terminology, in detail, with each of Cimino’s twelve desiderata.
Research Method/Procedure:
In our work, we will focus on qualitative analysis, whereby our taxonomy, the Q-Codes, and in particular, its vocabulary satisfies a standard set of desiderata. Qualitative analysis provides a simple and yet effective way to assess the Q-Codes taxonomy’s quality. We will briefly describe each of the desiderata and discuss how our taxonomy satisfies each one of them (or not).
Anticipated Results of the Research:
The qualitative evaluation is intended as an initial stage, which focuses on the Q-Codes taxonomy’s contents, namely, its vocabulary (e.g. terms and definitions). Our aim with the qualitative evaluation is to investigate whether our proposed taxonomy, and in particular its vocabulary, satisfies a set of desiderata. This will enable us to determine whether the knowledge acquisition and (part of) the conceptualization steps of our ontology development process have been performed correctly. We consider that validating our vocabulary against a set of well-defined desiderata is paramount before evaluating other aspects of the taxonomy (such as the relations). As a set of desiderata, we chose that proposed by Cimino in his seminal study entitled “Desiderata for controlled medical vocabularies in the twenty-first century” (Cimino, 1998). These desiderata ensure that our taxonomy can be successfully deployed and exploited in actual GM/FM applications / activities, such as indexing grey literature. The desiderata define a set of (desired) characteristics that (ideally all) standard medical vocabularies should satisfy. Thus, these desiderata help in alleviating inter-operability issues, with the use of common standards ensuring the efficient integration of our taxonomy with other medical vocabularies and resources (taxonomies, ontologies). From the results of this study, improvements can be made to the Q-Codes component of, and thus, the 3CGP terminology. This, in turn, improves the ability to index the grey literature with the 3CGP terminology, providing greater access to needed information.
Indication of costs related to the project:
This project has not been funded. 3CGP is placed under Attribution-Non-Commercial-Share-Alike4.0International(CCBY-NC-SA4.0) license.
Disciplines :
General & internal medicine Computer science
Author, co-author :
Resnick, Melissa P.; University of Texas at Houston > Health Science Center at Houston,Houston,TX,USA
American Society for Indexing. (n.d.). About Taxonomies & Controlled Vocabularies [A Special Interest Group of the American Society for Indexing]. Retrieved November 14, 2018, from http://www.taxonomies-sig.org/about.htm
Bellefontaine, S. P., & Lee, C. M. (2014). Between Black and White: Examining Grey Literature in Meta-analyses of Psychological Research. Journal of Child and Family Studies, 23(8), 1378-1388. https://doi.org/10.1007/s10826-013-9795-1
Cimino, J. J. (1996a). Formal descriptions and adaptive mechanisms for changes in controlled medical vocabularies. Methods of Information in Medicine, 35(3), 202-210.
Cimino, J. J. (1996b). Review paper: coding systems in health care. Methods of Information in Medicine, 35(4-5), 273-284.
Cimino, J. J. (1998). Desiderata for controlled medical vocabularies in the twenty-first century. Methods of Information in Medicine, 37(4-5), 394-403.
Coletti, M. H., & Bleich, H. L. (2001). Medical subject headings used to search the biomedical literature. Journal of the American Medical Informatics Association: JAMIA, 8(4), 317-323.
Côté, R. A., & Robboy, S. (1980). Progress in medical information management. Systematized nomenclature of medicine (SNOMED). JAMA, 243(8), 756-762.
Denda, K. (2002). Fugitive Literature in the Cross Hairs. Collection Management, 27(2), 75-86. https://doi.org/10.1300/J105v27n02-07
Evans, D. A., and Cimino., J. J., Hersh, W. R., Huff, S. M., & Bell, D. S. (1994). Toward a medical-concept representation language. The Canon Group. Journal of the American Medical Informatics Association: JAMIA, 1(3), 207-217.
Evans, D. A., and Rothwell., D. J., Monarch, I. A., Lefferts, R. G., & Cote, R. A. (1991). Toward representations for medical concepts. Medical Decision Making: An International Journal of the Society for Medical Decision Making, 11(4 Suppl), S102-108.
Evans, David A. (1988). Pragmatically-Structured, Lexical-Semantic Knowledge Bases for Unified Medical Language Systems. Proceedings of the Annual Symposium on Computer Application in Medical Care, 169-173.
Jamoulle, M., Cardillo, E., Ittoo, A., Vander Stichele, R., Resnick, M. P., Grosjean, J., ⋯ Vanmeerbeek, M. (2018). Indexing grey literature in General Practice: Family Medicine in the Era of Semantic Web. In D. Farace & J. Frantzen (Eds.), GL19 Conference Proceedings (Vol. 19). National Research Council of Italy Piazzale Aldo Moro 7, Rome: TextRelease. Retrieved from http://www.textrelease.com/images/GL19-Jamoulle-et-al.pdf
Jamoulle, M., Grosjean, J., Resnick, M., Ittoo, A., Treuherz, A., Vander Stichele, R., ⋯ Vanmeerbeek, M. (2017). A Terminology in General Practice/Family Medicine to Represent Non-Clinical Aspects for Various Usages: The Q-Codes. Studies in Health Technology and Informatics, 235, 471-475.
Jamoulle, M., & Resnick, M. P. (2016). General Practice / Family Medicine multilingual terminology - English version. Strépy-Bracquegnies, Belgium: Le livre en papier. Retrieved from http://www.publier-un-livre.com/fr/le-livre-en-papier/349-general-practice-family-medicine-multilingual-terminology-english-version
Lindberg, D. A., and Humphreys., B. L., & McCray, A. T. (1993). The Unified Medical Language System. Methods of Information in Medicine, 32(4), 281-291.
Mahood, Q., Van Eerd, D., & Irvin, E. (2014). Searching for grey literature for systematic reviews: challenges and benefits. Research Synthesis Methods, 5(3), 221-234. https://doi.org/10.1002/jrsm.1106
Moorman, P. W., van Ginneken, A. M., van der Lei, J., & van Bemmel, J. H. (1994). A model for structured data entry based on explicit descriptional knowledge. Methods of Information in Medicine, 33(5), 454-463.
New York Academy of Medicine. (2018, October). What is Grey Literature? | Grey Literature Database. Retrieved November 13, 2018, from http://www.greylit.org/about
Paez, A. (2017). Grey literature: An important resource in systematic reviews. Journal of Evidence-Based Medicine. https://doi.org/10.1111/jebm.12265
Pappas, C., & Williams, I. (2011). Grey Literature: Its Emerging Importance. Journal of Hospital Librarianship, 11(3), 228-234. https://doi.org/10.1080/15323269.2011.587100
Rassinoux, A. M., and Miller., R. A., Baud, R. H., & Scherrer, J. R. (1996). Modeling principles for QMR medical findings. Proceedings: A Conference of the American Medical Informatics Association. AMIA Fall Symposium, 264-268.
Rector, A. L., and Glowinski., A. J., Nowlan, W. A., & Rossi-Mori, A. (1995). Medical-concept models and medical records: an approach based on GALEN and PEN&PAD. Journal of the American Medical Informatics Association: JAMIA, 2(1), 19-35.
TextRelease. (n.d.-a). Grey Literature - GreySource, A Selection of Web-based Resources in Grey Literature [GreyNet International 2018]. Retrieved November 13, 2018, from http://www.greynet.org/greysourceindex/documenttypes.html
TextRelease. (n.d.-b). GreyNet International, Grey Literature Network Service [GreyNet International 2018]. Retrieved November 13, 2018, from http://www.greynet.org/home.html
Tillett, S., & Newbold, E. (2006). Grey literature at The British Library: revealing a hidden resource. Interlending & Document Supply, 34(2), 70-73. https://doi.org/10.1108/02641610610669769
van Ginneken, A. M., van der Lei, J., & Moorman, P. W. (1992). Towards unambiguous representation of patient data. Proceedings. Symposium on Computer Applications in Medical Care, 69-73.
Volot, F., Zweigenbaum, P., Bachimont, B., Ben Said, M., Bouaud, J., Fieschi, M., & Boisvieux, J. F. (1993). Structuration and acquisition of medical knowledge. Using UMLS in the conceptual graph formalism. Proceedings. Symposium on Computer Applications in Medical Care, 710-714.