[en] Quantitative microbial risk assessment (QMRA) is being used to estimate the risk level of pathogens along the food chain and to support management decisions for the reduction of food-safety risks. The degree of credibility that can be attached to risk assessment results depends largely on the quality and quantity of the data, the model structure and the assumptions taken. Quality Assurance (QA) in QMRA is fulfilled when all steps in the QMRA process are technically and scientifically valid, so that it can meet its objectives. An overview of QA methods for QMRA is presented. Whereas sensitivity analysis and scenario analysis are common in QMRA, formal methods for the evaluation of data quality, the critical evaluation of assumptions, structured expert elicitation, the checklist approach, and peer review are rarely applied in QMRA but could largely improve the transparency in the results of QMRAs. The degree of implementation of these methods should be proportionate to the stakes of the risk management questions, and discussed in consultation between risk assessors and risk managers. [nl] Kwantitatieve microbiologische risico-evaluatie (QMRA) wordt gebruikt als een beleidsondersteunde methode met het oog op de reductie van voedselveiligheidsrisico’s. De geloofwaardigheid van de conclusies gebaseerd op een risico-evaluatie zijn onlosmakelijk verbonden met de kwaliteit en kwantiteit van de data, de modelstructuur, en de gemaakte assumpties. Kwaliteitsgarantie wordt gedefinieerd als de structuur die ervoor zorgt dat alle stappen in het risico-evaluatieproces wetenschappelijk onderbouwd zijn, zodat de vooropgestelde beleidsvragen beantwoord kunnen worden. Terwijl gevoeligheids- en scenarioanalyse algemeen toegepast worden in QMRA, zijn formele methodes voor de evaluatie van datakwaliteit, de kritische beoordeling van aannames, gestructureerde expertbevraging, checklists, and peer review slechts zelden toegepast, terwijl deze de transparantie van het risicoanalyseproces ten goede zouden komen. De mate van het toepassen van deze kwaliteitsgarantiemethodes dient afgestemd te worden op het belang van de beleidsvragen, en in onderleg overleg tussen analisten en beleidsverantwoordelijken besproken te worden.
Disciplines :
Food science
Author, co-author :
Boone, Idesbald
Van der Stede, Yves
Aerts, Marc
Mintiens, Koen
Daube, Georges ; Université de Liège - ULiège > Département de sciences des denrées alimentaires > Microbiologie des denrées alimentaires
Language :
English
Title :
Quality assurance in quantitative microbial risk assessment
Alternative titles :
[nl] Kwaliteitsgarantie in kwantitatieve microbiologische risico-evaluatie
Alban, L., Olsen, A.M., Nielsen, B., Sorensen, R., Jessen, B. (2002). Qualitative and quantitative risk assessment for human salmonellosis duc to multi-resistant Salmonella Typhimurium DT104 from consumption of Danish dry-cured pork sausages. Preventive Veterinary Medicine 52, 251-265.
Bollaerts, K., Messens, W., Delhalle, L., Aerts, M., Van der Stede, Y., Dewulf, J., Quoilin, S., Maes, D., Mintiens, K., Grijspeerdt, K. (2009). Development of a quantitative microbial risk assessment for human salmonellosis through household consumption of fresh minced pork meat in Belgium. Risk Analysis 29, 820-840.
Bollaerts, K., Messens, W., Aerts, M., Dewulf, J., Maes, D., Grijspeerdt, K., Van der Stede, Y. (2010). Evaluation of scenarios for reducing human salmonellosis through household consumption of fresh minced pork meat. Risk Analysis 30, 853-865.
Boone, I., Van der Stede, Y., Bollaerts, K., Messens, W., Vose, D., Daube, G., Aerts, M., Mintiens, K. (2009a). Expert judgement in a risk assessment model for Salmonella spp. in pork: the performance of different weighting schemes. Preventive Veterinary Medicine 92, 224-234.
Boone, I., Van der Stede, Y., Bollaerts, K., Vose, D., Maes, D., Dewulf, J., Messens, W., Daube, G., Aerts, M., Mintiens, K. (2009b). NUSAP method for evaluating the data quality in a quantitative microbial risk assessment model for Salmonella in the pork production chain. Risk Analysis 29, 502-517.
Boone, I., Van der Stede, Y., Dewulf, J., Messens, W., Aerts, M., Daube, G., Mintiens, K. (2010). NUSAP: a method to evaluate the quality of assumptions in a quantitative microbial risk assessment. Journal of Risk Research 13, 337-352.
Calistri, P., Giovannini, A. (2008). Quantitative risk assessment of human campylobacteriosis related to the consumption of chicken meat in two Italian regions. International Journal of Food Microbiology 128, 274-287.
Cassin, M.H., Lammerding, A.M., Todd, E.C.D., Ross, W., McColl, R.S. (1998). Quantitative risk assessment for Escherichia coli O157:H7 in ground beef hamburgers. International Journal of Food Microbiology 41, 21 -44.
Codex Alimentarius Commission (1999). Principles and guidelines for the conduct of microbiological risk assessment. CAC/GL-30 Codex Alimentarius Commision (FAOAVHO). Available at: www.codexalimentarius.net/download/standards/ 357/CXG-030e.pdf
Cooke, R.M. (1991). Experts in Uncertainty. Opinion and Subjective Probability in Science. Oxford University Press, New York.
Delhalle, L., Saegerman, C., Messens, W., Famir, F., Korsak, N., Van der Stede, Y., Daube, G. (2009). Assessing interventions by quantitative risk assessment tools to reduce the risk of human salmonellosis from fresh minced pork meat in Belgium. Journal of Food Protection 72, 2252-2263.
Duffy, G., Cummins, E., Nally, P., O' Brien, S., Carney, S., Henchion, M., Mahon, D., Butler, F. (2006). E. coli O157:H7 in beef burgers produced in the Republic of Ireland: a quantitative microbial risk assessment. Report published by Teagasc. Ashtown, Dublin 15, Ireland, Ashtown Food Research Centre. Available at: http://www.teagasc.ie/ashtown/research/foodsafety/E.coli%20O157. QMRAbeef.pdf
EFSA (2006). Guidance of the Scientific Committee on a request from EFSA related to uncertainties in dietary exposure assessment, Request No EFSA-Q-2004-019, Adopted on 14 December 2006. The EFSA Journal 438, 1-54.
EFSA (2010). EFSA Panel on Biological Hazards; Scientific opinion on a quantitative microbiological risk assessment of Salmonella in slaughter and breeder pigs. The EFSA Journal 8(4), 1547.
EPA (2003). Draft guidance on the development, evaluation, and application of regulatory environmental models. Washington, D.C., US EPA Council for Regulatory Environmental Modeling. Available at: http://www.epa.gov/crem/ library/CREM Guidance Draft 2012-03.pdf
FAO/WHO (2002a). Risk assessments of Salmonella in eggs and broiler chickens. Microbiological Risk Assessment Series no. 2. Available at: http://www.who.int/foodsafety/publications/micro/en/salmonella.pdf
FAOAVHO (2002b). Risk assessment of Campylobacter spp. in broiler chickens and Vibrio spp. in seafood. Report of a Joint FAOAVHO Expert Consultation Bangkok, Thailand 5-9 August 2002. Available at: http://www.who.int/foodsafety/publications/micro/aug2002.pdf
FAOAVHO (2003). Hazard Characterization for Pathogens in Food and Water: Guidelines. Microbiological Risk Assessment Series no. 3. Available at: http://www.fao.org/ag/agn/agns/jemra-guidelines-hazard-en.asp
FAOAVHO (2006). Food safety risk analysis. A guide for national food safety authorities. Rome, FAO Food and Nutrition Paper 87. Available at: ftp://ftp.fao.org/ docrep/fao/009/a0822e/a0822e00.pdf
FAOAVHO (2008). Exposure assessment of microbiological hazards in food: Guidelines. Microbiological Risk Assessment Series no. 7. Available at: http://www.fao.org/ag/agn/agns/jemra-guidelines-exposure-en.asp
FAOAVHO (2009). Risk characterization ofmicrobiological hazards in food: Guidelines. Microbiological Risk Assessment Series no. 17. Available at: http://www.fao.org/ag/agn/agns/jemra-guidelines-risk-en.asp
Frey, H.C., Mokhtari, A., Danish, T. (2003). Evaluation of selected sensitivity analysis methods based upon applications to two food safety process risk models. Prepared by North Carolina State University for the Office of Risk Assessment and Cost-Benefit Analysis, USDA, Washington, DC. Available at: http://www.ce.ncsu.edu/risk/Phase2Final.pdf
Frey, H.C., Mokhtari, A., Zheng, J. (2004). Recommended practice regarding selection, application, and interpretation of sensitivity analysis methods applied to food safety process risk models. Prepared by North Carolina State University for the Office of Risk Assessment and Cost-Benefit Analysis, USDA, Washington, DC. Available at: http://www.ce.ncsu.edu/risk/Phase3Final.pdf
FSIS (2001). Draft risk assessment of the public health impact of Escherichia coli O157:H7 in ground beef. Prepared for the Food Safety and Inspection Service and United States Department of Agriculture, Washington, DC. Available at: http://www.fsis.usda.gov/OPPDE/rdad/FRPubs/00-023N/00-023NReport. pdf
Funtowicz, S.O., Ravetz, J.R. (1990). Uncertainty and Quality in Science for Policy. Kluwer, Dordrecht, 229 p.
Havelaar, A.H., Nauta, M.J., Jansen, J.T. (2004). Fine-tuning food safety objectives and risk assessment. International Journal of Food Microbiology 93, 11-29.
Havelaar, A.H., Mangen, M.J., de Koeijer, A.A., Bogaardt, M.J., Evers, E.G., Jacobs-Reitsma, W.F., van Pelt, W., Wagenaar, J.A., de Wit, G.A., van der Zee, H., Nauta, M.J. (2007). Effectiveness and efficiency of controlling Campylobacter on broiler chicken meat. Risk Analysis 27, 831-844.
Hill, A., England, T., Snary, E.L., Cook, A., Kelly, L.A., Evans, S.J., Wooldridge, M. (2003). A 'farm-toconsumption' risk assessment for the adverse effect to human health of Salmonella Typhimurium in pigs. Weybridge, Veterinary Laboratories Agency.
Janssen, P.H., Petersen, A.C., van der Sluijs, J.P., Risbey, J.S., Ravetz, J.R. (2005). A guidance for assessing and communicating uncertainties. Water Science and Technology 52, 125-131.
Janssen, P.H.M., Petersen, A.C., van der Sluijs, J.P., Risbey, J.S., Ravetz, J.R. (2003). RIVM/MNP Guidance for Uncertainty Assessment and Communication: Quickscan Hints & Actions List. Bilthoven, The Netherlands, RIVM/MNP. Available at: http://www.mnp.nl/bibliotheek/digitaaldepot/Guidance-QS- HA.pdf
Kloprogge, P., van der Sluijs, J., Petersen, A.C. (2005). A method for the analysis of assumptions in assessments, exploring the value-ladenness of two indicators in the fifth Dutch environmental outlook. Bilthoven, Netherlands Environmental Assessment Agency, Report no. 550002010/2005. Available at: http://www.mnp.nl/bibliotheek/rapporten/550002010.pdf
KIoprogge, P., van der Sluijs, J., Wardekker, J. (2007). Uncertainty communication. Issues and good practice. Utrecht, the Netherlands, Copernicus Institute Sustainable Development and Innovation, Report NWS-E-2007-199. Available at: http://www.nusap.net/downloads/reports/uncertainty-communication. pdf
Krayer von Krauss, M.P. (2005). Uncertainty in policy relevant sciences. Ph.D. thesis. Technical University of Denmark, Kgs. Lyngby.
Lammerding, A.M. (2007). Using Microbial Risk Assessment (MRA) in Food Safety Management. Summary report of a workshop held in October 2005 in Prague, Czech Republic. Brussels, ILSI Europe Report Series. Available at: http://www.ilsi.org.ar/biblioteca/ILSI-Europa-Monografias/MRAWorkshopreport[1]. pdf
Macgill, S., Fewtrell, L., Chudley, J., Kay, D. (2001). Quality audit and the assessment of waterborne risk. In: Fewtrell, L., Bartram, J. (editors). Water Quality: Guidelines, Standards and Health. IWA Publishing, London, pp. 185-206.
Morgan, M.G., Henrion, M. (1990). Uncertainty, A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis. Cambridge University Press, New York.
Nauta, M., Havelaar, A. (2008). Risk-based standards for Campylobacter in the broiler meat chain. Food Control 19, 372-381.
Nauta, M.J., Evers, E.G.,Takumi, K., Havelaar, A.H. (2001). Risk assessment of Shiga-toxin producing Escherichia coli O157 in steak tartare in the Netherlands. Bilthoven, RIVM, RIVM report 257851003. Available at: www.rivm.nl/bibliotheek/rapporten/257851003.pdf
Nauta, M.J., Jacobs-Reitsma, W.F., Havelaar, A.H. (2007). A risk assessment model for Campylobacter in broiler meat. Risk Analysis 27, 845-861.
Notermans, S., Dufrenne, J.B., Teunis, P., Beumer, R., te Giffel, M.C., Peeters-Weem, P. (1997). A risk assessment study of Bacillus cereus present in pasteurized milk. Food Microbiology 14, 143-151.
OMB (2004). Final information quality bulletin for peer review. Washington D.C., Office of Management and Budget. Available at: http://www.ocio.usda.gov/qi-guide/doc/peer-bulletin.pdf
Paisley, L. (2007). Quality Audit Worksheet. Available at: http://www.foot-and-mouth.org/fmd-csfca/community/work-package-3-risks/ Quality-AuditWorksheet-V5.xls/view?searchterm=audit
Petersen, A.C., Janssen, P.H.M., van der Sluijs, J.P., Risbey, J.S., Ravetz, J.R. (2003). RIVM/MNP Guidance for Uncertainty Assessment and Communication: Mini-Checklist & Quickscan Questionnaire. RIVM/MNP. Available at: http://www.rivm.nl/bibliotheek/digitaaldepot/Guidance-MC-QS-Q.pdf
Refsgaard, J.C., Henriksen, H.J., Harrar, W.G., Schölten, H., Kassahun, A. (2005). Quality assurance in model based water management - review of existing practice and outline of new approaches. Environmental Modelling & Software 20, 1201-1215.
Refsgaard, J.C., Van der Sluijs, J., Brown, C.D., van der Keur, P. (2006). A framework for dealing with uncertainty due to model structure error. Advances in Water Resources 29, 1586-1597.
Refsgaard, J.C., van der Sluijs, J.P., Højberg, A.L., Vanrolleghem, P.A. (2007). Uncertainty in the Environmental Modelling Process: A Review. Environmental Modelling & Software 22, 1543-1556.
Risbey, J., van der Sluijs, J., Kloprogge, P., Ravetz, J., Funtowicz, S., Corral Quintana, S. (2005). Application of a checklist for quality assistance in environmental modelling to an energy model. Environment Modelling and Assessment 10, 63-79.
Rosenquist, H., Nielsen, N.L., Sommer, H.M., Norrung, B., Christensen, B.B. (2003). Quantitative risk assessment of human campylobacteriosis associated with thermophilic Campylobacter species in chickens. International Journal of Food Microbiology 83, 87-103.
Saltelli, A., Chan, K., Scott, M. (2000). Sensitivity Analysis. John Wiley & Sons publishers, West Sussex.
Sargeant, J.M., Amezcua, M., Rajic, A., Wadell, L. (2005). A guide to conducting systematic reviews in agri-food public health. Department of Clinical Epidemiology and Biostatistics, McMaster University, Ontario, Canada, and Laboratory for Foodborne Zoonoses, Public Health Agency of Canada, Guelph, Ontario, Canada. Available at: http://dsp-psd.pwgsc.gc.ca/Collection/HP5-9- 2005E.pdf
Schlundt, J. (2000). Comparison of microbiological risk assessment studies published. International Journal of Food Microbiology 58, 197-202.
Slottje, P., van der Sluijs, J.P., Knol, A.B. (2008). Expert elicitation: methodological suggestions for its use in environmental health impact assessments. Utrecht University, RIVM Letter report 630004001/2008. Available at: http://www.nusap.net/downloads/reports/Expert-Elicitation.pdf
USDA-FSIS (1998). Salmonella Enteritidis risk assessment. Shell eggs and egg products. Prepared for FSIS by the Salmonella Enteritidis Risk Assessment Team. Final report. Available at: http://www.fsis.usda.gov/ophs/risk/contents. htm
van der Fels-Klerx, H.J., Cooke, R.M., Nauta, M.N., Goossens, L.H., Havelaar, A.H. (2005). A structured expert judgment study for a model of Campylobacter transmission during broiler-chicken processing. Risk Analysis 25, 109-124.
van der Fels-Klerx, I.H., Goossens, L.H., Saatkamp, H.W., Horst, S.H. (2002). Elicitation of quantitative data from a heterogeneous expert panel: formal process and application in animal health. Risk Analysis 22, 67-81.
van der Sluijs, J.P., Risbey, J.S., KIoprogge, P., Ravetz, J.R., Funtowicz, S.O., Corral Quintana, S., Guimarães Pereira, Â., De Marchi, B., Petersen, A.C., Janssen, P.H.M., Hoppe, R., Huijs, S.W.F. (2003). RIVM/MNP Guidance for Uncertainty Assessment and Communication: Detailed Guidance. Utrecht, Utrecht University, Copernicus Institute/Dep't. of Science, Technology and Society and RIVM. Available at: http://www.nusap.net/downloads/ detailedguidance.pdf
van der Sluijs, J.P., Janssen, P.H.M., Petersen, A.C., Kloprogge, P., Risbey, J.S., Tuinstra, W., Ravetz, J.R. (2004). RIVM/MNP Guidance for Uncertainty Assessment and Communication: Tool Catalogue for Uncertainty Assessment. Utrecht, the Netherlands, Utrecht University and RIVM-MNP, Report no. NWS-E-2004-37. Available at: http://www.nusap.net/downloads/toolcatalogue. pdf
van der Sluijs, J.P., Craye, M., Funtowicz, S., Kloprogge, P., Ravetz, J., Risbey, J. (2005). Combining quantitative and qualitative measures of uncertainty in model-based environmental assessment: The NUSAP System. Risk Analysis 25, 481-492.
VLA-DTU-RIVM (2010). EFSA Quantitative Microbiological Risk Assessment on Salmonella in Slaughter and Breeder Pigs: Final Report. Question No EFSA-Q-200700245. Grant number CFP/EFSA/BIOHAZ/2007/01. Veterinary Laboratories Agency. Available at: http://www.efsa.europa.eu/en/scdocs/scdoc/46e.htm
Voysey, P.A., Brown, M. (2000). Microbiological risk assessment: a new approach to food safety control. International Journal of Food Microbiology 58, 173-179.
Wardekker, J.A., van der Sluijs, J.P., Janssen, P.H.M., Kloprogge, P., Petersen, A.C. (2008). Uncertainty communication in environmental assessments: views from the Dutch science-policy interface. Environmental Science & Policy 11, 627-641.
WHO (2008). Guidance document on characterizing and communicating uncertainty in exposure assessment, Harmonization Project Document No. 6. IPCS Harmonization Project Document. Part 1. Available at: http://www.who.int/ipcs/ methods/harmonization/areas/exposure/en/index.html
