Diagnostic yield of CT head in delirium and altered mental status—A systematic review and meta-analysis
Haris Akhtar MBBS
Division of General Internal Medicine, Department of Medicine, McGill University Health Centre, Montreal, Canada
Search for more papers by this authorShazia H. Chaudhry PhD
School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
Search for more papers by this authorÉmilie Bortolussi-Courval BScN
Division of Experimental Medicine, Department of Medicine, McGill University Health Centre, Montreal, Canada
Search for more papers by this authorRyan Hanula BSc
Division of Experimental Medicine, Department of Medicine, McGill University Health Centre, Montreal, Canada
Search for more papers by this authorAnas Akhtar MBBS
Department of General Surgery, Letterkenny University Hospital, Letterkenny, Ireland
Search for more papers by this authorBénédicte Nauche MBSI
McGill University Health Centre Medical Libraries, Montreal, Canada
Search for more papers by this authorCorresponding Author
Emily G. McDonald MD, MSc
Division of General Internal Medicine, Department of Medicine, McGill University Health Centre, Montreal, Canada
Division of Experimental Medicine, Department of Medicine, McGill University Health Centre, Montreal, Canada
Clinical Practice Assessment Unit, Department of Medicine, McGill University Health Centre, Montreal, Canada
Correspondence
Emily G. McDonald, Division of General Internal Medicine, Department of Medicine, McGill University Health Centre, Office 3E.03 5252 De Maisonneuve Boulevard, Montréal, QC H4A 3S9, Canada.
Email: [email protected]
Search for more papers by this authorHaris Akhtar MBBS
Division of General Internal Medicine, Department of Medicine, McGill University Health Centre, Montreal, Canada
Search for more papers by this authorShazia H. Chaudhry PhD
School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
Search for more papers by this authorÉmilie Bortolussi-Courval BScN
Division of Experimental Medicine, Department of Medicine, McGill University Health Centre, Montreal, Canada
Search for more papers by this authorRyan Hanula BSc
Division of Experimental Medicine, Department of Medicine, McGill University Health Centre, Montreal, Canada
Search for more papers by this authorAnas Akhtar MBBS
Department of General Surgery, Letterkenny University Hospital, Letterkenny, Ireland
Search for more papers by this authorBénédicte Nauche MBSI
McGill University Health Centre Medical Libraries, Montreal, Canada
Search for more papers by this authorCorresponding Author
Emily G. McDonald MD, MSc
Division of General Internal Medicine, Department of Medicine, McGill University Health Centre, Montreal, Canada
Division of Experimental Medicine, Department of Medicine, McGill University Health Centre, Montreal, Canada
Clinical Practice Assessment Unit, Department of Medicine, McGill University Health Centre, Montreal, Canada
Correspondence
Emily G. McDonald, Division of General Internal Medicine, Department of Medicine, McGill University Health Centre, Office 3E.03 5252 De Maisonneuve Boulevard, Montréal, QC H4A 3S9, Canada.
Email: [email protected]
Search for more papers by this authorThis editorial comments on the article by Reznik and Rudolph in this issue.
Abstract
Background
CT head is commonly performed in the setting of delirium and altered mental status (AMS), with variable yield. We aimed to evaluate the yield of CT head in hospitalized patients with delirium and/or AMS across a variety of clinical settings and identify factors associated with abnormal imaging.
Methods
We included studies in adult hospitalized patients, admitted to the emergency department (ED) and inpatient medical unit (grouped together) or the intensive care unit (ICU). Patients had a diagnosis of delirium/AMS and underwent a CT head that was classified as abnormal or not. We searched Medline, Embase and other databases (informed by PRISMA guidelines) from inception until November 11, 2021. Studies that were exclusively performed in patients with trauma or a fall were excluded. A meta-analysis of proportions was performed; the pooled proportion of abnormal CTs was estimated using a random effects model. Heterogeneity was determined via the I2 statistic. Factors associated with an abnormal CT head were summarized qualitatively.
Results
Forty-six studies were included for analysis. The overall yield of CT head in the inpatient/ED was 13% (95% CI: 10.2%–15.9%) and in ICU was 17.4% (95% CI: 10%–26.3%), with considerable heterogeneity (I2 96% and 98% respectively). Heterogeneity was partly explained after accounting for study region, publication year, and representativeness of the target population. Yield of CT head diminished after year 2000 (19.8% vs. 11.1%) and varied widely depending on geographical region (8.4%–25.9%). The presence of focal neurological deficits was a consistent factor that increased yield.
Conclusion
Use of CT head to diagnose the etiology of delirium and AMS varied widely and yield has declined. Guidelines and clinical decision support tools could increase the appropriate use of CT head in the diagnostic etiology of delirium/AMS.
CONFLICT OF INTEREST
The authors have no conflicts of interest.
Supporting Information
Filename | Description |
---|---|
jgs18134-sup-0001-Supinfo.pdfPDF document, 2.9 MB | Table S1 Studies reporting CT head yield and predictive factors for abnormal CT (n=46). Table S2 Characteristics of studies included in the systematic review (n=46). Table S3 Random-effects meta-regression analyses of studies reporting yield of CT head (%). Table S4 Studies that developed risk score. Table S5 Risk of bias assessment with ROBINS-E tool. Figure S1 Forest plot of the random-effects meta-analysis for diagnostic yield (%) of positive CT head in the in-patient and ED setting, by study region. Figure S2 Forest plot of the random-effects meta-analysis for diagnostic yield (%) of positive CT head in the in-patient and ED setting, by year before or after 2000. Figure S3 Forest plot of the random-effects meta-analysis for diagnostic yield (%) of positive CT head in the in-patient and ED setting, by risk of bias. Figure S4 Forest plot of the random-effects meta-analysis for diagnostic yield (%) of positive CT head in the ICU setting. Figure S5 Forest plot of the random-effects meta-analysis for diagnostic yield (%) of positive CT head, in the ICU setting, by representativeness of the target population. Abbreviations: CAM, confusion assessment method; AMS, altered mental status; FND, focal neurological deficits. Figure S6 Forest plot of the random-effects meta-analysis for diagnostic yield (%) of positive CT head, in the ICU setting, by type of ICU setting. Figure S7 Funnel plot of the random-effects meta-analyses for the diagnostic yield of CT head, in the inpatient and ED setting. |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
REFERENCES
- 1Inouye SK. The dilemma of delirium: clinical and research controversies regarding diagnosis and evaluation of delirium in hospitalized elderly medical patients. Am J Med. 1994; 97(3): 278-288. doi:10.1016/0002-9343(94)90011-6
- 2Francis J, Young B. Diagnosis of delirium and confusional states. 2021.
- 3Gibb K, Seeley A, Quinn T, et al. The consistent burden in published estimates of delirium occurrence in medical inpatients over four decades: a systematic review and meta-analysis study. Age Ageing. 2020; 49(3): 352-360. doi:10.1093/ageing/afaa040
- 4Fong TG, Inouye SK, Jones RN. Delirium, dementia, and decline. JAMA Psychiat. 2017; 74(3): 212. doi:10.1001/jamapsychiatry.2016.3812
10.1001/jamapsychiatry.2016.3812 Google Scholar
- 5Wongpakaran N, Wongpakaran T, Bookamana P, et al. Diagnosing delirium in elderly Thai patients: Utilization of the CAM algorithm. BMC Fam Pract. 2011; 12(1). doi:10.1186/1471-2296-12-65
- 6Leslie DL. One-year health care costs associated with delirium in the elderly population. Arch Int Med. 2008; 168(1): 27-32. doi:10.1001/archinternmed.2007.4
- 7Breitbart W, Gibson C, Tremblay A. The delirium experience: delirium recall and delirium-related distress in hospitalized patients with cancer, their spouses/caregivers, and their nurses. Psychosomatics. 2002; 43(3): 183-194. doi:10.1176/appi.psy.43.3.183
- 8Day J, Higgins I. Existential absence: the lived experience of family members during their older loved one's delirium. Qual Health Res. 2015; 25(12): 1700-1718. doi:10.1177/1049732314568321
- 9Kennedy M, Koehl J, Gao J, Ciampa KA, Hayes BD, Camargo CA Jr. Use of antipsychotic and sedative medications in older patients in the emergency department. J Am Geriatr Soc. 2022; 70(3): 731-742. doi:10.1111/jgs.17590
- 10O'Mahony R. Synopsis of the National Institute for Health and Clinical Excellence guideline for prevention of delirium. Ann Int Med. 2011; 154(11): 746. doi:10.7326/0003-4819-154-11-201106070-00006
- 11Morandi A, Pandharipande P, Trabucchi M, et al. Understanding international differences in terminology for delirium and other types of acute brain dysfunction in critically ill patients. Intens Care Med. 2008; 34(10): 1907-1915. doi:10.1007/s00134-008-1177-6
- 12 iData Research. Over 75 million CT scans are performed each year and growing despite radiation concerns. iData Research blog. 2018. https://idataresearch.com/over-75-million-ct-scans-are-performed-each-year-and-growing-despite-radiation-concerns/.
- 13Brownlee SM, Korenstein D. Better understanding the downsides of low value healthcare could reduce harm. BMJ. 2021; 372: n117. doi:10.1136/bmj.n117
- 14Kale MS, Korenstein D. Overdiagnosis in primary care: framing the problem and finding solutions. BMJ. 2018; 362:k2820. doi:10.1136/bmj.k2820
- 15Korenstein D, Chimonas S, Barrow B, Keyhani S, Troy A, Lipitz-Snyderman A. Development of a conceptual map of negative consequences for patients of overuse of medical tests and treatments. JAMA Intern Med. 2018; 178(10): 1401-1407. doi:10.1001/jamainternmed.2018.3573
- 16Wong JC, Goyal N, McBride WC, Austin MS, Deirmengian GK. Head computed tomography is not useful for evaluating patients change in mental status following total joint arthroplasty. J Arthroplast. 2014; 29(6): 1114-1118. doi:10.1016/j.arth.2013.12.030
- 17Narayanan V, Keniston A, Albert RK. Utility of emergency cranial computed tomography in patients without trauma. Acad Emerg Med. 2012; 19(9): E1055-E1060. doi:10.1111/j.1553-2712.2012.01437.x
- 18Beaty CA, Arnaoutakis GJ, Grega MA, et al. The role of head computed tomography imaging in the evaluation of postoperative neurologic deficits in cardiac surgery patients. Ann Thorac Surg. 2013; 95(2): 548-554. doi:10.1016/j.athoracsur.2012.11.006
- 19Novoa Ferro M, Santos Armentia E, Silva Priegue N, Jurado Basildo C, Sepúlveda Villegas CA, Del Campo ES. Tomografía computarizada cerebral solicitada desde Urgencias: la realidad. Radiología. 2020;S0033-8338(20)30123-30125. doi:10.1016/j.rx.2020.08.005
- 20Stroup DF. Meta-analysis of observational studies in epidemiology a proposal for reporting. JAMA. 2000; 283(15): 2008. doi:10.1001/jama.283.15.2008
- 21Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009; 339(1): b2535. doi:10.1136/bmj.b2535
- 22Stiell IG, Wells GA, Vandemheen K, et al. The Canadian CT Head Rule for patients with minor head injury. Lancet. 2001; 357(9266): 1391-1396. doi:10.1016/s0140-6736(00)04561-x
- 23Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016; 5(1): 210. doi:10.1186/s13643-016-0384-4
- 24 ROBINS-E Development Group, Higgins J, Morgan R, et al Risk Of Bias In Non-randomized Studies - of Exposure (ROBINS-E). Launch version, 1. 2022. Available from: https://www.riskofbias.info/welcome/robins-e-tool.
- 25Mustafa RA, Santesso N, Brozek J, et al. The GRADE approach is reproducible in assessing the quality of evidence of quantitative evidence syntheses. J Clin Epidemiol. 2013; 66(7): 736-742; quiz 742.e1-5. doi:10.1016/j.jclinepi.2013.02.004
- 26Inouye SK, van Dyck CH, Alessi CA, Balkin S, Siegal AP, Horwitz RI. Clarifying confusion: the confusion assessment method. A new method for detection of delirium. Ann Intern Med. 1990; 113(12): 941-948. doi:10.7326/0003-4819-113-12-941
- 27Trzepacz PT, Baker RW, Greenhouse J. A symptom rating scale for delirium. Psychiatry Res. 1988; 23(1): 89-97. doi:10.1016/0165-1781(88)90037-6
- 28Adamis D, Sharma N, Whelan PJ, Macdonald AJ. Delirium scales: A review of current evidence. Aging Ment Health. 2010; 14(5): 543-555. doi:10.1080/13607860903421011
- 29Hirano LA, Bogardus ST Jr, Saluja S, Leo-Summers L, Inouye SK. Clinical yield of computed tomography brain scans in older general medical patients. J Am Geriatr Soc. 2006; 54(4): 587-592. doi:10.1111/j.1532-5415.2006.00692.x
- 30Finkelmeier F, Walter S, Peiffer K-H, et al. Diagnostic yield and outcomes of computed tomography of the head in critically Ill nontrauma patients. J Intens Care Med. 2017; 34(11-12): 955-966. doi:10.1177/0885066617720901
- 31Shuaib W, Tiwana MH, Chokshi FH, Johnson JO, Bedi H, Khosa F. Utility of CT head in the acute setting: value of contrast and non-contrast studies. Ir J Med Sci. 2014; 184(3): 631-635. doi:10.1007/s11845-014-1191-3
- 32Sterne JAC, Sutton AJ, Ioannidis JPA, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011; 343(1): d4002. doi:10.1136/bmj.d4002
- 33Segard J, Montassier E, Trewick D, Le Conte P, Guillon B, Berrut G. Urgent computed tomography brain scan for elderly patients. Europ J Emerg Med. 2013; 20(1): 51-53. doi:10.1097/mej.0b013e32834f9d51
- 34Leong LB, Wei Jian KH, Vasu A, Seow E. Identifying risk factors for an abnormal computed tomographic scan of the head among patients with altered mental status in the Emergency Department. Europ J Emerg Med. 2010; 17(4): 219-223. doi:10.1097/mej.0b013e328331dde5
- 35Khan S, Guerra C, Khandji A, Bauer RM, Claassen J, Wunsch H. Frequency of acute changes found on head computed tomographies in critically ill patients: A retrospective cohort study. J Critic Care. 2014; 29(5): 884.e7-884.e12. doi:10.1016/j.jcrc.2014.05.001
- 36Hufschmidt A, Shabarin V. Diagnostic yield of cerebral imaging in patients with acute confusion. Acta Neurologica Scandinavica. 2008; 118(4): 245-250. doi:10.1111/j.1600-0404.2008.01006.x
- 37Rothrock SG, Buchanan C, Green SM, Bullard T, Falk JL, Langen M. Cranial computed tomography in the emergency evaluation of adult patients without a recent history of head trauma: a prospective analysis. Acad Emerg Med. 1997; 4(7): 654-661. doi:10.1111/j.1553-2712.1997.tb03756.x
- 38Harris JE. High yield criteria for emergency cranial computed tomography in adult patients with no history of head injury. Emerg Med J. 2000; 17(1): 15-17. doi:10.1136/emj.17.1.15
- 39Tan I, Young N, Sindhusake DP, et al. Prospective evaluation of selected clinical criteria for cranial computed tomography in non-trauma adult patients. Emerg Med Austral. 2009; 21(1): 43-51. doi:10.1111/j.1742-6723.2008.01151.x
- 40Lai MMY, Tin W, Niam DM. Intracranial cause of delirium: computed tomography yield and predictive factors. Int Med J. 2012; 42(4): 422-427. doi:10.1111/j.1445-5994.2010.02400.x
- 41Wang X, You JJ. Head CT for nontrauma patients in the Emergency Department: clinical predictors of abnormal findings. Radiology. 2013; 266(3): 783-790. doi:10.1148/radiol.12120732
- 42Tung C, Lindgren A, Siemund R, van Westen D. Emergency room decision-making for urgent cranial computed tomography: selection criteria for subsets of non-trauma patients. Acta Radiol. 2014; 55(7): 847-854. doi:10.1177/0284185113506137
- 43Bent C, Lee PS, Shen PY, Bang H, Bobinski M. Clinical scoring system may improve yield of head CT of non-trauma emergency department patients. Emerg Radiol. 2015; 22(5): 511-516. doi:10.1007/s10140-015-1305-x
- 44Covino M, Gilardi E, Manno A, et al. A new clinical score for cranial CT in ED non-trauma patients: Definition and first validation. Am J Emerg Med. 2019; 37(7): 1279-1284. doi:10.1016/j.ajem.2018.09.032
- 45Hu SY, Hsieh MS, Lin MY, et al. Trends of CT utilisation in an emergency department in Taiwan: a 5-year retrospective study. BMJ Open. 2016; 6(6):e010973. doi:10.1136/bmjopen-2015-010973
- 46Sinclair DE, Kovacs G, Hillis M. Cranial CT scans-emergency department utilization. J Emerg Med. 1993; 11(5): 643-646. doi:10.1016/0736-4679(93)90325-2
- 47Thacker PJ, Sethi M, Sternlieb J, Schneider D, Naglak M, Patel RR. Rapid Response: To Scan or Not to Scan? The Utility of Noncontrast CT Head for Altered Mental Status. J Patient Saf. 2018; 17(8): e1125-e1129. doi:10.1097/pts.0000000000000447
- 48Purmer IM, van Iperen EP, Beenen LFM, et al. Brain computer tomography in critically ill patients - a prospective cohort study. BMC Med Imag. 2012; 12(1). doi:10.1186/1471-2342-12-34
- 49Benbadis SR, Sila CA, Cristea RL. Mental status changes and stroke. J Stroke Cerebrovasc Dis. 1994; 4(4): 216-219. doi:10.1016/s1052-3057(10)80093-x
- 50Brown G, Warren M, Williams JE, Adam EJ, Coles JA. Cranial computed tomography of elderly patients: an evaluation of its use in acute neurological presentations. Age Ageing. 1993; 22(4): 240-243. doi:10.1093/ageing/22.4.240
- 51Chokshi FH, Sadigh G, Carpenter W, Kang J, Duszak R Jr, Khosa F. Altered mental status in ICU patients. Critic Care Med. 2016; 44(12): e1180-e1185. doi:10.1097/ccm.0000000000002005
- 52Hardy JE, Brennan N. Computerized tomography of the brain for elderly patients presenting to the emergency department with acute confusion. Emerg Med Austr. 2008; 20(5): 420-424. doi:10.1111/j.1742-6723.2008.01118.x
- 53Hasan LM, Khan A, Singh M, Malone ML. Brain imaging in older patients with delirium. J Patient Centered Res Rev. 2017; 4(4): 261. doi:10.17294/2330-0698.1611
10.17294/2330-0698.1611 Google Scholar
- 54Hijazi Z, Lange P, Watson R, Maier AB. The use of cerebral imaging for investigating delirium aetiology. Europ J Int Med. 2018; 52: 35-39. doi:10.1016/j.ejim.2018.01.024
- 55Shin S, Lee HJ, Shin J, Lee S. Predictors of abnormal brain computed tomography findings in patients with acute altered mental status in the Emergency Department. Clin Exp Emerg Med. 2018; 5(1): 1-6. doi:10.15441/ceem.16.163
- 56Mehta A, Khirfan G, Shah P, et al. Scanning the confusion away: the diagnostic utility of head computer tomography (CT) in the evaluation of altered mental status in a non-neurological medical ICU of a Tertiary Care Center. Chest. 2016; 150(4): 289A. doi:10.1016/j.chest.2016.08.302
- 57Naughton BJ, Moran M, Ghaly Y, Michalakes C. Computed tomography scanning and delirium in elder patients. Acad Emerg Med. 2000; 7(5): 1107-1110. doi:10.1111/j.1553-2712.2000.tb03839.x
10.1111/j.1553-2712.1997.tb03690.x Google Scholar
- 58Owlia M, Yu L, Deible C, Hughes MA, Jovin F, Bump GM. Head CT scan overuse in frequently admitted medical patients. Am J Med. 2014; 127(5): 406-410. doi:10.1016/j.amjmed.2014.01.023
- 59Theisen-Toupal J, Breu AC, Mattison MLP, Arnaout R. Diagnostic yield of head computed tomography for the hospitalized medical patient with delirium. J Hosp Med. 2014; 9(8): 497-501. doi:10.1002/jhm.2198
- 60Vijayakrishnan R, Ramasubramanian A, Dhand S. Utility of head CT scan for acute inpatient delirium. Hospital Top. 2015; 93(1): 9-12. doi:10.1080/00185868.2015.1012928
- 61Wood LP, Parisi M, Finch IJ. Value of contrast enhanced CT scanning in the non-trauma emergency room patient. Neuroradiology. 1990; 32(4): 261-264. doi:10.1007/bf00593043
- 62Salerno D, Marik PE, Daskalakis C, Kolm P, Leone F. The role of head computer tomographic scans on the management of MICU patients with neurological dysfunction. J Intensive Care Med. 2009; 24(6): 372-375. doi:10.1177/0885066609344940
- 63Rafanan AL, Kakulavar P, Perl J II, Andrefsky JC, Nelson DR, Arroliga AC. Head computed tomography in medical intensive care unit patients: clinical indications. Critic Care Med. 2000; 28(5): 1306-1309. doi:10.1097/00003246-200005000-00008
- 64Roberts MA, Caird FI. The contribution of computerized tomography to the differentia diagnosis of confusion in elderly patients. Age Ageing. 1990; 19(1): 50-56. doi:10.1093/ageing/19.1.50
- 65Bilbault P. Non-trauma CT head scans in the emergency department: are we doing too much? Emerg Med J. 2009; 26(2): 151. doi:10.1136/emj.2008.060335
- 66West WM, Ali A, West KP, Stultz R. Acute computed tomography findings in patients with acute confusion of non-traumatic aetiology. West Ind Med J. 2011; 60(5): 571-575.
- 67Balachandran JS, Jaleel M, Jain M, et al. Head CT is of limited diagnostic value in critically ill patients who remain unresponsive after discontinuation of sedation. BMC Anesthesiol. 2009; 9(1). doi:10.1186/1471-2253-9-3
- 68Marik PE, Rakusin A, Sandhu SS. The impact of the accessibility of cranial CT scans on patient evaluation and management decisions. J Intern Med. 1997; 241(3): 241-247. doi:10.1046/j.1365-2796.1997.102116000.x
- 69Huang Y-S, Syue Y-J, Yen Y-L, Wu C-H, Ho Y-N, Cheng F-J. Physician risk tolerance and head computed tomography use for patients with isolated headaches. J Emerg Med. 2016; 51(5): 564-571.e1. doi:10.1016/j.jemermed.2016.06.012
- 70Maharaj I, Tosiello L. The Canadian CT head rule. The Lancet. 2001; 358(9286): 1013. doi:10.1016/s0140-6736(01)06139-6
- 71Stiell IG, Clement C, Rowe BH, et al. Multicenter prospective validation of the New Orleans criteria for CT in minor head injury. Acad Emerg Med. 2003; 10(5): 477.
10.1197/aemj.10.5.477 Google Scholar
- 72 Investigators* WGftCS. Effectiveness of managing suspected pulmonary embolism using an algorithm combining clinical probability, D-Dimer testing, and computed tomography. JAMA. 2006; 295(2): 172-179. doi:10.1001/jama.295.2.172
- 73Wells PS, Anderson DR, Bormanis J, et al. Value of assessment of pretest probability of deep-vein thrombosis in clinical management. The Lancet. 1997; 350(9094): 1795-1798. doi:10.1016/S0140-6736(97)08140-3
- 74Stiell I, Wells G, Laupacis A, et al. Multicentre trial to introduce the Ottawa ankle rules for use of radiography in acute ankle injuries. BMJ. 1995; 311(7005): 594-597. doi:10.1136/bmj.311.7005.594
- 75Brenner DJ, Hall EJ. Computed tomography — an increasing source of radiation exposure. N Engl J Med. 2007; 357(22): 2277-2284. doi:10.1056/nejmra072149
- 76 CT Scan - Private CT, CT Procedure. 2018.
- 77Wei LA, Fearing MA, Sternberg EJ, Inouye SK. The confusion assessment method: a systematic review of current usage. J Am Geriat Soc. 2008; 56(5): 823-830. doi:10.1111/j.1532-5415.2008.01674.x