Test-Retest Reliability of Shoulder Function Capacity using the EvalTech System
Abstract
Objective: The EvalTech system is often used to evaluate an individual’s functional shoulder performance in a work-related manner. However, there is a lack of information on the reliability of functional capacity evaluations (FCE) performed using the EvalTech system.
Material and Methods: This study considered the test-retest reliability of FCE for shoulder function in the push and pull and time measurement tests in 31 healthy young adults. Reliability was estimated using intraclass Correlation Coefficients (ICC2,1).
Results: The shoulder level push test had good to excellent reliability (ICC=0.88-0.93), the shoulder level pull test showed good reliability (ICC=0.81-0.83), the cart level push showed excellent reliability (ICC=0.95-0.97), and the cart level pull test showed excellent reliability (ICC=0.90-092). However, the combination of time measurement and overhead reaching tests showed only moderate reliability (ICC=0.66-0.72).
Conclusion: This indicates that the EvalTech system has good to excellent reliability in the push and pull tests, and moderate reliability in time measurement tests. This data should be considered by assessors when interpreting changes due to interventions and return-to-work assessments.
Impact Statement: This may have relevance to physical therapists performing FCE and supports the wider use of the EvalTech system, as this offers greater reliability and shorter assessment times than alternative systems when considering return-to-work assessments.
Keywords
Full Text:
PDFReferences
Executive HaS. Work related musculoskeletal disorder statistics (WRMSDs) in Great Britain, 2020 [monograph on the Internet]. Great Britain: Health and Safety Executive; [cited 2021 May 14]. Available from: https://www.hse.gov.uk/statistics/causdis/msd.pdf
Acquah AA, D’Souza C, Martin BJ, Arko-Mensah J, Dwomoh D, Nti AAA, et al. Musculoskeletal Disorder Symptoms among Workers at an Informal Electronic-Waste Recycling Site in Agbogbloshie, Ghana. Int J Environ Res Public Health 2021;18:2055.
Laorujisawat M. Ergonomic risk factors and guidance on the management of work-related musculoskeletal disorders (WMSDs) in the poultry industry. Thai Journal of Ergonomics 2020;3:65-75.
Renberg J, Wiggen ØN, Tvetene PØS, Færevik H, Van Beekvelt M, Roeleveld K. Effect of working position and cold environment on muscle activation level and fatigue in the upper limb during manual work tasks. Int J Ind Ergon 2020;80:103035.
Pillastrini P, Mugnai R, Bertozzi L, Costi S, Curti S, Guccione A, et al. Effectiveness of an ergonomic intervention on work-related posture and low back pain in video display terminal operators: a 3 year cross-over trial. Appl Ergon 2010;41:436-43.
Acquah AA, D’Souza C, Martin B, Arko-Mensah J, Nti AA, Kwarteng L, et al., editors. Processes and challenges associated with informal electronic waste recycling at Agbogbloshie, a suburb of Accra, Ghana. Proceedings of the Human Factors and Ergonomics Society Annual Meeting; 2019: SAGE Publications Sage CA: Los Angeles, CA.
Ohnishi A, Takanokura M, Sugama A. Evaluation of interhandle distance during pushing and pulling of a four-caster cart for upper limb exertion. Saf Health Work 2016;7:237-43.
Buddenberg LA, Davis C. Test–retest reliability of the Purdue pegboard Test. Am J Occup Ther 2000;54:555-8.
Proud EL, Bilney B, Miller KJ, Morris ME, McGinley JL. Measuring hand dexterity in people with Parkinson’s disease: reliability of pegboard tests. Am J Occup Ther 2019;73:7304205050p1-p8.
Chen JJ. Functional capacity evaluation & disability. Iowa Orthop J 2007;27:121.
Bieniek S, Bethge M. The reliability of WorkWell systems functional capacity evaluation: a systematic review. BMC Musculoskelet Disord 2014;15:1-13.
BTE Technologies. EvalTech: full-suite objective evaluation and testing system [homepage on the Internet]. Hanover (MD): BTE Technologies; [cited 2026 May 14]. Available from: https://www.btetechnologies.com/products/evaluationtesting/evaltech/
Portney LG, Watkins MP. Foundations of clinical research: applications to practice: Pearson/Prentice Hall Upper Saddle River, NJ; 2009.
Kollock Jr RO, Onate JA, Van Lunen B. The reliability of portable fixed dynamometry during hip and knee strength assessments. J Athl Train 2010;45:349-56.
Reneman M, Brouwer S, Meinema A, Dijkstra P, Geertzen J, Groothoff J. Test–retest reliability of the Isernhagen work systems functional capacity evaluation in healthy adults. J Occup Rehabil 2004;14:295-305.
James C, Mackenzie L, Capra M. Inter-and intra-rater reliability of the manual handling component of the WorkHab Functional Capacity Evaluation. Disabil Rehabil 2011;33:1797-804.
De Baets S, Calders P, Schalley N, Vermeulen K, Vertriest S, Van Peteghem L, et al. Updating the evidence on functional capacity evaluation methods: a systematic review. J Occup Rehabil 2018;28:418-28.
Amirjani N, Ashworth NL, Olson JL, Morhart M, Chan KM. Validity and reliability of the Purdue pegboard Test in carpal tunnel syndrome. Muscle Nerve 2011;43:171-7.
Zetterberg C, Heiden M, Lindberg P, Nylén P, Hemphälä H. Reliability of a new risk assessment method for visual ergonomics. Int J Ind Ergon 2019;72:71-9.
Gouttebarge V, Wind H, Kuijer PP, Sluiter JK, Frings-Dresen MH. Intra-and interrater reliability of the Ergo-Kit functional capacity evaluation method in adults without musculoskeletal complaints. Arch Phys Med Rehabil 2005;86:2354-60.
Refbacks
- There are currently no refbacks.
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.