Validity and reliability of a portable application for the evaluation of selective attention
Abstract
The purpose of this study is to check the validity and reliability of an application, built in the context of research to assess the selective attention of athletes. This study was chosen because, based on the international literature, there is a lack of software for mobile devices and its use in the evaluation of selective attention. In addition, nowadays the portability of measuring devices and their easy management by unskilled personnel is considered important. More specifically, the use of SuperLab™ 2.0 (Cedrus Corporation) created a test for the evaluation of selective attention. Using the App Inventor platform, a software was created for use on a mobile device, respectively. Both the SuperLab test and the portable software met specific requirements and specifications. The study involved 42 students of the Department of Physical Education & Sports Science at the Democritus University of Thrace, aged 18 to 22, clinically healthy. They implemented the test in the Super Lab and then did the same in the mobile device application. The results of the measurements of both software were analyzed with the help of the statistical package SPSS 24. The test-retest reliability analysis method was used to check the reliability of the measurement (selective attention). For data processing, indicators were used to evaluate both relative (ICC) and absolute reliability (SEM, SEM%, 95% LOA) (Atkinson & Nevill, 1998; Bland & Altman, 1986). The significance level was set at p <0.05. The analysis of the data showed that the application for mobile devices, created for the given study, presents homogeneous measurements with those of the software SuperLab™ 2.0 (Cedrus Corporation). The measurement findings provide useful information for a future survey of a larger sample.References
Assef, E. C. S., Capovilla, A. G. S., & Capovilla, F. C. (2007). Computerized Stroop Test to Assess Selective Attention in Children with Attention Deficit Hyperactivity Disorder. The Spanish Journal of Psychology, 10(1), 33-40.
Atkinson, G., & Nevill, A. M. (1998). Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Medicine, 26, 217-238.
Bland, J. M., & Altman, D. G. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. Lancet, 1, 307-310.
Bower, M., & Sturman, D. (2015). What are the educational affordances of wearable technologies? Computers and Education, 88, 343-353.
Bowie C. R & Harvey P. D. (2006). Administration and interpretation of the Trail Making Test. Nature Protocols, 1(5), 2277-2281.
Carota L., Indiverib G., & Dantec V. (2004) A software–hardware selective attention system. Neurocomputing, 58-60, 647-653.
Coppetti, T., Brauchlin, A., Muggler, S., Attinger-Toller, A., Templin, C., Schonrath, F., Hellermann, J., Luscher, T. F., Biaggi, P. and Wyss, C. A., (2017). Accuracy of smartphone apps for heart rate measurement. European Journal of Preventive Cardiology, 24(12), 1287-1293.
Draper, B. A., & Lionelle, A., (2005). Evaluation of selective attention under similarity transformation. Computer Vision and Image Understanding, 100(1–2), 152-171.
Elhai, J. D., Dvorak, R. D., Levine, J. C., Hall, B. J. (2017). Problematic smartphone use: A conceptual overview and systematic review of relations with anxiety and depression psychopathology. Journal of Affective Disorders, 207, 251-259.
Galán-Mercant A., Barón-López F. J., Labajos-Manzanares M. T., Cuesta-Vargas A. I. (2014). Reliability and criterion-related validity with a smartphone used in timed-up-and-go test. BioMedical Engineering OnLine, 13, 156.
Han, S., Lee, D., & Lee, S. (2016). A study on the reliability of measuring dynamic balance ability using a smartphone. The Journal of Physical Therapy Science, 28(9), 2515-2518.
Jenny J. (2013). Measurement of the Knee Flexion Angle with a Smartphone-Application is Precise and Accurate. Journal of Arthroplasty, 28(5), 784-787.
Jung J., Kim Y., & Chan-Olmsted S., (2014). Measuring usage concentration of smartphone applications: Selective repertoire in a marketplace of choices. Mobile Media & Communication, 2(3), 352-368.
Koo, T. K., & Li, M. Y. (2016). A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. Journal of chiropractic medicine, 15(2), 155–163.
Latif, M. Z., Hussain, I., Saeed, R., Qureshi, M. A., & Maqsood, U. (2019). Use of Smart Phones and social media in Medical Education: Trends, Advantages, Challenges and Barriers. Acta informatica medica: AIM: journal of the Society for Medical Informatics of Bosnia & Herzegovina: casopis Drustva za medicinsku informatiku BiH, 27(2), 133–138.
Luis, C. S., Del La Llave, A. L., & Perez-Llantada, M. C. (2013). Training to improve selective attention in children using neurofeedback through play. Revista de Psicopatologia y Psicologia Clinica, 18, 209-216.
Matsumura K. & Takehiro Yamakoshi T. (2013). iPhysioMeter: A new approach for measuring heart rate and normalized pulse volume using only a smartphone. Behavior Research Methods, 45(4), 1272-1278.
McHenry, M. S., Fischer, L. J., Chun, Y., & Vreeman, R. C. (2019). A systematic review of portable electronic technology for health education in resource-limited settings. Global health promotion, 26(2), 70–81. https://doi.org/10.1177/1757975917715035
Milani P., Coccetta C. A., Rabini A., Sciarra T., Massazza G. (2014). Mobile Smartphone Applications for Body Position Measurement in Rehabilitation: A Review of Goniometric Tools. PM & R: the journal of injury, function, and rehabilitation, 6(11), 1038-1043.
Mishra, T., Indramani, N., Singh, L., Singh, T., & Tiwari, T. (2016). Effects of visual warning cue on sustained attention task performance. Indian Journal of Health and Wellbeing, 7(8), 795-798.
Qiao J., Liu Z., Xu L., Wu T., Zheng X., Zhu Z., Zhu F., Qian B. and Qiu Y. (2012). Reliability Analysis of a Smartphone-aided Measurement Method for the Cobb Angle of Scoliosis. Journal of Spinal Disorders & Techniques, 25(4): e88-92.
Tehrani, K., Michael, A. (2014). Wearable technology and wearable devices: Everything you need to know. Wearable Devices Magazine. Retrieved from http://www.wearabledevices.com/what-is-a-wearable-device/
Veneri, G., Federico, A., & Rufa, A. (2014). Evaluating the influence of motor control on selective attention through a stochastic model: the paradigm of motor control dysfunction in cerebellar patient. BioMed research international, 2014, 162423.
Ventola C. L. (2014). Mobile devices and apps for health care professionals: uses and benefits. P & T: a peer-reviewed journal for formulary management, 39(5), 356–364.
Werner, B. C., Holzgrefe, R. E., Griffin, J. W., Lyons, M. L., Cosgrove, C. T., Hart, J. M., & Brockmeier, S. F. (2014). Validation of an innovative method of shoulder range-of-motion measurement using a smartphone clinometer application. Journal of shoulder and elbow surgery, 23(11), 275–282.
Wilson, H. K., (2015). A Critical Evaluation of Selective Attention Measures. Psychology, 1-42.
Woods, D. L., Wyma, J. M., Yund, E. W., Herron, T. J., & Reed, B. (2015). Factors influencing the latency of simple reaction time. Frontiers in human neuroscience, 9, 131.
Downloads
Published
How to Cite
Issue
Section
License
Authors who publish with this journal agree to the following terms:
a. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
b. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
c. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
