ºÚÁÏÍø

A Comparison of Three types of Trail Making Test in the Korean Elderly: Higher Completion Rate of Trail Making Test-Black and White for Mild Cognitive Impairment

Karyeong Kim¹, Jae-Won Jang², Min Jae Baek¹ and Sang Yun Kim^1,3*

¹Clinical Neuroscience Center, Seoul National University Bundang Hospital, Seongnam, Republic of Korea

²Department of Neurology, Kangwon National University Hospital, Chuncheon, Republic of Korea

³Department of Neurology, Seoul National University College of Medicine, Seoul, Korea

Corresponding Author:

SangYun Kim
Department of Neurology, Seoul National University Bundang Hospital
300 Gumi-dong, Bundang-gu, Seongnam-si, 463-707, Republic of Korea
Tel: +82 31 787 7462
E-mail: neuroksy@snu.ac.kr

Received Date: May 25, 2016; Accepted Date: May 30, 2016; Published Date: June 07, 2016

Citation: Kim K, Jang JW, Baek MJ, Kim SY (2016) A Comparison of Three types of Trail Making Test in the Korean Elderly: Higher Completion Rate of Trail Making Test-Black and White for Mild Cognitive Impairment. J Alzheimers Dis Parkinsonism 6:239. doi: 10.4172/2161-0460.1000239

Copyright: © 2016 Kim K, et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Visit for more related articles at Journal of Alzheimers Disease & Parkinsonism

Abstract

Objective: A Korean version of Trail Making Test (TMT) led to reduced clinical use in Korea because of lower completion rate. The current study examines multiple TMT versions in effort to identify which type might accurately detect cognitive decline with higher completion rate.

Methods: Three versions of TMT including the original TMT, TMT-Korean Letter (TMT-K), and TMT-Black and White (TMT-B&W) were utilized. A total of 62 participants were included, comprised of 30 cognitively normal controls (NC) and 32 mild cognitive impairment (MCI). Three TMT versions were administered to subjects with other neuropsychological tests.

Results: TMT-B&W completion time as well as that of Original TMT and TMT-K was successful in distinguishing MCI from NC adjusted for age, sex and educational level. TMT-B&W also showed a high correlation with other neuropsychological tests that represent frontal executive function. Regarding completion rate in MCI patients, Original TMT and TMT-K were not successfully completed (62% and 60.6%, respectively) compared with TMT-B&W (90.1%).

Conclusion: As TMT-B&W showed higher completion rate than others and revealed significant correlation with frontal executive function, this culture-fair measure can vitalize TMT task with increased applicability in Korean elderly adults who are unfamiliar with the sequence of English or Korean alphabet.

Keywords

Trail making test; Frontal lobe function test; Mild cognitive impairment

Introduction

As widely used neuropsychological test in a clinical setting [1], the Trial Making Test (TMT) identifies and distinguishes cognitive impairment [2-4] in a concise and simple manner [5-7]. The TMT has two parts: part A requires the test-taker to connect numbers (1-25) that are randomly distributed on a test paper (1->2->3…), while part B calls for the test-taker to alternate numbers and letters (1->A->2->B…) (Figure 1a). Part B requires more complex cognitive functions [8], and has proven to be sensitive to prefrontal cortical damage [9,10].

Figure 1: Three versions of Trail Making Test. Practice tests of original TMT (a), TMT-Korean Letter (b) and TMT-Black and white (c).

Past researchers have tried to develop a Korean version of TMT (TMT-K). In the initial version of TMT-K, part A used the same test sheet as the original TMT, while part B consisted of numbers and Korean alphabet (ê°Â?, ëÂ?Â?, ëÂ?¤……), instead of English alphabet (Figure 1b). However, even adults with normal cognitive ability had difficulty recalling the series of Korean characters, leading to poorer than expected performance on this task [11]. To accommodate testing in the elderly, who have a shorter attention span and lower educational level; researchers devised the Korean-Trail Making Test for the Elderly (K-TMT-e) [12]. However, K-TMT-e was too simple that it did not discriminate those with mild cognitive impairment (MCI) from cognitively normal subjects and showed no correlation with other cognitive tests that represent frontal executive function. Continued efforts to develop a TMT-K by replacing the stimuli of English alphabet in TMT-B with other characters have not been successful, in turn, leading to infrequent clinical use of the TMT [13]. To overcome these problems that might be caused by using alphabet, we developed the Trail Making Test-Black & White (TMT-B&W) using colours and Figures as stimuli in the same trace as the original ones [14] (Figure 1c).

The aims of the current study were 1) to validate the new versions of TMT-B&W in effort to maximize test-taker performance, and 2) to administer the three versions of these tests in older Korean healthy and patient with cognitively impaired subjects, to distinguish groups at the stage of mild cognitive impairment.

Materials and Methods

Subjects

Our subjects sample was a group of consecutive Korean patients who visited a health care centre of Seoul National University Bundang Hospital with complaint of memory decline. Inclusion criteria for mild cognitive impairment (MCI) based on Peterson criteria [15], were as follows: 1) cognitive complaints verified by a collateral source of information; 2) objectively abnormal cognitive impairment in one or more cognitive functions; 3) preserved ADL function; 4) normal visual and auditory functions; 5) no previously diagnosed neurological or psychiatric diseases; 6) failure to meet the diagnostic criteria of dementia based on the National Institute of Neurological and Communicative Disorders and Stroke and Alzheimer’s Disease and Related Disorders Association (NINCDS-ADRDA) [16].

The outpatients from a health care centre or caregivers of patients from Clinical Neuroscience Centre of Seoul National University Bundang Hospital were recruited as subjects with normal cognition (NC). Criteria for the NC group were as follows: 1) no cognitive complaint verified by any measurable information; 2) Mini-Mental State Examination (MMSE) no more than one standard below the mean for education and age [17]; 3) absence of significant impairment in any cognitive functions; 4) preserved activities of daily living (ADL) [18,19]; 5) absence of medical history that could undermine cognitive functions [20]; and 6) Geriatric Depression Scale (GDS) of less than 17 on the 30 item scale in the past week, suggesting absence of clinically significant depression.

After assessing for eligibility test for consecutively recruited 166 subjects, we excluded 51 individuals requiring more than 300 s to complete any type of TMT-B form and 53 subjects considered to have probable AD with mild dementia according to the NINCDS-ADRDA criteria [16]. Finally, this study included 62 total participants, comprised of 30 cognitively normal controls (NC) and 32 patients diagnosed with mild cognitive impairment (MCI).

This study was approved by the Seoul National University Hospital Institutional Review Board and written informed consent was obtained from all subjects before all procedures. The approval number is “B- 1306/208-107”.

Materials

Trail making test: Th e current study used three different forms of TMT. This study used 216 × 276 mm (letter size) paper, directions, and the trace of stimuli, in the same way as the original TMT [21]. The TMT versions included:

a. The original English version of the TMT (TMT-OR) (Figure 1a)

b. The TMT-Korean Letter (TMT-K) in which English letters are replaced with Korean letters (Figure 1b)

c. the TMT-Black and White (TMT-B&W), which has white numbers in black circles and black numbers in white circles distributed on a test sheet, composed of part A and B (Figure 1c). TMT-B&W part A (TMT-B&W-A) requires participants to draw a line to connect the 25 encircled numbers in ascending order without lifting their pen or pencil from the test sheet, as they complete part A of TMT (TMT-A). For the TMT-B&W Part B (TMT-B&W-B), numbers from 1 to 25 are presented in white and black backgrounds. The participant is instructed to connect consecutive numbers, alternating between white and black circles (i.e., 1(W)-2(B)- 3(W)-4(B)…).

Instructions were conducted in the same manner of the original TMT. An exercise trial was conducted before the test trial to make sure each participant fully understood how to do the task. A researcher started recording time as soon as the participant put the pen or pencil on the first circle and stopped measuring time when the pencil touched the last number. The time taken to complete the task was measured in seconds and 300 s for each TMT were allowed as maximum time. In order to control for learning effects, three tests were assigned randomly to subjects.

Other neuropsychological tests: Given that the intention of the current study was to determine feasibility of different versions of the TMT within the context of other neuropsychological evaluation, several other standard neuropsychological assessment tools that represent frontal executive function were used. These included Controlled Oral Word Association Task (COWAT) and Stroop test.

Method

Prior to the test, all participants’ personal information and level of subjective cognitive impairment was gathered through interview, and Mini-mental state examination (MMSE) was completed. Each participant was administered three types of TMT and subsequently given the neuropsychological test in order to minimize any possible influence of other neuropsychological tests on TMT performance. All tests were individually administered.

Statistical analysis

Student’s t-test was used to assess differences in age, education level. Multivariate analysis of covariance (MANCOVA) test was used to determine presence of any group differences in TMT time-to-completion as well as the results of other neuropsychological test between clinical groups, with age, education and gender as covariates. The chi-square (χ2) test was used to assess difference in categorical variables. To ensure construct validity of each TMT, we conducted correlations between the three types of TMT and other neuropsychological tests using Pearson’s R coefficient. Receiver operating characteristics (ROC) curves were obtained to evaluate whether the TMT showed difference in the clinical groups. All analyses were done with the PASW statistics version 18.0, with the statistical significance level set to P<0.05

Results

The demographic and clinical characteristics of the participants are described in Table 1. There were significant differences in age and gender between clinical groups (p<0.006 and p<0.001, respectively). Compared to NC subjects, MCI subjects demonstrated significantly lower MMSE scores, COWAT-Semantic word fluency, COWATPhonemic word fluency scores and Stroop test scores.

Table 1: Baseline demographics and characteristics according to diagnostic groups.

The original trail making test

There were significant group differences in time-to-completion of TMT-OR-A and TMT-OR-B adjusted for age, gender and level of education (p=0.003 for part A and p<0.001 for part B) (Table 1).

Finally, just 78 subjects out of 113 participants completed the TMT-OR that overall completion rate of TMT-OR was 69% (Figure 2). According to clinical group, 35 subjects out of 42 completed in NC and 44 subjects out of 71 in MCI completed TMT-OR that completion rate were 83.3% and 62%, respectively.

Figure 2: Completion rate of each version of Trail Making Test according to clinical group.

Korean version of trail making test

A significant difference in completion time for the TMT-K was noted between NC and MCI adjusted for age, gender and level of education. (p=0.003 for part A and p<0.001 for part B) (Table 1). Regarding completion of TMT-K, 77 subjects out of 113 completed the TMT-K that overall completion rate of TMT-K was 68.1% that revealed no difference compared with that of TMT-OR (Figure 2). According to clinical group, 34 subjects out of 42 completed in NC and 43 subjects out of 71 in MCI completed TMT-K that completion rate were 81.0% and 60.6%, respectively that showed no significant difference compared with those of TMT-OR.

Trail making test-black and white

Time-to-completion of TMT-B&W-A and B differentiated between NC and MCI adjusted for age, gender and level of education (p<0.001) (Table 1). Regarding completion of TMT-B&W, 105 subjects out of 113 completed the TMT-K that overall completion rate was 92.9% that revealed higher rate compared with that of TMT-OR or TMT-K (Figure 2). According to clinical group, 41 subjects out of 42 completed in NC and 64 subjects out of 71 in MCI completed TMT-B&W that completion rate were 97.6% and 90.1%, respectively that showed significantly higher rate compared with those of TMT-OR or TMT-K in MCI.

We performed a ROC analysis and estimated the area under the curve (AUC) to assess the diagnostic utility of three versions of TMT between MCI and NC. AS described in Table 2, the AUC-ROC were 0.665 and 0.774 for TMT-OR, 0.736 for part B of TMT-K, 0.790 and 0.753 for TMT-B&W. There was no significant difference in AUC value among three versions of TMT.

Table 2: Comparison of area under curve (AUC) of each version of TMT distinguishing clinical groups.

According to correlation analysis among age, education and each version of TMT, NC revealed no significant correlation whereas negative correlation was observed between TMT performance and age in MCI patients (Table 3).

Table 3: Pearson correlation among education, age and the indices of TMT.

Correlations between Trail Making and other neuropsychological tests

The bivariate analysis of the correlation between the neuropsychological tests scores showed significant coefficients between tests scores (Table 4). TMT-B&W significantly correlated with the TMT-OR or TMT-K. Part B of TMT-B&W also revealed significant correlation with COWAT and Stroop test-Color reading.

Table 4: Correlations among neuropsychological tests scores.

Discussion

One purpose of this study was to determine if the original or Korean version of TMT would suffice for use in the Korean older adult population, or if there is a need for the development of culturefair analogue such as TMT-B&W. Previous study of our team revealed that TMT-B&W is as reliable as original TMT [14] and current study focused on the applicability as a tool for early stage of cognitive decline such as MCI compared to original and Korean version of TMT. The subjects with dementia were carefully excluded, so we think that our data can represent of TMT performance of subtle cognitive decline according to different types of TMT. Although three versions of TMT tasks discriminated between NC and MCI without significant difference of in AUC value, the completion rate was quite different.

In comparison to part A of TMT, part B demands set shifting ability such as cognitive alteration or backward inhibition [8,22,23] that it is known to be more difficult to perform [24]. Regarding completion rate of TMT with Korean and English alphabets, although better performance in writing the Korean alphabet might have been expected, most of the subjects who could not accurately complete the task in English alphabet were also unable to complete the task in Korean, and vice versa. Some previous research [25,26] and this study incorporated highly-educated subjects (mean of 15.32 years, range 9 to 23)who know both of Korean and English alphabet showed difficulty in recalling the order of Korean alphabet as well as English one. So it is possible that knowing alphabet is one thing and knowing the order of alphabet is another that two versions of TMT were inapplicable to about 40% of MCI patients. Considering these low completion rate of both versions of TMT using alphabet, the current study suggests that replacing the English alphabet with Korean letters does not provide greater benefit in detecting early stage of cognitive impairment in older Korean adults. Although the original TMT proved to be an effective tool in differentiation of MCI and NC, it is possible that the application of an alternative TMT such as TMT-B&W is still needed for those who are unable to complete the original English or Korean version of the TMT.

It has shown that cultural variables affect cognitive test performance that a cognitive test does not always measure the same construct when it is applied in a different cultural context [27]. Like other neuropsychological tests, TMT may also have limited utility in crosscultural setting that a number of modified and alternate forms of TMT have been made to overcome the shortcomings of original TMT. Oral TMT does not use pencil and paper and it is performed verbally that was meant to be free from the cultural bias [28,29]. Expanded TMT uses clock faces of different times and black dots of different diameter to systemically varying the stimuli with in the TMT format [30]. Comprehensive TMT with 5 trails was developed to discriminate and detect the normal population from the patient with cognitive difficulty that it is more complex than original TMT [31-36]. The Color Trails Test (CTT) was developed as a culturally fair analogue of the TMT that does not use any letters except Arabic numbers [37]. Although the basic designs of the TMT and CTT are similar, they were not identical because the trace of the trails was different [38]. The Shape Trail Test (STT) includes all numbers (from 1 to 25) twice, once in a circle and once in a square that it is somewhat similar to CTT [39]. Symbol TMT does use neither letters nor numbers that it can be used with people that have no familiarity with the Arabic numeric system or a specific alphabet [40]. Other variants of TMT that used walking [41] or eye tracking [42] instead of line drawing were also introduced as a tool to detect dysexecutive function. On top of all the advantages of these culture fair analogues of TMT variants, TMT-B&W has additional merit that it is composed of the identical trace to original TMT. And it is intuitively applicable to patients with cognitive impairment as a simple but efficient tool by using the contrasting stimuli of black and white circles with Arabic numbers [14]. Although older subjects known to perform significantly more poorly than younger subjects in previous reports with TMT [43-46], the significant negative correlation were observed between TMT performance and age only in the MCI group (Table 3). Considering the age of MCI patients was significantly higher than normal control, the effect of age on TMT performance might need certain threshold level of age that is in line with the result of other study [46]. Higher educational level is also important factor to perform TMT [47,48], but it showed no correlation between educational level and TMT performance in this study (Table 3). We thought that this result derived from the higher educational level of our subjects as it was already reported that the effect of education became apparent only with poorly educated population.

Conclusion

Results of the current study demonstrate that the TMT-B&W as well as other TMT using alphabet proved to be sensitive to mild cognitive decline. Like the original TMT, the TMT-B&W showed a high correlation with other neuropsychological tests that assess frontal executive function. As the TMT-B&W was created to address the need for testing to minimize effects of language that a participant does not need knowledge of the English or Koran alphabet and the trace and the test results showed a pattern consistent with the original TMT. Thus, if a researcher is inclined to control language effects with higher completion rate, the TMT-B&W is recommended in the subjects with cognitive impairment. However, our study had some limitations. Although we tried to control the demographic variables using MANCOVA, the significant differences in age and gender between MCI and NC might have been affected the reliability and reproducibility of the cognitive outcome measures. We do not have standardized large norm study or data outside Korea to be a culture-fair test. And this study was focused on the subjects with relatively higher educational level that further study with undereducated Korean subjects or norm study across different countries would be needed to better determine the potential for more general utilization of the TMT-B&W.

Acknowledgement

We would like to thank the Medical Research Collaborating Center at Seoul National University Bundang Hospital for performing the statistical analyses.

References

1. Rabin LA, Barr WB, Burton LA (2005)
2. Lezak MD (2004)
3. Reitan RM, Wolfson D (1994)
4. Strauss E, Sherman EMS, Spreen OA (2006)
5. Heun R, Papassotiropoulos A, Jennssen F (1998)
6. Kraybill ML, Larson EB, Tsuang DW, Teri L, McCormick WC, et al. (2005)
7. Walker AJ, Meares S, Sachdev PS, Brodaty H (2005)
8. Crowe SF (1998)
9. Anderson CV, Bigler ED, Blatter DD (1995)
10. Stuss DT, Bisschop SM, Alexander MP, Levine B, Katz D, et al. (2001)
11. Seo EH, Lee DY, Kim KW, Lee JH, Jhoo JH, et al. (2006)
12. Yi HS, Chin JH (2007) Development andvalidation of Korean version of trail making test for elderly persons. Dementia and Neurocognitive Disorders6: 54-66.
13. Park JS, Kang YW, Yi HS, Kim YJ, Ma HI, et al. (2007) Usefulness of the Korean trail making test for the elderly (K-TMT-e) in detecting the frontal lobe dysfunction. Dementia and Neurocognitive Disorders 6: 12-17.
14. Kim HJ, Baek MJ, Kim S (2014)
15. Petersen RC (2004)
16. McKhann G, Drachman D, Folstein M, Katzman R, Price D, et al. (1984)
17. Kang Y, Na DL, Hahn S (1997)
18. Kang SJ, Choi SH, Lee BH, Kwon JC, Na DL, et al. (2002) The reliability and validity of the Korean instrumental activities of daily living (K-IADL). J Korean NeurolAssoc 20: 8-14.
19. Christensen KJ, Multhaup KS, Nordstrom S, Voss K (1991)
20. Marshall GA, Fairbanks LA, Tekin S, Vinters HV, Cummings JL (2006)
21. Reitan RM (1955)
22. Miner T, Ferraro FR (1998)
23. Mayr U, Keele SW (2000)
24. Vickers D, Vincent N, Medvedev A (1996)
25. Gaudino EA, Geisler MW, Squires NK (1995)
26. Ivnik RJ, Malec JF, Smith GE, Tangalos EG, Petersen RC (1996)
27. Fernández AL, Marcopulos BA (2008)
28. García-Tuñón MAS (2008)
29. DeCristoforo L, García-Tuñón MAS (2001)
30. Stanczak DE, Lynch MD, McNeil CK, Brown B (1998)
31. Homack S, Lee D, Riccio CA (2005)
32. Moses J (2002)
33. Allen DN, Thaler NS, Ringdahl EN, Barney SJ, Mayfield J (2012)
34. Bauman Johnson WL, Maricle DE, Miller DC, Allen DN, Mayfield J (2010)
35. Armstrong CM, Allen DN, Donohue B, Mayfield J (2008)
36. Salthouse TA, Toth J, Daniels K, Parks C, Pak R, et al. (2000)
37. D’Elia L, Satz P, Uchiyama C, White T (1996)
38. deFrias CM, Dixon RA, Strauss E (2006)
39. Zhao Q, Guo Q, Li F, Zhou Y, Wang B, et al. (2013)
40. Barncord SW, Wanlass RL (2001)
41. Perrochon A, Kemoun G (2014)
42. Hicks SL, Sharma R, Khan AN, Berna CM, Waldecker A, et al. (2013)
43. Kennedy KJ (1981)
44. Tombaugh TN (2004)
45. Abe M, Suzuki K, Okada K, Miura R, Fujii T, et al. (2004)
46. Hashimoto R, Meguro K, Lee E, Kasai M, Ishii H, et al. (2006)
47. Bornstein RA, Suga LJ (1988)
48. Giovagnoli AR, Del Pesce M, Mascheroni S, Simoncelli M, Laiacona M, et al. (1996)