Comparative Evaluation of Imaging Modalities for Eligibility in Endovascular Treatment of Delayed Onset Acute Anterior Circulation Ischemic Stroke in Siriraj Hospital: A Retrospective Analysis

Rungsima Chudapongse, M.D.3, Boonrerk Sangpetngam, M.D.1,3, Ekawut Chankaew, M.D.1,2, Thaweesak Aurboonyawat, M.D.1,2, Anchalee Churojana, M.D.1,3, Pattarawit Withayasuk, M.D.1,3

1Siriraj Center of Interventional Radiology, Faculty of Medicine Siriraj Hospital, Mahidol University, Bangkok, Thailand, 2Division of Neurosurgery,

Department of Surgery, Faculty of Medicine Siriraj Hospital, Mahidol University, Bangkok, Thailand, 3Division of Diagnostic Radiology, Department of Radiology, Faculty of Medicine Siriraj Hospital, Mahidol University, Bangkok, Thailand.


ABSTRACT

Objective: The goal of this study is to evaluate the consistency between computed tomographic perfusion (CTP) according to the endovascular therapy following imaging evaluation for ischemic stroke (DEFUSE-3) criteria and other standard computed tomography (CT) imaging modalities, such as multi-phase CT angiography (MCTA) and unenhanced computed tomography (UECT), in assessing patient eligibility for EVT as determined by neurointerventionists evaluations.

Materials and Methods: This retrospective analysis included 64 patients with anterior circulation stroke and onset between 6 to 12 hours or unknown onset. Two neuro-interventionalists independently reviewed images and assessed eligibility for EVT based on the Alberta stroke program early CT score (ASPECTS) derived from UECT and collateral score obtained from MCTA. The results were then compared to CTP, utilizing the DEFUSE-3 criteria. Results: Out of the 64 cases analyzed (mean age: 69 years ± 13.9 [SD]), 61 met DEFUSE-3 criteria for EVT by CTP, while 54 were deemed eligible based on an ASPECTS ≥ 6 and collateral score ≥ 3. Agreement between the modalities was moderate (Kappa coefficient score 0.4). When patients with ASPECTS score < 6 were excluded, concordance improved to perfect (Kappa coefficient score 1.0). Hence, concordance was significantly associated with ASPECTS scores ≥ 6 (P < 0.001).

Conclusion: In patients experiencing anterior circulation stroke with onset between 6 to 12 hours or unknown onset, excluding an ASPECTS score of 6 or higher, MCTA and UECT proved to be reliable for assessing endovascular treatment eligibility. These modalities may serve as substitutes for CTP and offer support in the clinical decision- making process.

Keywords: Endovascular thrombectomy; acute ischemic stroke; computed tomography; computed tomographic perfusion (Siriraj Med J 2024; 76: 573-580)


INTRODUCTION

Ischemic stroke is currently one of the leading causes of permanent disability in Thailand, especially when attributed to large vessel occlusion. Consequently, timely initiation of treatment during the acute phase is

imperative to optimize the likelihood of complete or near- complete recovery.1-3 Various therapeutic approaches are currently used to manage acute ischemic stroke, including intravenous thrombolysis, intra-arterial or combined thrombolysis, and mechanical recanalization techniques


*Corresponding author: Pattarawit Withayasuk E-mail: dorawit@gmail.com

Received 2 April 2024 Revised 18 June 2024 Accepted 3 July 2024 ORCID ID:http://orcid.org/0000-0001-8662-1315 https://doi.org/10.33192/smj.v76i9.268564


All material is licensed under terms of the Creative Commons Attribution 4.0 International (CC-BY-NC-ND 4.0) license unless otherwise stated.

which involve various devices for thrombectomy and/or stent placement. Choosing the most suitable treatment approach often requires a customized combination of interventions based on each patient’s individual factors.4,5 In recent years, notable strides in both technical

and procedural aspects of endovascular therapy (EVT) for stroke have established it as an effective treatment modality.5-7 Numerous studies have highlighted EVT’s benefits which extend to patients treated in delayed time windows helping to amplify its therapeutic impact.8 The development of imaging techniques has played a pivotal role in improving the selection process for EVT candidates, incorporating tools such as unenhanced computed tomography (UECT), single-phase CT angiography, multiple-phase CT angiography (MCTA), and magnetic resonance imaging (MRI).9,10 These advancements have collectively contributed to enhancing the precision and efficacy of endovascular interventions in stroke management.

The standard protocol for assessing patients diagnosed with acute onset ischemic stroke due to large vessel occlusion within a timeframe of less than six hours involves using MCTA and UECT. This evaluation is conducted using the Alberta Stroke Program Early CT Score (ASPECTS) and collateral scoring.9,11-13 However, for patients with unknown onset times or onset ≥ 6 hours, the ASPECTS and collateral scores are considered unreliable for evaluation. Numerous studies show that perfusion imaging outperforms conventional imaging in predicting excellent recanalization outcomes and favorable functional recovery.14-20 Therefore, the incorporation of perfusion imaging into the diagnostic process is pivotal for enhancing the accuracy and reliability of assessments, particularly in scenarios involving uncertain onset times or delayed presentations.

The endovascular therapy following imaging evaluation for ischemic stroke (DEFUSE-3) clinical trials conducted by G.W. Albers et al in 2018 evaluated patients with occlusions in the proximal middle cerebral artery and internal carotid artery whose onset of symptoms occurred between 6 and 24 hours prior. In this study, computed tomographic perfusion (CTP) using RapidAI (iSchema View, Menlo Park, CA) software was utilized to determine the areas of penumbra and core infarction. Patients identified as suitable candidates proceeded with endovascular surgery, and clinical outcomes of this group showed a greater degree of favorability compared to cases treated solely with medical intervention.14 This underscores the pivotal role of advanced imaging techniques, such as CTP, in extending the treatment window for endovascular interventions and improving clinical outcomes in specific patient populations.

At Siriraj Hospital, Mahidol University, Bangkok, Thailand, recent updates to stroke management guidelines include the use of UECT, MCTA and CTP with RapidAI software. These updates are in line with the guidelines from the DEFUSE-3 trials for making decisions about EVT, but with some minor modifications. The determination of EVT for delayed-onset strokes in the anterior circulation at Siriraj Hospital is based on the interventionist’s assessment using CTP alongside other CT imaging modalities. While the American Heart Association’s 2018 guidelines for acute ischemic stroke management recommend CTP criteria from the DEFUSE-3 trial for selecting delayed-onset patients for thrombectomy, certain patients who meet favorable CTP criteria may not undergo the procedure due to other factors, such as a low ASPECT score observed on UECT.2 However, the widespread availability of advanced CTP with artificial intelligence (AI) remains limited across many primary, secondary, and tertiary hospitals. Consequently, this study seeks to evaluate the consistency between CTP and other conventional CT imaging modalities, namely MCTA and UECT, in assessing patient eligibility for EVT. The evaluation criteria adhere to the CTP criteria based on DEFUSE-3 and the clinical judgment of neuro- interventionists. The primary objective is to investigate whether the necessity for CTP in routine clinical practice can be minimized by comparing its results with those from more readily available imaging modalities. This comparative analysis seeks to enhance and streamline the decision-making process for EVT eligibility, particularly in environments where advanced CTP with AI technology is less accessible.


MATERIALS AND METHODS

This study aims to assess the agreement between CTP (DEFUSE-3 criteria) and other conventional CT imaging modalities (MCTA and UECT) in determining patients’ eligibility for EVT based on the clinical judgement of neurointerventionists.

This study is designed as a single-center retrospective cohort study, involving a review of electronic medical records of patients with anterior circulation acute ischemic stroke with large vessel occlusion, including the M1 segment of middle cerebral artery (MCA), internal carotid artery (ICA) and common carotid artery (CCA), with symptom onset between 6-12 hours or of unknown onset. The review period spans from January 2018 to September 2022 at the Department of Interventional Neuroradiology, Siriraj Hospital.

Inclusion criteria

  1. Patients diagnosed with anterior circulation

    acute ischemic stroke with large vessel occlusion (CCA, ICA, M1 segment of MCA)

  2. Age ≥ 18 years old

  3. Onset between 6-12 hours or unknown onset21

  4. Received evaluation with UECT, MCTA and CTP in same event.

Exclusion criteria

  1. Poor image quality

  2. mRS (modified Rankin Scale) ≥ 3

  3. Inadequate clinical information or incomplete image study

  4. Patient’s National Institutes of Health Stroke Scale (NIHSS) score < 6

  5. M2 segment of MCA occlusion

MCTA and UECT images for each patient were systematically collected and organized for review. Two neuro-interventionists, each certified by the Thai board of interventional neuroradiology for more than 10 years and with over a decade of experience in diagnostic imaging and neuro-interventional procedures, were recruited to independently assess the cases. Their task was to determine the eligibility of each case for endovascular treatment, guided by specific criteria — such as an ASPECTS score

≥6 and collateral score of ≥3.9 To maintain objectivity, demographic details, and clinical history were concealed, with the evaluators having access only to information about the occlusion’s location. Case reviews were conducted separately to avoid potential bias. The outcomes of these evaluations were subsequently compared to findings from CTP, where the ischemic core and penumbral regions were measured using the RapidAI software, which is an automated image postprocessing system. Eligibility for endovascular treatment was determined according to the DEFUSE-3 criteria. The goal of this comparative analysis was to measure the agreement between the neuro-interventionalists’ clinical judgments based on conventional imaging and the results derived from advanced CTP enhanced by AI technology.

DEFUSE-3 criteria:9,14

  1. infarct core volume <70 mL

  2. penumbra volume ≥ 15 mL

  3. penumbra/infarct core ratio ≥ 1.8

Statistical analysis was conducted using PASW (Predictive Analytics Software) Statistics 18 software. Quantitative data were presented as means, while qualitative data were expressed as frequencies with percentages. The Fisher Exact test was employed to explore the significant associations between risk factors and endovascular treatment. The agreement between CTP by RapidAI

software and Multiple-phase CT angiography/UECT images, as well as interobserver variability regarding endovascular thrombectomy eligibility was assessed using Kappa correlation coefficients. A p-value <0.05 was considered statistically significant.

Given that this study was a retrospective analysis of existing medical records, the Institutional Review Board (IRB) of Siriraj Hospital, Mahidol University (Certificate of Approval number: Si 865/2022), granted exemption from the requirement to obtain individual patient consent. However, it is important to note that all patients included in this study had previously consented to their data being included in the hospital’s institutional database and for research purposes during their initial clinical consultation. This consent was secured through a standard process, ensuring patients were informed about the potential use of their medical data for research purposes. The retrospective nature of the study ensured stringent adherence to patient privacy and confidentiality. There were no direct patient interventions or interactions, and all patient data were anonymized to safeguard protect patient identities. The study adhered to the principles set in the Declaration of Helsinki, the Belmont Report, the Council for International Organizations of Medical Sciences (CIOMS) Guidelines and the International Conference on Harmonization in Good Clinical Practice (ICH-GCP).


RESULTS

From January 2018 to September 2022, data of 64 patients was collected and reviewed. Baseline characteristics are shown in Table 1. At baseline, the median age was

68.9 years and an analysis of baseline characteristics and risk factors showed no significant relationship with endovascular thrombectomy according to DEFUSE-3 criteria.

Within the original group, 61 patients met the DEFUSE-3 criteria for endovascular treatment based on CTP analysis, while a joint evaluation using MCTA and UECT, identified 52 patients as suitable candidates. Of these, 52 patients received endovascular treatment. Follow-up data was available for 33 patients.

Among the 33 patients for whom follow-up data was available, 16 (48.5%) exhibited functional independence by day 90, as defined by a mRS score of 0 to 2. The collection of comprehensive follow-up information encountered obstacles due to the referral system, resulting in some incomplete records.

A subgroup analysis was carried out, excluding 15 patients with ASPECTS scores <6. In this refined group of 49 patients, all met the DEFUSE-3 criteria for


TABLE 1. Baseline characteristic and demographic data.



All

Endovascular treatment by DEFUSE3

P-Value

Age (years), Mean±SD

69±13.9



Sex (Female, Male) n, (%)

30, 34 (46, 54)



Demographic Data




DM n, (%)

20 (31)

19 (29)

.628

HT n, (%)

39 (90)

38 (59)

.414

DLP n, (%)

22 (34)

19 (29)

.393

AF n, (%)

15 (23)

13 (20)

.361

CAD n, (%)

8 (12)

7 (12)

.604

Smoking n, (%)

13 (20)

12 (19)

.484

Previous Stroke n, (%)

13 (20)

12 (19)

.432

Abbreviations: DM = Diabetes Mellitus, HT = Hypertension, DLP = Dyslipidemia, AF = Atrial fibrillation, CAD = coronary arterial disease, mRS = modified Rankin Scale


endovascular treatment, and 48 were considered eligible based on their ASPECTS and Collateral score (>2) as assessed through MCTA and UECT imaging.

The comparison of consistency between CTP and other standard imaging modalities, as assessed by neuro- interventionalists, revealed a Kappa coefficient score of

0.4. According to Landis & Koch’s (1977) interpretation of Kappa values, this score is in moderate agreement, with a total concordance of 57 out of 64 cases and 7 discordant cases.22 The interobserver agreement between the two neuro-interventionalists was deemed substantial, with a Kappa coefficient score of 0.7.

After a detailed consensus discussion, the consistency between CT perfusion and other standard imaging modalities improved from slight to fair agreement. A subgroup analysis was also conducted, which excluded patients with ASPECTS scores <6. In this refined subgroup, consistency between the modalities reached perfect agreement, as indicated by a Kappa coefficient score of 1.0. Additionally, it was observed that cases with concordant agreement were significantly associated with ASPECTS scores ≥6, and vice versa, with a p-value less than 0.001. (Diagram 1)


DISCUSSION

Recent stroke guidelines recommend mechanical thrombectomy in patients who present anterior circulation ischemic stroke within 6 to 16 or 24 hours of symptom onset with large vessel occlusion, according to the

diffusion weighted image or CTP assessment with clinical mismatch in the triage of wake-up and late presenting strokes undergoing neurointervention with Trevo trial (DAWN) or DEFUSE-3 trial criteria.4 The DAWN trial15 identified candidates with large anterior circulation vessel occlusion for treatment with mechanical thrombectomy through a clinical-core mismatch based on the NIHSS score and imaging findings from CTP or diffusion-weighted MRI., Meanwhile, the DEFUSE-3 trial selected patients using perfusion-core mismatch and maximum core size as imaging criteria (infarct volume

<70 mL, penumbra volume ≥15 mL and a penumbra/ infarct core ratio ≥1.89,14) to select patients with large anterior circulation occlusion 6 to 16 hours from onset l for mechanical thrombectomy, which required CTP for patient selection. Despite its advantages, CTP is not universally available. CT has many practical advantages over other cerebral perfusion imaging methods, including its wide availability. Thus, in prior studies23-32 other modalities, such as UECT and MCTA, were used instead of advanced imaging to evaluate acute stroke patients with a late window period, with some questioning the need of perfusion imaging.33 The recently published MR CLEAN LATE34 demonstrated that patient selection in the late time window could be based on collateral circulation, making ASPECT score and CTP less critical. Studies by Wang et al.24 and Dhillon et al. have suggested that MCTA can match CTP in predicting outcomes and that endovascular treatment is viable and safe without the

need for advance neuroimaging in acute ischemic stroke patients with delayed stroke onset.28 However, conflicting findings persist, as some studies indicate that CTP can lower mortality, even though functional independence after late-window endovascular therapy appear similar to patients selected by UECT.30 The evolving landscape of stroke management underscores the ongoing exploration of diverse imaging modalities and patient selection criteria in the extended time window, acknowledging the practical considerations and limitations of available technologies in different clinical settings.

In this study, our primary objective was to assess the consistency among different imaging modalities in establishing EVT eligibility. This involved comparisons between CT perfusion (utilizing the DEFUSE-3 criteria) and the combined use of multiple-phase CT angiography and unenhanced computed tomography. It should be noted that the guidelines at Siriraj Hospital are predominantly based on DEFUSE 3 trial criteria, with slight adjustments to the time window, which has been narrowed to 6-12 hours or of unknown onset.

Our study’s findings indicate a slight agreement between CTP analyzed by RapidAI software and conventional imaging methods. Notably, discordance was noted in 7 out of 64 cases, predominantly due to two factors. In 6 out of the 7 cases, discordance was linked to an overestimation of the core infarction area during ASPECTS evaluation (Fig 1). This overestimation of the core infarction area is a significant concern when relying on UECT as it lacks the ability to differentiate between the penumbral and core infarction areas. A previous study conducted by Siegler et al.26 also highlighted this issue, revealing that while nearly three-quarters of thrombectomy patients showed ischemic changes on UECT, about one-third of these cases had normal core volumes on CTP. This finding underscores the necessity of incorporating both perfusion and non-contrast scans to achieve a thorough and precise determination of endovascular treatment eligibility.

Moreover, the subjectivity in evaluating ASPECTS scores present another challenge. This subjectivity stems from the wide range of cerebral hypodensity attenuation



A

B

C

D

E

F

G

Fig 1. A 47 years old patient presented right-sided weakness for 6 hours, NIHSS = 11 A: NECT of the brain showed a hypodense area in the head of the left caudate nucleus, left internal capsule and left lentiform nucleus, with an ASPECTS score = 7. B: CTA source image shows total occlusion of the M1 segment of left MCA (black arrow). C: Multi-phase CTA during the 1st phase shows a collateral score = 5. D: CT perfusion shows no core infarct with a ischemic penumbra area about 97 ml, resulting in a mismatch ratio = infinite. Based on the DEFUSE-3 criteria from CT perfusion, the patient underwent MT E: Left ICA angiogram shows nearly total occlusion of the M1 segment of the left MCA. F: Post-MT left ICA angiogram shows recanalization of the left MCA. G: Brain CT, 24 hours post-MT shows subacute infarction in the head of left caudate nucleus but no hemorrhagic transformation. The patient exhibited improvement in weakness, NIHSS = 3. At the 3-month follow-up, the patient showed mRS = 0.

Abbreviations: NIHSS = National Institutes of Health Stroke Scale, NECT = Non-enhanced computed tomography, ASPECTS = Alberta Stroke Program Early CT Score, CTA = Computed Tomography Angiography, MCA = middle cerebral artery, CT = computed tomography, MT = mechanical thrombectomy, ICA = internal carotid artery, mRS = modified Rankin Scale


A

B First phase

Second phase

C

D

E

F

Fig 2. A 55 years old patient presenting left-sided weakness upon waking up, NIHSS = 10. A: NECT of the brain shows a hypodense area in the right caudate nucleus, lentiform nucleus, internal capsule, insular cortex, M1 and M4 areas, and an ASPECTS score = 4. B: Multi- phase CTA in the 1st and 2nd phases shows total occlusion at M1 segment of the right MCA (black arrow) with collateral score = 4. C: CT perfusion shows a small area of core infarct, 22 ml, with a large ischemic penumbra area, mismatch ratio = 10.2. Based on the DEFUSE-3 criteria from CT perfusion, the patient was sent for MT. D: Right ICA angiogram shows total occlusion of the M1 segment of the right MCA. E: Post-MT right ICA angiogram shows recanalization of the right MCA. F: CT of the brain 24 hours after MT showed hemorrhagic transformation in the right basal ganglia. However, the patient improved in weakness, NIHSS = 2. At the 3-month follow-up, the patient showed mRS = 2.

Abbreviations: NIHSS = National Institutes of Health Stroke Scale, NECT = Non-enhanced computed tomography, ASPECTS = Alberta Stroke Program Early CT Score, CTA = Computed Tomography Angiography, MCA = middle cerebral artery, CT = computed tomography, MT = mechanical thrombectomy, ICA = internal carotid artery, mRS = modified Rankin Scale


values, measured in Hounsfield units (HU) on UECT, which can vary significantly when compared to MRI. ASPECTS scoring is predominantly utilized for assessing occlusions in the M1 segment of the MCA.

Furthermore, in one specific case, the complexity was further compounded by the presence of a concurrent posterior circulation occlusion, which was included in the penumbra volume calculation. This inclusion of additional pathology introduces challenges in accurately assessing the extent of ischemic damage and complicates the determination of treatment eligibility. These findings underscore the multifaceted nature of decision-making regarding EVT eligibility and emphasizes the importance of a comprehensive understanding of each patient’s unique anatomy and pathology.

In this study, it was found that discordant cases (15 out of 64) were significantly associated with ASPECTS less than 6 (p-value < 0.001). Consequently, by excluding cases with ASPECTS scores below 6 revealed perfect concordance between imaging modalities.

This outcome suggests that by removing cases prone to overestimation of core infarction, UECT and MCTA

could be emerged as reliable tools in the evaluation of delayed-onset acute anterior circulation stroke. The high level of agreement in this refined subgroup implies that these modalities, which are more readily available and less complex than advanced imaging techniques, could potentially serve as dependable alternatives in specific clinical scenarios.

Several limitations of this studyshouldbeacknowledged. First, the study’s relatively small population was the result of the recent incorporation of CTP using RapidAI software into the institution’s guidelines. This limited sample size may affect the broad applicability of our findings. Additionally, the lack of follow-up data for 20 out of 59 patients who underwent endovascular treatment posed additional constraints, potentially impacting the assessment of long-term outcomes and functional recovery. Additionally, the study’s reliance on quantification software from a single vendor could limit the generalizability of the results as the availability of quantitative core infarction/penumbra volume could be influenced by the specific characteristics and algorithms of the chosen software. The exclusive use of a single software may not

account for potential variations that may arise with different software solutions, potentially limiting the broader applicability of the study’s results.

These limitations underscore the importance of cautious interpretation of the study’s results. There is a clear need for future studies with larger and more diverse populations, alongside comprehensive follow-up data, to strengthen the robustness and generalizability of conclusion drawn from this research.


CONCLUSION

In conclusion, our study indicates that the highest level of agreement between CTP and other standard imaging modalities, including MCTA and UECT, occurs in patients with anterior circulation occlusion with onset between 6 to 12 hours or unknown onset, excluding cases with ASPECTS scores below 6. In cases where patients met these criteria, MCTA and UECT are dependable in assessments and can effectively act as alternative options to CTP analyzed by RapidAI software.


ACKNOWLEDGEMENTS

The authors thank all staff and colleagues of Siriraj Center of Interventional Radiology.

Conflicts of interest

All authors declare that there are no conflicts of interest related to any aspect of this research.

Funding

None

Author Contributions

BS and PW: Conceptualization.: RC, BS, EC, TA, AC and PW: Data curation.: RC and PW: Formal analysis.: RC, BS and PW: Methodology.: AC, BS and PW: Supervision.: RC and PW: Writing – original draft.: PW: Writing – review & editing.


REFERENCES

  1. Dharmasaroja P, Ratanakorn D, Nidhinandana S, Singhara Na Ayudhaya S, Churojana A, Suwatcharangkoon S. Thai guidelines of endovascular treatment in patients with acute ischemic stroke. J Thai Stroke Soc. 2019;18(2):52-75.

  2. Kleindorfer DO, Towfighi A, Chaturvedi S, Cockroft KM, Gutierrez J, Lombardi-Hill D, et al. 2021 guideline for the prevention of stroke in patients with stroke and transient ischemic attack: a guideline from the American Heart Association/ American Stroke Association. Stroke. 2021;52(7):e364-e467.

  3. Kim JT, Goyal M, Levy EI, Liebeskind D, Jahan R, Pereira VM, et al. Onset to reperfusion time as a determinant of outcomes across a wide range of ASPECTS in endovascular thrombectomy: pooled analysis of the SWIFT, SWIFT PRIME, and STAR

    studies. J Neurointerv Surg. 2020;12(3):240-5.

  4. Warner JJ, Harrington RA, Sacco RL, Elkind MS. Guidelines for the early management of patients with acute ischemic stroke: 2019 update to the 2018 guidelines for the early management of acute ischemic stroke. Am Heart Assoc; 2019. p. 3331-2.

  5. Churojana A, Mongkolratnan A, Sangpetngam B, Aurboonyawat T, Chankaew E, Withayasuk P, et al. A Comparison of Mechanical Thrombectomy for Large Vessel Occlusion in Acute Ischemic Stroke between Patients with and without Atrial Fibrillation. Siriraj Med J. 2018;70(4):278-83.

  6. Roubec M, Kuliha M, Procházka V, Krajča J, Czerný D, Jonszta T, et al. A controlled trial of revascularization in acute stroke. Radiology. 2013;266(3):871-8.

  7. Golnari P, Nazari P, Ansari SA, Hurley MC, Shaibani A, Potts MB, et al. Endovascular thrombectomy after large-vessel ischemic stroke: utilization, outcomes, and readmissions across the United States. Radiology. 2021;299(1):179-89.

  8. Kim BJ, Menon BK, Kim JY, Shin DW, Baik SH, Jung C, et al. Endovascular Treatment After Stroke Due to Large Vessel Occlusion for Patients Presenting Very Late From Time Last Known Well. JAMA Neurol. 2020;78(1):21-9.

  9. Nael K, Sakai Y, Khatri P, Prestigiacomo CJ, Puig J, Vagal

    A. Imaging-based selection for endovascular treatment in stroke. Radiographics. 2019;39(6):1696-713.

  10. Demeestere J, Wouters A, Christensen S, Lemmens R, Lansberg MG. Review of Perfusion Imaging in Acute Ischemic Stroke: From Time to Tissue. Stroke. 2020;51(3):1017-24.

  11. Menon BK, d’Esterre CD, Qazi EM, Almekhlafi M, Hahn L, Demchuk AM, et al. Multiphase CT angiography: a new tool for the imaging triage of patients with acute ischemic stroke. Radiology. 2015;275(2):510-20.

  12. Singer OC, Berkefeld J, Nolte CH, Bohner G, Reich A, Wiesmann M, et al. Collateral vessels in proximal middle cerebral artery occlusion: the ENDOSTROKE study. Radiology. 2015;274(3): 851-8.

  13. Kim BM, Baek JH, Heo JH, Nam HS, Kim YD, Yoo J, et al. Collateral status affects the onset-to-reperfusion time window for good outcome. J Neurol Neurosurg Psychiatry. 2018;89(9): 903-9.

  14. Albers GW, Marks MP, Kemp S, Christensen S, Tsai JP, Ortega- Gutierrez S, et al. Thrombectomy for stroke at 6 to 16 hours with selection by perfusion imaging. N Engl J Med. 2018;378(8): 708-18.

  15. Nogueira RG, Jadhav AP, Haussen DC, Bonafe A, Budzik RF, Bhuva P, et al. Thrombectomy 6 to 24 hours after stroke with a mismatch between deficit and infarct. N Engl J Med. 2018;378(1): 11-21.

  16. Nael K, Sakai Y, Larson J, Goldstein J, Deutsch J, Awad AJ, et al. CT Perfusion collateral index in assessment of collaterals in acute ischemic stroke with delayed presentation: Comparison to single phase CTA. J Neuroradiol. 2022;49(2):198-204.

  17. Pozzi-Mucelli RA, Furlanis G, Caruso P, Lugnan C, Zdjelar A, Degrassi F, et al. A Novel Fast CT Perfusion Core-Penumbra Mismatch Score: Correlation With Stroke Outcome. Neurologist. 2021;26(2):41-6.

  18. Vaclavik D, Volny O, Cimflova P, Svub K, Dvornikova K, Bar M. The importance of CT perfusion for diagnosis and treatment of ischemic stroke in anterior circulation. J Integr Neurosci. 2022; 21(3):92.

  19. Wannamaker R, Buck B, Butcher K. Multimodal CT in Acute

    Stroke. Curr Neurol Neurosci Rep. 2019;19(9):63.

  20. Wintermark M. Brain perfusion-CT in acute stroke patients. Eur Radiol. 2005;15 Suppl 4:D28-31.

  21. Cortijo E, Garcia-Bermejo P, Calleja AI, Perez-Fernandez S, Gomez R, del Monte JM, et al. Intravenous thrombolysis in ischemic stroke with unknown onset using CT perfusion. Acta Neurol Scand. 2014;129(3):178-83.

  22. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159-74.

  23. Nguyen TN, Abdalkader M, Nagel S, Qureshi MM, Ribo M, Caparros F, et al. Noncontrast Computed Tomography vs Computed Tomography Perfusion or Magnetic Resonance Imaging Selection in Late Presentation of Stroke With Large- Vessel Occlusion. JAMA Neurol. 2022;79(1):22-31.

  24. Wang Z, Xie J, Tang TY, Zeng CH, Zhang Y, Zhao Z, et al. Collateral Status at Single-Phase and Multiphase CT Angiography versus CT Perfusion for Outcome Prediction in Anterior Circulation Acute Ischemic Stroke. Radiology. 2020;296(2): 393-400.

  25. Reidler P, Thierfelder KM, Rotkopf LT, Fabritius MP, Puhr- Westerheide D, Dorn F, et al. Attenuation Changes in ASPECTS Regions: A Surrogate for CT Perfusion-based Ischemic Core in Acute Ischemic Stroke. Radiology. 2019;291(2):451-8.

  26. Siegler JE, Messe SR, Sucharew H, Kasner SE, Mehta T, Arora N, et al. Noncontrast CT versus Perfusion-Based Core Estimation in Large Vessel Occlusion: The Blood Pressure after Endovascular Stroke Therapy Study. J Neuroimaging. 2020;30(2):219-26.

  27. Nannoni S, Ricciardi F, Strambo D, Sirimarco G, Wintermark M, Dunet V, et al. Correlation between ASPECTS and Core Volume on CT Perfusion: Impact of Time since Stroke Onset

    and Presence of Large-Vessel Occlusion. AJNR Am J Neuroradiol. 2021;42(3):422-8.

  28. Dhillon PS, Butt W, Podlasek A, McConachie N, Lenthall R, Nair S, et al. Association between time to treatment and clinical outcomes in endovascular thrombectomy beyond 6 hours without advanced imaging selection. J Neurointerv Surg. 2023;15(4): 336-42.

  29. Diestro JDB. Rethinking the role of CT perfusion in the management of emergent large vessel ischemic stroke. J Neurointerv Surg. 2023;15(9):833-4.

  30. Kobeissi H, Ghozy S, Adusumilli G, Bilgin C, Tolba H, Amoukhteh M, et al. CT Perfusion vs Noncontrast CT for Late Window Stroke Thrombectomy: A Systematic Review and Meta-analysis. Neurology. 2023;100(22):e2304-e11.

  31. Nannoni S, Cereda CW, Sirimarco G, Lambrou D, Strambo D, Eskandari A, et al. Collaterals are a major determinant of the core but not the penumbra volume in acute ischemic stroke. Neuroradiology. 2019;61(9):971-8.

  32. Voleti S, Aziz YN, Vidovich J, Corcoran B, Zhang B, Mistry E, et al. Association Between CT Angiogram Collaterals and CT Perfusion in Delayed Time Windows for Large Vessel Occlusion Ischemic Strokes. J Stroke Cerebrovasc Dis. 2022; 31(3):106263.

  33. Fiehler J. Do we need CT perfusion for stroke patients? Define your terms. J Neurointerv Surg. 2022;14(9):847-8.

  34. Pirson FAV, Hinsenveld WH, Goldhoorn R-JB, Staals J, de Ridder IR, van Zwam WH, et al. MR CLEAN-LATE, a multicenter randomized clinical trial of endovascular treatment of acute ischemic stroke in The Netherlands for late arrivals: study protocol for a randomized controlled trial. Trials. 2021;22(1):160.