, Kyungeun Kim1,2
, Hee-Jung Yang3
, Boram Song1
, Dong Hoon Kim1
, Yumin Chung1
, Seoung Wan Chae1
1Department of Pathology, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Seoul, Korea
2Pathology Center, Seegene Medical Foundation, Seoul, Korea
3Department of Pathology, Keimyung University Dongsan Medical Center, Daegu, Korea
© The Korean Society of Pathologists/The Korean Society for Cytopathology
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (https://creativecommons.org/licenses/by-nc/4.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
Ethics Statement
This study was approved by the Institutional Review Board of Kangbuk Samsung Hospital (KBSMC IRB 2023-11-039-002; December 27, 2023) and conducted in accordance with the Declaration of Helsinki. The requirement for informed consent was waived because clinical data were used retrospectively and de-identified.
Availability of Data and Material
De-identified clinical and analysis data are available from the corresponding author upon reasonable request.
Code Availability
The QuPath scripts, including the custom Groovy tools developed for manual H-score entry, and the R analysis code used for image quantification, cutoff derivation, and survival analysis, are publicly available in a GitHub repository (https://github.com/kbsmc-path/qupath-hscore-quantification-tools).
Author Contributions
Conceptualization: KK, SWC. Data curation: KK, YC. Formal analysis: JA, SWC. Investigation: KK. Funding acquisition: SWC. Methodology: JA, KK, HJY, YC, SWC. Project administration: KK, YC, SWC. Resources: KK, BS. Software: SWC, JA. Supervision: KK, YC, SWC, DHK. Validation: JA, SWC, BS, YC, KK. Visualization: JA, SWC, YC. Writing—original draft: JA, YC. Writing—review & editing: JA, KK, HJY, BS, DHK, YC, SWC. Approval of final manuscript: all authors.
Conflicts of Interest
The authors declare that they have no potential conflicts of interest.
Funding Statement
This research was supported by a grant of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea (grant number: HI21C1137).
Acknowledgments
Generative AI (QuillBot) was used solely for grammar and language polishing.
| Characteristic | AGC (n = 209) | EGC (n = 319) | Total (n = 528) | p-value |
|---|---|---|---|---|
| Age (yr) | 61.4 ± 13.3 | 59.8 ± 11.7 | 60.4 ± 12.4 | .156 |
| Sex | .775 | |||
| Male | 144 (68.9) | 215 (67.4) | 359 (68.0) | |
| Female | 65 (31.1) | 104 (32.6) | 169 (32.0) | |
| T category | <.001 | |||
| T1 | 0 | 319 (100.0) | 319 (60.4) | |
| T2 | 49 (23.4) | 0 | 49 (9.3) | |
| T3 | 103 (49.3) | 0 | 103 (19.5) | |
| T4 | 57 (27.3) | 0 | 57 (10.8) | |
| N category | <.001 | |||
| N0 | 73 (34.9) | 263 (82.4) | 336 (63.6) | |
| N1 | 32 (15.3) | 25 (7.8) | 57 (10.8) | |
| N2 | 27 (12.9) | 5 (1.6) | 32 (6.1) | |
| N3a | 39 (18.7) | 1 (0.3) | 40 (7.6) | |
| N3b | 27 (12.9) | 0 | 27 (5.1) | |
| AJCC 8th pStagea | <.001 | |||
| Stage I | 24 (11.5) | 288 (90.3) | 312 (59.1) | |
| Stage II | 78 (37.3) | 6 (1.9) | 84 (15.9) | |
| Stage III | 96 (45.9) | 0 | 96 (18.2) | |
| Lymphatic invasion | <.001 | |||
| Absent | 83 (39.7) | 270 (84.6) | 353 (66.9) | |
| Present | 126 (60.3) | 49 (15.4) | 175 (33.1) | |
| Venous invasion | <.001 | |||
| Absent | 171 (81.8) | 313 (98.1) | 484 (91.7) | |
| Present | 38 (18.2) | 6 (1.9) | 44 (8.3) | |
| Perineural invasion | <.001 | |||
| Absent | 104 (49.8) | 314 (98.4) | 418 (79.2) | |
| Present | 105 (50.2) | 5 (1.6) | 110 (20.8) | |
| Resection margin | .003 | |||
| Negative | 201 (96.2) | 318 (99.7) | 519 (98.3) | |
| Positive | 8 (3.8) | 1 (0.3) | 9 (1.7) | |
| Signet-ring component | .048 | |||
| Absent | 130 (62.2) | 170 (53.3) | 300 (56.8) | |
| Present | 79 (37.8) | 149 (46.7) | 228 (43.2) | |
| Differentiationb | <.001 | |||
| WD | 14 (6.7) | 63 (19.7) | 77 (14.6) | |
| MD | 62 (29.7) | 87 (27.3) | 149 (28.2) | |
| PD | 133 (63.6) | 169 (53.0) | 302 (57.2) | |
| Lauren classification | .002 | |||
| Intestinal | 83 (39.7) | 157 (49.2) | 240 (45.5) | |
| Diffuse | 69 (33.0) | 115 (36.1) | 184 (34.8) | |
| Mixed | 57 (27.3) | 47 (14.7) | 104 (19.7) | |
| p53 expression (manual IHC interpretation)c | .003 | |||
| Null | 37 (17.7) | 36 (11.3) | 73 (13.8) | |
| Wild-type | 108 (51.7) | 211 (66.1) | 319 (60.4) | |
| Overexpression | 64 (30.6) | 72 (22.6) | 136 (25.8) | |
| p53, aberrant grouping (manual IHC)c | .001 | |||
| Wild-type | 108 (51.7) | 211 (66.1) | 319 (60.4) | |
| Aberrant (null + overexpression) | 101 (48.3) | 108 (33.9) | 209 (39.6) | |
| Overall survival status | <.001 | |||
| Alive | 151 (72.2) | 317 (99.4) | 468 (88.6) | |
| Dead | 58 (27.8) | 2 (0.6) | 60 (11.4) |
Values are presented as mean ± SD or number (%). p-values are determined by independent t-test (Welch) for age and chi-square test (or Fisher's exact test for 2 × 2 tables) for categorical variables.
AGC, advanced gastric cancer; EGC, early gastric cancer; AJCC, American Joint Committee on Cancer; WD, well differentiated; MD, moderately differentiated; PD, poorly differentiated; IHC, immunohistochemistry; SD, standard deviation.
aAJCC 8th edition pathologic stage derived from pT and pN; T4 treated as T4a. All patients underwent gastrectomy with curative intent and were M0 at surgery, so no case was assigned to stage IV. Nodal status (hence stage) is missing in 36 cases (11 AGC, 25 EGC); percentages are calculated over the full group, so N-category and stage rows may not sum to 100%;
bHistologic differentiation is grouped as WD, MD, or PD;
cp53 by manual three-tier IHC interpretation (null/wild-type/overexpression); aberrant denotes null plus overexpression.
| Cutoff method | Cutoffs | Low, n (events) | Wild-type, n (events) | Overexpression, n (events) | Global log-rank pa,b |
|---|---|---|---|---|---|
| Manual | 8.0/106.0 | 70 (11) | 324 (27) | 134 (22) | .012 |
| Tertiles | 27.6/78.6 | 176 (24) | 176 (9) | 176 (27) | .005 |
| Log-rank optimization | 21.3/95.7 | 136 (23) | 249 (14) | 143 (23) | <.001c |
| Extended Youden index | 14.5/100.8 | 99 (16) | 288 (21) | 141 (23) | .003 |
| ROC surface (VUS) | 12.4/103.8 | 88 (15) | 302 (22) | 138 (23) | .002 |
Final analytic cohort (n = 528, 60 deaths). H-scores were computed with the primary detector (InstanSeg) using the mean of the three intensity-threshold determinations.
ROC, receiver operating characteristic; VUS, volume under the ROC surface.
aGroup sizes are given as n (number of deaths). The reported p-value is the global (three-group) log-rank p-value. Multivariable hazard ratios for the aberrant versus wild-type comparison are reported in Table 4;
bPairwise log-rank comparisons showed that the low and overexpression groups did not differ significantly for any method (p = .48–.95), whereas both differed from wild-type. This supports their combination into a single aberrant category;
cFor the log-rank-optimized cutoffs, the nominal p-value is optimistically biased because the cutoffs were selected from the same survival data. After adjusting for the multiplicity of the cutpoint search (maximally selected rank statistics; Lausen-Schumacher approximation), the maximally selected statistic of 2.56 corresponded to an adjusted p-value of .168. Therefore, this strategy is reported as exploratory.
| Cutoff method | Cutoffs | Lower Δb | Upper Δ | Total deviation | Concordant n (%)c | κ | Linear-weighted κ | Aberrant sensitivityd | Aberrant specificity |
|---|---|---|---|---|---|---|---|---|---|
| Tertiles | 27.6/78.6 | +19.6 | −27.4 | 47.0 | 380 (72.0) | 0.580 | 0.648 | 1.000 | 0.543 |
| Log-rank optimization | 21.3/95.7 | +13.3 | −10.3 | 23.6 | 453 (85.8) | 0.766 | 0.800 | 1.000 | 0.769 |
| Extended Youden index | 14.5/100.8 | +6.5 | −5.2 | 11.7 | 492 (93.2) | 0.881 | 0.896 | 1.000 | 0.889 |
| ROC surface (VUS) | 12.4/103.8 | +4.4 | −2.2 | 6.6 | 506 (95.8) | 0.926 | 0.935 | 1.000 | 0.932 |
Final analytic cohort (n = 528). The manual H-score cutoffs (8.0 and 106.0) served as the common comparator, yielding three groups: 70 low, 324 wild-type, and 134 overexpression cases.
κ, Cohen's kappa; ROC, receiver operating characteristic; VUS, volume under the ROC surface.
aThe extended-Youden and ROC-surface cutoffs were derived against the pathologists’ three-tier immunohistochemistry interpretation of these same images as the reference standard. The comparator used in this table—the manual H-score cutoffs—is a separate classification, but it was set by the same pathologists on the same images and agrees with the reference standard in 493 of 528 cores (93.4%; κ = 0.878). The agreement reported here therefore reflects internal consistency rather than independent validation. Measured directly against the reference standard, the five classifications agree in 93.4% (manual), 72.2% (tertiles), 85.2% (log-rank), 91.5% (extended Youden) and 93.4% (ROC surface) of cores. The tertile and log-rank cutoffs were derived without reference to the manual interpretation;
bΔ denotes the difference between each data-derived cutoff and the corresponding manual cutoff; total deviation is the sum of the two absolute differences. Positive values indicate a higher cutoff than the manual threshold;
cConcordance denotes exact agreement of the three-tier assignment with the manual-cutoff classification. All discordances occurred between adjacent categories. Full confusion matrices are provided in Supplementary Table S8;
dSensitivity and specificity refer to the detection of the aberrant pattern (low plus overexpression) as defined by the manual cutoffs. The manual cutoffs define the narrowest aberrant category of the five—the lowest lower cutoff (8.0) and the highest upper cutoff (106.0). Every core called aberrant by the manual cutoffs is therefore also called aberrant by every data-derived method, so sensitivity is 1.000 by construction and the methods differ only in specificity;
| Cutoff strategy (lower/upper) | Aberrant vs. wild-type HR (95% CI) | p-value |
|---|---|---|
| Manual (8.0/106.0) | 1.63 (0.97–2.76) | .066 |
| Tertiles (27.6/78.6) | 2.50 (1.21–5.14) | .013 |
| Extended Youden index (14.5/100.8) | 1.81 (1.05–3.10) | .032 |
| Log-rank optimization (21.3/95.7)a | 2.65 (1.43–4.88) | .002 |
| ROC surface, VUS (12.4/103.8) | 1.91 (1.12–3.27) | .018 |
Final analytic cohort (n = 528, 60 deaths). Models were stratified by tumor stage (advanced vs. early gastric cancer) and adjusted for age, sex, poor differentiation, and signet-ring cell component.
Stage was handled by stratification rather than as a covariate because deaths occurred almost exclusively in the advanced gastric cancer group (58 of 60 deaths).
HR, hazard ratio; CI, confidence interval; ROC, receiver operating characteristic; VUS, volume under the ROC surface.
aThe log-rank–optimized cutoffs are derived from the same survival data used for testing and are therefore exploratory. After adjusting for the multiplicity of the cutpoint search (maximally selected rank statistics), the log-rank–optimized cutpoint was no longer significant (adjusted p = .168).
Final analytic cohort (n = 528, 60 deaths). The model was stratified by tumor stage (advanced vs. early gastric cancer).
Stage was handled by stratification rather than as a covariate because deaths occurred almost exclusively in the advanced gastric cancer group (58 of 60 deaths). The proportional-hazards assumption was satisfied for all terms (scaled Schoenfeld residuals, global p = .15).
HR, hazard ratio; CI, confidence interval.
PubReader
ePub Link
Cite this Article
| Characteristic | AGC (n = 209) | EGC (n = 319) | Total (n = 528) | p-value |
|---|---|---|---|---|
| Age (yr) | 61.4 ± 13.3 | 59.8 ± 11.7 | 60.4 ± 12.4 | .156 |
| Sex | .775 | |||
| Male | 144 (68.9) | 215 (67.4) | 359 (68.0) | |
| Female | 65 (31.1) | 104 (32.6) | 169 (32.0) | |
| T category | <.001 | |||
| T1 | 0 | 319 (100.0) | 319 (60.4) | |
| T2 | 49 (23.4) | 0 | 49 (9.3) | |
| T3 | 103 (49.3) | 0 | 103 (19.5) | |
| T4 | 57 (27.3) | 0 | 57 (10.8) | |
| N category | <.001 | |||
| N0 | 73 (34.9) | 263 (82.4) | 336 (63.6) | |
| N1 | 32 (15.3) | 25 (7.8) | 57 (10.8) | |
| N2 | 27 (12.9) | 5 (1.6) | 32 (6.1) | |
| N3a | 39 (18.7) | 1 (0.3) | 40 (7.6) | |
| N3b | 27 (12.9) | 0 | 27 (5.1) | |
| AJCC 8th pStage |
<.001 | |||
| Stage I | 24 (11.5) | 288 (90.3) | 312 (59.1) | |
| Stage II | 78 (37.3) | 6 (1.9) | 84 (15.9) | |
| Stage III | 96 (45.9) | 0 | 96 (18.2) | |
| Lymphatic invasion | <.001 | |||
| Absent | 83 (39.7) | 270 (84.6) | 353 (66.9) | |
| Present | 126 (60.3) | 49 (15.4) | 175 (33.1) | |
| Venous invasion | <.001 | |||
| Absent | 171 (81.8) | 313 (98.1) | 484 (91.7) | |
| Present | 38 (18.2) | 6 (1.9) | 44 (8.3) | |
| Perineural invasion | <.001 | |||
| Absent | 104 (49.8) | 314 (98.4) | 418 (79.2) | |
| Present | 105 (50.2) | 5 (1.6) | 110 (20.8) | |
| Resection margin | .003 | |||
| Negative | 201 (96.2) | 318 (99.7) | 519 (98.3) | |
| Positive | 8 (3.8) | 1 (0.3) | 9 (1.7) | |
| Signet-ring component | .048 | |||
| Absent | 130 (62.2) | 170 (53.3) | 300 (56.8) | |
| Present | 79 (37.8) | 149 (46.7) | 228 (43.2) | |
| Differentiation |
<.001 | |||
| WD | 14 (6.7) | 63 (19.7) | 77 (14.6) | |
| MD | 62 (29.7) | 87 (27.3) | 149 (28.2) | |
| PD | 133 (63.6) | 169 (53.0) | 302 (57.2) | |
| Lauren classification | .002 | |||
| Intestinal | 83 (39.7) | 157 (49.2) | 240 (45.5) | |
| Diffuse | 69 (33.0) | 115 (36.1) | 184 (34.8) | |
| Mixed | 57 (27.3) | 47 (14.7) | 104 (19.7) | |
| p53 expression (manual IHC interpretation) |
.003 | |||
| Null | 37 (17.7) | 36 (11.3) | 73 (13.8) | |
| Wild-type | 108 (51.7) | 211 (66.1) | 319 (60.4) | |
| Overexpression | 64 (30.6) | 72 (22.6) | 136 (25.8) | |
| p53, aberrant grouping (manual IHC) |
.001 | |||
| Wild-type | 108 (51.7) | 211 (66.1) | 319 (60.4) | |
| Aberrant (null + overexpression) | 101 (48.3) | 108 (33.9) | 209 (39.6) | |
| Overall survival status | <.001 | |||
| Alive | 151 (72.2) | 317 (99.4) | 468 (88.6) | |
| Dead | 58 (27.8) | 2 (0.6) | 60 (11.4) |
| Cutoff method | Cutoffs | Low, n (events) | Wild-type, n (events) | Overexpression, n (events) | Global log-rank p |
|---|---|---|---|---|---|
| Manual | 8.0/106.0 | 70 (11) | 324 (27) | 134 (22) | .012 |
| Tertiles | 27.6/78.6 | 176 (24) | 176 (9) | 176 (27) | .005 |
| Log-rank optimization | 21.3/95.7 | 136 (23) | 249 (14) | 143 (23) | <.001 |
| Extended Youden index | 14.5/100.8 | 99 (16) | 288 (21) | 141 (23) | .003 |
| ROC surface (VUS) | 12.4/103.8 | 88 (15) | 302 (22) | 138 (23) | .002 |
| Cutoff method | Cutoffs | Lower Δ |
Upper Δ | Total deviation | Concordant n (%) |
κ | Linear-weighted κ | Aberrant sensitivity |
Aberrant specificity |
|---|---|---|---|---|---|---|---|---|---|
| Tertiles | 27.6/78.6 | +19.6 | −27.4 | 47.0 | 380 (72.0) | 0.580 | 0.648 | 1.000 | 0.543 |
| Log-rank optimization | 21.3/95.7 | +13.3 | −10.3 | 23.6 | 453 (85.8) | 0.766 | 0.800 | 1.000 | 0.769 |
| Extended Youden index | 14.5/100.8 | +6.5 | −5.2 | 11.7 | 492 (93.2) | 0.881 | 0.896 | 1.000 | 0.889 |
| ROC surface (VUS) | 12.4/103.8 | +4.4 | −2.2 | 6.6 | 506 (95.8) | 0.926 | 0.935 | 1.000 | 0.932 |
| Cutoff strategy (lower/upper) | Aberrant vs. wild-type HR (95% CI) | p-value |
|---|---|---|
| Manual (8.0/106.0) | 1.63 (0.97–2.76) | .066 |
| Tertiles (27.6/78.6) | 2.50 (1.21–5.14) | .013 |
| Extended Youden index (14.5/100.8) | 1.81 (1.05–3.10) | .032 |
| Log-rank optimization (21.3/95.7) |
2.65 (1.43–4.88) | .002 |
| ROC surface, VUS (12.4/103.8) | 1.91 (1.12–3.27) | .018 |
| Variable | Adjusted HR (95% CI) | p-value |
|---|---|---|
| Aberrant p53 (vs. wild-type) | 1.81 (1.05–3.10) | .032 |
| Age (per 1 year) | 1.03 (1.01–1.06) | .002 |
| Female sex (vs. male) | 1.14 (0.66–1.95) | .640 |
| Poor differentiation (vs. other) | 1.99 (1.03–3.85) | .041 |
| Signet-ring-cell component (vs. none) | 1.09 (0.59–2.01) | .777 |
Values are presented as mean ± SD or number (%). p-values are determined by independent t-test (Welch) for age and chi-square test (or Fisher's exact test for 2 × 2 tables) for categorical variables. AGC, advanced gastric cancer; EGC, early gastric cancer; AJCC, American Joint Committee on Cancer; WD, well differentiated; MD, moderately differentiated; PD, poorly differentiated; IHC, immunohistochemistry; SD, standard deviation. AJCC 8th edition pathologic stage derived from pT and pN; T4 treated as T4a. All patients underwent gastrectomy with curative intent and were M0 at surgery, so no case was assigned to stage IV. Nodal status (hence stage) is missing in 36 cases (11 AGC, 25 EGC); percentages are calculated over the full group, so N-category and stage rows may not sum to 100%; Histologic differentiation is grouped as WD, MD, or PD; p53 by manual three-tier IHC interpretation (null/wild-type/overexpression); aberrant denotes null plus overexpression.
Final analytic cohort (n = 528, 60 deaths). H-scores were computed with the primary detector (InstanSeg) using the mean of the three intensity-threshold determinations. ROC, receiver operating characteristic; VUS, volume under the ROC surface. Group sizes are given as n (number of deaths). The reported p-value is the global (three-group) log-rank p-value. Multivariable hazard ratios for the aberrant versus wild-type comparison are reported in Pairwise log-rank comparisons showed that the low and overexpression groups did not differ significantly for any method (p = .48–.95), whereas both differed from wild-type. This supports their combination into a single aberrant category; For the log-rank-optimized cutoffs, the nominal p-value is optimistically biased because the cutoffs were selected from the same survival data. After adjusting for the multiplicity of the cutpoint search (maximally selected rank statistics; Lausen-Schumacher approximation), the maximally selected statistic of 2.56 corresponded to an adjusted p-value of .168. Therefore, this strategy is reported as exploratory.
Final analytic cohort (n = 528). The manual H-score cutoffs (8.0 and 106.0) served as the common comparator, yielding three groups: 70 low, 324 wild-type, and 134 overexpression cases. κ, Cohen's kappa; ROC, receiver operating characteristic; VUS, volume under the ROC surface. The extended-Youden and ROC-surface cutoffs were derived against the pathologists’ three-tier immunohistochemistry interpretation of these same images as the reference standard. The comparator used in this table—the manual H-score cutoffs—is a separate classification, but it was set by the same pathologists on the same images and agrees with the reference standard in 493 of 528 cores (93.4%; κ = 0.878). The agreement reported here therefore reflects internal consistency rather than independent validation. Measured directly against the reference standard, the five classifications agree in 93.4% (manual), 72.2% (tertiles), 85.2% (log-rank), 91.5% (extended Youden) and 93.4% (ROC surface) of cores. The tertile and log-rank cutoffs were derived without reference to the manual interpretation; Δ denotes the difference between each data-derived cutoff and the corresponding manual cutoff; total deviation is the sum of the two absolute differences. Positive values indicate a higher cutoff than the manual threshold; Concordance denotes exact agreement of the three-tier assignment with the manual-cutoff classification. All discordances occurred between adjacent categories. Full confusion matrices are provided in Sensitivity and specificity refer to the detection of the aberrant pattern (low plus overexpression) as defined by the manual cutoffs. The manual cutoffs define the narrowest aberrant category of the five—the lowest lower cutoff (8.0) and the highest upper cutoff (106.0). Every core called aberrant by the manual cutoffs is therefore also called aberrant by every data-derived method, so sensitivity is 1.000 by construction and the methods differ only in specificity;
Final analytic cohort (n = 528, 60 deaths). Models were stratified by tumor stage (advanced vs. early gastric cancer) and adjusted for age, sex, poor differentiation, and signet-ring cell component. Stage was handled by stratification rather than as a covariate because deaths occurred almost exclusively in the advanced gastric cancer group (58 of 60 deaths). HR, hazard ratio; CI, confidence interval; ROC, receiver operating characteristic; VUS, volume under the ROC surface. The log-rank–optimized cutoffs are derived from the same survival data used for testing and are therefore exploratory. After adjusting for the multiplicity of the cutpoint search (maximally selected rank statistics), the log-rank–optimized cutpoint was no longer significant (adjusted p = .168).
Final analytic cohort (n = 528, 60 deaths). The model was stratified by tumor stage (advanced vs. early gastric cancer). Stage was handled by stratification rather than as a covariate because deaths occurred almost exclusively in the advanced gastric cancer group (58 of 60 deaths). The proportional-hazards assumption was satisfied for all terms (scaled Schoenfeld residuals, global p = .15). HR, hazard ratio; CI, confidence interval.