Skip to main content

Risk factors and predictive nomograms for early death of patients with advanced hepatocellular carcinoma: a large retrospective study based on the SEER database

Abstract

Background

Hepatocellular carcinoma (HCC) is a kind of tumor with high invasiveness, and patients with advanced HCC have a higher risk of early death. The aim of the present study was to identify the risk factors of early death in patients with advanced HCC and establish predictive nomograms.

Methods

Death that occurred within 3 months of initial diagnosis is defined as early death. Patients diagnosed with stage IV HCC between 2010 and 2015 were collected from the Surveillance, Epidemiology, and End Results database for model establishment and verification. Univariable and multivariable logistic regression analyses were used to identify the risk factors. Predictive nomograms were constructed and an internal validation was performed. Decision curve analysis (DCA) was used to verify the true clinical application value of the models.

Results

Of 6603 patients (57% age > 60, 81% male, 70% white, 46% married), 21% and 79% had stage IVA and IVB, respectively. On the multivariable analyses, risk factors for early deaths in patients with stage IVA were age, tumor size, histological grade, alpha-fetoprotein (AFP), fibrosis score, tumor stage (T stage), surgery, radiotherapy, and chemotherapy, and that in stage IVB were age, histological grade, AFP, T stage, node stage (N stage), bone metastasis, lung metastasis, surgery, radiotherapy, and chemotherapy. The areas under the curves (AUCs) were 0.830 (95% CI 0.809–0.851) and 0.789 (95% CI 0.768–0.810) in stage IVA and IVB, respectively. Nomograms comprising risk factors with the concordance indexes (C-indexes) were 0.820 (95% CI 0.799–0.841) in stage IVA and 0.785 (95% CI 0.764–0.0.806) in stage IVB for internal validation (Bootstrapping, 1000re-samplings). The calibration plots of the nomograms show that the predicted early death was consistent with the actual value. The results of the DCA analysis show that the nomograms had a good clinical application.

Conclusion

The nomograms can be beneficial for clinicians in identifying the risk factors for early death of patients with advanced HCC and predicting the probability of early death, so as to allow for individualized treatment plans to be accurately selected.

Peer Review reports

Background

Liver cancer is the fifth most frequent cancer in the world, ranking fourth in the incidence of cancer-related mortality [1, 2]. Hepatocellular carcinoma (HCC) accounts for over 80% of primary liver cancer and ranks second in cancer migration [3]. Due to the insidious symptoms and high metastatic potential thereof, over 30% of hepatocellular carcinoma patients already have extrahepatic metastases at the time of initial diagnosis [4], and the five-year relative survival rate is only 8.1% [5].

The prognosis of HCC has always been poor, and surgical treatment is usually the only treatment option [6]. However, only 5–15% of patients with early HCC have the opportunity to receive surgical treatment [7], which most commonly includes liver transplantation, liver resection, and radiofrequency ablation [8]. For patients who have lost the opportunity for surgery, studies have shown that compared with conservative treatment, transcatheter arterial chemoembolization (TACE) can increase the 2-year survival rate of patients with intermediate liver cancer by 23% [7]. At present, for patients with advanced HCC, sorafenib, an oral multi-kinase inhibitor, is the most accepted option around the world. However, in addition to the serious side effects and eventual drug resistance, the median survival time is only 12.3 months [9, 10]. Further, studies have shown that the survival rates among patients with advanced HCC at 1, 2, and 3 years were 29%, 16%, and 8% [11], and the median survival time was 5.3 months [12], indicating that advanced HCC patients were prone to early death. Therefore, early identification of risk factors for early death of advanced HCC patients and assessment of the incidence of early death will not only help clinicians discern high-risk patients in time, but also be conducive to reducing the pain and economic burden of patients. So far, there has been no research on the nomograms of early death for patients with advanced HCC. As such, developing nomograms to guide clinicians in identifying risk factors for early death of patients and implementing individualized treatment is of considerable significance.

In the present study, patients diagnosed with advanced HCC in the SEER database were included as the research objects to explore the risk factors of early death, and nomograms were constructed to evaluate the probability of early death (≤ 3 months).

Methods

Patients

In the present study, SEER  Stat (version 8.3.9.2) was used to collect all the relevant data, including patients' clinical information. The inclusion criteria were as follows: (1) patients with stage IV HCC registered between 2010 and 2015; (2) site code: C22.0; and (3) histological codes:8170/3-8175/3 [in the light of the International Classification of Tumor Diseases Third Edition (ICD-O-3)]. The exclusion criteria were as follows: (1) patients with T0 stage; (2) patients with missing ethnic information; (3) patients with missing surgery-related information; (4) patients with missing survival time; and (5) patients with the cause of death unknown. Figure 1 shows the patient selection flowchart. In consideration of the malignant degree and early metastasis performance of HCC as well as previous studies, early death was defined as death that occurs within 3 months after initial diagnosis [13, 14]. According to the latest American Joint Commission on Cancer (AJCC 8th) staging, patients with stage IVA HCC were defined as those with regional lymph node metastasis but without distant metastasis (IVA: T1–4; N1; M0); and patients with stage IVB HCC were defined as those with distant metastasis, whether with lymph node metastasis or not (IVB: T1–4; N0–1; M1) [15].

Fig. 1
figure 1

Patient selection flowchart. After selection criteria, 6603 patients were selected, of which 1392 were in stage IVA and 5211 were in stage IVB. 621 patients experienced early death in stage IVA, and 3271 patients in stage IVB suffered early death. Abbreviations: HCC, hepatocellular carcinoma

Data collection

The information of patients with advanced HCC was extracted from the SEER database. The information included the following: (1) Baseline information including age, gender, race, and marital status; and (2) Clinical characteristics including tumor size, histological grade, AFP, fibrosis score (Ishak scoring system) [16], T stage, N stage, bone metastasis, brain metastasis, lung metastasis, surgery information, radiotherapy information, chemotherapy information, survival time, vital status, and cause of death.

Statistical analysis

R software (Version 4.1.2; https://www.R-project.org) was used for all statistical analyses. The basic characteristics of the categorical variables in the patients were described using numbers and percentages (n, %), and were compared by means of the Chi-squared test. In the SEER data set, univariable and multivariable logistic regression analyses (Forward: LR) were used to identify variables that were significantly associated with early death of patients with advanced HCC. Two-sided P-values < 0.05 were considered statistically significant. Based on the statistically significant risk factors in the multivariable regression analysis, the R language “rms” package was used to develop predictive nomograms. The area under the receiver operating characteristic (ROC) curves (AUCs) were plotted to evaluate the discriminative performance of the nomograms [17]. Calibration curves were plotted to verify the accuracy and reliability of the nomograms [18]. Decision curves analysis (DCA) was performed to evaluate the applicability of the nomograms in clinical practice [19, 20]. Bootstrapping (1000 re-samplings) and cross-validation (k = 10) were performed for internal validation, comparing the C-indexes after bootstrapping between the verification model and the original data to measure the accuracy of the nomograms.

Results

Characteristics of patients

A total of 6799 patients with stage IV HCC in the SEER database were included in the present study. In accordance with the exclusion criteria, 6603 patients were selected, of which 1392 (Additional file 1: Table S1) were in stage IVA and 5211 (Additional file 2: Table S2) were in stage IVB. Among the patients, 44.6% of stage IVA patients and 62.8% of stage IVB patients experienced early death. In general, 57% of patients with advanced HCC were older than 60 years old and most were male (81%). Moreover, 70% of patients with advanced HCC were White and 16% were Black. The number of patients with tumors larger than 50 mm was over two times higher than those with tumors smaller than 50 mm. Over 65% of patients with advanced HCC were AFP positive. In stage IVB patients, 29.3% of patients had bone metastasis and 40.3% of patients had lung metastasis, but only 2.2% of patients had brain metastasis. Few patients received surgery (7.3% in stage IVA and 3.4% in stage IVB) and radiotherapy (9.3% in stage IVA and 16.0% in stage IVB), but a relatively large number of patients (over 35%) received chemotherapy, and patients receiving chemotherapy were less likely to suffer early death (21%). The characteristics of all patients are shown in Table 1.

Table 1 Characteristics with advanced HCC patients

Risk factors analysis for early death

Univariable and multivariable logistic regression analyses were used to determine the risk factors for early death in advanced HCC. In stage IVA HCC patients, 9 risk factors were identified, including age (41–60/61–80/ > 80) [OR 4.097 (1.158–17.179)/4.444 (1.259–18.591)/ 2.675 (0.700–11.897), P < 0.05]; tumor size (21–50 mm/51–100 mm/ > 100 mm/Unknown) [OR 1.642 (0.746–3.880)/2.571 (1.173–6.054)/5.521 (2.443–13.370)/4.376 (1.897–10.795), P < 0.001]; histological grade (Grade I–II/Grade III–IV/Unknown) [OR 1.754 (1.079–2.869)/0.826 (0.590–1.156), P < 0.05]; AFP (Positive/Unknown) [OR 1.796 (1.191–2.728)/1.387 (0.844–2.289), P < 0.005]; fibrosis score (Ishak 0–4/Ishak 5–6) [OR 2.528 (1.174–5.650)/2.043 (0.993–4.369), P < 0.05]; T stage (T3–4/TX) [OR 2.061 (1.501–2.838)/1.714 (0.977–3.022), P < 0.001]; surgery (Local tumor destruction/Wedge resection/Lobectomy) [OR 0.187 (0.053–0.502)/0.083 (0.012–0.332)/0.020 (0.001–0.108), P < 0.001]; radiotherapy (Yes) [OR 0.080 (0.041–0.145), P < 0.001]; and chemotherapy (Yes) [OR 0.144 (0.109–0.190), P < 0.001]. In stage IVB HCC patients, 10 risk factors were identified including age (41–60/61–80/ > 80) [OR 1.728 (1.090–2.740)/1.804 (1.137–2.864)/1.440 (0.864–2.403), P < 0.05]; histological grade (Grade I–II/Grade III–IV/Unknown) [OR 2.178 (1.703–2.792)/1.400 (1.176–1.666), P < 0.001]; AFP (Positive/Unknown) [OR 1.462 (1.194–1.791)/1.240 (0.984–1.563), P < 0.001]; T stage (T3–4/TX) [OR 1.363 (1.171–1.588)/1.249 (1.030–1.516), P < 0.001]; N stage (N1/NX) [OR 1.210 (1.029–1.426)/0.994 (0.821–1.206), P < 0.05]; bone metastasis (Yes/Unknown) [OR 1.239 (1.050–1.463)/0.715 (0.487–1.057), P < 0.05]; lung metastasis (Yes/Unknown) [OR 2.195 (1.901–2.537)/1.214 (0.839–1.763), P < 0.001]; surgery (Local tumor destruction/Wedge resection/Lobectomy/Surgery but the specific operation unknown) [OR 0.139 (0.067–0.265)/0.204 (0.089–0.441)/0.077 (0.032–0.165)/0.649 (0.141–2.597), P < 0.001]; radiotherapy (Yes) [OR 0.342 (0.281–0.415), P < 0.001]; and chemotherapy (Yes) [OR 0.163 (0.142–0.187), P < 0.001]. Tables 2 and 3 show the results of univariable and multivariable logistic regression analysis.

Table 2 The univariable logistic regression analysis for analyzing the risk factors for early death of advanced HCC
Table 3 The multivariable logistic regression analysis for analyzing the risk factors for early death of advanced HCC

Nomogram construction

Based on the independent and significant risk factors identified by multivariable logistic regression analysis, independent predictive models were developed to predict the probability of early death in patients with advanced HCC, which were presented as nomograms (Fig. 2A, B). In the nomograms, the total points could be obtained by adding up the points for each risk factor, and then the probability of early death could be estimated. For example, a 70-year-old stage IVB patient with lung metastasis of HCC, histological grade III, AFP positive, and only receiving chemotherapy, had an early death probability of about 50%.

Fig. 2
figure 2

A, B The nomograms of early death in patients with advanced HCC. A stage IVA, enrolling in 9 risk factors; B stage IVB, enrolling in 10 risk factors. Abbreviations: alpha-fetoprotein

Performance and validation of nomograms

Figure 3A, B show the ROC curves of the nomogram for predicting early death in stage IVA and stage IVB HCC patients. In stage IVA patients, the area under the ROC curve (AUC) was 0.830 (95% CI 0.809–0.851); and in stage IVB patients, the ROC curve (AUC) was 0.789 (95% CI 0.768–0.810), indicating that the nomograms had significant predictive ability. Calibration curves were used to evaluate the true compliance of the model. The abscissa was the nomogram-predicted probability of early death, and the ordinate was the actual diagnosed early death, ranging from 0 to 1. The dotted line connecting the two opposite corners was the ideal reference line, and the closer the remaining curves are to the line, the closer the predicted value was to the actual value. In the present study, all calibration curves were close to the diagonals line, indicating a good agreement between the actual observations and predictions (Fig. 3C, D). Internal verification was conducted through bootstrapping (1000 re-samplings) and cross-validation (k = 10). The C-indexes after bootstrapping were 0.820 (95% CI 0.799–0.841) and 0.785 (95% CI 0.764–0.0.806) in stage IVA and stage IVB, respectively. Figure 4A, B show the AUCs after cross-validation (k = 10), which were 0.820 (95% CI 0.799–0.841) and 0.784 (95% CI 0.763–0.805) in stage IVA and IVB, respectively, suggesting that the nomograms have good prediction performance.

Fig. 3
figure 3

A, B The receiver operating characteristic (ROC) curves for the nomogram. A stage IVA; B stage IVB. C, D The calibration curves plots for the nomogram (bootstrapping, 1000 re-samplings). C stage IVA; D stage IVB. Abbreviations: AUC, area under the curve

Fig. 4
figure 4

A, B The ROC curves after cross-validation (k = 10) for the nomogram. A stage IVA; B stage IVB. Abbreviations: AUC, area under the curve

Clinical utility

DCA was used to evaluate the clinical applicability of the nomograms. Figure 5A, B show that, in stage IVA patients, the threshold probability was 1–78%; and in stage IVB patients, the threshold probability was 1–85%. Therefore, the constructed nomograms could well assist clinicians in accurately evaluating early death of patients with advanced HCC.

Fig. 5
figure 5

A, B The decision curve analyses (DCA) for the nomogram. A stage IVA; B stage IVB. Abbreviations: HCC, hepatocellular carcinoma

Discussion

At present, most existing studies have been based on the exploration of early hepatocarcinoma and the long-term survival rate of patients. As an example, Llovet et al. reported that although treatment techniques and strategies in recent years have markedly improved, the 1-year, 2-year, and 3-year overall survival rates in advanced HCC were 29%, 16%, and 8%, respectively [11]. As such, the long-term survival rate of patients with advanced liver cancer is significantly low, and most patients will experience early death. So far, there is a scarcity of research on the early death of patients with advanced HCC. Therefore, developing a series of prediction tools to identify the risk factors and predict the probability of early death to guide clinical treatment is of considerable significance.

The Surveillance, Epidemiology, and End Results (SEER) database (https://seer.cancer.gov/data/), supported by the Surveillance Research Program (SRP) in NCI's Division of Cancer Control and Population Sciences (DCCPS), is one of the most representative broad-scale tumor registration databases, and has records of 34.6% of the US cancer registry population [21]. SEER database provides a large amount of evidence-based medical information, including patients' general information (such as gender, age, race, and marital status), as well as tumor size, TNM stage, histological grade, survival time, and vital status, which contribute to clinical medical research and evidence-based medical practice.

Although the AJCC staging system has been commonly used in the prognosis assessment of primary liver cancer, there are certain limitations in that crucial risk factors such as age, gender, race, histological grade, and treatment solutions are not included. The innovation of the present research lies in the first-time development of nomograms for early death of advanced HCC, which include the aforementioned risk factors.

Nomograms are straightforward and accessible tools, and are the visualization result of various regression analysis. Notably, nomograms have been widely used in malignant tumor risk and prognosis assessment in recent years [22]. The present nomograms were based on the SEER database, which have the characteristics of a large sample size and complete patient follow-up information. Therefore, the nomograms are more exact and stable [23, 24]. The AUC of the present nomograms was found to be greater than 0.75, indicating significantly high accuracy. Additionally, the results of internal validation also illustrate that the nomograms had good predictive ability and calibration ability. With the help of nomograms, clinicians can add the scores corresponding to each risk factor to obtain a total score, so as to accurately predict the probability of early death in advanced HCC patients, and then implement targeted therapy as soon as possible.

Wan et al. [25] constructed a prognostic scoring model for the long-term survival rate of elderly liver cancer patients based on the SEER database, but did not develop a nomogram; and Liu et al. [26] established a prognostic nomogram model for hepatocellular carcinoma based on the SEER database, but did not evaluate the clinical net benefit rate of the nomogram. Traditional ROC curve analysis is merely a statistical abstraction and cannot provide the direct clinical value [27], whereas DCA is a significant analysis in assessing whether a predictive model can be used in clinical practice and whether patients can benefit. Despite the benefits thereof, few studies have adopted the DCA approach in assessing the net benefit of predictive models. In the present study, the DCA results show that, when the threshold probability was between 1 and 78% in stage IVA patients and 1% and 85% in stage IVB patients, the net benefit of the nomogram was better than that in all-patient-death or no-patient-death scenarios.

In the present study, regardless of stage IVA or stage IVB patients, age was significantly associated with early death, which is consistent with the results of previous studies [28, 29]. From the SEER database data and the existing research, HCC is obviously more likely to occur in males [30]; however, gender was not a risk factor for early death of advanced HCC patients. In stage IVA patients, the probabilities of early death in male and female patients were 45% and 42%, and those of male and female patients with stage IVB were 63% and 64%, respectively. Further, the results show that race and marital status were not risk factors for early death of patients. Except for the aforementioned demographic characteristics, the results also show that in patients with stage IVA, larger tumor size, higher histological grade, AFP positive, higher fibrosis scores, T3–4 stage, and patients who had not received surgery, radiotherapy, or chemotherapy were at higher risk of early death, which is consistent with the previous findings of Zhang et al. [31]. In patients with stage IVB, higher histological grade, AFP positive, T3–4 stage, N1 stage, bone metastasis, lung metastasis, and those without surgery, radiotherapy, or chemotherapy, there was a tendency to experience an early death, which is consistent with the previous findings of Zhang and Chen et al. [32, 33].

As previously reported, tumor size is an independent risk factor for HCC recurrence and death after HCC resection. Taking 5 cm as the boundary, the 5-year recurrence-free survival (RFS) and overall survival (OS) rates in the ≤ 5 cm group were 38.3% and 61.5%, while those in the > 5 cm group were 25.1% and 59.9% [34]. However, the results of the present study show that tumor size was not a risk factor for early death in patients with stage IVB, which could be attributed to stage IVB HCC being mostly caused by the recurrence of early liver cancer after surgery. Here, the disease progressed rapidly, and the tumor size may have had less impact on the early death of patients. The results also illustrate that, in stage IVB patients, the fibrosis score was also not a risk factor for early death. Liver fibrosis is a chronic inflammatory process, and has been reported to have no effect on OS and RFS until developing into liver cirrhosis [35]. However, stage IVB HCC had the characteristics of rapid progression and extensive invasiveness, and cirrhosis had no chance to develop, which might be why the fibrosis score was not a risk factor for early death in patients with stage IVB [36]. The brain is one of the most likely sites for metastasis in patients with advanced HCC [32, 37, 38], but the present results did not show that brain metastasis was significantly associated with the early death of patients. Such findings could be attributed to the small number of occurrences of brain metastasis in liver cancer and the insufficient sample size.

At present, liver cancer has entered a multimodal diagnosis and treatment era. In addition to the commonly used methods of ultrasound, magnetic resonance imaging, and computed tomography, tumor markers are also emerging as a significant factor in the diagnosis of liver cancer [39]. Tumor markers that contribute to the diagnosis of HCC include AFP heterogeneity, Glypican-3, osteopontin, Des-γ-carboxyprothrombin, Golgi protein-73, abnormal pro-thrombin, and heat shock protein [40]. Among said markers, AFP is the most widely accepted serum biomarker for the diagnosis of HCC; however, the specificity and sensitivity were found to be 72–90% and 39–65%, respectively. Moreover, the early diagnosis efficiency of AFP was only 9–32%, and cholangiocarcinoma did not express AFP, which limited the clinical use thereof [41, 42]. As such, if said tumor markers can be combined with epidemiology and clinical pathology, a more accurate prediction model could be established to guide the individualized treatment of HCC.

Sorafenib is currently considered to be the standard frontline therapy for advanced HCC. However, a large number of adverse events mainly including gastrointestinal or skin diseases have been found in patients taking sorafenib. In severe cases, sorafenib can cause high blood pressure and abdominal pain, leading to interruption of treatment [43]. Approximately 30% of patients with advanced HCC can benefit from sorafenib, and such patients will usually develop drug resistance within 6 months [44]. Therefore, for the treatment of advanced HCC, new drugs need to be explored and the process of tumor resistance needs to be further understood.

Whether HCC patients with lymph node invasion should accept surgery treatment remains a controversial issue. However, in the present study, the outcome indicates that surgery had an important effect on the improvement of early death in advanced HCC. Moreover, previous studies have stressed that surgery had beneficial value for advanced HCC patients, especially for those with regional lymph node invasion [45]. As such, although the guidelines recommend targeted therapy as the frontline treatment for advanced HCC, such therapy might be more suitable for patients with stage IVB. For patients with stage IVA who only have regional lymph node metastasis, surgery might also be a better treatment option. Despite such recommendations, in consideration of the small number of patients undergoing surgery in the present study, a more prudent approach would be to set strict indications for surgery in advanced HCC based on the clinical conditions of the patients. Further, large-scale prospective studies are required to verify the surgical value of advanced HCC.

Inevitably, there are several limitations in the present study. First, although the SEER database provides a large enough sample size, there is still a lack of several potential risk factors, which may be related to early death, such as the specific location of regional lymph node metastasis, the patients' past medical history, adverse habits (drinking and smoking history), postoperative tumor remnants, the specific methods of radiotherapy and chemotherapy, and other tumor markers aside from AFP. Second, the SEER database has limitations in HCC tumor staging. Specifically, the AJCC staging system lacks important prognostic information, including Child–Pugh classification and the patients' performance status, and thus, cannot be widely endorsed for HCC. There is a possibility that the patients in the present research may have included Child–Pugh class C, who were in Barcelona Clinic Liver Cancer (BCLC) stage D, and surgery, radiotherapy, and chemotherapy were not recommended. Third, as a retrospective study, selection bias caused by censoring data was unavoidable. Finally, although internal verification suggests that the nomograms had good predictive capabilities, multiple centers and large sample size data are required for external verification to avoid overfitting.

Conclusion

In conclusion, based on the large sample size provided by the SEER database, the risk factors for early death of patients with advanced HCC were identified and nomograms were developed. The results of internal verification suggest that the nomograms had significantly high accuracy. The nomograms may help oncologists and clinicians identify risk factors and probability of early death more quickly and accurately, so as to allow for more precise individualized treatment plans to be formulated, thereby improving the patients' survival probability and quality of life.

Availability of data and materials

The original data for this study is obtained from the SEER database. The detailed website can be found at: https://seer.cancer.gov/data/. More specific data used in this study are available from the authors upon reasonable request and with permission of the SEER database.

Abbreviations

HCC:

Hepatocellular carcinoma

SEER:

Surveillance, epidemiology, and end results

C-index:

Concordance index

ROC:

Receiver operating characteristic

AUC:

Area under the curve

DCA:

Decision curve analysis

TACE:

Transcatheter arterial chemoembolization

SRP:

Surveillance research program

NCI:

National Cancer Institute

DCCPS:

Division of cancer control and population sciences

ICD-O-3:

International classification of tumor diseases third edition

OR:

Odds ratio

CI:

Confidence interval

CSS:

Cancer-specific survival

OS:

Overall survival

RFS:

Recurrence-free survival

AFP:

Alpha-fetoprotein

AJCC:

American Joint Commission on Cancer

BCLC:

Barcelona Clinic Liver Cancer

References

  1. Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394–424.

    PubMed  Google Scholar 

  2. EASL Clinical Practice Guidelines. Management of hepatocellular carcinoma. J Hepatol. 2018;69:182–236.

    Article  Google Scholar 

  3. Kole C, Charalampakis N, Tsakatikas S, Vailas M, Moris D, Gkotsis E, Kykalos S, Karamouzis MV, Schizas D. Immunotherapy for hepatocellular carcinoma: a 2021 update. Cancers. 2020;12:2859.

    Article  CAS  PubMed Central  Google Scholar 

  4. Zhang K, Tao C, Wu F, Wu J, Rong W. A practical nomogram from the SEER database to predict the prognosis of hepatocellular carcinoma in patients with lymph node metastasis. Ann Palliat Med. 2021;10:3847–63.

    Article  PubMed  Google Scholar 

  5. Zhang X, El-Serag HB, Thrift AP. Predictors of five-year survival among patients with hepatocellular carcinoma in the United States: an analysis of SEER-Medicare. Cancer Causes Control. 2021;32:317–25.

    Article  PubMed  Google Scholar 

  6. Nathan H, Hyder O, Mayo SC, Hirose K, Wolfgang CL, Choti MA, Pawlik TM. Surgical therapy for early hepatocellular carcinoma in the modern era: a 10-year SEER-medicare analysis. Ann Surg. 2013;258:1022–7.

    Article  PubMed  Google Scholar 

  7. Anwanwan D, Singh SK, Singh S, Saikam V, Singh R. Challenges in liver cancer and possible treatment approaches. Biochim Biophys Acta Rev Cancer. 2020;1873: 188314.

    Article  CAS  PubMed  Google Scholar 

  8. Xie DY, Ren ZG, Zhou J, Fan J, Gao Q. 2019 Chinese clinical guidelines for the management of hepatocellular carcinoma: updates and insights. Hepatobiliary Surg Nutr. 2020;9:452–63.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Vogel A, Cervantes A, Chau I, Daniele B, Llovet JM, Meyer T, Nault JC, Neumann U, Ricke J, Sangro B, et al. Hepatocellular carcinoma: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol. 2018;29:iv238–55.

    Article  CAS  PubMed  Google Scholar 

  10. Kudo M, Finn RS, Qin S, Han KH, Ikeda K, Piscaglia F, Baron A, Park JW, Han G, Jassem J, et al. Lenvatinib versus sorafenib in first-line treatment of patients with unresectable hepatocellular carcinoma: a randomised phase 3 non-inferiority trial. Lancet. 2018;391:1163–73.

    Article  CAS  PubMed  Google Scholar 

  11. Llovet JM, Burroughs A, Bruix J. Hepatocellular carcinoma. Lancet (London, England). 2003;362:1907–17.

    Article  Google Scholar 

  12. Collette S, Bonnetain F, Paoletti X, Doffoel M, Bouché O, Raoul JL, Rougier P, Masskouri F, Bedenne L, Barbare JC. Prognosis of advanced hepatocellular carcinoma: comparison of three staging systems in two French clinical trials. Ann Oncol Off J Eur Soc Med Oncol. 2008;19:1117–26.

    Article  CAS  Google Scholar 

  13. Song Z, Wang Y, Zhang D, Zhou Y. A novel tool to predict early death in uterine sarcoma patients: a surveillance, epidemiology, and end results-based study. Front Oncol. 2020;10: 608548.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Feng Y, Guo K, Jin H, Xiang Y, Zhang Y, Ruan S. A predictive nomogram for early mortality in stage IV gastric cancer. Med Sci Monit. 2020;26: e923931.

    PubMed  PubMed Central  Google Scholar 

  15. Amin MB, Greene FL, Edge SB, Compton CC, Gershenwald JE, Brookland RK, Meyer L, Gress DM, Byrd DR, Winchester DP. The Eighth Edition AJCC Cancer Staging Manual: Continuing to build a bridge from a population-based to a more “personalized” approach to cancer staging. CA Cancer J Clin. 2017;67:93–9.

    Article  PubMed  Google Scholar 

  16. Ishak K, Baptista A, Bianchi L, Callea F, De Groote J, Gudat F, Denk H, Desmet V, Korb G, MacSween RN. Histological grading and staging of chronic hepatitis. J Hepatol. 1995;22:696–9.

    Article  CAS  PubMed  Google Scholar 

  17. Janssens A, Martens FK. Reflection on modern methods: Revisiting the area under the ROC Curve. Int J Epidemiol. 2020;49:1397–403.

    Article  PubMed  Google Scholar 

  18. Kramer AA, Zimmerman JE. Assessing the calibration of mortality benchmarks in critical care: the Hosmer-Lemeshow test revisited. Crit Care Med. 2007;35:2052–6.

    Article  PubMed  Google Scholar 

  19. Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Mak. 2006;26:565–74.

    Article  Google Scholar 

  20. Vickers AJ, Cronin AM, Elkin EB, Gonen M. Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers. BMC Med Inform Decis Mak. 2008;8:53.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Zhang Z, Pu J, Zhang H. Development and validation of a simple-to-use nomogram to predict early death in metastatic pancreatic adenocarcinoma. Front Oncol. 2021;11: 729175.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Yan B, Su BB, Bai DS, Qian JJ, Zhang C, Jin SJ, Jiang GQ. A practical nomogram and risk stratification system predicting the cancer-specific survival for patients with early hepatocellular carcinoma. Cancer Med. 2021;10:496–506.

    Article  PubMed  Google Scholar 

  23. Shen H, Deng G, Chen Q, Qian J. The incidence, risk factors and predictive nomograms for early death of lung cancer with synchronous brain metastasis: a retrospective study in the SEER database. BMC Cancer. 2021;21:825.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  24. Huang Z, Hu C, Liu K, Yuan L, Li Y, Zhao C, Hu C. Risk factors, prognostic factors, and nomograms for bone metastasis in patients with newly diagnosed infiltrating duct carcinoma of the breast: a population-based study. BMC Cancer. 2020;20:1145.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Wan S, Nie Y, Zhu X. Development of a prognostic scoring model for predicting the survival of elderly patients with hepatocellular carcinoma. PeerJ. 2020;8: e8497.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  26. Liu K, Huang G, Chang P, Zhang W, Li T, Dai Z, Lv Y. Construction and validation of a nomogram for predicting cancer-specific survival in hepatocellular carcinoma patients. Sci Rep. 2020;10:21376.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. Vickers AJ, Van Calster B, Steyerberg EW. Net benefit approaches to the evaluation of prediction models, molecular markers, and diagnostic tests. BMJ (Clin Res ed). 2016;352: i6.

    Google Scholar 

  28. Chen X, Lu Y, Shi X, Han G, Zhao J, Gao Y, Wang X. Development and validation of a novel model to predict regional lymph node metastasis in patients with hepatocellular carcinoma. Front Oncol. 2022;12: 835957.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Ye G, Wang L, Hu Z, Liang J, Bian Y, Zhan C, Lin Z. Risk and prognostic nomograms for hepatocellular carcinoma with newly-diagnosed pulmonary metastasis using SEER data. PeerJ. 2019;7: e7496.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  30. Golabi P, Jeffers T, Younoszai Z, Otgonsuren M, Sayiner M, Mishra A, Venkatesan C, Younossi ZM. Independent predictors of mortality and resource utilization in viral hepatitis related hepatocellular carcinoma. Ann Hepatol. 2017;16:555–64.

    Article  PubMed  Google Scholar 

  31. Zhang K, Tao C, Wu F, Wu J, Rong W. A practical nomogram from the SEER database to predict the prognosis of hepatocellular carcinoma in patients with lymph node metastasis. Ann Palliative Med. 2021;10:3847–63.

    Article  Google Scholar 

  32. Chen Q-F, Huang T, Shen L, Li W. Predictive value of a nomogram for hepatocellular carcinoma with brain metastasis at initial diagnosis: a population-based study. PLoS ONE. 2019;14: e0209293.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  33. Zhang L, Yan L, Niu H, Ma J, Yuan B-Y, Chen Y-H, Zhuang Y, Hu Y, Zeng Z-C, Xiang Z-L. A nomogram to predict prognosis of patients with unresected hepatocellular carcinoma undergoing radiotherapy: a population-based study. J Cancer. 2019;10:4564–73.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  34. Liang B-Y, Gu J, Xiong M, Zhang E-L, Zhang Z-Y, Chen X-P, Huang Z-Y. Tumor size may influence the prognosis of solitary hepatocellular carcinoma patients with cirrhosis and without macrovascular invasion after hepatectomy. Sci Rep. 2021;11:16343.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. Wang Q, Fiel MI, Blank S, Luan W, Kadri H, Kim KW, Manizate F, Rosenblatt AG, Labow DM, Schwartz ME, Hiotis SP. Impact of liver fibrosis on prognosis following liver resection for hepatitis B-associated hepatocellular carcinoma. Br J Cancer. 2013;109:573–81.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Liu H, Cen D, Yu Y, Wang Y, Liang X, Lin H, Cai X. Does fibrosis have an impact on survival of patients with hepatocellular carcinoma: Evidence from the SEER database? BMC Cancer. 2018;18:1125.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Yan B, Bai DS, Zhang C, Qian JJ, Jin SJ, Jiang GQ. Characteristics and risk differences of different tumor sizes on distant metastases of hepatocellular carcinoma: a retrospective cohort study in the SEER database. Int J Surg. 2020;80:94–100.

    Article  PubMed  Google Scholar 

  38. Liu J, Chen S, Wang W, Ning BF, Chen F, Shen W, Ding J, Chen W, Xie WF, Zhang X. Cancer-associated fibroblasts promote hepatocellular carcinoma metastasis through chemokine-activated hedgehog and TGF-β pathways. Cancer Lett. 2016;379:49–59.

    Article  CAS  PubMed  Google Scholar 

  39. Zong J, Fan Z, Zhang Y. Serum tumor markers for early diagnosis of primary hepatocellular carcinoma. J Hepatocell Carcinoma. 2020;7:413–22.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. De Stefano F, Chacon E, Turcios L, Marti F, Gedaly R. Novel biomarkers in hepatocellular carcinoma. Dig Liver Dis. 2018;50:1115–23.

    Article  PubMed  CAS  Google Scholar 

  41. Zhang G, Ha SA, Kim HK, Yoo J, Kim S, Lee YS, Hur SY, Kim YW, Kim TE, Park YG, et al. Combined analysis of AFP and HCCR-1 as an useful serological marker for small hepatocellular carcinoma: a prospective cohort study. Dis Mark. 2012;32:265–71.

    Article  CAS  Google Scholar 

  42. Tsuchiya N, Sawada Y, Endo I, Saito K, Uemura Y, Nakatsura T. Biomarkers for the early diagnosis of hepatocellular carcinoma. World J Gastroenterol. 2015;21:10573–83.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  43. Colagrande S, Regini F, Taliani GG, Nardi C, Inghilesi AL. Advanced hepatocellular carcinoma and sorafenib: diagnosis, indications, clinical and radiological follow-up. World J Hepatol. 2015;7:1041–53.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Tang W, Chen Z, Zhang W, Cheng Y, Zhang B, Wu F, Wang Q, Wang S, Rong D, Reiter FP, et al. The mechanisms of sorafenib resistance in hepatocellular carcinoma: theoretical basis and therapeutic aspects. Signal Transduct Target Ther. 2020;5:87.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Chen L, Sun T, Chen S, Ren Y, Yang F, Zheng C. The efficacy of surgery in advanced hepatocellular carcinoma: a cohort study. World J Surg Oncol. 2020;18:119.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors are grateful to all the patients, researchers, and institutions that participated in the SEER database.

Funding

The present study was funded by 1: The National Natural Science Foundation of China. (81872255, 62141109). 2: The Leading-edge Technology Programme of Jiangsu Natural Science Foundation (BK20212012).

Author information

Authors and Affiliations

Authors

Contributions

HDZ and YWZ contributed to the study design and literature search. HDZ, HD, WJX, and PCZ completed the data analysis. HDZ, XLD, SWL, XQ, and YZ generated and improved the figures and tables. HDZ and XLD completed the manuscript. YWZ and MY proofread the manuscript. All authors contributed to the article and approved the submitted version.

Corresponding authors

Correspondence to Meng Yang or Yewei Zhang.

Ethics declarations

Ethics approval and consent to participate

All experimental protocols were approved by the National Cancer Institute (USA) to obtain research data on cancer patients (reference number 17461-Nov2020). This study was in line with the 1964 Helsinki Declaration and subsequent amendments or similar ethical standards.

Consent for publication

Not applicable.

Competing interests

All authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Table S1

. A dataset of the information of stage IVA HCC patients.

Additional file 2: Table S2

. A dataset of the information of stage IVB HCC patients.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, H., Du, X., Dong, H. et al. Risk factors and predictive nomograms for early death of patients with advanced hepatocellular carcinoma: a large retrospective study based on the SEER database. BMC Gastroenterol 22, 348 (2022). https://0-doi-org.brum.beds.ac.uk/10.1186/s12876-022-02424-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12876-022-02424-5

Keywords