Abstract
Multiple immunosuppressive mechanisms exist in the tumor microenvironment that drive poor outcomes and decrease treatment efficacy. The co-expression of NOS2 and COX2 is a strong predictor of poor prognosis in ER- breast cancer and other malignancies. Together, they generate pro-oncogenic signals that drive metastasis, drug resistance, cancer stemness, and immune suppression. Using an ER- breast cancer patient cohort, we found that the spatial expression patterns of NOS2 and COX2 with CD3+CD8+PD1- T effector (Teff) cells formed a tumor immune landscape that correlated with poor outcome. NOS2 was primarily associated with the tumor-immune interface, whereas COX2 was associated with immune desert regions of the tumor lacking Teff cells. A higher ratio of NOS2 or COX2 to Teff was highly correlated with poor outcomes. Spatial analysis revealed that regional clustering of NOS2 and COX2 was associated with stromal-restricted Teff, while only COX2 was predominant in immune deserts. Examination of other immunosuppressive elements, such as PDL1/PD1, Treg, B7H4, and IDO1, revealed that PDL1/PD1, Treg, and IDO1 were primarily associated with restricted Teff, whereas B7H4 and COX2 were found in tumor immune deserts. Regardless of the survival outcome, other leukocytes, such as CD4 T cells and macrophages, were primarily in stromal lymphoid aggregates. Finally, in a 4T1 model, COX2 inhibition led to a massive cell infiltration, thus validating the hypothesis that COX2 is an essential component of the Teff exclusion process and, thus, tumor evasion. Our study indicates that NOS2/COX2 expression plays a central role in tumor immunosuppression. Our findings indicate that new strategies combining clinically available NOS2/COX2 inhibitors with various forms of immune therapy may open a new avenue for the treatment of aggressive ER- breast cancers.
Introduction
Immune therapies, such as checkpoint inhibitors, cancer vaccines, and T cell adoptive therapies, have created novel treatment options for advanced cancers (1–6). Some success in combining immune with conventional therapy has shown immune system polarization as a significant factor in overcoming clinically challenging tumors. Various immunosuppressive mechanisms within the tumor microenvironment (TME) are among the most significant stumbling blocks for successfully treating challenging cancers (7). Given the importance of immune evasion for tumor survival, the spatial characterization of immune cells and the distribution of potential immunosuppressive agents within the TME must be evaluated.
The numerous molecular effectors inhibiting the immune response within the TME act on the immune, stromal, and tumor cells compartments. Immunosuppressive mechanisms include T cell-centered mechanisms, such as PD1/PDL1 and Treg; cellular factors, cytokines, growth factors, and small molecules derived from metabolites, such as kynurenines and polyamines (8–11). The co-existence of these different immunosuppressive mechanisms in the TME provides multiple layers of immune suppression.
Nitric oxide synthase 2 (inducible NOS; NOS2) and cyclooxygenase-2 (COX2) have been suggested as drivers of a poor prognosis (12–17), and play a significant role in the immunosuppressive properties of several cancers. In many solid tumors, NOS2 and COX2 are elevated (18–23). In estrogen receptor negative (ER-) breast cancer, in particular, elevated NOS2/COX2 levels are one of the strongest predictors of poor prognosis (16). Both NOS2 and COX2 form a feedforward loop fueling the propagation of different pro-tumorigenic mechanisms. They, in turn, activate primary oncogenic pathways, ultimately leading to metastasis, chemoresistance, and cancer stem cell characteristics (16). According to recent research (12, 24), NOS2 and COX2 are associated with the restriction of CD8 cells in human malignancies. Moreover, in animal models, inhibiting NOS2 and COX2 produces profound changes in the immune system, countering the metastatic process and tumor growth, resulting in cures and resistance to tumor rechallenge (24). Accordingly, NOS and COX inhibitors dramatically increase survival in chemo-resistant triple-negative breast cancer (TNBC) (24–26).
Mechanistically, NOS2 and COX2 induce the cytokines IL10, TGFβ, and IL6, which suppress the immune system (24, 27), while modifying the metabolic programming of particular cells (16, 28–30). NOS2 and COX2 are heme proteins that can swiftly respond to environmental changes, such as hypoxia and inflammation, making them crucial components linking environmental sensing and immune status (31). CD8 T cells and IFNγ are essential for NOS2 and COX2 expression in the tumor cells in vivo (12). This requirement of antitumor factors to induce NOS2 and COX2 is strongly associated with poor outcomes and presents a conundrum. Indeed, regions of elevated NOS2 and COX2 are close to restricted CD8 cells and lymphoid aggregates, whereas, in cold regions (i.e., low CD8 counts) and immune deserts, COX2 is present (24). However, when CD8 cells penetrate the tumor nest, NOS2 and COX2 levels in the entire tumor are low, suggesting their significant role in CD8 restriction and exclusion. This progression from an inflammatory region to an immune desert suggests that, in addition to NOS2 and COX2, other immune-suppressive factors account for the transition from inflammation to an immune desert status.
IFNγ and cytokines are essential for tumor eradication as well as the induction of NOS2 and COX2, that is linked to poor prognoses (12, 25). This apparent dichotomy of IFNγ activity between tumor eradication (via facilitated positive immune responses in the host) and NOS2/COX2- associated tumor evasion (via PDL1, Treg, B7H4, and IDO1), implicates it as a mediator in a delicate balance (16, 32, 33). Similar dichotomies exist for the immunosuppressive agents IDO1 and PDL1 that are stimulated by IFNγ (34, 35). This negative feedback response to IFNγ results in suppression of the cytolytic activity of T cells. The spatial evaluation of immunosuppressive factors and their relationships can be exploited for more effective treatments against difficult-to-treat forms of cancer.
In the current study, we performed immunohistochemical analyses on ER- breast cancer biopsies to determine whether the spatial distribution of NOS2 and COX2 contributes to other immune suppressive mechanisms involving PD1/PDL1, Treg, IDO1, and B7H4 to suppress Teff (CD3CD8PD1-) cell function. Our collected evidence demonstrates that NOS2 and COX2 play a crucial and complementary role in the tumor’s immune suppression mechanisms, and that the spatial orientation of immune and tumor cells creates a unique tumor landscape that drives the formation of immune deserts and immune cell restriction, fueling immune suppression, thus tumor progression.
Results
Comparison of immunosuppressive markers with patient survival
The composition of immunosuppressive factors in the TME influences the immune profile determining therapeutic response (36–39). There are four distinct methods of immunosuppression: 1) cell-to-cell contact with specific receptors such as PDL1/PD1 and B7H4; 2) generation of diffusible proteins like cytokines and growth factors, such as IL10 and TGFβ; 3) production of small diffusible molecules like metabolic substrates, such as kynurenines, polyamine; 4) small molecule regulators, such as NO and PGE2 (40–48). Thus, each type has a specific spatial distribution to mediate immunosuppression that ranges from direct cell contact agents to those that diffuse throughout the tumor, and even systemically, impacting different tissues throughout the body. To define the immunosuppression mechanisms of NOS2 and COX2 within the tumor, multiplex immunofluorescence was used to define their location. Tumor samples from 21 ER- breast cancer patients (ER-), which included deceased (n=11) and alive (n=10), were imaged (see Materials and Methods). Multiple immune cell markers were evaluated, such as: CD68 for macrophage; T cell markers, CD3, CD4, CD8; tumor markers CK-SOX10; immune modulatory factors, PD1, PDL1, FOXP3, IFNγ, NOS2, and COX2. The percentage of cells containing these markers were then compared with survival outcome (Fig.1A). Only NOS2 and COX2 were statistically associated with a negative outcome as a univariate (Fig.1A). NOS2 was evaluated at 3 levels determined by average cell intensity, to be weak (NOS2w), medium (NOS2m), or strong (NOS2s), showing that increased NOS2 expression correlated with poor outcome (Suppl. Fig. 1A). In contrast, IFNγ demonstrated slightly elevated levels that were marginally associated with a positive outcome. In contrast, the other markers lacked significance (Fig.1A). These results indicate that NOS2/COX2 were the only factors associated with poor prognosis at the single cell level, corroborating previous IHC-based studies (49, 50).
In the tumor epithelium of ER-breast cancer, there is an inverse relationship between NOS2/COX2 levels and Teff numbers that is associated with poor outcomes. To define the survival relationship between NOS2 and COX2 with other immune and tumor factors, the ratio of the percentage of cells expressing a given factor to NOS2s and COX2 expression levels was evaluated. Prior studies showed that NOS2 is predominantly associated with the tumor epithelium (49). When the ratio of NOS2/COX2 to the tumor marker CK-SOX10 was analyzed (Fig. 1B), there was a strong and statistically significant difference in survival, with a significant correlation between higher NOS2/COX2 per tumor cell and decreased survival (Fig.1B, Suppl. Fig. 1B). This evidence indicates that higher proportion of NOS2 or COX2 expressing tumor cells is associated with a poor prognosis. Furthermore, a linear analysis showed that NOS2s and COX2 had a strong correlation in deceased but not in alive patients (Fig. 1C, Suppl. Fig.1D). The analysis of the co-expression of NOS2m and COX2 with the tumor marker CK-SOX10 revealed that tumor-NOS2m and tumor- COX2 was also linear in deceased but not alive patients (Fig.1C). Thus, this set of data indicates that tumor-NOS2 and -COX2 correlate strongly with the outcome, confirming our previous finding by immunohistochemistry DAB staining that NOS2 and COX2 in the tumor epithelium is associated with poor outcome (49).
Next, the ratio of NOS2s and COX2 was compared with different immune factors. The results show that the immune markers CD8 and CD3 correlated with survival, while PDL1, PD1, FOXP3, and CD68 did not (Sup. Fig.1E-H). Further classification of the CD3/CD8 phenotype showed that the ratio of NOS2s and COX2 to CD3+CD8+ (CD3CD8) numbers was significant (Suppl. Fig.1K). Further subtyping the CD3CD8 phenotypes show that the NOS2s ratio with Teff (CD3CD8PD1-) were strongly significant but not with Tex (CD3CD8PD1+) (Fig.1D, Suppl. Fig,1K). Conversely, CD4/CD3 phenotypes such as Treg did not correlate with survival (Suppl. Fig 1F). These findings demonstrate that Teff (CD3CD8PD1-) has an inverse relationship with NOS2 and COX2. CD8 Teff is a significant source of IFNγ, which can lead to induction of NOS2 and COX2 (12) (Graphical Abstract). Comparing the ratio between NOS2 or COX2 with IFNγ, a strikingly similar significant trend to CD8 Teff was observed (Fig. 1D). Furthermore, the ratios between NOS2, COX2, and CD8 was analyzed using more extensive databases such as GEO and TCGA (Fig.1F). Comparing the 75th percentile of high NOS2 to the remaining samples reveals a significant correlation with a negative outcome, confirming the relationship between NOS2 and CD8 (Fig.1F). Therefore, these single-cell fluorescence analyses were confirmed by the larger genomic databases corroborating the existence of a crucial antagonistic relationship between NOS2 and COX2 and T-effector/ IFNγ presence that is associated with survival.
Immune suppression of Teff cells through negative feedback by NOS2 and COX2
One of the contradictions in this relationship between T-effector/IFNγ and NOS2/COX2 is that IFNγ is required to induce NOS2 and the Th1 cytokines TNF and IL1 in human malignancies (12, 51–53). This evidence suggests that, although NOS2/COX2 inhibit Teff/ IFNγ, this cytokine must be present in the tumor. Using a linear analysis, NOS2 and COX2 were plotted against IFNγ in all the samples, showing no significant correlations (Suppl. Fig. 1I and J). However, when analyzed comparing deceased and alive patients, the deceased group showed a strong linear relationship between NOS2s and IFNγ, which was absent in the surviving patients . Linear analysis of NOS2 with Teff revealed similar results (Fig. 1, Suppl. Fig. 1K). These linear correlations indicate that the NOS2s phenotype requires IFNγ from Teff, which leads to increased NOS2/COX2 associated with poor outcomes (paper 4 submitted). The contradicting results between beneficial Teff/IFNγ and harmful NOS/COX2 effects can be explained by the ability of PGE2 and NO to decrease Th1 responses via multiple mechanisms, including inducing IL10 and TGFβ (54, 55), in a negative response to IFNγ and TNF/IL1. These survival-based correlations demonstrate that NOS2 and COX2 play a leading and conspicuous role in the immune suppression of Teff cells in ER- breast cancer. Nonetheless, the dichotomy poses the question of how this distribution and configuration may spatially and temporally influence immunosuppression in ER- breast cancer and the relationship between other immune suppressive mechanisms.
Immune suppressive phenotypes distribution at the whole tumor level
In deceased patients, Teff (CD3CD8PD1-) are excluded from tumor nests, while IFNγ is more evenly distributed throughout the tumor (12, 56). To define the spatial localization of Teff and IFNγ relative to NOS2/COX2, density heat maps were utilized to evaluate the juxtaposition between these factors within the TME. Examining the spatial relationship between NOS2 and COX2 with Teff (CD3CD8PD1-) and IFNγ reveals their spatially unique orientation (Fig. 2A). In contrast to widely distributed IFNγ throughout the tumor, dense regions of Teff (CD3CD8PD1-) clusters form foci spatially distinct from high density NOS2 and COX2 areas (12). While orthogonal, the Teff cells were proximal to NOS2+ regions (Fig. 2A). These findings suggest that in deceased patients, Teff (CD3CD8PD1-) are excluded from tumor nests while IFNγ is more evenly distributed throughout the tumor. This is consistent with IFNγ binding to other cells in regions of the lipid rafts (57). From this analysis, there are clear distinct regions of NOS2, COX2, and Teff in the deceased patients.
NOS2 and COX2 are predominant in tumor regions where CD3CD8 content is lower
To further define the distribution of immunosuppressive cellular phenotypes and NOS2/COX2, the ratio of immunosuppressive markers (i.e., Treg, Mac-PDL1, etc.) with tumor-COX2+ was analyzed and plotted against Teff (CD3CD8PD1-). The highly significant linear correlation between tumor-COX2+ and tumor-NOS2+ (Fig.1C) allows either to used to evaluate their association with different cellular phenotypes. Due to the antagonistic relationship concerning survival between NOS2 or COX2 with Teff cell number, a ratio of each marker to tumor-COX2+ was calculated and plotted against the percentage of Teff cells. The ratio between each immune suppressive cellular phenotype and tumor-COX2+ by itself was insignificant (Suppl. Fig.2A). Nonetheless, when the ratio of these immune suppressive phenotypes to tumor-COX2+ was plotted against the Teff cel percentage, a significant linear relationship was observed in which the ratio of lymphoid cells CD4 Treg, CD8 Treg, and CD8 Tex (CD3CD8PD1+) (Fig. 2C). The correlations between tumor-PDL1 and macrophage-COX2 were only marginally significant, indicating a weak relationship (Fig. 2D). Overall, whole tumor PDL1 cellular phenotypes were not highly correlated with survival or related to other cellular phenotypes in this cohort (Fig. 2B). Thus, leukocyte-based immunosuppressive cells are favored in the presence of elevated lymphoid cells in the tumor (inflamed tumor), while NOS2 and COX2 predominates in the presence of lower overall CD3CD8 (cold, immune desert) indicting distinct roles in tumor immunosuppression between inflamed and cold regions.
Spatial clustering of tumor-NOS2+ and tumor-COX2+ is a significant determinant of poor outcome in ER- breast cancer
To identify cellular neighborhoods that correlate with outcome, a spatial uniform manifold approximation and projection (S-UMAP) analysis of all single cell neighborhoods was conducted (58). The S-UMAP was applied to all single cell neighborhood density profiles constructed of 9 phenotypes (CD4+FOXP3+ CD8+FOXP3+, CD8+CD3+PD1+, tumor NOS2+, tumor COX2+, tumor PDL1+, CD68+PDL1+, CD68+COX2+, and others) to identify clusters of similar neighborhoods. The differential cluster distribution (the ratio of cluster populations by outcome) revealed that relative to survivors, deceased patients had a greater percentage of cellular neighborhoods with elevated levels of tumor-NOS2+, tumor-COX2+, CD4+FOXP3+, CD8+FOXP3+, and CD68+PDL1+ (Fig 2E, F). Comparison of distances between individual factors show that tumor-COX2+, and tumor-NOS2+had a gradient effect where the correlation with inhibitory cell types in deceased patients deceased rapidly with distance (Fig 2G). In the cellular neighborhoods of deceased patients, the tumor-COX2+ and tumor-NOS2+ densities decreased rapidly over 100 µm (Fig 2G). This suggests that clustering of tumor-NOS2+ and tumor-COX2+ in spatially distinct regions is an important determinate of poor outcome. In contrast, Treg and Tex (CD68+PDL1+) impact on survival was not dependent on distance (Fig 2G). Furthermore, exhausted T-cells CD8+CD3+PD1+and tumor-PDL1 were marginally predictive of good outcome which could be attributed to success of extensive CD8 tumor infiltration and widespread IFNγ (Fig 2G). This unbiased analysis identifies the cellular phenotypes that impact survival, implicating the presence of distinct neighborhoods in deceased patients with specific configuration and location of these specific cellular immunosuppressive phenotypes. Thus, S-UMAP analysis validates our contention that tumor-NOS2+ and tumor-COX2+ in spatially distinct cellular regions is an important determinant of poor outcome in patients with ER- breast cancer.
Immune suppression mechanism occurs in specific regions of the TME
The correlation between Teff density and immunosuppressive phenotype suggests that the mechanism of immunosuppressive factors has regional spatial orientation connotations. Previous reports show that tumor-excluded (cold) vs. infiltrating (hot) CD8 cells have an impact on survival (56). The tumor has numerous spatially distinct regions, spanning from lymphoid aggregates to tumor cores; therefore, the regional distribution of immune-tumor interactions was evaluated. To this end, five distinct regions with specifically defined tumor anatomical features were annotated, including lymphoid aggregates and small and large tumor nests. The tumor regions were subdivided into edges of a large tumor’s NOS2+/- region at the tumor/stromal interface and the interior (core) (Fig. 3A-C). The smaller tumor fragments were defined tumor clusters > 0.02 mm2 and in most cases less than 3 cells thick in one dimension. In contrast, the larger tumor nest > 0.1 mm2 was used to designate the tumor core or edges. Spatial analysis of these regions with cellular phenotypes presented above was analyzed in these regions (Fig. 3 D-E). The percentage of cell categories in each region was determined. As anticipated, lymphoid cellular phenotypes formed a gradient from lymphoid aggregates to the tumor’s interior. As expected, the lymphoid aggregates had the highest of leukocytes, including both CD3 (either CD4 or 8) and CD68 cells, with far less tumor cells (Fig. 3D-G). In contrast, the tumor core had considerably lower leukocytes (<3%) and more tumor cells. One feature is that alive patients had 4 times more Teff in the interior of the tumor than deceased, indicating more infiltration, consistent with previous reports (12, 56) (Fig. 3D). In deceased patients, there was ∼ 1% Teff cells, which corresponds to an immune desert and is consistent with CD8 cell exclusion leading to poor outcome (56). As anticipated, NOS2 and COX2 were associated with tumor regions, constituting the tumor’s predominant phenotype as compared to CD3 and CD68 (Fig. 3 F, G). PDL1 was detected in both tumor cells and macrophages. CD3CD4 (Treg?) was restricted to stroma and lymphoid marginal aggregates in deceased and alive patients. As anticipated, the phenotypes of these immune suppression markers were in distinct regions.
NOS2/COX2 drives Teff exclusion from the tumor
As shown above, the large and even small tumor nests exclude CD3CD8 cells from the core, resulting in the development of immune deserts. A previous report suggested that in TNBC, fibrosis was the primary driver of this processes, restricting mobility of CD8, while others suggest an unknown factor (56). Examining the edge of the larger tumors, NOS2 and COX2 were expressed at the tumor edge and less in the core, suggesting an essential role in excluding Teff. In a comparison of different regions of the different tumors, there appear to be 3 classes of CD8 T- cells exclusion from the tumor nest forming immune desert: Type I: restricted inflamed with NOS2+ edge and COX2hi; Type II NOS2- with COX2hi and Type III with NOS2-, sporadic COX2 with few proximal stromal lymphoid cells <500 µm (<1%) (figure 4A). These observations point to COX2 as having a significant role in the final phases and maintenance of the tumor’s immune desert and exclusion of Teff cells.
To investigate the role of NOS2 and COX2 in Teff exclusion, a TNBC murine model was used. Our previous study shows that in the murine TNBC 4T1 model in untreated control, CD8 lymphoid cells were restricted in the margins similar to the immune desert in the human deceased patient (Fig. 3A & B) (24). While there was less difference between the control and NOS2- animals, inhibition of COX2 with indomethacin (INDO) resulted in extensive infiltration of Teff and a dramatic increase in IFNγ and CD8 cells (24). As depicted in Figure 4B, spatial analysis reveals the infiltration of Teff (CD3CD8PD1-) cells into the core of the tumor, resulting primarily from COX2 inhibition less from NOS2. In contrast, CD4 cells remained on the outside despite Teff infiltration(24) (Fig. 4C). This evidence suggests that while NOS2 and COX2 control the migration of CD8, CD4 mobility is unaffected. These results show that COX2 has a significant role in excluding CD8 cells from the tumor’s interior and that targeting it can convert cold tumors to inflamed tumors with infiltrating CD8 Teff, resulting in a more effective response.
The differential movement of CD8 and CD4 observed in the murine model was examined in humans, comparing deceased and alive patients. Regions at the tumor edge proximal to a lymphoid patch were examined in type I immune desert (inflamed but stromal restricted Teff) correlating with deceased patients compared with alive patient infiltrating Teff. As seen in Figure 4D, the deceased patient with restricted CD8 and CD4 were predominately confined to the lymphoid aggregate. However, in the alive patient the CD8 readily migrated, infiltrating the tumor core, yet like in the murine model, the CD4 cells remained in the lymphoid aggregate. Taken together, from murine and human samples clearly show that COX2 controls CD8 mobility while CD4 cells remain near the lymphoid aggregate (Fig. 4E).
COX2/PGE2 have been shown to differentially impact various types of T cells, favoring more immune suppressive phenotypes. When the lymphoid aggregate was analyzed for different immune cellular phenotypes, there was a difference between deceased and alive patients. Analysis of Teff ratio with different immune markers comparing survival showed only the ratio of Teff/CD4 Treg and Teff/Mac-PDL1 had a significant effect on survival (Fig. 4F). This finding was corroborated in the 4T1 model where addition of indomethacin and INDO/NOS2- inhibition resulted in higher Teff/CD4 Treg or Teff/Mac-PDL1 ratios (Fig. 4G). To further extend this observation, CD8a and FOXP3 showed increased HR, validating these ratio relationships (Fig. 4H). The above data taken together clearly show that COX2 and NOS2 have a significant role in controlling the infiltration and mobility of CD8 as well as the immune polarization within the tumor lymphoid aggregates.
NOS2 and COX2 are spatially distinct from Treg and PDL1
Figures 2 and 3 show that NOS2 and COX2 are distinctly localized. Therefore, a comparison of different types of whole tumor configurations was undertaken. Whole tumor phenotypes were established based on the distribution of CD3CD8PD1-, tumor-NOS2, and tumor-COX2 (Suppl. Fig 3A). Correlation analysis was used to determine the threshold based on the % of cells in the whole tumor as high (+) and low (-), which provided the development of general whole tumor phenotypes (Suppl. Fig. 3A-C). As seen from a scatter plot of NOS2 or COX2 versus Teff, there are 3 distinct major phenotypes (sup. Fig 3B). In the surviving patients, the major phenotype was Teff+ CD8+ (CD3CD8PD1- (9/10)) which upon closer examination shows infiltrating CD8 cells (Fig.4A). Conversely, deceased patients had more varied distribution ranging from CD8+NOS2+COX2+ (restricted CD8 inflamed type I immune desert (fig 4A)) to CD8-NOS2- COX2lo (Type III immune desert (Fig. 4A). The majority of deceased patients exhibited a predominant CD8-NOS2-COX2+ (type II immune desert, Fig. 4A) phenotype. The difference between these phenotypes is that CD8 cells were restricted from the tumor in deceased patients while the tumors were fully infiltrated in survivors.
Next, density heat maps of tumor-PDL1, Treg FOXP3, tumor-NOS2+, and tumor-COX2+ compared with CD3CD8 were done to identify the topography of each cellular neighborhood (Fig. 5). Restricted tumors classified as CD8+NOS2+COX2+ had two distinct regions containing both high (restricted inflamed) and devoid CD3CD8 regions (immune desert) (Fig. 5A). Figure 5A shows that in restricted CD8 regions, lymphoid aggregates also had Treg and PDL1. In contrast, regions with low or absent CD3CD8 cells contain more tumor-NOS2+and tumor-COX2+, consistent with figures 2 and 3, supporting the existence of regional differences. One deceased patient with inflamed but restricted CD8+ was devoid of either NOS2 or COX2. However, extraordinarily high levels of Treg, PDL1, and PD1 were observed. Thus, confirming the notion that Treg, PDL1, and PD1 are spatially and even temporally associated with Teff cells while orthogonal to NOS2 and COX2 (Fig 5B). This clearly supports the linear analysis in Fig. 2C. Figures 5C and D represent Low CD3CD8 (immune deserts) with low NOS2 but higher COX2. In contrast, alive patients have low levels of NOS2 and COX2, and high levels of infiltrating CD3CD8PD1- yet there were low levels of Treg, implicating that in the absence of NOS2/COX2, Treg is a predominate factor in immune suppression.
In contrast, low Treg with higher NOS2 and COX2 leads to immune suppression and poor outcomes. In addition, there were low levels of PDL1 and high levels of IFNγ. Since PDL1 can be induced by IFNγ expression, this indicates the efficacy of tumor eradication. These two distinct profiles of deceased and living patients demonstrate that NOS2 and COX2 play a significant role in determining survival and is involved from the transition from inflamed to the immune desert.
IDO1 and B7H4 have distinct spatial orientation
Previous studies show that the immunosuppressive factors IDO1 and B7H4 were in distinct regions (56). Whereas IDO1 was largely associated with the lymphoid regions, the B7H4 was associated with the tumor core (56, 59). Here, spatial analysis using multiplexing fluorescence for IDO1 and B7H4 were examined and compared with other immunosuppressive markers. When IDO1 and B7H4 were evaluated in univariant survival analyses, there was no significance (Fig. 6A, B). However, the ratio of NOS2s to IDO1 and B7H4 was significant relative to Teff and IFNγ (Fig. 6A, B). Since IDO1 and B7H4 can be induced by IFNγ (60), this may reflect Teff/IFNγ activity. Previous studies indicate that a high IDO1 level is a favorable prognostic indicator for ER+ but not significant for ER- breast cancer (61). These findings suggest that NOS2/COX2 and IDO1 have a contrary relationship in terms of survival. IDO1 to NOS2 versus CD8CD3 demonstrates, once more, that the IDO1/NOS2 ratio is associated with elevated CD3CD8 and, more importantly, CD8CD3PD1- cytolytic T cells.
Next, the localization of IDO1 and B7H4 was compared to CD3CD8, tumor-NOS2 and tumor-COX2. Using density heat maps, it is confirmed that higher IDO1 concentrations are proximal to lymphoid-restricted regions, indicating association with the lymphoid aggregates (Fig 6C-F). However, B7H4 was associated with immune desert and the core of the tumor. Comparing these to tumor-NOS2 and tumor-COX2, IDO1 was more closely associated with edge and lymphoid aggregates proximal to NOS2 in deceased and widely distributed in alive patients. In contrast, the immune desert contained both B7H4 and COX2. Thus, IDO1 is associated with inflamed regions containing CD3CD8 cells proximal to NOS2 in deceased patients, but the immune desert is predominately COX2 and B7H4. A landscape of different immunosuppressive cellular phenotypes shows those that are predictive of survival occupying unique regions of the tumor microenvironment.
Discussion
Poor outcomes for cancer patients are determined by processes such as metastasis, chemoresistance, and immunosuppression. The immunosuppressive tumor microenvironment is a significant obstacle to successful immunotherapy, thus interventions capable of reducing immunosuppression are promising. Our study shows that that NOS2 and COX2 have powerful immunosuppressive properties that participate in progressive depression of the immune antitumor response. IFNγ from Teff is crucial in inducing NOS2/COX2 expression in TNBC (12), and the resulting NO/PGE2 production inhibits Teff function. This dichotomy represents a classic negative feedback mechanism, where IFNγ from activated Teff increases tumor-NOS2 and COX2, dampening the Th1 antitumor response. The specific spatial orientation of Teff/NOS2/COX2 is a critical determinant of outcome and shapes the immunosuppressive response. Patients with positive outcomes have low, sporadic, NOS2 and COX2 expression, with Teff penetrating the tumor core. In contrast, patients with stromal or marginally restricted Teff can have elevated NOS2 and/or COX2, which, when regionally clustered, forms a leukocyte-depleted zone that does not permit Teff penetration. Thus, the spatial relationship between NOS2/COX2 expression and Teff cells shapes the immune environment of the TME.
There are 3 distinct types of CD8 T-cell exclusion from the tumor core with respect to Teff/NOS2/COX2 that correlate with poor outcomes: Type I, restricted inflamed, with stromal restricted CD8 T-cell inflamed regions with elevated tumor NOS2 and COX2; Type II, developing immune desert with a lower percentage of stromally restricted CD8 T-cells where there is tumor-COX2+ without tumor-NOS2; and Type III, indicating mature immune desert with <1% CD8 cells (<500 µm (<1%) with tumor-NOS2-, and sporadic COX2 with few stromal lymphoid cells with elevated B7H4. Another feature that distinguishes Type I and II from III is that in Type I and II there are proximal lymphoid aggregates to the tumor, while in type III there is none. Although these are distinct regional phenotypes, it is not uncommon to observe all of them in the same tumor, suggesting that these are linked through a progressive process from the inflammatory entry of tumor infiltrating lymphocytes (TIL) inducing NO/PGE2 production, leading to mature immune deserts.
CD8 exclusion from the tumor prevents the cell-to-cell contact necessary for Teff release of cytolytic effector molecules into tumor cells. This specific cell interaction targets tumor/virally infected cells, limiting damage to normal tissue in contrast to the non-specific killing of rapidly growing cells that occurs with conventional therapies (62–65). Thus, interventions that enhance T cell entry into the tumor and their tumoricidal activity will be therapeutically beneficial. In a previous study in TNBC, restriction of CD8 was related to poor outcomes, consistent with other reports in various cancers; therefore, higher TIL can be restricted or infiltrated (66–69). Furthermore, the authors show that there were three different types of CD8 exclusion: stromally restricted, marginally restricted, and complete immune desert (<1% CD8). However, an understanding of the distinct spatial distributions is required to clearly define the mechanisms operating in the immune/tumor interaction. The definition of the three types of CD8 exclusion regarding NOS2 and COX2 expression shown here demonstrates that tumor exclusion of Teff is controlled by NOS2 and COX2.
While NOS2 and COX2 impact the whole tumor landscape, they also influence specific tumor regions, increasing the TME heterogeneity. The 5 regions: large tumor nests with or without NOS2 expression, lymphoid aggregate, tumor edge, tumor core, and tumor satellites, are impacted differently by the spatial configuration and distribution of Teff/NOS2/COX2. The regional restriction maintaining distance between lymphoid cells appears to be an essential process to protect the tumor and reduce the TIL. More importantly, each region has a distinct immunosuppressive mechanism. For example, the core of larger tumors is predominated by COX2 and B7H4, while the inflamed edge is NOS2+/COX2+. In the lymphoid aggregates, immune cell-based immunosuppression predominates, such as Treg and Mac-PDL1. The specific regions of immunosuppression relative to Teff/NOS2/COX2 spatial configuration provide insight into the role of NOS2 and COX2 in general immunosuppression.
Since the spatial defined immunosuppressive niches share common mechanisms, they indicate that complimentary use of immune activating therapy may have synergistic effects targeting different regions. In the Type I configuration, the increased restricted lymphoid cells reside primarily in the lymphoid aggregates. The immune polarization of this region can impact survival. The survival comparisons of Teff with other markers, specifically in these regions, showed two phenotypes predicting poor outcomes: CD4 Treg and Mac-PDL1. The 4T1 model also shows this trend, with NOS2 or COX2 inhibition increasing the ratios of Teff to CD4-Treg and Teff to Mac-PDL1 associated with improved survival, demonstrating that NOS2 and COX2 determine the nature of the lymphoid aggregates of TIL.
In various types of cancer, high Treg cells and a low ratio of CD8+ T cells to Treg cells in the TME are associated with unfavorable prognosis (70–72). The Treg phenotype is induced by TGFβ, IFNγ, and IL4 (73–75), driving IDO1 and kynurenine production further increasing Treg cells. Treg produce numerous immunosuppressive cytokines, including IL10 and TGFβ. Both PGE2 and NO can increase Treg factors such as IL10. Treg cells suppress Teff through direct PGE2 stimulation of IL10. With NOS2 and COX2 driving cytokine release and activation of IL10 and TGFβ, these systems complement each other regionally to maintain immune suppression.
While tumor-PDL1 expression can be located at the tumor-stromal interface, the Mac-PDL1 is an immunosuppressive tumor-associated macrophage (TAM) that resides primarily in the lymphoid aggregates. Mac-PDL1 expression occurs through exposure to IFNγ, TNF, and IL6 as part of a negative feedback loop (76, 77). TNF-ɑ and IL-6 activate the NF-kB and STAT3 signaling pathway to regulate PD-L1 expression on M2 TAM (76–79). Increased PDL1 expression on macrophages is involved in developing the TAM phenotype (77, 80). Mac-PDL1 has been shown to inhibit Teff in collaboration with IDO1 or granulin (81–85). The IDO1 density heat maps show a strong association with high CD3CD8 regions, suggesting that an increase in this M2 macrophage phenotype relative to Teff indicates poor CD8 health. Thus, the increase in different cytokines and proximity to IDO1 suggest that poor outcomes is due in part to the induction of the M2 immunosuppressive phenotype that polarizes the lymphoid aggregate.
Type I restricted-inflamed tumors show increased tumor-NOS2 and -COX2. The relative positioning of NOS2 and COX2 to Teff suggests an immunosuppressive progression from inflamed foci to an immune desert devoid of lymphocytes. The NOS2+ regions with complimentary COX2+ can increase prooncogenic pathways and lead to metastasis. NOS2 and NO have been shown to increase metastasis. The higher levels of NOS2 lead to an increase in oncogenic pathways and immune modulatory proteins such as IL1, IL6, IL8, and TNFα (86). Regions of elevated NOS2 and COX2 would be expected to increase cancer cell stemness, thus leading to therapy resistance while also causing increased activation of TGFβ and IL-10. The diffusion of these immunosuppressive factors would counter Th1 inflammation, favoring more immunosuppression. Thus, the Type I configuration is highly inflamed with distinct areas that fuel immunosuppression through complementary mechanisms. Therefore, the interaction of lymphoid aggregates and the tumor edge leads to immune suppression and increases chemoresistance and metastasis, the hallmark of poor outcomes.
Type 2 and Type 3 immune deserts represent regions with decreased TIL having a CD8-NOS2-COX2+ phenotype. These are immunologically cold tumor regions, with Type 2 having lymphoid aggregates proximal (< 0.5 mm) while Type 3 does not. Type 2 shows a gap between many of the tumor nests and leukocytes that is 50 -100 µm. High COX2 rather than NOS2 suggests the importance of PGE2 from the tumor in maintaining the exclusion of CD8 cells. The lack of TIL aggregates in type 3 is associated with lower COX2 levels together with B7H4 expression. Thus, these regions of the immune desert may be predisposed to therapy resistance. The 4T1 model produces these Type 2/3 immune deserts and has features that resemble human tumors. The addition of radiation simply augments the marginal immunosuppressed populations, despite the cell injury. However, NOS2 and COX2 inhibition activates Teff, increasing granzyme B. The enrichment of Type 2/3 immune phenotypes through damage due to treatment or tumor stress such as hypoxias and ischemia/reperfusion can recruit lymphocytes that produce IFNγ and cytokines. However, they also induce a robust NOS2/COX2 immunosuppression response, thus leading to poor clinical outcome. Several studies show that more advanced tumors have poorer responses and reduced TIL penetration into the tumor core (87–90). This observation would reflect a fortified tumor barrier where preferential activation of NOS2/COX2 dramatically limits antitumor immune response.
In more advanced tumors such as chemoresistant breast cancer, the combination of tumor cell chemoresistance and immunosuppression results in poor outcomes. A recent study of chemoresistant TNBC patients treated with a pan–NOS inhibitor low dose aspirin showed remarkable positive outcomes with >88% response in locally advanced tumors (91). The administration of the NOS inhibitor resulted in changes in the TME where there was some increase in CD8 together with M1 macrophages, neutrophils (N1), and B cells (91). Remarkably similar changes were observed in the 4T1 model, where NOS2-/INDO led to increased CD8 cells, N1, and B cells, resulting in cures (24). In the murine TNBC 4T1 model, NSAID alone only targeted the T cells, providing a delay but not a cure. This remarkable similarity between the clinical trial and animal model suggests the importance of targeting NOS2 and COX2 to relieve immune suppression. Crosstalk between NOS and COX2 leads to chemoresistance and cancer stem cells while mediating immunosuppression.
Conclusion
NOS2 and COX2 tumor expression shape the immune landscape and mediate the transition from inflamed regions to immune deserts. While NOS2 and COX2 have numerous direct suppressive mechanisms, they also enhance other immunosuppressive mechanisms. It is important to appreciate the distinct regional mechanisms of immune suppression resulting from the differential expression of NOS2 and COX2. The formation of an immune desert and the subsequent resistance to treatment linked to NOS2/COX2 induction in the tumor indicate that novel treatments targeting these proteins may have value for more advanced therapy-resistant tumors. NOS2 and COX2 augment multiple immunosuppressive pathways and increase the severity of immunosuppression (Fig.7). Taken together, these data show that in ER- breast cancer, NOS2 and COX2 have a prominent role in immunosuppression making it treatment resistant. Thus, NOS2 and COX2 targeting may increase the efficacy of a wide range of treatments.
Determining the immunosuppressive phenotypes of distinct regions of the tumor landscape provides insight into the multiple local mechanisms affecting tumor survival. The introduction of checkpoint inhibitors has provided a new approach to the treatment of various malignancies. In breast cancer, however, checkpoint inhibitors have been significantly less effective (55, 92, 93). Immunosuppressive factors that reduce the efficacy of many cancer treatment strategies present a major obstacle to successful therapy. According to the data presented herein, restriction and even elimination of CD8 effector cells by NOS2 and COX2 suggests that NO and PGE2 play an essential role in immunosuppression and agents that control their activity offer an important clinical tool in controlling the immune response.
Materials and Methods
Tissue Collection and Immunohistochemical Analysis of Patient Tumor Sections
Tumor specimens (n = 21) were obtained from breast cancer patients recruited at the University of Maryland (UMD) Medical Center, the Baltimore Veterans Affairs Medical Center, Union Memorial Hospital, Mercy Medical Center, and the Sinai Hospital in Baltimore between 1993 and 2003. Informed consent was obtained from all patients. The collection of tumor specimens, survey data, and clinical and pathological information (UMD protocol no. 0298229) was reviewed and approved by the UMD Institutional Review Board (IRB) for the participating institutions. The research was also reviewed and approved by the NIH Office of Human Subjects Research (OHSR no. 2248). Breast tumor NOS2 and COX2 expression was analyzed previously by IHC using 1:250 diluted NOS2 antibody and 1:50 diluted COX2 antibody (no. 610328 and 610204, respectively, BD Biosciences, San Diego, CA,) and scored by a pathologist (49, 50). For NOS2 staining, a combination score of intensity and distribution were used to categorize the immunohistochemical NOS2 stains where intensity received a score of 0-3 if the staining was negative, weak, moderate, or strong. The NOS2 distribution received scores of 0-4 for distributions <10%, 10-30%, >30-50%, >50-80% and >80% positive cells (49). For COX2 staining, scores of negative to weak (1–2) or moderate to strong (3–4) were categorized as low or high, respectively (50). Herein, NOS2 and COX2 expressions were also analyzed by fluorescent staining performed on the Leica Biosystems (Wetzlar, Germany) Bond RX Autostainer XL ST5010 using the Bond Polymer Refine Kit (Leica Biosystems DS9800), with omission of the Post Primary Block reagent, DAB and Hematoxylin. After antigen retrieval with EDTA (Bond Epitope Retrieval 2), sections were incubated for 30 min with COX2 (Cell Signaling Technology, Danvers, MA, no. 12282, 1:100), followed by the Polymer reagent and OPAL Fluorophore 520 (AKOYA, Marlborough, MA). The COX2 antibody complex was stripped by heating with Bond Epitope Retrieval 2. Sections were then incubated for 30 min with NOS2 antibody (Abcam no. ab15323, 1:50), followed by the Polymer reagent and OPAL Fluorophore 690. The NOS2 antibody complex was stripped by heating with Bond Epitope Retrieval 2 and then stained with CD8 (Abcam no. 101500, 1:100) or IFNγ (Abcam no. 231036, 1:200), followed by the Polymer reagent and OPAL Fluorophore 570. Sections were stained with DAPI and coverslipped with ProLong Gold AntiFade Reagent (Invitrogen). Images were captured using the Aperio ScanScope FL whole slide scanner (Leica). The original IHC previously reported (49, 50) and fluorescent NOS2/COX2 staining results were generally consistent. (IDO1 AND B7H4),
Formalin-fixed paraffin embedded (FFPE) tissue sectioned at 4 μm and mounted on SuperFrost Plus slides were stained with a FixVUE Immuno-8TM Kit (formerly referred to as UltiMapper® kits (Ultivue Inc., Cambridge, MA), USA; CD8, NOS2, COX2, CKSOX10, and IFNγ cocktail) using the antibody conjugated DNA-barcoded multiplexed immunofluorescence (mIF) method (1). These kits include the required buffers and reagents to run the assays: antibody diluent, pre-amplification mix, amplification enzyme and buffer, fluorescent probes and corresponding buffer, and nuclear counterstain reagent. Hematoxylin and Eosin (H&E) and mIF staining was performed using the Leica Biosystems BOND RX Autostainer. Before performing the mIF staining, FFPE tissue sections were baked vertically at 60-65 °C for 30 min to remove excess paraffin prior to loading on the BOND RX. The BOND RX was used to stain the slides with the recommended FixVUE (UltiMapper) protocol. During assay setup, the reagents from the kit were prepared and loaded onto the Autostainer in Leica Titration containers. Solutions for epitope retrieval (ER2, Leica Biosystems cat# AR9640), BOND Wash (Leica Biosystems cat# AR9590), along with all other BOND RX bulk reagents were purchased from Leica). During this assay, the sample was first incubated with a mixture of all 4 antibody conjugates, next the DNA barcodes of each target were simultaneously amplified to improve the sensitivity of the assay. Fluorescent probes conjugated with complementary DNA barcodes were then added to the sample to bind and label the targets; Next, a gentle signal removal step was used to remove the fluorescent probes of the markers. The stained slides were mounted in ProLong Gold Anti-Fade Mountant (Thermo Fisher Scientific, Waltham, MA, cat# P36965) and coverslipped (Fisherbrand Cover Glass 22 x 40mm, #1.5). Digital immunofluorescence images were scanned at 20X magnification. Images were co-registered and stacked with Ultivue UltiStacker software. The digital images were then analyzed using HALO image analysis platform (94).
Previous studies indicate that NOS2 fluorescence intensity thresholds of total tumor intensity are associated with a worse prognosis. Here, the intensity levels of NOS2 and COX2 at the single-cell level were determined (see methods). The thresholds of strong, medium, and weak were determined as previous described based on average cell intensity and increasing thresholds based on standard deviation, with each value compared to significance between the deceased and alive (12, 24); (see Materials and Methods). NOS2 demonstrated that differences in survival were statistically strengthened demonstrating fourfold significance between the deceased and the alive (Fig. Sup. 1A). In contrast, the maximum difference and statical significance of COX2 did not change over the 3 thresholds. Thus, the thresholds for NOS2s and NOS2all were based on the analysis of NOS2s and NOS2all, while COX2all was used to represent this protein. The all designation is a sum samples of the cells that have intensity > the weak threshold limit. These findings confirm that NOS2 scoring by a pathologist is consistent with fluorescence imaging and that the elevated NOS2 and COX2 was larger associated with tumor (94).
The Cancer Genome Atlas (TCGA) and Gene Expression Omnibus (GEO) Analyses
The breast cancer (BRCA) subset of TCGA (https://www.cancer.gov/about-nci/organization/ccg/research/structural-genomics/tcga) was accessed through the UCSC (University of California, Santa Cruz) Xena Browser (Date of access: 11/2/2022, https://xena.ucsc.edu/). GEO dataset, GSE37751 was download from the GEO portal (https://www.ncbi.nlm.nih.gov/geo/). The gene expression matrix files from both datasets were parsed and merged with their index file after download. Gene expression data, ratios between genes, and survival data were exported to GraphPad Prism (10.1.2) for survival plotting.
Statistical Analysis
Experiments were assayed in triplicate unless otherwise stated. Student t test was test was employed to assess statistical significance using the GraphPad Prism software (version 9). Image analyses are reported as mean + SEM and T-tests with Welch’s or Mann Whitney correction were used when appropriate to determine significance. Linear analyses and Pearson’s correlations were also conducted to determine significant correlations between protein expressions using Prism software (10.1.2). Significance is reported as *p ≤ 0.05, **p ≤ 0.01, ***p ≤ 0.001, ****p≤0.0001.
Abbreviations
- ARG1
- Arginase 1
- B7H4
- a.k.a. VTCN1, V-set domain containing T cell activation inhibitor 1
- BRCA
- Breast Carcinoma
- CD8
- a.k.a. CD8A, cluster of differentiation 8
- CK-SOX10
- Cytokeratin-SRY-box transcription factor 10
- COX2
- a.k.a. PTGS2, Prostaglandin-endoperoxide synthase 2
- ER-
- Estrogen Receptor Negative
- FOXP3
- Forkhead Box P3
- GEO
- Gene Expression Omnibus
- IDC
- Invasive Ductal Carcinoma
- IDO1
- Indoleamine 2,3-dioxygenase 1
- IFN
- Interferon
- IFNG
- Interferon Gamma
- IHC
- Immunohistochemistry
- IL1
- Interleukin 1
- IL10
- Interleukin 10
- IRB
- Institutional Review Board
- NOS2
- Nitric Oxide Synthase 2
- PD1
- Programmed Cell Death 1
- PDL1
- Programmed Cell Death Ligand 1
- TCGA
- The Cancer Genome Atlas
- Teff
- T effector Cell
- Texh
- T exhausted Cell
- TGF
- Tumor Growth Factor
- Treg
- T Regulatory Cell
- TME
- Tumor Microenvironment
- TNF
- Tumor Necrosis Factor
- PGE2
- Prostaglandin E2
- S-UMAP
- Spatial Uniform Manifold Approximation and Projection
Figure legends
Figure Supplemental 1. Determination of significance of Thresholding of NOS2 and COX2 at the single cell level.
The threshold was determined as previously described. A) Tables comparing one tail of Mann Whitney and Welch of the mean difference between deceased and alive. B) Ratio of NOS2 at medium and weak as well COX2 with the tumor marker CK-SOX10. C) Graphic comparison of the NOS2/tumor relationship with 2 tail MW or tail Welch. D) Linear regression analysis of the phenotype tumor-NOS2 and tumor-COX2 all samples (n=21) deceased (n=11) and alive (n=10) tumor NOS2 was used at NOS2m. The ratio of NOS2s with cellular immune and tumor cellular phenotypes where F) CD8 G) CD4 H) CD68 I) tumor. The linear regression comparing survival status J) IFNγ with NOS2s and K) IFNγ with COX2 and L) Teff and NOS2.
Supplemental Figure 2. Analysis of cellular phenotypes.
Analysis of the ratio of cellular phenotypes comparing A) tumor-COX2 and B) NOS2s. (*p <0.5, **p <0.01, *** p<0.001, Mann-Whitney test, one-tail).
Supplemental Figure 3. Whole tumor phenotypes.
Defining the whole tumor phenotypes based on CD8, NOS2 and COX2 % cells. A) is the % cells distribution comparing deceased and Alive for CD8, NOS2, and COX2. B) distribution lots of tumor-NOS2 or tumor-COX2 with CD3CD8 C) table of the different phenotypes comparing deceased and alive.
Acknowledgements
This project was funded in whole or in part with Federal funds from the Intramural Research Program of the NIH, National Cancer Institute, CCR, CIL. This project has been funded in part with Federal funds from the Frederick National Laboratory for Cancer Research, National Institutes of Health, under contract HHSN261200800001E (ALW, WFH, DB, EFE, MP, SKA, SJL). This project was funded in part by São Paulo Research Foundation (FAPESP) grants 2018/08107-2 and 2021/14642-0 (LC, MCR), NIH R01CA238727, NIH U01CA253553, and John S Dunn Research Foundation (STCW), NCI grant no. U54 CA210181, the Breast Cancer Research Foundation (BCRF), the Moran Foundation, Causes for a Cure, philanthropic support from M. Neal and R. Neal, and the Center for Drug Repositioning and Development Program (CREDO) (JCC), Science Foundation Ireland (SFI) grant number 17/CDA/4638, and a SFI and European Regional Development Fund (ERDF) grant number 13/RC/2073 (SAG). We wish to thank the São Paulo Research Foundation (FAPESP) for student support (LC). The content of this publication does not necessarily reflect the views or policies of the Department of Health and Human Services, nor does mention of trade names, commercial products, or organizations imply endorsement by the US Government.
Footnotes
↵# Primary Author(s)
References
- 1.↵
- 2.↵
- 3.↵
- 4.↵
- 5.
- 6.↵
- 7.↵
- 8.↵
- 9.
- 10.
- 11.↵
- 12.↵
- 13.
- 14.
- 15.
- 16.↵
- 17.↵
- 18.↵
- 19.
- 20.
- 21.
- 22.
- 23.↵
- 24.↵
- 25.↵
- 26.↵
- 27.↵
- 28.↵
- 29.
- 30.↵
- 31.↵
- 32.↵
- 33.↵
- 34.↵
- 35.↵
- 36.↵
- 37.
- 38.
- 39.↵
- 40.↵
- 41.
- 42.
- 43.
- 44.
- 45.
- 46.
- 47.
- 48.↵
- 49.↵
- 50.↵
- 51.↵
- 52.
- 53.↵
- 54.↵
- 55.↵
- 56.↵
- 57.↵
- 58.↵
- 59.↵
- 60.↵
- 61.↵
- 62.↵
- 63.
- 64.
- 65.↵
- 66.↵
- 67.
- 68.
- 69.↵
- 70.↵
- 71.
- 72.↵
- 73.↵
- 74.
- 75.↵
- 76.↵
- 77.↵
- 78.
- 79.↵
- 80.↵
- 81.↵
- 82.
- 83.
- 84.
- 85.↵
- 86.↵
- 87.↵
- 88.
- 89.
- 90.↵
- 91.↵
- 92.↵
- 93.↵
- 94.↵