RT Journal Article SR Electronic T1 A forest model intercomparison framework and application at two temperate forests along the East Coast of the United States JF bioRxiv FD Cold Spring Harbor Laboratory SP 464578 DO 10.1101/464578 A1 Adam Erickson A1 Nikolay Strigul YR 2018 UL http://biorxiv.org/content/early/2018/12/24/464578.abstract AB Forest models often reflect the dominant management paradigm of their time. Until the late 1970s, this meant sustaining yields. Following landmark work in forest ecology, physiology, and biogeochemistry, the current generation of models is further intended to inform ecological and climatic forest management in alignment with national biodiversity and climate mitigation targets. This has greatly increased the complexity of models used to inform management, making them difficult to diagnose and understand. State-of-the-art forest models are often complex, analytically intractable, and computationally-expensive, due to the explicit representation of detailed biogeochemical and ecological processes. Different models often produce distinct results while predictions from the same model vary with parameter values. In this project, we developed a rigorous quantitative approach for conducting model intercomparisons and assessing model performance. We have applied our original methodology to compare two forest biogeochemistry models, the Perfect Plasticity Approximation with Simple Biogeochemistry (PPA-SiBGC) and Landscape Disturbance and Succession with Net Ecosystem Carbon and Nitrogen (LANDIS-II NECN). We simulated past-decade conditions at flux tower sites located within Harvard Forest, MA, USA (HF-EMS) and Jones Ecological Research Center, GA, USA (JERC-RD). We mined field data available for both sites to perform model parameterization, validation, and intercomparison. We assessed model performance using the following time-series metrics: net ecosystem exchange, aboveground net primary production, aboveground biomass, C, and N, belowground biomass, C, and N, soil respiration, and, species total biomass and relative abundance. We also assessed static observations of soil organic C and N, and concluded with an assessment of general model usability, performance, and transferability. Despite substantial differences in design, both models achieved good accuracy across the range of pool metrics. While LANDIS-II NECN showed better fidelity to interannual NEE fluxes, PPA-SiBGC indicated better overall performance for both sites across the 11 temporal and 2 static metrics tested (HF-EMS = 0.73, +0.07, = 4.84, −10.02; JERC-RD = 0.76, +0.04, = 2.69, −1.86). To facilitate further testing of forest models at the two sites, we provide pre-processed datasets and original software written in the R language of statistical computing. In addition to model intercomparisons, our approach may be employed to test modifications to forest models and their sensitivity to different parameterizations.ANPPAboveground net primary productionAPIApplication programming interfaceBGCBiogeochemistryCOSTCooperation in Science and TechnologyCPUCentral processing unitCSVComma-separated valuesDoDDepartment of DefenseECEddy covarianceEDEcosystem Demography modelEMSEnvironmental Measurement StationFVSForest Vegetation SimulatorGPGPUGeneral-purpose graphics processing unitHFHarvard ForestIBIS2Integrated Biosphere Simulator 2JERCJones Ecological Research CenterL-systemsLindenmayer systemsLANDIS-IILandscape Disturbance and Succession model 2LM3Land Model 3LPJ-GUESSLund-Potsdam-Jena General Ecosystem SimulatorMAEMean absolute errorMC1MAPSS-Century-1 modelNECNNet Ecosystem Carbon and Nitrogen modelNEENet ecosystem exchangeNSENash-Sutcliffe efficiencyPPAPerfect Plasticity Approximation modelProFoUndTowards robust projections of European forests under climate changeRAMRandom access memoryRDRed DirtRMSERoot mean squared errorSASSize- and age-structured equationsSOCSoil organic carbonSONSoil organic nitrogenTDEThroughfall Displacement Experiment