Abstract
Forest models often reflect the dominant management paradigm of their time. Until the late 1970s, this meant sustaining yields. Following landmark work in forest ecology, physiology, and biogeochemistry, the current generation of models is further intended to inform ecological and climatic forest management in alignment with national biodiversity and climate mitigation targets. This has greatly increased the complexity of models used to inform management, making them difficult to diagnose and understand. State-of-the-art forest models are often complex, analytically intractable, and computationally-expensive, due to the explicit representation of detailed biogeochemical and ecological processes. Different models often produce distinct results while predictions from the same model vary with parameter values. In this project, we developed a rigorous quantitative approach for conducting model intercomparisons and assessing model performance. We have applied our original methodology to compare two forest biogeochemistry models, the Perfect Plasticity Approximation with Simple Biogeochemistry (PPA-SiBGC) and Landscape Disturbance and Succession with Net Ecosystem Carbon and Nitrogen (LANDIS-II NECN). We simulated past-decade conditions at flux tower sites located within Harvard Forest, MA, USA (HF-EMS) and Jones Ecological Research Center, GA, USA (JERC-RD). We mined field data available for both sites to perform model parameterization, validation, and intercomparison. We assessed model performance using the following time-series metrics: net ecosystem exchange, aboveground net primary production, aboveground biomass, C, and N, belowground biomass, C, and N, soil respiration, and, species total biomass and relative abundance. We also assessed static observations of soil organic C and N, and concluded with an assessment of general model usability, performance, and transferability. Despite substantial differences in design, both models achieved good accuracy across the range of pool metrics. While LANDIS-II NECN showed better fidelity to interannual NEE fluxes, PPA-SiBGC indicated better overall performance for both sites across the 11 temporal and 2 static metrics tested (HF-EMS = 0.73, +0.07,
= 4.84, −10.02; JERC-RD
= 0.76, +0.04,
= 2.69, −1.86). To facilitate further testing of forest models at the two sites, we provide pre-processed datasets and original software written in the R language of statistical computing. In addition to model intercomparisons, our approach may be employed to test modifications to forest models and their sensitivity to different parameterizations.
Abbreviations
- ANPP
- Aboveground net primary production
- API
- Application programming interface
- BGC
- Biogeochemistry
- COST
- Cooperation in Science and Technology
- CPU
- Central processing unit
- CSV
- Comma-separated values
- DoD
- Department of Defense
- EC
- Eddy covariance
- ED
- Ecosystem Demography model
- EMS
- Environmental Measurement Station
- FVS
- Forest Vegetation Simulator
- GPGPU
- General-purpose graphics processing unit
- HF
- Harvard Forest
- IBIS2
- Integrated Biosphere Simulator 2
- JERC
- Jones Ecological Research Center
- L-systems
- Lindenmayer systems
- LANDIS-II
- Landscape Disturbance and Succession model 2
- LM3
- Land Model 3
- LPJ-GUESS
- Lund-Potsdam-Jena General Ecosystem Simulator
- MAE
- Mean absolute error
- MC1
- MAPSS-Century-1 model
- NECN
- Net Ecosystem Carbon and Nitrogen model
- NEE
- Net ecosystem exchange
- NSE
- Nash-Sutcliffe efficiency
- PPA
- Perfect Plasticity Approximation model
- ProFoUnd
- Towards robust projections of European forests under climate change
- RAM
- Random access memory
- RD
- Red Dirt
- RMSE
- Root mean squared error
- SAS
- Size- and age-structured equations
- SOC
- Soil organic carbon
- SON
- Soil organic nitrogen
- TDE
- Throughfall Displacement Experiment