✦ScienexySCIENCE KNOWLEDGE LIBRARY
concept · SCI-REF-001-038

Equation Validation, Numerical Solutions and Computational Analysis

Equation validation, numerical solutions, and computational analysis provide methods for checking scientific mathematical models, solving equations that cannot be handled conveniently by analytical methods, and investigating system behaviour through computation. They connect mathematical formulation with numerical reliability, experimental evidence, simulation, and scientific prediction.

NameExpressionMeaning

General numerical approximation

y(x) ≈ yₕ(x)

Represents a numerical approximation yₕ to the intended mathematical solution y.

Forward Euler update

yₙ₊₁ = yₙ + Δt f(tₙ, yₙ)

Approximates the next solution value of an initial-value problem using the derivative at the current time and state.

Mean absolute error

MAE = (1/N) Σᵢ₌₁ᴺ |yᵢ - ŷᵢ|

Measures the average absolute difference between observed and predicted values.

Root-mean-square error

RMSE = √[(1/N) Σᵢ₌₁ᴺ (yᵢ - ŷᵢ)²]

Measures the square root of the average squared prediction error.

Residual

eᵢ = yᵢ - ŷᵢ

Represents the difference between an observed value and its corresponding model prediction.

Relative numerical error

εᵣ = |yₙᵤₘ - yᵣₑf|/|yᵣₑf|

Measures the relative difference between a numerical result and a nonzero reference value.

Explanation

Introduction

Many scientific equations describe systems that are too complicated to solve exactly using algebraic or analytical techniques. Nonlinear interactions, multiple variables, complicated geometries, changing boundary conditions, and coupled physical processes often require numerical methods and computational simulations. However, obtaining a numerical result does not automatically mean that the equation has been solved correctly or that the model represents reality. Scientific computational analysis therefore requires several distinct activities: checking the mathematical formulation, verifying the numerical implementation, evaluating numerical errors, and validating the model against independent evidence.

Core Concepts

Analytical Solution

An analytical solution is an exact mathematical expression or a solution represented through established mathematical functions and operations, subject to the assumptions of the model.

Numerical Solution

A numerical solution is an approximate solution calculated using numerical algorithms, usually represented by discrete values, approximate functions, or iterative results.

Computational Analysis

Computational analysis uses algorithms, numerical methods, and computer-based calculations to solve, simulate, analyse, and interpret mathematical models.

Verification

Verification examines whether the mathematical and computational problem has been implemented and solved correctly.

Validation

Validation examines whether the mathematical model adequately represents the real system for its intended scientific purpose.

Distinction

Verification asks whether the equations and calculations are being handled correctly. Validation asks whether the equations themselves provide a sufficiently accurate representation of the physical phenomenon.

Stages Of Scientific Equation Evaluation

StageDescription

Mathematical verification

Check algebraic manipulations, derivations, equation structure, dimensional consistency, and mathematical conditions.

Implementation verification

Check that the computational code correctly represents the intended mathematical equations, algorithms, and boundary conditions.

Numerical verification

Evaluate discretization errors, convergence behaviour, stability, and sensitivity to numerical resolution.

Physical validation

Compare model predictions with independent experimental observations, field measurements, or other suitable evidence.

Predictive evaluation

Determine whether the model remains reliable for the new conditions and predictions for which it is intended to be used.

Analytical And Numerical Solutions

Analytical Methods

MethodDescription

Algebraic manipulation

Uses mathematical operations to rearrange equations and obtain unknown quantities in explicit or implicit form.

Separation of variables

Transforms certain differential equations into forms in which variables can be separated and integrated.

Integration methods

Obtains solutions through integration when the mathematical structure and conditions permit it.

Transform methods

Uses transformations such as Fourier or Laplace transforms to simplify selected differential and integral problems.

Eigenvalue methods

Uses eigenvalues and eigenfunctions to analyse linear operators, dynamic systems, and boundary-value problems.

Numerical Methods

MethodDescriptionExamples

Root-finding methods

Estimate solutions of equations that cannot conveniently be solved analytically.

  • Bisection method

  • Newton-Raphson method

  • Secant method

Numerical linear algebra

Solves systems of linear equations and related matrix problems.

  • Gaussian elimination

  • LU decomposition

  • Iterative linear solvers

Numerical integration

Approximates definite integrals using discrete evaluations of the integrand.

  • Trapezoidal rule

  • Simpson's rule

  • Gaussian quadrature

Ordinary differential equation solvers

Approximate the evolution of systems governed by ordinary differential equations.

  • Euler method

  • Runge-Kutta methods

  • Adaptive time-stepping methods

Partial differential equation solvers

Approximate spatially and temporally varying systems using discretized governing equations.

  • Finite-difference methods

  • Finite-volume methods

  • Finite-element methods

Optimization methods

Determine parameter values or model configurations that minimize or maximize a specified objective function under relevant constraints.

  • Gradient-based optimization

  • Constrained optimization

  • Derivative-free optimization

Monte Carlo methods

Use repeated random sampling to estimate quantities, explore uncertainty, or investigate probabilistic systems.

Numerical Representation

Discretization

Discretization converts a continuous mathematical problem into a finite collection of algebraic or computational operations by dividing time, space, or another continuous domain into discrete points, intervals, or elements.

Grid And Mesh

A grid or mesh defines the computational locations or elements at which approximate variables are represented.

Time Stepping

Time-dependent simulations often advance a model from one time level to another using a numerical integration scheme.

Iteration

Iterative methods repeatedly update an approximation until a specified convergence condition or stopping criterion is reached.

Floating Point Arithmetic

Computers represent most real numbers using finite-precision numerical formats. Rounding and representation errors can therefore affect computational results.

Numerical Approximation

The numerical solution generally differs from the exact mathematical solution because of discretization, truncation, iteration, and finite-precision effects.

Major Numerical Error Types

ErrorDescription

Truncation error

Arises when an infinite mathematical process or continuous operation is approximated using a finite representation.

Round-off error

Arises from finite-precision representation and arithmetic operations performed by a computer.

Discretization error

Arises when a continuous domain or derivative is represented using discrete computational elements or points.

Iteration error

Arises when an iterative numerical method is stopped before reaching its exact or sufficiently converged solution.

Propagation error

Occurs when numerical errors from earlier calculations influence later results, potentially accumulating over time or across computational steps.

Model error

Arises from limitations in the mathematical representation itself rather than from the numerical solution procedure.

Convergence And Stability

Convergence

A numerical method is convergent when its approximate solution approaches the intended mathematical solution as the relevant numerical resolution is refined under the required conditions.

Numerical Stability

Numerical stability concerns whether computational errors remain controlled or grow during the calculation.

Consistency

A numerical method is consistent when its discrete formulation approaches the intended continuous mathematical problem as the discretization is refined.

Time Step

The time-step size influences accuracy and stability in time-dependent numerical simulations. Its acceptable value depends on the equation, numerical scheme, and system characteristics.

Grid Resolution

Spatial resolution influences how accurately a computational mesh represents gradients, boundaries, interfaces, and small-scale structures.

Convergence Testing

A convergence study compares results obtained with progressively refined grids, smaller time steps, or tighter numerical tolerances to determine whether important outputs are approaching stable values.

Caution

A converged numerical solution may still be physically inaccurate if the model equations, parameters, assumptions, or boundary conditions are inappropriate.

Verification Methods

MethodDescription

Analytical benchmark comparison

Compare a numerical solution with an exact or well-established analytical solution for a simpler problem.

Method of manufactured solutions

Construct a known mathematical solution and determine the source terms required to make it satisfy a modified governing equation. The numerical implementation can then be checked against the known solution.

Grid-refinement study

Repeat calculations with increasingly fine spatial resolution and examine whether key numerical results converge.

Time-step refinement

Reduce the time step and examine whether time-dependent results become more accurate or stable.

Conservation checks

Check whether the numerical calculation respects expected balances of mass, energy, momentum, charge, or other relevant quantities.

Code and algorithm testing

Use unit tests, benchmark problems, independent implementations, and systematic checks to identify implementation errors.

Validation Methods

MethodDescription

Experimental comparison

Compare predicted values with measurements from controlled laboratory experiments.

Field-data comparison

Evaluate predictions against observations collected in natural or operational environments.

Independent dataset testing

Use observations not involved in model construction or parameter calibration to evaluate predictive performance.

Statistical performance assessment

Use appropriate error and agreement measures to quantify how closely predictions match observations.

Physical plausibility assessment

Examine whether predicted values, trends, and system behaviour are consistent with known physical restrictions and established scientific evidence.

Cross-model comparison

Compare predictions with other independently developed models, while considering differences in assumptions and intended applications.

Statistical Assessment

Residual Analysis

Residual analysis examines differences between observed and predicted values to identify systematic patterns, possible model inadequacies, and unexplained variation.

Mean Absolute Error

The mean absolute error measures the average magnitude of prediction errors without allowing positive and negative errors to cancel.

Root Mean Square Error

The root-mean-square error gives greater weight to larger errors because the individual differences are squared before averaging.

Coefficient Of Determination

The coefficient of determination describes the proportion of variation in a response explained by a fitted model under its statistical definition. It should not be treated as a complete measure of scientific validity.

Uncertainty Intervals

Prediction intervals and uncertainty intervals communicate the range of values associated with estimates or predictions under specified statistical assumptions.

Selection Of Metrics

Performance measures should be selected according to the scientific objective, data distribution, error consequences, and model structure.

Computational Analysis Workflow

StepNameDescription

1

Define the scientific problem

Identify the physical system, scientific question, expected outputs, and relevant accuracy requirements.

2

Formulate the mathematical model

Specify the governing equations, variables, parameters, assumptions, and constraints.

3

Specify initial and boundary conditions

Define the information required to make the mathematical problem sufficiently specified.

4

Choose a numerical method

Select a suitable algorithm based on the equation type, mathematical properties, accuracy requirements, and computational resources.

5

Discretize the problem

Create a spatial mesh, time grid, or other numerical representation as required.

6

Implement the computational algorithm

Translate the mathematical formulation into reliable computational procedures and document the implementation.

7

Perform verification

Check the numerical implementation using analytical benchmarks, conservation tests, and appropriate numerical refinement.

8

Run the simulation

Calculate the numerical solution using the selected parameters, conditions, and computational settings.

9

Analyse numerical errors

Examine convergence, stability, discretization sensitivity, round-off effects, and iterative stopping conditions.

10

Validate against evidence

Compare results with independent measurements or established experimental observations.

11

Analyse uncertainty and sensitivity

Investigate how uncertain inputs, model parameters, and numerical settings influence the predicted outcomes.

12

Interpret and communicate results

Explain the physical meaning of the computed outputs, the evidence supporting them, and the limitations that remain.

Computational Tools And Reproducibility

Programming Languages

Scientific computation commonly uses languages such as Python, Julia, MATLAB, C, C++, and Fortran, depending on the problem, software environment, and performance requirements.

Scientific Libraries

Numerical libraries provide tested implementations of linear algebra, optimization, integration, differential equation solving, statistical analysis, and visualization.

Visualization

Plots, spatial maps, vector fields, and animations help researchers inspect model behaviour, detect anomalies, and communicate results.

Reproducibility

A reproducible computational study documents the equations, data, parameter values, software environment, numerical methods, and relevant computational settings.

Data Management

Scientific datasets should be stored and processed with clear units, metadata, quality-control procedures, and traceable transformations.

Documentation

Code, model assumptions, validation results, and numerical settings should be documented so that calculations can be independently examined and repeated.

Limitations

  • Numerical methods produce approximations rather than automatically providing exact solutions.

  • Computational results depend on the correctness of the mathematical formulation and implementation.

  • A stable numerical algorithm may still solve an inaccurate physical model.

  • Insufficient spatial or temporal resolution may fail to capture important system behaviour.

  • Finite-precision arithmetic can influence calculations, particularly in ill-conditioned problems.

  • Complex simulations may require substantial computational resources.

  • Experimental validation may be limited by measurement uncertainty or incomplete observations.

  • Statistical agreement does not necessarily demonstrate that the underlying physical mechanisms are correct.

  • Different numerical methods may produce different results when the problem is poorly conditioned or insufficiently resolved.

Common Mistakes

  • Treating numerical convergence as proof of physical validity.

  • Confusing verification with validation.

  • Using a numerical method without checking its stability requirements.

  • Selecting a grid or time step without examining numerical resolution.

  • Ignoring conservation errors in simulations of physical transport.

  • Comparing predictions with data that were already used for calibration and describing the comparison as independent validation.

  • Reporting numerical results without units, uncertainty, or computational settings.

  • Assuming that more decimal places indicate greater scientific accuracy.

  • Failing to document code, parameter values, or data-processing procedures.

Applications

  • Numerical simulation of mechanical and fluid systems.

  • Computational heat and mass transfer.

  • Climate and atmospheric modeling.

  • Chemical reaction and transport simulations.

  • Finite-element analysis of materials and structures.

  • Computational electromagnetism.

  • Biological and ecological system simulation.

  • Optimization and parameter estimation in scientific research.

  • Uncertainty quantification and computational experimental design.

Worked Example

Problem

A numerical method is used to approximate the solution of a differential equation describing the time evolution of a physical quantity.

Governing Equation

dy/dt = f(t, y)

Initial Condition

y(t₀) = y₀

Numerical Method

The forward Euler method approximates the solution at the next time step using the current derivative.

Update Relationship

yₙ₊₁ = yₙ + Δt f(tₙ, yₙ)

Interpretation

  • The numerical method begins from the known initial value.

  • It evaluates the derivative at the current time and state.

  • It uses that derivative to estimate the change over a finite time interval.

  • The calculation is repeated to approximate the solution at later times.

Verification

  • Check that the implementation uses the intended differential equation and initial condition.

  • Compare the result with an analytical solution when one is available.

  • Repeat the calculation using smaller time steps.

  • Examine whether the numerical solution approaches a stable result as the time step is reduced.

  • Check whether the computed values remain physically meaningful.

Validation

Compare the model's predictions with independent experimental measurements of the physical system, accounting for measurement uncertainty and differences between experimental and idealized conditions.

Conclusion

The numerical algorithm approximates a mathematical solution. Verification evaluates the correctness and numerical reliability of the calculation, while validation evaluates whether the governing model adequately represents the actual physical system.

Variables

SymbolMeaningUnit

y

Exact or intended mathematical solution

Depends on the physical quantity

yₕ

Numerical approximation to the solution

Same as y

t

Time

Second (s)

Δt

Numerical time-step size

Second (s)

f(t, y)

Function defining the rate of change in the differential equation

Unit of y divided by unit of time

yᵢ

Observed value for data point i

Depends on the measured quantity

ŷᵢ

Predicted value for data point i

Same as yᵢ

N

Number of observations

Dimensionless count

eᵢ

Residual for observation i

Same as the measured quantity

εᵣ

Relative error

Dimensionless

Example or application

FieldDescription

Computational fluid dynamics

Numerical methods approximate fluid motion by solving discretized governing equations and examining convergence, conservation, and agreement with experimental flow measurements.

Climate science

Computational climate models simulate interactions among the atmosphere, ocean, land, and ice. Their numerical implementation and predictions are evaluated through different verification and validation procedures.

Structural engineering

Finite-element methods approximate the deformation and stress distribution of structures, while mesh refinement and experimental comparison help assess numerical and physical reliability.

Chemistry

Numerical differential equation solvers simulate chemical reaction networks when multiple interacting reaction processes make analytical solutions impractical.

Biology

Computational models simulate population dynamics and biological processes, with model predictions evaluated against independent experimental or field observations.

Geoscience

Numerical simulations investigate groundwater flow, heat transport, sediment movement, and other geological processes across complex spatial domains.

Definition

Equation validation, numerical solutions, and computational analysis are methods for verifying mathematical formulations and computational implementations, approximating solutions to scientific equations, evaluating numerical errors, and assessing whether model predictions agree with independent physical evidence.

Purpose

  • Solve scientific equations that are difficult or impossible to solve analytically.

  • Check whether equations and computational implementations are mathematically and numerically reliable.

  • Evaluate numerical convergence, stability, and error.

  • Compare model predictions with independent experimental and observational evidence.

  • Analyse complex systems through computational simulation.

  • Communicate scientific results with appropriate uncertainty and reproducibility.

Importance

  • Numerical methods make it possible to investigate complex scientific systems that lack convenient analytical solutions.

  • Verification helps detect errors in mathematical formulations and computational implementations.

  • Validation establishes whether a model is useful for representing the real system under specified conditions.

  • Numerical error analysis prevents false confidence in computational outputs.

  • Computational methods support interdisciplinary scientific research and large-scale simulation.

  • Reproducible computational workflows make scientific calculations easier to inspect, test, and independently repeat.

Related Topics

  • SCI-REF-001-025

  • SCI-REF-001-026

  • SCI-REF-001-027

  • SCI-REF-001-028

  • SCI-REF-001-030

  • SCI-REF-001-033

  • SCI-REF-001-037

Sources and verification

Sources are shown as provided in the project data. Not every source has yet been independently verified. Please report errors or missing citations.

  • Richard L. Burden, J. Douglas Faires and Annette M. Burden, Numerical Analysis, Cengage Learning.
  • Steven C. Chapra and Raymond P. Canale, Numerical Methods for Engineers, McGraw-Hill.
  • John D. Anderson, Computational Fluid Dynamics: The Basics with Applications, McGraw-Hill.
  • William L. Oberkampf and Christopher J. Roy, Verification and Validation in Scientific Computing, Cambridge University Press.

Suggest a correction or source · More in Scientific Formulas