Volumetric Inverse Rendering via Neural Radiative Transfer

Computer Graphics Forum (EGSR 2026)

Best Paper Award

1Max-Planck-Institut für Informatik, 2University College London

We propose a formulation for volumetric inverse rendering under global illumination without explicit global-illumination rendering. By framing the problem as constrained optimization over neural fields, the approach enables physically consistent reconstruction, novel-view synthesis, and relighting. Here, we demonstrate relighting of the reconstructed volume with anisotropic optical properties using a combination of environment illumination and three colored local light sources.

Abstract

Volumetric inverse rendering seeks to recover the optical properties of participating media from images. Existing approaches either rely on differentiable stochastic light transport simulation, which require substantial algorithmic effort, or use simplified models that fail to capture global illumination. We propose a formulation that reconciles physically complete light transport with general-purpose neural optimization. The optical properties of the medium and the full light field are represented as neural fields and estimated through a joint optimization process. Global illumination is enforced via a residual objective derived from the Radiative Transfer Equation in local differential form, complemented by a volume rendering term along primary viewing rays to mitigate \rev{low-frequency} bias. We demonstrate reconstruction of spatially varying, color-resolved scattering, absorption, and phase function parameters from multi-view images. Beyond reconstruction, the same framework supports learning generative models of participating media with physical optical properties under global illumination.

Method

Overview of our approach. Two neural fields encode the optical properties of the participating medium and the scene's light field (orange). Disentanglement is guided by multiple optimization objectives (grey) that incorporate the available data (green).

Results

Optical Properties Reconstruction

Reconstruction results on two scenes (row blocks), comparing different methods (rows). The first three columns show linearly tonemapped slices through the reconstructed medium properties, namely absorption, scattering, and extinction. The remaining columns demonstrate novel-view synthesis under novel illumination. TensorIR does not recover volumetric medium properties and is therefore shown only for the image-based comparisons.


Optical Properties Generation

Three scenes (columns) sampled from our generative model, showing diverse volumetric structures with physically meaningful optical properties, rendered under training (top row) and novel (bottom row) illumination. All images are rendered from the same view.


BibTeX




    @article{Nsampi2026NeuralRT,
      author = {Ntumba Elie Nsampi and Adarsh Djeacoumar and Hans-Peter Seidel and Tobias Ritschel and Thomas Leimk{\"u}hler},
      title = {Volumetric Inverse Rendering via Neural Radiative Transfer},
      journal = {Computer Graphics Forum},
      volume = {45},
      number = {4},
      pages = {},
      doi = {},
      url = {},
      eprint = {},
      year = {2026}
    }