Image Warping For Compressing And Spatially Organizing A Dense Collection Of Images

Image-based rendering (IBR) systems create photorealistic views of complex 3D environments by resampling large collections of images captured in the environment. The quality of the resampled images increases significantly with image capture density. Thus, a significant challenge in interactive IBR systems is to provide both fast image access along arbitrary viewpoint paths and efficient storage of large image data sets. We describe a spatial image hierarchy combined with an image compression scheme that meets the requirements of interactive IBR walkthroughs. By using image warping and exploiting image coherence over the image capture plane, we achieve compression performance similar to traditional motion-compensated schema, e.g., MPEG, yet allow image access along arbitrary paths. Furthermore, by exploiting graphics hardware for image resampling, we can achieve interactive rates during IBR walkthroughs.

Daniel G Aliaga, Paul Rosen, Voicu S Popescu, and Ingrid Carlbom. Image Warping For Compressing And Spatially Organizing A Dense Collection Of Images. Signal Processing: Image Communication, 2006.

@article{aliaga2006image,
  title = {Image Warping for Compressing and Spatially Organizing a Dense Collection of
    Images},
  author = {Aliaga, Daniel G and Rosen, Paul and Popescu, Voicu S and Carlbom, Ingrid},
  journal = {Signal Processing: Image Communication},
  volume = {21},
  pages = {755--769},
  year = {2006},
  keywords = {Image-based rendering, Spatial hierarchy, Compression, Hierarchical,
Random access},
  note = {Special Issue on interactive representation still and dynamic scenes.},
  abstract = {Image-based rendering (IBR) systems create photorealistic views of complex
    3D environments by resampling large collections of images captured in the environment.
    The quality of the resampled images increases significantly with image capture density.
    Thus, a significant challenge in interactive IBR systems is to provide both fast image
    access along arbitrary viewpoint paths and efficient storage of large image data sets.
    We describe a spatial image hierarchy combined with an image compression scheme that
    meets the requirements of interactive IBR walkthroughs. By using image warping and
    exploiting image coherence over the image capture plane, we achieve compression
    performance similar to traditional motion-compensated schema, e.g., MPEG, yet allow
    image access along arbitrary paths. Furthermore, by exploiting graphics hardware for
    image resampling, we can achieve interactive rates during IBR walkthroughs.}
}