Everybody Must Get STOne: Video Compressive Sensing

Richard Baraniuk
Rice University
Electrical and Computer Engineering

Compressive sensing enables the reconstruction of high-resolution signals from under-sampled data. While compressive methods simplify data acquisition, they require the solution of difficult recovery problems to make use of the resulting measurements. We present a new sensing framework that combines the advantages of both conventional and compressive sensing. Using the STOne transform, video frames can be reconstructed instantly at Nyquist rates at any power-of-two resolution. The same data can then be "enhanced" to higher resolutions using compressive methods that leverage sparsity to "beat" the Nyquist limit. The availability of a fast direct reconstruction enables compressive measurements to be processed on small embedded devices. We demonstrate by constructing a real-time compressive video camera.

Joint work with Tom Goldstein of University of Maryland and Kevin Kelly of Rice University

Back to Computational Photography and Intelligent Cameras