Efficient algorithms of image restoration and data recovery are derived by exploring sparse approximations of the underlying solutions by redundant systems such as wavelet frames and Gabor frames. Several algorithms and numerical simulation results for image restoration, compressed sensing, and matrix completion will be presented in this talk.