Research_photo_scene_motion

Image motion provides powerful cues about scene structure. Our work addresses:

  • Robust estimation of optical flow.
  • Motion estimation over long sequences.
  • Layered models of motion.
  • Segmentation of scenes in motion.
  • Detection of occlusion and disocclusion.
  • Inference of structure and material.
  • Datasets for quantitative evaluation of optical flow.
  • Learning models of image motion.
  • Biological models of motion perception.
We make our work available to others for research purposes.
1. The most recent and most accurate optical flow code in Matlab

Download

This method implements many of the currently best known techniques for accurate optical flow and is ranked #1 on the Middlebury evaluation as of June 2010.

The software is made available for research pupropses. Please read the copyright statement and contact me for commerical licensing.

2. Matlab implmentation of the Black and Anandan dense optical flow method

The Matlab flow code is easier to use and more accurate than the original C code. The objective function being optimized is the same but the Matlab version uses more modern optimization methods:

Matlab implementation of Black and Anandan robust dense optical flow algorithm

The method in 1 above is more accurate and also implements Black and Anandan plus much more.

3. Original Black and Anandan method implemented in C

The optical flow software here has been used by a number of graphics companies to make special effects for movies. This software is provided for research purposes only; any sale or use for commercial purposes is strictly prohibited.

 

Please contact me if you wish to use this code for commercial purpose.

If you are a commercial enterprise and would like assistance in using optical flow in your application, please contact me at my consulting address black@opticalflow.com.

This is EXPERIMENTAL software. It is provided to illustrate some ideas in the robust estimation of optical flow. Use at your own risk. No warranty is implied by this distribution.

Copyright notice.

There are two versions available. First, the original C code implementing the robust flow methods described in Black and Anandan '96:

Thumb_menze
Discrete Optimization for Optical Flow
Menze, M., Heipke, C. and Geiger, A.
In German Conference on Pattern Recognition (GCPR), 2015.
Abstract:
Thumb_subimage
Smooth Loops for Unconstrained Video
Sevilla-Lara, L., Wulff, J., Sunkavalli, K. and Shechtman, E.
In Computer Graphics Forum (Proceedings of EGSR), 2015.
Abstract:
Thumb_isa
Joint 3D Estimation of Vehicles and Scene Flow
Menze, M., Heipke, C. and Geiger, A.
In Proc. of the ISPRS Workshop on Image Sequence Analysis (ISA), 2015.
Abstract:
Thumb_jonasteaser
Efficient Sparse-to-Dense Optical Flow Estimation using a Learned Basis and Layers
Wulff, J. and Black, M.J.
In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) 2015, June 2015.
Abstract:
Thumb_img_sceneflow
Object Scene Flow for Autonomous Vehicles
Menze, M. and Geiger, A.
In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) 2015, June 2015.
Abstract:
Thumb_blurreccv
Modeling Blurred Video with Layers
Wulff, J. and Black, M.J.
In Computer Vision – ECCV 2014, Springer International Publishing, volume 8694, Lecture Notes in Computer Science, pages 236-252, September 2014.
Abstract:
Thumb_new_teaser_aligned
Optical Flow Estimation with Channel Constancy
Sevilla-Lara, L., Sun, D., Learned-Miller, E.G. and Black, M.J.
In Computer Vision – ECCV 2014, Springer International Publishing, volume 8689, Lecture Notes in Computer Science, pages 423-438, September 2014.
Abstract:
Thumb_teaser
Intrinsic Video
Kong, N., Gehler, P.V. and Black, M.J.
In Computer Vision – ECCV 2014, Springer International Publishing, volume 8690, Lecture Notes in Computer Science, pages 360-375, September 2014.
Abstract:
Thumb_ijcvflow2
A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles behind Them
Sun, D., Roth, S. and Black, M.J.
International Journal of Computer Vision (IJCV), 106(2):115-137, 2014.
Abstract:
Thumb_deqingcvpr13b
A fully-connected layered model of foreground and background flow
Sun, D., Wulff, J., Sudderth, E., Pfister, H. and Black, M.
In IEEE Conf. on Computer Vision and Pattern Recognition, (CVPR 2013), pages 2451-2458, Portland, OR. June 2013.
Abstract:
Thumb_sinteltr
MPI-Sintel Optical Flow Benchmark: Supplemental Material
Butler, D.J., Wulff, J., Stanley, G.B. and Black, M.J.
Technical Report No. 6, Max Planck Institute for Intelligent Systems, October 2012.
Thumb_sinteleccv2012crop
A naturalistic open source movie for optical flow evaluation
Butler, D.J., Wulff, J., Stanley, G.B. and Black, M.J.
In European Conf. on Computer Vision (ECCV), Springer-Verlag, Part IV, LNCS 7577, pages 611-625, October 2012.
Abstract:
Thumb_sintelworkshop
Lessons and insights from creating a synthetic optical flow benchmark
Wulff, J., Butler, D.J., Stanley, G.B. and Black, M.J.
In ECCV Workshop on Unsolved Problems in Optical Flow and Stereo Estimation, Springer-Verlag, Part II, LNCS 7584, pages 168-177, October 2012.
Thumb_cvprlayers12crop
Layered segmentation and optical flow estimation over time
Sun, D., Sudderth, E. and Black, M.J.
In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), IEEE, pages 1768-1775, 2012.
Abstract:
Thumb_jneuroscicrop
Visual Orientation and Directional Selectivity Through Thalamic Synchrony
Stanley, G., Jin, J., Wang, Y., Desbordes, G., Wang, Q., Black, M. and Alonso, J.
Journal of Neuroscience, 32(26):9073-9088, June 2012.
Abstract:
Thumb_middleburyimagesmall
A Database and Evaluation Methodology for Optical Flow
Baker, S., Scharstein, D., Lewis, J.P., Roth, S., Black, M.J. and Szeliski, R.
International Journal of Computer Vision, 92(1):1-31, March 2011.
Abstract:
Thumb_secretsimagesmall2
Secrets of optical flow estimation and their principles
Sun, D., Roth, S. and Black
In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), IEEE, pages 2432-2439, June 2010.
Thumb_nips2010layersimagesmall
Layered image motion with explicit occlusions, temporal consistency, and depth ordering
Sun, D., Sudderth, E. and Black, M.J.
In Advances in Neural Information Processing Systems 23 (NIPS), MIT Press, pages 2226-2234, 2010.
Abstract:
Thumb_learningflow
Learning Optical Flow
Sun, D., Roth, S., Lewis, J.P. and Black, M.J.
In European Conf. on Computer Vision, ECCV, Springer-Verlag, volume 5304, LNCS, pages 83–97, October 2008.
Abstract:
Thumb_specular
Specular flow and the recovery of surface structure
Roth, S. and Black, M.
In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, CVPR, volume 2, pages 1869-1876, New York, NY. June 2006.
Abstract: