Spatio-temporal video segmentation and representation for video indexing: new issues in motion analysis Patrick Bouthemy IRISA / INRIA Rennes

Efficient access to information contained in video databases implies that a structured representation of the content of the video is built beforehand. We will address several important issues to be solved in that context: - temporal segmentation of the video into shots handling different kinds of transitions (cut, fade, dissolve, wipe) - camera motion characterization (static, panning, zooming, tracking) - extraction and tracking of relevant entities within a shot - scene activity characterization for a large range of motion types - creation of "annotated" iconic video summaries and index database - motion-based query by similarity. We have build an original and unified framework which mainly proceeds from the analysis of the apparent motion between successive images and of related information. It relies on statistical techniques, involving robust estimation of 2D parametric motion models, Hinkley's test, log-likelihood ratio tests, MRF modeling, statistical contextual labeling, temporal cooccurrences of local motion-related quantities. References:
Some of them are available by a click here.

  • P. Bouthemy, M. Gelgon and F. Ganansia.
    A unified approach to shot change detection and camera motion characterization.
    To appear in IEEE Trans. on Circuits and Systems for Video Technology (scheduled Dec. 1999)
  • P. Bouthemy and R. Fablet,
    Motion characterization from temporal cooccurrences of local motion-based measures for video indexing.
    Proc. 14th Int. Conf on Pattern Recognition, ICPR'98, p. 905--908,
    Brisbane, August 1998.
  • M. Gelgon and P. Bouthemy,
    Determining a structured spatio-temporal representation of video content for efficient visualisation and indexing.
    {\it Proc. of the 5th European Conf. on Computer Vision, ECCV'98}, LNCS 1406, Springer Verlag, p. 595--609,
    Fribourg, June 1998.
  • M. Gelgon, P. Bouthemy and T. Dubois
    A region tracking method with failure detection for an interactive video indexing environment.
    Proc. 3rd Int. Conf. on Visual Information Systems, Visual'99
    Amsterdam, June 1999.
  • J.-M. Odobez and P. Bouthemy.
    Robust multiresolution estimation of parametric motion models.
    Journal of Visual Communication and Image Representation, 6(4):348--365, Dec. 1995.