Demo of Motion Segmentation

These video compare the segmentations using the mixture of dynamic textures and several other state-of-the-art methods:

(DytexMixIC) – mixture of dynamic textures, using initial contour.
(DytexMixCS) – mixture of dynamic textures, using component splitting (i.e. no initialization).
(Ising) – Ising descriptors, using initial contour. [Ghoreyshi and Vidal, WDV 2006].
(GPCA) – generalized PCA, [Vidal and Ravichandran, CVPR 2005].
(NormCuts) – normalized cuts with motion profiles, [Shi and Malik, ICCV 1999].
(OpFlow) – optical-flow and mean-shift clustering, [Comaniciu and Meer, PAMI 2002].

The original video is on the left, and the segmented video is on the right. The video is available in both AVI format (DivX, playable with RealPlayer or Windows Media player) and Quicktime format (H.264).

Segmentation of Synthetic Video

The first four synthetic examples are from Doretto, et. al., “Dynamic Texture Segmentation”, in ICCV 2003. These video are segmented using an initial contour provided in the paper.

ocean-appearance

[avi (0.9 MB) | mov (0.7 MB)]
Synthetic video where two patches of the ocean has been rotated 90 degrees.
ocean-dynamics

[avi (0.6 MB) | mov (0.5 MB)]
Synthetic video where the dynamics of two patches of the ocean have been altered.
ocean-fire

[avi (1.7 MB) | mov (1.2 MB)]
Synthetic video of two textures: ocean and fire. The segmentation follows the changing outline of the flame.
ocean-steam
[avi (3.1 MB) | mov (2.5 MB)]
Synthetic video of two textures: ocean and steam.

Segmentation of Synthetic Texture Database

The synthetic texture database contains 299 videos of synthetic textures with 2, 3, or 4 segments. The database is available here.

synthdb2 – video textures with 2 segments. (view all)
texture_027
[avi (1.3 MB) | mov (1 MB)]
texture_014
[avi (1.2 MB) | mov (0.9 MB)]
texture_098
[avi (1.1 MB) | mov (0.9 MB)]
texture_039
[avi (1.3 MB) | mov (1.4 MB)]
synthdb3 -video textures with 3 segments. (view all)
texture_003
[avi (0.8 MB) | mov (0.6 MB)]
texture_008
[avi (1.3 MB) | mov (1 MB)]
texture_031
[avi (0.6 MB) | mov (0.5 MB)]
texture_053
[avi (0.8 MB) | mov (0.6 MB)]
synthdb4 – video textures with 4 segments. (view all)
texture_083
[avi (0.7 MB) | mov (0.5 MB)]
texture_092
[avi (1.4 MB) | mov (1.3 MB)]
texture_034
[avi (1.3 MB) | mov (0.9 MB)]
texture_004
[avi (1.3 MB) | mov (1 MB)]

Segmentation of Real Video

These are examples of segmenting real video using the mixture of dynamic textures.

water fountain
[avi (1.5 MB) | mov (1.1 MB)]

Fountain with three types of water motion.
highway traffic
[avi (0.4 MB) | mov (0.3 MB)]

Motion segmentation of a traffic highway scene.
highway traffic
[avi (0.4 MB) | mov (0.3 MB)]

Motion segmentation of traffic on a bridge.
crowded pedestrian scene
[avi (8 MB) | mov (4.6 MB)]

Crowded pedestrian scene. Lots of people moving!