DePan video filter - global motion stabilizer

Plugin for Ulead MediaStudio Pro and Ulead VideoStudio

Copyright (c) 2005 Alexander G. Balakhnin aka Fizick

DePan is video filter for restoration of shaky video. It makes horizontal and vertical panning more smooth.

Your processed video will look like filmed with professional equipment (tripod, steady cam).

How to use - Quick start guide:

• Apply DePan to some video clip as any other videofilter in videoeditor;
• Check that “Motion Stabilization” button in DePan filter dialog is pressed, then press “OK” button.
• That’s all!  Play and save your stabilized video clip (with default parameters settings).

Simple Installation and Registration procedures are described below. And download link too.

How filter works:

DePan filter works in 3 main steps (stages)

• First step is motion estimation, when DePan searches the most appropriate inter-frame motion and estimates inter-frame similarity to detect scene change.
• Second step is motion stabilization, when DePan smoothes the motion (by inertial method) with some smoothness factor.
• Third step is filling of some empty borders areas (arisen from picture motion compensation shift).

These borders pixels may be either leaved black, or filled by additional adaptive picture zoom, or filled by mirrored neighbor pixels.

Notes: Some frame borders are not visible on most TV (overscan area).

Filter parameters and switches

   The main radio-button switches operation mode. Press button “Motion stabilization” to stabilize, or press button “Test and graph” to check and show some filter settings (check inter-frame similarities and scene changes, borders, etc).

   The “Scenes Threshold” parameter defines the threshold value of inter-frame similarity (correlation). It defines how similar must be current frame to previous one in the same scene. DePan will detect scene change for current frame, if current value of correlation is below this threshold. Set it lower to prevent false scene change detecting, set it higher to prevent skipping of true scene change.

   The default setting is quite good for most video, but you can check it. Switch filter to “Test and graph” mode and play clip. You will see a graph of inter-frame similarity. Values above threshold is green, values below threshold is red (at scene change). Green means that the scene will be stabilized.

   The “Smoothness factor” parameter controls the degree of stabilization as frames range. It is the most important parameter, its optimal value is depended on your clip content.  Set it larger for more smooth motion, however it may result in larger frames shifts and empty borders.

   Adjust “Solid borders width” parameters for letterbox effect, individually for top, bottom, left and right. Adjust them properly to cover all bad pixels near borders, it is especially important for filling “by Mirror”.

   You can use constant or adaptive zoom to enlarge the shifted frames and to partially fill empty borders areas. "Min (const)" parameter defines constant or minimal adaptive zoom value (in percent). Switch “Adaptive” check-box to use variable zoom. In addition, you can adjust the "Max (%)" parameter to set maximum value of the adaptive zoom (percent). The "Rise Time" parameter defines, how fast the zoom value can be varied. The unit is a frame (or field), the same as for "Smoothness factor". (The zoom fall time is a little above of the rise time value.)

   I recommend you to check some (all) of “by Mirrors” check-boxes to fill empty areas by mirrored pixels near top, bottom, left or right frame borders. It may be used in addition to zoom. Mirror positions are defined by “Solid border width” parameters. If thin moving black line sometimes appears along some border of your stabilized video in "Mirror" mode, you must increase correspondent "Solid border width" parameter to remove it. So, the mirror positions must be set at normal (clean) areas without edge garbage and fading.

   Use "blur" check-box to switch blurring of mirrored pixels near left and right borders. It can partially conceal some sharp mirrored objects.

    Switch "Fix last frame" check box to gradually decrease the stabilization degree at the end of clip. The very last frame will be fixed (not moved). Use this to provide a smooth transition from stabilized to rest (non-stabilized) part of your video.

   There are also motion compensation limit parameters for "Horizontal" and "Vertical" shift.

   The parameters values are varied linearly between key frames, and so do not forget set parameters for every key frame (both start and end). Use "copy and paste" method (by right mouse click on keyframe control).
You can also switch "Same for all key frames" checkbox to use constant parameters values for whole clip.

   For interlaced video, DePan will process not frames but fields. It is defined by project output file settings.

   The small preview window of DePan dialog works badly. Please, use timeline to check your settings.

Applications:

Digital video filmed with hand-held camera, especially:

•  with big zoom;
•  in motion (walk);
•  through the automobile window etc;
•  without camcorder internal video-stabilizer.

Features:

• advanced methods of video motion recognition and correction;
• scene-change detection;
• various empty borders filling methods;
• both progressive and interlaced video processing;
• keying of Scenes threshold and Smoothness parameters;
• easy-to-use user interface;
• basic and more advanced parameters tuning;
• small price.

Compatibility:

•  CPU Intel Pentium II (Celeron) or AMD Athlon (Duron) and above.
•  OS Microsoft Windows 95,98,ME,2000,XP, NT4.0 (not all localized versions were tested).
•  Must work with Ulead MediaStudio Pro 5.0 - 8.0, Ulead VideoStudio 5.0 – 9.0.

Installation:

1. Download installation zip archive.
2. Unpack all files from installation zip archive (by WinZip, etc) to your MediaStudio video filter (vft_plug) directory, for example:
   C:\Program Files\Ulead Systems\MediaStudio Pro 7.0\vft_plug)
3. Run Ulead application (Videoeditor), the new videofilter group “Fizick” will be created with “Depan” filter in it.
4. DePan firstly will work in DEMO mode.
   Demo version restriction: red diagonal line placed on output video (it is the only difference from registered version).
5. Try the filter with your video before buy it!
6. DePan filter must be registered (activated) to remove demo mode restriction for your current computer.

Registration procedure:

You can register your copy of DePan online at the cost 17 USD (may vary) online via share*it!

Share*it is global shareware software distribution service of Element 5 AG company. Link:

1. Run Ulead application on your computer, press “Register” button on DePan videofilter dialog.
2. Check “ComputerID” field, it must contain some digital number. Write it to some place or do not close dialog.
3. Connect to Internet, go to “share*it” secure service Web site http://www.shareit.com  ,
   enter program number 300009614 to “Search Catalog” field, else use direct link,
   or simply click “Order now!” button in DePan register dialog.
4. Please, fill all needed fields with your personal data.
5. Select preferred payment method.
6. Enter your ComputerID number to “Additional ordering Information” field exactly as is without spaces etc.
   Hint:  you may copy data from DePan Register dialog and paste to this field.
7. Pay for the order.
8. Please, wait some time, until you will receive the registration key via e-mail (or online).
9. Press “Register”button on DePan filter dialog again.
10. Enter registration key (without spaces etc) to “Registration key” field, press “OK” button.

Notes. The file “depan.key” will be created in vft_plug directory.

You must have write access to vft_plug directory to register (logon as Administrator in Windows2000 or XP).

DePan filter will work as registered full version (without demo restriction) on one computer with registered ComputerID only.

ComputerID number is specific for your computer system but it is the same for any Ulead application program.

Notes for multi-boot systems: DePan will be registered for only one system.

If your system was crashed, you should reinstall Windows with the same (old) settings (user name, computer name, etc) to restore your ComputerId and Registration key validity.

Current version limitations:

 - fixed position and size of motion estimation window (centered, near full frame);

- sequential (not arbitrary) access to frames, from start to end of clip;

- dialog interface in English only;

- RGB24 only;

- not real-time, rather slow operation;

- fast preview does not always work properly;

- motion stabilization is interrupted (restarted) at the start/end point of any applied transition effect (with some jerk);

- the filter is not present in MSP8 "Production Library" like the others (for settings change). But it is available in the list of video filters: right click over the clip -> Video Filters -> Option menu.

- it can not completely replace the real tripod :)

License

The author of this program accepts no responsibility for damages resulting from the use of this product and makes no warranty or representation, either express or implied, including but not limited to, any implied warranty of merchantability or fitness for a particular purpose. This software is provided "AS IS", and you, its user, assume all risks when using it.

DePan videofilter is shareware software.

You may distribute unregistered demo version (without registration key) freely, but without any modification of package.

You may try DePan in demo mode during unlimited time on any computer.

Registered version of DePan is distributed without money-back.

Once registered, the user is granted a non-exclusive license to use a copy of DePan on one computer, with registered ComputerID number, at a time, for any legal purpose, with any software of Ulead Systems, Inc.

Some of the API included in this software is copyrighted and is proprietary of Ulead Systems, Inc.

You may not modify package of DePan videofilter, reverse engineer, decompile, disassemble or otherwise attempt to discover its source code and API.

Support

1.  Technical support: from author, Alexander G. Balakhnin http://www.fizick.com

2. See also Ulead MediaStudio forums.

3. Order, registration, and payment support is provided by Share*it Web-based Customer Care Center:
http://www.shareit.com/ccc/index.html?publisherid=200003957

Versions history

v.0.1 to 1.15  - April 25 to December 31, 2004 - versions for AVI Synth 2.5

v.2.0 – January 15, 2005 - first version for Ulead MediaStudio Pro.

v.2.0.12 – January 23, 2005 – bug fixed: corrected fields shift for interlaced video.

v.2.1.0 – January 29, 2005 – changes: operation mode now global; borders width now keyed; top and bottom borders halved for fields of interlaced video; borders plotted in graph mode.

v.2.1.2 – February 7, 2005 – fixed some problem with registration.

v.2.1.3 – February 14, 2005 – borders of first frame filled; Help updated; Help in German added.

v.2.1.4 - February 23, 2005 – Windows98 support.

v.2.2.1 - March 3, 2005 – fixed v.2.1.4 bug with key file creation;
    - solid borders are now static for non-mirrored directions;
    - default setting changed to all borders width =2 with all mirrors switched on.

v.2.2.2 - March 3, 2005 - fixed v.2.1.4-2.2.1 memory leakage.

v.2.2.3 - March 14, 2005 - disabled preview in dialog to fix some problem with parameters adjustment

v.2.3.0 – March 26, 2005 – decreased stabilization near end of clip (very last frame position fixed)

v.2.4.0 – May 01, 2005 – added option to blur mirrored pixels   

v.2.5.1 - May 15, 2005 - Added user control of "fix last frame" option. Adaptive zoom option is improved to provide larger zoom value and more smooth variation, with user control of max zoom value.

v.2.6.0 – June 5, 2005 – Increased smoothness factor range. Improved adaptive zoom method. Added option to control zoom rise time. Added user control of compensation limits.

v.2.6.1 – June 15, 2005 – Changed "zoom rise time" unit to frame.

v.2.7.0 – December 8, 2005 – Improved zoom mode. Changed limits from hard to soft. Added "Min (const)" zoom parameter. Zoom values are now absolute. Added "Same for all key frames" option.

Downloads

Download DePan version 2.2.3

Download DePan version 2.4.0

Download DePan version 2.5.1

Download DePan version 2.6.1

Download DePan version 2.7.0

Examples

1. Song. Handheld camera with big zoom was used. PAL Video CD MPEG1 files (about 1300 kb)

Original (shaked)

Stabilized by DePan (deshaked) (used all mirrors, and small borders)

Disclaimer

Ulead does not sponsor, affiliate, or endorse DePan videofilter.

Ulead, MediaStudio and VideoStudio are trademarks or registered trademarks of Ulead Systems, Inc. in the United States and/or other countries.