Switch to Russian

StereomorpherPlus

Purpose of the program

Requirements to computer and system

Interface and buttons

Keys

Pop-up menu

Basic functions for polygons:

      Automatic polygons creation
      Manual polygons creation

                  Editing mode

                  Pen tool

                  Lasso tool

                  Magic wand tool

                  Double magic wand tool

      Polygon selection
      Polygon shifting
      Polygon removing
      Removing all polygons
      Adding vertices to a polygon
      Removing vertices from a polygon
      Vertex shifting
      Attribute of polygon: foreground and background
      Saving polygons
      Loading polygons

Stereo matching:

      Stereo matching
      Segment deformation
      Segment overlapping

Parallax measure tool

New views generation:

      Basic settings
      Error correction

2D to 3D conversion

Work order

Troubleshooting

_____________________________________________________________________________________________________________________________________

Purpose of the program

The program is intended for generating new views basing on a stereo pair, that is, in-between and outer views. Sequence of views is used for creating lenticular images.

StereomorpherPlus uses the basic principle of usual morphing applications: drawing of identical shapes in left and right images, and transformation of the left shape into the right shape. But there are some essential particularities:

Formats of input files are BMP, PNG, TIFF, JPEG in Greyscale, RGB colour mode, TIFF in CMYK and RGBA colour mode. Formats of output files are TIFF in colour mode of source images. Don't support multilayered TIFF.

Top

Requirements to computer and system

Windows 98/NT4/2000/XP/Vista.

Display resolution not less than 800x600 pixels.

1024 MB RAM or more

Top

Interface and buttons

In the beginning, open left and right images using top buttons Open... Don't mix up left and right images.

- this is button to swap the left and right images.

Buttons and are used for increasing and decreasing the images. Besides, one can increase and decrease left and right images using the mouse wheel.

Left tools are used for manual polygons creation. See details here. See details about Parallax measure tool here.

Check on button fix vertices numbers in polygons, you can't add/remove the vertices in a polygon.

This button opens the dialogue Automatic polygon creation. See details here. This dialogue is used as parameters setting for Lasso tool.

Down buttons Reopen... is used for loading polygons and delete the previous polygons. Buttons Open & join loads the polygons without removing the previous polygons. In the left the polygon filename apears. Button removes the selected polygon. Button Clear removes all polygons. Save as... saves the polygons in a new file, Save saves the polygons in the current file.

and flip the polygons to other side using copying and shifting or stereo matching. See details here.

This button opens the views generation dialogue. See details here.

This button opens the views generation dialogue. See details here.

Choose in top menu File-Save project... to save project settings, choose File-Load project... to load a project.

Help in the top menu is for Read Help... and About...

Top

Keys

Q - for removing the vertices drawn with the Pen or Lasso tools for the left polygon.

W - for removing the vertices drawn with the Pen or Lasso tools for the right polygon.

A - for consequent selection of left and right identical polygons (with equivalent numbers). Herewith, polygon number is increased, and unselected polygons are hidden.
SHIFT-A - for consequent selection of left and right identical polygons (with equivalent numbers). Herewith, polygon number is decreased, and unselected polygons are hidden.

S - for consequent selection of left and right identical polygons (with equivalent numbers). Herewith, polygon number is increased, and all polygons are visible.
SHIFT-S - for consequent selection of left and right identical polygons (with equivalent numbers). Herewith, polygon number is decreased, and all polygons are visible.

F - for consequent selection of wrong stereomatched polygons. During stereo matching the program defines the questionable polygons pairs, but it works not very correctly. Herewith, polygon number is increased.
SHIFT-F - for consequent selection of wrong stereomatched polygons. Herewith, polygon number is decreased.

Delete - removes selected left and right polygons. Be careful.

Arrows - for shifting the right selected polygon.

SHIFT-Arrows - for shifting the left selected polygon.

Z - shows selected left and right polygon in the full screen.

Top

Pop-up menu

Move the mouse to the viewing area and click its right button, a context menu will appears:

Command names correspond to their functions.

Top

Basic functions for polygons:

Automatic polygons creation

The application has a function of automatic polygon creation for the left image. Click to open this dialogue:

First step is Segmentation - uniform painted fragment image. By decreasing Colour tolerance, you get greater number of segments, increase Colour tolerance to decrease the number of segments.

After the segmentation click Make polygons. Vertices tolerance defines the distance between the vertices. It's better to set 1 or 2, 3 is for a large image, 0 is for very small image.

Value Minimal segment defines the minimum size of segment, smaller segments will be removed. Minimal segment is the linear pixel size of a minimal segment.

After this click Cancel to close the dialogue. Button Set parameters saves the current parameters without any action.

Manual polygons creation

Use this tools for manual polygon creation:

- polygons editing mode;

- Pen tool;

- Lasso tool;

- Magic wand;

- Double magic wand.

Click a buttons to choose the necessary mode.

Editing mode

In polygon editing mode you can create new polygon using the context menu and command Add polygon, three vertices polygon appears, and you can add new vertex by mouse double-click. Drag and drop a vertex using mouse. Button must be checked off. This is not very suitable method to create new polygons. Better to use other tools.

Pen tool

- Pen tool works usually, click the mouse to add new vertex. Press Q-key for left polyline and W-key for right polyline to remove last vertex. Then use the context menu and command Add polygon to transform this polyline to polygon. If you don't want to add this polyline, remove this polyline using the context menu and command Delete selected polygon or button .

Lasso tool

- Lasso tool works usually. Drag and drop the polyline. You can release the left mouse button and then press again to continue this polyline. You can choose Pen and continue the polyline using Pen tool. Then choose Lasso again. Press Q key for left polyline and W key for right polyline to remove last vertices (press and don't release).

Click Lasso tool, and Red spanner appears, click Red spanner to open Settings dialogue:

Set Vertices tolerance. Set 0 for very small images. Set 2 for 1 mpx images. Set 3 for high resolution images. Button Set parameters saves the settings.

Then use the context menu and command Add polygon to transform this polyline to polygon. If you don't want to add this polyline, remove it using the context menu and command Delete selected polygon or button .

Magic wand tool

- Magic wand tool works usually, click the center of fragment.

Red spanner to open Settings dialogue:

Colour tolerance defines the size of fragment. Vertices tolerance defines the distance between the vertices. It's better to set 1 or 2, 3 is for a large image, 0 is for very small image. Value Minimal segment defines the minimum size of segment, smaller segments will be removed. Minimal segment is the linear pixel size of a minimal segment. Button Set parameters saves the settings.

Double magic wand tool

- Double magic wand tool works as Magic wand, but creates two poligons in the left image and in the right image. Better to click near the border of fragment, not the center of fragment.

Red spanner to open Settings dialogue:

Colour tolerance, Vertices tolerance, Minimal segment are values for Magic wand. Analyzed fragment, Horizontal parallax, Vertical parallax are values for Stereo matching. Look at the details here.

Button Set parameters saves the settings.

Polygon selection

Move the mouse cursor inside polygon, then click the right button, a context menu will be shown:

Click command Select polygon. This command is inactive if the mouse cursor is outside of the polygon or the polygon is selected.

S and A keys are used for the polygons selection too. Press S key to select the polygons with number incresing, SHIFT-S to select the polygons with number decreasing. Press A key to select the polygons with number increasing, SHIFT-A to select the polygons with number decreasing. If you use A key, unselected polygons are hidden.

S and A keys select left and right identical polygons (with equivalent numbers). Better to use A key to find stereo matching errors and to correct it.

Polygon shifting

Arrows keys are used for shifting right selected polygon. SHIFT-Arrows are used for shifting left selected polygon.

Polygon removing

You can use the button to delete the selected polygon.

Delete key removes selected left and right polygons simultaneously. If you delete non-identical left and right polygons, you destroy the correspondence between polygons. Be careful! In the version 2.6 and more there is the protection for this case.

Removing all polygons

Click the button Clear to remove all polygons. The question Do you want to delete all polygons? appears, click O. K. to proceed.

Adding a vertices to a polygon

Click button to choose the polygon editing mode. Move the mouse cursor to the edge and double-click, new vertex appears. Attention, button must be check off. If check is on, you can't add/delete the vertex, the number of the vertices will be fixed. This option is used for stereo matching errors correction. Polygons number and vertices number in the polygon for left and right images must be equal.

Removing a vertices from a polygon

Click button to choose the polygon editing mode. Move the mouse cursor to the vertex and double-click, this vertex disappears. Attention, button must be unchecked. If is checked, you can't add/delete the vertex, the number of the vertices will be fixed. This option is used for stereo matching errors correction. Polygons number and vertices number in the polygon for left and right images must be equal.

Vertex shifting

Click button to choose the polygon editing mode. Drag and drop the vertex using the left mouse button. Press SHIFT key and the vertex will be moved horizontally only. Press CTRL key and the vertex will be moved vertically. Most of stereo pairs have a zero vertical parallax, so move the vertex with SHIFT key for stereo matching errors correction to avoid the vertical parallax.

Attribute of polygon: foreground and background

Selected polygon may be marked as background polygon. Click right mouse button and choose the Set as background from context menu:

Besides, you can mark the selected polygon as separate foeground (Set as separate foreground command). It's used for the protrudent details, for example, whiskers, eyelashes, stamens of flower...

foreground polygon                                             background polygon

Saving polygons

Button Save as... is used to save the polygons at the new filename, Save saves the polygons in the current file. Polygon file has PGN extension. Click Save every times as you make some changes in the polygons.

Loading polygons

Click the lower button Open... and choose the necessary PGN-file to open polygons, previous polygons will be removed. Buttons Open & join loads the polygons without removing the previous polygons. Button Open & join ... combines several polygons sets with different filenames. For example, you want to combine three polygon sets: 1.pgn, 2.pgn, 3.pgn, open this files, all three polygon sets appear in the same window. Then you can save new file, for example, new.pgn.

Top

Stereo matching:

Stereo matching

Stereo matching is the algorithm of finding the identical polygons of left and right images. Click button to find identical right polygons for left polygon. This dialogue appears:

If you set the parallax to zero, the polygon will be copied without change.

Analyzed fragment Horizontal parallax Vertical parallax

Options Source image analyse and Gradient image analyse determine what images will be analysed, the source ones or their gradient images.

Most often you need to use the option Source image analyse.

If the left and right images differ by colour or lighting, it will be better to analyse only gradient images. In this case choose Gradient image analyse. If the image's content is determined by outlines, use Gradient image analyse too.

source stereo pair gradient images

Option For all polygons is used, if you want to make the stereo matching For all polygons, For the selected polygon option makes the stereo matching For the selected polygon only.

Segment deformation

If the right segment is a deformation of the left segment, it's better to use the stereo matching with some parallaxes and analyzed fragment values. You can choose these values by predictor-corrector method.

Segment overlapping

If the right segment is a result of left segment shifting, set the parallaxes is equal to zero, the segment will be copied without deformation, then you shift it using Arrows keys. If some segment is overlapped by fore segment the polygons must be crossed.

Top

Parallax measure tool

- we use this tool to measure the parallaxes and analyzed fragment. In the left window we can see anaglyph image. Anaglyph image is suitable to see and measure parallaxes. Red-cyan anaglyph line show the parallaxes between left and right images. Click left mouse button at equivalent left and right points. Look at this left values H and V. H shows the horizontal shift (or parallax). V shows the vertical shift. We can measure the horizontal and vertical parallaxes, and the size of some fragment (analyzed fragment). This values are in pixels.

We need to know this values for Stereo Matching:

Top

New views generation:

Basic settings

Click the button to open this dialogue:

Enter the number of views in the field Number of source and in-between views. This value is number of in-between views and source images. If Number of source and in-between views = 2, the number of in-between views will be zero.

Enter the number of outer views in the field Number of outer views. This is number of outer left and right images. So total number of views will be:

Total number of views = Number of source and in-between views + 2*Number of outer views You can do a morph using the morph transition, or by using two warp effects. This works because a morph is actually done by warping both the images in opposite directions and fading one into the other. If you want to customize your morph with other effects, you can try doing it by separating it into two warps. Draw the shapes in both images/videos separately, and then copy the shapes of one to the other and associate them properly to create the warps.

Option Warp and Warp and fade define two morph effects. Warp and fade makes the warping of both images in opposite directions and the fading one into the other for in-between views generation. Warp option makes the image warping without the fading. Outer views are warped without fading in any cases.

Option By layers and Smooth define two methods of image generation. Try both methods, and choose best result.

Set Make one frame only to generate one frame.

Parallel processing accelerates the new views generation 2-3 times.

Click button Proceed and generate new views.

Button Set parameters saves the current settings.

Error correction

The polygons correspondence errors leads to the image garbling. Easy to see these errors by generation of two in-between views with the Warp and fade option. Set the Number of source and in-between views is equal four, the number of in-between views will be two. Set the Warp and fade . If in-between views are twinning in the some fragment, it means the polygons are wrong corresponded or need to draw a additional polygons in this place. Image smearing indicates the wrong corresponded polygons. Find and correct these polygons.

Set Make one frame only and generate middle or first or last frame to test the quality.

Top

2D to 3D conversion

Open the same image in the left and right windows.

Paint the polygons, for example, so:

Click this button and set minimal values in Stereo Matching dialogue. So you copy left polygons to right.

Then move and deformate right polygons: backgrond is moved to right, foreground is shifted to left. Remember, background is to right, foreground is to left!

Then click this button to make 2D to 3D conversion:

Parallax is measured in relative number. The relative number is the polygons' shift value. For example, we shifted the polygon 5 pixels. 1 relative number = 5 pixels, 3.5 relative number = 18 pixel for this polygon. Next polygon was moved 10 pixels, 3.5 relative number = 35 pixels for next polygon.

Top

Work order

Open left and right images in StereomorpherPlus using the top buttons Open.... Don't mix up left and right ones. Use and to increase/decrease the images.

Now we begin to draw the polygons for one image (better for left image). Try to make the polygons automatically, click button to open the dialogue Automatic polygon creation. If the result is not satisfactory, click Clear to remove all. You can correct the polygons using the A-key (the polygon number increases) and SHIFT-A (the polygon number decreases). You can draw the polygons manually using the Lasso and Pen tools.

Don't forget to click Save to save your current work.

After polygons creation check on to fix the number of vertices in polygons.

Now we create the corresponding polygons in the right image. Click this button to open the dialogue Stereo matching. Set the maximal vertical and horizontal parallaxes and analyzing fragment size. Choose the For all polygons option. Then choose For the selected polygon to make the corresponding for certain polygon.

Now press S and SHIFT-S keys to find and correct the corresponding errors. Click button to choose the polygon editing mode, you can move the vertices. Most of stereo pairs have a zero vertical parallax, so move the vertex with SHIFT-key to avoid the vertical parallax.

Attention!!! Be careful, if you delete the some polygon. Delete only identical left and right polygons. Use Delete-key with S and A-keys.

If you want to copy some polygon again, click , set For the selected polygon, set zero parallaxes and click Proceed, this polygon will be copyed instead of old polygon, then you can shift it by Arrows-keys.

Don't forget to click Save.

Polygons will be used for new views generation. Click File -> Save project.... Later you may load this project file, set the new number of outer and in-between views generation and create new views set.

Click or to create new views.

Top

Troubleshooting

Software don't support Indexed colours image, don't load multilayered and compressed TIF.

In the find some bugs please contact the developer.

Top

All copyrights to StereomorpherPlus are exclusively owned by the author Evgenia Wassenmiller, © 2004-2008.