1219

Creating a Panoramic Video from Standard Video Footage

Peleg Shmuel, HUJI, School of Computer Science and Engineering, Computer Science

Keywords

Video, Frame, Mosaic, Axis

Current development stage

TRL9 Actual system proven in operational environment

Application

A number of overlapping images of a scene are initially recorded by a camera to form a mosaic. Mosaic images constitute a panoramic view around the optical axis. Mosaic images from aerial cameras translate parallel to the scene and the optical axis is perpendicular both to the scene and to the direction of camera motion. Records by a moving camera at incorrect angles or taken at different distances from the camera may result in curled mosaic image. One can get a tapered mosaic if images warped during the record because of unsmooth camera motion.

Our Innovation

A new and improved system and method for generating a rectified mosaic image from a series of regular images recorded by a moving camera; or a plurality of panoramic images. 

1219.jpg 

Figure 1.  A system for generating a rectified mosaic image from a series of images recorded by a moving camera. Figure 2 schematically depicts operations performed in connection with generating a mosaic image from a series of individual images. The system 10 includes a camera 11 that is mounted on a rig 12. The camera 11 may be any type of camera for recording images on any type of recording medium, including, for example, film, an electronic medium such as charge-coupled devices (CCD), or any other medium capable of recording images. The rig 12 facilitates pointing of the camera 11 at a scene 13 to facilitate recording of images thereof. The rig 12 includes a motion control 14 configured to move the camera 11. In moving the camera 11, the motion control can translate the camera 11 , rotate it around its axis, or any combination thereof. In one embodiment, it will be assumed that the motion control 14 can translate the camera 11 along a path 16 and rotate the camera during translation. While the camera 11 is being moved, it can record images 20(1),..., 20(1) (generally identified by reference numeral 20(i)) of the scene 13 from a series of successive locations along the path 16.

Technology

The mosaicing system comprises of  three interrelated modules

  • a quadrangular region defining module - defines one individual image a quadrangular region in relation to two points on a vertical anchor in the one individual image and mappings of two points on a vertical anchor in at least one other individual image into the one individual image
  • a warping module is configured to warp the quadrangular region to a rectangular region
  • a mosaicking module transforms the quadrangular region to the mosaic image

For generating mosaic from panoramic images, the system will also comprise of following designated modules:

  • A motion determining module is configured to determine image motion between two panoramic images
  • A normalizing module will normalize respective columns in the panoramic images in relation to the ratio of the image motion thereof to the image motion of a selected column
  • A strip selection module will select strips of the normalized panoramic images
  • The mosaicing module will lastly form a mosaic out of the selected strips 

Patent Status

Granted Europe 1234278; Germany (Europe) 60043452.4-08; Japan (Asia) 4372382

Contact for more information:

Aviv Shoher
SVP BUSINESS DEVELOPMENT
+972-2-6586635
Contact ME:
Image CAPTCHA