Method and system for combining video with spatio-temporal alignment

Given two video sequences (IS1, IS2), a composite video sequence can be generated which includes visual elements from each of the given sequences, suitably synchronized and represented in a chosen focal plane (figure 1). For example, given two video sequences with each showing a different contestant individually racing the same down-hill course, the composite representation can include elements from each of the given sequences to show the contestants as if racing simultaneously. Generating a composite representation can be facilitated by referring to a common background against which foreground objects are imaged. The composite representation can be formed by suitably blending together of foreground and background, and with re-scaling and/or re-framing for optimized presentation.