Video Games on Video
Video games on video integrates the logic and interaction mechanisms of a video game with a video of the real environment, to create a playable game. Two games were developed as a proof-of-concept of this research - AugFrog and Shopping Mall Pinball.
This research has been conducted under the advisement of Dr. Robert St. Amant, at North Carolina State University.
Thesis: Toward Video Games on Video (thesis)
Publication: Interfaces 76 - Experiencing design Video games on video
AugFrog
AugFrog, is based on the classic video game Frogger, developed by Konami in 1981. We recorded a video of a nearby highway for the game environment. A virtual frog moves through the traffic, as shown in the video. The frog is able to jump onto nearby passing vehicles, gets occluded by vehicles behind it and gets hit if it collides with any of the vehicles.
Computer Vision algorithms in C++
Shopping Mall Pinball
Shopping Mall Pinball adopts the same basic concept as the Pinball game, but with the difference that it involves the ball bouncing off people walking in a corridor of a shopping mall instead of being deflected by objects on a table. In Human Pinball, the virtual entities i.e. flippers, ramps and the ball, augment the video frames
OpenCV