US 7,522,186 B2
Method and apparatus for providing immersive surveillance
Aydin Arpa, Jacksonville, Fla. (US); Keith J. Hanna, Princeton Junction, N.J. (US); Rakesh Kumar, Monmouth Junction, N.J. (US); Supun Samarasekera, Princeton, N.J. (US); Harpreet Singh Sawhney, West Windsor, N.J. (US); Manoj Aggarwal, Lawrenceville, N.J. (US); David Nister, Bellevue, Wash. (US); and Stephen Hsu, Sunnyvale, Calif. (US)
Assigned to L-3 Communications Corporation, New York, N.Y. (US)
Filed on Jul. 24, 2002, as Appl. No. 10/202,546.
Application 10/202546 is a continuation in part of application No. 09/800550, filed on Mar. 07, 2001, granted, now 6,985,620, filed on Jan. 10, 2006.
Claims priority of provisional application 60/339726, filed on Nov. 02, 2001.
Claims priority of provisional application 60/187557, filed on Mar. 07, 2000.
Prior Publication US 2003/0085992 A1, May 08, 2003
Int. Cl. H04N 7/18 (2006.01)
U.S. Cl. 348—153  [348/143; 348/152] 40 Claims
OG exemplary drawing
 
1. A surveillance system for monitoring a scene comprising:
a three-dimensional model of the scene defining surfaces corresponding to surfaces of real objects in the scene;
a plurality of cameras each producing a respective video capturing at least a respective portion of the scene;
an image processor, coupled to said plurality of cameras, constructing a texture map from image data of one or more of the videos and projecting said texture map onto one or more of the surfaces of the model of the scene and rendering a sequence of images representing a view of the scene with the texture map of the image data on said one or more surfaces therein;
a display, coupled to the image processor, displaying the image to a user; and
a view controller, coupled to the image processor, for selecting views of the scene to be displayed; and
wherein the constructing of the texture map includes identifying, for each of said one or more surfaces or portions thereof, a subset of the videos that contain said surface or said portion of said surface; and
wherein said subset of videos does not include any of the videos that has a view of said surface or portion thereof that is occluded by any of the other surfaces of the model.