US 7,532,224 B2
Information processing method and apparatus
Yuichi Bannai, Koganei (Japan)
Assigned to Canon Kabushiki Kaisha, Tokyo (Japan)
Filed on Apr. 07, 2006, as Appl. No. 11/400,480.
Claims priority of application No. 2005-112108 (JP), filed on Apr. 08, 2005.
Prior Publication US 2006/0227151 A1, Oct. 12, 2006
Int. Cl. G09G 5/00 (2006.01); G06T 15/10 (2006.01); G06T 15/20 (2006.01); G06T 17/40 (2006.01); G06F 3/00 (2006.01); G06F 15/20 (2006.01); A63F 13/00 (2006.01)
U.S. Cl. 345—633  [345/619; 345/630; 345/7; 345/156; 348/42; 348/51; 348/563; 348/739; 359/458; 359/462; 382/154; 382/291; 382/295] 5 Claims
OG exemplary drawing
 
1. An information processing method for enabling a further user to share a mixed reality space image including a virtual object superimposed in a space where a first user exists, comprising:
a first image acquiring step of obtaining a first stereo image based on stereo video data from a first stereo capturing section mounted on the first user and a virtual object image created based on the position and orientation of the first stereo capturing section;
a second image acquiring step of obtaining a second stereo image based on stereo video data from a second stereo capturing section provided in the space where the first user exists and a virtual object image created based on the position and orientation of the second stereo capturing section;
a selecting step of selecting an image from the first stereo image and the second stereo image according to an instruction of the further user;
a displaying step of displaying the selected image to the further user;
a manipulation object position acquiring step of obtaining the position of a manipulation object manipulated by the further user;
a further user position and orientation acquiring step of obtaining the position and orientation of the further user;
a relative position information acquiring step of obtaining relative position information representing the position of the manipulation object relative to the position and orientation of the further user;
a producing step of producing a manipulation object virtual image based on the position and orientation of the first stereo capturing section, with reference to the relative position information of the manipulation object and the position and orientation of one of the first and second stereo capturing sections corresponding to the selected image;
a combining step of combining the manipulation object virtual image with the first stereo image to create a composite image; and
a displaying step of displaying the composite image to the first user.