Projection-based visualization of tangential deformation of nonrigid surface by deformation estimation using infrared texture

Punpongsanon, Parinya; Iwai, Daisuke; Sato, Kosuke

Virtual Reality, 2015, 19(1), 45-56

Number of Access:653（2025-07-27 17:43 Counts）

Identifier to cite or link to this item: https://hdl.handle.net/11094/81841

Link to primary information 

File Format Terms of use Size Views Date.Available Description information
VirtualReality_19_1_45 pdf None 13.5 MB 349 2021.06.28  

Item Information

Output File Export EndNote Basic Export Mendeley

Title
Projection-based visualization of tangential deformation of nonrigid surface by deformation estimation using infrared texture
Creator
NRID
1000090812222 1000090812222
ORCID
0000-0003-2720-7768 0000-0003-2720-7768
researchmap permalink
parinya parinya
Scopus Author ID
55974259100 55974259100
CreatorName
Punpongsanon, Parinya
NRID
1000090504837 1000090504837
researchmap permalink
daisukeiwai daisukeiwai
Scopus Author ID
55931917600 55931917600
CreatorName
Iwai, Daisuke
NRID
1000090187188 1000090187188
researchmap permalink
read0076311 read0076311
Scopus Author ID
56192879500 56192879500
CreatorName
Sato, Kosuke
Subject
Projection-based mixed reality
User interaction
Deformable surface
Description
Punpongsanon, P., Iwai, D. & Sato, K. Projection-based visualization of tangential deformation of nonrigid surface by deformation estimation using infrared texture. Virtual Reality 19, 45–56 (2015). https://doi.org/10.1007/s10055-014-0256-y.
This is a post-peer-review, pre-copyedit version of an article published in Virtual Reality. The final authenticated version is available online at: https://doi.org/10.1007/s10055-014-0256-y.
Abstract
In this paper, we propose a projection-based mixed reality system that visualizes the tangential deformation of a nonrigid surface by superimposing graphics directly onto the surface by projected imagery. The superimposed graphics are deformed according to the surface deformation. To achieve this goal, we develop a computer vision technique that estimates the tangential deformation by measuring the frame-by-frame movement of an infrared (IR) texture on the surface. IR ink, which can be captured by an IR camera under IR light, but is invisible to the human eye, is used to provide the surface texture. Consequently, the texture does not degrade the image quality of the augmented graphics. The proposed technique measures individually the surface motion between two successive frames. Therefore, it does not suffer from occlusions caused by interactions and allows touching, pushing, pulling, and pinching, etc. The moving least squares technique interpolates the measured result to estimate denser surface deformation. The proposed method relies only on the apparent motion measurement; thus, it is not limited to a specific deformation characteristic, but is flexible for multiple deformable materials, such as viscoelastic and elastic materials. Experiments confirm that, with the proposed method, we can visualize the surface deformation of various materials by projected illumination, even when the user’s hand occludes the surface from the camera.
Publisher
Springer
Source Title
Virtual Reality
Volume (Issue)
19(1)
Page
45-56
Date of Issued
2015-03
Language
English
Handle URL
https://hdl.handle.net/11094/81841
PISSN
13594338
eISSN
14349957
NCID
AA11558816
Relation.isVersionOf
DOI (Publisher Version)
https://doi.org/10.1007/s10055-014-0256-y
Access Rights
open access
oaire:version
Accepted Manuscript
Category
学術雑誌論文 Journal Article