Reducing Visual Discomfort with HMDs
Using Dynamic Depth of Field

Although head-mounted displays (HMDs) are ideal devices for personal viewing of immersive stereoscopic content, exposure to VR applications on HMDs can result in adverse physical reactions (eye fatigue, headaches, nausea, and sweating). This study shows that depth-of-field blur can decrease (approximately 30%) overall visual discomfort with HMDs.

Sky Browser: Search for HDR Sky Maps

In a visual effects studio for movie production, sky maps play an important role for acting as a sky backdrop to a scene. We define a feature space that supports an interactive search function for HDR sky maps, allowing users to find ideal images based on the scene's appearance.

Perceptually Optimised Illumination for Seamless Composites

Realistic illumination in composition is important for a seamless mixture between the virtual and real world objects in visual effects and mixed reality. Here we find perceptually optimised thresholds for reducing resources across resolution and dynamic range of the radiance map for image based lighting.

A Pose Space for Squash and Stretch Deformation

'Squash & Stretch' is a fundamental technique in traditional animation, in which the shape of a character or object is intentionally distorted in order to accentuate its movement. We contribute a novel technique in which the squash & stretch effect can be introduced and controlled simply by specifying examples of the desired effect at any point along an animation timeline.

Publications

2017

  • T Rhee, L Petikam, B Allen, A Chalmers, "MR360: Mixed Reality Rendering for 360-degree Panoramic Videos", IEEE Virtual Reality 2017, to appear in IEEE Transactions on Visualization and Computer Graphics (TVCG)
  • S Yoon, J Lewis, T Rhee, "Blending Face Details: Synthesizing a Face using Multi-Scale Face Models", IEEE Computer Graphics and Applications, 2017, to appear
  • T Rhee, P Lui, JP Lewis, "Deformable Human Body Modeling from 3D Medical Image Scans", The Role and Importance of Mathematics in Innovation, 143-147, 2017

2016

2015

2014

  • A. Chalmers, J. Choi, T. Rhee, "Perceptually Optimised Illumination for Seamless Composites", Pacific Graphics 2014.
  • A. Chalmers, J.P. Lewis, P. Hillman, C. Tait, T. Rhee, "Sky Browser: Search for HDR Sky Maps", Pacific Graphics 2014.
  • J.P. Lewis, K. Anjyo, T. Rhee, "Superresolution from Principal Component Models by RKHS Sampling", Mathematical Progress in Expressive Image Synthesis (short paper), 2014.
  • Z. Levi, D. Zorin, "Strict Minimizers For Geometric Optimization", SIGGRAPH Asia (ACM Transactions on Graphics) 2014.
  • Z. Levi, D. Levin, "Shape Deformation via Interior RBF", IEEE Transactions on Visualization and Computer Graphics 2014
  • FP Tasse, A Emilien, MP Cani, S Hahmann, N Dodgson, "Feature-based terrain editing from complex sketches", Computers and Graphics 45, 101-115, 2014
  • J Shen, J Kosinka, MA Sabin, NA Dodgson, "Conversion of trimmed NURBS surfaces to Catmull–Clark subdivision surfaces", Computer Aided Geometric Design 31 (7), 486-498, 2014
  • J Kosinka, M Sabin, N Dodgson, "Creases and boundary conditions for subdivision curves", Graphical Models 76 (5), 240-251, 2014
  • H Lieng, T Pouli, E Reinhard, J Kosinka, NA Dodgson, "Cornsweet surfaces for selective contrast enhancement", Computers and Graphics 42, 1-13, 2014
  • J Kosinka, MA Sabin, NA Dodgson, "Semi‐sharp Creases on Subdivision Curves and Surfaces>", Computer Graphics Forum 33 (5), 217-226, 2014
  • L Świrski, N Dodgson, "Rendering synthetic ground truth images for eye tracker evaluation", Proceedings of the Symposium on Eye Tracking Research and Applications, 219-222, 2014
  • AT Duchowski, DH House, J Gestring, R Congdon, L Świrski, NA Dodgson, K Krejtz, I Krejtz "Comparing estimated gaze depth in virtual and physical environments", Proceedings of the Symposium on Eye Tracking Research and Applications, 103-110, 2014
  • J Kosinka, MA Sabin, NA Dodgson, "Subdivision surfaces with creases and truncated multiple knot lines", Computer Graphics Forum 33 (1), 118-128, 2014
  • NA Dodgson, "Going to the movies: Lessons from the film industry for 3d libraries", 3D Research Challenges in Cultural Heritage, 93-103, 2014

2013

  • A. Chalmers, J. Choi, T. Rhee, "Perceptually Based Radiance Map for Realistic Composition", Proc. of 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013), Wellington, NZ, Nov, 2013.
  • J.P. Lewis, T. Rhee, “Principal Component Analysis and Laplacian Splines: steps toward a unified model”, Proc. of Forum Math for Industry (FMI 2013), Fukuoka, Japan, Oct, 2013.
  • J.P. Lewis, K. Anjyo, Z. Mo, T. Rhee, “Probable and improbable faces”, Proc. of Mathematical Progress in Expressive Image Synthesis (MEIS2013), Fukuoka, Japan, Oct, 2013.
  • Z. Levi, C. Gotsman, "ArtiSketch: A System for Articulated Sketch Modeling",Eurographics (Computer Graphics Forum) 2013
  • Z. Levi, C. Gotsman, "D-Snake: Image Registration by As-Similar-As-Possible Template Deformation", IEEE Transactions on Visualization and Computer Graphics 2013

2012

  • C.S. Calude, J.P. Lewis, "Is there a Universal Image Generator?", Applied Mathematics and Computation, vol 218, #16, 2012.
  • Y. Seol, J.P. Lewis, J. Seo, B. Choi, K. Anjyo, J. Noh, "Spacetime Expression Cloning for Blendshapes", ACM Transaction On Graphics, 31, 2, 2012.
  • N. Kang, M.W. Lee, T. Rhee, "Liver Deformation during Respiration using Sparse Local Features", IEEE Computer Graphics and Applications, Vol. 32, No.5, 2012.
  • H. Shim, R. Adelsberger, J.D. Kim, S. Rhee, T. Rhee, J. Sim, M. Gross, C. Kim, "Time-of-flight sensor and color camera calibration for multi-view acquisition," The Visual Computer, Vol. 28, Issue 12, 2012.
  • I. Ha, T. Rhee, J. Kim, "Smooth mesh generation from noisy depth image", Proc. of The 1st IEEE Global Conference on Consumer Electronics (GCCE2012), Tokyo, Japan, Oct. 2012.
  • S. Rhee, Y. Lee, J.D. Kim, T. Rhee, "Split and Merge Approach for Detecting Multiple Planes in a Depth Image", Proc. of the International Conference on Image Processing (ICIP 2012), Orlando, U.S.A., September, 2012.
  • I. Ha, T. Rhee, "Composition of Synthetic Objects with Color‐Depth Video", Proc. of Computer Graphics International (CGI 2012, short), U.K., Jun. 2012.
  • N. Kang, K. Kim, S. Kim, T. Rhee, "Robust Organ Deformation Driven by Sparse Local Features", IEEE International Symposium on Biomedical Imaging (ISBI 2012, poster), Barcelona, Spain, May., 2012.
  • K. Kim, N. Kang, T. Rhee, J. Kim, "Analysis of Liver Deformation on Breathing", IEEE International Symposium on Biomedical Imaging (ISBI 2012, poster), Barcelona, Spain, May. 2012.
  • S. Kim, N. Kang, K. Kim, T. Rhee, J. Kim, "Panoramic Elasticity Modeling", IEEE International Symposium on Biomedical Imaging (ISBI 2012, poster), Barcelona, Spain, May. 2012.

2011

  • S. Baker, D. Scharstein, J.P. Lewis, S. Roth, M.J. Black, R. Szeliski,"A Database and Evaluation Methodology for Optical Flow", International Journal of Computer Vision, 92, 1, 2011.
  • Y. Seol, J. Seo, P.H. Kim, J.P. Lewis, J. Noh, "Artist Friendly Facial Animation Retargeting" ACM Transaction On Graphics, vol 30, #6, 2011 (also ACM SIGGRAPH ASIA, 2011).
  • Y. Seol, J. Seo, P. H. Kim, J.P. Lewis, J. Noh, "Weighted Pose Space Editing for Facial Animation Visual Computer", 2011. (Accepted). Conference version: Seol, Seo, Kim, Lewis, Noh, Pose Space Editing of Blendshape Based Facial Animation, CGI 2011.
  • K. Anjyo, J.P. Lewis, RBF Interpolation and Gaussian Process Regression through an RKHS Formulation JMI Volume 3 2011.
  • J.P. Lewis, K. Anjyo, "Direct Manipulation Blendshapes", IEEE Computer Graphics and Applications 30(4) Special Issue: Digital Human Faces
  • T. Rhee, Y. Hwang, J.D. Kim, C. Kim, "Real-time Facial Animation from Live Video Tracking", Proc. Of Eurographics/ACM SIGGRAPH Symposium on Computer Animation, Vancouver, Canada, Aug. 2011.
  • H. Liu, X. Wei, J. Chai, I. Ha, T. Rhee, "Realtime Human Motion Control with A Small Number of Inertial Sensors", Proc. of ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games 2011 (I3D), San Francisco, U.S.A., Feb. 2011.
  • T. Rhee, J.P. Lewis, U. Neumann, K. Nayak, "Scan-Based Volume Animation Driven by Locally Adaptive Articulated Registrations", IEEE Transactions on Visualization and Computer Graphics, Vol.17, No.3, 2011.

2010

  • A. Lagae, S. Lefebvre, R. Cook, T. DeRose, G. Drettakis, D.S. Ebert, J.P. Lewis, K. Perlin, M. Zwicker,"A Survey of Procedural Noise Functions", Computer Graphics Forum 29, 8, 2010; also Eurographics 2010 State of the Art Report: Procedural Noise Functions.
  • H. Shim, I. Ha, T. Rhee, J. Kim, C. Kim, "Probabilistic Approach to Realistic Face Synthesis", Proc. of the International Conference on Image Processing (ICIP 2010), Hong Kong, Sep. 2010.

2009

  • S. Lee, K. Lee, T. Rhee, U. Neumann, "Reservoir Model Information System: REMIS", Proc. SPIE 7243, Visualizaion and Data Analysis 2009.
  • M. Sips, B. Neubert, J.P. Lewis, P. Hanrahan, "Selecting Good Views of High-Dimensional Data using Class Consistency", Computer Graphics Forum Vol. 28 #3 (Special issue: Eurovis 2009)

2008

  • T.Rhee, J.P. Lewis, Krishna Nayak, U. Neumann, "AdaptiveNon-rigid Registration of 3D Knee MRI in Different Pose Spaces", Proc. of IEEE International Symposium on Biomedical Imaging (ISBI ‘08), presented at Paris, France, May 2008.
  • T. Rhee, J.P. Lewis, K. Nayak, U. Neumann, "Creating an Animatable 3D Volume Hand Model from In Vivo MRI", Proc. of MMVR 16, In The Studies of Health Technology and Informatics (SHTI) series pp402-407, presented at Long Beach, CA, Jan 2008.

2007

  • J.P. Lewis, I. Mostafavi, R. West, G.E. Sosinsky, M.E. Martone, "Shape Priors by Kernel Density Modeling of PCA Residual Structure", IEEE International Conference on Image Processing 2007.
  • T. Rhee, J.P. Lewis, U. Neumann, K. Nayak, "Soft-tissue Deformation for In-Vivo Volume Animaton", Proc. of Pacific Graphics 2007, pp 435-438, presented at Maui, Hawaii, October 2007.
  • J.P. Lewis, M. McGuire, P. Fox, "Mapping the Mental Space of Game Genres", ACM SIGGRAPH Symp. Video Games 2007.
  • J.P. Lewis, K. Anjyo, "A Region-of-Influence Measure for Automatic Skinning", IVCNZ 07
  • S. Baker, D. Scharstein, J.P. Lewis, S. Roth, M.J. Black, R. Szeleski, "A Database and Evaluation Methodology for Optical Flow", ICCV 07.
  • J.P. Lewis, J. Mooser, Z. Deng, U. Neumann, "A User Interface Technique for Controlling Blendshape Interference", in Data-Driven 3D Animation, Springer, 2007.
  • Z. Deng, J.P. Lewis, U. Neumann, "Realistic Eye Motion Synthesis by Texture Synthesis", in Data-Driven 3D Animation, Springer, 2007.
  • J.P. Lewis, M. McGuire, P. Fox, Mapping the Mental Space of Game Genres, ACM SIGGRAPH Symp. Video Games 2007

2006

  • Xiao Xian, J.P. Lewis, S.H. Soon, N. Fong, T. Feng, "A Powell Optimization Approach for Example-Based Skinning in a Production Animation Environment", Computer Animation and Social Agents (CASA 2006)
  • T. Rhee, J.P. Lewis, U. Neumann, "Real-Time Weighted Pose-Space Deformation on the GPU", Computer Graphics Forum, Vol 25, No 3, pp439-448, Proc. of Eurographics 2006, presented at Vienna, Austria, September 2006.
  • T. Rhee, U. Neumann, J.P. Lewis, "Human Hand Modeling from Surface Anatomy", Proc. of ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games 2006 (I3D), pp27-34, presented at Redwood City, CA, March2006.

2005

  • J.P. Lewis, N. Fong, XueXian, S.H. Soon, T. Feng, "More Optimal Strokes for NPR Sketching", ACM Graphite 2005.
  • J.P. Lewis, J. Mooser, Z. Deng, U. Neumann, "Reducing Blendshape Interference by Selected Motion Attenuation", ACM I3D 2005
  • Z. Deng, J.P. Lewis, U. Neumann, "Automated Eye Motion Using Texture Synthesis", IEEE Computer Graphics and Applications, March/April 2005.
  • Z. Mo, J.P. Lewis, U. Neumann, "SmartCanvas: A Gesture-Driven Intelligent Drawing Desk System", Proc. of International Conference on Intelligent User Interface (IUI) 2005.
  • R. West, J. Burke, C. Kerfeld, E. Mendelowitz, T. Holton, J.P. Lewis, E. Drucker, W. Yan, Both and Neither: in silico v1.0, Ecce Homology. Leonardo, 38 (4) 2005.

2004

2002

  • H.Han, T. Rhee, K. Lee, S. Lee, R. Lee, and S. Kim, "Development of 3D Rendering System and Application to the Industrial Design Process", Proc. of HCI Korea 2002, presented at PyongChang, Korea, Feb. 2002.

2001

1999

1996

  • T. Rhee, S. Park, and I. Ihm, "Development of Visualization Toolkits for Effective Rendering of Huge Volume Data", Proc. of KISS (Spring), pp.731-734, Daegu, April 1996.
  • Ihm, and T. Rhee, "On Effective Rendering of Huge Volume Data", Proc. of Korea CAD/CAM Society 96, pp.234-239, Seoul, Feb. 1996.

1995

  • T. Rhee, K. Baek, R. Lee, and I. Ihm, "Case Study: Construction of Sogang Volume Rendering System V0.55", Proc. of Computer Graphics Society 95, pp.112-114, presented at Seoul, Nov. 1995.
  • K. Paek, T. Rhee, R. Lee, and I. Ihm, "SGVR: Construction of Scientific Visualization System for Collaboration", Proc. of KISS (Fall), Incheon, Oct. 1995.
  • J.P. Lewis, "Fast Template Matching", Vision Interface 1995.

1994

1991

1990

  • J.P. Lewis, "Apparatus and Method for Lip-Synching Animation." U.S. Patent No. 4,913,539, Apr.3,90.

1989

  • J.P. Lewis, "Algorithms for Solid Noise Synthesis", Siggraph 89.
  • J.P. Lewis, "Algorithms for Music Composition by Neural Nets: Improved CBR Paradigms", International Computer Music Conference 89.

1988

  • J.P. Lewis, "Creation by Refinement: A Creativity Paradigm for Gradient Descent Learning Networks." International Conference on Neural Networks 88.

1987

Courses

  • Ken Anjyo, J.P. Lewis, Scattered Interpolation for Computer Graphics, ACM SIGGRAPH 2014
  • Alec Jacobson, Zhigang Deng, Ladislav Kavan, J.P. Lewis, Skinning: Real-time Shape Deformation, ACM SIGGRAPH 2014
  • J.P. Lewis, K. Anjyo, T. Rhee, F. Pighin, Z. Deng, Practice and Theory of Blendshape Facial Models, Eurographics STAR 2014