Augmented Reality + Digital Twins in Advanced Manufacturing and Industry 4.0

News Flash!!! Research Opportunities 24Feb2022

Our lab currently has new research projects with research institutes. Interest students can email us to find out about the topic and scope of these projects. Interest students will need to apply for scholarships, which are as below . Once successful in the scholarship and admission application, you can join our lab to work on these new research projects.

  3. NUS ISEP Scholarship
  4. NUS Suzhou RI Scholarship
  5. Other scholarships can be found here.

Augmented Reality AR

AR is a novel form of human-machine interaction that overlays computer-generated information on the real world environment. It enhances the existing environment rather than replacing it as in the case of virtual reality. It augments the human’s capabilities in task performance and information visualization and processing, leading to enhanced efficiency.

AR in Advanced Manufacturing and Industry 4.0

The application of AR technologies to simulate and improve the design, assembly, manufacturing processes, disassembly, maintenance, logistics and product end-of-life processes before they are carried out is an innovative and effective approach. Research on the applications of AR in Industry 4.0 and product design and manufacturing is a strong and growing area.

AR in Assistive Technology & Rehabilitation Engineering

Due to the increasing population of elderly people worldwide, there is a growing proportion of individuals who suffer from hand impairments due to illnesses related to ageing or other forms of injury. AR-based assistive technology devices and rehabilitation systems can be effectively developed and employed to assist the physically-challenged and the elderly individuals in their everyday life as well as rehabilitation needs.

Video of Researches in NUS-ARAT Lab!

This video shows AR in Manufacturing in the lab (Jun 2013).

ARATLab Youtube Channel

This youtube channel features videos of researches in our lab.

View Our AR Posters! (12 August 2014)

An app that can be downloaded to view AR posters of our lab. Details.

Professor Andrew YC Nee’s Public Lecture – The Next Sense + The Nth Reality 

Professor Andrew Nee delivered a public lecture of the above title as part of the Faculty of Engineering at NUS Engineering Lecture Series on 14th April 2014 at the Engineering Auditorium. Highlights of the talk can be found here. Photos taken during the public lecture can be found here.

AR Navi NUS Launch!

An AR Navi system for NUS Faculty of Engineering has been launched on 20 July 2011 by Engineering Dean Prof Chan Eng Soon. Details.

Technology for Licensing: WinAR Ver 1 and Ver 2

WinAR is a Windows-based development platform (MFC) for AR applications. It provides camera image streaming, image processing, tracking and registration algorithms, and user interaction panels to developers in order for them to concentrate on application-oriented programming. Development of new algorithms for image processing, tracking and registrations, etc., can also be conducted in the WinAR platform. Moreover, it includes functions which may be useful for the developers, such as the function to import STL or 3DS models, functions to render frequently used characters, images, videos, and objects in the scene. The advantage of developing in WinAR is to allow AR developers to focus on development of their applications rather than working on the fundamentals of image processing and computer vision.

Technology for Licensing: Bare Hand Recognition and Detection for AR Applications

A computer interaction (HCI) system using bare hands for AR or other suitable applications. The main motivation behind this invention is the development of a natural and intuitive i.e. gesture based HCI method in AR environment, by using bare hand feature detection and tracking, through which the users can interact naturally with 2D/3D virtual objects in a real-life scene using their bare hands.

Technology for Licensing: Markerless 6DOF Computer Vision Tracker for 3D Augmentation of Patterned Planar Surfaces

The invention is a marker-less 6DOF computer vision based tracker that can augment 3D computer media, e.g., graphics, onto multiple well patterned planar surfaces in real time. The tracker uses a small camera, e.g., a webcam, to capture video of the planar objects and compute their 3D orientations and positions relative to the camera. This information is used to render computer generated 3D graphics onto the captured video, so that the graphics appears to be attached to the real world objects, and moves together with these objects as the video scene changes.

Technology for Licensing: Virtual Keyboard

This invention relates to the field of computer vision and augmented reality techniques for an active computer input device. It assists the handicapped who have difficulty in moving their body except for slight head movements and slight finger movements. It allows them to control electronic devices at home and access computer functions such as sending emails, browsing the Internet, etc.