PhD Alumna Maria Gorlatova Receives NSF Career Award
EE PhD Alumna Maria Gorlatova received an NSF CAREER Award to build the Foundations of IoT-Supported Mobile Augmented Reality. "Our ultimate goal is to make mobile augmented reality more reliable, paving way for its widespread application in health-critical and safety-critical domains."
She earned her Ph.D. in Electrical Engineering from Columbia University in the Wireless and Mobile Networking Lab led by Prof. Gil Zussman.
"During my PhD studies at Columbia, I've learned to examine jointly the Internet of Things devices themselves and the environment in which they are deployed. The proposed research applies this mindset to pervasive mobile augmented reality deployments: rather than examine mobile augmented reality technology on its own, we will examine how it is affected by the properties of the environments around it, and how controlling the state of the environment can improve its performance", said Gorlatova.
Mobile augmented reality, which integrates computer-generated virtual objects with real-world environments around a user in real time, has the potential to bring to the users, vibrant and immersive representations of important information at the right time and the right place within the physical world. Yet existing mobile augmented reality systems often make mistakes in identifying the objects present in the real world, thus generating incorrect virtual objects for the users. They also make mistakes in placing virtual objects within the real world, making them appear as shifting, oscillating, or jumping around. This project will address such environmental awareness limitations by taking advantage of Internet of Things (IoT) sensors and controllers located in the vicinity of mobile augmented reality devices. Many IoT devices, such as smart lights, cameras, and displays, are already pervasive in smart homes, offices, and other environments. This project will improve mobile augmented reality environmental awareness by using these IoT devices as sources of additional information about the real world, and as means for partially controlling the state of the world. The project will make mobile augmented reality more reliable, paving way for its applications in health-critical and safety-critical domains, such as medicine and transportation. The project will develop multi-disciplinary research skills in a diverse cohort of graduate, undergraduate, and high school students. The findings of this project will be showcased as interactive demonstrations at K-12-oriented events, with the particular aim of attracting women and underrepresented minorities to science and engineering.
This project will lay the foundations for studies of IoT-supported mobile augmented reality by developing techniques for designing, implementing, and evaluating it, and by demonstrating IoT-supported methods that improve the performance of core mobile augmented reality algorithms. The goals of this research are divided into three thrusts. The first thrust will develop an IoT-supported mobile augmented reality platform, a game engine-based IoT-supported augmented reality emulator, and new IoT-supported mobile augmented reality applications. The second thrust will examine and quantify the failures in mobile augmented reality semantic awareness, and will develop algorithms that address these failures by making use of the IoT camera-provided availability of multiple views of the same physical space and IoT-based smart light and shade controls. The third thrust will examine and quantify failures in mobile augmented reality spatial awareness, develop machine learning-based techniques to predict whether the failures are likely to occur in a given environment, and demonstrate algorithms that improve spatial awareness by controlling the state of smart lights, shades, and displays available in the environment.
Maria's current research focuses on the challenges and opportunities associated with adding connectivity and intelligence to every device big and small — the cross-disciplinary area known as the Internet of Things. Her work involves the development of architectures, algorithms, and protocols for pervasive technologies of the future. This work crosses traditional discipline boundaries and requires thinking across multiple layers of system and protocol stacks. She is particularly interested in the opportunities associated with fog and edge computing, and in breaking the barriers for technologies that enable fundamentally new deployments and experiences, such as energy harvesting and augmented reality. More about her current research.
More information on the NSF Career Award can be found here.