SCIEN Talk

TBA

Registration is required to attend. The talks will be presented via Zoom, and you will receive a Zoom meeting URL when you register for the presentation.

Holographic optics are an exciting tool to increase the performance and reduce the size and weight of augmented and virtual reality displays. In this talk, I will describe two types of holographic optics that can be applied to AR/VR, as recently outlined in two ACM SIGGRAPH publications. In the first part, I will describe how static holographic optics can be used to replace conventional optical elements, such as refractive lenses, to enable highly compact, sunglasses-like virtual reality displays while retaining high performance. In the second part, I'll describe the potential of dynamic holography to replace the conventional image formation process and enable compact and high performance augmented reality displays. In particular, I will focus on a key challenge of dynamic holographic displays, limited etendue, and present a candidate solution to increase etendue through the co-design of a simple scattering mask and hologram optimization.

CMOS image sensors (CIS) are widely used in commercial, industrial and scientific applications. The low light sensors are useful for day-through-night imaging, capturing images in extreme lighting conditions from daylight through quarter-moon darkness. The low light sensors are required for numerous applications like surveillance, security, and mobile applications. Low illumination imaging performance and dynamic range (DR) of an image sensor are limited by the temporal noise of the photodetector and readout signal chain. I will overview some of our work in the domain of low light imaging, starting from a novel pixels increasing the conversion gain and simultaneously reducing the temporal noise of the pixels to more advanced pixel architectures capable of lowering the temporal noise below sub electron level. The dual effect of increased conversion gain and reduced noise, increases the effective dynamic range in the low illumination conditions and provide an alternative to commercial low light sensors like image intensifiers, electron bombardment, EMCMOS. The use of these high responsive light sensors in applications like surveillance, security, reconnaissance UAVs, bio-luminescence and imaging systems in space platform will be discussed.

In this talk I will describe our system for capturing, reconstructing, compressing, and rendering high quality immersive light field video. We record immersive light fields using a custom array of 46 time-synchronized cameras distributed on the surface of a hemispherical, 92cm diameter dome. From this data we produce 6DOF volumetric videos with a wide 80-cm viewing baseline, 10 pixels per degree angular resolution, and a wide field of view (>220 degrees), at 30fps video frame rates. Even though the cameras are placed 18cm apart on average, our system can reconstruct objects as close as 20cm to the camera rig. We accomplish this by leveraging the recently introduced DeepView view interpolation algorithm, replacing its underlying multi-plane image (MPI) scene representation with a collection of spherical shells which are better suited for representing panoramic light field content. We further process this data to reduce the large number of shell layers to a small, fixed number of RGBA+depth layers without significant loss in visual quality. The resulting RGB, alpha, and depth channels in these layers are then compressed using conventional texture atlasing and video compression techniques. The final, compressed representation is lightweight and can be rendered on mobile VR/AR platforms or in a web browser.

Label-free optical imaging of living biological systems offers rich information that can be of immense value for a variety of biomedical tasks. Despite the exceptional theoretical potential, current label-free microscopy platforms are challenging for real-world clinical and biological applications. The major obstacles include the lack of flexible laser sources, limited contrast, and the challenge of acquiring and interpreting the high-dimensional dataset.

In this talk, I will present new optical imaging platforms and methodologies that will address these challenges. By generating and tailoring coherent supercontinuum from photonic crystal fibers, simultaneous metabolic and structural imaging can be achieved without aids of stains, enabling perturbation-free exploration of living systems. These capabilities further motivate development of analytical tools for image-based segmentation and diagnosis, showing broad potential of this label-free imaging technology in discovering new metabolic biomarkers and enabling real-time point-of-procedure applications.

After registering, you will receive a confirmation email containing information about joining the meeting.

The encapsulation of the retina inside the eye has always challenged our ability to study the anatomy and physiology of retinal neurons in their native state. Our group is developing new tools using adaptive optics that allow not only structural imaging but also functional recording and control of retinal neurons at a cellular spatial scale. By combining adaptive optics with calcium imaging, we can optically record from hundreds of ganglion cells in the nonhuman primate eye over periods as along as years. This approach is especially well-suited for recording from cells serving the central fovea, which has been difficult to access with microelectrodes. Using optogenetics, we can also directly excite these same ganglion cells with light in the living animal. These capabilities together establish a two-way communication link with retinal ganglion cells. I will discuss the advantages and the current limitations of these approaches, as well as speculate about possible future applications for vision restoration and understanding the role of the retina in perception.

My attempts to photograph the Earth from space using the moon as a camera, and several computational imaging projects resulting from those attempts.

Single-photon avalanche diodes (SPADs) are an emerging sensor technology capable of detecting and time-tagging individual photons with picosecond precision. Despite (or perhaps, due to) these capabilities, SPADs are considered specialized devices suitable only for photon-starved scenarios, and restricted to a limited set of niche applications. This raises the following questions: Can SPADs operate not just in low light, but in bright scenes as well? Can SPADs be used not just with precisely controlled active light sources such as pulsed lasers, but under passive, uncontrolled illumination like cellphone or machine vision cameras?
I will describe our recent work on designing computational imaging techniques that (a) enable single-photon sensors to operate across the entire gamut of imaging conditions including high-flux scenes, and (b) leverages SPADs as passive imaging devices for ultra-low light photography. The overall goal is to transform SPADs into all-weather, general-purpose sensors capable of both active and passive imaging, across photon-starved and photon-flooded environments.

With over 466 million people suffering from disabling hearing loss globally according to the World Health Organization, and the number expected to rise to 900 million people by 2050, hearing aids are crucially important medical wearable devices. Untreated hearing loss has been linked to increased risks of social isolation, depression, dementia, fall injuries, and other health issues. In this talk, we will present a new class of in-ear devices with embedded sensors and artificial intelligence, which are shaped to fit an individual with 3D-imaging of the ear geometry. In addition to providing frequency-dependent amplification of sound to compensate for hearing loss, these devices serve as a continuous monitor for important physiological parameters, an automatic fall detection and alert system, as well as a personal assistant with connectivity to the cloud. Furthermore, Bluetooth-paired with a vision aid, these devices present exciting possibilities for multisensory perceptual augmentation of hearing, balance, vision, and memory, helping people live better and more productive lives.

Retinal topography is affected by pathology such as drusen and tumors, and it may be useful to determine topography with fundus imaging when three-dimensional imaging is not available. In this talk, I will present a novel method of retinal topography scanning using the stripe projection technology of the CLARUSTM 700 (ZEISS, Dublin, CA) wide-field fundus camera. The camera projects stripes onto the retina and records images of the returned light while maintaining a small angle between illumination and imaging. We make use of this structured illumination, analyzing neighboring stripes to determine depth -i.e. the retinal topography – from both relative defocus and stripe displacements. The resulting topography maps are finally compared to three-dimensional data from optical coherence tomography imaging.