Course Assignment 2 - Multimodal Rendering

Overview

Several modalities of a Monkey head datasets are combined in order to describe the anatomy of soft tissue (MRI), hard tissue (CT), and metabolism (PET). The rendering plugin from Course Assignment 1 containing cool-to-warm shading, contour rendering, and illustrative transparency has been extended. The skull (CT data) is rendered using cool-to-warm and contour rendering.

• MRI or PET data is shown only in regions with high brain activity (first hit on PET data).
• In order to deal with occlusion, the skull (CT data) is removed according to the color when brain data is occluded.
• Using this approach, dark contours (context) can be preserved, while light materials are removed.

Results

The skull is depicted in blue, contours are enhanced. First hit rendering of brain activity data (PET), where the shading is performed on the MRI data. The color coding represents the brain activity.	In regions where high PET data (high brain activity) is occluded, the CT data is culled, based on the color of the skull rendering (dark colors remain, high colors are removed). Accordingly only the contours are preserved giving a rough representation of the skull, while showing the MRI data with high PET activity.
Clipping planes reveal regions with high brain activity (red). MRI data shown with PET color.	Transparency of the skull is increased.
Rendering of the PET data inside the skull (first hit).	Show Video (AVI, 18 MB)