Fusion of gaze with hierarchical image segmentation for robust object detection

Thesis (M. Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2004.Includes bibliographical references (p. 41).We present Flycatcher, a prototype system illustrating the idea of gaze- based image processing in the context of object segmentation for wearable photography. The prototype includes a wearable eye tracking device that captures real-time eyetraces of a user, and a wearable video camera that captures first-person perspective images of the user's visual environment. The system combines the deliberate eyetraces of the user with hierarchical image segmentation applied to scene images to achieve reliable object segmentation. In evaluations with certain classes of real-world images, fusion of gaze and image segmentation information led to higher object detection accuracy than either signal alone. Flycatcher may be integrated with assistive communication devices, enabling individuals with severe motor impairments to use eye control to communicate about objects in their environment. The system also represents a promising step toward an eye-driven interface for "copy and paste" visual memory augmentation in wearable computing applications.by Jeffrey M. Bartelma.M.Eng

Analysis of RNA Binding by the Dengue Virus NS5 RNA Capping Enzyme

Flaviviruses are small, capped positive sense RNA viruses that replicate in the cytoplasm of infected cells. Dengue virus and other related flaviviruses have evolved RNA capping enzymes to form the viral RNA cap structure that protects the viral genome and directs efficient viral polyprotein translation. The N-terminal domain of NS5 possesses the methyltransferase and guanylyltransferase activities necessary for forming mature RNA cap structures. The mechanism for flavivirus guanylyltransferase activity is currently unknown, and how the capping enzyme binds its diphosphorylated RNA substrate is important for deciphering how the flavivirus guanylyltransferase functions. In this report we examine how flavivirus NS5 N-terminal capping enzymes bind to the 5′ end of the viral RNA using a fluorescence polarization-based RNA binding assay. We observed that the KD for RNA binding is approximately 200 nM Dengue, Yellow Fever, and West Nile virus capping enzymes. Removal of one or both of the 5′ phosphates reduces binding affinity, indicating that the terminal phosphates contribute significantly to binding. RNA binding affinity is negatively affected by the presence of GTP or ATP and positively affected by S-adensyl methoninine (SAM). Structural superpositioning of the dengue virus capping enzyme with the Vaccinia virus VP39 protein bound to RNA suggests how the flavivirus capping enzyme may bind RNA, and mutagenesis analysis of residues in the putative RNA binding site demonstrate that several basic residues are critical for RNA binding. Several mutants show differential binding to 5′ di-, mono-, and un-phosphorylated RNAs. The mode of RNA binding appears similar to that found with other methyltransferase enzymes, and a discussion of diphosphorylated RNA binding is presented

NS3 protease from flavivirus as a target for designing antiviral inhibitors against dengue virus

The development of novel therapeutic agents is essential for combating the increasing number of cases of dengue fever in endemic countries and among a large number of travelers from non-endemic countries. The dengue virus has three structural proteins and seven non-structural (NS) proteins. NS3 is a multifunctional protein with an N-terminal protease domain (NS3pro) that is responsible for proteolytic processing of the viral polyprotein, and a C-terminal region that contains an RNA triphosphatase, RNA helicase and RNA-stimulated NTPase domain that are essential for RNA replication. The serine protease domain of NS3 plays a central role in the replicative cycle of dengue virus. This review discusses the recent structural and biological studies on the NS2B-NS3 protease-helicase and considers the prospects for the development of small molecules as antiviral drugs to target this fascinating, multifunctional protein

Novel ATP-Independent RNA Annealing Activity of the Dengue Virus NS3 Helicase

The flavivirus nonstructural protein 3 (NS3) bears multiple enzymatic activities and represents an attractive target for antiviral intervention. NS3 contains the viral serine protease at the N-terminus and ATPase, RTPase, and helicase activities at the C-terminus. These activities are essential for viral replication; however, the biological role of RNA remodeling by NS3 helicase during the viral life cycle is still unclear. Secondary and tertiary RNA structures present in the viral genome are crucial for viral replication. Here, we used the NS3 protein from dengue virus to investigate functions of NS3 associated to changes in RNA structures. Using different NS3 variants, we characterized a domain spanning residues 171 to 618 that displays ATPase and RNA unwinding activities similar to those observed for the full-length protein. Interestingly, we found that, besides the RNA unwinding activity, dengue virus NS3 greatly accelerates annealing of complementary RNA strands with viral or non-viral sequences. This new activity was found to be ATP-independent. It was determined that a mutated NS3 lacking ATPase activity retained full-RNA annealing activity. Using an ATP regeneration system and different ATP concentrations, we observed that NS3 establishes an ATP-dependent steady state between RNA unwinding and annealing, allowing modulation of the two opposing activities of this enzyme through ATP concentration. In addition, we observed that NS3 enhanced RNA-RNA interactions between molecules representing the ends of the viral genome that are known to be necessary for viral RNA synthesis. We propose that, according to the ATP availability, NS3 could function regulating the folding or unfolding of viral RNA structures

Visual Memory Augmentation:

We present two early prototype systems that leverage computer memory to augment human memory in everyday situations. Both experiments investigate the role of eye tracking as a way to detect a person's attention and use this knowledge to affect short and long term memory processes. This work is part of a larger effort underway at the MIT Media Laboratory to develop systems that work symbiotically with humans, leading to increased performance along numerous cognitive and physical dimensions [9]

Flexibility between the protease and helicase domains of the dengue virus NS3 protein conferred by the linker region and its functional implications

10.1074/jbc.M109.090936Journal of Biological Chemistry2852418817-18827JBCH