Vision System Enables First Automated Learning and Testing Chamber with Real-Time Feedback
Using human researchers to observe test subject behavior during research experiments can be time consuming and expensive. The available manpower for real-time observation is limited, and human observations are inherently subjective. To address some of these limitations, the Tufts Center for Regenerative and Developmental Biology has partnered with Wireless Techniques to develop the first automated learning and testing chamber for analyzing behavior in small animals. The chamber uses a Cognex In-Sight® Micro vision system instead of a human researcher to observe the behavior of test subjects.
Tufts researchers are using the new testing chamber to study the molecular mechanisms underlying the abilities of living things to learn from their environment. Light stimuli are used to train worms and tadpoles on specific tasks, and the animals are then tested for recall in a variety of molecular-genetic and pharmacological experiments. The new tracking system provides quantitative data on the subjects’ behavior and performance in learning assays; this is a unique system—the first that allows not simply tracking of animal movement but actually gives parallel, independent feedback to each subject so they can learn specific tasks. Simple animals such as flatworms share many of the same behavioral pathways and neurotransmitters with human beings, so these animals are frequently studied to better understand the properties of memory storage and transmission in tissue. The new chamber makes it possible to test new drug compounds to see if they have any impact on cognitive ability.
“Modern cognitive science is striving to understand the connection between molecular genetics and the information processing mechanisms that give rise to behavior and thought,” said Professor Michael Levin, Director of The Tufts Center for Regenerative and Developmental Biology. “The biomedical aspect of this goal includes the search for drugs that will aid learning and memory and the understanding of various influences on cognition.”
In a typical experiment, worms will be trained to stay in, or avoid, specific parts of the dish or to move at specific rates. Worms that successfully perform the task will be rewarded by lowered light levels (worms inherently prefer the dark).
Up to now, studies have been performed manually. But the manual approach of assessing behavior puts significant limits on experimental progress. Only a limited number of animals can be analyzed by hand due to manpower and cost limitations. Manual handling also introduces the potential for the results to be affected by the judgment and errors of the person running the experiment. For example, the lack of consensus on the learning abilities of flatworms has been attributed to the small sample sizes that have been required by manual training. Manual methods also make it difficult or impossible for other labs to replicate results and for other scientists to view the original experiment and potentially uncover trends that might have been missed by the experimenter.
The Tufts Center selected Wireless Techniques to design and build an automated learning and testing chamber that could provide real-time feedback without a human researcher. Wireless Techniques (now through its successor-in-interest Boston Engineering Corporation—a product and systems development services firm with its principal office located in Waltham, MA—which acquired substantially all of Wireless Techniques’ assets) designs and builds custom electronic devices and instrumentation for applications including wireless and wired communications, sensing, and signal processing. Cognex was chosen as the vision system supplier because its sophisticated image processing tools provided the ability to determine the position of the worms despite complicated shadowing effects created by the movement of the water in the test chamber.
How the chamber works
The chamber consists of 12 cells arranged in a grid, each holding a disposable Petri dish where the worm lives. The environment in each cell is individually controlled by the software depending on the behavior of the animal within. The lid contains a series of light emitting diodes (LEDs) controlled by a computer that are used to train worms. A set of four bright LEDs can be set to illuminate a single quadrant of the dish, and barriers prevent the light from spreading to adjacent quadrants. Red LEDs that cannot be seen by the worms are applied at all times during experiments so that the vision system can track the motion of the worms without having any effect on the worm’s behavior. Electrodes in the dish allow the experimenter to also provide weak electrical signals to the animals.
Each experiment is controlled by an algorithm written by Levin’s team. First, the position of the worms in their dishes is recorded by the vision camera. Then an action is taken such as turning on a light in one quadrant of the dish with the goal of teaching the animal to swim to the lighted quadrant. Then the position of the worm is again recorded by the vision camera. Based on the position (and second-order quantities like speed, direction of movement, etc.) of the worm, another action might be taken such as rewarding the worm by turning down the lights because it swam to the correct quadrant or turning on a bright light because it did not perform the task properly. These series of measurements and actions can continue until the program reaches a predefined condition (a level of performance indicating that the animal has understood the task to be learned).
Because the system is automated, 12 experiments can be run simultaneously seven days a week, 24 hours a day without human intervention. As a result, much larger sample sizes can be achieved, and experiments can also be run for much longer periods. Millions of observation and training cycles can be performed, a level of training far beyond what can realistically be accomplished by manual methods. The system also provides complete consistency among experiments, allowing labs to replicate experiments performed elsewhere. The more consistent learning environment helps reduce the amount of noise in the data. The vision system records the worms’ motion so it can be easily reviewed and analyzed by other experts, shared via the internet, etc.
Overcoming the vision challenge
“Machine vision was one of the greatest challenges in this automated learning system,” said Chris Granata, former President of Wireless Techniques, now Program Manager, Wireless and Sensing Technologies at Boston Engineering. “The water touching the sides of the dish creates a meniscus which rises and falls. This creates shadows that change over time and are difficult to distinguish from the worms. This application requires a vision system with powerful vision tools that are capable of identifying the location of the worm and is completely self-contained in a compact package so we can easily increase the number of cells. The Cognex In-Sight Micro 1400 was ideal for this application because of its broad toolset and the fact that the entire system is contained in a 30 mm x 30 mm by 60 mm enclosure.”
In order to reliably differentiate worms from randomly changing water shadows, background images of empty quadrants are captured every 20 seconds. By tracking the worm’s position and regularly capturing images of shadows in the unoccupied quadrants, the system can remove the shadows from the live images be performing image subtraction.
A histogram tool is used to identify and group the lightest colored pixels in order to identify possible positions of the worm. Several convolution and morphological filters are used to enhance the image. For example, morphological dilation filtering is used to connect white pixels in close proximity to each other and smooth out edges of white islands. Then a blob detection tool picks out the three largest groups of light colored pixels and sorts them in order of size. In almost every case, the largest object is the worm, however, multiple objects are tracked to address the rare possibility that one or more shadows may be larger than the worm.
In the end, scientists hope to use this research to make discoveries about the molecular basis of memory and develop new nootropic drugs.
“We are using quantitative automated behavior analysis techniques to ask how and where information is encoded and how it can be imprinted upon the regenerating brain by other tissues,” said Levin. “Genetic changes can be made to the worms and then their learning performance can be measured in the chamber in order to understand which genes affect learning and memory. This chamber also provides a very powerful tool for investigating the mechanisms of memory and behavior and for drug screening of new nootropic compounds designed to treat conditions such as attention-deficit hyperactivity disorder (ADHD), drug addiction, etc. as well as counteract effects of neurotoxins and improve cognitive performance. Automating the training and testing process will enable us to make faster progress by running many more experiments on a 24x7 basis instead of just when human experimenters are available; moreover, the quantitative data (impossible to obtain with human observers) will reveal unprecedented insights into the processes of learning and memory.”