Schematic diagram comparing the components of biological tactile neurons and artificial tactile neuron devices developed in the research. Credit: Korea Institute of Science and Technology (KIST)

The stiffness levels and distributions of biological materials reflect disease-related information, from cells to tissues. For example, malignant breast tumors are usually stiffer and have a more irregular shape than benign breast tumors. Ultrasound elastography can non-invasively determine the degree and shape of the tissue stiffness and is used for diagnosing breast cancer due to its low cost. However, the opinion of an experienced expert is essential for interpreting ultrasound elastography images, but different experts differ in accuracy.

Teams led by Dr. Hyunjung Yi and Suyoun Lee have developed a simple but highly accurate disease diagnosis technology by combining tactile neuron devices with learning methods. Unlike the previously reported artificial tactile neuron devices, this tactile neuron device can determine the stiffness of objects. Their results were published in Advanced Materials.

Neuromorphic technology is a that aims to emulate the human brain's information processing method, which is capable of high-level functions while consuming a small amount of energy using electronic circuits. It is gaining attention as a new data processing technology useful for AI, IoT and autonomous driving, requiring the processing of complex and vast information.

Sensory neurons receive through sensory receptors and convert them into electrical spike signals. Here, the generated spike pattern varies based on the external stimulus information. For example, higher stimulus intensity causes higher generated spike frequency. The research team developed an artificial tactile neuron device with a simple structure that combines a sensor and an ovonic threshold switch device to produce such sensory neuron characteristics. Applying pressure to the causes the sensor's resistance to decrease and the connected ovonic switch element's spike frequency to change. The developed artificial tactile neuron device is a high-response, high-sensitivity device that allows the pressing force to generate faster electrical spikes while improving the pressure sensitivity, which focuses on the fact that stiffer materials result in faster pressure sensing when pressed.

The electrical spike duration (or 1/frequency) generated by the developed device is less than 0.00001 s, which is more than 100,000 times faster than the several seconds it usually takes to press an object. Additionally, while the existing devices could detect a low pressure (approximately 20 kPa, similar to a force of light pressing) with a spike frequency change of 20 to 40 Hz, the developed device can detect the low pressure with spike frequency changes of 1.2 MHz. This allows real-time conversion of changes in the pressing force into spikes.

  • (left) Spike evolution pattern examples of the artificial tactile neuron device according to the stiffness of the pressed material, (right) Example of determining whether a tumor is malignant or benign by AI learning of ultrasound elastography images of a breast tumor using the stiffness-encoded spike patterns. Red indicates soft areas, and blue indicates stiff regions. Credit: Korea Institute of Science and Technology (KIST)

  • The research results are published as an inside back cover paper in Advanced Materials. Credit: Korea Institute of Science and Technology (KIST)

To deploy the developed device to actual disease diagnosis, the research team used elastography images of malignant and benign breast tumors and utilized a spiking neural network learning method. Each pixel of the color-coded ultrasound elastography image which is correlated with the stiffness of the imaged material was converted into a frequency change value and used for training the AI. As a result, it was possible to determine the malignancy of a breast tumor with up to 95.8% accuracy.

The KIST research team stated, "the developed artificial tactile neuron technology is capable of detecting and learning mechanical properties with a simple structure and method." The team added, "Through follow-up research, it will be possible to solve the noise reflection issue, which is a disadvantage of ultrasound elastography if artificial tactile neurons can collect an object's elastography image obtainable using ultrasound elastography."

The team also expects the device to be helpful in low-power and high-accuracy disease diagnosis and applications such as robotic surgery where a surgical site needs to be quickly determined in an environment humans cannot directly contact.

More information: Junseok Lee et al, An Artificial Tactile Neuron Enabling Spiking Representation of Stiffness and Disease Diagnosis, Advanced Materials (2022). DOI: 10.1002/adma.202201608

Journal information: Advanced Materials

Provided by National Research Council of Science & Technology