Tokyo University of Science


2021.02.02 Tuesday

Deep Vision: Near-Infrared Imaging and Machine Learning Can Identify Hidden Tumors

Near-infrared hyperspectral imaging combined with machine learning can visualize tumors in deep tissue and covered by a mucosal layer, scientists show

Gastrointestinal stromal tumors are tumors of the digestive tract that grow underneath the mucus layer covering our organs. Because they are deep inside the tissue, these "submucosal tumors" are difficult to detect and diagnose, even with a biopsy. Now, researchers from Japan have developed a novel minimally invasive and accurate method using infrared imaging and machine learning to distinguish between normal tissue and tumor areas. This technique has a strong potential for widespread clinical use.

Tumors can be damaging to surrounding blood vessels and tissues even if they're benign. If they're malignant, they're aggressive and sneaky, and often irrevocably damaging. In the latter case, early detection is key to treatment and recovery. But such detection can sometimes require advanced imaging technology, beyond what is available commercially today.

For instance, some tumors occur deep inside organs and tissues, covered by a mucosal layer, which makes it difficult for scientists to directly observe them with standard methods like endoscopy (which inserts a small camera into a patient's body via a thin tube) or reach them during biopsies. In particular, gastrointestinal stromal tumors (GISTs)―typically found in the stomach and the small intestines―require demanding techniques that are very time-consuming and prolong the diagnosis. Now, to improve GIST diagnosis, Drs. Daiki Sato, Hiroaki Ikematsu, and Takeshi Kuwata from the National Cancer Center Hospital East in Japan, Dr. Hideo Yokota from the RIKEN Center for Advanced Photonics, Japan, and Drs. Toshihiro Takamatsu and Kohei Soga from Tokyo University of Science, Japan, led by Dr. Hiroshi Takemura, have developed a technology that uses near-infrared hyperspectral imaging (NIR-HSI) along with machine learning. Their findings are published in Nature's Scientific Reports .

"This technique is a bit like X-rays, the idea is that you use electromagnetic radiation that can pass through the body to generate images of structures inside," Dr. Takemura explains, "The difference is that X-rays are at 0.01-10 nm, but near-infrared is at around 800-2500 nm. At that wavelength, near-infrared radiation makes tissues seem transparent in images. And these wavelengths are less harmful to the patient than even visible rays."

This should mean that scientists can safely investigate something that is hidden inside tissues, but until the study by Dr. Takemura and his colleagues, no one had attempted to use NIR-HSI on deep tumors like GISTs. Speaking of what got them to go down this line of investigation, Dr. Takemura pays homage to the late professor who began their journey: "This project has been possible only because of late Prof. Kazuhiro Kaneko, who broke the barriers between doctors and engineers and established this collaboration. We are following his wishes."

Dr. Takemura's team performed imaging experiments on 12 patients with confirmed cases of GISTs, who had their tumors removed through surgery. The scientists imaged the excised tissues using NIR-HSI, and then had a pathologist examine the images to determine the border between normal and tumor tissue. These images were then used as training data for a machine-learning algorithm, essentially teaching a computer program to distinguish between the pixels in the images that represent normal tissue versus those that represent tumor tissue.

The scientists found that even though 10 out of the 12 test tumors were completely or partly covered by a mucosal layer, the machine-learning analysis was effective in identifying GISTs, correctly color-coding tumor and non-tumor sections at 86% accuracy. "This is a very exciting development," Dr. Takemura explains, "Being able to accurately, quickly, and non-invasively diagnose different types of submucosal tumors without biopsies, a procedure that requires surgery, is much easier on both the patient and the physicians."

Beating the Heat: Oxidation in Novel Coating Material for Aircraft Gas Turbine Engines

The machine learning technique developed by Dr. Takemura and team could distinguish tumor tissue from healthy tissue in ex vivo images of resected tumors, with 86% accuracy
Photo courtesy: Hiroshi Takemura from Tokyo University of Science

Dr. Takemura acknowledges that there are still challenges ahead, but feels they are prepared to solve them. The researchers identified several areas that would improve on their results, such as making their training dataset much larger, adding information about how deep the tumor is for the machine-learning algorithm, and including other types of tumors in the analysis. Work is also underway to develop an NIR-HSI system that builds on top of existing endoscopy technology.

"We've already built a device that attaches an NIR-HSI camera to the end of an endoscope and hope to perform NIR-HSI analysis directly on a patient soon, instead of just on tissues that had been surgically removed," Dr. Takemura says, "In the future, this will help us separate GISTs from other types of submucosal tumors that could be even more malignant and dangerous. This study is the first step towards much more groundbreaking research in the future, enabled by this interdisciplinary collaboration."

For now, a means of accurately and non-invasively detecting GISTs early on could be clinically available widely, soon!

Authors  : Daiki Sato1, Toshihiro Takamatsu2,3, Masakazu Umezawa4, Yuichi Kitagawa4, Kosuke Maeda5, Naoki Hosokawa4, Kyohei Okubo4,6, Masao Kamimura4,6, Tomohiro Kadota1, Tetsuo Akimoto7,8, Takahiro Kinoshita9, Tomonori Yano1, Takeshi Kuwata10, Hiroaki Ikematsu1,2, Hiroshi Takemura3,5, Hideo Yokota11 & Kohei Soga3,4,6
Title of original paper  : Distinction of surgically resected gastrointestinal stromal tumor by near-infrared hyperspectral imaging
Journal  : Scientific Reports
DOI  : 10.1038/s41598-020-79021-7
Affiliations  : 1Department of Gastroenterology and Endoscopy, National Cancer Center Hospital East, Japan. 2Exploratory Oncology Research & Clinical Trial Center, National Cancer Center, Japan. 3Research Institute for Biomedical Sciences, Tokyo University of Science, Japan. 4Department of Materials Science and Technology, Tokyo University of Science, Japan. 5Department of Mechanical Engineering, Tokyo University of Science, Japan. 6Imaging Frontier Center, Tokyo University of Science, Japan. 7Division of Radiation Oncology, National Cancer Center Hospital East, Japan. 8Course of Advanced Clinical Research of Cancer, Juntendo University Graduate School of Medicine, Japan. 9Department of Gastric Surgery, National Cancer Center Hospital East, Japan. 10Department of Pathology and Clinical Laboratories, National Cancer Center Hospital East, Japan. 11RIKEN Center for Advanced Photonics, Japan.
Further Informationt

Professor Hiroshi Takemura
Department of Mechanical Engineering,
Tokyo University of Science
Email: takemura【@】

Hiroaki Ikematsu, MD, PhD
Department of Gastroenterology and Endoscopy
National Cancer Center Hospital East
Email: hikemats【@】

Team Leader: Hideo Yokota (D.Eng.)
Image Processing Research Team
RIKEN Center for Advanced Photonics
Email: hyokota【@】

Media contact

Tsutomu Shimizu
Public Relations Divisions
Tokyo University of Science
Email: mediaoffice【@】

Office of Public Relations, Strategic Planning Bureau (Kashiwa Campus)
National Cancer Center Japan 
E-mail: ncc-admin【@】

Jens Wilkinson
International Affairs Division
Email: gro-pr【@】

Funding information

This study was partially funded by The National Cancer Center Research and Development Fund.


Contact Us

Public Relations Division, Tokyo University of Science

e-mail: mediaoffice(at sign)


Our site uses cookies to assist us in studying user behavior on the site and in improving the operation of the site. By using this website, you consent to our use of cookies. See our Privacy Policy for details.