Introduction: Bladder cancer (BC) is a major health concern that poses a significant threat to the population, with an increasing incidence rate and a high risk of recurrence and progression. The primary clinical method for diagnosing BC is cystoscopy, but due to the limitations of traditional white light cystoscopy and inadequate clinical experience among junior physicians, its detection rate for bladder tumor, especially small and flat lesions, is relatively low. However, recent years have seen remarkable advancements in the application of artificial intelligence (AI) technology in the field of medicine. This has led to the development of numerous AI algorithms that have been successfully integrated into medical practices, providing valuable assistance to clinicians. The purpose of this study is to develop a cystoscopy algorithm that is real time, cost effective, high performing, and accurate, with the aim of enhancing the detection rate of bladder tumors during cystoscopy. Materials and Methods: For this study, a dataset of 3,500 cystoscopic images obtained from 100 patients diagnosed with BC was collected, and a deep learning model was developed utilizing the U-Net algorithm within a convolutional neural network for training purposes. Results: This study randomly divided 3,500 images from 100 BC patients into training and validation groups, and each patient’s pathology result was confirmed. In the validation group, the accuracy of tumor recognition by the U-Net algorithm reached 98% compared to primary urologists, with greater accuracy and faster detection speed. Conclusion: This study highlights the potential of U-Net-based deep learning techniques in the detection of bladder tumors. The establishment and optimization of the U-Net model is a significant breakthrough and it provides a valuable reference for future research in the field of medical image processing.

1.
Lobo
N
,
Afferi
L
,
Moschini
M
,
Mostafid
H
,
Porten
S
,
Psutka
SP
et al
.
Epidemiology, screening, and prevention of bladder cancer
.
Eur Urol Oncol
.
2022
;
5
(
6
):
628
39
.
2.
Soria
F
,
Gurioli
A
,
Peraldo
F
,
Oderda
M
,
Giona
S
,
Ambrosini
E
et al
.
Innovations in the endoscopic management of bladder cancer: is the era of white light cystoscopy over
.
Urologia
.
2013
80 Spec No 1
1
8
.
3.
Santoni
G
,
Morelli
MB
,
Amantini
C
,
Battelli
N
.
Urinary markers in bladder cancer: an update
.
Front Oncol
.
2018
;
8
:
362
.
4.
Fradet
Y
,
Grossman
HB
,
Gomella
L
,
Lerner
S
,
Cookson
M
,
Albala
D
et al
.
A comparison of hexaminolevulinate fluorescence cystoscopy and white light cystoscopy for the detection of carcinoma in situ in patients with bladder cancer: a phase III, multicenter study
.
J Urol
.
2007
;
178
(
1
):
68
73
; discussion 73.
5.
Burger
M
,
Catto
JW
,
Dalbagni
G
,
Grossman
HB
,
Herr
H
,
Karakiewicz
P
et al
.
Epidemiology and risk factors of urothelial bladder cancer
.
Eur Urol
.
2013
;
63
(
2
):
234
41
.
6.
van den Bosch
S
,
Alfred Witjes
J
.
Long-term cancer-specific survival in patients with high-risk, non-muscle-invasive bladder cancer and tumour progression: a systematic review
.
Eur Urol
.
2011
;
60
(
3
):
493
500
.
7.
Bryan
RT
,
Billingham
LJ
,
Wallace
DM
.
Narrow-band imaging flexible cystoscopy in the detection of recurrent urothelial cancer of the bladder
.
BJU Int
.
2008
;
101
(
6
):
702
5
; discussion 705-6.
8.
Daneshmand
S
,
Patel
S
,
Lotan
Y
,
Pohar
K
,
Trabulsi
E
,
Woods
M
et al
.
Efficacy and safety of blue light flexible cystoscopy with hexaminolevulinate in the surveillance of bladder cancer: a phase III, comparative, multicenter study
.
J Urol
.
2018
;
199
(
5
):
1158
65
.
9.
East
JE
,
Suzuki
N
,
von Herbay
A
,
Saunders
BP
.
Narrow band imaging with magnification for dysplasia detection and pit pattern assessment in ulcerative colitis surveillance: a case with multiple dysplasia associated lesions or masses
.
Gut
.
2006
;
55
(
10
):
1432
5
.
10.
Jichlinski
P
,
Guillou
L
,
Karlsen
SJ
,
Malmström
PU
,
Jocham
D
,
Brennhovd
B
et al
.
Hexyl aminolevulinate fluorescence cystoscopy: new diagnostic tool for photodiagnosis of superficial bladder cancer: a multicenter study
.
J Urol
.
2003
;
170
(
1
):
226
9
.
11.
Nakayoshi
T
,
Tajiri
H
,
Matsuda
K
,
Kaise
M
,
Ikegami
M
,
Sasaki
H
.
Magnifying endoscopy combined with narrow band imaging system for early gastric cancer: correlation of vascular pattern with histopathology (including video)
.
Endoscopy
.
2004
;
36
(
12
):
1080
4
.
12.
Yoshida
T
,
Inoue
H
,
Usui
S
,
Satodate
H
,
Fukami
N
,
Kudo
SE
.
Narrow-band imaging system with magnifying endoscopy for superficial esophageal lesions
.
Gastrointest Endosc
.
2004
;
59
(
2
):
288
95
.
13.
Krithika Alias AnbuDevi
M
,
Suganthi
K
.
Review of semantic segmentation of medical images using modified architectures of UNET
.
Diagnostics
.
2022
;
12
(
12
):
3064
.
14.
Sun
J
,
Tárnok
A
,
Su
X
.
Deep learning-based single-cell optical image studies
.
Cytometry A
.
2020
;
97
(
3
):
226
40
.
15.
Yoon
HJ
,
Kim
JH
.
Lesion-based convolutional neural network in diagnosis of early gastric cancer
.
Clin Endosc
.
2020
;
53
(
2
):
127
31
.
16.
Cheng
J
,
Zou
Q
,
Zhao
Y
.
ECG signal classification based on deep CNN and BiLSTM
.
BMC Med Inform Decis Mak
.
2021
;
21
(
1
):
365
.
17.
Paladini
E
,
Vantaggiato
E
,
Bougourzi
F
,
Distante
C
,
Hadid
A
,
Taleb-Ahmed
A
.
Two ensemble-CNN approaches for colorectal cancer tissue type classification
.
J Imaging
.
2021
;
7
(
3
):
51
.
18.
Mantica
G
,
Terrone
C
.
Re: eugene Shkolyar, Xiao Jia, Timothy C. Chang, et al. Augmented Bladder Tumor Detection Using Deep Learning. Eur Urol 2019;76:714-8
.
Eur Urol
.
2020
;
77
(
5
):
e133
.
19.
Ronneberger
O
,
Fischer
P
,
Brox
T
.
U-net: convolutional networks for biomedical image segmentation
. In:
Navab
N
,
Hornegger
J
,
Wells
W
,
Frangi
A
, editors. Proceedings of the medical image computing and computer-assisted intervention – MICCIO 2015;
2015
.
20.
Norman
B
,
Pedoia
V
,
Majumdar
S
.
Use of 2D U-net convolutional neural networks for automated cartilage and meniscus segmentation of knee MR imaging data to determine relaxometry and morphometry
.
Radiology
.
2018
;
288
(
1
):
177
85
.
21.
Yu
J
,
Cai
L
,
Chen
C
,
Fu
X
,
Wang
L
,
Yuan
B
et al
.
Cascade path augmentation unet for bladder cancer segmentation in MRI
.
Med Phys
.
2022
;
49
(
7
):
4622
31
.
22.
Ge
R
,
Cai
H
,
Yuan
X
,
Qin
F
,
Huang
Y
,
Wang
P
et al
.
MD-UNET: multi-input dilated U-shape neural network for segmentation of bladder cancer
.
Comput Biol Chem
.
2021
;
93
:
107510
.
23.
Yang
R
,
Du
Y
,
Weng
X
,
Chen
Z
,
Wang
S
,
Liu
X
.
Automatic recognition of bladder tumours using deep learning technology and its clinical application
.
Int J Med Robot
.
2021
;
17
(
2
):
e2194
.
24.
Shkolyar
E
,
Jia
X
,
Chang
TC
,
Trivedi
D
,
Mach
KE
,
Meng
MQ
et al
.
Augmented bladder tumor detection using deep learning
.
Eur Urol
.
2019
;
76
(
6
):
714
8
.
25.
Chan
EO
,
Pradere
B
,
Teoh
JY
European Association of Urology – Young Academic Urologists EAU-YAU Urothelial Carcinoma Working Group
.
The use of artificial intelligence for the diagnosis of bladder cancer: a review and perspectives
.
Curr Opin Urol
.
2021
;
31
(
4
):
397
403
.
26.
Ikeda
A
,
Nosato
H
.
Overview of current applications and trends in artificial intelligence for cystoscopy and transurethral resection of bladder tumours
.
Curr Opin Urol
.
2024
;
34
(
1
):
27
31
.
27.
Ali
N
,
Bolenz
C
,
Todenhöfer
T
,
Stenzel
A
,
Deetmar
P
,
Kriegmair
M
et al
.
Deep learning-based classification of blue light cystoscopy imaging during transurethral resection of bladder tumors
.
Sci Rep
.
2021
;
11
(
1
):
11629
.
28.
Jia
X
,
Shkolyar
E
,
Laurie
MA
,
Eminaga
O
,
Liao
JC
,
Xing
L
.
Tumor detection under cystoscopy with transformer-augmented deep learning algorithm
.
Phys Med Biol
.
2023
;
68
(
16
):
165013
.
29.
Barrios
W
,
Abdollahi
B
,
Goyal
M
,
Song
Q
,
Suriawinata
M
,
Richards
R
et al
.
Bladder cancer prognosis using deep neural networks and histopathology images
.
J Pathol Inform
.
2022
;
13
:
100135
.
30.
Chang
TC
,
Shkolyar
E
,
Del Giudice
F
,
Eminaga
O
,
Lee
T
,
Laurie
M
et al
.
Real-time detection of bladder cancer using augmented cystoscopy with deep learning: a pilot study
.
J Endourol
.
2023
.
31.
Mutaguchi
J
,
Morooka
K
,
Kobayashi
S
,
Umehara
A
,
Miyauchi
S
,
Kinoshita
F
et al
.
Artificial intelligence for segmentation of bladder tumor cystoscopic images performed by U-net with dilated convolution
.
J Endourol
.
2022
;
36
(
6
):
827
34
.
You do not currently have access to this content.