The application scope of Artificial Intelligence (AI) technology in the medical field has significantly expanded, and interventions using AI technology and big data have become capable of delivering high-precision, personalized medical care with greater accuracy and efficiency, overcoming many drawbacks of human performance [1]. Additionally, AI technology offers the significant advantage of supplementing scarce human resources [2] and promoting continuous self- management. These AI qualities are utilized for managing chronic diseases and correcting health behaviors that require ongoing self-management [3]. Moreover, AI has the capacity to consider a wide range of information about an individual, which is essential for perpetual, customized, patient-centered interventions. Importantly, one-size-fits-all approaches are no longer desirable and AI technology serves as an excellent tool for improving various forms of personalized health care interventions [4]. Most individuals struggle to maintain self- care in the absence of external health care interventions [5]. Strategies to assist with forming health behavior habits as part of continuous and effective self-management are warranted. The personalized capabilities of AI may be helpful for improving personalized dental care, especially in supporting effective health habit interventions [6].
Dental plaque, a major cause of the two primary oral diseases, dental caries and periodontal disease, is a community of microorganisms living in the oral cavity, forming a complex ecosystem on the surface of the teeth [7]. The management of dental plaque is important, not only for maintaining personal oral hygiene, but also contributes to the overall health and well-being of an individual. For example, dental plaque can influence the development and progression of heart and metabolic diseases [8,9]. Recent studies have highlighted the interconnection between oral health and overall health, underscoring the importance of managing dental plaque [10]. The coronavirus disease 2019 (COVID-19) pandemic has led to the suspension of community face-to-face oral health programs and education in public facilities such as kindergartens, daycare centers, and schools, with the provision of public oral health care services being partially suspended or limited [11]. As efforts to minimize direct human contact and reduce offline activities continue, the adoption of contactless or automated systems in various fields is increasing [12]. Despite the return to daily life and the normalization of health services in the post-corona era, it is difficult to develop oral health services as actively as before [13]. In this context, digital healthcare in a contactless form can be an important tool, and its significance in the field of oral care is increasingly highlighted [14]. Developing and implementing contactless healthcare services that assess health status and provide information is crucial [15]. This study aimed to develop and assess an image-based AI technology for quantifying dental plaque, thus addressing one of the most significant causes of oral diseases.
In this paper, we designed an AI app service to quantify dental plaque. Figure 1 shows the overall system structure. The proposed app service performs the function of quantifying and locating oral plaque stained with a dental stain (Dentichak, Thomastone Co., Ltd, Republic of Korea) that specifically stains dental plaque within the oral cavity. Dental plaque is detected and analyzed based on tooth images taken with a smartphone. The detected data confirm the location of dental plaque for analysis. Images taken are uploaded to the service app. The entire oral cavity is recognized. Information for each tooth range (e.g., maxilla-left/right, mandible-left/right, quadrant) is delivered to the service backend. The AI models an inference from the independently captured oral images, which is then used to optimize the model inference speed. Meanwhile, the functions related to the dental plaque monitoring service app contribute to the backend processes.
In this study, oral imaging image data for AI learning was collected from May 2022 to October 2023. Continuous collection was conducted according to the collection procedure, and the final data was collected as 5,000 cases (Figure 2).
An AI learning verification process was carried out on the dataset, wherein the existing AI image learning dataset was divided according to the 6:2:2 ratio to create training data. A web-based labeling tool was developed to facilitate usage across various computer environments, and this tool was employed to label dental plaque data extracted from the collected dataset. Both Bounding Box and Polygon areas were designated for marking, and labeling was conducted within the Canvas area using a class designation feature to identify teeth and oral plaque regions. After delineating the areas of interest and classes for the labeling process, adjusting positions, and revising the labels, the AI learning data was compiled through an Export function, thereby assembling the labeled data for training.
The dental biofilm detection AI model was developed through the labeling process for training, verification, and testing of both the tooth recognition (gingival tooth separation) model and the tooth detection (plaque detection) model. For the tooth recognition model, the gingival range for 12 positions on the frontal teeth was delineated. As for the tooth detection model, labeling was performed on both teeth and plaque areas (Figure 3).
YOLOv7 was finally selected as the tooth recognition model after performance verification, and Deeplav3 was finally selected as the tooth detection model, and each model has the most accurate and fastest detection ability through AI model performance verification. We verified the suitability of performance by comparing YOLOv4 and YOLOv7 as tooth detection models, and UNet and Deeplav3 as tooth detection models. We consulted dentists and dental hygienists at dental university hospitals to verify the accuracy of the inference results of teeth and dented plaque ranges using actual images. Verification of the two models was carried out simultaneously. The object naming process for the tooth recognition model was learned by specifying the tooth standards of 12 frontal photos of the mouth and the dental plaque detection model matched individual teeth and plaque areas that were deemed the same. After comparing performance, the optimal learning model was selected and advanced.
4) Evaluation of the AI model and agreement with dental professionals’ annotationsTo validate the clinical relevance, a minimum of 1,000 photographic data were collected using a digital camera (3,216× 2,136 pixels, Canon EOS 60D, Japan), and an additional 100 photographs were taken using the cameras integrated into smart-phones (1,280×960 pixels, iPhone 14 pro [Apple], Gaxlaxy 23 Ultra [Samsung]). Both types of photographs depicted the dental plaque on the tooth surface stained with a plaque disclosing solution (plaque checker), and were analyzed and annotated for dental plaque by both dental professionals and the AI program. The agreement between the evaluations made by the AI model and the markings by professionals was confirmed, and to assess the consistency of manual diagnoses, the same photographs were evaluated by different dental profes-sionals. In another comparison, 100 photographs of primary teeth taken with an intraoral camera (1,280×960 pixels, TPC Ligang, Dongguan, China) were annotated to display the dental plaque areas evaluated by both the AI model and dental professionals. This approach improves diagnostic accuracy for each method based on photographs with lower resolution (fewer pixels) compared to images obtained with digital cameras.
This study described the entire development and machine training process for a dental plaque evaluation system. We provided details of all the steps, from uploading photographs of anterior teeth stained for dental plaque, to generating examination data and labelling data for AI learning, and analyzing dental plaque management through an AI model. The AI learning outcomes, utilizing YOLOv7, predict accuracy without the need for data preprocessing, enabling the analysis of normal and additional dental plaque content. However, it is anticipated that better results could be achieved by acquiring more dental plaque data to enhance the accuracy of the dental plaque AI diagnostic model. While dental plaque examination itself is straightforward in the clinical setting, the evaluation of dental plaque necessitates detailed analysis, consistent guidelines, and continuous follow-up management. Due to limited resources and time constraints in dental clinics, these procedures are often not performed. As a result, despite the necessity for adequate oral hygiene management following dental treatment, the dental professional focus remains solely on treatment provision. Consequently, the subsequent follow-up management is often neglected. The AI model described in this study may assist with simplifying this workflow process in the clinical setting.
In the exploration of modern healthcare paradigms, the integration of Artificial Intelligence (AI) and digital platforms in delivering medical services signifies a pivotal shift towards more personalized and accessible treatment [16]. The model proposed in this study for quantifying and managing dental plaque is evidence of such advancements, showcasing a framework designed to navigate the complexities of healthcare environment while emphasizing the ultra-personalized centrality of individualized dental care and diagnosis [17]. Utilizing the capabilities of on-device AI, this model aims to extend effective dental health services beyond traditional face-to-face consultations to a digital format, enabling patients to receive timely and customized education and advice for managing dental plaque, a critical component in oral health maintenance [18]. The adjunctive use of AI technology in dental plaque evaluation could be likened to AI-assisted medical diagnosis technology. AI technology serves a supplemental role, rather than as a replacement for professional clinical judgements [19].
Despite its promising outlook, this model’s practical application is challenged by the need for robust continuous service management to fully realize its potential. A comprehensive understanding of oral health and its close relationship with systemic diseases is necessary [20]. This technology must also reflect the demands for patient-wide health data, such as MyData for medical diagnosis. Furthermore, this technology must comply with current assessment criteria [21]. Additionally, securing devices for capturing images of plaque on the teeth’s external and lingual surfaces could allow for broader AI learning and judgment capabilities. This technology could be integrated and utilized across various fields, including post-implant care and tartar removal procedures. Developing an agile management system capable of integrating new research findings, updating educational content, and adapting to regulatory changes without interrupting service delivery to the end-user is essential [22].
Another critical aspect is enhancing user experience. The effectiveness of digital health interventions heavily depends on their ability to engage users effectively. In the context of the dental plaque management education program, this entails creating an interactive and user-friendly interface that promotes ongoing engagement and facilitates the easy understanding of complex health information [23]. Personalization features adjusting advice and recommendations based on the user’s specific health data and preferences could significantly enhance the program’s relevance and impact. However, achieving such a level of personalization requires sophisticated algorithms and a deep understanding of user behaviors. The incorporation of human-centered design principles into model development is critical. This technology may also be utilized as a tool to assist in raising individual awareness of of daily oral health status, rather than as a diagnostic tool.
The integration and security of medical data represent another crucial focus area. The personalized nature of the proposed model heavily depends on the accurate and secure handling of sensitive health data [24]. Thus, ensuring the integrity and confidentiality of patient information is paramount. The model must also seamlessly integrate with existing healthcare IT systems to facilitate the efficient exchange and analysis of health data, thereby enhancing continuity of care. Addressing these issues requires a multidisciplinary approach, combining insights from healthcare professionals, AI and machine learning experts, data privacy specialists, and user experience designers. By fostering collaboration across these diverse fields, the model can be refined to meet the high standards of reliability, usability, and security required for successful implementation.
In conclusion, the dental plaque management education program model has the potential to revolutionize how dental care, as well as education and daily dental management, is provided and experienced. By attempting to identify and solve oral hygiene problems confirmed by individuals or professionals, this model can pave the way for a new era of dentistry that is more accessible, personalized, and effective. This model can break the stagnation in oral care, address oral inequality, and ease accessibility, allowing for applications across various fields.
This work was supported by Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. RS-2023- 00232355, Personalized oral care services based on oral care prescription data and dental photos).
The plaque disclosing solution used in this study was provided free of charge by THOMASTONE Company (Cheonan, Republic of Korea) and was utilized as the material for research.