KIARA - AI-based recording of work processes in the operating theatre for the automated creation of the surgery report

After a surgery, the attending doctor writes a surgery report. This can be very time-consuming and takes up a lot of working time. Doctors do not have this time to treat patients. The KIARA project therefore aims to develop a system that automatically generates surgery reports. It records the activities in the surgical field via cameras that are integrated into the surgical lamps. The image data is analysed using AI to recognise and log objects, people and all their surgical activities. These are automatically delivered to the surgery report software. With the additional data, the surgery report can also be supplemented with helpful information, e.g., by integrating images or statistics. The system is designed to constantly learn through human feedback and to simplify clinical processes for the benefit of medical staff by automating the creation of a surgery report.

HFC will accompany the user-centred design process in the project, especially in the areas of user research, analysis and evaluation. In addition, we are responsible for the processing of the ELSI questions and the design of the interaction between the medical staff and the KIARA system - before, during and after the operation. We will implement suitable methods of participative development and develop a process model for taking human-centred aspects into account in the use of AI.

The project duration is from 08/2022 to 08/2025 and is funded by the German Federal Ministry of Education and Research within the framework of the call "AI-based assistance systems for process-accompanying health applications".

Further information in German can be found on the project's own website projekt-kiara.de or in the project outline from the BMBF.