Experimental Study on Entendre Semantic Feedback

An experimental study was conducted to examine the users' reaction to semantic feedback while editing ontologies using ROO.

• Study materials. This includes a development version of ROO with integrated semantic feedback, the POI-BuildingsAndPlaces ontology and a user script for the evaluation. This file contains all that is required to replicate the study (note that below, we provide an enhanced version of ROO that generates feedback messages that are more complete than those used during the study).


• Gathered Data and Analysis contains the data, as well as the analysis of the data in excel spreadsheets.


• ROO with generated Rabbit feedback. This version of ROO improves on the version used during the Entendre evaluation by providing the feedback sentences in the tool itself (during the evaluation, these sentences were provided as 'additional feedback' on a sheet of paper).
  If you want to replicate the experiment, we suggest to use this version instead of the one provided in the study materials.
  Note that this version of ROO is still in heavy development and should not be used in production(it contains several bugs that have to be fixed before we release a stable version).

Demo of the Semantic Feedback

The following video shows the semantic feedback based on a few sentences that were used during the evaluation. The sentences and the ontology are about points of interest in Leeds.

ROO - Intuitive Ontology Engineering Tool with Semantic Feedback from Dhaval Thakker on Vimeo.