A user-centred evaluation framework for the Sealife semantic web browsers
Résumé
Background
Semantically-enriched browsing has enhanced the browsing experience by providing contextualised dynamically generated Web content, and quicker access to searched-for information. However, adoption of Semantic Web technologies is limited and user perception from the non-IT domain sceptical. Furthermore, little attention has been given to evaluating semantic browsers with real users to demonstrate the enhancements and obtain valuable feedback. The Sealife project investigates semantic browsing and its application to the life science domain. Sealife's main objective is to develop the notion of context-based information integration by extending three existing Semantic Web browsers (SWBs) to link the existing Web to the eScience infrastructure.
Methods
This paper describes a user-centred evaluation framework that was developed to evaluate the Sealife SWBs that elicited feedback on users' perceptions on ease of use and information findability. Three sources of data: i) web server logs; ii) user questionnaires; and iii) semi-structured interviews were analysed and comparisons made between each browser and a control system.
Results
It was found that the evaluation framework used successfully elicited users' perceptions of the three distinct SWBs. The results indicate that the browser with the most mature and polished interface was rated higher for usability, and semantic links were used by the users of all three browsers.
Conclusion
Confirmation or contradiction of our original hypotheses with relation to SWBs is detailed along with observations of implementation issues.
Semantically-enriched browsing has enhanced the browsing experience by providing contextualised dynamically generated Web content, and quicker access to searched-for information. However, adoption of Semantic Web technologies is limited and user perception from the non-IT domain sceptical. Furthermore, little attention has been given to evaluating semantic browsers with real users to demonstrate the enhancements and obtain valuable feedback. The Sealife project investigates semantic browsing and its application to the life science domain. Sealife's main objective is to develop the notion of context-based information integration by extending three existing Semantic Web browsers (SWBs) to link the existing Web to the eScience infrastructure.
Methods
This paper describes a user-centred evaluation framework that was developed to evaluate the Sealife SWBs that elicited feedback on users' perceptions on ease of use and information findability. Three sources of data: i) web server logs; ii) user questionnaires; and iii) semi-structured interviews were analysed and comparisons made between each browser and a control system.
Results
It was found that the evaluation framework used successfully elicited users' perceptions of the three distinct SWBs. The results indicate that the browser with the most mature and polished interface was rated higher for usability, and semantic links were used by the users of all three browsers.
Conclusion
Confirmation or contradiction of our original hypotheses with relation to SWBs is detailed along with observations of implementation issues.
Fichier principal
1471-2105-10-S10-S14.pdf (1.15 Mo)
Télécharger le fichier
1471-2105-10-S10-S14-S1.TXT (15.48 Ko)
Télécharger le fichier
1471-2105-10-S10-S14-S2.TXT (12.17 Ko)
Télécharger le fichier
1471-2105-10-S10-S14-S3.TXT (403 B)
Télécharger le fichier
1471-2105-10-S10-S14-S4.TXT (15.41 Ko)
Télécharger le fichier
1471-2105-10-S10-S14-S5.TXT (10.46 Ko)
Télécharger le fichier
1471-2105-10-S10-S14.xml (111.63 Ko)
Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Format : Autre
Format : Autre
Format : Autre
Format : Autre
Format : Autre
Format : Autre
Loading...