Please use this identifier to cite or link to this item:
https://sc1ence.europeia.pt/handle/20.500.12275/392
Title: | Sketch-Based Interaction for Planning-Based Interactive Storytelling | Authors: | Ana Araújo Barros Viseu Edirlei Everson Soares de Lima |
Keywords: | Automated planning; Interactive narratives; Interactive storytelling; Sketch recognition; Sketch-based interaction | Issue Date: | Nov-2020 | Publisher: | IEEE Computer Society | Source: | de Lima, E. S., Gheno, F. J., & Viseu, A. (2020, November). Sketch-Based Interaction for Planning-Based Interactive Storytelling. In 2020 19th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames) (pp. 154-162). IEEE. | Journal: | Brazilian Symposium on Games and Digital Entertainment, SBGAMES | Conference: | 19th Brazilian Symposium on Computer Games and Digital Entertainment, SBGames 2020; Virtual, Recife; Brazil; 7 November 2020 through 10 November 2020 | Abstract: | Drawings have been used for thousands of years as a visual complement to oral and written storytelling. The evolution of technology and the advent of interactive narratives brings the possibility of exploring drawings and storytelling in new ways. This paper presents a new sketch-based interaction method for planning-based interactive storytelling systems, which uses a deep learning model based on a Convolutional Neural Network to recognize digital hand-drawn sketches. By combining real time sketch recognition with a planning-based plot generation algorithm, the proposed system allows users to interact with narratives by sketching objects on smartphones or tablet computers, which are then recognized by the system and converted into virtual objects in the story world, thereby affecting the plot of the narrative. Preliminary results show that the sketch recognition model has a remarkable accuracy for small sets of sketch classes (accuracy of 95.1% for 14 classes), which are sufficient to provide a good variety of interaction options. In addition, it can also be extended to more complex scenarios while maintaining a considerable accuracy (87.4% for 172 classes and 71.6% for 345 classes). | URI: | https://sc1ence.europeia.pt/handle/20.500.12275/392 | DOI: | 10.1109/SBGames51465.2020.00029 |
Appears in Collections: | IADE |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Sketch-Based Interaction for Planning-Based Interactive Storytelling.pdf | 705.65 kB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.