Keywords (1)

Academic
Publications
The Design of Puzzle Selection Strategies for ESP-Like GWAP Systems

The Design of Puzzle Selection Strategies for ESP-Like GWAP Systems,10.1109/TCIAIG.2010.2049846,IEEE Transactions on Computational Intelligence and Ai

The Design of Puzzle Selection Strategies for ESP-Like GWAP Systems   (Citations: 2)
BibTex | RIS | RefWorks Download
The “games with a purpose” (GWAP) genre is a type of “human computation” that outsources certain steps of the computational process to humans. Although most GWAP studies focus on the design and analysis of GWAP systems, a systematic and thorough evaluation of existing systems is lacking. We address the issue in this paper. Taking the ESP game as an example, we propose a metric, called system utility, for evaluating the performance of GWAP systems, and use analysis to study the properties of the ESP game. We argue that GWAP systems should be designed and played with strategies. To this end, based on our analysis, we implement an optimal puzzle selection strategy (OPSA) to improve GWAP systems. Using a comprehensive set of simulations, we show that the proposed OPSA approach can improve the system utility of the ESP game significantly. In addition, we implement a quasi ESP game, called ESP Lite, which embeds three puzzle selection algorithms transparently and records the complete game trace for evaluation and further research. During a one-month experiment, we have investigated the inner properties of the three strategies in real-world GWAP systems, and verified that the OPSA scheme achieves the best system utility for the ESP game. The results of this study demonstrate that GWAP systems are more efficient if they are designed and played with strategies.
Journal: IEEE Transactions on Computational Intelligence and Ai in Games , vol. 2, no. 2, pp. 120-130, 2010
Cumulative Annual
View Publication
The following links allow you to view full publications. These links are maintained by other sources not affiliated with Microsoft Academic Search.
    • ...Most existing GWAP-based geo-tagging approaches focus on the design, implementation, and measurement of real word applications, then [11] [12] [13] focus on the performance of GWAP systems which can be improved significantly if they play with strategies...

    Tzu-Chieh Tsaiet al. GWAP Design for a Mobile Geo-Tagging System with Confident Verificatio...

    • ...The problem has been formulated as a scheduling problem, and the Optimal Puzzle Selection Algorithm (OPSA) has been proposed to determine the optimal number of agreements required for all puzzles based on an analytical model [14, 15]...
    • ...In [14, 15], Chen et al. proposed asystem gainmetric for assessing the performance of GWAP systems, and designed the Optimal Puzzle Selection Algorithm (OPSA) based on an analytical model...
    • ...munity [6]. ESP Lite is a‘ quasi’ ESP Game that embeds various puzzle selection algorithms (namely, RPSA, FPSA, and OPSA [15])...
    • ...Finally, using the system gain metric [14, 15], we compare the system gain achieved by the APSA and the OPSA schemes in the simulations...

    Yu-Song Syuet al. Exploiting Puzzle Diversity in Puzzle Selection for ESP-Like GWAP Syst...

Sort by: