Title:
An Empirical Study of the Effect of Agent Competence on User Performance and Perception
An Empirical Study of the Effect of Agent Competence on User Performance and Perception
| dc.contributor.author | Catrambone, Richard | |
| dc.contributor.author | Stasko, John T. | |
| dc.contributor.author | Xiao, Jun | |
| dc.date.accessioned | 2004-07-27T19:00:08Z | |
| dc.date.available | 2004-07-27T19:00:08Z | |
| dc.date.issued | 2004 | |
| dc.description.abstract | We studied the role of the competence of a user interface agent/assistant that helped users to learn and use a new text editor. Participants in the study made a set of prescribed changes to a document via the editor with the aid of one of four interface agents. Participants could ask questions out loud to the agent and the agent would respond using a synthesized voice; the agent would also make proactive suggestions. The agents varied in the quality of responses and suggestions made. One group of participants were provided with a help screen as well as the agent. We focused on assessing the relation between users' objective performance, interaction style, and subjective experience. Results revealed that the perceived utility of the agent was influenced by the types of errors made by the agent, while participants' subjective impressions of the agent related to the perceptions of its representation. In addition, allowing participants to choose their preferred assistance style(s) (agent vs. online-help) improved objective performance. We correlate quantitative findings with qualitative interview data and discuss implications for the design and the implementation of systems with interface agents. | en |
| dc.format.extent | 325572 bytes | |
| dc.format.mimetype | application/pdf | |
| dc.identifier.uri | http://hdl.handle.net/1853/53 | |
| dc.language.iso | en | |
| dc.publisher | Georgia Institute of Technology | en |
| dc.relation.ispartofseries | GVU Technical Report;GIT-GVU-04-03 | |
| dc.subject | Embodied conversational agents | en |
| dc.subject | Empirical evaluation | en |
| dc.subject | Interface agent | en |
| dc.subject | Quantitative study | en |
| dc.subject | Qualitative study | en |
| dc.title | An Empirical Study of the Effect of Agent Competence on User Performance and Perception | en |
| dc.type | Text | |
| dc.type.genre | Technical Report | |
| dspace.entity.type | Publication | |
| local.contributor.author | Stasko, John T. | |
| local.contributor.author | Catrambone, Richard | |
| local.contributor.corporatename | GVU Center | |
| local.relation.ispartofseries | GVU Technical Report Series | |
| relation.isAuthorOfPublication | 915f1577-d445-49b2-aa51-02218153f559 | |
| relation.isAuthorOfPublication | bbd9920e-1d90-49df-af67-a593c21b1b62 | |
| relation.isOrgUnitOfPublication | d5666874-cf8d-45f6-8017-3781c955500f | |
| relation.isSeriesOfPublication | a13d1649-8f8b-4a59-9dec-d602fa26bc32 |