Answer Evaluation

Answer

Searching sources

Answer Evaluation

After the answer

Task workload

Required

Rate how it felt to assess the answer you just saw. Touch every slider to give your rating.

Mental demand How mentally demanding was the task? Physical demand How physically demanding was the task? Temporal demand How hurried or rushed was the pace? Performance How successful did you feel in making your judgement? Effort How hard did you have to work to make your judgement? Frustration How irritated, stressed, or annoyed did you feel?

Answer Evaluation

Final questions

Background questions

Required unless marked optional

Answer a few final background questions about your experience with sources and answer assistants.

Using sources

How familiar are you with interpreting citations and checking whether sources support claims?

Source-checking question

Which statement best describes when a citation supports an answer?

The title sounds relevant. The shown evidence actually supports the answer claim. There are several citations. I cannot tell.

Source-checking question

If the shown source information does not support the answer, what should usually happen to your credibility judgement?

I should still trust the answer. I should lower the answer's credibility. I should ignore the evidence. I cannot tell.

AI answer assistant familiarity

How often do you use AI-based search, question answering, or citation-enabled assistants?

Source-based answer assistants

How familiar are you with answer assistants that use retrieved web or document sources?

Research assistant familiarity

Which of these research or answer assistants are you familiar with? Select all that apply.

Other optional

General trust propensity

I generally trust automated systems to provide reliable information.

General trust propensity

I generally trust online information when it appears to come from named sources.

General trust propensity

I usually verify online information before relying on it.

Optional comments

Assess the answer

Topic familiarity

How trustworthy is this answer?

Task workload

Background questions

Finished