Please contact x or y in case of any queries.


All annotations must be your own independent work. Any instance of collusion, sharing or unfair means will result in rejection and bans.
Before submitting the HIT, please make sure to go to the "SUBMIT" tab, and check if there are any warnings.

The general goal in this HIT is to generate a sequence of questions (referred to as a conversation here) from a given domain. Specifically, you start with an entity of your choice (e.g. Christopher Nolan), and think of an interesting question. You can then browse Wikipedia and Wikidata to identify the correct answer(s), which are provided as text and Wikidata links. The next questions in the conversation should be based on the context: information that is clear from the previous questions and answers should be left out, but the intent should be clear to a human (when reading the whole conversation). Please see the video for examples.

Most importantly:
(1) The questions should be of a factoid nature (only hard facts, no opinions, procedures, etc.).
(2) The follow-up questions (questions 2-5) should have an incomplete formulation. This means that information that is clear from the ongoing conversation (context) should not be repeated.
(3) The answer URL should be the Wikidata URL of the answer, and not the URL to a page where the answer can be found! If the answer is a date or some other constant (name, number, currency, ...), the provided answer for the Wikidata URL should be directly this constant (no URL).
(4) You should not stay on one Wikidata or Wikipedia page to build the whole conversation! Try to change entities over the course of the conversation. This is verified automatically, and you might not be able to submit the HIT if you pose all questions on the same entity.

Act as if talking to Alexa, the Google Assistant or Siri and assume that it would understand the context (it is not necessary that they should be able to answer your questions correctly).
The video below describes the general task, guided by examples. You can find additional instructions and details below.

Steps:
(1) Watch video.
(2) Read further instructions below.
(3) Create one conversation for each domain (books, movies, music, soccer, tv series).
(4) Submit task.
Important notes
Entities:
- Actors, Characters, Places, Movies, Books, Songs, Albums, Directors, Footballers, Tournament, ...

Questions:
- Only factoid questions
- Questions with clear, incontestable answers:
- When was Robbie Williams born?
- which Nolan films won an Oscar?
- Non-factoid questions are not allowed:
- Who is Christopher Nolan's favorite actor? (subjective)
- Who will win the next Oscar? (speculative)
- What was the childhood of Tom Cruise like? (passage or descriptive answer)
- Also "why" and "how" questions
 
- Questions should not have more than 3 answers
- Not allowed: Name all films directed by Quentin Tarantino.
 
- Answers of the questions should not change over time
- Not allowed: What is the last movie by Quentin Tarantino?
- Not allowed: How old is Leonardo DiCaprio?
 
- Do not pick questions that are ambiguous:
- Give me the director of King Kong (there are four such movies - 1933, 1976, 2005 and 2017)
- children? (could mean: does he have children?, what are the names of his children, how many children does he have?)
 
- Avoid questions with different kinds of answers
- E.g. When and where?
- 2013 (answer is a year)
- London (answer is a location)
 
- Avoid questions asking for durations
- In which timespan did Miroslav Klose play for the german national team?
 
- Using diverse syntax in the questions is very important

Follow-up questions:
- Key aspect of this study
 
- Should contain incomplete formulations whenever possible
- If something is clear from the context, do not repeat it
 
- Will often have incomplete grammar / sentence fragments
- His birthplace?, When?, director of the movie?, music was by?

Completed questions:
- Completed questions should be self-sufficient, i.e. the intent should be understandable by a human without any context
 
- Therefore, giving more information is preferred
- Which actor plays the role of Mr. Morningstar in the TV series Lucifer?
- This is preferable to: Who plays Morningstar in Lucifer?

Answering:
- You can use Wikipedia or Wikidata for answering, but please submit only the Wikidata URL and plain text answer
- Plain text: Kit Harrington, Wikidata URL: https://www.wikidata.org/wiki/Q357607
- Plain text: Game of Thrones, Wikidata URL: https://www.wikidata.org/wiki/Q23572
 
- If there are multiple answers, separate them with a semicolon (;) for both plain text and Wikidata URL's
- Question: Who performed Something Just Like This?
- Plain text answer: The Chainsmokers;Coldplay
- Wikidata URL answer: https://www.wikidata.org/wiki/Q7721993;https://www.wikidata.org/wiki/Q45188
 
- Answer with Yes/No for existential questions (yes/no questions)
- The 'Answer(s) - Wikidata URL(s)'-field should also be just Yes/No, not a reference!
- Did J. R. R. Tolkien write The Hobbit? -Yes
- Did Atletico Madrid win the Super Cup in 2017? -No
 
- If the answer is a date or a constant:
- Plain text answer and answer URL should be the same! Do not give the page on which you found the answer as Wikidata URL answer.
- Use the following formats (same as in Wikidata)
- Date: dd Month yyyy (e.g. 20 November 2018)
- Year: yyyy (e.g. 2003)
- Height: n centimeter (e.g. 178 centimeter)
- If quantities do not have a unit, just enter the plain number
 
- Do not include unnecessary spaces and punctuations in your answers
- like: dots, spaces, newlines, tabs, ...

Answer source:
- Please provide the source where you found the correct answer
- E.g. you found Kit Harrington in a Wikipedia table as answer for Who played Jon Snow in GOT?
- Select 'Wikipedia - Table' as answer source (even though 'https://www.wikidata.org/wiki/Q357607' is the correct Wikidata answer URL)
 
- The answer might be found via different sources. In that case please still provide only the source which you used.
Suggestions for good conversations
- You should not stay on one wikidata page for a conversation
- Check the examples given in the videos for inspiration
- Hopping to other entities during the conversation is preferable
 
- Please verify the correctness and completeness of your answers before submitting
 
- All questions should have an unambiguous intent
 
- Do not always refer to entities in previous questions/answers with pronouns
- You can also use references as "the author's birthplace?", "when was the movie published?" instead of "his birthplace?" or "when was it published?"
- You can use aliases of entities in follow-up questions:
- Q1: "When was the football club Real Madrid founded?"
- Q2: "and the home ground of Los Blancos?"
 
- Do not ask for a date but give only the year as the answer
- Rather ask for the year, if the exact date is not there
 

Slightly more complex questions are welcome.
Examples for good complex questions (could appear anywhere in the conversation):
- In which movies did Richard Gere and Julia Roberts appear together?
- Longest movie of the series?
- second last book of the series?
- Which Australian singer is married to Josh Homme and lives in Los Angeles?
- How many members did they have in 1970?
- Which has more seasons: Breaking Bad or How I Met your Mother?
- In which city is Harry Kane's 2018 club?
Conversation
Domain

Books
Question 1




Question 2




Question 3




Question 4




Question 5




Conversation
Domain

Movies
Question 1




Question 2




Question 3




Question 4




Question 5




Conversation
Domain

Music
Question 1




Question 2




Question 3




Question 4




Question 5




Conversation
Domain

Soccer
Question 1




Question 2




Question 3




Question 4




Question 5




Conversation
Domain

TV series
Question 1




Question 2




Question 3




Question 4




Question 5




Problems (to be solved before submitting)
 
Empty fields
 
Feedback