slight comment updates
@@ -25,11 +25,11 @@ Submission guidelines will be released soon
## Remarks on dataset versions
-The several versions of the dataset can be accessed with `convai2:none`, `convai2:self`, and `convai2:self_revised`.
+The several versions of the dataset can be accessed with `convai2:self`, `convai2:self_revised` and `convai2:none`.
-These correspond to "no persona", "original self persona", and "revised self persona" in the original [PersonaChat](https://arxiv.org/pdf/1801.07243.pdf) paper.
+These correspond to "original self persona", "revised self persona" and "no persona" in the original [PersonaChat](https://arxiv.org/pdf/1801.07243.pdf) paper.
However, in contrast to that dataset, we have modified the preprocessing, merged the valid and test set, and are generating a new hidden test set. We have also added training examples from the perspective of both speakers and additional candidates to support training / evaluating using a ranking loss.
-You can use the `none` mode to contrast your model's ability to take advantage of its persona with `self`, but `self` is the default setting for the task.
+You can use the `none` mode to contrast your model's ability to take advantage of its persona with `self`, but `self` is the default setting for the task, and you will be evaluate on 'self' and 'self_revised'.
You can see examples of models prepared for the original (non-competition) PersonaChat task [here](https://github.com/facebookresearch/ParlAI/tree/master/projects/personachat), which should generally transfer pretty easily to this task. However, we will continue to add baseline models to this project folder as we run experiments.
