GET-Evidence

Sub-tasks:

• This should be accompanied by a report which shows the number of variants seen in only one genome and sorted by autoscore (a column in the report).

• The dump should have a column for "relevance" which can have the following values:

Relevant (at least 1 user identified a relevant web-hit)
Not-Relevant (at least 1 user identified every web-hit as not relevant)
Not-Reviewed

The report should be a list of variants only in one genome, sorted according to autoscore and randomized within each autoscore.

IE, in order:
[randomized list of variants in only one genome with autoscore = 6]
followed by
[randomized list of variants in only one genome with autoscore = 5]
...
etc.

It would be nice if we also had a column summarizing the evaluated web hits so far (ie, someone has evaluated this as having N valid hits and M nonvalid hits). It should not report the raw number of web hits. (I don't want this to bias our behavior in going through these evaluations for the purpose of the paper, someday we may wish to add it of course.)

The voting system is in place, so you can vote relevant / not relevant for each web hit.

The current decision (if any) for each web hit is shown on the left side of the link.

If you're logged in, you can vote by clicking the "thumbs up" or "thumbs down" icons on the right side of the link.

UI fixes todo:

• Indicate what your current vote is for each link (perhaps by highlighting the icon that represents your existing vote)
• Improve icons (suggestions other than fixing the anti-alias/resize ugliness?)
• Tool-tips to indicate what the voting icons do

First stab at a report: http://evidence.personalgenomes.org/report?type=need-web-review

Also, the latest-flat dump has a "webscore" column:

• "Y" if at least one web hit has been voted "relevant" by a majority or a tie; or
• "-" if some web hits have not been voted on yet; or
• "N" otherwise (i.e. all web hits are voted "not relevant", or there are no web hits)

This is great! Can you increase the number of pages displayed at:

• http://evidence.personalgenomes.org/report?type=need-web-review
  We need to page through all such variants with "autoscore >= 2"

Replying to [comment:10 https://www.google.com/accounts/o8/id?id=AItOawk3Kp1W2TZ9rVrm-L11IDlFY9UvU5ReVXw]:

This is great! Can you increase the number of pages displayed at:

• http://evidence.personalgenomes.org/report?type=need-web-review
  We need to page through all such variants with "autoscore >= 2"

(Fixed the other day but forgot to update ticket, oops.)

This report now shows 1200 hits. The first 846 hits have autoscore >= 2.