GET-Evidence

On Mon, Feb 04, 2013 at 12:11:23PM -0500, Madeleine Ball wrote:

The problem isn't present when I log in using Google OpenID rather than
www.madprime.org.

The problem is present when I log in using www.madprime.org in an incognito
window.

That's a red herring, I think. Unless your Google OpenID is not an admin
user?

The problem had to do with slow name resolving on the Keep nodes. I fixed
that.

I saw the timeouts as an admin, but not as an ordinary user.

Get-Evidence apparently does some really expensive lookups on the genomes
page when logged in as an admin - it seems to iterate over every item in the
/home/trait/upload folder (currently 1300+). That is a design bug.

It also requests the job output from Keep if the records on its disk for an
upload do not entirely line up.

It does that check on every request for the genomes page (this is a design
bug, these kinds of checks should be done out of band), and is not able to
resolve the inconsistency (this is an ordinary bug). So... it keeps retrying
to fix those datasets by checking in with Keep. On every load of the genomes
page. There are 340 uploads in this situation. You can imagine that makes
things slow.

I've temporarily disabled the check that is broken, and the genomes page now
loads in about 25 seconds. Still pretty terrible, but better than before.