Project

General

Profile

Bug #22141

Updated by Peter Amstutz about 1 month ago

Search in the picking dialog is incredibly slow. 

 Specifically, this is "Filter Collections list in Projects" with a project selected.    So it is getting the listing for a specific project.    The project itself has at least 16,000 collections in it. 

 Here's a couple of queries: 

 https://xxxxx.example.com/arvados/v1/groups/xxxxx-j7d0g-gp9u6hjrcgwy40d/contents?limit=200&filters=[[%22uuid%22,%22is_a%22,[%22arvados%23group%22,%22arvados%23collection%22]],[%22collections.any%22,%22ilike%22,%22%25Output%25%22],[%22collections.any%22,%22ilike%22,%22%25from%25%22],[%22collections.any%22,%22ilike%22,%22%25WE%25%22]] 

 https://xxxxx.example.com/arvados/v1/groups/xxxxx-j7d0g-gp9u6hjrcgwy40d/contents?limit=200&filters=[[%22uuid%22,%22is_a%22,[%22arvados%23group%22,%22arvados%23collection%22]],[%22collections.any%22,%22ilike%22,%22%25%25%22],[%22collections.any%22,%22ilike%22,%22%25Output+from+WES%25%22]] 

 These both time out. 

 Here is the basic query 

 https://xngs1.rdcloud.bms.com/arvados/v1/groups/xngs1-j7d0g-gp9u6hjrcgwy40d/contents?limit=200&filters=[[%22uuid%22,%22is_a%22,[%22arvados%23group%22,%22arvados%23collection%22]],[%22collections.properties.type%22,%22not+in%22,[%22intermediate%22,%22log%22]]] 

 h2. Improvements 

 The regular listing excludes logs and intermediates, but when filtering, it stops doing that, which means it is filtering on a much much larger set of collections.    It should continue excluding logs and intermediates. 

 It should be using count=none.    If exactly 200 items are returned, it should add the entry, "there may be more items, try filtering" 

 There should be some kind of indication that it is reloading the list, currently there's no feedback and so when the search takes too long, it feels like nothing is happening at all. 

Back