Project

General

Profile

Actions
Copy link

Bug #7979

closed

Python sdk needs more agressive retries

Added by Sarah Guthrie over 8 years ago. Updated over 4 years ago.

Status:
Closed
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Story points:
-

Description

Pipeline https://workbench.su92l.arvadosapi.com/pipeline_instances/su92l-d1hrv-5izco85vnnq6vt3#Components fails with KeepReadError: failed to read 6c35d441091109f77b5457c40812dbae+26720+Aee4a4920fd4db4112a45df5b58b065d17ea31d4c@5679c987: service http://keep14.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found

nico reports:
keep17.su92l:/home/nico# ls /data/su92l-keep-*/keep/6c3/6c35d441091109f77b5457c40812dbae
/data/su92l-keep-3/keep/6c3/6c35d441091109f77b5457c40812dbae
keep17.su92l:/home/nico# md5sum /data/su92l-keep-*/keep/6c3/6c35d441091109f77b5457c40812dbae
6c35d441091109f77b5457c40812dbae /data/su92l-keep-3/keep/6c3/6c35d441091109f77b5457c40812dbae
keep17.su92l:/home/nico#

But the keepstore never gets it:
grep 6c35d441091109f77b5457c40812dbae /etc/sv/keepstore/log/main/current
1!keep17.su92l:/home/nico#

Which is probably a network glitch or something like that.

Related issues

Related to Arvados - Idea #8539: [SDKs/FUSE] Better retry defaultsResolvedActions
Actions
Copy link

Also available in: Atom PDF