Story #11558

[FUSE] Integration test using real programs with complex write patterns.

Added by Peter Amstutz over 2 years ago. Updated almost 2 years ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
Arvados Future Sprints
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

Test programs known to have trouble with writable fuse in the past:
  • aws s3 downloader
  • azure blobxfer
  • aspera downloader
  • bcl2fastq
  • 'STAR', 
    '--runMode', 'genomeGenerate',
    '--genomeDir', outdir.path,  
    '--runThreadN',str(ncores),
    '--genomeFastaFiles', genome_fasta_file,
    '--sjdbOverhang', str(sjdbOverhang),
    '--sjdbGTFfile', gtf

Also file system benchmarking tools, e.g. fio or iozone
https://github.com/axboe/fio

Benchmarking tools would have the added benefit of tracking performance and identifying regressions.

History

#1 Updated by Peter Amstutz over 2 years ago

  • Description updated (diff)

#2 Updated by Peter Amstutz over 2 years ago

  • Description updated (diff)

#3 Updated by Tom Morris over 2 years ago

  • Description updated (diff)

#4 Updated by Tom Morris almost 2 years ago

  • Target version set to Arvados Future Sprints

Also available in: Atom PDF