If the cached build image has an older version of Ruby, Go, etc., remove it when installing the new one, or at least make sure the old version doesn't affect the package. For example, if the cached image has ruby 2.5 and the current version has ruby 2.7, the package shouldn't have the gems installed for ruby 2.5, or any files in the installed ruby dir that were removed between ruby 2.5 and 2.7.