google cloud storage - gsutil cp error--device or resource busy -
i've got issue gsutil cp. i'm getting "oserror: [errno 16] device or resource busy" error. i'm using python 2.7.2. gsutil output below. tried changing temp directory , didn't help.
idea might causing error? i've tried bunch of times , file gets uploaded in spite of error message, not.
thanks!
fri may 16 14:05:50 ~ > gsutil cp hello.txt gs://cg2 copying file://hello.txt [content-type=text/plain]... traceback (most recent call last): file "/nfs/apps/python/2.7.2/lib/python2.7/multiprocessing/util.py", line 261, in _run_finalizers finalizer() file "/nfs/apps/python/2.7.2/lib/python2.7/multiprocessing/util.py", line 200, in __call__ res = self._callback(*self._args, **self._kwargs) file "/nfs/apps/python/2.7.2/lib/python2.7/shutil.py", line 249, in rmtree onerror(os.remove, fullname, sys.exc_info()) file "/nfs/apps/python/2.7.2/lib/python2.7/shutil.py", line 247, in rmtree os.remove(fullname) oserror: [errno 16] device or resource busy: '/ifs/scratch/c2b2/ngs_lab/db2175/temp/pymp-omqdnl/.nfs00000000250c4c2000003c71' traceback (most recent call last): file "/nfs/apps/python/2.7.2/lib/python2.7/multiprocessing/util.py", line 261, in _run_finalizers finalizer() file "/nfs/apps/python/2.7.2/lib/python2.7/multiprocessing/util.py", line 200, in __call__ res = self._callback(*self._args, **self._kwargs) file "/nfs/apps/python/2.7.2/lib/python2.7/shutil.py", line 249, in rmtree onerror(os.remove, fullname, sys.exc_info()) file "/nfs/apps/python/2.7.2/lib/python2.7/shutil.py", line 247, in rmtree os.remove(fullname) oserror: [errno 16] device or resource busy: '/ifs/scratch/c2b2/ngs_lab/db2175/temp/pymp-u61unf/.nfs00000000251f72fd00003c72'
if @ the gsutil cp command source code, see code paths invoke tempfile.namedtemporaryfile. looks setting of temp/tmpdir/tmp in environment points nfs directory, causes error when temporary directory removed. if change environment tempfiles created on local disk, should stop experiencing issue.
Comments
Post a Comment