google cloud storage - gsutil cp error--device or resource busy -
i've got issue gsutil cp.  i'm getting "oserror: [errno 16] device or resource busy" error.  i'm using python 2.7.2.  gsutil output below.  tried changing temp directory , didn't help.
 idea might causing error?  i've tried bunch of times , file gets uploaded in spite of error message, not.
 thanks!  
fri may 16 14:05:50 ~ > gsutil cp hello.txt gs://cg2 copying file://hello.txt [content-type=text/plain]... traceback (most recent call last):   file "/nfs/apps/python/2.7.2/lib/python2.7/multiprocessing/util.py", line 261, in _run_finalizers     finalizer()   file "/nfs/apps/python/2.7.2/lib/python2.7/multiprocessing/util.py", line 200, in __call__     res = self._callback(*self._args, **self._kwargs)   file "/nfs/apps/python/2.7.2/lib/python2.7/shutil.py", line 249, in rmtree     onerror(os.remove, fullname, sys.exc_info())   file "/nfs/apps/python/2.7.2/lib/python2.7/shutil.py", line 247, in rmtree     os.remove(fullname) oserror: [errno 16] device or resource busy: '/ifs/scratch/c2b2/ngs_lab/db2175/temp/pymp-omqdnl/.nfs00000000250c4c2000003c71' traceback (most recent call last):   file "/nfs/apps/python/2.7.2/lib/python2.7/multiprocessing/util.py", line 261, in _run_finalizers     finalizer()   file "/nfs/apps/python/2.7.2/lib/python2.7/multiprocessing/util.py", line 200, in __call__     res = self._callback(*self._args, **self._kwargs)   file "/nfs/apps/python/2.7.2/lib/python2.7/shutil.py", line 249, in rmtree     onerror(os.remove, fullname, sys.exc_info())   file "/nfs/apps/python/2.7.2/lib/python2.7/shutil.py", line 247, in rmtree     os.remove(fullname) oserror: [errno 16] device or resource busy: '/ifs/scratch/c2b2/ngs_lab/db2175/temp/pymp-u61unf/.nfs00000000251f72fd00003c72' 
if @ the gsutil cp command source code, see code paths invoke tempfile.namedtemporaryfile. looks setting of temp/tmpdir/tmp in environment points nfs directory, causes error when temporary directory removed. if change environment tempfiles created on local disk, should stop experiencing issue.
Comments
Post a Comment