python - How do I test whether an nltk resource is already installed on the machine running my code? -


i started first nltk project , confused proper setup. need several resources punkt tokenizer , maxent pos tagger. myself downloaded them using gui nltk.download(). collaborators of course want things downloaded automatically. haven't found idiomatic code in docu.

am supposed put nltk.data.load('tokenizers/punkt/english.pickle') , code? going download resources every time script run? provide feedback user (i.e. co-developers) of being downloaded , why taking long? there must gear out there job, right? :)

//edit explify question:
how test whether nltk resource (like punkt tokenizer) installed on machine running code, , install if not?

you can use nltk.data.find() function, see https://github.com/nltk/nltk/blob/develop/nltk/data.py:

>>> import nltk >>> nltk.data.find('tokenizers/punkt.zip') zipfilepathpointer(u'/home/alvas/nltk_data/tokenizers/punkt.zip', u'')

when resource not available you'll find error:

traceback (most recent call last):   file "<stdin>", line 1, in <module>   file "/usr/local/lib/python2.7/dist-packages/nltk-3.0a3-py2.7.egg/nltk/data.py", line 615, in find     raise lookuperror(resource_not_found) lookuperror:  **********************************************************************   resource u'punkt.zip' not found.  please use nltk downloader   obtain resource:  >>> nltk.download()   searched in:     - '/home/alvas/nltk_data'     - '/usr/share/nltk_data'     - '/usr/local/share/nltk_data'     - '/usr/lib/nltk_data'     - '/usr/local/lib/nltk_data' **********************************************************************

most probably, ensure collaborators have package:

>>> try: ...     nltk.data.find('tokenizers/punkt') ... except lookuperror: ...     nltk.download('punkt') ...  [nltk_data] downloading package punkt /home/alvas/nltk_data... [nltk_data]   package punkt up-to-date! true

-

Comments

Post a Comment

Popular posts from this blog

how to proxy from https to http with lighttpd -

i have internal site (192.168.2.1) accessible http on different server run public web-server using lighttpd. can make internal site accessible outside work follows $http["host"] == "internal.example.com" { ... proxy.server = ( "" => ( "internal" => ( "host" => "192.168.2.1", "port" => 8000 ) ) } this works, use https outside world. question is, how can proxy going https http ? i've tried this: $server["socket"] == ":443" { $http["host"] == "internal.example.com" { ... proxy.server = ( "" => ( "internal" => ( "host" => "http://192.168.2.1", "port" => 8000 ) ) } } but doesn't seem wor...
Read more

android - Automated my builds -

i have multiple app , android project want automated in build , release sequence. have ant script build , create apk of app. want have 1 script or ant file start build sequence app. maybe don't konw search, can't find easy documentation on ant. the point of use jenkins ant (or maven, i'm not sure of difference between them now) automated build sequence when people commit on project. any int appreciated maven dependencies (over ant) don't need pass around jars. recommend maven on ant day. syntax , overall process easier understand, @ end of both build tools. if able to, more recommend upgrading gradle. easy create different build types , create them ./gradlew assemble here project jake wharton can see power of gradle. there release , debug build, can make lot more if like. https://github.com/jakewharton/u2020 here android docs gradle http://tools.android.com/tech-docs/new-build-system/user-guide . if can't find looking here, check out main grad...
Read more

python - Flask migration error -

i've got application build on flask , wanted create new migration today. when run $python manage.py db upgrade i got message raise util.commanderror('only single head supported. ' alembic.util.commanderror: single head supported. script directory has multiple heads (due branching), must resolved manually editing revision files form linear sequence. run alembic branches see divergence(s). so run command $alembic branches no config file 'alembic.ini' found, or file has no '[alembic]' section any clue on about? the error messages coming alembic, use command form alembic <command> , integrating flask coming flask-migrate, need use form python manage.py db branches . to resolve multiple branches, make 1 of branches point down other branch upgrade graph straight line. see alembic's docs on branches: http://alembic.readthedocs.org/en/latest/branches.html
Read more