http://streamhacker.com/2008/12/03/part-of-speech-tagging-with-nltk-part-3/#utm_source=feed&utm_medium=feed&utm_campaign=feed Weotta be Hacking Mon, 08 Mar 2010 21:22:02 -0800 http://wordpress.org/?v=2.9.2 hourly 1 http://streamhacker.com/2008/12/03/part-of-speech-tagging-with-nltk-part-3/comment-page-1/#comment-69 Jacob Wed, 16 Sep 2009 22:05:14 +0000 http://streamhacker.wordpress.com/?p=52#comment-69 Cool! What's your topic? My name's Jacob Perkins, and I should probably put it somewhere obvious :) Cool! What’s your topic?
My name’s Jacob Perkins, and I should probably put it somewhere obvious

]]> http://streamhacker.com/2008/12/03/part-of-speech-tagging-with-nltk-part-3/comment-page-1/#comment-68 karen Wed, 16 Sep 2009 20:28:06 +0000 http://streamhacker.wordpress.com/?p=52#comment-68 Hi! i'd like to cite this for my dissertation but i can't find ur name anywhere! Hi! i’d like to cite this for my dissertation but i can’t find ur name anywhere!

]]> http://streamhacker.com/2008/12/03/part-of-speech-tagging-with-nltk-part-3/comment-page-1/#comment-9 Jacob Fri, 20 Mar 2009 17:00:03 +0000 http://streamhacker.wordpress.com/?p=52#comment-9 I have not tested nltk.tag.pos_tag() (I'm pretty sure it wasn't released when I wrote this series). I believe it was trained with most or all of the available corpora, which would definitely make it more accurate. However, it'll only have high accuracy for text that's similar to the corpora it was trained on. If you're tagging text that has a lot of specialty/unique words and phrases, you'll need to create your own training data for the training process in order to get accurate results. I have not tested nltk.tag.pos_tag() (I’m pretty sure it wasn’t released when I wrote this series). I believe it was trained with most or all of the available corpora, which would definitely make it more accurate. However, it’ll only have high accuracy for text that’s similar to the corpora it was trained on. If you’re tagging text that has a lot of specialty/unique words and phrases, you’ll need to create your own training data for the training process in order to get accurate results.

]]> http://streamhacker.com/2008/12/03/part-of-speech-tagging-with-nltk-part-3/comment-page-1/#comment-8 Joe Fri, 20 Mar 2009 16:37:57 +0000 http://streamhacker.wordpress.com/?p=52#comment-8 I played around with Brown/Treebank/conll2000 a little bit. Did you test with nltk.tag.pos_tag()? It loads a pickle to do the tagging. I'm asking because that seemed to perform comparable/better, and was already setup. I played around with Brown/Treebank/conll2000 a little bit. Did you test with nltk.tag.pos_tag()? It loads a pickle to do the tagging. I’m asking because that seemed to perform comparable/better, and was already setup.

]]>