Ask HN: Stemmers in ruby, any good? or should I just go ahead and write my own?
The most popular option seems to be https://github.com/aurelian/ruby-stemmer. But its kinda outdated and gives poor-ish results.
"why" becomes "whi", "people" becomes "peopl" and a lot lot many incorrect ones.
Something like Solr's reduction to stems is what I was hoping for to be able to use it in my project.
Thinking of going for a full port of Porter's stemming. Thoughts?
2 comments
[ 3.2 ms ] story [ 9.8 ms ] threadDid you try the uea-stemmer? Also pretty old: https://github.com/ealdent/uea-stemmer
Also, there's the treat gem, which is an all-in-one package...it uses both the stemmer you mentioned and the uea one...so maybe that's it for Rubyists.
https://github.com/louismullie/treat
Not a Ruby guy so no idea if its any good, but it is the implementation linked from here http://tartarus.org/~martin/PorterStemmer/