6 ms·
To expand slightly on the above: I'm using BeautifulSoup to parse out the text fragments in the html doc. Then, for each fragment, a set of features are extrac
by callorico 16y ago
To expand slightly on the above: I'm using BeautifulSoup to parse out the text fragments in the html doc. Then, for each fragment, a set of features are extracted. This is really the secret sauce part of things. The features are looking at things like, how many words are in the text fragment (ingredients tend to be fairly short). The features are fed into a classifier (I'm using the NLTK library for this) which outputs a yes/no label on whether or not this is an ingredient.
Let me know if you've got any NLP or machine learning experience. I'd love to bounce some ideas off of you.
- bryanh 16y agoThanks for the info, I have little NLP experience but have been diving into machine learning and simple neural nets. What are your thoughts on NLTK? I've yet to use it.