HACKER Q&A
📣 PaulHoule

Good Sentiment Analysis Models for Short Social Media Posts?


I've gone looking on Huggingface for sentiment analysis models, I find quite a few that are aimed at product reviews.

I'd like to look at a Twitter or Mastodon timeline or a sequence of headlines submitted to HN and make a time series of someone's mood or, alternately, make something that adds a "do you really want to post that?" dialog if the system things you're coming unhinged.

Something that is in the huggingface ecosystem or easy to get running under pytorch is preferred. Anyone know about a good model?


  👤 extasia Accepted Answer ✓
BERT + LL would do just fine I imagine. There's the IMDB review dataset for sentiment analysis (50k reviews) which I imagine might be a fine dataset for transfer learning on if you can't find anything better.

👤 init
I worked on something like this more than a decade ago back when bayesian classifiers were SOTA for sentiment analysis. It's relatively easy to use an existing model to bootstrap and fine tune a new model. The hardest part is collecting and cleaning up the data for training.