Best local LLM to summarize web pages?
Is there an local LLM which can summarize long web pages, even if it requires handing it over the actual text instead of whole web page? I know there is LLama-7B which can run locally (8GB VRAM) but I haven't heard anything nice about it for practical uses like this.
In my experience it really depends on the nature of the websites due to the datasets they were trained on. A popular training dataset for summarization models is e.g. news articles, so while they can work well on other news sites, they might not work well on a SDK's docs page and so on.