Local Setup for document summarization with LLMs?

I find myself going through lots of documents with long and tedious language and would love to be able to use text summarization to get a sense of what a document is before going deep on it. I don't want to use ChatGPT since the information is sensitive. What local setup do you have for an LLM text summarizer for documents? I've been thinking of making a local app where I can drop off documents and have my llm query them. What have you done?