Fortunately, most documents are sent to me digitally, where I can easily file them on my computer and back them up.
For non-digital documents like auto lease paperwork, home-related legal documents, major bills that I want to keep around, etc, my filing system is incredibly poor. By 'poor', I mean: it takes far too long to find the document I'm looking for, it's difficult to decide where to file something, and it's too difficult to find things.
Every few years, we take a stab at reorganizing our files, but the lack of searchability and the other affordances of digital documents leaves me wanting more.
How do you organize your personal documents? Do you digitze them somehow? Do you have a great filing system? I want to know.
If I need to get an invoice from last december, I just lookup around this date in my stack.
Time spent to store information : 0 ; time spent to find something : a few minutes, once every other month.
Every five years, I take the bottom of the stack and file it in the cellar. And I come back from the cellar with 10 year old documents I can either trash (in my office secured bin) or keep in my filing box.
I also keep contracts (insurance, bank, ...) in this filing box.
Last thing : All documents that will be used for my tax returns (at least the equivalent of it in France) go in one folder. I will use it once a year then file this in the "taxes" box.
I have a Samba share that I added as a destination on my network scanner. I then tag them, add a correspondent, and never think about them again. PDFs that are sent to me are just uploaded and tagged the same way.
The paper copies are then thrown into a box in hopes I never need the originals.
I back up the document storage regularly.
Scanned documents go directly into DevonThink ( https://www.devontechnologies.com/apps/devonthink ). DevonThink has a database of all my documents and keeps it indexed/searchable).
I have a Synology NAS set up with a WebDAV share. DevonThink syncs my document database with the Synology NAS via WebDAV automatically. I have several macs and mobile devices that use DevonThink -- each one configured to sync with my NAS. That way every single document can be found and accessed on any of my devices (via VPN). In addition, I can add a document to devonthink from any device and it will be sync'd to the NAS and accessible on all other devices.
The NAS has a HyperBackup task to back up my encrypted document database to BackBlaze B2, which is very cost effective.
This set up allows me to access all of my documents and search them from all of my devices. And my documents are not at risk of being lost because they are stored on the NAS (with redundant drives) and also backed up to cloud. It's been working great for years.
I have tried multiple times to ditch DevonThink, because i'd prefer to have a web application running on the NAS itself to manage document storage/database. But nothing comes close to devonthink IMO. And since I use a mac/ios devices, it's fine. But this solution would not work for windows/linux/android users.
I then move each scanned document into an appropriate folder. I have folders for bills, cars, instruction manuals, mortgages, receipts, taxes, ect. The folders are backed up on Google Drive, but I could also use Dropbox, Onedrive, iCloud, a NAS, USB key, ect.
If you're extremely lazy, there is some OCR and AI to try and infer filenames and make them searchable. In theory, you could just scan everything into a single folder and search it. (But I don't trust it.)
(I originally bought the scanner to scan old photos. Now I'm the goto guy in my family whenever anyone has a stack of photos they need scanned.)
This is partly a joke, but part sincere advice. I think one of the reasons our marriage has been such a joy is that we've been highly complimentary in areas like this where the little stresses of life can easily become big stresses for couples. When it comes to bookkeeping, keeping track of things, etc., she excels tremendously. But driving anywhere causes her a small stroke, and it happens to be something I thoroughly enjoy, and don't even mind in heavy traffic.
The main threat model these days is digital, rather than physical. I favor paper records, in a folder by tax year (sorted by month). The iPhone Notes app has a really good document scanner built in, if you need a digital copy you can create it, then delete it. For the house I have a house folder, for the car I have a car folder. I just pay cash for cars, so that really cuts down on documents needed (this kind of thing should be part of your decision-making process!).
For digital, I use Google Drive, with rough organization of Taxes/2021, Taxes/2020, ..., Health, Family, Notes, etc. Don't obsess too much, you rarely go back in time so it's OK to keep it lightweight and optimize for the "now" when inserting and spend that little extra time searching later when retrieving.
The exception are things that are too tedious to scan (50+ page mortgage doc), are required to be paper for legal reasons (birth certificates), or sentimental items. Those are surprisingly few, and go into a hanging-folder plastic tub that has a waterproof gasket on the lid.
Most damage from house fires is the water from the firehoses, so it's important to protect from water damage first, then worry about fire damage if you keep your documents at the top of your home (attic). I store my document tub in the bottom of my closet, so it's relatively safe.
I only use it through the web, incognito mode, no desktop clients, never check 'remember password', and this is one of the few accounts that are not stored in my password manager.
Physical documents can be scanned using the Notes app on iOS, it can correct lighting and straighten the image, looks as good or better than a scanner and takes no time at all.
Are you worried about data security/malware at all? How do you protect your data?
Maybe I listened to too many Darknet Diaries episodes, but recently I've been thinking more about how to protect my personal digital documents. All it takes is one bad link or fishing email. Once a virus/trojan/ransomware is on the system, the attacker has a lot of leverage with everything scanned and neatly filed.
My idea is to use a separate laptop for archiving digital documents that is never connected to the Internet. Still a thought experiment at this point so I can't speak to the practicality (backups, etc.) of this yet.
The categories should ideally have minimal overlap, so it's clear where they go.
Example categories are: home, car, banking/finance, legal, health, education, and ephemeral inbox.
In case of overlaps, it gets sorted by the organisation that sent the document, e.g. a bank loan about a car will be in the banking drawer, not in the car drawer.
The ephemeral inbox is for anything that only needs to be retained short term (<1 years), regardless of the category.
For any letter that requires an action, I will create a task in my to do list. I will then either file it in the ephemeral inbox or discard it if not needed.
Electronic documents are saved in Dropbox folders by category and year, and are prefixed by ISO 8601 dates.
Periodically I take the current batch of unencrypted files and add them to a VeraCrypt volume, which contains files organized in this way, going back to around 2005. The encrypted volume sits on the same NAS. There have been surprisingly few times that I've had to "search" for an old document in the archives. And when I do, I can just go to the target year folder, and glance through the scanned images, and also make sure to give descriptive names to the scanned files, if it's important.
Once every few months I back up the encrypted volume to a gold-layered DVD disc (The encrypted volume is still nowhere near 4.7 GB), and store it in a cool, dark place.
Their scanner app on the phone let's me quickly scan a new document.
It is the best I have found so far.
I think Evernote have continuously gotten worse over the years (they keep adding "features" I do not care about), but at the core: Storing and indexing documents - I think it is still pretty great.
Same thing with PDF statements, invoice, receipts, etc I receive via email or whatever. Goes into the giant folder.
Most of the time, I don't even bother renaming the filename to something useful like "Auto Loan Statement". The handy thing that Scanbot does is OCR the scanned content, so I can use macOS's Spotlight to easily pull up whatever I'm looking for. It works really well and I don't worry about it, anymore.
At some point, I may get an itch to run Spotlight queries and start dumping stuff into organized subfolders, but that itch hasn't come yet.
The one thing I break out into an individual subfolder are my yearly tax docs.
I've never been able to stick to an organizational plan involving renaming files with ISO dates (but in fact, Scanbot renames it with ISO date automatically) and organizing stuff into sub-folders. You're a better (wo)man than me, if you can stick with that, though.
It’s 2021, there’s no reason to have a filing cabinet of paper documents.
Regarding organization, I use a simple folder structure, e.g. /paper/insurances/car, /paper/taxes/2020, /paper/
When I get rid of things I shred the documents.
For digital documents, I store then in a folder.
Scanned and original digital documents all go in iCloud with categories like - receipts - medical (self, spouse) - taxes - financial (etc.)
I know you didn't ask about photos and music but to me these are also important digital documents.
All photos are managed by the OS in the cloud. I backup the photo database using BackBlaze.
Music is again similarly managed by the OS in the cloud.
For note taking I prefer apple notes, but every once in a while, I just email the important notes.
Why e-mail? Because it is an open standard, it will be readable in the far far future. I can easily migrate to another provider, or make backups with imap functionality. I backup my gmail with another gmail account which I check yearly to keep it alive.
Email is also something which I always have at hand: on my phone, but I can also email to myself on another computer or from another account.
Mail search in gmail is also quite alright.
I scan everything with ScannerPro on my iPhone (which OCRs text to make it searchable) as items come in via mail etc. or print to PDF if I see myself needing something later. Scanned docs sync to Dropbox, and I move them to their appropriate Dropbox folder (e.g. property, taxes by year, biz, etc.) when I sit down at my laptop. It’s worked pretty well. I think the key is focus on the new docs, and you’ll eventually stop needing to refer to the old paper docs in your old folders (rather than trying to scan literally everything, which seems like a daunting task).
Everything is kept in chronological order. It isn't very fast to look up things up, but given I hardly ever have to access those docs I think I save more time not having to think about how to classify documents than the search once or twice per year for a doc.
In the case of documents that have a reliable internet service source (e.g. Amazon order receipts) I don't even bother filing or scanning. Instead I go get the document again from its source if I need it. Amazon keeps orders going back to the beginning, afaik.
I have an inbox for mail. I throw out junk and envelopes and put things that are important-but-not-actionable in a plastic tote in chronological order. Bills go in there after they are paid. (By me)
Every six months or so or when tax time comes around my wife files the papers. She gets depressed doing it, but at least bills get paid on time because I don’t get depressed about filing paper in real time.
Additionally, I would also recommend backing them up offsite somewhere such as Backblaze B2 [2], making sure to encrypt all files there (even ones that are not encrypted on your local drive) using something like Restic [3].
[1] https://www.veracrypt.fr/code/VeraCrypt/
[2] https://www.backblaze.com/b2/cloud-storage.html
[3] https://help.backblaze.com/hc/en-us/articles/4403944998811-Q...
For sheets that can't be hole-punched like a birth certificate or a car title, I use either the pockets in the folder or plastic page protectors that can go into the binder. For sections pertaining to specific events, like initial purchase and financing documents and maintenance visits for a car, I use tape tabs to mark the first page of whatever came out of that event. (You could use dividers made for three-ring binders, too.)
It's a good system; everything you need for it you can get just about anywhere, it doesn't take much maintenance, and lookups are pretty close to trivial. Too, unlike a filing cabinet, it's portable; if you need to take a set of documents somewhere (reference, tax preparation, etc), they are durably collated in a form that will easily withstand travel.
I use a Doxie [0] scanner and scan absolutely everything meaningful: documents, receipts, invoices, physical photos, note from friends, Christmas cards, credit cards etc. Having a "scan everything" attitude means I don't have to think about what I do and don't scan. I try and save as many of these files as PDFs with OCR (which the Doxie supports)
Every week or two I dump all of the scans from the Doxie into my "Downloads" folder where I rename any files that have obvious content to something more meaningful (easier to search this way). Anything that needs to be manually filed (company documents for example) I do myself.
Everything else get automatically sorted using Hazel [1] after 2 weeks in the Download folder. They get sent to an "Archive" folder that is split into subfolders: PDFs, videos, images, music, design files, documents, etc. All files are automatically sorted into [year]/[month] folders.
This archive is great as it becomes a location for everything that doesn't have a home. For example I also perform a WhatsApp backup every month or two that adds all new photos and content that I've received from people into the same Archive. Likewise anything I've downloaded that hasn't been deleted or moved somewhere can be found there.
When I move again I may digitize them by setting up a 'jig' using a piece of acrylic or glass from Home depot to flatten the pages so I can photograph them. Once that's done, I just keep a folder on my computer called "Documents" that gets copied to the cloud or wherever. Same basic filing system as the paper documents. One copy in the cloud and one on my computer, and every few years I make some kind of offline backup that I then forget about for years.
I dont recommend retrieval to do anything with OCR or Full Text Search. In my personal experience, simplest way to retrieve data is by date. If I am looking or 2018 tax records, I have already found the root folder(digital or paper). Fast enough retrieval, hmmm.
You may optimise as per you. I hope the idea helps.
The wastebasket is our most important design tool--and it's seriously underused.
Otherwise everything is digitized and shredded. iOS has a great scanner built into Notes, which can be exported / airdropped as a pdf.
Digital assets can be kept in a managed shared cloud folder like Dropbox or 1pw if containing secrets / identity matters.
But this is just physical records and the scope of it is getting smaller every year. Other data includes contacts, events, communications, negotiations, login credentials and their associated code words, URLs, etc. and other interesting information. Most of it is electronic. Most of it has been collecting for over 40 years. I have a search method that starts with Gmail or Google Contacts or Google Calendar or Evernote or LastPass. (For work these are replaced with MS Office365 equivalents) One or more of these usually comes up with either the root data or key attributes that I can use to search on again. Often I get a communication that has a date and a name associated, this leads me to a calendar event or a note in Evernote. I often make a note in Evernote that gives some context and maybe points me to a doc in a specific document or paper file folder (or bankers box).
It’s important that I use similar folder, tag, keyword, or category names in electronic file systems, email folders, and even paper folders. Eg. “Family/Jason/Health/Dental” or “Finances/Taxes/Taxyear2020/IRS”, etc. Lastly, the older I get, the more I commit to electronic records. Rather than remembering the names of an acquaintances children and the date their spouse passed away, I record this info in my contact for that person.
I only wish I had faithfully started this system when I was 20 rather than gradually since I was 40 years old.
On my desktop(s) I run insync, and allow everything to sync all over the place. A cronjob then runs that does a pdf2txt for any file, storing the contents in I use ripgrep to search for content in files, when I can't remember things. Then, because I'm a special level of worried, I maintain a backup of my Google Drive cache with SpiderOak. After all, one never knows.
As far as storage: it all goes on my home (Samba) server with nightly (onsite) backup. Yes, this is a "hoarding" situation; it's easier to keep accumulating than to make (irrevocable?) decisions about what to delete. I know my backup solution is only robust against certain failures, but paring down the huge collection in order to make offline backup feasible means grappling with aging out the appropriate parts of it. This is on my to-do list... Also on my to-do list, once I establish a mission-critical doc-subset, is storing those docs on https://www.fidsafe.com/
edit: re organizing: it's all manual; pdf file(name)s are auto-prefixed with date-of-scan, and I rename to add a content-denoting suffix, plus move into a dir structure (which has evolved a bit). So, not very efficient, but still much better than pre-scanner (papers stuffed in 2 actual filing cabinets).
Then I've written a shitty tool to make a fulltext index of all the pdfs in the current directory https://git.sr.ht/~ghost08/pdfq (It doesn't have documentation or even a README so ...)
And then I search like so: `cd my/documents/path && pdfq index && pdfq search "my query"`, it just prints the file names which match the query.
Also for backup I use syncthing, so I have 3 copies of all my documents on 3 computers in my house.
Pile up things to scan on dresser
Periodically scan them into Evernote using a brother mfp + MacBook.
Some things I scan from Evernote on iPhone
Occasionally tag things (esp tax related), but very little folders etc
Search as needed by keyword and time. For example, if I need a car bill, I should just search the name of the dealership and have it in the first few hits.
But, this has gotten slow and Evernote UI has gotten worse imo.
I’d really like something that was faster scanning - like 0 or 1 button presses ideally. And had automatic ingress for emailed docs like paperless statements, bills, etc. Then had smarts to automatically tag some, and had very fast search.
Workflow is Scan -> throw on a big pile (file very important stuff away) and discard everything once the scans are OCR'd and saved on my encrypted NAS share (for which I have a regular offsite backup).
As Doxies OCR works great and I use Docfetcher on my NAS for ultrafast search/retrieval, I don't need to tag anything manually or use different folders but can just "scan it away" without any manual edits which is a huge timesaver.
I don't really want to use Google for my personal documents, and I also don't want to use a web app to access them. It syncs across all devices and has a nice built in scanner and a few other nifty features.
We even use it for sharing notes between family members. If I go to the store, my wife might send me a shared note with "collab" mode where she will see each item I have ticked off.
Before that I used Evernote, but they lost half my notes. As a non paying "customer" I couldn't really complain.
It may be an upfront effort to get going if you have a morass of documents, but helps later on when searching for things. There's old command-line tools like 'qmv' if you want to easily do bulk renaming within a text editor.
1) Any machine I use is only a pull away from the latest
2) Having a repo lets me track history and use search functionality based on repo tags. It also provides versioning for documents.
3) Each clone on each machine acts as its own backup.
4) The NAS is mirrored, the active backup is also mirrored.
There is a custom program running in a container that will feed any new doc to pdfsandwich (or similar OCR tooling), move the doc into a digital inbox prefixed with the current date. From there I can either leave it as it is (the date is usually good enough to find things) or - if I get to it - give it a proper name and put it into a folder structure (like some of the other responders).
The custom tooling also indexes all docs and provides my family a web interface to search.
Simple and effective.
Throw anything in the bin that I don’t need or something I can get easily if needed.
If a paper document might be needed for longer or getting another copy might be an issue then scan it.
I name the files and folders appropriately often appending to existing names.
Repeat a cleanup on existing documents, both paper and digital, regularly. A lot of documents loose their importance over time - either they literally expired or you overestimated their importance or have just lost value.
Also I've been trying https://stack.area120.com/ which is a google product. You can scan a document, and then tag it (tags vs folders), and you can have multiple tags on a document. So scan, tag insurance + medical, and then you can search by tags etc. You can also add key/value pairs for important information. For instance, you can add a claim number to the insurance doc, or a telephone number etc. Seems to work pretty well so far.
http://www.synthstuff.com/mt/archives/individual/2005/10/the...
https://caveblogem.wordpress.com/2007/01/19/a-folksonomy-for...
The bot names and places the file in the right folder for paperless to ingest.
My biggest issue is finding those documents like "oh its tax season -- where is the receipt for the stuff that I bought from Staples " or "where is the reciept for the medicine I bought so that I could file it for the insurance reimburesment" .
I am hacking away using AWS ML APIs but so far I am not happy with my results.
The date and comprehensive filename is often enough to find a document, but additionally I can do a "full text search" on all documents with the text layer that is put onto scans by the OCR.
Everything else I place in a large pile on the side of my desk - once it looks like it's going to fall over I go through everything, throw out what looks useless and put the rest in a separate pile. Every once in a while I scan the separate pile documents to OneNote and shred them. It's worked surprisingly well for the past 15 years or so.
I'm gonna do a Show HN on it one day because it seems like a lot of people have the same problem as me.
This folder is backed up.
For "long-term" "important" files, I have some fire-resistant safe boxes
For "really-important" stuff, I use a gun safe (this list is incredibly tiny)
How are these details being digitalized? By whom? Where? When? How often? WHY? How may I access:
1. what are my data rights?
2. How evaluate.
3.. how to corroborate?
4... How verify?
5. .... How expunge?
6.... How to not streisand the fuck out of people?
7... What specifically are my deets that are protected under law that I may defend vs not
There are some paper documents that I do not bother to digitize. I keep these in a small filing cabinet in actual physical folders.
The trick is simply memorizing which documents go into which folders.
You can organize it better, but the truth is that search works well enough and you are probably not going to need it.
Beyond just managing personal documents, there’s always the question of access to these documents by loved ones or other trusted people.
Throw those as well as any digital documents into my google drive.
If I need a document, it's just a search away. Literally zero time organizing or filing; I just count on the fact that google drive search is pretty good.
Those folders are grouped together by broader subject - loan documents, tax documents, etc. - in alphabetical order.
By familial entity (family, mum, dad, kids)
Then By year/month/day (bills) Or time independent (diploma, ...)
Then if I need to organize a document for my family auto
- the contract goes to family > auto
- the bills go to family > yearmonth > yearmonth_auto_provider-name.pdf
A search on the tree on file name is enough for us.
The digitized versions then go into a PARA system.
I thought I need a OCR, but my folder structure is enough.
It’s simple reliable and will exist in 20 years.
Anything I think I'll need or want to keep gets scanned, everything else is shredded once it is no longer useful. Paper docs are almost guaranteed to get lost - the only paper docs I intentionally hold long-term are things I don't want to lose in a fire, in a bug-out bag.
I haven't gotten around to it yet but I intend to eventually back up the critical documents locally or in some other cloud service to prevent random Google account locks from totally crippling me.
You need a proper filing cabinet with two drawers [1]. You then set up the document holder inserts like so:
Top Drawer: Urgent, Important, and then months: Jan, Feb, March etc for two years
Bottom Drawer: One section for each category you want. Just make them up as you go along - Mortgage, Car, The System: When receiving a new document (usually when opening the post, but obviously could come from school/doctor/whatever): 1) Is it something you need to act on? If so, put it in Urgent 2) Is it something you'll need imminently (e.g. a doctor's letter that you need to remember to take to an appointment in two weeks' time)? If so, put it in Important 3) Do you need to keep it? If so: 5) Not sure what to do? Just put it in the current month and move on with your life Once a day/week/whatever works for you: 1) Is there anything in urgent that you can act on? If so, do it. You'll likely then either post it, move it to Important, or put it in the current month Where the hell is that stupid letter / form / aargh I'm supposed to be leaving in five minutes 1) It should be in Important or Urgent 2) Look back through recent months, you'll probably find it there Once a year / once every two years (we do this in the gap between Christmas and New Year) 1) Go through all the months, and either move them to a category in the bottom drawer, or bin them. Because you only do The Big Chuck Out once a year, you can put the time into getting it professionally shredded. For this reason, I often only chuck proper rubbish (flyers, ads etc) and file everything else so it gets shredded. We had various combinations of ring binders / document wallets / etc etc and eventually they fill up or you run out of them and don't get around to buying more (plus they start getting bulky once you have a lot of stuff). The filing cabinets are a lump, but they hold a LOT of stuff. Since using it, going through post / being given forms is quick and painless, and we haven't lost anything. [1] https://www.bisleydirect.co.uk/bisley-bs2e-flush-front-filin...
4) Can you just bin it? If so, bin it. 3a) Does it have an obvious and immediate home in one of the categories in the bottom drawer? If so, put it there
3b) Put it in the current month