Best way to store, index and categorize audio recordings

Question

As my kids grow up, I realise I've got a bunch of sound recordings taken on my phone, usually of them saying or doing something hilarious. Right now, it's just a big directory where each filename is a timestamp, but I figure there must be a better way to make these more accessible & searchable.A bit like lightroom/darktable helps organise and add metadata to photos, is there an equivalent for sound files?(I'm almost tempted to crack out some sort of machine learning thing to transcribe and then tag each file, but maybe this already exists?)

LinuxBender · Accepted Answer

I am not an expert on this but I think regardless of the tools or platforms being used to organize the files, more important is likely going to be the MP3 metadata added to the files with date, participants, genre, comments, etc... so that you can easily switch platforms later and don't have to rely on saving some ever-growing database. Maybe you could also get the kids to give you a comment or quote to also add to the MP3 metadata.
The only platform I have used to organize and share music is Ampache [1] but that is likely overkill for your intended purpose. I don't know what the best tools would be to add the metadata to MP3 files however.
[1] - https://github.com/ampache/ampache/wiki

sandreas · Answer

You could start with a simple experiment using DeepSpeech[1] as an automatic transcription tool (I assume these recordings are non-public, so you'd prefer a local service instead of a cloud solution, which detection rate would probably be better).

After having the text auto-transcribed into a simple txt file, I would check the quality and do some manual corrections, where required.

Then import the transcribed text into the audio file metadata (e.g. Lyrics, Description or Comment, depending on your metadata format).

The relevant fields I would look at are:

  Description
  LongDescription
  Comment
  Lyrics
  Group
  Title
  Album
  Composer

Depending on the length of the recording you could also add chapters. Here is a nice audio book guide with some further ideas: https://github.com/seanap/Plex-Audiobook-Guide?tab=readme-ov...

Now you should have access to the metadata via audio player - maybe even a search would be supported.

[1]: https://deepgram.com/learn/guide-deepspeech-speech-to-text

defrost · Answer

If you're doing a pipelined bulk processing pass to add metadata tags after extracting them via Speech to text, or have delimited notes in a text file, or ... etc.
You might find ExifTool useful.
It's pure commandline (with a few third party GUI's IIRC) multiplatform and purpose built to display, edit, add media tags to all sorts of AV files.
https://exiftool.org/

tacostakohashi · Answer

I like a low-tech approach for this kind of thing. I'd just improve on what you're doing by coming up with a directory structure (no more than two levels deep), and descriptive filenames along with the timestamp.
maybe:
birthdays/joey/2020-01-28-cutting-cake.mp3
holidays/disneyland/2022-02-13-roller-coaster.mp3
...

paulcole · Answer

Every time you want to search your voice clips, do it in a text file or notes on your phone.If that file is empty in 6 months then you&rsquo;ve just saved yourself some time and effort and can just delete the files.