Right now, when I’m not home, I check him on camera to see if he’s doing ok. This can be stressful, especially when my phone has bad coverage or if Yuri is hiding.
It would be great if we could find some way to detect his movements (or sounds maybe?) when he’s having a seizure and send a push notification to my phone.
I’m an iOS developer so I could easily do the server/app part, however I have no idea about the rest. Is there some sort of gyroscope or something we could attach to his collar? Or maybe a programmable smart watch? Or anything else that could help?
I’d really appreciate any help or advice!
Some extra information:
• Here's a youtube video showing how a seizure looks: https://www.youtube.com/watch?v=PUzJebl0464 WARNING: this can be disturbing!!
• Seizures are totally random, but usually they last around 3-5 minutes. They start slowly, and at their peak the cat lies on the floor, moving legs quickly and shaking its head.
• Yuri's heart rate goes up for 10-15' until he calms down.
• I'm open to any solution and it's not a problem if it's not perfect (but I would prefer false positives over false negatives)
Mount a bell on your cat. Maybe more than one, with different sounds - collar, back and (if you can get him to tolerate it) a leg. Then train an ML model to recognise the sound of a seizure.
There are a few options for electronic collar-mounted platforms. But finding one that is all three of capable, lightweight enough for the cat, and has decent battery life, is difficult. We already know that bells are light enough, and they don't have a battery life problem. My guess is that ML will easily be able to detect a seizure with high accuracy, probably even with only one bell. You might need a mic in each room.
(after watching the video) It may even be enough to just detect the bell, and have a crude threshold for the proportion of time it's been ringing in the last minute or so - which will be a lot faster to gather the data for. That would be a good MVP.
You'd need more infrastructure (like Home Assistant + a Zigbee dongle, or an always-on app listening for BLE advertisements, depending on the sensor radio) but you could apply some filtering to a vibration sensor to determine a threshold for alerts.
(despite the description saying you need the Aqara hub, the sensor works with most Zigbee coordinators, and certainly the popular ones in the Home Assistant community.)
It supports cheap smart watches like the PineTime and BangleJS (I would not recommend a Garmin device since Garmin likes to break their API). You might not be able to use the HRM due to furr being in the way but you can hopefully still use the accelerometer data to determine if Yuri is having a seizure. You might need to change thresholds for the algorithms based on accelerometer data to better match cat seizures. OSD is developeded mainly with humans as the intended sensor wearers.
Or, you could put Yuri in a closed area with camera monitoring. Train a YOLO5 model in Yuri vision and let it monitor the area. You would have to simulate a seizure though. You could make a fabric facsimile of the animal and place it in different areas on its side. The shape of an animal in a seizure is not the same as when it's sleeping. It would be up to you to determine the difference.
If heart rate is reliable enough indicator of seizures, perhaps a heart rate monitor could be used?
Have you considered keeping him only in one room while you are gone, and placing many cameras in the room, as well as having a more controlled lighting set up? Then you might be able to go down the video recognition path, although I have no idea if it's even really possible. At least you have some training data (like the YouTube video you linked).
Either one or two sensors, first one matbe gyroscope, second one maybe electrode or similar for muscle activation (ten to a hundred times more expensive upon googling)
Some algorithm saying if the movement is squiggly enough and if the combined sensors are activityful maybe give u a text or call or push notice with higher prediction percent displayed if both active
Or just do that with the gyroscope only, display the movement graph over time and u can use your intuition on the movement pattern to see if its a false positive or not
And obviously i forgot about bodycam People even stream their cats lives with bodycams i think u should be able to see if its having a seizure as for detection idk maybe something neural detecting the same scene shaking, worst case scenario pay amazon mturk or something
I assume there must be researchers trying to do this electronically too (See - https://newsreleases.sandia.gov/seizure_sensor/ for example.). It might not be practical yet unfortunately though, and not sure if it would translate to animals.
Good luck in finding a solution though! I would assume something like an accelerometer on their collar might be able to detect shaking.
Yes, it's possible, but it would be difficult to do on your own if only because you can't (won't ethically) induce seizures at will so testing will be hard.
My suggestion would be to try to find research into this. There are many medical devices for humans that have found use in animal applications and I'm sure that seizure detection is a well-researched field.
It may not be difficult to copy a researcher's work. You'd be surprised to learn how simple most medical devices are at their core (I've been in the field for 20 years): it's the surrounding safety and predictability requirements that tend to make them complex and expensive.
1. build a yolo based cat detector to detect where yuri is
2. then build an action recognition on video (there are many good action recognition approaches such as videoMAE etc that could be leveraged to detect normal cat activity vs abnormal activity.
hope that helps.
https://www.aliexpress.com/w/wholesale-Bluetooth-Acceleromet...
The BT50 claims 50m distance (open) but with a 8 hours battery life, which will shrink with time. You'd need longer battery life I guess?
I think the software would be easy.... if you know what you are doing. That might be the plumber joke of knowing where to whack the pipe. I "feel" like it wouldn't be hard.
[edit] Maybe the (Holyiot) beacon tag, it has longer battery life, need to check the specs how good the accelerometer is - https://aliexpress.com/w/wholesale--beacon-tag--acceleromete...