This poses a problem, because each user will onboard with a large amount of data that needs to be processed. I am attempting to do this in the browser using rust and web assembly in order to save on compute costs. I want to ultimately convert the data to vectors and store in qdrant for ease of search, however all of the rust crates I have found for embedding text (fastembed, rust_sentence_transformers etc.) do not work in wasm. I have also seen projects like voy, that handle embeddings in JS, however this would be to slow when running on a user's emails.
Does anyone know of any projects or crates that can embed text in web assembly? Or alternatively, does anyone have any other ideas on how to implement this efficiently?
Thanks!