Open WebUI’s document management loads everything into a vector database. When you use the hashtag, it will trigger a search against the vector database based on your prompt. These results are run feed into the LLM. Open WebUI should generate a hashtag that can reference all the documents. But the quality of the results will be influenced by the embeddings and the LLM that responds to you.
Install ollama. It has ROCm support (on Linux at least). Then hook it up to your favorite client. It has its own API and an openai compatible one.
KoboldCPP has ban tokens that prevent those tokens from being output. Otherwise just put it in the prompt and it should probably work.
Even the smell of Olives causes me to gag. I absolutely cannot eat them. Olive oil is fine. But actual olives, no. Doesn’t matter if they’re old, new, canned, fresh. They’re absolutely disgusting. One of the few foods I outright cannot and will not eat.
Doesn’t gnome already have this?
I use a Misskey fork for micro blogging and I can’t even get Lemmy posts to load. The profiles of communities do, but that’s it.
Ah right. What I really meant to ask was if it can do protocols other than http.
Which I don’t think it can…
Are you able to tunnel ports other than 80 and 443 through Cloudflare?
Right. I agree.
You mean the part about people citing laws like GDPR is dead on?
The fork was originally created because upstream NewPipe elected not to include sponsor block functionality.
Will existing projects have to adapt their codebases to work with ActivityPods? I assume yes.
So is there a way to follow someone on Threads now? Or at least get one’s instance to load a post? Where are the details of this beyond Zuckerberg’s post?
The GPL explicitly allows selling the software, like a proprietary software product. You don’t even need to have the code up in a public repo. What you DO need to do, though, is provide a reasonable way for customers to get the source code, and send it to them if they ask. Just because a project is GPL doesn’t mean you’re entitled to the source for free. Of course, if someone buys it and requests the source, they can do whatever they want with it, including uploading it somewhere. Which in the end, essentially makes it available to everyone. Which is the whole point!
All of this only works if the owners of the code respect the license. In this particular case, I don’t believe a contributor agreement was ever created, so if the new owners want to close source the apps, they’ll have to get permission from all contributors, or drastically rewrite those contributions.
But again, this only matters if they respect the license in the first place…
Didn’t they contribute networking stuff?
It used to be open source, then it went completely closed. As mentioned, Organic Maps is the fork that is the continuation of the GPL app.
Fluffy is also a desktop client.
Excellent! You should update your original post with the solution, if you haven’t.
A vector search converts your query into magic numbers, and then searches the database for other magic numbers that are “similar” (closet to it in the vector space, which is basically an N-dimensional graph of points and directions). These results are then returned as snippets to the LLM and it does stuff from that point.
The effectiveness of the vector search depends on how Open WebUI breaks up the documents into smaller sections, and how good the embeddings are.
I’m not exactly sure what you want to achieve, but you might have success in using an LLM to summarize the documents beforehand, using a specific prompt to extract the info you want, then feed that into the vector DB. This would require some scripting, of course.
The easiest thing to do is try it. See if Open WebUI’s vector search is able to handle it. Make sure to use a good embedding model like nomic-embed-text (can be found on ollama.com). You can change the vector search settings in the documents settings from the workspace on OpenWebUI.
Edit: https://ollama.com/library/nomic-embed-text