discourse plugin supports ai now with many functions, like ai search, summary, related
may be our forum can add these function
Agreed, it would be great to make this available. Unfortunately it’s not free.
Is there still cost to pay for self-hosted ones like Slicer forum? Or are you talking about API token cost? If the latter, JetStream2 might be of use: Overview - Jetstream2 Documentation
Discourse AI seems to interface all of those three models JS2 offer: Discourse AI - Large Language Model (LLM) settings page - Site Management - Discourse Meta
Yes, API tokens cost money. There are about 6000 page views per day. Very rough estimate: assuming $0.03 per interaction and average one interaction per page view would cost $5400/month. There are about 1800 signed-in user visits per month, so if we charged users a few dollars per month for AI usage that would cover the costs.
Discourse indeed supports vLLM, so it may be possible to use Jetstream2 for free AI features. To try, we would need Model id, URL, API key:
I don’t really know much about LLMs and their API. This is what I found on their website. Hope it helps: Access the APIs - Jetstream2 Documentation
They are a very supportive group and have weekly office hours on ever Tuesday 2p (ET). They might be able to help you.
It’s a great idea to use the JS2 servers. Unfortunately I couldn’t get them to work with discourse but they do work well and you can get a lot of detailed info about Slicer from either the Llama or DeepSeek models they expose through Open WebUI.
1 Like