Anyone tried this Matrix<>ActivityPub bridge?
-
(1/2)
@verita84
> You can generate a .gguf however you want and try to run itI can also pick any cake recipe I want off the web and try to bake it. That doesn't guarantee me an edible cake though ; )
-
(1/2)
@verita84
> You can generate a .gguf however you want and try to run itI can also pick any cake recipe I want off the web and try to bake it. That doesn't guarantee me an edible cake though ; )
(2/2)
My point is, unless a server project provides a repeatable methods for generating a reliably useful model, running it locally isn't substantially better to running it remotely via an API. The main difference is that the person running the server pays for the compute it uses, instead of the supplier of the model. That seems worse to me, not better.
-
@verita84
> Unless you have a 32GB GPU , don't even think about doing any development work without an AI subscription. Even 32GB isn't enoughThis seems like a good argument for not including generative models in your project. What do you see as the most convincing reasons for including them? Benefits sufficient to outweigh all the downsides we've been discussing?
-
@verita84
> Image and music generation is fine on lowend gpusOk, but what are the *benefits* of generating mediocre images and music by auto-mashing human-created ones? How do they outweigh the costs?
> Qwen 9b is great for bots, summary, and other tasks
What are the benefits of using a Trained #MOLE for these, rather than traditional automation programming, or getting humans to help? How do they outweigh the costs?
'Don't know' is a fair answer, but then, why promote it in your project?
-
? [[global:guest]] crossposted this topic to General Discussion
-
-
-
-
@Jelqberg_Mcjelqstein
I don't know what this means. -
@Jelqberg_Mcjelqstein
Imagine I am GenX and I have no idea what this storm of emojis means. Use your *words*. If it just means you think I'm gay, that's factually wrong, but anyone who Mutes on that basis is a mouth-breathing waste of skin, so I don't really give a shit.But if I'm being accused of something serious, I want to know.
-
@Jelqberg_Mcjelqstein
Ah, I see. You've been at your Mum's brandy again. Get out of the basement and grow up. Muted.
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login