Any suggestions for solutions?

You’re conflating me asking how to use these tools with you who’s misusing them. I see you still don’t accept what you’re doing is wrong. But go you.

Please be very careful. The python code it’ll spit out will most likely be outdated, not work as well as it should (the code isn’t “thought out” as if a human did it.

If you want to learn, dive it, set yourself tasks, get stuck, and f around.

Yeah shell scripts are one of those things that you never remember how to do something and have to always look it up!

Was this system vibe coded? I get the feeling it was…

lol. Way to contradict yourself.

I haven’t actually found the coder-specific ones to be much (if at all) better than the generic ones. I wish I could have. Hopefully LLMs can become more efficient in the very near future.

Some questions and because you don’t actually understand, also, the answers.

• what does the LLM understand the context of, (other user’s data owned by Twitch)
• How is the LLM fed that data? (You store it and feed it to the LLM)
• Do you use Twitch’s data and its users data through an AI without their consent? (Most likely, yes)
• Do you have consent from the users to store ‘facts’ about them (You’re pissy, so obviously not)
• Are you then storing that processed data? (Yes, you are, written to a file)
• Is the purpose this data processing commercial (Yes, it is, designed to increase viewer count for the user of this system - and before you retort “OMG it helps twitch too”… Uhm no, Twitch has the viewers if not watching him, watching someone else)

I mean yeah, it’s a use case, but own up to the fact that you’re wrong. Or be pissy. I don’t care.

Doesn’t Twitch own all data that is written and their TOS will state something like you can’t store data yourself locally.

No, what is it? How do I try it?

Surely none of that uses a small LLM <= 3B?

That’s not the point here. People probably do not need a pi 5. There are many other pi devices (and similar boards) with significantly less draw.

Damn, I should have ended the post with /s for people like you.

See here’s the thing. Why would anyone want to host ALL the stuff on one pi? That is not what they were designed for. Ollama on a pi? Are you out of your mind? I’d run the biggest model I can on a modern gpu not some crappy old computer or pi…Right tool, right job. And why is dropping containers “less secure”? Do you mean “less cool”? Less easy to deploy? But you’re not deploying it, you’re installing it. You sound like a complete newb which is fine, but just take a step back from things and get some more experience. A pi is a tool for a purpose, not the end all. Using an old laptop is not going to save the world and arguing that it’s just better than a pi (or similar alternative) is just dumb. Use a laptop for all I care, I’m not the boss of you.

As for an arr stack, I’m really disappointed with the software and don’t use it and those who do have way too much time to set it up, and then make use of it!

I can self host what I want on a pi zero. But, I do have some 30 years of experience so can probably do things some won’t understand / bother with.

I’m sure silicon valley are stepping on each other, vying to get their hands on these super cheap laptops for their 24/7 AI training.

It’s even worth pointing out you can disable various parts of the pi so it uses / needs even less juice.

Pi’s are ARM-based, which still to this day limits the scope of their applicability.

Untrue.

Also, you should absolutely inspect a laptop before buying. Many, if not most, of old laptops will run just fine for the next few years.

Until the battery needs replacing, costing more than a pi, one key on the keyboard dies, etc.

Please be specific rather than referring to ‘raspberry pis’ together. Different models have way different characteristics.

This is generally not true. A small server running on an old pi when idling will have hardly any draw. It will cost literally pennies to run for the whole year.