• 1 Post
  • 57 Comments
Joined 1 year ago
cake
Cake day: July 2nd, 2023

help-circle



  • I like that, some YouTube video i came across had the sentiment that it was ok to be a renaissance man, jack of all trades kinda deal. I liked that a lot since i have a few different hobbies and im not particularly great at any of them but im good for the most part.

    Made me feel like i didn’t have to be perfect and it was cool to just be dong stuff.



  • Me personally, i use my AMD 7700XT to run ollama on my main pc. Can be helpful for troubleshooting as the internet gets worse amd worse to search especially if i dont know what the issue is. Thats my main use case for it but id like to set up something with RAG and use it to help me with documentation if i have questions.

    I don’t think its super worth it to use a VPS for an LLM if you already have a decrnt gpu that you can run it on. If yoy dont already have the hardware, plenty of older gpus can run the models pretty well. My 1070ti still kicks ass all these years later and you can find them for $100 bucks or less on ebay used. Ive used it for ollama as well and it does just fine.

    Will it be super fast or a really big model? No, but if its for personal use, i dont see any benefit to paying a monthly subscription for it and like i said, works well enough for me.

    Its also more secure and private to host it yourself if thats worth anything to you. Thats one of the biggest reasons i self host.


  • This is rough man, I’m really sorry to hear all that. Christmas is supposed to be a happy time for everyone even without all the gifts.

    Maybe instead of gifts for your kids like physical things, plan a day with just you and them. Do something fun as a family or with each of them individually. Memories like that they can cherish for a long time after this year and gifts dont have to be material.

    Given what you said, it sounds like you could use a day of fun with them.



  • I agree with this. I’m using a 1070ti for image gen and it would be more than capable for handling some LLM stuff. An AMD 7700xt ive found dors well with 7B models on my main rig but im sure you could get away with somthing cheaper or less powerful.

    That said, the amount of text you can genrate or the context length of its answers will depend the model you use and the larger the model, the more power it takes.

    If youre just messing around with it or want it to review or answer small questions, I’d say a 1070ti like I’m using would be just fine. Some folks use even more budget friendly options. If you got a gaming machine with any semi recent GPU, I’d say go for it. Worst case, you can pay for a subscription later if you really want.



  • Wouldn’t exactly fit my use case because this pc also doubles as my game in bed pc and is what I’m currently using for ai image generation. If i could get big picture mode but still run applications that arent games or for streaming, that’d be ideal. From the recommendations, seems like kodi is a fan favorite but not exactly a DE either. Might work but I’d rather it be a DE than an app i have to run but beggers cant be choosers.

    That said, I have 2 chunky servers that my buddy gave me recently and I’m planning on self hosting a lot of things with them which likely include jellyfin.

    I will say that im slowly getting the internet to a decent spot at least for streaming, generally as long as my connection is fast enough between starlink and my lte connection (using failover with pfsense) i can usually stream ok. Though with one tower in my area and trees surrounding my place, its never gonna be great.


  • My desktop pc runs Fedora with Wayland currently and it works really well. I like wayland a lot and was trying to use it on my media pc as well but it wasnt playing well with Firefox for video playback. Not sure if this was fixed yet or if it was even a bug but it was not good when i tried it on kubuntu. Haven’t tried it om popos yet but it might just be an issue with gnome. Ive never been a fan of gnome ever since i started messing around with linux.

    Love kde plasma though, its def the best DE ive found so far. Coming from Windows and all the customization it has, its so nice.


  • I mostly use this pc as a streaming box for online content like youtube or crunchyroll so not really sure kodi would fit that anyways. Will probably have jellyfin up again at some point so might use kodi for that? Idk, mot something im doing anytime soon.

    Rn im using the default for PopOS and like you, scaled the ui. Its fine, but not quite right yknow? Ui scaling in Linux hasnt ever felt quite right to me especially when I’m using a tv.

    I also use this pc to do other things so its not just a media PC all the time which is another reason why i was looking for a desktop environment rather than a whole new os.

    Is mate pretty good for scaling well? I havent used it before but a small gripe is that the default for pop doesnt scale well when the taskbar always shows. Applications get cut off at the bottom. Pretty annoying.