The coder model has only that one. The ones bigger than that are like 20GB+, and my GPU has 16GB. I’ve only tried two models, but it looked like the size balloons after that, so that may be the biggest models that I can run.
The coder model has only that one. The ones bigger than that are like 20GB+, and my GPU has 16GB. I’ve only tried two models, but it looked like the size balloons after that, so that may be the biggest models that I can run.
I got it working with my 6800XT. I’m running deep seek r1 14b (somewhere around there) and the deep seek coder V2. I have a link to a blog with those instructions
https://gotosocial.michaeldileo.org/@mdileo/statuses/01JQA4M4Q33PMCADH9M2AWQSS8
For me federation is working to mastodon, but I don’t think comments are really out yet, but I use cactus comments for it, but that doesn’t federate to mastodon, it federates to matrix. It also requires a matrix server, which was a total pita to set up.
oh, I thought that was a mastodon thing or something. Thank you for the clarification :)
I have dynamic dns through cloudflare that provides a proxy ip address for me in addition to some protections.
After that I use a reverse proxy to route specific domain names to services. My router is set up to forward only ports 80 and 443 to that reverse proxy, so there’s a good layer of safety there. There could be a weakness on the router, but at this point traffic is pretty limited.
After that, at least for your service, if you can have some control or throttling of signings and be more selective about who you let in, then that could help.
I say do it. Sure there’s risk someone could put something on there you don’t want, but I wouldn’t say it’s big enough to not do it.
Did you ever find a solution? I’m having the same problem. I ensured that my user has wildcard permissions for the host, so it’s granted ALL on 'friendica'@'%'
.
To add on, you can comment in a “binary search” method. Comment out one half of them, if it’s still there, half again, etc and keep going down until you find it.
I’m on mobile and can’t make out any of it, but good luck!
I try to do something to make my presence known because the number of times I’ve frightened a woman by, from her perspective, appearing out of nowhere, is quite high. I’m a pretty quiet walker too.
I also make extra space on the sidewalk or I’ll cross the street at night when I’m overtaking less than 3-4 in a group.
Writefreely is super light weight and minimalist in its design. It also federates with mastodon.
To add on, your budget here really matters. Ideally, you can have an external NAS or drive enclosure that is managed by the laptop. If you want easy backups, a cloud storage provider can help. I do nightly backups to idrive.
Thank you! This took so long to figure out
Because it doesn’t feel real 😉
Edit: i thought you referred to TrueNas. I’m tired
Sure thing! Hopefully that can help with ideas I got started by doing little short trips in the US. Maybe you can change things up with some weekend road trips or something
I work office hours at US central time, so things don’t really change a whole lot there. I wake up, do breakfast if it’s offered, hop on the morning meeting, and optionally find a cafe to work at.
Many places offer breakfast and lots of hostels have kitchens and refrigerators, so I’ll take one of those eco bags that I got for $0.50 in latin america and buy a few things for a meal, or I’ll eat out, which I do too much.
Hygiene is fine. Every place has showers and toilets - just wear flip flops or shower shoes in shared showers.
I’m currently in the US. My company’s policy of work abroad changed, so I’ll be back here for a while.
problems
I’ve learned to be more flexible. Sometimes places have flakey internet, but I have my phone as a hotspot. Your plans won’t always work out and its fine, there will be another way to make it happen. There’s another bus, plane, lodging around. It’ll be fine.
Your moving long term and have a digitally oriented job.
I kept my job and I saved a ton of money in latin america. To give you an idea, the cost of my not out of the ordinary apartment plus utilities in Austin, TX came out to about $68 per day. My housing costs in latin america ranged from $10-$40 per day. It’s hard to spend there in a day what I was doing just for rent. And that’s eating out 2-3 times per day.
So I have way more money now.
Best part is the adventure and seeing the world. Worst might be that connections are fleeting and you need to be ok with the finality of things. I think this is good overall, but what I do is I’ll travel for a while and then settle for a month or more at a CoLive arrangement. Those have the benefits of hostels in the social aspect, but you often have your own room, sometimes a dorm, and people stay for minimum amounts of time, which is often a month.
The conveniences of home can be missed a bit, but then I can rent a private room or a hotel if I want. Also, sometimes I want my me time, but then I retreat too much, so the social aspects of hostels can pull me out of that.
Buses in Latin America are great. I flew sometimes, but I have local transit passes for most places that I went to. Going between cities, I often took the bus.
I’ve been doing it for a year and a half and don’t see myself stopping. I know people that have been doing it for 7+ years. It’s whatever fits you. You don’t have to fit a mold. You can try it for short term and go back, you can do it on and off, whatever. It’s your life. Live it. haha
I sold all of my possessions and have been traveling as a digital nomad for a year and a half. It was the best thing I’ve ever done.
that would probably be better as an app, rather than a hosted service.
I run picsur. It’s not an image resizer like that. It’s like Imgur, but self-hosted and can take size arguments as part of the query. I use it to host images for a markdown based blog and keep the sizes under control.
On a side note, I recently started noticing so many sites that use full sized images regardless of the actual size it shows up on screen.
I haven’t tried those, so not really, but with open web UI, you can download and run anything, just make sure it fits in your vram so it doesn’t run on the CPU. The deep seek one is decent. I find that i like chatgpt 4-o better, but it’s still good.