![](https://lemmy.ca/pictrs/image/0a59bb89-bf0b-412c-b7b4-83247b4158bb.jpeg)
![](https://lemmy.world/pictrs/image/8286e071-7449-4413-a084-1eb5242e2cf4.png)
That’s 128GB RAM, the GPU has 24GB VRAM. Ollama has gotten pretty smart with resource allocation. Smaller models can fit soley on my VRAM but I can still run larger models on RAM.
Mastodon: @greg@clar.ke
That’s 128GB RAM, the GPU has 24GB VRAM. Ollama has gotten pretty smart with resource allocation. Smaller models can fit soley on my VRAM but I can still run larger models on RAM.
I’ve installed Ollama on my Gaming Rig (RTX4090 with 128GB ram), M3 MacBook Pro, and M2 MacBook Air. I’m running Open WebUI on my server which can connect to multiple Ollama instances. Open WebUI has it’s own Ollama compatible API which I use for projects. I’ll only boot up my gaming rig if I need to use larger models, otherwise the M3 MacBook Pro can handle most tasks.
I’m running a search instance on a VPS so my home IP isn’t linked to my searches. The main disadvantage is that my VPS is in Toronto and I live 2hrs away so geo searches don’t work very well. For instance, if I Google “restaurants” I get results for local restaurants whereas if I Gregle (I named my search engine Gregle) I get results for results near my VPS.
DM me if you want a link to my instance to check it out. It’s open but I don’t publicize it because bad actors could ruin my IP addresses reputation with spam queries via the API.
I forgot to post an affiliate link and explain how routing all your internet traffic though one company equals security
I’m 100% secure, I have Nord VPN
Maybe someone is sneaking into your room while you’re sleeping and stuffing dryer lint up your nose ¯_(ツ)_/¯
Oops I did it again by Britney Spears
This is exactly the situation 😅
This sounds really fun! I’m putting this on my long to-do list
Religion has competition now, AI is also profiting from hallucinations that lots of people believe as fact.
That’s fair, I can appreciate an attack vector in cases where there are bad blocks and the drive was unencrypted. Luckily bad blocks are less common with modern SSDs and assuming the disk was encrypted, a few bad blocks are unlikely to expose any contents. So knowing the number of bad blocks and what data was stored would inform if a fill and empty approach would be suitable to sanitize the drive.
Fill the drive 100% using data duplicator then delete everything on the drive. Repeat a few times to ensure you scrub all blocks. There is no need to physically destroy the drive.
edit: fair criticism of this approach in cases when the data is unencryptd and the hard drives has bad blocks. I just wanted to give a counter to the destroying hardware approach which isn’t necessary warranted
Why do you believe that most people you know don’t live and are just surviving?
Have you downloaded your podcasts while I’m another country or with a VPN set in another country?
It’s not implausible, Proton has a free privacy respecting tier
Gmail was initially advertising funded while respecting privacy. It’s a false dichotomy to argue that a service can’t have a free privacy respecting offering. We’ve just become accustomed to accepting targeted advertising as the norm.
Is a fart a ghost?
Why do blind people hate skydiving?
how would anyone know if a particular name is being unused?
I have a couple of nice domain hacks and I use them for email and random services I run so the root domain appeared to be abandoned. I received so many messages from people wanting to buy them I just started pointing them at other sites so they would stop hassling me. I’ve had one of these domains for nearly 20 years and it’s my main email address. I’m not selling because it would be a year long full time job just to update all my services 😅
Fun fact, DEDSEC is a type of memory used in Soviet era mainframes.