I know the reputation that AI has on Lemmy, however I’ve found that some users (like myself) have found that LLMs can be useful tools.
What are fellow AI users using these tools for? Furthermore, what models are you using that find the most useful?
I know the reputation that AI has on Lemmy, however I’ve found that some users (like myself) have found that LLMs can be useful tools.
What are fellow AI users using these tools for? Furthermore, what models are you using that find the most useful?
I run LLMs locally for scripting, ADD brainstorming/organization, automation, pseudo editors and all sorts of stuff, as they’re crazy good for the size now.
I think my favorites are Nemotron 49B (for STEM), Qwen3 finetunes (for code), some esoteric 2.5 finetunes (for writing), and Jamba 52B (for analysis, RAG, chat, long context, this one is very underrated). They all fit in 24GB. And before anyone asks, I know they’re unreliable, yes. But they are self hosted and tools that work for me.
I could run GLM 4.5 offloaded with a bit more RAM…