As you may know, ChatGPT collects a lot of data on the users for the improvement of their AI, but this poses risks in its own way. I was wondering whether there are privacy alternatives to ChatGPT. Perhaps on F-Droid or Aurora/PlayStore, or for Linux.
Are there any alternatives you know of? Or are there other ways to interact with ChatGPT without giving personal information, such as a privacy focussed front-end?
33 Comments
projectmoon@lemm.ee · 17 pts · 2y
https://sh.itjust.works/c/localllama
anamethatisnt@lemmy.world · 13 pts · 2y
!localllama@sh.itjust.works
CommunityLinkFixer@lemmings.world · 9 pts · 2y
Hi there! Looks like you linked to a Lemmy community using a URL instead of its name, which doesn't work well for people on different instances. Try fixing it like this: !localllama@sh.itjust.works
NoTimeLeft@lemmy.world · 2 pts · 2y
Very helpful! Thanks!
Rolando@lemmy.world · 1 pts · 2y
also see !fosai@lemmy.world
shootwhatsmyname@lemm.ee · 17 pts · 2y
Are you able to run LLMs on your own computer?
If so:
mynamesnotrick@lemmy.zip · 2 pts · 2y
Yep, I use: https://github.com/oobabooga/text-generation-webui and currently am using this model:
mistralai/Mistral-7B-Instruct-v0.2.simple@lemm.ee · 12 pts · 2y
Be aware OP that local LLMs are quite a bit worse than what's available online. Llama 3 is (probably?) the best one available now and even that has a habit of being very stupid sometimes compared to claude or chatgpt.
NoTimeLeft@lemmy.world · 1 pts · 2y
Alright. Will keep that in mind, thanks!
shootwhatsmyname@lemm.ee · 1 pts · 2y
Phi3 is surprisingly good for its size and speed too
aleph@lemm.ee · 11 pts · 2y
I use https://huggingface.co/chat/, which is an open source alternative to ChatGPT.
Their privacy policy is here.
pineapplelover@lemm.ee · 10 pts · 2y
Ddg chat
https://duck.com/chat
RiQuY@lemm.ee · 6 pts · 2y
One of these is programming oriented but they let you choose the model so I guess it is fine:
OpenAI API alternative:
NoTimeLeft@lemmy.world · 1 pts · 2y
Good to have, I'm a bit of a programmer myself :)
anamethatisnt@lemmy.world · 4 pts · 2y
There are private GPT solutions coming, f.e. https://www.fujitsu.com/global/products/data-transformation/data-driven/ai-test-drive/
They are aimed at companies that for compliance reasons want to self host.
I wouldn't trust an llm solution with sensitive information unless I host it myself.
NoTimeLeft@lemmy.world · 2 pts · 2y
Do you happen to know how this self-hosting would work? Can I run it at my desktop/phone or even a raspberry pi? How is the quality of generated results compared to ChatGPT?
brianorca@lemmy.world · 2 pts · 2y
I can run 7B models on my laptop with its embedded GPU. Running on a phone or a Pi is possible with smaller models, but very slow. Expect good speed with a desktop Nvidea GPU. Later this year, there should be new computers with an NPU integrated to the CPU which should speed up computers that don't have a dedicated GPU. (But a GPU will still outperform them by a lot.)
70B models will run very slowly on even the best consumer hardware due to memory limitations.
a4ng3l@lemmy.world · 1 pts · 2y
Typically llm are rather ressource intensive - you need beefy hardware to run those at speed. Especially if you intend to train them with your data to improve their relevance. I don’t think mobile phones or run to the mill laptops are going to be enough for any non-trivial implementations. I might be skewed by experiences on non-personal projects though.
A1kmm@lemmy.amxl.com · 4 pts · 2y
The best option is to run them models locally. You'll need a good enough GPU - I have an RTX 3060 with 12 GB of VRAM, which is enough to do a lot of local AI work.
I use Ollama, and my favourite model to use with it is Mistral-7b-Instruct. It's a 7 billion parameter model optimised for instruction following, but usable with 4 bit quantisation, so the model takes about 4 GB of storage.
You can run it from the command line rather than a web interface - run the container for the server, and then something like
docker exec -it ollama ollama run mistral, giving a command line interface. The model performs pretty well; not quite as well on some tasks as GPT-4, but also not brain-damaged from attempts to censor it.By default it keeps a local history, but you can turn that off.
delirious_owl@discuss.online · 1 pts · 2y
Is that 12GB RAM just for the model or total?
yonder@sh.itjust.works · 2 pts · 2y
I think the GPU has 12GB of physical ram.
delirious_owl@discuss.online · 1 pts · 2y
D:
Ilandar@aussie.zone · 3 pts · 2y
CrabAndBroom@lemmy.ml · 2 pts · 2y
I've been using GPT4All and quite liking it so far.
Croquette@sh.itjust.works · 2 pts · 2y
I'm taking a chance, but which model would you use for learning new programming language?
CrabAndBroom@lemmy.ml · 3 pts · 2y
Hmm, not sure exactly. I've been using Llama3 because it seems to give decent results for most things quickly, but I haven't really done much coding with it outside of some simple bash scripts TBH.
Croquette@sh.itjust.works · 2 pts · 2y
I am looking for a basic coding AI. I don't want to create a complex software, just something to get me started by example. So bash script level is good enough for me.
AVincentInSpace@pawb.social · 2 pts · 2y
Your future coworkers will thank you if you do not use an AI for that at all
Croquette@sh.itjust.works · 3 pts · 2y
I'm talking about really basic stuff. AI is great as an entry point to a new language.
For example, in python, finding out the current folder in which the script is running or in preact, how to use simple hooks.
It's fast, and once I know the name of the functions used, I can look up the documentation I need to and find appropriate tutorials and examples.
jjlinux@lemmy.ml · 2 pts · 2y
I use venice.ai because it's browser based and does not require an account. It is somewhat limited, but it works for my extremely limited purposes.
aStonedSanta@lemm.ee · 1 pts · 2y
Anyone know if there is a way to feed a local AI some of the one notes from my job so I can search like a lazy bastard?
invisiblegorilla@sh.itjust.works · 2 pts · 2y
Yeah. You can use ollama, and openwebui. Openwebui allows you to RAG (search your own files) with little effort
Upstream7564@discuss.tchncs.de · 1 pts · 1y
tufek@sopuli.xyz · 0 pts · 2y
https://arstechnica.com/ai/2024/05/openai-will-use-reddit-posts-to-train-chatgpt-under-new-deal/ (motherfockers)
anonchatgpt.com
Upstream7564@discuss.tchncs.de · 1 pts · 1y
Zerush@lemmy.ml · 0 pts · 2y
I use Andi, which is enough for my needs, and for sure is the most private and trustworth AI out there (maybe locally hosted apart). It was the first AI chat/search ever, long before the others from Google, Bing and Fakebook. Former LazyWeb.