Doesn’t Twitch own all data that is written and their TOS will state something like you can’t store data yourself locally.

No, what is it? How do I try it?

Surely none of that uses a small LLM <= 3B?

There’s a difference between using it as entertainment and using it chronically. In answer to television/ films - everything in the last twenty five to thirty years is rubbish and a waste of time. I still like a blast on a cheap Chinese hand-held emulator to fill 10-20 mins or so then I put it down and forget about it.

When you adult, you have responsibilities. I’ve known children who come from successful families who have never played on a console because they’re busy doing positive things in life that will help them in future.

You also begin to realise how much of a waste of time gaming actually is.

But won’t this be a mish-mash of different docker containers and projects creating an installation, dependency, upgrade nightmare?

But its website is Chinese. Also what’s the github?

This looks interesting - do you have experience of it? How reliable / efficient is it?

Try the beta on the github repo, and use a smaller model!

I’m getting very-near real-time on my old laptop. Maybe a delay of 1-2s whilst it creates the response

I agree. it looks nice, explains the models fairly well, hides away the model settings nicely, and even recommends some initial models to get started that have low requirements. I like the concept of plugins but haven’t found a way to e.g. run python code it creates yet and display the output in the window

I’ve discovered jan.ai which is far faster than GPT4All, and visually a little nicer.

EDIT: After using it for an hour or so, it seems to crash all the time, I keep on having to reset it, and currently am facing it freezing for no reason.