Looks like it now has Docling Content Extraction Support for RAG. Has anyone used Docling much?

Oh and I typically get 16-20 tok/s running a 32b model on Ollama using Open WebUI. Also I have experienced issues with 4-bit quantization for the K/V cache on some models myself so just FYI

It really depends on how you quantize the model and the K/V cache as well. This is a useful calculator. https://smcleod.net/vram-estimator/ I can comfortably fit most 32b models quantized to 4-bit (usually KVM or IQ4XS) on my 3090’s 24 GB of VRAM with a reasonable context size. If you’re going to be needing a much larger context window to input large documents etc then you’d need to go smaller with the model size (14b, 27b etc) or get a multi GPU set up or something with unified memory and a lot of ram (like the Mac Minis others are mentioning).

This would be a great potential improvement in UX for streaming sports feeds for sure - not having to navigate web pages and start / manage streams manually etc. Does anyone know if this is possible for sites serving these streams like FirstRowSports or StreamEast etc?

Hopefully these improvements will become available to other Nvidia GPU architectures like Ada and Ampere in the future as well.

Is it possible to use StreetComplete on iOS?

I think we can all agree that modifications to these models which remove censorship and propaganda on behalf of one particular country or party is valuable for the sake of accuracy and impartiality, but reading some of the example responses for the new model I honestly find myself wondering if they haven’t gone a bit further than that by replacing some of the old non-responses and positive portrayals of China and the CPC with a highly critical perspective typified by western governments which are hostile to China (in particular the US). Even the name of the model certainly doesn’t make it sound like neutrality and accuracy is their primary aim here.

I used to daily drive Ubuntu some years ago for work/personal use but have been back on Win 10 primarily for the last 4-5 years. I was considering trying to go back due to how much Windows sucks (despite some proprietary software only being available on it) but remembering the trouble I had with some networking/printer drivers and troubleshooting those issues and then seeing this article Is definitely making me reconsider…

Yeah I use voyager pretty much exclusively on my iPhone so maybe I should request a feature like that there? Seems like it would be something that many people would appreciate. Not sure why I end up seeing posts with -10, -15 votes… Those are generally trash haha

https://lemmy.world/c/thepoliceproblem

Thanks for the info. I don’t know a ton about them but I’m honestly massively impressed at the talent of the Proton devs. The fact that they have made most games run as well and some games run better on Unix operating systems through a translation layer than on Windows (the OS they were designed for) is ridiculously impressive. And this just shows they aren’t resting on their laurels but are being proactive in preventing issues before they happen which is immensely commendable and impressive.

Thanks for the context. I figured I must be missing something since performance increases like this for proton would be huge news and likely not possible.

Anyone have more context on this? These are some pretty massive increases if the games in the table are in any way representative of all games.

True; I think I used LineageOS or similar back when I was still in Android but if you’re not in the 0.01% who do have a custom Android OS installed it seems like a privacy focused map app is still of limited use potentially.

This looks like it has come a long way, but since this is a privacy community I have to ask: Realistically, whether you are on iOS or Android, isn’t it likely Google or Apple are still tracking your location much of the time directly from the OS?

Okay, can I hijack this thread to ask the question from some fellow coffee enthusiasts: Do decaf beans actually tend to suck? I would be interested in a decaf or half-caff blend but curious what the connoisseurs think… and sorry no I haven’t searched for a post on this in the community so feel free to downvote the crap out of me / take mercy on me and link one of it exists…

As a ‘front page of the internet’ it has been a pretty great replacement for me as it’s where I go each day to just see what’s going on. However, due to the smaller size you do lose a lot of the activity in more niche communities and the sheer volume of posts/comments compared to Reddit. That’s the biggest downside. Still, you also lose the incessant ads/bad UI/UX decisions and ever accelerating late stage capitalism driven enshittification so that’s a big plus.

I there a changelog available?

Looks great! Any recommended recipes? Never tried it but love Thai generally.

What’s really going to blow your mind is when you realize that if you organize you could ultimately have any rights you want.