You could watch two YouTube films at once. (No but seriously 2Mb/s is too low even for just YouTube. YouTube recommends 20Mb/s. And that’s probably assuming 30hz. So you probably actually want at double or more. https://support.google.com/youtube/answer/78358)
That’s cool! I’m really interested to know how many tokens per second you can get with a really good U.2. My gut is that it won’t actually be better than the 24VRAM+96RAM cache setup this user already tested with though.
How much do you need? Show your maths. I looked it up online for my post, and the website said 1747GB, which is completely in-line with other models.
Can you link that post?
Running R1 locally isn’t realistic. But you can rent a server and run it privately on someone else’s computer. It costs about 10 per hour to run. You can run it on CPU for a little less. You need about 2TB of RAM.
If you want to run it at home, even quantized in 4 bit, you need 20 4090s. And since you can only have 4 per computer for normal desktop mainboards, that’s 5 whole extra computers too, and you need to figure out networking between them. A more realistic setup is probably running it on CPU, with some layers offloaded to 4 GPUs. In that case you’ll need 4 4090s and 512GB of system RAM. Absolutely not cheap or what most people have, but technically still within the top top top end of what you might have on your home computer. And remember this is still the dumb 4 bit configuration.
Edit: I double-checked and 512GB of RAM is unrealistic. In fact anything higher than 192 is unrealistic. (High-end) AM5 mainboards support up to 256GB, but 64GB RAM sticks are much more expensive than 48GB ones. Most people will probably opt for 48GB or lower sticks. You need a Threadripper to be able to use 512GB. Very unlikely for your home computer, but maybe it makes sense with something else you do professionally. In which case you might also have 8 RAM slots. And such a person might then think it’s reasonable to spend 3000 Euro on RAM. If you spent 15K Euro on your home computer, you might be able to run a reduced version of R1 very slowly.
a similar number of Hamas fighters have been killed during that period, the sources said
Now call me conspiratorial if you want, but I think this messaging is actually a sneaky lie to explain why they’ve killed a quarter million civilians and somewhere around zero combatants.
I’m really underwhelmed by 32B Qwen DeepSeek R1. Both in its reasoning and knowledge. Still haven’t needed to or tested it at maths, so maybe that’s where it really shines.
1.5b will run fast on just CPU I think.
Friendship ended with Nazi company. Now the Nazi country is my best friend.
Show me where the ICC charged Biden
The USA says they will kill everyone who works at the ICC if they charge Biden. I imagine you’re no fan of the ISIL caliph, but you wouldn’t tell him to his face. Biden laps his kill-count during his morning coffee.
https://www.hrw.org/news/2002/08/03/us-hague-invasion-act-becomes-law
It’s not that The Guardian buried a technical detail of the story, the protestors deliberately got close to the BBC offices, because they were protesting the BBC. The BBC is complicit in this genocide, together with The Guardian. The Guardian’s reporting is slightly uninformative in a way that shields the reader from knowing the subject’s opinion on The Guardian’s complicity.
You don’t think it matters that a news outlet is running cover for their ally? A news outlet that themselves forbid their journalists from using the word “genocide” in the context of Israel’s genocide of Palestinians until November 2024?
You know China can just buy your data, right? It’s easier than entering a monopoly and beating the dominant player.
Giant fingers
I’d like to draw attention to how every tankie who commented in this thread actually looked at the sources whereas the liberals mostly read the headline.
Can’t you guys just stop using Adrian Zens? Is no one else able to make up unhinged nonsense about China? Literally all it takes is for him to adopt a pseudonym and the credibility of the propaganda increases entirely for free.
Ah yes, because the blue party are 5.2 Zionist, they think apartheid and ethnic cleansing is the birthright of whites on all days but Sundays, while the green party is 6.8 Zionist, they think apartheid and ethnic cleaning is the birthright of whites including Sundays.
The blue party actually wanted to dismantle Israel you guys, they were just waiting for the mortgage to be paid off.