• 0 Posts
  • 9 Comments
Joined 2 years ago
cake
Cake day: June 20th, 2023

help-circle




  • Also because, as a person who has studied multiple languages, German is hard and English is Easy with capital E.

    No genders for nouns (German has three), no declinations, no conjugations other than “add an s for third person singular”, somewhat permissive grammar…

    It has its quirks, and pronunciation is the biggest one, but nowhere near German (or Russian!) declinations, Japanese kanjis, etc.

    Out of the wannabe-esperanto languages, English is in my opinion the easiest one, so I’m thankful it’s become the technical Lingua Franca.



  • I’m talking about running them in GPU, which favours the GPU even when the comparison is between an AMD Epyc and a mediocre GPU.

    If you want to run a large version of deepseek R1 locally, with many quantized models being over 50GB, I think the cheapest Nvidia GPU that fits the bill is an A100 which you might find used for 6K.

    For well under that price you can get a whole Mac Studio with those 192 GB the first poster in this thread mentioned.

    I’m not saying this is for everyone, it’s certainly not for me, but I don’t think we can dismiss that there is a real niche where Apple has a genuine value proposition.

    My old flatmate has a PhD in NLP and used to work in research, and he’d have gotten soooo much use out of >100 GB of RAM accessible to the GPU.