We're already seeing deals on graphics cards for Black Friday, but now is just about the worst time to pick up a current-gen Nvidia graphics card.
  • state_electrician@discuss.tchncs.de
    31·
    2 years ago

    Only slightly related question: is there such a thing as an external nVidia GPU for AI models? I know I can rent cloud GPUs but I am wondering if long-term something like an external GPU might be worth it.

    • baconisaveg@lemmy.ca
      6·
      2 years ago

      A 3090 (used) is the best bang for your buck for any LLM / StableDiffusion work right now. I’ve seen external GPU enclosures, though they probably cost as much as slapping a used 3090 into a barebones rig and running it headless in a closet.

    • AnotherDirtyAnglo@lemmy.ca
      3·
      2 years ago

      Generally speaking, buying outright is always cheaper than renting, because you can always continue to run the device potentially for years, or sell it to reclaim some capital.