• 0 Posts
  • 15 Comments
Joined 1 year ago
cake
Cake day: January 17th, 2024

help-circle

  • The torrent protocol works by having uploader (seeders) users sharing their files to downloader users (leechers). Users are topically both seeders and leechers.

    With that in mind, to seed a file means to share it with others. And yes, you need your torrent client open for that. QBitTorrent is amazing and doesn’t have much overhead in your system, plus you can limit your upload speed and net upload. Some console-based torrent apps are even lighter. No VPS required unless you have specific constraints.





  • The 1.5B version that can be run basically on anything. My friend runs it in his shitty laptop with 512MB iGPU and 8GB of RAM (inference takes 30 seconds)

    You don’t even need a GPU with good VRAM, as you can offload it to RAM (slower inference, though)

    I’ve run the 14B version on my AMD 6700XT GPU and it only takes ~9GB of VRAM (inference over 1k tokens takes 20 seconds). The 8B version takes around 5-6GB of VRAM (inference over 1k tokens takes 5 seconds)

    The numbers in your second link are waaaaaay off.