Frontends and software
  • Oobabooga’s Text Generation Web-UI (includes several backends)
  • SillyTavern (a frontend with lots of features) (You need to provide your own backend or online service. Also all the settings can be a bit overwhelming for a beginner.)
  • KoboldCPP (easy to install, works without a high-end GPU) (Download models in GGUF format. Q4_K_M or Q5_K_M quantization is recommended.)
  • KoboldAI
  • Agnaistic (Github)

(There are lots more.)

Free of charge services
Models (I recommend you start with one of these)

(This list is outdated.)

More models

Most models available in quantized GGUF format, pay attention to what you’re downloading. And choose a proper quantization level that fit’s onto your hardware. Usually that’d be 4-6 or 8bits.

Characters for roleplay
Character editors
  • Character card editor (v1 format)
  • Character card editor (v2 format)
  • Guide (Don’t pay too much attention to the old guides telling you to use a specific format. That has become obsolete. Listing properties or plain normal text is fine nowadays. But make sure to make it clear, concise and without contradictions. LLMs aren’t too smart. And have a look at the prompt format of your model and recommended settings. That really matters.)
Guides
More info

[I invite you to share and reuse my content. This text is licensed CC-BY 4.0]

  • @magn418OPMEnglish
    2•1 year ago

    Thanks, done. Help is appreciated 👍

    Yeah, I’m very GPU-poor. I do inference on my CPU using KoboldCPP.

    I think I have to go to bed soon, it’s super late here. I’m going to add more tomorrow and gladly incorporate your contributions.

      • @magn418OPMEnglish
        2•1 year ago

        Alright. Thanks for your input. I’ve made some changes.

        can you please add https://character.ai

        I’ve decided against CharacterAI because it doesn’t let you download the characters. Except you install a browser plugin/script and extract it and that’s maybe a bit complicated for someone new. And I was under the impression that Character AI cracked down on NSFW use anyways? But perhaps you meant characterhub.org ? because that and chub.ai are the same.

        Some models I recommend

        I wouldn’t recommend Pygmalion anymore, compared to the models of the recent months, it’s more a toaster in comparison and mainly does *blushing* and moaning for me. Most of the time it doesn’t really grasp the scenario. The Tiefighter I linked is by the same people(??) and way better in my opinion. And the Wizard-Uncensored ones are a bit dated. I’m not 100% sure if I want to mix them in with the others. I’ve added the Airoboros. And skimmed through the list and the ratings/benchmarks available.

        I’d rather limit this to … say … 5 of the current top favorite models total so it answers the question: “what’s the best model out there” and “what handful of models should I try first as a beginner” A list of like 300 models and then saying good luck figuring it out is maybe not the best. But we can always have a seperate thread for that. Maybe we could add what a specific model excels at, if it gets a convoluted list. But I’m happy to discuss and compare our favorite models and add them, just let’s try and keep the list short in this guide.

        character editor

        added to the list

        if you ever feel like starting a Character Sharing (etc) thread

        Go ahead. I -personally- am not yet decided where this should be headed. If you like something, feel free to just do it. I’d also make all of my info editable to you and everyone. But as far as I know Lemmy doesn’t have Wikis available (yet).

        My preliminary vision is to offer an alternative to Discord where every discussion happens behind closed doors. And to provide some info specifically about ERP because some of the general advice regarding LLMs doesn’t really translate into the realm of sex. And maybe offer quality, because there are lots of places already where character cards get shared and models get uploaded, but quantity isn’t quality and a big pile of convoluted things doesn’t really help. Unless you already exactly know what you’re looking for.

        And I would really like to read stories generated by other people. longer Chatlogs, and see what other people do.