AuroraNemoia’s avatarAuroraNemoia’s Twitter Archive—№ 1,148

    1. so, you can pass up to 16 items to koboldcpp's API using "logit_bias", the dict needs to have the token IDs in quotes like this {"10864": -70} and 16 is a bit limiting, but its nice that this is here at all.
      Permalink On twitter.com Twitter logo AuroraNemoia’s avatar ❤️ 1 Favorite Mood +4 🙂
  1. …in reply to @AuroraNemoia
    if someone smarter than me could confirm if just changing the github.com/LostRuins/koboldcpp/pull/577/commits/0f839de974d0d202b43d9d8076c79f52ab5092c2 "logit_bias_max" here would be enough to unlock magical powers, please tell.
    On twitter.com Twitter logo AuroraNemoia’s avatar Mood +2 🙂