Qwen3.5 4B + grabbing logits is almost "Jev"? Or even just Qwen Reranker?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| | Saw the new Introducing System One Models & Jev - TypeSafe AI Blog Jev model which just outputs probabilities given choices and I thought it sounded a something the Qwen reranker models could do? Then I tried implementing it and got even better results with Qwen 4B + just assign each option to a letter and grab the logit probailities for each one. Results and samples at https://github.com/TheoLeeCJ/openjev, you can try it in your browser too at openjev.com Is there something I'm missing here? [link] [comments] |
More from r/LocalLLaMA
-
The AI race: China's open-weight models trail US closed models by just 7 months
Oct 14
-
Anthropic Executive Says Open-Source AI Models Are Higher Risk
Oct 14
-
ComfyUI v0.40.0 released
Oct 14
-
So this is how they do it --> RTX 5090, once a consumer gaming card, is now on smugglers’ menu alongside cigarettes
Oct 14
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.