The article linked here seems to be a (bad) auto-translated version.
It's not uncommon for images to be incorporated in an article like this, as they typically get shared around WeChat and correspond better with the 'culture'.
What I and my team have been doing in papers is just to refer to the OpenRouter slugs. It upsets reviewers because they will complain it "is not sufficiently clear to a wider audience" but I do agree it's the cleanest approach.
Also goes to prove how much power OpenRouter has actually...
This reminded me of coming across LeoCAD (https://www.leocad.org/ - first release in 1997!) as a kid and playing around with it for endless nights, wondering how close it was to whatever tool Lego was using in-house.
Looking at screenshots of older versions gave a burst of nostalgia.
LeoCAD is really nice and smooth to work with, and on Linux a much better experience than Lego's own Bricklink Studio. Unfortunately, for instructions you can't really get away from Studio, and while importing the model made in LeoCAD works for 99% of the bricks, you tend to end up with one or two types of brick misaligned, flipped, rotated, or missing.
The input attribution part is interesting though, but I do wonder to which extent that is just assigning some sort of SHAP values to the input tokens, in which case it should be pretty portable to any kind of model.
What I typically end up doing is just recalc the slug and see if it matches the provided one. If it doesn't redirect to the most up to date slug matching the id. Though who knows if those old SEO patterns still matter these days...
My personal feel (completely subjective) is that during RLHF humans are incredibly sensitive to this pattern, especially when talking about personal or emotional issues. Any reply in the form of "it's not you, it's them" is such a dopamine hit that the LLMs started applying it for everything else.
reply