• theunknownmuncher@lemmy.world
    cake
    link
    fedilink
    arrow-up
    1
    ·
    10 days ago

    Qwen3.6 27b beats Claude Opus 4.5 in most benchmarks. Qwen3.6 35b beats Opus 4.5 in a few specific benchmarks, but most benchmarks have Opus 4.5 beating Qwen3.6 35b, although there is not a big gap between Opus 4.5 and Qwen3.6 27b or 35b either way.

          • theunknownmuncher@lemmy.world
            cake
            link
            fedilink
            arrow-up
            1
            ·
            10 days ago

            “I don’t think any of that is true. show me data” is shown data “I won’t accept that data!” Lol. Lmao even.

            Yeah, I’m not going to play this game of trying to anticipate which numbers you’re willing to accept and which you aren’t. You have just as equal access to a search engine as I have. All of the results I have seen align with the numbers that Qwen released and are well within margins of error.

            This model’s release caused such a stir and was a big deal due to the fact that it reproducibly meets or beats Claude Opus 4.5 while being locally runnable. If you won’t believe it, okay, I don’t care. 🤷

              • theunknownmuncher@lemmy.world
                cake
                link
                fedilink
                arrow-up
                1
                ·
                10 days ago

                I run 27b at q8 with unquantized KV cache and 256k context on two Instinct MI60 GPUs. Definitely the best model that I have been able to run locally at a reasonable speed. 35b generates tokens as fast as you’d expect from any cloud provider. 27b is slower than 35b, of course, but token generation is still faster than my reading speed and suitable with coding agents.

          • theunknownmuncher@lemmy.world
            cake
            link
            fedilink
            arrow-up
            1
            arrow-down
            1
            ·
            10 days ago

            It’s not like the Qwen team hasn’t already built a lot of trust with the community. They’ve never been misleading with previous releases, the “marketing material” (🙄) is for a free product, so they have no incentive to lie, and it would be extra stupid because anyone can run the benchmarks and verify their numbers independently anyway. What would be the point?