what was the concurrency limitation? that node should be able to support a lot more

I don't believe safetensors has a native int4 dtype, so they packed 4 int4s into a bf16 in this checkpoint.

If you're in SF and weighing this decision, it's easy to get tilted in the buy direction because the rental stock is so horrific. Landlords have very little incentive to update properties or provide basic amenities that people take for granted in other major cities (good luck getting a washer/dryer).

I wonder if there’s any reason SF has that problem yet almost no other cities do.

With the 3.5 release, the Plus model was just a rebrand of the open weight 397B. But I suspect that will change going forward. They haven’t released the weights for 3.6 but they did make it available through a few US providers.

absolutely not, take Kimi K2.6 for a spin

Isn't Kimi K2.6 natively INT4?

I don't think any models are natively INT4? I wouldn't see the point to nerf the model out-of-the-box.

It's not nerfed, it's natively trained at that quantization a.k.a. Quantization Aware Training.

QAT typically uses BF16/FP32 during the training process to simulate lower precision.

The only model I have seen like that is GPT OSS, natively quantized to MXFP4.

I don’t think this is true across Blizzard. Overwatch is the best it’s ever been.

The Steam userbase would appear to disagree, with the recent reviews being mostly negative reviews (and the user reviews for Overwatch have hovered between mixed and negative for years now). And this doesn't appear to be from review bombing by some specific subset of players, the language breakdown shows reviews ranging from mixed to negative in all major language groups (English, Russian, Chinese, etc.).

I give them a try about twice a year. I write a lot of Rust which should be squarely in their wheelhouse.

This last time I was pleasantly surprised to find they mostly fixed their SSH remote editing support. But then it started truncating rustc inline error messages and I couldn’t figure out how to view the whole thing easily. When you’re just trying to get something done little bits like this can add up quickly. Punted back to Cursor for now.

I don't like the way remote editing works with plugins. IIRC, the remote agent pulls the plugins from the connecting client. I get why it's done like that, but I'd way rather have it go the opposite direction.

I want a setup where I can have an immutable devcontainer with local copies of everything I need to develop 100% offline; dependencies, tools, etc.. Having my local editor pull plugins from a devcontainer for the project seems to make more sense to me.

I didn't dig in too much. Maybe there's a way to make it work somehow.

They are but the IDE needs to be integrated with them.

Qwen specifically calls out FIM (“fill in the middle”) support on the model card and you can see it getting confused and posting the control tokens in the example here.

Oh, that’s interesting. Thanks for the correction. I didn’t know such heavily post trained models could still do good ol fashion autocomplete.

17b per token. So when you’re generating a single stream of text (“decoding”) 17b parameters are active.

If you’re decoding multiple streams, it will be 17b per stream (some tokens will use the same expert, so there is some overlap).

When the model is ingesting the prompt (“prefilling”) it’s looking at many tokens at once, so the number of active parameters will be larger.