This is a good pattern because it would allow all the models to "think" a bit before giving an answer even if they don't have reasoning or thinking turn on. Just make sure you have the reasoning output before the final answer. A mistake I see all the time is having the answer outputted first then the explanation after which leaves more room for models to rationalize bad answers.

Good pattern: {"explanation": <short explanation for your answer>, "answer": <your final answer: true|false|i don't know>}

Bad pattern: {"answer": <your answer here>, "explanation": <short explanation for your answer>}

Do you understand how problematic this is?

I think we can all agree that this experiment being flawed in multiple ways is TRUE. But I think it's a great exercise in identifying common mistakes people make when using LLMs. This would be a great interview question for a prompt engineering job.

> But I think the Catholic church should start thinking about an answer to that.

Questions like these about the soul are not new. Religious philosophers have been thinking about them for hundreds of years.

Nice! Happy to see the site appearing as itself on the front page doesn't cause some crazy recursive crash :)

There are many applications. I mainly see it used for detecting drift in datasets for ML models. It has a nice benefit over the KL divergence in the case where the two distributions you're measuring have no overlap (KL won't compute, but JS will just return 0). Also, when taking its square root you get a distance rather than a divergence which allows you to compare it to JSD measurements of other distributions.

> Also, when taking its square root you get a distance

Easy conversion into a distance metric is hugely valuable to making the property amenable to KNN-based dimensionality reduction algos (and I'm sure other things I don't understand, as a non-mathematician)

Here's a library that the creator of UMAP provides (UMAP being a workhorse of dimensional reduction algos), for doing approx nearest neighbor search: https://pynndescent.readthedocs.io/en/latest/api.html#pynnde...

Say more, or say less.

When you read stuff like "existential grief" you gotta roll your eyes.

Ok Deckard

> For those looking for a more discreet way to spend quality time, my sources tell me the single-occupancy office rooms on the top floor are sometimes left unlocked.

This was an interesting little rundown on all the different libraries at Harvard made all the more enjoyable by the author's humor and wit.