6 posts with this tag
In the last blog post, we discussed some of the major issues with LLM evaluation benchmarks, and why they are often a poor way of assessing model performance. So what, if anything, should replace them? One alternative you may have heard of is the …
Have you ever listened to the creators of the latest large language model talk about how their model is the "most powerful", "most intelligent" or "best" model to date, and wondered how they're measuring this? One of the most common ways this is …
Have a think back to when GPT-4 came out in March 2023. One of the key things that OpenAI highlighted in their technical report was that this model was showing near-human performance, measured by how it scored on exams designed for humans. They …
The claims of artificial general intelligence, or AGI, have been some of the hottest and most emotionally charged discussions about large language models. In addition, these claims probably have the most intellectual weight behind them of all of the …
In June 2022, a story hit international news that a Google engineer believed that one of their large language models had achieved sentience. Blake Lemoine was testing Google's conversational LLM LaMDA (the model that went on to power the original …
