In April 2023, a few weeks after the launch of GPT-4, the Internet went wild for two new software projects with the audacious names BabyAGI and AutoGPT. “Over the past week, developers around the ...

Pretraining a modern large language model (LLM), often with ~100B parameters or more, typically involves thousands of ...

What if you could demystify one of the most fantastic technologies of our time—large language models (LLMs)—and build your own from scratch? It might sound like an impossible feat, reserved for elite ...

These new models are specially trained to recognize when an LLM is potentially going off the rails. If they don’t like how an interaction is going, they have the power to stop it. Of course, every ...

Researchers at Nvidia have developed a new technique that flips the script on how large language models (LLMs) learn to reason. The method, called reinforcement learning pre-training (RLP), integrates ...

A new academic study challenges a core assumption in developing large language models (LLMs), warning that more pre-training data may not always lead to better models. Researchers from some of the ...

A duplex speech-to-speech model changes the premise: The intelligence layer consumes audio and produces audio directly. The model can attend to what was said and how it was said—content and delivery ...

Scientists warn that current AI tests reward polite responses rather than real moral reasoning in large language models.

Researchers at TU Graz are using virtual reality and large language models to support people with autism spectrum disorder in ...