In 2024, two scientists from Google DeepMind shared the Nobel Prize in chemistry for an artificial-intelligence program called AlphaFold2. For decades, scientists had struggled to understand how ...
LLM2Vec is a simple recipe to convert decoder-only LLMs into text encoders. It consists of 3 simple steps: 1) enabling bidirectional attention, 2) training with masked next token prediction, and 3) ...