context learning

knowledge lives outside the model — retrieved and handed over at query time

model weights never change. it gets better at using external info, not at reasoning itself.

ships today

weight updates

knowledge is baked into the model via training — no lookup needed

the model itself becomes different. new knowledge interacts with existing representations.

largely unsolved