Uncategorized

  • Are LLMs conscious? Today’s LLMs are missing some capabilities that we typically associate with consciousness, such as persistent memory, continuous updating, or an ability to interact with their environment. Nonetheless, the question of whether an LLM is conscious while performing inference seems valid. Some people argue that LLMs can’t possibly be conscious, because they only…

  • This article is part of the series “Permanence might be all you need“. The series documents a side project of mine in which I explore invariant learning. Also in this series: Priors and Invariants, a Primer Permanence – One Prior to Rule Them All? [coming soon] Learning Continuous Concept Spaces [coming soon] Instantiation and Feature…

  • This article is part of the series “Permanence Might Be All You Need“. The series documents a side project of mine in which I explore invariant learning. Also in this series: Priors and Invariants, a Primer Permanence – One Prior to Rule Them All? [coming soon] Learning Continuous Concept Spaces [coming soon] Instantiation and Feature…

  • The notion of object permanence, “the understanding that objects continue to exist even when they cannot be seen”, is considered an important developmental step in young children, and often used as an indicator of advanced mental capabilities in animals. But could permanence play a much more fundamental role in how intelligence forms? Could it in…