Uncategorized

  • LLMs are Crystallized-Conscious

    , , ,

    Are LLMs conscious? Today’s LLMs are missing some capabilities that we typically associate with consciousness, such as persistent memory, continuous updating, or an ability to interact with their environment. Nonetheless, the question of whether an LLM is conscious while performing inference seems valid. Some people argue that LLMs can’t possibly be conscious, because they only…

  • Permanence – One Prior to Rule Them All? [Perm. 2/6]

    This article is part of the series “Permanence might be all you need“. The series documents a side project of mine in which I explore invariant learning. Also in this series: From invariant representations… In machine learning, we often represent the state of a system as vectors. Artificial neural networks take the vector representation of…

  • Priors and Invariants, a Primer [Perm. 1/6]

    This article is part of the series “Permanence Might Be All You Need“. The series documents a side project of mine in which I explore invariant learning. Also in this series: We need priors to learn If you’re already familiar with inductive priors and the No Free Lunch Theorem, feel free to skip this section.…

  • Permanence Might Be All You Need

    The notion of object permanence, “the understanding that objects continue to exist even when they cannot be seen”, is considered an important developmental step in young children, and often used as an indicator of advanced mental capabilities in animals. But could permanence play a much more fundamental role in how intelligence forms? Could it in…