Building HTM Systems

This website is under active development. Some of the development is live-coded on Archives of the live streams are here. For complete information, see github.

This is a Work In Progress. It is incomplete, it may be inaccurate, it might be confusing, or broken, or filled with grammar errors. It is under construction.

What is this?

This is an interactive technical guide to building Hierarchical Temporal Memory software systems from scratch. It will help you build a simulation of neocortex using HTM neurons. The system we create will simulate both proximal and distal dendritic synapses. We will show you how to establish proximal connections between the cells within a layer to an input space, and how spatial pooling learns spatial patterns within that space over time by activating mini-columns within the layer. You will also learn some encoding strategies to get your data into sparse binary format.

Distal connections between neurons in the active mini-columns allow sequence memory. We will show how single order temporal memory works when there is only 1 neuron in each mini-column. We’ll show how adding more cells per column creates a high-order memory. HTM neurons have predictive states. Cell populations can be inspected to extract predictions of future spatial features.

See Also