14 Apr 2020
Jeff Hawkins and Subutai Ahmad take questions from the community. More details at https://discourse.numenta.org/t/numenta-office-hours-april-14-2020/7357
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 10 participants
- 1:08 hours
7 Apr 2020
Details at [https://discourse.numenta.org/t/big-htm-hackers-hangout-april-7-2020/7258](https://discourse.numenta.org/t/big-htm-hackers-hangout-april-7-2020/7258) -- Watch live at https://www.twitch.tv/rhyolight_
- 13 participants
- 1:33 hours
18 Mar 2020
Florian Fiebig discusses his attendance at COSYNE 2020.
Discussion at https://discourse.numenta.org/t/cosyne-2020-recap-numenta-research-mar-9/7268
Part 1: https://youtu.be/BLBPqIOyMgo
Part 2: https://youtu.be/JM5DE2BChT0
Discussion at https://discourse.numenta.org/t/cosyne-2020-recap-numenta-research-mar-9/7268
Part 1: https://youtu.be/BLBPqIOyMgo
Part 2: https://youtu.be/JM5DE2BChT0
- 7 participants
- 50 minutes
16 Mar 2020
This paper describes a model of how an animal might use grid cells, place cells, and border cells to navigate in complex environments. It was an excellent summary of existing ideas and it introduced several things we were not aware of that could be important for understanding how a cortical column works.
Read paper at https://onlinelibrary.wiley.com/doi/10.1002/hipo.23147
Discuss at https://discourse.numenta.org/t/navigating-with-grid-and-place-cells-in-cluttered-environments-paper-review/7296
Read paper at https://onlinelibrary.wiley.com/doi/10.1002/hipo.23147
Discuss at https://discourse.numenta.org/t/navigating-with-grid-and-place-cells-in-cluttered-environments-paper-review/7296
- 8 participants
- 1:21 hours
24 Feb 2020
This is the 2nd part of Aries' talk. The first half is here: https://youtu.be/L8PzquwMV6A
Discuss at: https://discourse.numenta.org/t/numenta-research-meeting-feb-19-2020-part-2/7239
Paper: https://www.nature.com/articles/nn.4385
Discuss at: https://discourse.numenta.org/t/numenta-research-meeting-feb-19-2020-part-2/7239
Paper: https://www.nature.com/articles/nn.4385
- 5 participants
- 1:18 hours
19 Feb 2020
Numenta Research Meeting - Feb 19, 2020
Discussion at: https://discourse.numenta.org/t/numenta-research-meeting-feb-25-2020/7238
Paper: https://www.cell.com/neuron/fulltext/S0896-6273(16)30707-3
Discussion at: https://discourse.numenta.org/t/numenta-research-meeting-feb-25-2020/7238
Paper: https://www.cell.com/neuron/fulltext/S0896-6273(16)30707-3
- 5 participants
- 33 minutes
12 Feb 2020
Continuing conversation about traveling waves (see NRM from Feb 12).
- https://www.nature.com/articles/nature08010
- https://www.ncbi.nlm.nih.gov/pubmed/22072668
Discussion at https://discourse.numenta.org/t/implications-of-traveling-waves-nrm-feb-12-2020/7188
- https://www.nature.com/articles/nature08010
- https://www.ncbi.nlm.nih.gov/pubmed/22072668
Discussion at https://discourse.numenta.org/t/implications-of-traveling-waves-nrm-feb-12-2020/7188
- 4 participants
- 1:15 hours
12 Feb 2020
Jeff Hawkins will talk about some papers he is reading on traveling theta waves, and how they might work in primary sensory cortex.
- https://www.nature.com/articles/nature08010
- https://www.ncbi.nlm.nih.gov/pubmed/22072668
- https://www.nature.com/articles/nature08010
- https://www.ncbi.nlm.nih.gov/pubmed/22072668
- 5 participants
- 50 minutes
10 Feb 2020
Numenta Research Meeting, with Marcus Lewis presenting a writeup on Backprop-Trained Permanences. See it at https://github.com/mrcslws/nupic.research/blob/backprop-structure/projects/backprop_structure/documents/backprop-permanences/backprop-permanences.pdf
Discussion at https://discourse.numenta.org/t/backprop-trained-permanences-nrm-feb-10-2020/7166.
Discussion at https://discourse.numenta.org/t/backprop-trained-permanences-nrm-feb-10-2020/7166.
- 5 participants
- 25 minutes
5 Feb 2020
Some discussion of Local Field Potential (LFP) from Florian, probably some random discussion of other things.
https://discourse.numenta.org/t/numenta-research-meeting-feb-5-2020/7147
https://discourse.numenta.org/t/numenta-research-meeting-feb-5-2020/7147
- 6 participants
- 35 minutes
24 Jan 2020
Florian's ideas after reading the following paper:
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3972729/
A Hybrid Oscillatory Interference/Continuous Attractor Network Model of Grid Cell Firing
Daniel Bush and Neil Burgess
Grid cells in the rodent medial entorhinal cortex exhibit remarkably regular spatial firing patterns that tessellate all environments visited by the animal. Two theoretical mechanisms that could generate this spatially periodic activity pattern have been proposed: oscillatory interference and continuous attractor dynamics. Although a variety of evidence has been cited in support of each, some aspects of the two mechanisms are complementary, suggesting that a combined model may best account for experimental data. The oscillatory interference model proposes that the grid pattern is formed from linear interference patterns or “periodic bands” in which velocity-controlled oscillators integrate self-motion to code displacement along preferred directions. However, it also allows the use of symmetric recurrent connectivity between grid cells to provide relative stability and continuous attractor dynamics. Here, we present simulations of this type of hybrid model, demonstrate that it generates intracellular membrane potential profiles that closely match those observed in vivo, addresses several criticisms aimed at pure oscillatory interference and continuous attractor models, and provides testable predictions for future empirical studies.
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3972729/
A Hybrid Oscillatory Interference/Continuous Attractor Network Model of Grid Cell Firing
Daniel Bush and Neil Burgess
Grid cells in the rodent medial entorhinal cortex exhibit remarkably regular spatial firing patterns that tessellate all environments visited by the animal. Two theoretical mechanisms that could generate this spatially periodic activity pattern have been proposed: oscillatory interference and continuous attractor dynamics. Although a variety of evidence has been cited in support of each, some aspects of the two mechanisms are complementary, suggesting that a combined model may best account for experimental data. The oscillatory interference model proposes that the grid pattern is formed from linear interference patterns or “periodic bands” in which velocity-controlled oscillators integrate self-motion to code displacement along preferred directions. However, it also allows the use of symmetric recurrent connectivity between grid cells to provide relative stability and continuous attractor dynamics. Here, we present simulations of this type of hybrid model, demonstrate that it generates intracellular membrane potential profiles that closely match those observed in vivo, addresses several criticisms aimed at pure oscillatory interference and continuous attractor models, and provides testable predictions for future empirical studies.
- 3 participants
- 1:37 hours
24 Jan 2020
Invariance vs. Equivariance (presented by Marcus Lewis)
http://dicarlolab.mit.edu/sites/dicarlolab.mit.edu/files/pubs/dicarlo%20and%20cox%202007.pdf
Discussion at https://discourse.numenta.org/t/numenta-research-invariance-vs-equivariance-jan-24-2020/7115
http://dicarlolab.mit.edu/sites/dicarlolab.mit.edu/files/pubs/dicarlo%20and%20cox%202007.pdf
Discussion at https://discourse.numenta.org/t/numenta-research-invariance-vs-equivariance-jan-24-2020/7115
- 4 participants
- 1:11 hours
21 Jan 2020
Presentation given by Matt Taylor of Numenta at the "Towards AGI" Meetup at UCSC Silicon Valley Extension.
Original live stream at https://www.youtube.com/watch?v=qVKVj4nx-mE
Original live stream at https://www.youtube.com/watch?v=qVKVj4nx-mE
- 8 participants
- 60 minutes
24 Dec 2019
Join Matt Taylor and his online community watch this historic debate live between Gary Marcus and Yoshua Bengio Dec 23rd. They voted on the best debater and discussed the content and generally had a good time watching the debate. See original Twitch video at https://www.twitch.tv/videos/525773366.
Original event details: https://www.eventbrite.ca/e/debate-yoshua-bengio-gary-marcus-live-streaming-tickets-81620778947#
Original event details: https://www.eventbrite.ca/e/debate-yoshua-bengio-gary-marcus-live-streaming-tickets-81620778947#
- 10 participants
- 2:06 hours
4 Dec 2019
Marcus Lewis will draw a connection between the "Sparse Manifold Transform" paper and Numenta's general "location" idea.
http://papers.nips.cc/paper/8251-the-sparse-manifold-transform
Discussion at https://discourse.numenta.org/t/numenta-research-meeting-dec-4-2019/6881
http://papers.nips.cc/paper/8251-the-sparse-manifold-transform
Discussion at https://discourse.numenta.org/t/numenta-research-meeting-dec-4-2019/6881
- 6 participants
- 1:17 hours
20 Nov 2019
Topic is "Does sparsity help Continual Learning?"
Hosted by Vincenzo Lomonaco.
Hosted by Vincenzo Lomonaco.
- 9 participants
- 1:18 hours
28 Oct 2019
Moving forward on the STP model to show the first application (beyond merely matching electrophysiology), a working memory model by Mongillo,Barak &Tsodyks (https://science.sciencemag.org/content/319/5869/1543). Free PDF access through here: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.352.9618&rep=rep1&type=pdf
- 6 participants
- 59 minutes
23 Oct 2019
I'll probably touch on both these papers, although the first one is more essential reading than the second.
- Cortical mechanisms of action selection:the affordance competition hypothesis http://www.cisek.org/pavel/Pubs/Cisek2007.pdf
- Resynthesizing behavior through phylogenetic refinement https://link.springer.com/content/pdf/10.3758%2Fs13414-019-01760-1.pdf
The interesting thing to me in these models is the similarities between "affordances" in Cisek's models and "objects" in our models.
- Cortical mechanisms of action selection:the affordance competition hypothesis http://www.cisek.org/pavel/Pubs/Cisek2007.pdf
- Resynthesizing behavior through phylogenetic refinement https://link.springer.com/content/pdf/10.3758%2Fs13414-019-01760-1.pdf
The interesting thing to me in these models is the similarities between "affordances" in Cisek's models and "objects" in our models.
- 9 participants
- 1:07 hours
27 Sep 2019
The very interesting and recently published paper at ICLR2019 studying the impact of sparsity in the context of Continual Learning:
https://openreview.net/forum?id=Bkxbrn0cYX
Related: Continual Learning via Neural Pruning
Siavash Golkar, Michael Kagan, Kyunghyun Cho https://arxiv.org/abs/1903.04476
https://openreview.net/forum?id=Bkxbrn0cYX
Related: Continual Learning via Neural Pruning
Siavash Golkar, Michael Kagan, Kyunghyun Cho https://arxiv.org/abs/1903.04476
- 6 participants
- 2:07 hours
20 Sep 2019
Paper review: https://arxiv.org/abs/1804.02464 "Differentiable plasticity: training plastic neural networks with backpropagation"
It is aimed to be a connection between the work we are doing, with structural plasticity through Hebbian learning, and continual learning.
Will possibly review a 2nd paper: "Backpropamine: training self-modifying neural networks with differentiable neuromodulated plasticity"
https://openreview.net/forum?id=r1lrAiA5Ym
Subutai, time-willing, will go over "Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties"
https://www.nature.com/articles/338334a0
It is aimed to be a connection between the work we are doing, with structural plasticity through Hebbian learning, and continual learning.
Will possibly review a 2nd paper: "Backpropamine: training self-modifying neural networks with differentiable neuromodulated plasticity"
https://openreview.net/forum?id=r1lrAiA5Ym
Subutai, time-willing, will go over "Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties"
https://www.nature.com/articles/338334a0
- 6 participants
- 54 minutes
18 Sep 2019
https://link.springer.com/article/10.1007/s10827-019-00729-1 from visiting scientist Florian Fiebig. He says:
Its a brief 6 page paper, and I think it can serve as a neat introduction to the kinds of spiking neural networks and model thinking about the cortical microcircuit I was working on for my PhD.
The main idea in short:
Many Hebbian Learning Rules violate Dale's principle (A neuron cannot be both excitatory and inhibitory, all its axons release the same neurotransmitter) in the course of dynamic synaptic weight learning, because it this may change the sign of an individual connection. On the example of a reduced cortical microcircuit originally built as an attractor model of working memory, we show how biological cortex might instead learn negative correlations through a di-synaptic circuit involving double bouquet cells (DBC). These cells are very particular in the way they are distributed regularly across the cortical surface and innervate the whole minicolumn below without affecting neighboring columns. "Indeed, disregarding some exceptions, there appears to be one DBC horsetail per minicolumn"
Its a brief 6 page paper, and I think it can serve as a neat introduction to the kinds of spiking neural networks and model thinking about the cortical microcircuit I was working on for my PhD.
The main idea in short:
Many Hebbian Learning Rules violate Dale's principle (A neuron cannot be both excitatory and inhibitory, all its axons release the same neurotransmitter) in the course of dynamic synaptic weight learning, because it this may change the sign of an individual connection. On the example of a reduced cortical microcircuit originally built as an attractor model of working memory, we show how biological cortex might instead learn negative correlations through a di-synaptic circuit involving double bouquet cells (DBC). These cells are very particular in the way they are distributed regularly across the cortical surface and innervate the whole minicolumn below without affecting neighboring columns. "Indeed, disregarding some exceptions, there appears to be one DBC horsetail per minicolumn"
- 5 participants
- 1:56 hours
16 Sep 2019
Marcus talks about sparsity in neural networks across Deep Learning and HTM, and Jeff talks about building bridges between the two spaces.
- 6 participants
- 60 minutes
13 Sep 2019
Paper review: https://www.researchgate.net/publication/26753678_Holtmaat_A_Svoboda_K_Experience-dependent_structural_synaptic_plasticity_in_the_mammalian_brain_Nat_Rev_Neurosci_10_647-658
Holtmaat A, Svoboda K. Experience-dependent structural synaptic plasticity in the mammalian brain.
Also: https://www.ncbi.nlm.nih.gov/pubmed/26354919
Holtmaat A, Svoboda K. Experience-dependent structural synaptic plasticity in the mammalian brain.
Also: https://www.ncbi.nlm.nih.gov/pubmed/26354919
- 3 participants
- 45 minutes
5 Sep 2019
(Previous version had missing content) Jeff talks and asks a lot of questions.
- 8 participants
- 1:14 hours
4 Sep 2019
We experienced an internet outage in the office during this video, a complete video is here: https://youtu.be/Hw6rA4Hq24k
- 6 participants
- 39 minutes
3 Sep 2019
How all level of visual hierarchy are doing object recognition on sensory input and informing each other via lateral connections, even without the hierarchical connections. An explanation of the Thousand Brains Theory of Intelligence.
- 1 participant
- 10 minutes
30 Aug 2019
Yes, we're reviewing our own paper. :P Two newer Numenta hires are going to review our latest theoretical neuroscience paper. This is more for the benefit of the new hires to completely understand the Thousand Brains Theory of Intelligence.
- 7 participants
- 1:51 hours
20 Aug 2019
Some presentation slides posted on the meetup page: https://www.meetup.com/BraIns-Bay/events/263945823/
0:00 Subutai Ahmad - Sparsity in the Neocortex
24:05 Lucas Souza - Literature Review
43:46 Hattie Zhou - Deconstructing Lottery Tickets
1:19:00 Gorden Wilson - Sparsity in Hardware
0:00 Subutai Ahmad - Sparsity in the Neocortex
24:05 Lucas Souza - Literature Review
43:46 Hattie Zhou - Deconstructing Lottery Tickets
1:19:00 Gorden Wilson - Sparsity in Hardware
- 12 participants
- 2:00 hours
19 Aug 2019
Numenta Journal Club reviews: https://arxiv.org/abs/1712.01312
Discussion at https://discourse.numenta.org/t/learning-sparse-neural-networks-through-l0-regularization/6471/10
Discussion at https://discourse.numenta.org/t/learning-sparse-neural-networks-through-l0-regularization/6471/10
- 5 participants
- 41 minutes
16 Aug 2019
Numenta Journal Club - Aug 16, 2019
Weight Agnostic Neural Networks:
https://arxiv.org/abs/1906.04358
The is a fairly new paper (Jun 11) that reinforces the implication of the Lottery Ticket Hypothesis: that the weights of a network don’t matter as much as people think and there’s a lot of importance in the structure of a network.
Discussion at https://discourse.numenta.org/t/weight-agnostic-neural-networks/6467
Weight Agnostic Neural Networks:
https://arxiv.org/abs/1906.04358
The is a fairly new paper (Jun 11) that reinforces the implication of the Lottery Ticket Hypothesis: that the weights of a network don’t matter as much as people think and there’s a lot of importance in the structure of a network.
Discussion at https://discourse.numenta.org/t/weight-agnostic-neural-networks/6467
- 6 participants
- 1:04 hours
14 Aug 2019
With Numenta founder Jeff Hawkins.
Aug 14 Numenta Research Meeting
Aug 14 Numenta Research Meeting
- 8 participants
- 1:29 hours
9 Aug 2019
In the last live-stream Jeff did at https://www.youtube.com/watch?v=Z7ot3eNz3aw, I stopped the stream and the conversation kept going! I should have kept rolling, but here is a backup recording from Marcus's computer in case you would like to watch.
- 6 participants
- 31 minutes
9 Aug 2019
GPU Kernels for Block-Sparse Weights
https://openai.com/blog/block-sparse-gpu-kernels/
https://d4mucfpksywv.cloudfront.net/blocksparse/blocksparsepaper.pdf
Discussion at https://discourse.numenta.org/t/openai-paper-review-gpu-kernels-for-block-sparse-weights/6440
https://openai.com/blog/block-sparse-gpu-kernels/
https://d4mucfpksywv.cloudfront.net/blocksparse/blocksparsepaper.pdf
Discussion at https://discourse.numenta.org/t/openai-paper-review-gpu-kernels-for-block-sparse-weights/6440
- 7 participants
- 35 minutes
7 Aug 2019
This is just a recap of the Deep Learning portion of the event.
A recap by Lucas Souza, Numenta Research Engineer.
Numenta Research Meeting - Aug 7 2019
Discuss at https://discourse.numenta.org/t/deep-learning-reinforcement-learning-summer-school-2019-recap/6434/2
A recap by Lucas Souza, Numenta Research Engineer.
Numenta Research Meeting - Aug 7 2019
Discuss at https://discourse.numenta.org/t/deep-learning-reinforcement-learning-summer-school-2019-recap/6434/2
- 7 participants
- 1:05 hours
5 Aug 2019
Jeff Hawkins describes minicolumns and Spatial Pooling. Discussion at https://discourse.numenta.org/t/jeff-on-minicolumns-spatial-pooling/6401.
- 5 participants
- 52 minutes
23 Jul 2019
Paper review of "Learning distant cause and effect using only local and immediate credit assignment" (https://arxiv.org/abs/1905.11589)
Discuss at https://discourse.numenta.org/t/paper-review-of-recurrent-sequence-memory/6357
Discuss at https://discourse.numenta.org/t/paper-review-of-recurrent-sequence-memory/6357
- 6 participants
- 1:05 hours
22 Jul 2019
Jeff Hawkins gives a talk about how he thinks about neurons and modeling them. This will be focused on internal engineers, but Jeff is fine with us live-streaming it as well.
Discussion at https://discourse.numenta.org/t/how-to-model-neurons-with-jeff-hawkins/6350
Discussion at https://discourse.numenta.org/t/how-to-model-neurons-with-jeff-hawkins/6350
- 5 participants
- 1:17 hours
22 Jul 2019
"Temporal Memory via Recurrent Sparse Memory-like models" - topic from Jeremy Gordon https://twitter.com/onejgordon
Discuss at https://discourse.numenta.org/t/temporal-memory-via-rsm-like-models/6345
Discuss at https://discourse.numenta.org/t/temporal-memory-via-rsm-like-models/6345
- 4 participants
- 28 minutes
19 Jul 2019
For this Friday’s journal club, we will be looking at a recently published paper by Bruno Olshausen at the Redwood Institute. It is about a more plausible algorithm in terms of biological constraints. It also ties well with the latest discussions on Continuous Learning, it provides an ingenious and elegant approach to the catastrophic forgetting problem in multitask learning.
Here is the link to the paper: https://arxiv.org/abs/1902.05522
Here is the link to the paper: https://arxiv.org/abs/1902.05522
- 5 participants
- 44 minutes
17 Jul 2019
Subutai will quickly review Elon Musk & Neuralink's new paper and we will discuss. https://www.biorxiv.org/content/10.1101/703801v1
- 6 participants
- 33 minutes
15 Jul 2019
We'll add another visualization to display a stack-ranked minicolumn competition, as community viewer Falco suggested.
- 2 participants
- 2:27 hours
12 Jul 2019
We have a visitor who recently finished her PhD at Purdue, and will be starting as a professor at Yale in August. She has an upcoming paper to be published in Nature called "Towards Spike-based Machine Intelligence with Neuromorphic Computing". She will be discussing this work with us at our Numenta Research Meeting.
- 5 participants
- 1:54 hours
11 Jul 2019
What is Continuous Learning? Borrowing from a recently released survey [1], "Continual learning (CL) is a particular machine learning paradigm where the data distribution and learning objective changes through time, or where all the training data and objective criteria are never available at once".
We will try to answer a few questions, and reviewing the existing literature is a way towards answering those questions:
- How is it defined in the literature?
- What are the most common approaches?
- How do current approaches relate to biology and neuroscience?
- What are the limitations and open questions?
- What are future research directions?
As a reminder, our meetups are journal clubs, so we invite participants to read on the topic beforehand and join the discussion.
https://www.meetup.com/BraIns-Bay/events/262647238/
Review papers:
[1] Continuous Learning for Robotics (https://arxiv.org/abs/1907.00182)
[2] Continual Lifelong Learning with Neural Networks: A Review (https://arxiv.org/abs/1802.07569)
Additional Literature:
[3] Overcoming Catastrophic Forgetting in Neural Networks (https://arxiv.org/abs/1612.00796)
[4] Continual Learning via Neural Pruning (https://arxiv.org/abs/1903.04476)
[5] Superposition of Many Models Into One (https://arxiv.org/abs/1902.05522)
0:00 Lucas Souza
1:18:09 Sam Heiserman
We will try to answer a few questions, and reviewing the existing literature is a way towards answering those questions:
- How is it defined in the literature?
- What are the most common approaches?
- How do current approaches relate to biology and neuroscience?
- What are the limitations and open questions?
- What are future research directions?
As a reminder, our meetups are journal clubs, so we invite participants to read on the topic beforehand and join the discussion.
https://www.meetup.com/BraIns-Bay/events/262647238/
Review papers:
[1] Continuous Learning for Robotics (https://arxiv.org/abs/1907.00182)
[2] Continual Lifelong Learning with Neural Networks: A Review (https://arxiv.org/abs/1802.07569)
Additional Literature:
[3] Overcoming Catastrophic Forgetting in Neural Networks (https://arxiv.org/abs/1612.00796)
[4] Continual Learning via Neural Pruning (https://arxiv.org/abs/1903.04476)
[5] Superposition of Many Models Into One (https://arxiv.org/abs/1902.05522)
0:00 Lucas Souza
1:18:09 Sam Heiserman
- 19 participants
- 1:54 hours
10 Jul 2019
We have a visiting scholar Theivendiram Pranavan from National University of Singapore who'll be talking about his work on unsupervised continuous machine learning.
- 6 participants
- 37 minutes
8 Jul 2019
We need to add a period to the current active duty cycles as well as implementing overlap duty cycles.
- 3 participants
- 2:20 hours
8 Jul 2019
Live Numenta Research Meeting. Adding scale-invariance to our model.
- 4 participants
- 1:12 hours
5 Jul 2019
I will be reviewing the current prose for the Spatial Pooling page and continuing to write about the minicolumn competition and active duty cycles.
- 2 participants
- 2:00 hours
5 Jul 2019
HTM Hackers’ Hangout is a live monthly Google Hangout held for our online community. Anyone is free to join in the discussion either by connecting directly to the hangout or commenting on the YouTube video during the live stream.
More info on all these topics at Discuss at https://discourse.numenta.org/t/htm-hackers-hangout-july-5-2019/6240
More info on all these topics at Discuss at https://discourse.numenta.org/t/htm-hackers-hangout-july-5-2019/6240
- 4 participants
- 43 minutes
1 Jul 2019
Writing a prose description of Spatial Pooling for https://building-htm-systems.herokuapp.com/spatial-pooling
- 2 participants
- 3:00 hours
1 Jul 2019
Marcus is further investigating Capsules and how they might inform HTM (and vice versa?)
- 6 participants
- 1:01 hours
25 Jun 2019
BHTMS - Finish up SP learning and start Active Duty Cycles -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 1:38 hours
21 Jun 2019
https://www.re-work.co/events/ -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 1:07 hours
18 Jun 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 2:41 hours
17 Jun 2019
For details and discussion, go to https://discourse.numenta.org/t/connecting-hintons-capsules-to-numenta-research/6160
This morning, Marcus is planning on discussing capsules on the whiteboard, connecting them to our work.
Here are 3 Hinton capsules papers and 1 talk.
2011 Paper: http://www.cs.toronto.edu/~hinton/absps/transauto6.pdf
2017 Paper: http://www.cs.toronto.edu/~hinton/absps/DynamicRouting.pdf
2018 Paper: http://www.cs.toronto.edu/~hinton/absps/EMcapsules.pdf
2014 Talk: https://www.youtube.com/watch?v=rTawFwUvnLE
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
This morning, Marcus is planning on discussing capsules on the whiteboard, connecting them to our work.
Here are 3 Hinton capsules papers and 1 talk.
2011 Paper: http://www.cs.toronto.edu/~hinton/absps/transauto6.pdf
2017 Paper: http://www.cs.toronto.edu/~hinton/absps/DynamicRouting.pdf
2018 Paper: http://www.cs.toronto.edu/~hinton/absps/EMcapsules.pdf
2014 Talk: https://www.youtube.com/watch?v=rTawFwUvnLE
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 5 participants
- 54 minutes
17 Jun 2019
Discussion at https://discourse.numenta.org/t/icml-2019-recap/6161
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 34 minutes
12 Jun 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 2:12 hours
10 Jun 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 5 participants
- 1:24 hours
10 Jun 2019
Review of paper in bioarxiv: https://www.biorxiv.org/content/10.1101/657114v1
Layer 6 ensembles can selectively regulate the behavioral impact and layer-specific representation of sensory deviants
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
Layer 6 ensembles can selectively regulate the behavioral impact and layer-specific representation of sensory deviants
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 43 minutes
8 Jun 2019
Review of the paper Scalable training of artificial neural networks and how it relates to our ongoing research on applying sparsity to neural networks (https://www.nature.com/articles/s41467-018-04316-3).
Additional papers reviewed to set the background for the discussion:
1) Rethinking the Value of Network Pruning (https://arxiv.org/abs/1810.05270): structured pruning using several different approaches, reinitialize remaining weights to random values.
2) The Lottery Ticket Hypothesis (https://arxiv.org/abs/1803.03635): Finding Sparse, Trainable Neural Networks: unstructured pruning based on the magnitude of final weights, set remaining weights to initial values.
3) Deconstructing Lottery Tickets (https://arxiv.org/abs/1905.01067): Zeros, Signs, and the Supermask: unstructured pruning based on the magnitude of final weights or the magnitude increase, set weights to constants with same sign as previous initial values.
Structured pruning usually refers to changing the network architecture, like removing a filter or a layer.
Unstructured pruning is “sparsifying”, killing the connections by setting the weights to zero and freezing.
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
Additional papers reviewed to set the background for the discussion:
1) Rethinking the Value of Network Pruning (https://arxiv.org/abs/1810.05270): structured pruning using several different approaches, reinitialize remaining weights to random values.
2) The Lottery Ticket Hypothesis (https://arxiv.org/abs/1803.03635): Finding Sparse, Trainable Neural Networks: unstructured pruning based on the magnitude of final weights, set remaining weights to initial values.
3) Deconstructing Lottery Tickets (https://arxiv.org/abs/1905.01067): Zeros, Signs, and the Supermask: unstructured pruning based on the magnitude of final weights or the magnitude increase, set weights to constants with same sign as previous initial values.
Structured pruning usually refers to changing the network architecture, like removing a filter or a layer.
Unstructured pruning is “sparsifying”, killing the connections by setting the weights to zero and freezing.
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 43 minutes
7 Jun 2019
Establishing the initial permanence values for the spatial pooling algorithm.
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 6 participants
- 2:24 hours
7 Jun 2019
https://discourse.numenta.org/t/htm-hackers-hangout/6106
https://github.com/htm-community/building-htm-systems
https://discourse.numenta.org/t/other-htm-projects/2163
https://discourse.numenta.org/t/exploring-the-repeating-inputs-problem/5498
https://github.com/htm-community/building-htm-systems
https://discourse.numenta.org/t/other-htm-projects/2163
https://discourse.numenta.org/t/exploring-the-repeating-inputs-problem/5498
- 4 participants
- 43 minutes
6 Jun 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 25 participants
- 3:11 hours
6 Jun 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 6 participants
- 1:52 hours
4 Jun 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 7 participants
- 2:37 hours
4 Jun 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 5 participants
- 1:37 hours
31 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 2:21 hours
31 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 1:37 hours
31 May 2019
Orientation and object composition and reference frames.
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 1:17 hours
31 May 2019
Courage and wit have served thee well.
Thou hast been promoted to the next level.
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
Thou hast been promoted to the next level.
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 9 minutes
30 May 2019
Showing off my kids and some sounds for subscribers. -- Watch live at https://www.twitch.tv/rhyolight_
- 1 participant
- 11 minutes
29 May 2019
My broadcasting software crashed in the middle of this stream, so I had to cut it up into pieces. Sorry about the previous botched video. This one has sound throughout.
-- Watch live at https://www.twitch.tv/rhyolight_
-- Watch live at https://www.twitch.tv/rhyolight_
- 7 participants
- 1:25 hours
24 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 5 participants
- 2:31 hours
23 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 1:04 hours
23 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 2:05 hours
22 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 1:01 hours
20 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 1 participant
- 10 minutes
20 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 13 minutes
20 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 1:19 hours
20 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 1:14 hours
20 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 1 participant
- 14 minutes
17 May 2019
A thought experiment, started on Twitter at https://twitter.com/rhyolight/status/1129047857250484224
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 1 participant
- 9 minutes
17 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 5 participants
- 4:04 hours
17 May 2019
HTM Community chat, forum Q&A, shenanigans.
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 44 minutes
13 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 1:28 hours
13 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 1 participant
- 10 minutes
13 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 5 participants
- 19 minutes
12 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 1:00 hours
11 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 1:19 hours
10 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 20 minutes
10 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 1:05 hours
10 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 40 minutes
9 May 2019
A description of the current HTM research repositories, and a vision of python HTM project future. Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 1 participant
- 8 minutes
6 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 45 minutes
6 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 1:14 hours
6 May 2019
An explanation of HTM sequence memory. -- Watch live at https://www.twitch.tv/rhyolight_
- 1 participant
- 10 minutes
3 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 1 participant
- 14 minutes
3 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 13 minutes
2 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 2:44 hours
2 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 1 participant
- 29 minutes
1 May 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 5 participants
- 25 minutes
29 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 32 minutes
29 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 15 minutes
29 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 9 minutes
28 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 1:04 hours
27 Apr 2019
https://discourse.numenta.org/t/issue-with-getting-anomaly-parameters-instead-of-swarming/5754/30 -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 27 minutes
26 Apr 2019
https://discourse.numenta.org/t/issue-with-getting-anomaly-parameters-instead-of-swarming/5754/30 -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 40 minutes
26 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 1:08 hours
25 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 1:18 hours
25 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 5 participants
- 3:09 hours
24 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 5 participants
- 36 minutes
23 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 1:01 hours
23 Apr 2019
I got some help from community members to add LaTeX and code syntax highlighting React components. Really happy that people are helping me out with the details. I also got simplehtm in place as the encoder engine. -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 1:54 hours
22 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 1:20 hours
22 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 5 participants
- 1:06 hours
19 Apr 2019
Creating a C++ Spatial Pooler in Python 3 through pybind. -- Watch live at https://www.twitch.tv/rhyolight_
- 1 participant
- 13 minutes
12 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 3:34 hours
12 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 2:44 hours
12 Apr 2019
It already worked. -- Watch live at https://www.twitch.tv/rhyolight_
- 1 participant
- 6 minutes
11 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 24 minutes
10 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 1:11 hours
10 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 5 participants
- 26 minutes
8 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 1:00 hours
5 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 1 participant
- 7 minutes
5 Apr 2019
Discuss at https://discourse.numenta.org/t/htm-hackers-hangout-apr-5-2019/5735
HTM Hackers’ Hangout is a live monthly Google Hangout held for our online community. Anyone is free to join in the discussion either by connecting directly to the hangout or commenting on the YouTube video during the live stream.
More info on all these topics at http://numenta.org.
HTM Hackers’ Hangout is a live monthly Google Hangout held for our online community. Anyone is free to join in the discussion either by connecting directly to the hangout or commenting on the YouTube video during the live stream.
More info on all these topics at http://numenta.org.
- 8 participants
- 1:03 hours
4 Apr 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 1:09 hours
3 Apr 2019
What do we know about cortical columns? A neuroscience (and artificial intelligence) discussion with Jeff Hawkins of Numenta.
- 4 participants
- 1:10 hours
1 Apr 2019
Spatial pooling, maxpool, CNN, HTM, temporal memory, bursting, boosting, etc. -- Watch live at https://www.twitch.tv/rhyolight_
- 2 participants
- 1:35 hours
1 Apr 2019
Numenta Research Meeting - neuroscience / artificial intelligence (AI) / neocortex oscillations https://gist.github.com/rhyolight/59dcd4f5810a00b001697abd70452411 -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 23 minutes
30 Mar 2019
Fun Friday! 2D object recognition, brain / tech chat, HTM Forum discussion -- Watch live at https://www.twitch.tv/rhyolight_
- 5 participants
- 3:14 hours
26 Mar 2019
## Getting started
Putting together the idea of a simple 2D environment and an agent that is linked to it. -- Watch live at https://www.twitch.tv/rhyolight_
Putting together the idea of a simple 2D environment and an agent that is linked to it. -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 1:03 hours
25 Mar 2019
AI / Neuroscience Chat Episode 2: Basics of sparse distributed representations -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 1:16 hours
25 Mar 2019
For most of this video I was trying to get some Twitch overlay features working. I investigated the Twitch API docs for streams and users, and tried to set up webhook subscriptions. -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 3:02 hours
23 Mar 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
An overview of today's AI landscape. How AI might apply to games.
An overview of today's AI landscape. How AI might apply to games.
- 2 participants
- 1:06 hours
23 Mar 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 4 participants
- 1:13 hours
18 Mar 2019
Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 3 participants
- 1:36 hours
18 Mar 2019
Watch this for a short introduction to this twitch channel, with details about what content I plan on streaming and why I'm doing it. Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/rhyolight_
- 1 participant
- 18 minutes
1 Mar 2019
Discussion at https://discourse.numenta.org/t/htm-hackers-hangout-mar-1-2019/5516.
HTM Hackers’ Hangout is a live monthly Google Hangout held for our online community. Anyone is free to join in the discussion either by connecting directly to the hangout or commenting on the YouTube video during the live stream.
Columns Paper: https://numenta.com/neuroscience-research/research-publications/papers/a-theory-of-how-columns-in-the-neocortex-enable-learning-the-structure-of-the-world/
Columns+ Paper: https://numenta.com/neuroscience-research/research-publications/papers/locations-in-the-neocortex-a-theory-of-sensorimotor-object-recognition-using-cortical-grid-cells/
More info on all these topics at http://numenta.org.
HTM Hackers’ Hangout is a live monthly Google Hangout held for our online community. Anyone is free to join in the discussion either by connecting directly to the hangout or commenting on the YouTube video during the live stream.
Columns Paper: https://numenta.com/neuroscience-research/research-publications/papers/a-theory-of-how-columns-in-the-neocortex-enable-learning-the-structure-of-the-world/
Columns+ Paper: https://numenta.com/neuroscience-research/research-publications/papers/locations-in-the-neocortex-a-theory-of-sensorimotor-object-recognition-using-cortical-grid-cells/
More info on all these topics at http://numenta.org.
- 6 participants
- 32 minutes
23 Jan 2019
About our latest paper "A Framework for Intelligence and Cortical Function Based on Grid Cells in the Neocortex": https://numenta.com/neuroscience-research/research-publications/papers/a-framework-for-intelligence-and-cortical-function-based-on-grid-cells-in-the-neocortex/
Text Q&A on HTM Forum at https://discourse.numenta.org/t/thousand-brains-hangout-with-jeff-subutai/5077
The MIT talk Jeff refers to: https://numenta.com/company/events/2017/12/15/mit-center-for-brains/
Text Q&A on HTM Forum at https://discourse.numenta.org/t/thousand-brains-hangout-with-jeff-subutai/5077
The MIT talk Jeff refers to: https://numenta.com/company/events/2017/12/15/mit-center-for-brains/
- 11 participants
- 59 minutes
22 Jan 2019
Matt and Florian will present their interpretation of paper "Deep Predictive Learning: A Comprehensive Model of Three Visual Streams" as described here: https://discourse.numenta.org/t/deep-predictive-learning-a-comprehensive-model-of-three-visual-streams/3076
- 8 participants
- 1:26 hours
7 Dec 2018
Discussion at https://discourse.numenta.org/t/htm-hackers-hangout-dec-7/5031.
HTM Hackers’ Hangout is a live monthly Google Hangout held for our online community. Anyone is free to join in the discussion either by connecting directly to the hangout or commenting on the YouTube video during the live stream.
More info on all these topics at http://numenta.org.
HTM Hackers’ Hangout is a live monthly Google Hangout held for our online community. Anyone is free to join in the discussion either by connecting directly to the hangout or commenting on the YouTube video during the live stream.
More info on all these topics at http://numenta.org.
- 2 participants
- 14 minutes
