“Learning to Synchronize” – new paper in PLoS Computational Biology

Congrats to Pieter Verbeke et al for having their work accepted at PLoS Computational Biology!

In their paper, they present a computational framework on how biological and artificial agents can address the trade-off between being sufficiently adaptive to acquiring novel information (plasticity) and retaining older information (stability); known as the stability-plasticity dilemma. For this purpose, they combined two prominent computational neuroscience principles, namely Binding by Synchrony (Fries, 2005, 2015) and Reinforcement Learning (Sutton & Barto, 1998). The model learns to couple/synchronize task-relevant modules, while also learning to decouple/desynchronize currently task-irrelevant modules. As a result, old (but currently task-irrelevant) information is protected from overwriting (stability) while new information can be learned quickly in currently task-relevant modules (plasticity). In order to test the generalizability of their framework, learning to synchronize was combined with task modules that learn via one of three classical learning algorithms, namely Rescorla-Wagner (Widrow & Hoff, 1960), backpropagation (Rummelhart, Hinton & Williams, 1986) and Restricted Boltzmann machines (Hinton, 2012). The resulting models were tested on a reversal learning paradigm where the models had to learn to switch between three different task rules. The authors demonstrated how combining learning to synchronize with several classic learning algorithms resulted in significant computational advantages over networks without synchrony, in terms of both stability and plasticity. Crucially, the resulting models’ processing dynamics are also consistent with empirical data and provide empirically testable hypotheses for future MEG/EEG studies.

 

 

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s