If #AI were a historical timeline, #RNN and #LSTM were the early trailblazers—laying the foundation for the rise of #GPT and #BERT, the transformers that reshaped how machines understand and generate human language.

Free Them All: On Palestinian Political Prisoners
MASK UP, WE NEED YOU: Palestinian Solidarity, Covid-19, and the Struggle for Liberation
@rimoskyo

#Palestine #FreePalestine #CenterRevolutionaryPalestineVoices #RNN

https://rimoskyo.com/shop/p/mask-up-we-need-you-palestinian-solidarity-covid-19-and-the-struggle-for-liberation

Popular Front for the Liberation of Palestine on the Occasion of Palestinian Prisoners’ Day - April 17
telegram: RNN_Prisoners

Friendly Introduction to #DeepLearning Architectures (#CNN, #RNN, #GAN, #Transformers, Encoder-Decoder Architectures). | by Jyoti Dabass, Ph.D | Apr, 2024 | #python in Plain English

https://python.plainenglish.io/friendly-introduction-to-deep-learning-architectures-cnn-rnn-gan-transformers-encoder-decoder-b11334e4cdf7

Feedback-based motor control can guide #plasticity and drive rapid #learning –#preprint by Feulner et al. (2022)

Check out this #NeurIPS2023 paper by Dinc et al. (2023) who introduce #CORNN, convex #optimization of recurrent neural networks for rapid inference of #NeuralDynamics:

https://arxiv.org/abs/2311.10200

Learning better with Dale’s Law: A Spectral Perspective - #NeurIPS2023 contribution by Li et al. (2023). It discusses how to train brainlike #RNNs with separate inhibitory and excitatory units with similar performance as standard RNNs:

https://openreview.net/forum?id=rDiMgZulwi

Reconstructing computational system dynamics from neural data with #RecurrentNeuralNetworks by @DurstewitzLab :

https://www.nature.com/articles/s41583-023-00740-7

#RNN #CompNeuro https://mathstodon.xyz/@DurstewitzLab/111198955816667183

Alter, was soll das denn? Die #DB_Bahn hat den Fahrplan geändert. Der Zug, mit dem ich üblicherweise montags pendele, fährt nicht mehr. Muss jetzt die längere Strecke über Köln statt Hannover fahren und am Frankfurter Flughafen umsteigen, statt ab Hbf. Damit steigt die Wahrscheinlichkeit, dass ich meinen Anschluss nicht schaffe und 2 Stunden später ankomme.
Zu allem Überfluss hat der #RNN auch Fahrpläne geändert + meinen Bus gestrichen, so dass ich ohnehin später ankomme

Representing context and priority in #WorkingMemory: #RNN represent first order context, that individuates an item, and higher-order context, that can change unpredictably, via distinct mechanisms – New #preprint by Wan et al. (2023)

https://www.biorxiv.org/content/10.1101/2023.10.24.563608v1

What happens when you give Recurrent Neural Networks brain-inspired constraints of 3D spatial structure & neural communication during learning?

In our new project we show typical structural & functional #neuroscience motifs like modularity, small-worldness, functional clusters, mixed selectivity & efficiency emerge in these spatially-embedded RNNs

#Preprint
https://www.biorxiv.org/content/10.1101/2022.11.17.516914v1

#PaperThread / Summary
https://www.jachterberg.com/seRNN

#AI #neuralnetwork #NeuroAI #RNN #newpaper @neuroscience