EE Student Information

The Department of Electrical Engineering supports Black Lives Matter. Read more.

• • • • •

EE Student Information, Spring Quarter through Academic Year 2020-2021: FAQs and Updated EE Course List.

Updates will be posted on this page, as well as emailed to the EE student mail list.

Please see Stanford University Health Alerts for course and travel updates.

As always, use your best judgement and consider your own and others' well-being at all times.

Probability Seminar presents Emergence of communication through reinforcement learning with invention

Emergence of communication through reinforcement learning with invention
Monday, October 12, 2020 - 4:00pm
Mackenzie Simper (Stanford Math)
Abstract / Description: 

Reinforcement learning in a two-player Lewis signaling game is a simple model to study the emergence of communication in cooperative multi-agent systems. When there are a fixed number of states and signals there is a positive probability that a successful communication system does not emerge. If the learning dynamics are modified to include invention – rather than fixing the number of signals, at each step there is always a chance to introduce a new signal – then the system converges to successful signaling almost surely. The reinforcement process can be modeled as an interacting urn system, and the proof uses a combination of stochastic approximation techniques and comparison with simpler urn models.