EE Student Information

The Department of Electrical Engineering supports Black Lives Matter. Read more.

• • • • •

EE Student Information, Spring Quarter through Academic Year 2020-2021: FAQs and Updated EE Course List.

Updates will be posted on this page, as well as emailed to the EE student mail list.

Please see Stanford University Health Alerts for course and travel updates.

As always, use your best judgement and consider your own and others' well-being at all times.

ISL Colloquium presents "Empirical Risk Minimization in High-dimensions: Asymptotics, Optimality and Double Descent"

Topic: 
Empirical Risk Minimization in High-dimensions: Asymptotics, Optimality and Double Descent
Thursday, February 27, 2020 - 4:30pm
Venue: 
Packard 101
Speaker: 
Prof Christos Thrampoulidis (UC Santa Barbara)
Abstract / Description: 

At the heart of contemporary statistical signal processing problems, as well as modern machine-learning practices, lie high-dimensional inference tasks in which the number of unknown parameters is of the same order as (and often larger than) the number of observations.

In this talk, I describe a framework based on Gaussian-process inequalities to sharply characterize the statistical performance of convex empirical risk minimization in high dimensions. By focusing on the simple, yet highly versatile, model of binary linear classification, I will demonstrate that, albeit challenging, sharp results are advantageous over loose order-wise bounds. For instance, they lead to precise answers to the following questions: When are training data linearly separable? Is least-squares bad for binary classification? What is the best convex loss function? Is double descent observed in linear models and how do its features (such as the transition threshold and global minima) depend on the training data and on the learning procedure?

Many of the ideas and technical tools of our work originate from the study of sharp phase-transitions in compressed sensing. Throughout the talk, I will highlight how our results relate to and advance this literature.


The Information Systems Laboratory Colloquium (ISLC) is typically held in Packard 101 every Thursday at 4:30 pm during the academic year. Coffee and refreshments are served at 4pm in the second floor kitchen of Packard Bldg.

The Colloquium is organized by graduate students Joachim Neu, Tavor Baharav and Kabir Chandrasekher. To suggest speakers, please contact any of the students.

Bio:

Christos Thrampoulidis is an Assistant Professor in the ECE Department at UC Santa Barbara since July 2018. His research interests include statistical signal processing, optimization, and, machine learning. Before joining UCSB, Dr. Thrampoulidis was a Postdoctoral Researcher at the Research Laboratory of Electronics at MIT. He received his M.Sc. and Ph.D. degrees in Electrical Engineering from Caltech in 2012 and 2016, respectively, and his Diploma of electrical and computer engineering from the University of Patras in Greece in 2011. He is a recipient of the 2014 Qualcomm Innovation Fellowship.