Search for tag: "distinct"

Johannes Schmidt-Hieber - Mathematics for Deep Neural Networks: Energy landscape and open problems (Lecture 5/5)

To derive a theory for gradient descent methods, it is important to have some understanding of the energy landscape. In this lecture, an overview of existing results is given. The second part of the…

From  Kathryn Gentilello 2 Months ago 24 views 0  

Johannes Schmidt-Hieber - Mathematics for Deep Neural Networks: Statistical theory for deep ReLU networks (Lecture 4/5)

We outline the theory underlying the recent bounds on the estimation risk of deep ReLU networks. In the lecture, we discuss specific properties of the ReLU activation function that relate to skipping…

From  Kathryn Gentilello 2 Months ago 13 views 0  

Cherie R. Kagan - Designer Colloidal Nanocrystal Materials for Electronic and Optical Applications

Semiconductor and plasmonic nanocrystals are known for their size and shape dependent photo-luminescence and localized surface plasmon resonances, respectively. In this talk, I will describe the use…

From  Kathryn Gentilello 3 Months ago 13 views 0  

Johannes Schmidt-Hieber - Mathematics for Deep Neural Networks: Advantages of Additional Layers (Lecture 3/5)

Why are deep networks better than shallow networks? We provide a survey of the existing ideas in the literature. In particular, we discuss localization of deep networks, functions that can be easily…

From  Kathryn Gentilello 3 Months ago 19 views 0  

Johannes Schmidt-Hieber - Mathematics for Deep Neural Networks : Theory for shallow networks (Lecture 2/5)

We start with the universal approximation theorem and discuss several proof strategies that provide some insights into functions that can be easily approximated by shallow networks. Based on this, a…

From  Kathryn Gentilello 3 Months ago 27 views 0  

Johannes Schmidt-Hieber - Mathematics for Deep Neural Networks (Lecture 1/5)

Lecture 1) Survey on neural network structures and deep learning There are many different types of neural networks that differ in complexity and the data types that can be processed. This lecture…

From  Kathryn Gentilello 3 Months ago 51 views 0  

Galyna Livshyts - A Tight Net with Respect to a Random Matrix Norm and Applications to Estimating Singular Values

In this talk we construct a net around the unit sphere with good properties. We show that with exponentially high probability, the value of |Ax| on the sphere can be approximated well using this net,…

From  Kathryn Gentilello 4 Months ago 6 views 0  

Tuo Zhao - Towards Understanding First Order Algorithms for Nonconvex Optimization in Machine Learning

Stochastic Gradient Descent-type (SGD) algorithms have been widely applied to many non-convex optimization problems in machine learning, e.g., training deep neural networks, variational Bayesian…

From  Kathryn Gentilello 4 Months ago 17 views 0  

Éva Tardos - Learning and Efficiency of Outcomes in Games

Selfish behavior can often lead to suboptimal outcome for all participants, a phenomenon illustrated by many classical examples in game theory. Over the last decade we have studied Nash equilibria…

From  Kathryn Gentilello 4 Months ago 20 views 0  

Michael Mitzenmacher - Bloom Filters, Cuckoo Hashing, Cuckoo Filters, Adaptive Cuckoo Filters, and Learned Bloom Filters

I will go over some of my past and present work on hashing-based data structures. After presenting some background on Bloom filters and cuckoo hashing, we will describe cuckoo filters, an efficient…

From  Kathryn Gentilello 6 Months ago 29 views 0  

Christopher Jarzynski - Scaling down the laws of thermodynamics

Thermodynamics provides a robust conceptual framework and set of laws that govern the exchange of energy and matter. Although these laws were originally articulated for macroscopic objects, it is…

From  Kathryn Gentilello 6 Months ago 96 views 0  

Elias Zerhouni - From Academia to Government to Industry: Lessons Learned

Elias Zerhouni, M.D., is the President, Global Research & Development, and a member of the Executive Committee for Sanofi. Dr. Zerhouni’s academic career was spent at the renowned Johns…

From  Kathryn Gentilello 7 Months ago 9 views 0  

Gabor Lugosi - Mean Estimation: Median-of-Means Tournaments

In these lectures we discuss some statistical problems with an interesting combinatorial structure behind. We start by reviewing the "hidden clique" problem, a simple prototypical example…

From  Kathryn Gentilello 7 Months ago 16 views 0  

Chris Urmson - Delivering the Benefits of Self-Driving Technology Safely, Quickly, and Broadly

The sixth Kelly Distinguished Lecturer, Chris Urmson, will present “Delivering the Benefits of Self-Driving Technology Safely, Quickly, and Broadly” on Wednesday, November 7, from…

From  Kathryn Gentilello 7 Months ago 302 views 0  

Gabor Lugosi - Combinatorial Testing Problems

In these lectures we discuss some statistical problems with an interesting combinatorial structure behind. We start by reviewing the "hidden clique" problem, a simple prototypical example…

From  Kathryn Gentilello 7 Months ago 23 views 0  

Ruth Misener - Gaussian Processes for Hybridizing Analytical & Data-Driven Decision-Making

Surrogate models are widely appreciated in chemical engineering. The typical setting focuses on expensive-to-evaluate, possibly uncertain functions. Resources are typically limited, so effective…

From  Kathryn Gentilello 8 Months ago 38 views 0