Sitemap

A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.

Pages

Posts

Future Blog Post

less than 1 minute read

Published:

This post will show up by default. To disable scheduling of future posts, edit config.yml and set future: false.

Blog Post number 4

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 3

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 2

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 1

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

portfolio

publications

talks

Finding Low-Rank Functions Using Linear Layers in Neural Networks

Published:

A fundamental question in the theory of neural networks is the role of depth. Empirically it is widely known that deeper networks tend to perform better than shallow ones. However, the reasoning behind this phenomenon is not well understood. In this talk I will discuss the role of depth in the simplified case where most of the layers have a linear activation. Specifically, the regularization associated with training a neural network with many linear layers followed by a single ReLu layer using weight decay is equivalent to a function-space penalty that encourages the network to select a low-rank function, i.e. one with small active subspace.

Neural Networks Can Automatically Adapt to Low-Dimensional Structure in Inverse Problems

Published:

Abstract: Machine learning methods are increasingly used to solve inverse problems, wherein a signal must be estimated from few measurements generated via a known acquisition procedure. While approaches based on neural networks perform well empirically, they have limited theoretical guarantees. Specifically, it is unclear whether neural networks can reliably take advantage of low-dimensional structure shared by signals of interest — thus facilitating recovery in settings where the signal dimension far exceeds the number of available measurements. In this talk, I will present a positive resolution to this question for the special case of underdetermined linear inverse problems. I will show that, when trained with standard techniques and without explicit guidance, deep linear neural networks automatically adapt to underlying low-dimensional structure in the data, resulting in improved robustness against noise. These results shed light on how neural networks generalize well in practice by naturally capturing hidden patterns in data.

teaching

Teaching experience 1

Undergraduate course, University 1, Department, 2014

This is a description of a teaching experience. You can use markdown like any other post.

Teaching experience 2

Workshop, University 1, Department, 2015

This is a description of a teaching experience. You can use markdown like any other post.