IPAM Institute for Pure and Applied Mathematics UCLA NSF
Skip Navigation Links

Graduate Summer School: Deep Learning, Feature Learning

July 9 - 27, 2012

UCLA Faculty Center, California Room

Printable Version

Monday, July 09, 2012

Morning Session

8:00 - 8:45 Check-In/Breakfast (Hosted by IPAM)
8:45 - 9:00 Welcome and Opening Remarks
9:00 - 10:00

Geoffrey Hinton (University of Toronto)

"PART 1: Introduction to Deep Learning & Deep Belief Nets (PDF Parts 1 & 2)"
Presentation (PDF File)
1080p | 480p | 240p |

10:00 - 10:30 Break
10:30 - 11:30

Geoffrey Hinton (University of Toronto)

"PART 2: Using backpropagation for fine-tuning a generative model to be better at discrimination"
1080p | 480p | 240p |

11:30 - 12:00 Break
12:00 - 1:00 Joint talk: James Bergstra (Harvard), Clement Farabet (NYU)
1:00 - 2:30 Lunch (on your own)

Afternoon Session

2:30 - 3:30

Yann LeCun (New York University)

"Deep Learning, Graphical Models, Energy-Based Models, Structured Prediction"
Presentation (PDF File)
1080p | 480p | 240p |

3:30 - 4:00 Break
4:00 - 5:00

Yann LeCun (New York University)

"Deep Learning, Graphical Models, EnergyBased Models, Structured Prediction (Part 2)"
Presentation (PDF File)
1080p | 480p | 240p |

5:00 - 6:30 Reception (Hosted by IPAM)

Tuesday, July 10, 2012

Morning Session

8:00 - 9:00 Continental Breakfast
9:00 - 10:00

Andrew Ng (Stanford University)

"Deep Learning, Self-Taught Learning and Unsupervised Feature Learning (Part 1 Slides1-68; Part 2 Slides 69-109)"
Presentation (PDF File)
1080p | 480p | 240p |

10:00 - 10:30 Break
10:30 - 11:30

Andrew Ng (Stanford University)

"Advanced topics + Research philosophy / Neural Networks: Representation"
Presentation (PDF File)
1080p | 480p | 240p |

11:30 - 12:00 Break
12:00 - 1:00

Andrew Ng (Stanford University)

"Non-linear hypotheses"
1080p | 480p | 240p |

1:00 - 2:30 Lunch (on your own)

Afternoon Session

2:30 - 3:30

Andrew Ng (Stanford University)

"Non-linear hypotheses (Part 2)"
1080p | 480p | 240p |

3:30 - 4:00 Break
4:00 - 5:00 Joint talk: James Bergstra (Harvard), Clement Farabet (NYU)

Wednesday, July 11, 2012

Morning Session

8:00 - 9:00 Continental Breakfast
9:00 - 10:00

Yann LeCun (New York University)

"Learning Hierarchies of Invariant Features (Parts 1 & 2)"
Presentation (PDF File)
1080p | 480p | 240p |

10:00 - 10:30 Break
10:30 - 11:30

Yann LeCun (New York University)

"Deep Learning, Graphical Models, EnergyBased Models, Structured Prediction (Part 3)"
1080p | 480p | 240p |

11:30 - 12:00 Break
12:00 - 1:00 Joint talk: James Bergstra (Harvard), Clement Farabet (NYU)
1:00 - 2:30 Lunch (on your own)

Afternoon Session

2:30 - 3:30

Geoffrey Hinton (University of Toronto)

"PART 3: Some applications of deep learning (Slides 1-38)"
Presentation (PDF File)
1080p | 480p | 240p |

3:30 - 4:00 Break
4:00 - 5:00

Geoffrey Hinton (University of Toronto)

"PART 4: A computational principle that explains sex, the brain, and sparse coding (Slides 39-92)"
Presentation (PDF File)
1080p | 480p | 240p |


Thursday, July 12, 2012

Morning Session

8:00 - 9:00 Continental Breakfast
9:00 - 10:00

Rob Fergus (New York University)

"Deep Learning Methods for Vision"
Presentation (PDF File)
1080p | 480p | 240p |

10:00 - 10:30 Break
10:30 - 11:30

Rob Fergus (New York University)

"Deep Learning Methods for Vision (Part 2)"
1080p | 480p | 240p |

11:30 - 12:00 Break
12:00 - 1:00

Geoffrey Hinton (University of Toronto)

 
Presentation (PDF File)
1080p | 480p | 240p |

1:00 - 2:30 Lunch (on your own)

Afternoon Session

2:30 - 3:30

Alan Yuille (University of California, Los Angeles (UCLA))

"Part 1"
1080p | 480p | 240p |

3:30 - 4:00 Break
4:00 - 5:00 Joint talk: James Bergstra (Harvard), Clement Farabet (NYU)

Friday, July 13, 2012

Morning Session

8:00 - 9:00 Continental Breakfast
9:00 - 10:00

Graham Taylor (University of Guelph)

 
Presentation (PDF File)
1080p | 480p | 240p |

10:00 - 10:30 Break
10:30 - 11:30

Graham Taylor (University of Guelph)

 
Presentation (PDF File)
1080p | 480p | 240p |

11:30 - 12:00 Break
12:00 - 1:00

Alan Yuille (University of California, Los Angeles (UCLA))

"Part 2"
1080p | 480p | 240p |

1:00 - 2:30 Lunch (on your own)

Afternoon Session

2:30 - 3:30

Alan Yuille (University of California, Los Angeles (UCLA))

"Part 3"
1080p | 480p | 240p |

3:30 - 4:00 Break
4:00 - 5:00

Yann LeCun (New York University)

"Deep Learning, Graphical Models, EnergyBased Models, Structured Prediction (Part 4)"
1080p | 480p | 240p |


Monday, July 16, 2012

Morning Session

8:00 - 9:00 Continental Breakfast
9:00 - 10:00

Yoshua Bengio (University of Montreal)

"Part 1"
1080p | 480p | 240p |

10:00 - 10:30 Break
10:30 - 11:30

Yoshua Bengio (University of Montreal)

"Part 2"
1080p | 480p | 240p |

11:30 - 12:00 Break
12:00 - 1:00

Stephen Wright (University of Wisconsin-Madison)

"Some Relevant Topics in Optimization (Part 1) - (Slides Cover Parts 1 & 2)"
Presentation (PDF File)
1080p | 480p | 240p |

1:00 - 2:30 Lunch (on your own)

Afternoon Session

2:30 - 3:30

Stephen Wright (University of Wisconsin-Madison)

"Some Relevant Topics in Optimization (Part 2)"
1080p | 480p | 240p |

3:30 - 4:00 Break
4:00 - 5:00

Arthur Szlam (New York University)

"A tutorial on sparse modeling."
Presentation (PDF File)
1080p | 480p | 240p |

5:00 - 6:30 Reception (Hosted by IPAM)

Tuesday, July 17, 2012

Morning Session

8:00 - 9:00 Continental Breakfast
9:00 - 10:00

Stephen Wright (University of Wisconsin-Madison)

"Sparse and Regularized Optimization Part 1 (Slides Cover Parts 1 & 2)"
Presentation (PDF File)
1080p | 480p | 240p |

10:00 - 10:30 Break
10:30 - 11:30

Stephen Wright (University of Wisconsin-Madison)

"Sparse and Regularized Optimization Part 2"
Presentation (PDF File)
1080p | 480p | 240p |

11:30 - 12:00 Break
12:00 - 1:00

Arthur Szlam (New York University)

 
1080p | 480p | 240p |

1:00 - 2:30 Lunch (on your own)

Afternoon Session

2:30 - 3:30

Yoshua Bengio (University of Montreal)

"Part 3"
1080p | 480p | 240p |

3:30 - 4:00 Break
4:00 - 5:00

Yoshua Bengio (University of Montreal)

"Part 4"
1080p | 480p | 240p |


Wednesday, July 18, 2012

Morning Session

8:00 - 9:00 Continental Breakfast
9:00 - 10:00

Stéphane Mallat (École Polytechnique)

"Scattering Invariant Deep Networks for Classification "
Presentation (PDF File)
1080p | 480p | 240p |

10:00 - 10:30 Break
10:30 - 11:30

Stéphane Mallat (École Polytechnique)

"Scattering Invariant Deep Networks for Classification (Part 2)"
1080p | 480p | 240p |

11:30 - 12:00 Break
12:00 - 1:00

Kai Yu (Baidu Inc.)

"Part 1"
1080p | 480p | 240p |

1:00 - 2:30 Lunch (on your own)

Afternoon Session

2:30 - 3:30

Kai Yu (Baidu Inc.)

"Part 2"
1080p | 480p | 240p |

3:30 - 4:00 Break
4:00 - 5:00

Jorge Nocedal (Northwestern University)

"Tutorial on Optimization methods for machine learning"
Presentation (PDF File)
1080p | 480p | 240p |


Thursday, July 19, 2012

Morning Session

8:00 - 9:00 Continental Breakfast
9:00 - 10:00

Jorge Nocedal (Northwestern University)

"Tutorial on Optimization methods for machine learning (Part 2)"
1080p | 480p | 240p |

10:00 - 10:30 Break
10:30 - 11:30

Jorge Nocedal (Northwestern University)

"Tutorial on Optimization methods for machine learning (Part 3)"
Presentation (PDF File)
1080p | 480p | 240p |

11:30 - 2:00 Lunch (on your own)

Afternoon Session

2:00 - 3:30

Stéphane Mallat (École Polytechnique)

"Scattering Invariant Deep Networks for Classification (Part 3)"
1080p | 480p | 240p |

3:30 - 4:00 Break
4:00 - 5:00

Jason Morton (Pennsylvania State University)

"An Algebraic Perspective on Deep Learning"
Presentation (PDF File)
1080p | 480p | 240p |


Friday, July 20, 2012

Morning Session

8:00 - 9:00 Continental Breakfast
9:00 - 10:00

Jason Morton (Pennsylvania State University)

"An Algebraic Perspective on Deep Learning (Part 2)"
Presentation (PDF File)
1080p | 480p | 240p |

10:00 - 10:30 Break
10:30 - 11:30

Jason Morton (Pennsylvania State University)

"An Algebraic Perspective on Deep Learning (Part 3)"
Presentation (PDF File)
1080p | 480p | 240p |

11:30 - 12:00 Break
12:00 - 1:00

Yoshua Bengio (University of Montreal)

 
1080p | 480p | 240p |

1:00 - 2:30 Lunch (on your own)

Afternoon Session

2:30 - 3:30

Stanley Osher (University of California, Los Angeles (UCLA))

 
1080p | 480p | 240p |

3:30 - 4:00 Break
4:00 - 5:00

Stanley Osher (University of California, Los Angeles (UCLA))

 
1080p | 480p | 240p |


Monday, July 23, 2012

Morning Session

8:00 - 9:00 Continental Breakfast
9:00 - 10:00

Ruslan Salakhutdinov (University of Toronto)

 
Presentation (PDF File)
1080p | 480p | 240p |

10:00 - 10:30 Break
10:30 - 11:30

Ruslan Salakhutdinov (University of Toronto)

 
Presentation (PDF File)
1080p | 480p | 240p |

11:30 - 12:00 Break
12:00 - 1:00

Marc'Aurelio Ranzato (Google Inc.)

"Deep Gated MRF's - part 1"
Presentation (PDF File)
1080p | 480p | 240p |

1:00 - 2:30 Lunch (on your own)

Afternoon Session

2:30 - 3:30

Marc'Aurelio Ranzato (Google Inc.)

"Deep Gated MRF's - part 2"
Presentation (PDF File)
1080p | 480p | 240p |

3:30 - 4:00 Break
4:00 - 5:00

Jason Weston (Google Research)

"Part 1"
1080p | 480p | 240p |

5:00 - 6:30 Reception (Hosted by IPAM)
6:30 - 7:30

Brian Milch (Google Inc.)

"From Text to Concepts at Google"


Tuesday, July 24, 2012

Morning Session

8:00 - 9:00 Continental Breakfast
9:00 - 10:00

Jason Weston (Google Research)

"Part 2"
1080p | 480p | 240p |

10:00 - 10:30 Break
10:30 - 11:30

Jason Weston (Google Research)

"Part 3"
1080p | 480p | 240p |

11:30 - 12:00 Break
12:00 - 1:00

Ruslan Salakhutdinov (University of Toronto)

 
Presentation (PDF File)
1080p | 480p | 240p |

1:00 - 2:30 Lunch (on your own)

Afternoon Session

2:30 - 3:30

Bruno Olshausen (University of California, Berkeley (UC Berkeley))

"From natural scene statistics to models of neural coding and representation (part 1)"
Presentation (PDF File)
1080p | 480p | 240p |

3:30 - 4:00 Break
4:00 - 5:00

Marc'Aurelio Ranzato (Google Inc.)

"Large Scale Deep Learning"
Presentation (PDF File)
1080p | 480p | 240p |


Wednesday, July 25, 2012

Morning Session

8:00 - 9:00 Continental Breakfast
9:00 - 10:00

Thomas Serre (Brown University)

"Deep learning in the visual cortex - Part 1"
Presentation (PDF File)
1080p | 480p | 240p |

10:00 - 10:30 Break
10:30 - 11:30

Thomas Serre (Brown University)

"Deep learning in the visual cortex - Part 2"
Presentation (PDF File)
1080p | 480p | 240p |

11:30 - 12:00 Break
12:00 - 1:00

Roland Memisevic (Johann Wolfgang Goethe-Universität Frankfurt)

"Multiview Feature Learning - Part 1"
Presentation (PDF File)
1080p | 480p | 240p |

1:00 - 2:30 Lunch (on your own)

Afternoon Session

2:30 - 3:30

Roland Memisevic (Johann Wolfgang Goethe-Universität Frankfurt)

"Multiview Feature Learning - Part 2"
Presentation (PDF File)
1080p | 480p | 240p |

3:30 - 4:00 Break
4:00 - 5:00

Bruno Olshausen (University of California, Berkeley (UC Berkeley))

"From natural scene statistics to models of neural coding and representation (part 2)"
Presentation (PDF File)
1080p | 480p | 240p |


Thursday, July 26, 2012

Morning Session

8:00 - 9:00 Continental Breakfast
9:00 - 10:00

Iain Murray (University of Edinburgh)

"Introduction to MCMC for deep learning"
Presentation (PDF File)
1080p | 480p | 240p |

10:00 - 10:30 Break
10:30 - 11:30

Iain Murray (University of Edinburgh)

"Density estimation"
Presentation (PDF File)
1080p | 480p | 240p |

11:30 - 12:00 Break
12:00 - 1:00

Nando de Freitas (University of British Columbia)

"Part 1"
1080p | 480p | 240p |

1:00 - 2:30 Lunch (on your own)

Afternoon Session

2:30 - 3:30

Nando de Freitas (University of British Columbia)

"Part 2"
1080p | 480p | 240p |

3:30 - 4:00 Break
4:00 - 5:00

Thomas Serre (Brown University)

"Deep learning in the visual cortex - Part 3"
Presentation (PDF File)
1080p | 480p | 240p |


Friday, July 27, 2012

Morning Session

8:00 - 9:00 Continental Breakfast
9:00 - 10:00

Nando de Freitas (University of British Columbia)

"An Informal Mathematical Tour of Feature Learning"
Presentation (PDF File)
1080p | 480p | 240p |

10:00 - 10:30 Break
10:30 - 11:30

Nando de Freitas (University of British Columbia)

"Part 3"
1080p | 480p | 240p |

12:00 - 1:30 Lunch (on your own)

Afternoon Session

1:30 - 2:30 Panel Discussion: Nando de Freitas, Iain Murray, Bruno Olshausen, Ruslan Salakhutdinov, Roland Memisevic
2:30 - 3:00 Closing Remarks by Russ Caflisch (IPAM Director)

NSF Math Institutes   |   Webmaster