没有合适的资源?快使用搜索试试~ 我知道了~
首页麻省理工:深度学习介绍PPT-4
麻省理工:深度学习介绍PPT-4
需积分: 16 17 下载量 165 浏览量
更新于2023-03-16
评论 1
收藏 20MB PDF 举报
一门面向所有人的人工智能公开课。 对初学者来说,有没有易于上手,使用流行神经网络框架进行教学的深度学习课程?近日,麻省理工学院(MIT)正式开源了在线介绍性课程「MIT 6.S191:深度学习入门」。该课程包括一系列有关神经网络及其在序列建模、计算机视觉、生成模型和强化学习等方面的基本应用知识。 课程链接:http://introtodeeplearning.com/ 课程视频:https://www.youtube.com/watch?list=PLtBw6njQRU-rwp5__7C0oIVt26ZgjG9NI&v=JN6H4rQvwgY 课程 GitHub:https://github.com/aamini/introtodeeplearning_labs 具体介绍可参考:https://www.jiqizhixin.com/articles/MIT-6-s191-introduction-to-deep-learning http://introtodeeplearning.com/
资源详情
资源评论
资源推荐
Institut
des algorithmes
d’apprentissage
de Montréal
Deep Generative Models
Aaron Courville
MILA, Université de Montréal
6.S191: Introduction to Deep Learning
MIT, Jan 30th, 2018
1
•
Generative models take training samples from some data
distribution and learn a model that represents that distribution.
•
Density estimation:
•
Sample generation:
Generative modeling
(Goodfellow 2016)
Generative Modeling
•
Density estimation
•
Sample generation
Training examples Model samples
Figure 1: Some generative models perform density estimation. These models take a
training set of examples d rawn from an un k n own dat a -g en e rat i n g distribut io n p
data
and return an estimate of that distribution. The estimate p
model
can be evaluated for
a particular va lu e o f x to obtain an estimate p
model
(x) of the true density p
model
(x).
This figure illustrates the process for a collecti o n of sample s of one-di men s io n a l dat a
and a Gaussian model.
(Goodfellow 2016)
Generative Modeling
•
Density estimation
•
Sample generation
Training examples Model samples
Figure 2: Some generative models are able to generate samples from the model distri-
bution. In t h is illustratio n of the p rocess, we show samples fro m the ImageNet (Deng
et al.,2009,2010;Russakovskyet al., 2014) dataset. An id e al generative model would
be able to train on examples as shown o n the left and then create more examples from
the same distribution as shown on the right. At present, generat ive mod el s are not yet
advanced enough to do this correctly for ImageNet, so for demo n st ra t io n purpo ses this
figure uses actual I m a g eNe t data to illustrate wh a t an ideal generative mode l would
produce.
http://www.iangoodfellow.com/slides/2016-12-04-NIPS.key
The video was recorded by the NIPS f oun dat i on and should be made avail -
able at a later date .
Generative adversarial networks are an exampl e of generative models.The
term “generative model” is used in many di↵erent way s. In this tutorial, the
term refers to any model that takes a tr ai ni n g set, consisting of samples drawn
from a distribution p
data
, and learns to represent an estimate of that distri bu t i on
somehow. The result is a probabil i ty d i st r ib u ti on p
model
. In some cases, the
model estimates p
model
explicitly, as shown in figure 1. In other cases, the
model is onl y able to generate samples from p
model
, as shown in fi gur e 2. Some
models are able to do both. GANs focus primarily on sample generation, th ou gh
it is poss i ble to design GANs that can do both.
2
images taken from Goodfellow (2017)
(Goodfellow 2016)
Generative Modeling
•
Density estimation
•
Sample generation
Training examples Model samples
Figure 1: Some gen era t i ve mod el s perform density estimation . These models take a
training set of examples drawn from an unknown data-g e n era ti n g distributio n p
data
and return an est imat e of that distribution. The estimate p
model
can be evaluated for
a particular value of x to obtain an estimate p
model
(x) of the true density p
model
(x).
This figure illustrates the process for a collecti on of samples of one-dimension al data
and a Gaussian model.
(Goodfellow 2016)
Generative Modeling
•
Density estimation
•
Sample generation
Training examples Model samples
Figure 2: Some generative mod els are able to generate samples from the model distri-
bution. In this illustration of the process, we show samples from the Ima g eN et (Deng
et al.,2009,2010;Russakovskyet al., 2014) dat as et . An id ea l generative model would
be able to train on exampl es as shown on the left a n d then cre a te more exampl es from
the same d is t rib u t io n as shown on th e right. At present , generative models are not yet
advance d enough to do this correctly for ImageNet, so for demon st ra t io n purposes this
figure uses actual ImageNet data to illu st ra t e what an ide al generative model would
produce.
http://www.iangoodfellow.com/slides/2016-12-04-NIPS.key
The video was r ec ord ed by the NIPS foundati on an d should be m ade avail -
able at a later date.
Generative adversarial networ k s ar e an example of generative models.The
term “generative model” is used in many di↵erent ways. In this tutorial, t h e
term r ef er s to any model that t akes a training set, consisting of samples drawn
from a distribution p
data
, and learns to represent an estimate of that distribution
somehow. The result is a probabili ty distri b ut i on p
model
. In some cases, the
model est i mat es p
model
explicitly, as shown in figure 1. In other cases, the
model is only able to generate sampl e s fr om p
model
, as shown in figure 2. Some
models are able to do both. GANs focus primarily on sample generat ion , though
it is possible to desi gn GANs th at can do both.
2
2
•
Many tasks require structured output
-
Eg. Machine translation
Why generative models?
image credit: Adam Geitgey blog (2016) Machine Learning is Fun Part 5: Language Translation with Deep Learning and the Magic of Sequences
Why Generative Models? Outlier detection
cars
wheelchairs
✘
✘
✘
•
Large-scale deployment of CNN-
based perception systems is
becoming a reality.
•
How do we detect when we
encounter something new or rare
(i.e. not appearing in the training
data)?
•
Goal: detect these outliers
(anomalies) to avoid dangerous
misclassification.
•
Strategy: Leverage generative
models of the training distribution
to detect outliers.
Outlier!
Why Generative Models? Generation for Simulation
•
Supports Reinforcement Learning for Robotics: Make simulations sufficiently
realistic that learned policies can readily transfer to real-world application
5
Photo from IEEE Spectrum
Generative model
剩余38页未读,继续阅读
h1039442919
- 粉丝: 5
- 资源: 37
上传资源 快速赚钱
- 我的内容管理 收起
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
会员权益专享
最新资源
- ExcelVBA中的Range和Cells用法说明.pdf
- 基于单片机的电梯控制模型设计.doc
- 主成分分析和因子分析.pptx
- 共享笔记服务系统论文.doc
- 基于数据治理体系的数据中台实践分享.pptx
- 变压器的铭牌和额定值.pptx
- 计算机网络课程设计报告--用winsock设计Ping应用程序.doc
- 高电压技术课件:第03章 液体和固体介质的电气特性.pdf
- Oracle商务智能精华介绍.pptx
- 基于单片机的输液滴速控制系统设计文档.doc
- dw考试题 5套.pdf
- 学生档案管理系统详细设计说明书.doc
- 操作系统PPT课件.pptx
- 智慧路边停车管理系统方案.pptx
- 【企业内控系列】企业内部控制之人力资源管理控制(17页).doc
- 温度传感器分类与特点.pptx
资源上传下载、课程学习等过程中有任何疑问或建议,欢迎提出宝贵意见哦~我们会及时处理!
点击此处反馈
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功
评论0