没有合适的资源?快使用搜索试试~ 我知道了~
首页CS231n - Convolutional Neural Networks for Vision Recognition
资源详情
资源评论
资源推荐
Convolutional Neural Networks
for Visual Recognition
Feifei Li
CS231n, Stanford Open Course
Edited by fengfu-chris, email: fengfu0527@gmail.com
Copyright: Stanford Vision Group
Contents
Part I: Neural Networks
1.1 - Image Classification: Data-driven Approach, k-Nearest Neighbor, train/val/test splits ------- 3
1.2 - Linear classification: Support Vector Machine, Softmax ------------------------------------------ 19
1.3 - Optimization: Stochastic Gradient Descent ---------------------------------------------------------- 37
1.4 - Backpropagation, Intuitions ---------------------------------------------------------------------------- 51
1.5 - Neural Networks Part 1: Setting up the Architecture ----------------------------------------------- 60
1.6 - Neural Networks Part 2: Setting up the Data and the Loss ---------------------------------------- 73
1.7 - Neural Networks Part 3: Learning and Evaluation -------------------------------------------------- 89
1.8 - Putting it together: Minimal Neural Network Case Study ---------------------------------------- 109
Part II: Convolutional Neural Networks
2.1 - Convolutional Neural Networks: Architectures, Convolution & Pooling Layers ------------- 123
2.2 - Understanding and Visualizing Convolutional Neural Networks ------------------------------- 146
2.3 - Transfer Learning and Fine-tuning Convolutional Neural Networks --------------------------- 152
2.4 - ConvNet Tips and Tricks: squeezing out the last few percent ----------------------------------- 155
Part X: Preparation
x.1 - Python Numpy Tutorial ------------------------------------------------------------------------------- 156
x.2 - IPython Tutorial ---------------------------------------------------------------------------------------- 182
x.3 - Terminal ------------------------------------------------------------------------------------------------- 186
These notes accompany the Stanford CS class CS231n: Convolutional Neural Networks
for Visual Recognition. Feel free to ping @karpathy if you spot any mistakes or issues,
or submit a pull request to our git repo.
We encourage the use of the hypothes.is extension to annote comments and discuss
these notes inline.
Assignments
Assignment #1: Image Classification, kNN, SVM, Softmax
Assignment #2: Neural Networks, ConvNets I
Assignment #3: ConvNets II, Transfer Learning, Visualization
Module 0: Preparation
Python / Numpy Tutorial
IPython Notebook Tutorial
Terminal.com Tutorial
Module 1: Neural Networks
Image Classification: Data-driven Approach, k-Nearest Neighbor,
train/val/test splits
L1/L2 distances, hyperparameter search, cross-validation
Linear classification: Support Vector Machine, Softmax
parameteric approach, bias trick, hinge loss, cross-entropy loss, L2 regularization, web
demo
Optimization: Stochastic Gradient Descent
optimization landscapes, local search, learning rate, analytic/numerical gradient
Backpropagation, Intuitions
chain rule interpretation, real-valued circuits, patterns in gradient flow
Neural Networks Part 1: Setting up the Architecture
CS231n Convolutional Neural Networks for Visual
Recognition
1
cs231n
cs231n
karpathy@cs.stanford.edu
model of a biological neuron, activation functions, neural net architecture,
representational power
Neural Networks Part 2: Setting up the Data and the Loss
preprocessing, weight initialization, regularization, dropout, loss functions in the wild
Neural Networks Part 3: Learning and Evaluation
gradient checks, sanity checks, babysitting the learning process, momentum
(+nesterov), second-order methods, Adagrad/RMSprop, hyperparameter optimization,
model ensembles
Putting it together: Minimal Neural Network Case Study
minimal 2D toy data example
Module 2: Convolutional Neural Networks
Convolutional Neural Networks: Architectures, Convolution / Pooling Layers
layers, spatial arrangement, layer patterns, layer sizing patterns,
AlexNet/ZFNet/VGGNet case studies, computational considerations
Understanding and Visualizing Convolutional Neural Networks
tSNE embeddings, deconvnets, data gradients, fooling ConvNets, human comparisons
Transfer Learning and Fine-tuning Convolutional Neural Networks
ConvNet Tips and Tricks: squeezing out the last few percent
multi-scale, model ensembles, data augmentations
Module 3: ConvNets in the wild
Other Visual Recognition Tasks: Localization, Detection, Segmentation
ConvNets in Practice: Distributed Training, GPU bottlenecks, Libraries
2
This is an introductory lecture designed to introduce people from outside of Computer
Vision to the Image Classification problem, and the data-driven approach. The Table of
Contents:
Intro to Image Classification, data-driven approach, pipeline
Nearest Neighbor Classifier
k-Nearest Neighbor
Validation sets, Cross-validation, hyperparameter tuning
Pros/Cons of Nearest Neighbor
Summary
Summary: Applying kNN in practice
Further Reading
Image Classification
Motivation. In this section we will introduce the Image Classification problem, which is
the task of assigning an input image one label from a fixed set of categories. This is one
of the core problems in Computer Vision that, despite its simplicity, has a large variety
of practical applications. Moreover, as we will see later in the course, many other
seemingly distinct Computer Vision tasks (such as object detection, segmentation) can
be reduced to image classification.
Example. For example, in the image below an image classification model takes a single
image and assigns probabilities to 4 labels,
{cat, dog, hat, mug}
. As shown in the image,
keep in mind that to a computer an image is represented as one large 3-dimensional
array of numbers. In this example, the cat image is 248 pixels wide, 400 pixels tall, and
has three color channels Red,Green,Blue (or RGB for short). Therefore, the image
consists of 248 x 400 x 3 numbers, or a total of 297,600 numbers. Each number is an
integer that ranges from 0 (black) to 255 (white). Our task is to turn this quarter of a
million numbers into a single label, such as
"cat"
.
CS231n Convolutional Neural Networks for Visual
Recognition
3
剩余190页未读,继续阅读
xiaofengfu2009
- 粉丝: 0
- 资源: 2
上传资源 快速赚钱
- 我的内容管理 收起
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
会员权益专享
最新资源
- RTL8188FU-Linux-v5.7.4.2-36687.20200602.tar(20765).gz
- c++校园超市商品信息管理系统课程设计说明书(含源代码) (2).pdf
- 建筑供配电系统相关课件.pptx
- 企业管理规章制度及管理模式.doc
- vb打开摄像头.doc
- 云计算-可信计算中认证协议改进方案.pdf
- [详细完整版]单片机编程4.ppt
- c语言常用算法.pdf
- c++经典程序代码大全.pdf
- 单片机数字时钟资料.doc
- 11项目管理前沿1.0.pptx
- 基于ssm的“魅力”繁峙宣传网站的设计与实现论文.doc
- 智慧交通综合解决方案.pptx
- 建筑防潮设计-PowerPointPresentati.pptx
- SPC统计过程控制程序.pptx
- SPC统计方法基础知识.pptx
资源上传下载、课程学习等过程中有任何疑问或建议,欢迎提出宝贵意见哦~我们会及时处理!
点击此处反馈
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功
评论7