Python深度学习实战

需积分: 0 141 浏览量更新于2024-07-18 收藏 14.63MB PDF 举报

"Deep Learning with Python" 这本书"Deep Learning with Python"是一本针对具有Python基础知识并希望进入深度学习领域的读者的指南。它旨在从基础知识出发，逐步引导读者掌握深度学习的理论并解决实际问题。即使你已经有了一些深度学习的经验，本书后面的章节也能够提供额外的价值。作者在书中深入浅出地介绍了深度学习的概念，适合那些有一定Python编程经验但对机器学习和深度学习不熟悉的读者。全书内容覆盖了从基础理论到高级实用应用的全过程。对于初学者来说，这是一条学习深度学习的清晰路径，它会帮助读者理解如何通过Python来构建和训练神经网络模型。书中的内容不仅限于理论，还包括了实际应用的案例，使得读者能够将所学知识应用到解决现实世界的问题上。此外，本书也适用于已经熟悉深度学习的读者，他们可以在后面的章节中探索更深入的主题和技术，以扩大自己的知识视野和提高解决问题的能力。本书是通过Manning Early Access Program（MEAP）发布的，这意味着读者可以提前获取还在编写过程中的章节，参与到讨论并提供反馈。Manning出版社鼓励读者在论坛上分享观点和建议，以促进内容的完善。在深度学习领域，Keras是一个常用的高级神经网络API，它建立在TensorFlow、Theano或CNTK等后端之上，简化了模型构建和实验的过程。因此，本书很可能会涵盖Keras的使用，包括模型定义、训练、评估和优化等方面。 "Deep Learning with Python"是一本全面的深度学习教程，涵盖了从基础知识到高级主题的广泛内容，是Python开发者进入深度学习领域的理想起点，同时也为有经验的深度学习者提供了深入学习的新视角。无论你是新手还是老手，这本书都为你提供了一条通向深度学习实践与精通的道路。

Deep learning has reached a level of public attention and industry investment never seen

before in the history of AI, but it isn’t the first successful form of machine learning. In

fact, it’s a safe bet to say that most of the machine learning algorithms in use in the

industry today are still not deep learning algorithms. Deep learning isn’t always the right

tool for the job—sometimes there just isn’t enough data for deep learning to be

applicable, and sometimes the problem is simply better solved by a different algorithm. If

deep learning is your first contact with machine learning, then you may find yourself in a

situation where all you have is the deep learning hammer and every machine learning

problem starts looking like a nail for this hammer. The only way not to fall into this trap

is to be familiar with other approaches and practice them when appropriate.

A detailed exposure of classical machine learning approaches is outside of the scope

of this book, but we will briefly go over them and describe the historical context in which

they were developed. This will allow us to place deep learning in the broader context of

machine learning, and better understand where deep learning comes from and why it

matters.

Probabilistic modeling is the application of the principles of statistics to data analysis. It

was one of the earliest forms of machine learning, yet it is still widely used to this day.

One of the best-known algorithms in this category is the Naive Bayes algorithm.

Naive Bayes is a type of machine learning classifier based on applying the Bayes

Theorem while assuming that the features in the input data are all independent (a strong,

or "naive" assumption, which is where the name comes from). This form of data analysis

actually predates computers, and was applied by hand decades before its first computer

implementation (most likely dating back to the 1950s). The Bayes Theorem and the

foundations of statistics themselves date back to the 18th century, and these are all you

need to start using Naive Bayes classifiers.

A closely related model is the Logistic Regression (logreg for short), which is

sometimes considered to be the "hello world" of modern machine learning. Don’t be

misled by its name—logreg is in fact a classification algorithm rather than a regression

algorithm. Much like Naive Bayes, logreg predates computing by a long time, yet it is

still very useful to this day, thanks to its simple and versatile nature. It is often the first

thing a data scientist will try on a dataset to get a feel for the classification task at hand.

1.2 Before deep learning: a brief history of machine learning

1.2.1 Probabilistic modeling

©Manning Publications Co. We welcome reader comments about anything in the manuscript - other than typos and

other simple mistakes. These will be cleaned up during production of the book by copyeditors and proofreaders.

https://forums.manning.com/forums/deep-learning-with-python

Licensed to <null>

Early iterations of neural networks have been completely supplanted by the modern

variants that we cover in these pages; however, it is helpful to be aware of how deep

learning originated. Although the core ideas of neural networks were investigated in toy

forms as early as the 1950s, the approach took decades to really get started. For a long

time, the missing piece was a lack of an efficient way to train large neural networks. This

changed in the mid-1980s, as multiple people independently rediscovered the

"backpropagation" algorithm, a way to train chains of parametric operations using

gradient descent optimization (later in the book, we will go on to precisely define these

concepts), and started applying it to neural networks.

The first successful practical application of neural nets came in 1989 from Bell Labs,

when Yann LeCun combined together the earlier ideas of convolutional neural networks

and backpropagation, and applied them to the problem of handwritten digits

classification. The resulting network, dubbed "LeNet", was used by the US Post Office in

the 1990s to automate the reading of ZIP codes on mail envelopes.

As neural networks started gaining some respect among researchers in the 1990s thanks

to this first success, a new approach to machine learning rose to fame and quickly sent

neural nets back to oblivion: kernel methods.

Kernel methods are a group of classification algorithms, the best known of which is

the Support Vector Machine (SVM). The modern formulation of SVM was developed by

Vapnik and Cortes in the early 1990s at Bell Labs and published in 1995, although an

older linear formulation was published by Vapnik and Chervonenkis as early as 1963.

SVM aims at solving classification problems by finding good "decision boundaries"

(Figure 1.10) between two sets of points belonging to two different categories. A

"decision boundary" can be thought of as a line or surface separating your training data

into two spaces corresponding to two categories. To classify new data points, you just

need to check which side of the decision boundary they fall on.

Figure 1.10 A decision boundary

1.2.2 Early neural networks

1.2.3 Kernel methods

©Manning Publications Co. We welcome reader comments about anything in the manuscript - other than typos and

other simple mistakes. These will be cleaned up during production of the book by copyeditors and proofreaders.

https://forums.manning.com/forums/deep-learning-with-python

Licensed to <null>

SVMs proceed to find these boundaries in two steps:

First, the data is mapped to a new high-dimensional representation where the decision

boundary can be expressed as an hyperplane (if the data is two-dimensional like in our

example, an "hyperplane" would simply be a straight line).

Then a good decision boundary (a separation hyperplane) is computed by trying to

maximize the distance between the hyperplane and the closest data points from each

class, a step called "maximizing the margin". This allows the boundary to generalize well

to new samples outside of the training dataset.

The technique of mapping data to a high-dimensional representation where a

classification problem becomes simpler may look good on paper, but in practice it is

often computationally intractable. That’s where the "kernel trick" comes in, the key idea

that kernel methods are named after. Here’s the gist of it: for finding good decision

hyperplanes in the new representation space, you don’t have to explicitly compute the

coordinates of your points in the new space, you just need to compute the distance

between pairs of points in that space, which can be done very efficiently using what is

called a "kernel function". A kernel function is a computationally tractable operation that

maps any two points in your initial space to the distance between these points in your

target representation space, completely by-passing the explicit computation of the new

representation. Kernel functions are typically crafted by hand rather than learned from

data—in the case of SVM, only the separation hyperplane is learned.

At the time they were developed, SVMs exhibited state of the art performance on

simple classification problems, and were one of the few machine learning methods

backed by extensive theory and amenable to serious mathematical analysis, making it

well-understood and easily interpretable. Because of these useful properties, it became

extremely popular in the field for a long time.

However, SVM proved hard to scale to large datasets and did not provide very good

results for "perceptual" problems such as image classification. Since SVM is a "shallow"

method, applying SVM to perceptual problems requires first extracting useful

representations manually (a step called "feature engineering"), which is difficult and

brittle.

Decision trees are flowchart-like structures that can allow to classify input data points or

predict output values given inputs. They are easy to visualize and interpret. Decisions

trees learned from data started getting significant research interest in the 2000s, and by

2010 they were often preferred to kernel methods.

1.2.4 Decision trees, Random Forests and Gradient Boosting Machines

©Manning Publications Co. We welcome reader comments about anything in the manuscript - other than typos and

other simple mistakes. These will be cleaned up during production of the book by copyeditors and proofreaders.

https://forums.manning.com/forums/deep-learning-with-python

Licensed to <null>

Figure 1.11 A decision tree: the parameters that are learned are the questions about the

data. A question could be, for instance, "is coefficient 2 in the data higher than 3.5?".

In particular, the "Random Forest" algorithm introduced a robust and practical take on

decision tree learning that involves building a large number of specialized decision trees

then ensembling their outputs. Random Forests are applicable to a very wide range of

problems --you could say that they are almost always the second-best algorithm for any

shallow machine learning task. When the popular machine learning competition website

Kaggle.com got started in 2010, Random Forests quickly became a favorite on the

platform—until 2014, when Gradient Boosting Machines took over. Gradient Boosting

Machines, much like Random Forests, is a machine learning technique based on

ensembling weak prediction models, generally decision trees. It leverages "gradient

boosting", a way to improve any machine learning model by iteratively training new

models that specialize in addressing the weak points of the previous models. Applied to

decision trees, the use of the "gradient boosting" technique results in models that strictly

outperform Random Forests most of the time, while having very similar properties. It

may be one of the best, if not the best, algorithm for dealing with non-perceptual data

today. Alongside deep learning, it is one of the most commonly used technique in Kaggle

competitions.

Around 2010, while neural networks were almost completely shunned by the scientific

community at large, a number of people still working on neural networks started making

important breakthroughs: the groups of Geoffrey Hinton at the University of Toronto,

Yoshua Bengio at the University of Montreal, Yann LeCun at New York University, and

IDSIA in Switzerland.

In 2011, Dan Ciresan from IDSIA started winning academic image classification

competitions with GPU-trained deep neural networks—the first practical success of

modern deep learning. But the watershed moment came in 2012, with the entry of

Hinton’s group in the yearly large-scale image classification challenge ImageNet. The

ImageNet challenge was notoriously difficult at the time, consisting in classifying

high-resolution color images into 1000 different categories after training on 1.4 million

images. In 2011, the top-5 accuracy of the winning model, based on classical approaches

1.2.5 Back to neural networks

other simple mistakes. These will be cleaned up during production of the book by copyeditors and proofreaders.

https://forums.manning.com/forums/deep-learning-with-python

Licensed to <null>

to computer vision, was only 74.3%. Then in 2012, a team led by Alex Krizhevsky and

advised by Geoffrey Hinton was able to achieve a top-5 accuracy of 83.6%—a significant

breakthrough. The competition has been dominated by deep convolutional neural

networks every year since. By 2015, we had reached an accuracy of 96.4%, and the

classification task on ImageNet was considered to be a completely solved problem.

Since 2012, deep convolutional neural networks ("convnets") have become the go-to

algorithm for all computer vision tasks, and generally all perceptual tasks. At major

computer vision conferences in 2015 or 2016, it had become nearly impossible to find

presentations that did not involve convnets in some form. At the same time, deep learning

has also found applications in many other types of problems, such as natural language

processing. It has come to completely replace SVMs and decision trees in a wide range of

applications. For instance, for several years, the European Organization for Nuclear

Research, CERN, used decision tree-based methods for analysis of particle data from the

ATLAS detector at the Large Hadron Collider (LHC), but they eventually switched to

Keras-based deep neural networks due to their higher performance and ease of training

on large datasets.

The reason why deep learning took off so quickly is primarily that it offered better

performance on many problems. But that’s not the only reason. Deep learning is also

making problem-solving much easier, because it completely automates what used to be

the most crucial step in a machine learning workflow: "feature engineering".

Previous machine learning techniques, "shallow" learning, only involved

transforming the input data into one or two successive representation spaces, usually via

very simple transformations such as high-dimensional non-linear projections (SVM) or

decision trees. But the refined representations required by complex problems generally

cannot be attained by such techniques. As such, humans had to go to great length to make

the initial input data more amenable to processing by these methods, i.e. they had to

manually engineer good layers of representations for their data. This is what is called

"feature engineering". Deep learning, on the other hand, completely automates this step:

with deep learning, you all features in one pass rather than having to engineer themlearn

yourself. This has greatly simplified machine learning workflows, often replacing very

sophisticated multi-stage pipelines with a single, simple, end-to-end deep learning model.

You may ask, if the crux of the issue is to have multiple successive layers of

representation, could shallow methods be applied repeatedly to emulate the effects of

deep learning? In practice, there are fast-diminishing returns to successive application of

shallow learning methods, because the optimal first representation layer in a 3-layer

. What is transformativemodel is not the optimal first layer in a 1-layer or 2-layer model

about deep learning is that it allows a model to learn all layers of representation , atjointly

the same time, rather than in succession ("greedily", as it is called). With joint feature

learning, whenever the model adjusts one of its internal features, all other features that

depend on it will automatically adapt to the change, without requiring human

1.2.6 What makes deep learning different

other simple mistakes. These will be cleaned up during production of the book by copyeditors and proofreaders.

https://forums.manning.com/forums/deep-learning-with-python

Licensed to <null>

剩余316页未读，继续阅读

HandyOrg

粉丝: 23
资源: 3

Python深度学习实战

Francois Chollet的《Deep Learning with Python》：权威指南与实践

Python深度学习入门指南：《Deep Learning with Python》

Python深度学习入门指南：Francois Chollet的《Deep Learning with Python》

deep learning with Python

deep learning with python

Python深度学习实例解析与代码展示

boost-chrono-1.53.0-28.el7.x86_64.rpm.zip

atlas-devel-3.10.1-12.el7.x86_64.rpm.zip

atkmm-2.24.2-1.el7.i686.rpm.zip

bsf-javadoc-2.4.0-19.el7.noarch.rpm.zip

最新资源