《自然语言处理综论（第2版）》打印版导览：核心技术与应用详解

5星 · 超过95%的资源需积分: 10 175 浏览量更新于2024-07-18 收藏 12.98MB PDF 举报

《自然语言处理综论（第二版，英文打印版）》是由Daniel Jurafsky和James H. Martin合著的经典之作，该书在自然语言处理和计算语言学领域占有重要地位。这本教材全面深入地探讨了自然语言处理的各种核心概念和技术，旨在帮助读者理解并掌握从基础知识到高级主题的广泛内容。该书共分为四个部分： 1. **Part I：MORPHOLOGY** - 这一部分涵盖了形态学的基础，包括正则表达式与自动机（Chapter 2），词汇与变换器（Chapter 3），n-gram模型（Chapter 4），词类和词性标注（Chapter 5），以及隐马尔可夫模型和最大熵模型（Chapter 6）。这些章节介绍如何分析和处理单词结构，是语言理解的基石。 2. **Part II：PHONETICS** - 关注语音学和语音合成技术（Chapter 7-8），接着是自动语音识别（ASR）的理论和实践，包括基础（Chapter 9）及进阶话题（Chapter 10），以及计算音韵学（Chapter 11）。这部分内容对于声音转文本系统至关重要。 3. **Part III：SYNTAX** - 进入句法层面，涵盖了英语的正式语法（Chapter 12），上下文无关文法解析（Chapter 13），统计解析（Chapter 14），语言复杂性理论（Chapter 15），以及特征和统一性概念（Chapter 16）。这些章节讨论了句子结构的规则和语言模型。 4. **Part IV：SEMANTICS AND PRAGMATICS** - 最后一部分探讨语义和语用学，如意义的表示（Chapter 17）、计算语义学（Chapter 18）、词汇语义（Chapter 19）以及计算机处理语言理解和交流的实际应用。这本书不仅适合研究生和专业人士作为深入学习的参考书籍，也对研究人员和工程师设计和实现自然语言处理系统提供了宝贵资源。通过阅读本书，读者可以建立起坚实的自然语言处理基础，了解不同技术在实际应用中的操作流程，以及如何结合理论与实践进行创新。

DRAFT

14 Chapter 1. Introduction

inventio n of the calculus by Leibnitz and by Newton, the multiple development o f the

theory of natural selection b y Wallace and by Darwin, and the multiple invention of

the telephone by Gray and Bell.

But Merton gives a further array of evidence for the

hypothesis that m ultiple discovery is the rule rather than the exception, including many

cases of putative singletons that turn out be a rediscovery of previously unpublished or

perhaps inaccessible work. An even stronger piece of evidence is his ethnomethodolog-

ical point that scientists themselves act under the assumption that multiple invention is

the norm. Thus many aspects of scientiﬁc life are designed to help scientists avoid be-

ing “scooped”; submission dates on journal articles; careful dates in research records;

circulation of preliminary or technical reports.

1.6.8 A Final Brief Note on Psychology

Many of the chapters in this book include short summaries of psychological research

on human processing. Of course, understanding human language processing is an im-

portant scientiﬁc goal in its own right and is part of the general ﬁeld of cogn itive sci-

ence. However, an understanding of human language processing can often be helpful

in building better machine models of language. This seems contrary to the popular

wisdom, which holds that direct mimicry of n ature’s algorithms is rarely useful in en-

gineering applications. For example, the argument is often made that if we copied

nature exactly, airplanes would ﬂap their wings; yet airplanes with ﬁxed wings are a

more successful engineering solution. But language is not aeronautics. Cribbing from

nature is sometimes useful for aeronautics (after all, airplanes do have wings), bu t it is

particularly useful when we are trying to solve human-centered tasks. Airplane ﬂight

has different goals than bird ﬂight; but the goal of speech recognition systems, for ex-

ample, is to perform exactly the task that human court reporters perform every day:

transcribe spoken dialog. Since people already do this well, we can learn from nature’s

previous solution. Since an important application of speech and language processing

systems is for human-computer interaction, it makes sense to copy a solution that be-

haves the way people are accustomed to.

1.7 SUMMARY

This chapter introduces the ﬁeld of speech and language processing. The following are

some of the highlights of this chapter.

• A good way to understand the concerns of speech and language processing re-

search is to consider what it would take to create an intelligent agent like HAL

from 2001: A Space Odyssey, or build a web-based question answerer, or a ma-

chine translation engine.

• Speech and language technology relies on formal models, or representations, of

Ogburn and Thomas are generally credited with noticing that the prevalence of multiple inventions sug-

gests that the cultural milieu and not individual genius is the deciding causal factor in scientiﬁc discovery . In

an amusing bit of recursion, ho wever, Merton notes that even this idea has been multiply discovered, citing

sources from the 19th century and earlier!

DRAFT

Section 1.7. Summary 15

knowledge of language at the levels of phonology and phonetics, morphology,

syntax, semantics, pragmatics and discourse. A small number of formal models

including state machines, formal rule systems, logic, and probabilistic models

are used to capture this knowledge.

• The foundations of speech and language technology lie in computer science, lin-

guistics, mathematics, electrical engineering and psychology. A small number of

algorithms from standard frameworks are used throughout speech and language

processing,

• The critical connection between language and thought has placed speech and

language processing technology at the center of debate over intelligent machines.

Furthermore, research on how people interact with complex media indicates that

speech and language processing technology will be critical in the development

of future technologies.

• Revolutionary applications of speech and language processing are currently in

use around the world. The creation of the web, as well as signiﬁcant recent

improvements in speech recognition and synthesis, will lead to many more ap-

plications.

BIBLIOGRAPHICAL AND HISTORICAL NOTES

Research in the various subareas of speech and language processing is spread across

a wide number of conference proceedings and journals. The conferences and journals

most centrally concerned with natural language processing and computational linguis-

tics are asso ciated with the Association for Computational L inguistics (ACL), its Eu-

ropean counterpart (EACL), and the International Conference on Computational Lin-

guistics (COLING). The annual proceedings of ACL, NAACL, and EACL, and the

biennial COLING conference are the primary forums for work in this area. Related

conferences include various proceedings of ACL Special Interest Groups (SIGs) such

as the Conference on Natural Language Learning (CoNLL), as well as the conference

on Empirical Methods in Natural Language Processing (EMNLP).

Research on speech recognition, understanding, and synthesis is p resented at the

annual INTERSPEECH conference, which is called the International Conference on

Spoken Language Processing (ICSLP) and the European Conference on Speech Com-

munication and Technology (EUROSPEECH) in alternating years, or the annual IEEE

International Conference on Acoustics, Speech, and Signal Processing (IEEE ICASSP).

Spoken language dialogue research is presented at these or at workshops like SIGDial.

Journals include ComputationalLinguistics, Natural LanguageEngineering, Speech

Communication, Computer Speech and Language,theIEEE Transactions on Audio,

Speech & Language Processing and the ACM Transactions on Speech and Language

Processing.

Work on language processing from an Artiﬁcial Intelligence perspective can be

found in the annual meetings of the American Association for Artiﬁcial Intelligence

(AAAI), as well as the biennial International Joint Conference on Artiﬁcial Intelli-

DRAFT

Section 1.7. Summary 17

Allen, J. (1995). Natural Language Understanding.Benjamin

Cummings, Menlo Park, CA.

Backus, J. W. (1959). The syntax and semantics of the proposed

international algebraic language of the Zurch ACM-GAMM

Conference. In Information Processing: Proceedings of the

International Conference on Information Processing, Paris,

pp. 125–132. UNESCO.

Berger, A., Della Pietra, S. A., and Della Pietra, V. J. (1996). A

maximum entropy approach to natural language processing.

Computational Linguistics, 22(1), 39–71.

Bird, S. and Loper, E. (2004). NLTK: The Natural Language

Toolkit. In Proceedings of the ACL 2004 demonstration ses-

sion, Barcelona, Spain, pp. 214–217.

Bledsoe, W. W. and Browning, I. (1959). Pattern recognition

and reading by machine. In 1959 Proceedings of the Eastern

Joint Computer Conference, pp. 225–232. Academic, New

York.

Bresnan, J. and Kaplan, R. M. (1982). Introduction: Grammars

as mental representations of language. In Bresnan, J. (Ed.),

The Mental Representation of Grammatical Relations.MIT

Press, Cambridge, MA.

Bro wn, P. F., Cocke, J., Della Pietra, S. A., Della Pietra, V. J.,

Jelinek, F., Laf ferty, J. D., Mercer, R. L., and Roossin, P. S.

(1990). A statistical approach to machine translation. Com-

putational Linguistics, 16(2), 79–85.

Carlson, L., Marcu, D., and Okurowski, M. E. (2001). Build-

ing a discourse-tagged corpus in the framework of rhetorical

structure theory. In Proceedings of SIGDIAL.

Charniak, E. (1993). Statistical Language Learning.MITPress.

Chomsky, N. (1956). Three models for the description of lan-

guage. IRI Transactions on Information Theory, 2(3), 113–

124.

Chomsky, N. (1959). A review of B. F. Skinner’s “Verbal Be-

havior”. Language, 35, 26–58.

Church, K. W. (1980). On memory limitations in natural lan-

guage processing. Master’s thesis, MIT. Distributed by the

Indiana University Linguistics Club.

Cohen, P. R. and Perrault, C. R. (1979). Elements of a plan-

based theory of speech acts. Cognitive Science, 3(3), 177–

212.

Colmerauer, A. (1970). Les syst`emes-q ou un formalisme pour

analyser et synth´etiser des phrase sur ordinateur. Internal pub-

lication 43, D´epartement d’informatique de l’Universit´ede

Montr´eal†.

Colmerauer, A. (1975). Les grammaires de m´etamorphose GIA.

Internal publication, Groupe Intelligence artiﬁcielle, Facult´e

des Sciences de Luminy, Universit´e Aix-Marseille II, France,

Nov 1975. English version, Metamorphosis grammars. In L.

Bolc, (Ed.), Natural Language Communication with Comput-

ers, Lecture Notes in Computer Science 63, Springer Verlag,

Berlin, 1978, pp. 133–189.

Cullingford, R. E. (1981). SAM. In Schank, R. C. and Riesbeck,

C. K. (Eds.), Inside Computer Understanding: Five Programs

plus Miniatur es, pp. 75–119. Lawrence Erlbaum, Hillsdale,

NJ.

Davis, K. H., Biddulph, R., and Balashek, S. (1952). Automatic

recognition of spoken digits.

Journal of the Acoustical Society

of America, 24(6), 637–642.

Dejean, H. and Tjong Kim Sang, E. F. (2001). Introduction to

the CoNLL-2001 shared task: Clause identiﬁcation. In Pro-

ceedings of CoNLL-2001.

Fillmore, C. J. (1968). The case for case. In Bach, E. W. and

Harms, R. T. (Eds.), Universals in Linguistic Theory, pp. 1–

88. Holt, Rinehart & Winston, New York.

Francis, W. N. (1979). A tagged corpus – problems and

prospects. In Greenbaum, S., Leech, G., and Sv a rtvik, J.

(Eds.), Studies in English linguistics for Randolph Quirk, pp.

192–209. Longman, London and New York.

Francis, W. N. and Kuˇcera, H. (1982). Frequency Analysis of

English Usage. Houghton Mifﬂin, Boston.

Gazdar, G. and Mellish, C. (1989). Natural Language Process-

ing in LISP. Addison Wesley.

Grosz, B. J. (1977). The representation and use of focus in a

system for understanding dialogs. In IJCAI-77, Cambridge,

MA, pp. 67–76. Morgan Kaufmann. Reprinted in Grosz et al.

(1986).

Grosz, B. J., Jones, K. S., and Webber, B. L. (Eds.). (1986).

Readings in Natural Language Processing. Morgan Kauf-

mann, Los Altos, Calif.

Hajiˇc, J. (1998). Building a Syntactically Annotated Corpus:

The Prague Dependency Treebank, pp. 106–132. Karolinum,

Prague/Praha.

Harris, Z. S. (1962). String Analysis of Sentence Structure .

Mouton, The Hague.

Hobbs, J. R. (1978). Resolving pronoun references. Lingua,

44, 311–338. Reprinted in Grosz et al. (1986).

Joshi, A. K. and Hopely, P. (1999). A parser from antiquity. In

Kornai, A. (Ed.), Extended Finite State Models of Language,

pp. 6–15. Cambridge Univ ersity Press, Cambridge.

Kaplan, R. M. and Kay, M. (1981). Phonological rules and

ﬁnite-state transducers. Paper presented at the Annual meet-

ing of the Linguistics Society of America. New York.

Karttunen, L. (1999). Comments on Joshi. In Kornai, A. (Ed.),

Extended Finite State Models of Language, pp. 16–18. Cam-

bridge Uni versity Press, Cambridge.

Kay, M. (1979). Functional grammar. In BLS-79,Berkeley,CA,

pp. 142–158.

Kilgarrif f, A. and Pa lmer, M. (Eds.). (2000). Computing and the

Humanities: Special Issue on SENSEVAL, Vol. 34. Kluwer.

Kintsch, W. (1974). The Representation of Meaning in Memory.

Wiley, New York.

Kleene, S. C. (1951). Representation of eve nts in nerve nets

and ﬁnite automata. Tech. rep. RM-704, RAND Corporation.

RAND Research Memorandum†.

DRAFT

18 Chapter 1. Introduction

Kleene, S. C. (1956). Representation of events in nerve nets and

ﬁnite automata. In Shannon, C. and McCarthy, J. (Eds.), Au-

tomata Studies, pp. 3–41. Princeton University Press, Prince-

ton, NJ.

K o enig, W., Dunn, H. K., Y., L., and Lacy (1946). The sound

spectrograph. Journal of the Acoustical Society of America,

18, 19–49.

Kuˇcera, H. and Francis, W. N. (1967). Computational analy-

sis of present-day American English. Brown University Press,

Providence, RI.

Lehnert, W. G. (1977). A conceptual theory of question an-

swering. In IJCAI-77, Cambridge, MA, pp. 158–164. Morgan

Kaufmann.

Manning, C. D., Raghavan, P., and Sch¨utze, H. (2008). In-

troduction to Information Retrieval. Cambridge University

Press, Cambridge, UK.

Manning, C. D. and Sch¨utze, H. (1999). Foundations of Statis-

tical Natural Language Processing. MIT Press, Cambridge,

MA.

Marcus, M. P., Santorini, B., and Marcinkiewicz, M. A. (1993).

Building a large annotated corpus of English: The Penn tree-

bank. Computational Linguistics, 19(2), 313–330.

McCulloch, W. S. and Pitts, W. (1943). A logical calculus of

ideas immanent in nervous activity. Bulletin of Mathematical

Biophysics, 5, 115–133. Reprinted in Neurocomputing: Foun-

dations of Research, ed. by J. A. Anderson and E Rosenfeld.

MIT Press 1988.

Merton, R. K. (1961). Singletons and multiples in scientiﬁcdis-

covery . American Philosophical Society Proceedings, 105(5),

470–486.

Miltsakaki, E., Prasad, R., Joshi, A. K., and Webber, B. L.

(2004). The Penn Discourse Treebank. In LREC-04.

Mosteller, F. and Wallace, D. L. (1964). Inference and Disputed

Authorship: The Federalist. Springer-Verlag, New York. 2nd

Edition appeared in 1984 and was called Applied Bayesian

and Classical Inference .

Naur, P., Backus, J. W., Bauer, F. L., Green, J., Katz, C.,

McCarthy, J., Perlis, A. J., Rutishauser, H., Samelson, K.,

Vauquois, B., Wegstein, J. H., v an Wijnagaarden, A., and

Woodger, M. (1960). Report on the algorithmic language AL-

GOL 60. Communications of the ACM, 3(5), 299–314. Re-

vised in CACM 6:1, 1-17, 1963.

Norman, D. A. and Rumelhart, D. E. (1975). Explorations in

Cognition. Freeman, San Francisco, CA.

Och, F. J. and Ney, H. (2003). A systematic comparison of var-

ious statistical alignment models. Computational Linguistics,

29(1), 19–51.

Ogburn, W. F. and Thomas, D. S. (1922). Are in ventions in-

evitable? A note on social evolution. Political Science Quar-

terly, 37

, 83–98.

Palmer, M., Fellbaum, C., Cotton, S., Delfs, L., and Dang,

H. T. (2001). English tasks: All-words and verb lexical sam-

ple. In Proceedings of SENSEVAL-2: Second International

Workshop on Evaluating Word Sense Disambiguation Sys-

tems,Toulouse,France.

Palmer, M., Kingsbury, P., and Gildea, D. (2005). The proposi-

tion bank: An annotated corpus of semantic roles.. Computa-

tional Linguistics, 31(1), 71–106.

Partee, B. H., ter Meulen, A., and Wall, R. E. (1990). Mathe-

matical Methods in Linguistics. Kluwer, Dordrecht.

Pearl, J. (1988). Pr obabilistic Reasoning in Intelligent Systems:

Networks of Plausible Inference. Morgan Kaufman, San Ma-

teo, Ca.

Pereira, F. C. N. and Shieber, S. M. (1987). Prolog and Natural-

Languag e Analysis,Vol.10ofCSLI Lectur e Notes. Chicago

University Press, Chicago.

Pereira, F. C. N. and Warren, D. H. D. (1980). Deﬁnite clause

grammars for language analysis— a survey of the formalism

and a comparison with augmented transition networks. Artiﬁ-

cial Intelligence, 13(3), 231–278.

Perrault, C. R. and Allen, J. (1980). A plan-based analysis of

indirect speech acts. American Journal of Computational Lin-

guistics, 6(3-4), 167–182.

Quillian, M. R. (1968). Semantic memory. In Minsky, M. (Ed.),

Semantic Information Processing, pp. 227–270. MIT Press,

Cambridge, MA.

Rabiner, L. R. and Juang, B. (1993). Fundamentals of Speech

Recognition. Prentice Hall, Englewood Cliffs, NJ.

Reeves, B. and Nass, C. (1996). The Media Equation: How

People Treat Computers, Television, and New Media Like Real

People and Places. Cambridge Uni versity Press, Cambridge.

Russell, S. and Norvig, P. (2002). Artiﬁcial Intelligence: A

Modern Approach. Prentice Hall, Englewood Cliffs, NJ. Sec-

ond edition.

Schank, R. C. (1972). Conceptual dependency: A theory of nat-

ural language processing. Cognitive Psychology, 3, 552–631.

Schank, R. C. and Albelson, R. P. (1977). Scripts, Plans, Goals

and Understanding. Lawrence Erlbaum, Hillsdale, NJ.

Schank, R. C. and Riesbeck, C. K. (Eds.). (1981). Inside

Computer Understanding: Five Programs plus Miniatures.

Lawrence Erlbaum, Hillsdale, NJ.

Searle, J. R. (1980). Minds, brains, and programs. Behavioral

and Brain Sciences, 3, 417–457.

Shannon, C. E. (1948). A mathematical theory of communica-

tion. Bell System Technical Journal, 27(3), 379–423. Contin-

ued in following volume.

Shieber, S. M. (1994). Lessons from a restricted Turing test.

Communications of the ACM,

37(6), 70–78.

Sidner, C. L. (1983). Focusing in the comprehension of deﬁnite

anaphora. In Brady, M. and Berwick, R. C. (Eds.), Compu-

tational Models of Discourse, pp. 267–330. MIT Press, Cam-

bridge, MA.

Simmons, R. F. (1973). Semantic networks: Their computa-

tion and use for understanding English sentences. In Schank,

R. C. and Colby, K. M. (Eds.), Computer Models of Thought

and Langua ge, pp. 61–113. W.H. Freeman and Co., San Fran-

cisco.

剩余1069页未读，继续阅读

Albert_Dillon

粉丝: 3
资源: 8

《自然语言处理综论（第2版）》打印版导览：核心技术与应用详解

自然语言处理综论#（美）Daniel Jurafsky著 冯志伟译.pdf

自然语言处理综论 第2版_2018.03_784_14391789.pdf

Speech and Language Processing 2nd edition.pdf

自然语言处理综论第二版pdf

自然语音处理综论第二版 英文版

EM算法&Learn Python the Hard Way（第三版）&PYTHON自然语言处理中文版&集体智慧编程&自然语言处理综论 第二版

自然语言处理综论第二版冯志伟pdf

英文版自然语言处理综论

自然语言处理综论

自然语言处理综论（中英文）

最新资源

自然语言处理综论#（美）Daniel Jurafsky著冯志伟译.pdf

自然语言处理综论第2版_2018.03_784_14391789.pdf

自然语音处理综论第二版英文版

EM算法&Learn Python the Hard Way（第三版）&PYTHON自然语言处理中文版&集体智慧编程&自然语言处理综论第二版