id	sid	tid	token	lemma	pos
en-wikipedia-org-1345	1	1	Information	information	NN
en-wikipedia-org-1345	1	2	theory	theory	NN
en-wikipedia-org-1345	1	3	-	-	:
en-wikipedia-org-1345	1	4	Wikipedia	wikipedia	NN
en-wikipedia-org-1345	1	5	Information	information	NN
en-wikipedia-org-1345	1	6	theory	theory	NN
en-wikipedia-org-1345	1	7	From	from	IN
en-wikipedia-org-1345	1	8	Wikipedia	Wikipedia	NNP
en-wikipedia-org-1345	1	9	,	,	,
en-wikipedia-org-1345	1	10	the	the	DT
en-wikipedia-org-1345	1	11	free	free	JJ
en-wikipedia-org-1345	1	12	encyclopedia	encyclopedia	NN
en-wikipedia-org-1345	1	13	Jump	Jump	NNP
en-wikipedia-org-1345	1	14	to	to	IN
en-wikipedia-org-1345	1	15	navigation	navigation	NN
en-wikipedia-org-1345	1	16	Jump	Jump	NNP
en-wikipedia-org-1345	1	17	to	to	TO
en-wikipedia-org-1345	1	18	search	search	VB
en-wikipedia-org-1345	1	19	Theory	theory	NN
en-wikipedia-org-1345	1	20	dealing	deal	VBG
en-wikipedia-org-1345	1	21	with	with	IN
en-wikipedia-org-1345	1	22	information	information	NN
en-wikipedia-org-1345	1	23	Not	not	RB
en-wikipedia-org-1345	1	24	to	to	TO
en-wikipedia-org-1345	1	25	be	be	VB
en-wikipedia-org-1345	1	26	confused	confuse	VBN
en-wikipedia-org-1345	1	27	with	with	IN
en-wikipedia-org-1345	1	28	Information	Information	NNP
en-wikipedia-org-1345	1	29	science	science	NN
en-wikipedia-org-1345	1	30	.	.	.
en-wikipedia-org-1345	2	1	This	this	DT
en-wikipedia-org-1345	2	2	article	article	NN
en-wikipedia-org-1345	2	3	may	may	MD
en-wikipedia-org-1345	2	4	contain	contain	VB
en-wikipedia-org-1345	2	5	indiscriminate	indiscriminate	NN
en-wikipedia-org-1345	2	6	,	,	,
en-wikipedia-org-1345	2	7	excessive	excessive	JJ
en-wikipedia-org-1345	2	8	,	,	,
en-wikipedia-org-1345	2	9	or	or	CC
en-wikipedia-org-1345	2	10	irrelevant	irrelevant	JJ
en-wikipedia-org-1345	2	11	examples	example	NNS
en-wikipedia-org-1345	2	12	.	.	.
en-wikipedia-org-1345	3	1	Please	please	UH
en-wikipedia-org-1345	3	2	improve	improve	VB
en-wikipedia-org-1345	3	3	the	the	DT
en-wikipedia-org-1345	3	4	article	article	NN
en-wikipedia-org-1345	3	5	by	by	IN
en-wikipedia-org-1345	3	6	adding	add	VBG
en-wikipedia-org-1345	3	7	more	more	JJR
en-wikipedia-org-1345	3	8	descriptive	descriptive	JJ
en-wikipedia-org-1345	3	9	text	text	NN
en-wikipedia-org-1345	3	10	and	and	CC
en-wikipedia-org-1345	3	11	removing	remove	VBG
en-wikipedia-org-1345	3	12	less	less	RBR
en-wikipedia-org-1345	3	13	pertinent	pertinent	JJ
en-wikipedia-org-1345	3	14	examples	example	NNS
en-wikipedia-org-1345	3	15	.	.	.
en-wikipedia-org-1345	4	1	See	see	VB
en-wikipedia-org-1345	4	2	Wikipedia	Wikipedia	NNP
en-wikipedia-org-1345	4	3	's	's	POS
en-wikipedia-org-1345	4	4	guide	guide	NN
en-wikipedia-org-1345	4	5	to	to	IN
en-wikipedia-org-1345	4	6	writing	write	VBG
en-wikipedia-org-1345	4	7	better	well	JJR
en-wikipedia-org-1345	4	8	articles	article	NNS
en-wikipedia-org-1345	4	9	for	for	IN
en-wikipedia-org-1345	4	10	further	further	JJ
en-wikipedia-org-1345	4	11	suggestions	suggestion	NNS
en-wikipedia-org-1345	4	12	.	.	.
en-wikipedia-org-1345	5	1	(	(	-LRB-
en-wikipedia-org-1345	5	2	May	May	NNP
en-wikipedia-org-1345	5	3	2020	2020	CD
en-wikipedia-org-1345	5	4	)	)	-RRB-
en-wikipedia-org-1345	5	5	Information	information	NN
en-wikipedia-org-1345	5	6	theory	theory	NN
en-wikipedia-org-1345	5	7	Entropy	Entropy	NNP
en-wikipedia-org-1345	5	8	Differential	Differential	NNP
en-wikipedia-org-1345	5	9	entropy	entropy	JJ
en-wikipedia-org-1345	5	10	Conditional	Conditional	NNP
en-wikipedia-org-1345	5	11	entropy	entropy	JJ
en-wikipedia-org-1345	5	12	Joint	Joint	NNP
en-wikipedia-org-1345	5	13	entropy	entropy	JJ
en-wikipedia-org-1345	5	14	Mutual	mutual	JJ
en-wikipedia-org-1345	5	15	information	information	NN
en-wikipedia-org-1345	5	16	Conditional	Conditional	NNP
en-wikipedia-org-1345	5	17	mutual	mutual	JJ
en-wikipedia-org-1345	5	18	information	information	NN
en-wikipedia-org-1345	5	19	Relative	relative	JJ
en-wikipedia-org-1345	5	20	entropy	entropy	JJ
en-wikipedia-org-1345	5	21	Entropy	entropy	JJ
en-wikipedia-org-1345	5	22	rate	rate	NN
en-wikipedia-org-1345	5	23	Limiting	Limiting	NNP
en-wikipedia-org-1345	5	24	density	density	NN
en-wikipedia-org-1345	5	25	of	of	IN
en-wikipedia-org-1345	5	26	discrete	discrete	JJ
en-wikipedia-org-1345	5	27	points	point	NNS
en-wikipedia-org-1345	5	28	Asymptotic	asymptotic	JJ
en-wikipedia-org-1345	5	29	equipartition	equipartition	NN
en-wikipedia-org-1345	5	30	property	property	NN
en-wikipedia-org-1345	5	31	Rate	rate	NN
en-wikipedia-org-1345	5	32	–	–	:
en-wikipedia-org-1345	5	33	distortion	distortion	NN
en-wikipedia-org-1345	5	34	theory	theory	NN
en-wikipedia-org-1345	5	35	Shannon	Shannon	NNP
en-wikipedia-org-1345	5	36	's	's	POS
en-wikipedia-org-1345	5	37	source	source	NN
en-wikipedia-org-1345	5	38	coding	code	VBG
en-wikipedia-org-1345	5	39	theorem	theorem	JJ
en-wikipedia-org-1345	5	40	Channel	Channel	NNP
en-wikipedia-org-1345	5	41	capacity	capacity	NN
en-wikipedia-org-1345	5	42	Noisy	Noisy	NNP
en-wikipedia-org-1345	5	43	-	-	HYPH
en-wikipedia-org-1345	5	44	channel	channel	NNP
en-wikipedia-org-1345	5	45	coding	code	VBG
en-wikipedia-org-1345	5	46	theorem	theorem	JJ
en-wikipedia-org-1345	5	47	Shannon	Shannon	NNP
en-wikipedia-org-1345	5	48	–	–	:
en-wikipedia-org-1345	5	49	Hartley	Hartley	NNP
en-wikipedia-org-1345	5	50	theorem	theorem	NN
en-wikipedia-org-1345	5	51	v	v	IN
en-wikipedia-org-1345	5	52	t	t	NN
en-wikipedia-org-1345	5	53	e	e	NNP
en-wikipedia-org-1345	5	54	Information	information	NN
en-wikipedia-org-1345	5	55	theory	theory	NN
en-wikipedia-org-1345	5	56	studies	study	VBZ
en-wikipedia-org-1345	5	57	the	the	DT
en-wikipedia-org-1345	5	58	quantification	quantification	NN
en-wikipedia-org-1345	5	59	,	,	,
en-wikipedia-org-1345	5	60	storage	storage	NN
en-wikipedia-org-1345	5	61	,	,	,
en-wikipedia-org-1345	5	62	and	and	CC
en-wikipedia-org-1345	5	63	communication	communication	NN
en-wikipedia-org-1345	5	64	of	of	IN
en-wikipedia-org-1345	5	65	information	information	NN
en-wikipedia-org-1345	5	66	.	.	.
en-wikipedia-org-1345	6	1	It	-PRON-	PRP
en-wikipedia-org-1345	6	2	was	be	VBD
en-wikipedia-org-1345	6	3	originally	originally	RB
en-wikipedia-org-1345	6	4	proposed	propose	VBN
en-wikipedia-org-1345	6	5	by	by	IN
en-wikipedia-org-1345	6	6	Claude	Claude	NNP
en-wikipedia-org-1345	6	7	Shannon	Shannon	NNP
en-wikipedia-org-1345	6	8	in	in	IN
en-wikipedia-org-1345	6	9	1948	1948	CD
en-wikipedia-org-1345	6	10	to	to	TO
en-wikipedia-org-1345	6	11	find	find	VB
en-wikipedia-org-1345	6	12	fundamental	fundamental	JJ
en-wikipedia-org-1345	6	13	limits	limit	NNS
en-wikipedia-org-1345	6	14	on	on	IN
en-wikipedia-org-1345	6	15	signal	signal	NN
en-wikipedia-org-1345	6	16	processing	processing	NN
en-wikipedia-org-1345	6	17	and	and	CC
en-wikipedia-org-1345	6	18	communication	communication	NN
en-wikipedia-org-1345	6	19	operations	operation	NNS
en-wikipedia-org-1345	6	20	such	such	JJ
en-wikipedia-org-1345	6	21	as	as	IN
en-wikipedia-org-1345	6	22	data	datum	NNS
en-wikipedia-org-1345	6	23	compression	compression	NN
en-wikipedia-org-1345	6	24	,	,	,
en-wikipedia-org-1345	6	25	in	in	IN
en-wikipedia-org-1345	6	26	a	a	DT
en-wikipedia-org-1345	6	27	landmark	landmark	NN
en-wikipedia-org-1345	6	28	paper	paper	NN
en-wikipedia-org-1345	6	29	titled	title	VBN
en-wikipedia-org-1345	6	30	"	"	``
en-wikipedia-org-1345	6	31	A	a	DT
en-wikipedia-org-1345	6	32	Mathematical	mathematical	JJ
en-wikipedia-org-1345	6	33	Theory	Theory	NNP
en-wikipedia-org-1345	6	34	of	of	IN
en-wikipedia-org-1345	6	35	Communication	Communication	NNP
en-wikipedia-org-1345	6	36	"	"	''
en-wikipedia-org-1345	6	37	.	.	.
en-wikipedia-org-1345	7	1	The	the	DT
en-wikipedia-org-1345	7	2	field	field	NN
en-wikipedia-org-1345	7	3	is	be	VBZ
en-wikipedia-org-1345	7	4	at	at	IN
en-wikipedia-org-1345	7	5	the	the	DT
en-wikipedia-org-1345	7	6	intersection	intersection	NN
en-wikipedia-org-1345	7	7	of	of	IN
en-wikipedia-org-1345	7	8	probability	probability	NN
en-wikipedia-org-1345	7	9	theory	theory	NN
en-wikipedia-org-1345	7	10	,	,	,
en-wikipedia-org-1345	7	11	statistics	statistic	NNS
en-wikipedia-org-1345	7	12	,	,	,
en-wikipedia-org-1345	7	13	computer	computer	NN
en-wikipedia-org-1345	7	14	science	science	NN
en-wikipedia-org-1345	7	15	,	,	,
en-wikipedia-org-1345	7	16	statistical	statistical	JJ
en-wikipedia-org-1345	7	17	mechanics	mechanic	NNS
en-wikipedia-org-1345	7	18	,	,	,
en-wikipedia-org-1345	7	19	information	information	NN
en-wikipedia-org-1345	7	20	engineering	engineering	NN
en-wikipedia-org-1345	7	21	,	,	,
en-wikipedia-org-1345	7	22	and	and	CC
en-wikipedia-org-1345	7	23	electrical	electrical	JJ
en-wikipedia-org-1345	7	24	engineering	engineering	NN
en-wikipedia-org-1345	7	25	.	.	.
en-wikipedia-org-1345	8	1	A	a	DT
en-wikipedia-org-1345	8	2	key	key	JJ
en-wikipedia-org-1345	8	3	measure	measure	NN
en-wikipedia-org-1345	8	4	in	in	IN
en-wikipedia-org-1345	8	5	information	information	NN
en-wikipedia-org-1345	8	6	theory	theory	NN
en-wikipedia-org-1345	8	7	is	be	VBZ
en-wikipedia-org-1345	8	8	entropy	entropy	JJ
en-wikipedia-org-1345	8	9	.	.	.
en-wikipedia-org-1345	9	1	Entropy	entropy	JJ
en-wikipedia-org-1345	9	2	quantifies	quantify	VBZ
en-wikipedia-org-1345	9	3	the	the	DT
en-wikipedia-org-1345	9	4	amount	amount	NN
en-wikipedia-org-1345	9	5	of	of	IN
en-wikipedia-org-1345	9	6	uncertainty	uncertainty	NN
en-wikipedia-org-1345	9	7	involved	involve	VBN
en-wikipedia-org-1345	9	8	in	in	IN
en-wikipedia-org-1345	9	9	the	the	DT
en-wikipedia-org-1345	9	10	value	value	NN
en-wikipedia-org-1345	9	11	of	of	IN
en-wikipedia-org-1345	9	12	a	a	DT
en-wikipedia-org-1345	9	13	random	random	JJ
en-wikipedia-org-1345	9	14	variable	variable	NN
en-wikipedia-org-1345	9	15	or	or	CC
en-wikipedia-org-1345	9	16	the	the	DT
en-wikipedia-org-1345	9	17	outcome	outcome	NN
en-wikipedia-org-1345	9	18	of	of	IN
en-wikipedia-org-1345	9	19	a	a	DT
en-wikipedia-org-1345	9	20	random	random	JJ
en-wikipedia-org-1345	9	21	process	process	NN
en-wikipedia-org-1345	9	22	.	.	.
en-wikipedia-org-1345	10	1	For	for	IN
en-wikipedia-org-1345	10	2	example	example	NN
en-wikipedia-org-1345	10	3	,	,	,
en-wikipedia-org-1345	10	4	identifying	identify	VBG
en-wikipedia-org-1345	10	5	the	the	DT
en-wikipedia-org-1345	10	6	outcome	outcome	NN
en-wikipedia-org-1345	10	7	of	of	IN
en-wikipedia-org-1345	10	8	a	a	DT
en-wikipedia-org-1345	10	9	fair	fair	JJ
en-wikipedia-org-1345	10	10	coin	coin	NN
en-wikipedia-org-1345	10	11	flip	flip	NN
en-wikipedia-org-1345	10	12	(	(	-LRB-
en-wikipedia-org-1345	10	13	with	with	IN
en-wikipedia-org-1345	10	14	two	two	CD
en-wikipedia-org-1345	10	15	equally	equally	RB
en-wikipedia-org-1345	10	16	likely	likely	JJ
en-wikipedia-org-1345	10	17	outcomes	outcome	NNS
en-wikipedia-org-1345	10	18	)	)	-RRB-
en-wikipedia-org-1345	10	19	provides	provide	VBZ
en-wikipedia-org-1345	10	20	less	less	JJR
en-wikipedia-org-1345	10	21	information	information	NN
en-wikipedia-org-1345	10	22	(	(	-LRB-
en-wikipedia-org-1345	10	23	lower	lower	RBR
en-wikipedia-org-1345	10	24	entropy	entropy	JJ
en-wikipedia-org-1345	10	25	)	)	-RRB-
en-wikipedia-org-1345	10	26	than	than	IN
en-wikipedia-org-1345	10	27	specifying	specify	VBG
en-wikipedia-org-1345	10	28	the	the	DT
en-wikipedia-org-1345	10	29	outcome	outcome	NN
en-wikipedia-org-1345	10	30	from	from	IN
en-wikipedia-org-1345	10	31	a	a	DT
en-wikipedia-org-1345	10	32	roll	roll	NN
en-wikipedia-org-1345	10	33	of	of	IN
en-wikipedia-org-1345	10	34	a	a	DT
en-wikipedia-org-1345	10	35	die	die	NN
en-wikipedia-org-1345	10	36	(	(	-LRB-
en-wikipedia-org-1345	10	37	with	with	IN
en-wikipedia-org-1345	10	38	six	six	CD
en-wikipedia-org-1345	10	39	equally	equally	RB
en-wikipedia-org-1345	10	40	likely	likely	JJ
en-wikipedia-org-1345	10	41	outcomes	outcome	NNS
en-wikipedia-org-1345	10	42	)	)	-RRB-
en-wikipedia-org-1345	10	43	.	.	.
en-wikipedia-org-1345	11	1	Some	some	DT
en-wikipedia-org-1345	11	2	other	other	JJ
en-wikipedia-org-1345	11	3	important	important	JJ
en-wikipedia-org-1345	11	4	measures	measure	NNS
en-wikipedia-org-1345	11	5	in	in	IN
en-wikipedia-org-1345	11	6	information	information	NN
en-wikipedia-org-1345	11	7	theory	theory	NN
en-wikipedia-org-1345	11	8	are	be	VBP
en-wikipedia-org-1345	11	9	mutual	mutual	JJ
en-wikipedia-org-1345	11	10	information	information	NN
en-wikipedia-org-1345	11	11	,	,	,
en-wikipedia-org-1345	11	12	channel	channel	NN
en-wikipedia-org-1345	11	13	capacity	capacity	NN
en-wikipedia-org-1345	11	14	,	,	,
en-wikipedia-org-1345	11	15	error	error	NN
en-wikipedia-org-1345	11	16	exponents	exponent	NNS
en-wikipedia-org-1345	11	17	,	,	,
en-wikipedia-org-1345	11	18	and	and	CC
en-wikipedia-org-1345	11	19	relative	relative	JJ
en-wikipedia-org-1345	11	20	entropy	entropy	RB
en-wikipedia-org-1345	11	21	.	.	.
en-wikipedia-org-1345	12	1	Important	important	JJ
en-wikipedia-org-1345	12	2	sub	sub	NN
en-wikipedia-org-1345	12	3	-	-	HYPH
en-wikipedia-org-1345	12	4	fields	field	NNS
en-wikipedia-org-1345	12	5	of	of	IN
en-wikipedia-org-1345	12	6	information	information	NN
en-wikipedia-org-1345	12	7	theory	theory	NN
en-wikipedia-org-1345	12	8	include	include	VBP
en-wikipedia-org-1345	12	9	source	source	NN
en-wikipedia-org-1345	12	10	coding	code	VBG
en-wikipedia-org-1345	12	11	,	,	,
en-wikipedia-org-1345	12	12	algorithmic	algorithmic	JJ
en-wikipedia-org-1345	12	13	complexity	complexity	NN
en-wikipedia-org-1345	12	14	theory	theory	NN
en-wikipedia-org-1345	12	15	,	,	,
en-wikipedia-org-1345	12	16	algorithmic	algorithmic	JJ
en-wikipedia-org-1345	12	17	information	information	NN
en-wikipedia-org-1345	12	18	theory	theory	NN
en-wikipedia-org-1345	12	19	,	,	,
en-wikipedia-org-1345	12	20	and	and	CC
en-wikipedia-org-1345	12	21	information	information	NN
en-wikipedia-org-1345	12	22	-	-	HYPH
en-wikipedia-org-1345	12	23	theoretic	theoretic	JJ
en-wikipedia-org-1345	12	24	security	security	NN
en-wikipedia-org-1345	12	25	.	.	.
en-wikipedia-org-1345	13	1	Applications	application	NNS
en-wikipedia-org-1345	13	2	of	of	IN
en-wikipedia-org-1345	13	3	fundamental	fundamental	JJ
en-wikipedia-org-1345	13	4	topics	topic	NNS
en-wikipedia-org-1345	13	5	of	of	IN
en-wikipedia-org-1345	13	6	information	information	NN
en-wikipedia-org-1345	13	7	theory	theory	NN
en-wikipedia-org-1345	13	8	include	include	VBP
en-wikipedia-org-1345	13	9	lossless	lossless	JJ
en-wikipedia-org-1345	13	10	data	datum	NNS
en-wikipedia-org-1345	13	11	compression	compression	NN
en-wikipedia-org-1345	13	12	(	(	-LRB-
en-wikipedia-org-1345	13	13	e.g.	e.g.	RB
en-wikipedia-org-1345	14	1	ZIP	zip	NN
en-wikipedia-org-1345	14	2	files	file	NNS
en-wikipedia-org-1345	14	3	)	)	-RRB-
en-wikipedia-org-1345	14	4	,	,	,
en-wikipedia-org-1345	14	5	lossy	lossy	JJ
en-wikipedia-org-1345	14	6	data	data	NN
en-wikipedia-org-1345	14	7	compression	compression	NN
en-wikipedia-org-1345	14	8	(	(	-LRB-
en-wikipedia-org-1345	14	9	e.g.	e.g.	RB
en-wikipedia-org-1345	15	1	MP3s	MP3s	NNP
en-wikipedia-org-1345	15	2	and	and	CC
en-wikipedia-org-1345	15	3	JPEGs	JPEGs	NNP
en-wikipedia-org-1345	15	4	)	)	-RRB-
en-wikipedia-org-1345	15	5	,	,	,
en-wikipedia-org-1345	15	6	and	and	CC
en-wikipedia-org-1345	15	7	channel	channel	NNP
en-wikipedia-org-1345	15	8	coding	coding	NN
en-wikipedia-org-1345	15	9	(	(	-LRB-
en-wikipedia-org-1345	15	10	e.g.	e.g.	RB
en-wikipedia-org-1345	16	1	for	for	IN
en-wikipedia-org-1345	16	2	DSL	DSL	NNP
en-wikipedia-org-1345	16	3	)	)	-RRB-
en-wikipedia-org-1345	16	4	.	.	.
en-wikipedia-org-1345	17	1	Its	-PRON-	PRP$
en-wikipedia-org-1345	17	2	impact	impact	NN
en-wikipedia-org-1345	17	3	has	have	VBZ
en-wikipedia-org-1345	17	4	been	be	VBN
en-wikipedia-org-1345	17	5	crucial	crucial	JJ
en-wikipedia-org-1345	17	6	to	to	IN
en-wikipedia-org-1345	17	7	the	the	DT
en-wikipedia-org-1345	17	8	success	success	NN
en-wikipedia-org-1345	17	9	of	of	IN
en-wikipedia-org-1345	17	10	the	the	DT
en-wikipedia-org-1345	17	11	Voyager	Voyager	NNP
en-wikipedia-org-1345	17	12	missions	mission	NNS
en-wikipedia-org-1345	17	13	to	to	IN
en-wikipedia-org-1345	17	14	deep	deep	JJ
en-wikipedia-org-1345	17	15	space	space	NN
en-wikipedia-org-1345	17	16	,	,	,
en-wikipedia-org-1345	17	17	the	the	DT
en-wikipedia-org-1345	17	18	invention	invention	NN
en-wikipedia-org-1345	17	19	of	of	IN
en-wikipedia-org-1345	17	20	the	the	DT
en-wikipedia-org-1345	17	21	compact	compact	JJ
en-wikipedia-org-1345	17	22	disc	disc	NN
en-wikipedia-org-1345	17	23	,	,	,
en-wikipedia-org-1345	17	24	the	the	DT
en-wikipedia-org-1345	17	25	feasibility	feasibility	NN
en-wikipedia-org-1345	17	26	of	of	IN
en-wikipedia-org-1345	17	27	mobile	mobile	JJ
en-wikipedia-org-1345	17	28	phones	phone	NNS
en-wikipedia-org-1345	17	29	and	and	CC
en-wikipedia-org-1345	17	30	the	the	DT
en-wikipedia-org-1345	17	31	development	development	NN
en-wikipedia-org-1345	17	32	of	of	IN
en-wikipedia-org-1345	17	33	the	the	DT
en-wikipedia-org-1345	17	34	Internet	internet	NN
en-wikipedia-org-1345	17	35	.	.	.
en-wikipedia-org-1345	18	1	The	the	DT
en-wikipedia-org-1345	18	2	theory	theory	NN
en-wikipedia-org-1345	18	3	has	have	VBZ
en-wikipedia-org-1345	18	4	also	also	RB
en-wikipedia-org-1345	18	5	found	find	VBN
en-wikipedia-org-1345	18	6	applications	application	NNS
en-wikipedia-org-1345	18	7	in	in	IN
en-wikipedia-org-1345	18	8	other	other	JJ
en-wikipedia-org-1345	18	9	areas	area	NNS
en-wikipedia-org-1345	18	10	,	,	,
en-wikipedia-org-1345	18	11	including	include	VBG
en-wikipedia-org-1345	18	12	statistical	statistical	JJ
en-wikipedia-org-1345	18	13	inference,[1	inference,[1	JJ
en-wikipedia-org-1345	18	14	]	]	-RRB-
en-wikipedia-org-1345	18	15	cryptography	cryptography	NN
en-wikipedia-org-1345	18	16	,	,	,
en-wikipedia-org-1345	18	17	neurobiology,[2	neurobiology,[2	FW
en-wikipedia-org-1345	18	18	]	]	-RRB-
en-wikipedia-org-1345	18	19	perception,[3	perception,[3	NN
en-wikipedia-org-1345	18	20	]	]	-RRB-
en-wikipedia-org-1345	18	21	linguistics	linguistic	NNS
en-wikipedia-org-1345	18	22	,	,	,
en-wikipedia-org-1345	18	23	the	the	DT
en-wikipedia-org-1345	18	24	evolution[4	evolution[4	NNP
en-wikipedia-org-1345	18	25	]	]	-RRB-
en-wikipedia-org-1345	18	26	and	and	CC
en-wikipedia-org-1345	18	27	function[5	function[5	NN
en-wikipedia-org-1345	18	28	]	]	-RRB-
en-wikipedia-org-1345	18	29	of	of	IN
en-wikipedia-org-1345	18	30	molecular	molecular	JJ
en-wikipedia-org-1345	18	31	codes	code	NNS
en-wikipedia-org-1345	18	32	(	(	-LRB-
en-wikipedia-org-1345	18	33	bioinformatics	bioinformatics	NNP
en-wikipedia-org-1345	18	34	)	)	-RRB-
en-wikipedia-org-1345	18	35	,	,	,
en-wikipedia-org-1345	18	36	thermal	thermal	JJ
en-wikipedia-org-1345	18	37	physics,[6	physics,[6	NN
en-wikipedia-org-1345	18	38	]	]	-RRB-
en-wikipedia-org-1345	18	39	quantum	quantum	NN
en-wikipedia-org-1345	18	40	computing	computing	NN
en-wikipedia-org-1345	18	41	,	,	,
en-wikipedia-org-1345	18	42	black	black	JJ
en-wikipedia-org-1345	18	43	holes	hole	NNS
en-wikipedia-org-1345	18	44	,	,	,
en-wikipedia-org-1345	18	45	information	information	NN
en-wikipedia-org-1345	18	46	retrieval	retrieval	NN
en-wikipedia-org-1345	18	47	,	,	,
en-wikipedia-org-1345	18	48	intelligence	intelligence	NN
en-wikipedia-org-1345	18	49	gathering	gathering	NN
en-wikipedia-org-1345	18	50	,	,	,
en-wikipedia-org-1345	18	51	plagiarism	plagiarism	NN
en-wikipedia-org-1345	18	52	detection,[7	detection,[7	NNP
en-wikipedia-org-1345	18	53	]	]	-RRB-
en-wikipedia-org-1345	18	54	pattern	pattern	NN
en-wikipedia-org-1345	18	55	recognition	recognition	NN
en-wikipedia-org-1345	18	56	,	,	,
en-wikipedia-org-1345	18	57	anomaly	anomaly	IN
en-wikipedia-org-1345	18	58	detection[8	detection[8	NNP
en-wikipedia-org-1345	18	59	]	]	-RRB-
en-wikipedia-org-1345	18	60	and	and	CC
en-wikipedia-org-1345	18	61	even	even	RB
en-wikipedia-org-1345	18	62	art	art	NN
en-wikipedia-org-1345	18	63	creation	creation	NN
en-wikipedia-org-1345	18	64	.	.	.
en-wikipedia-org-1345	19	1	Contents	content	NNS
en-wikipedia-org-1345	19	2	1	1	CD
en-wikipedia-org-1345	19	3	Overview	overview	NN
en-wikipedia-org-1345	19	4	2	2	CD
en-wikipedia-org-1345	19	5	Historical	historical	JJ
en-wikipedia-org-1345	19	6	background	background	NN
en-wikipedia-org-1345	19	7	3	3	CD
en-wikipedia-org-1345	19	8	Quantities	quantity	NNS
en-wikipedia-org-1345	19	9	of	of	IN
en-wikipedia-org-1345	19	10	information	information	NN
en-wikipedia-org-1345	19	11	3.1	3.1	CD
en-wikipedia-org-1345	19	12	Entropy	Entropy	NNP
en-wikipedia-org-1345	19	13	of	of	IN
en-wikipedia-org-1345	19	14	an	an	DT
en-wikipedia-org-1345	19	15	information	information	NN
en-wikipedia-org-1345	19	16	source	source	NN
en-wikipedia-org-1345	19	17	3.2	3.2	CD
en-wikipedia-org-1345	19	18	Joint	Joint	NNP
en-wikipedia-org-1345	19	19	entropy	entropy	JJ
en-wikipedia-org-1345	19	20	3.3	3.3	CD
en-wikipedia-org-1345	19	21	Conditional	Conditional	NNP
en-wikipedia-org-1345	19	22	entropy	entropy	JJ
en-wikipedia-org-1345	19	23	(	(	-LRB-
en-wikipedia-org-1345	19	24	equivocation	equivocation	NN
en-wikipedia-org-1345	19	25	)	)	-RRB-
en-wikipedia-org-1345	19	26	3.4	3.4	CD
en-wikipedia-org-1345	19	27	Mutual	mutual	JJ
en-wikipedia-org-1345	19	28	information	information	NN
en-wikipedia-org-1345	19	29	(	(	-LRB-
en-wikipedia-org-1345	19	30	transinformation	transinformation	NN
en-wikipedia-org-1345	19	31	)	)	-RRB-
en-wikipedia-org-1345	19	32	3.5	3.5	CD
en-wikipedia-org-1345	19	33	Kullback	Kullback	NNP
en-wikipedia-org-1345	19	34	–	–	:
en-wikipedia-org-1345	19	35	Leibler	Leibler	NNP
en-wikipedia-org-1345	19	36	divergence	divergence	NN
en-wikipedia-org-1345	19	37	(	(	-LRB-
en-wikipedia-org-1345	19	38	information	information	NN
en-wikipedia-org-1345	19	39	gain	gain	NN
en-wikipedia-org-1345	19	40	)	)	-RRB-
en-wikipedia-org-1345	19	41	3.6	3.6	CD
en-wikipedia-org-1345	19	42	Other	other	JJ
en-wikipedia-org-1345	19	43	quantities	quantity	NNS
en-wikipedia-org-1345	19	44	4	4	CD
en-wikipedia-org-1345	19	45	Coding	code	VBG
en-wikipedia-org-1345	19	46	theory	theory	NN
en-wikipedia-org-1345	19	47	4.1	4.1	CD
en-wikipedia-org-1345	19	48	Source	source	NN
en-wikipedia-org-1345	19	49	theory	theory	NN
en-wikipedia-org-1345	19	50	4.1.1	4.1.1	CD
en-wikipedia-org-1345	19	51	Rate	rate	NN
en-wikipedia-org-1345	19	52	4.2	4.2	CD
en-wikipedia-org-1345	19	53	Channel	Channel	NNP
en-wikipedia-org-1345	19	54	capacity	capacity	NN
en-wikipedia-org-1345	19	55	4.2.1	4.2.1	CD
en-wikipedia-org-1345	19	56	Capacity	capacity	NN
en-wikipedia-org-1345	19	57	of	of	IN
en-wikipedia-org-1345	19	58	particular	particular	JJ
en-wikipedia-org-1345	19	59	channel	channel	NN
en-wikipedia-org-1345	19	60	models	model	NNS
en-wikipedia-org-1345	19	61	5	5	CD
en-wikipedia-org-1345	19	62	Applications	Applications	NNPS
en-wikipedia-org-1345	19	63	to	to	IN
en-wikipedia-org-1345	19	64	other	other	JJ
en-wikipedia-org-1345	19	65	fields	field	NNS
en-wikipedia-org-1345	19	66	5.1	5.1	CD
en-wikipedia-org-1345	19	67	Intelligence	Intelligence	NNP
en-wikipedia-org-1345	19	68	uses	use	NNS
en-wikipedia-org-1345	19	69	and	and	CC
en-wikipedia-org-1345	19	70	secrecy	secrecy	VB
en-wikipedia-org-1345	19	71	applications	application	NNS
en-wikipedia-org-1345	19	72	5.2	5.2	CD
en-wikipedia-org-1345	19	73	Pseudorandom	Pseudorandom	NNP
en-wikipedia-org-1345	19	74	number	number	NN
en-wikipedia-org-1345	19	75	generation	generation	NN
en-wikipedia-org-1345	19	76	5.3	5.3	CD
en-wikipedia-org-1345	19	77	Seismic	seismic	JJ
en-wikipedia-org-1345	19	78	exploration	exploration	NN
en-wikipedia-org-1345	19	79	5.4	5.4	CD
en-wikipedia-org-1345	19	80	Semiotics	Semiotics	NNPS
en-wikipedia-org-1345	19	81	5.5	5.5	CD
en-wikipedia-org-1345	19	82	Miscellaneous	miscellaneous	JJ
en-wikipedia-org-1345	19	83	applications	application	NNS
en-wikipedia-org-1345	19	84	6	6	CD
en-wikipedia-org-1345	19	85	See	see	VBP
en-wikipedia-org-1345	19	86	also	also	RB
en-wikipedia-org-1345	19	87	6.1	6.1	CD
en-wikipedia-org-1345	19	88	Applications	application	NNS
en-wikipedia-org-1345	19	89	6.2	6.2	CD
en-wikipedia-org-1345	19	90	History	history	NN
en-wikipedia-org-1345	19	91	6.3	6.3	CD
en-wikipedia-org-1345	19	92	Theory	theory	NN
en-wikipedia-org-1345	19	93	6.4	6.4	CD
en-wikipedia-org-1345	19	94	Concepts	concept	NNS
en-wikipedia-org-1345	19	95	7	7	CD
en-wikipedia-org-1345	19	96	References	reference	NNS
en-wikipedia-org-1345	19	97	7.1	7.1	CD
en-wikipedia-org-1345	19	98	The	the	DT
en-wikipedia-org-1345	19	99	classic	classic	JJ
en-wikipedia-org-1345	19	100	work	work	NN
en-wikipedia-org-1345	19	101	7.2	7.2	CD
en-wikipedia-org-1345	19	102	Other	other	JJ
en-wikipedia-org-1345	19	103	journal	journal	NN
en-wikipedia-org-1345	19	104	articles	article	NNS
en-wikipedia-org-1345	19	105	7.3	7.3	CD
en-wikipedia-org-1345	19	106	Textbooks	textbook	NNS
en-wikipedia-org-1345	19	107	on	on	IN
en-wikipedia-org-1345	19	108	information	information	NN
en-wikipedia-org-1345	19	109	theory	theory	NN
en-wikipedia-org-1345	19	110	7.4	7.4	CD
en-wikipedia-org-1345	19	111	Other	other	JJ
en-wikipedia-org-1345	19	112	books	book	NNS
en-wikipedia-org-1345	19	113	7.5	7.5	CD
en-wikipedia-org-1345	19	114	MOOC	MOOC	NNS
en-wikipedia-org-1345	19	115	on	on	IN
en-wikipedia-org-1345	19	116	information	information	NN
en-wikipedia-org-1345	19	117	theory	theory	NN
en-wikipedia-org-1345	19	118	8	8	CD
en-wikipedia-org-1345	19	119	External	external	JJ
en-wikipedia-org-1345	19	120	links	link	NNS
en-wikipedia-org-1345	19	121	Overview[edit	overview[edit	NN
en-wikipedia-org-1345	19	122	]	]	-RRB-
en-wikipedia-org-1345	19	123	Information	information	NN
en-wikipedia-org-1345	19	124	theory	theory	NN
en-wikipedia-org-1345	19	125	studies	study	VBZ
en-wikipedia-org-1345	19	126	the	the	DT
en-wikipedia-org-1345	19	127	transmission	transmission	NN
en-wikipedia-org-1345	19	128	,	,	,
en-wikipedia-org-1345	19	129	processing	processing	NN
en-wikipedia-org-1345	19	130	,	,	,
en-wikipedia-org-1345	19	131	extraction	extraction	NN
en-wikipedia-org-1345	19	132	,	,	,
en-wikipedia-org-1345	19	133	and	and	CC
en-wikipedia-org-1345	19	134	utilization	utilization	NN
en-wikipedia-org-1345	19	135	of	of	IN
en-wikipedia-org-1345	19	136	information	information	NN
en-wikipedia-org-1345	19	137	.	.	.
en-wikipedia-org-1345	20	1	Abstractly	abstractly	RB
en-wikipedia-org-1345	20	2	,	,	,
en-wikipedia-org-1345	20	3	information	information	NN
en-wikipedia-org-1345	20	4	can	can	MD
en-wikipedia-org-1345	20	5	be	be	VB
en-wikipedia-org-1345	20	6	thought	think	VBN
en-wikipedia-org-1345	20	7	of	of	IN
en-wikipedia-org-1345	20	8	as	as	IN
en-wikipedia-org-1345	20	9	the	the	DT
en-wikipedia-org-1345	20	10	resolution	resolution	NN
en-wikipedia-org-1345	20	11	of	of	IN
en-wikipedia-org-1345	20	12	uncertainty	uncertainty	NN
en-wikipedia-org-1345	20	13	.	.	.
en-wikipedia-org-1345	21	1	In	in	IN
en-wikipedia-org-1345	21	2	the	the	DT
en-wikipedia-org-1345	21	3	case	case	NN
en-wikipedia-org-1345	21	4	of	of	IN
en-wikipedia-org-1345	21	5	communication	communication	NN
en-wikipedia-org-1345	21	6	of	of	IN
en-wikipedia-org-1345	21	7	information	information	NN
en-wikipedia-org-1345	21	8	over	over	IN
en-wikipedia-org-1345	21	9	a	a	DT
en-wikipedia-org-1345	21	10	noisy	noisy	JJ
en-wikipedia-org-1345	21	11	channel	channel	NN
en-wikipedia-org-1345	21	12	,	,	,
en-wikipedia-org-1345	21	13	this	this	DT
en-wikipedia-org-1345	21	14	abstract	abstract	JJ
en-wikipedia-org-1345	21	15	concept	concept	NN
en-wikipedia-org-1345	21	16	was	be	VBD
en-wikipedia-org-1345	21	17	made	make	VBN
en-wikipedia-org-1345	21	18	concrete	concrete	JJ
en-wikipedia-org-1345	21	19	in	in	IN
en-wikipedia-org-1345	21	20	1948	1948	CD
en-wikipedia-org-1345	21	21	by	by	IN
en-wikipedia-org-1345	21	22	Claude	Claude	NNP
en-wikipedia-org-1345	21	23	Shannon	Shannon	NNP
en-wikipedia-org-1345	21	24	in	in	IN
en-wikipedia-org-1345	21	25	his	-PRON-	PRP$
en-wikipedia-org-1345	21	26	paper	paper	NN
en-wikipedia-org-1345	21	27	"	"	``
en-wikipedia-org-1345	21	28	A	a	DT
en-wikipedia-org-1345	21	29	Mathematical	Mathematical	NNP
en-wikipedia-org-1345	21	30	Theory	Theory	NNP
en-wikipedia-org-1345	21	31	of	of	IN
en-wikipedia-org-1345	21	32	Communication	Communication	NNP
en-wikipedia-org-1345	21	33	"	"	''
en-wikipedia-org-1345	21	34	,	,	,
en-wikipedia-org-1345	21	35	in	in	IN
en-wikipedia-org-1345	21	36	which	which	WDT
en-wikipedia-org-1345	21	37	"	"	``
en-wikipedia-org-1345	21	38	information	information	NN
en-wikipedia-org-1345	21	39	"	"	''
en-wikipedia-org-1345	21	40	is	be	VBZ
en-wikipedia-org-1345	21	41	thought	think	VBN
en-wikipedia-org-1345	21	42	of	of	IN
en-wikipedia-org-1345	21	43	as	as	IN
en-wikipedia-org-1345	21	44	a	a	DT
en-wikipedia-org-1345	21	45	set	set	NN
en-wikipedia-org-1345	21	46	of	of	IN
en-wikipedia-org-1345	21	47	possible	possible	JJ
en-wikipedia-org-1345	21	48	messages	message	NNS
en-wikipedia-org-1345	21	49	,	,	,
en-wikipedia-org-1345	21	50	where	where	WRB
en-wikipedia-org-1345	21	51	the	the	DT
en-wikipedia-org-1345	21	52	goal	goal	NN
en-wikipedia-org-1345	21	53	is	be	VBZ
en-wikipedia-org-1345	21	54	to	to	TO
en-wikipedia-org-1345	21	55	send	send	VB
en-wikipedia-org-1345	21	56	these	these	DT
en-wikipedia-org-1345	21	57	messages	message	NNS
en-wikipedia-org-1345	21	58	over	over	IN
en-wikipedia-org-1345	21	59	a	a	DT
en-wikipedia-org-1345	21	60	noisy	noisy	JJ
en-wikipedia-org-1345	21	61	channel	channel	NN
en-wikipedia-org-1345	21	62	,	,	,
en-wikipedia-org-1345	21	63	and	and	CC
en-wikipedia-org-1345	21	64	then	then	RB
en-wikipedia-org-1345	21	65	to	to	TO
en-wikipedia-org-1345	21	66	have	have	VB
en-wikipedia-org-1345	21	67	the	the	DT
en-wikipedia-org-1345	21	68	receiver	receiver	NN
en-wikipedia-org-1345	21	69	reconstruct	reconstruct	VB
en-wikipedia-org-1345	21	70	the	the	DT
en-wikipedia-org-1345	21	71	message	message	NN
en-wikipedia-org-1345	21	72	with	with	IN
en-wikipedia-org-1345	21	73	low	low	JJ
en-wikipedia-org-1345	21	74	probability	probability	NN
en-wikipedia-org-1345	21	75	of	of	IN
en-wikipedia-org-1345	21	76	error	error	NN
en-wikipedia-org-1345	21	77	,	,	,
en-wikipedia-org-1345	21	78	in	in	IN
en-wikipedia-org-1345	21	79	spite	spite	NN
en-wikipedia-org-1345	21	80	of	of	IN
en-wikipedia-org-1345	21	81	the	the	DT
en-wikipedia-org-1345	21	82	channel	channel	NNP
en-wikipedia-org-1345	21	83	noise	noise	NN
en-wikipedia-org-1345	21	84	.	.	.
en-wikipedia-org-1345	22	1	Shannon	Shannon	NNP
en-wikipedia-org-1345	22	2	's	's	POS
en-wikipedia-org-1345	22	3	main	main	JJ
en-wikipedia-org-1345	22	4	result	result	NN
en-wikipedia-org-1345	22	5	,	,	,
en-wikipedia-org-1345	22	6	the	the	DT
en-wikipedia-org-1345	22	7	noisy	noisy	NNP
en-wikipedia-org-1345	22	8	-	-	HYPH
en-wikipedia-org-1345	22	9	channel	channel	NNP
en-wikipedia-org-1345	22	10	coding	coding	NN
en-wikipedia-org-1345	22	11	theorem	theorem	NN
en-wikipedia-org-1345	22	12	showed	show	VBD
en-wikipedia-org-1345	22	13	that	that	IN
en-wikipedia-org-1345	22	14	,	,	,
en-wikipedia-org-1345	22	15	in	in	IN
en-wikipedia-org-1345	22	16	the	the	DT
en-wikipedia-org-1345	22	17	limit	limit	NN
en-wikipedia-org-1345	22	18	of	of	IN
en-wikipedia-org-1345	22	19	many	many	JJ
en-wikipedia-org-1345	22	20	channel	channel	NN
en-wikipedia-org-1345	22	21	uses	use	VBZ
en-wikipedia-org-1345	22	22	,	,	,
en-wikipedia-org-1345	22	23	the	the	DT
en-wikipedia-org-1345	22	24	rate	rate	NN
en-wikipedia-org-1345	22	25	of	of	IN
en-wikipedia-org-1345	22	26	information	information	NN
en-wikipedia-org-1345	22	27	that	that	WDT
en-wikipedia-org-1345	22	28	is	be	VBZ
en-wikipedia-org-1345	22	29	asymptotically	asymptotically	RB
en-wikipedia-org-1345	22	30	achievable	achievable	JJ
en-wikipedia-org-1345	22	31	is	be	VBZ
en-wikipedia-org-1345	22	32	equal	equal	JJ
en-wikipedia-org-1345	22	33	to	to	IN
en-wikipedia-org-1345	22	34	the	the	DT
en-wikipedia-org-1345	22	35	channel	channel	NN
en-wikipedia-org-1345	22	36	capacity	capacity	NN
en-wikipedia-org-1345	22	37	,	,	,
en-wikipedia-org-1345	22	38	a	a	DT
en-wikipedia-org-1345	22	39	quantity	quantity	NN
en-wikipedia-org-1345	22	40	dependent	dependent	JJ
en-wikipedia-org-1345	22	41	merely	merely	RB
en-wikipedia-org-1345	22	42	on	on	IN
en-wikipedia-org-1345	22	43	the	the	DT
en-wikipedia-org-1345	22	44	statistics	statistic	NNS
en-wikipedia-org-1345	22	45	of	of	IN
en-wikipedia-org-1345	22	46	the	the	DT
en-wikipedia-org-1345	22	47	channel	channel	NN
en-wikipedia-org-1345	22	48	over	over	IN
en-wikipedia-org-1345	22	49	which	which	WDT
en-wikipedia-org-1345	22	50	the	the	DT
en-wikipedia-org-1345	22	51	messages	message	NNS
en-wikipedia-org-1345	22	52	are	be	VBP
en-wikipedia-org-1345	22	53	sent	send	VBN
en-wikipedia-org-1345	22	54	.	.	.
en-wikipedia-org-1345	23	1	[	[	-LRB-
en-wikipedia-org-1345	23	2	2	2	LS
en-wikipedia-org-1345	23	3	]	]	-RRB-
en-wikipedia-org-1345	23	4	Information	information	NN
en-wikipedia-org-1345	23	5	theory	theory	NN
en-wikipedia-org-1345	23	6	is	be	VBZ
en-wikipedia-org-1345	23	7	closely	closely	RB
en-wikipedia-org-1345	23	8	associated	associate	VBN
en-wikipedia-org-1345	23	9	with	with	IN
en-wikipedia-org-1345	23	10	a	a	DT
en-wikipedia-org-1345	23	11	collection	collection	NN
en-wikipedia-org-1345	23	12	of	of	IN
en-wikipedia-org-1345	23	13	pure	pure	JJ
en-wikipedia-org-1345	23	14	and	and	CC
en-wikipedia-org-1345	23	15	applied	applied	JJ
en-wikipedia-org-1345	23	16	disciplines	discipline	NNS
en-wikipedia-org-1345	23	17	that	that	WDT
en-wikipedia-org-1345	23	18	have	have	VBP
en-wikipedia-org-1345	23	19	been	be	VBN
en-wikipedia-org-1345	23	20	investigated	investigate	VBN
en-wikipedia-org-1345	23	21	and	and	CC
en-wikipedia-org-1345	23	22	reduced	reduce	VBN
en-wikipedia-org-1345	23	23	to	to	IN
en-wikipedia-org-1345	23	24	engineering	engineering	NN
en-wikipedia-org-1345	23	25	practice	practice	NN
en-wikipedia-org-1345	23	26	under	under	IN
en-wikipedia-org-1345	23	27	a	a	DT
en-wikipedia-org-1345	23	28	variety	variety	NN
en-wikipedia-org-1345	23	29	of	of	IN
en-wikipedia-org-1345	23	30	rubrics	rubric	NNS
en-wikipedia-org-1345	23	31	throughout	throughout	IN
en-wikipedia-org-1345	23	32	the	the	DT
en-wikipedia-org-1345	23	33	world	world	NN
en-wikipedia-org-1345	23	34	over	over	IN
en-wikipedia-org-1345	23	35	the	the	DT
en-wikipedia-org-1345	23	36	past	past	JJ
en-wikipedia-org-1345	23	37	half	half	JJ
en-wikipedia-org-1345	23	38	-	-	HYPH
en-wikipedia-org-1345	23	39	century	century	NN
en-wikipedia-org-1345	23	40	or	or	CC
en-wikipedia-org-1345	23	41	more	more	JJR
en-wikipedia-org-1345	23	42	:	:	:
en-wikipedia-org-1345	23	43	adaptive	adaptive	JJ
en-wikipedia-org-1345	23	44	systems	system	NNS
en-wikipedia-org-1345	23	45	,	,	,
en-wikipedia-org-1345	23	46	anticipatory	anticipatory	JJ
en-wikipedia-org-1345	23	47	systems	system	NNS
en-wikipedia-org-1345	23	48	,	,	,
en-wikipedia-org-1345	23	49	artificial	artificial	JJ
en-wikipedia-org-1345	23	50	intelligence	intelligence	NN
en-wikipedia-org-1345	23	51	,	,	,
en-wikipedia-org-1345	23	52	complex	complex	JJ
en-wikipedia-org-1345	23	53	systems	system	NNS
en-wikipedia-org-1345	23	54	,	,	,
en-wikipedia-org-1345	23	55	complexity	complexity	NN
en-wikipedia-org-1345	23	56	science	science	NN
en-wikipedia-org-1345	23	57	,	,	,
en-wikipedia-org-1345	23	58	cybernetics	cybernetic	NNS
en-wikipedia-org-1345	23	59	,	,	,
en-wikipedia-org-1345	23	60	informatics	informatic	NNS
en-wikipedia-org-1345	23	61	,	,	,
en-wikipedia-org-1345	23	62	machine	machine	NN
en-wikipedia-org-1345	23	63	learning	learning	NN
en-wikipedia-org-1345	23	64	,	,	,
en-wikipedia-org-1345	23	65	along	along	IN
en-wikipedia-org-1345	23	66	with	with	IN
en-wikipedia-org-1345	23	67	systems	system	NNS
en-wikipedia-org-1345	23	68	sciences	science	NNS
en-wikipedia-org-1345	23	69	of	of	IN
en-wikipedia-org-1345	23	70	many	many	JJ
en-wikipedia-org-1345	23	71	descriptions	description	NNS
en-wikipedia-org-1345	23	72	.	.	.
en-wikipedia-org-1345	24	1	Information	information	NN
en-wikipedia-org-1345	24	2	theory	theory	NN
en-wikipedia-org-1345	24	3	is	be	VBZ
en-wikipedia-org-1345	24	4	a	a	DT
en-wikipedia-org-1345	24	5	broad	broad	JJ
en-wikipedia-org-1345	24	6	and	and	CC
en-wikipedia-org-1345	24	7	deep	deep	JJ
en-wikipedia-org-1345	24	8	mathematical	mathematical	JJ
en-wikipedia-org-1345	24	9	theory	theory	NN
en-wikipedia-org-1345	24	10	,	,	,
en-wikipedia-org-1345	24	11	with	with	IN
en-wikipedia-org-1345	24	12	equally	equally	RB
en-wikipedia-org-1345	24	13	broad	broad	JJ
en-wikipedia-org-1345	24	14	and	and	CC
en-wikipedia-org-1345	24	15	deep	deep	JJ
en-wikipedia-org-1345	24	16	applications	application	NNS
en-wikipedia-org-1345	24	17	,	,	,
en-wikipedia-org-1345	24	18	amongst	amongst	IN
en-wikipedia-org-1345	24	19	which	which	WDT
en-wikipedia-org-1345	24	20	is	be	VBZ
en-wikipedia-org-1345	24	21	the	the	DT
en-wikipedia-org-1345	24	22	vital	vital	JJ
en-wikipedia-org-1345	24	23	field	field	NN
en-wikipedia-org-1345	24	24	of	of	IN
en-wikipedia-org-1345	24	25	coding	code	VBG
en-wikipedia-org-1345	24	26	theory	theory	NN
en-wikipedia-org-1345	24	27	.	.	.
en-wikipedia-org-1345	25	1	Coding	code	VBG
en-wikipedia-org-1345	25	2	theory	theory	NN
en-wikipedia-org-1345	25	3	is	be	VBZ
en-wikipedia-org-1345	25	4	concerned	concern	VBN
en-wikipedia-org-1345	25	5	with	with	IN
en-wikipedia-org-1345	25	6	finding	find	VBG
en-wikipedia-org-1345	25	7	explicit	explicit	JJ
en-wikipedia-org-1345	25	8	methods	method	NNS
en-wikipedia-org-1345	25	9	,	,	,
en-wikipedia-org-1345	25	10	called	call	VBN
en-wikipedia-org-1345	25	11	codes	code	NNS
en-wikipedia-org-1345	25	12	,	,	,
en-wikipedia-org-1345	25	13	for	for	IN
en-wikipedia-org-1345	25	14	increasing	increase	VBG
en-wikipedia-org-1345	25	15	the	the	DT
en-wikipedia-org-1345	25	16	efficiency	efficiency	NN
en-wikipedia-org-1345	25	17	and	and	CC
en-wikipedia-org-1345	25	18	reducing	reduce	VBG
en-wikipedia-org-1345	25	19	the	the	DT
en-wikipedia-org-1345	25	20	error	error	NN
en-wikipedia-org-1345	25	21	rate	rate	NN
en-wikipedia-org-1345	25	22	of	of	IN
en-wikipedia-org-1345	25	23	data	datum	NNS
en-wikipedia-org-1345	25	24	communication	communication	NN
en-wikipedia-org-1345	25	25	over	over	IN
en-wikipedia-org-1345	25	26	noisy	noisy	JJ
en-wikipedia-org-1345	25	27	channels	channel	NNS
en-wikipedia-org-1345	25	28	to	to	TO
en-wikipedia-org-1345	25	29	near	near	IN
en-wikipedia-org-1345	25	30	the	the	DT
en-wikipedia-org-1345	25	31	channel	channel	NN
en-wikipedia-org-1345	25	32	capacity	capacity	NN
en-wikipedia-org-1345	25	33	.	.	.
en-wikipedia-org-1345	26	1	These	these	DT
en-wikipedia-org-1345	26	2	codes	code	NNS
en-wikipedia-org-1345	26	3	can	can	MD
en-wikipedia-org-1345	26	4	be	be	VB
en-wikipedia-org-1345	26	5	roughly	roughly	RB
en-wikipedia-org-1345	26	6	subdivided	subdivide	VBN
en-wikipedia-org-1345	26	7	into	into	IN
en-wikipedia-org-1345	26	8	data	datum	NNS
en-wikipedia-org-1345	26	9	compression	compression	NN
en-wikipedia-org-1345	26	10	(	(	-LRB-
en-wikipedia-org-1345	26	11	source	source	NN
en-wikipedia-org-1345	26	12	coding	code	VBG
en-wikipedia-org-1345	26	13	)	)	-RRB-
en-wikipedia-org-1345	26	14	and	and	CC
en-wikipedia-org-1345	26	15	error	error	NN
en-wikipedia-org-1345	26	16	-	-	HYPH
en-wikipedia-org-1345	26	17	correction	correction	NN
en-wikipedia-org-1345	26	18	(	(	-LRB-
en-wikipedia-org-1345	26	19	channel	channel	NNP
en-wikipedia-org-1345	26	20	coding	code	VBG
en-wikipedia-org-1345	26	21	)	)	-RRB-
en-wikipedia-org-1345	26	22	techniques	technique	NNS
en-wikipedia-org-1345	26	23	.	.	.
en-wikipedia-org-1345	27	1	In	in	IN
en-wikipedia-org-1345	27	2	the	the	DT
en-wikipedia-org-1345	27	3	latter	latter	JJ
en-wikipedia-org-1345	27	4	case	case	NN
en-wikipedia-org-1345	27	5	,	,	,
en-wikipedia-org-1345	27	6	it	-PRON-	PRP
en-wikipedia-org-1345	27	7	took	take	VBD
en-wikipedia-org-1345	27	8	many	many	JJ
en-wikipedia-org-1345	27	9	years	year	NNS
en-wikipedia-org-1345	27	10	to	to	TO
en-wikipedia-org-1345	27	11	find	find	VB
en-wikipedia-org-1345	27	12	the	the	DT
en-wikipedia-org-1345	27	13	methods	method	NNS
en-wikipedia-org-1345	27	14	Shannon	Shannon	NNP
en-wikipedia-org-1345	27	15	's	's	POS
en-wikipedia-org-1345	27	16	work	work	NN
en-wikipedia-org-1345	27	17	proved	prove	VBD
en-wikipedia-org-1345	27	18	were	be	VBD
en-wikipedia-org-1345	27	19	possible	possible	JJ
en-wikipedia-org-1345	27	20	.	.	.
en-wikipedia-org-1345	28	1	A	a	DT
en-wikipedia-org-1345	28	2	third	third	JJ
en-wikipedia-org-1345	28	3	class	class	NN
en-wikipedia-org-1345	28	4	of	of	IN
en-wikipedia-org-1345	28	5	information	information	NN
en-wikipedia-org-1345	28	6	theory	theory	NN
en-wikipedia-org-1345	28	7	codes	code	NNS
en-wikipedia-org-1345	28	8	are	be	VBP
en-wikipedia-org-1345	28	9	cryptographic	cryptographic	JJ
en-wikipedia-org-1345	28	10	algorithms	algorithm	NNS
en-wikipedia-org-1345	28	11	(	(	-LRB-
en-wikipedia-org-1345	28	12	both	both	DT
en-wikipedia-org-1345	28	13	codes	code	NNS
en-wikipedia-org-1345	28	14	and	and	CC
en-wikipedia-org-1345	28	15	ciphers	cipher	NNS
en-wikipedia-org-1345	28	16	)	)	-RRB-
en-wikipedia-org-1345	28	17	.	.	.
en-wikipedia-org-1345	29	1	Concepts	concept	NNS
en-wikipedia-org-1345	29	2	,	,	,
en-wikipedia-org-1345	29	3	methods	method	NNS
en-wikipedia-org-1345	29	4	and	and	CC
en-wikipedia-org-1345	29	5	results	result	NNS
en-wikipedia-org-1345	29	6	from	from	IN
en-wikipedia-org-1345	29	7	coding	code	VBG
en-wikipedia-org-1345	29	8	theory	theory	NN
en-wikipedia-org-1345	29	9	and	and	CC
en-wikipedia-org-1345	29	10	information	information	NN
en-wikipedia-org-1345	29	11	theory	theory	NN
en-wikipedia-org-1345	29	12	are	be	VBP
en-wikipedia-org-1345	29	13	widely	widely	RB
en-wikipedia-org-1345	29	14	used	use	VBN
en-wikipedia-org-1345	29	15	in	in	IN
en-wikipedia-org-1345	29	16	cryptography	cryptography	NN
en-wikipedia-org-1345	29	17	and	and	CC
en-wikipedia-org-1345	29	18	cryptanalysis	cryptanalysis	NN
en-wikipedia-org-1345	29	19	.	.	.
en-wikipedia-org-1345	30	1	See	see	VB
en-wikipedia-org-1345	30	2	the	the	DT
en-wikipedia-org-1345	30	3	article	article	NN
en-wikipedia-org-1345	30	4	ban	ban	NN
en-wikipedia-org-1345	30	5	(	(	-LRB-
en-wikipedia-org-1345	30	6	unit	unit	NN
en-wikipedia-org-1345	30	7	)	)	-RRB-
en-wikipedia-org-1345	30	8	for	for	IN
en-wikipedia-org-1345	30	9	a	a	DT
en-wikipedia-org-1345	30	10	historical	historical	JJ
en-wikipedia-org-1345	30	11	application	application	NN
en-wikipedia-org-1345	30	12	.	.	.
en-wikipedia-org-1345	31	1	Historical	historical	JJ
en-wikipedia-org-1345	31	2	background[edit	background[edit	NFP
en-wikipedia-org-1345	31	3	]	]	-RRB-
en-wikipedia-org-1345	31	4	Main	main	JJ
en-wikipedia-org-1345	31	5	article	article	NN
en-wikipedia-org-1345	31	6	:	:	:
en-wikipedia-org-1345	31	7	History	history	NN
en-wikipedia-org-1345	31	8	of	of	IN
en-wikipedia-org-1345	31	9	information	information	NN
en-wikipedia-org-1345	31	10	theory	theory	NN
en-wikipedia-org-1345	31	11	The	the	DT
en-wikipedia-org-1345	31	12	landmark	landmark	NN
en-wikipedia-org-1345	31	13	event	event	NN
en-wikipedia-org-1345	31	14	that	that	WDT
en-wikipedia-org-1345	31	15	established	establish	VBD
en-wikipedia-org-1345	31	16	the	the	DT
en-wikipedia-org-1345	31	17	discipline	discipline	NN
en-wikipedia-org-1345	31	18	of	of	IN
en-wikipedia-org-1345	31	19	information	information	NN
en-wikipedia-org-1345	31	20	theory	theory	NN
en-wikipedia-org-1345	31	21	and	and	CC
en-wikipedia-org-1345	31	22	brought	bring	VBD
en-wikipedia-org-1345	31	23	it	-PRON-	PRP
en-wikipedia-org-1345	31	24	to	to	IN
en-wikipedia-org-1345	31	25	immediate	immediate	JJ
en-wikipedia-org-1345	31	26	worldwide	worldwide	JJ
en-wikipedia-org-1345	31	27	attention	attention	NN
en-wikipedia-org-1345	31	28	was	be	VBD
en-wikipedia-org-1345	31	29	the	the	DT
en-wikipedia-org-1345	31	30	publication	publication	NN
en-wikipedia-org-1345	31	31	of	of	IN
en-wikipedia-org-1345	31	32	Claude	Claude	NNP
en-wikipedia-org-1345	31	33	E.	E.	NNP
en-wikipedia-org-1345	31	34	Shannon	Shannon	NNP
en-wikipedia-org-1345	31	35	's	's	POS
en-wikipedia-org-1345	31	36	classic	classic	JJ
en-wikipedia-org-1345	31	37	paper	paper	NN
en-wikipedia-org-1345	31	38	"	"	``
en-wikipedia-org-1345	31	39	A	a	DT
en-wikipedia-org-1345	31	40	Mathematical	Mathematical	NNP
en-wikipedia-org-1345	31	41	Theory	Theory	NNP
en-wikipedia-org-1345	31	42	of	of	IN
en-wikipedia-org-1345	31	43	Communication	Communication	NNP
en-wikipedia-org-1345	31	44	"	"	''
en-wikipedia-org-1345	31	45	in	in	IN
en-wikipedia-org-1345	31	46	the	the	DT
en-wikipedia-org-1345	31	47	Bell	Bell	NNP
en-wikipedia-org-1345	31	48	System	System	NNP
en-wikipedia-org-1345	31	49	Technical	Technical	NNP
en-wikipedia-org-1345	31	50	Journal	Journal	NNP
en-wikipedia-org-1345	31	51	in	in	IN
en-wikipedia-org-1345	31	52	July	July	NNP
en-wikipedia-org-1345	31	53	and	and	CC
en-wikipedia-org-1345	31	54	October	October	NNP
en-wikipedia-org-1345	31	55	1948	1948	CD
en-wikipedia-org-1345	31	56	.	.	.
en-wikipedia-org-1345	32	1	Prior	prior	RB
en-wikipedia-org-1345	32	2	to	to	IN
en-wikipedia-org-1345	32	3	this	this	DT
en-wikipedia-org-1345	32	4	paper	paper	NN
en-wikipedia-org-1345	32	5	,	,	,
en-wikipedia-org-1345	32	6	limited	limited	JJ
en-wikipedia-org-1345	32	7	information	information	NN
en-wikipedia-org-1345	32	8	-	-	HYPH
en-wikipedia-org-1345	32	9	theoretic	theoretic	JJ
en-wikipedia-org-1345	32	10	ideas	idea	NNS
en-wikipedia-org-1345	32	11	had	have	VBD
en-wikipedia-org-1345	32	12	been	be	VBN
en-wikipedia-org-1345	32	13	developed	develop	VBN
en-wikipedia-org-1345	32	14	at	at	IN
en-wikipedia-org-1345	32	15	Bell	Bell	NNP
en-wikipedia-org-1345	32	16	Labs	Labs	NNPS
en-wikipedia-org-1345	32	17	,	,	,
en-wikipedia-org-1345	32	18	all	all	DT
en-wikipedia-org-1345	32	19	implicitly	implicitly	RB
en-wikipedia-org-1345	32	20	assuming	assume	VBG
en-wikipedia-org-1345	32	21	events	event	NNS
en-wikipedia-org-1345	32	22	of	of	IN
en-wikipedia-org-1345	32	23	equal	equal	JJ
en-wikipedia-org-1345	32	24	probability	probability	NN
en-wikipedia-org-1345	32	25	.	.	.
en-wikipedia-org-1345	33	1	Harry	Harry	NNP
en-wikipedia-org-1345	33	2	Nyquist	Nyquist	NNP
en-wikipedia-org-1345	33	3	's	's	POS
en-wikipedia-org-1345	33	4	1924	1924	CD
en-wikipedia-org-1345	33	5	paper	paper	NN
en-wikipedia-org-1345	33	6	,	,	,
en-wikipedia-org-1345	33	7	Certain	Certain	NNP
en-wikipedia-org-1345	33	8	Factors	Factors	NNPS
en-wikipedia-org-1345	33	9	Affecting	Affecting	NNP
en-wikipedia-org-1345	33	10	Telegraph	Telegraph	NNP
en-wikipedia-org-1345	33	11	Speed	Speed	NNP
en-wikipedia-org-1345	33	12	,	,	,
en-wikipedia-org-1345	33	13	contains	contain	VBZ
en-wikipedia-org-1345	33	14	a	a	DT
en-wikipedia-org-1345	33	15	theoretical	theoretical	JJ
en-wikipedia-org-1345	33	16	section	section	NN
en-wikipedia-org-1345	33	17	quantifying	quantify	VBG
en-wikipedia-org-1345	33	18	"	"	``
en-wikipedia-org-1345	33	19	intelligence	intelligence	NN
en-wikipedia-org-1345	33	20	"	"	''
en-wikipedia-org-1345	33	21	and	and	CC
en-wikipedia-org-1345	33	22	the	the	DT
en-wikipedia-org-1345	33	23	"	"	``
en-wikipedia-org-1345	33	24	line	line	NN
en-wikipedia-org-1345	33	25	speed	speed	NN
en-wikipedia-org-1345	33	26	"	"	''
en-wikipedia-org-1345	33	27	at	at	IN
en-wikipedia-org-1345	33	28	which	which	WDT
en-wikipedia-org-1345	33	29	it	-PRON-	PRP
en-wikipedia-org-1345	33	30	can	can	MD
en-wikipedia-org-1345	33	31	be	be	VB
en-wikipedia-org-1345	33	32	transmitted	transmit	VBN
en-wikipedia-org-1345	33	33	by	by	IN
en-wikipedia-org-1345	33	34	a	a	DT
en-wikipedia-org-1345	33	35	communication	communication	NN
en-wikipedia-org-1345	33	36	system	system	NN
en-wikipedia-org-1345	33	37	,	,	,
en-wikipedia-org-1345	33	38	giving	give	VBG
en-wikipedia-org-1345	33	39	the	the	DT
en-wikipedia-org-1345	33	40	relation	relation	NN
en-wikipedia-org-1345	33	41	W	w	NN
en-wikipedia-org-1345	33	42	=	=	SYM
en-wikipedia-org-1345	33	43	K	K	NNP
en-wikipedia-org-1345	33	44	log	log	NNP
en-wikipedia-org-1345	33	45	m	m	NNP
en-wikipedia-org-1345	33	46	(	(	-LRB-
en-wikipedia-org-1345	33	47	recalling	recall	VBG
en-wikipedia-org-1345	33	48	Boltzmann	Boltzmann	NNP
en-wikipedia-org-1345	33	49	's	's	POS
en-wikipedia-org-1345	33	50	constant	constant	NN
en-wikipedia-org-1345	33	51	)	)	-RRB-
en-wikipedia-org-1345	33	52	,	,	,
en-wikipedia-org-1345	33	53	where	where	WRB
en-wikipedia-org-1345	33	54	W	w	NN
en-wikipedia-org-1345	33	55	is	be	VBZ
en-wikipedia-org-1345	33	56	the	the	DT
en-wikipedia-org-1345	33	57	speed	speed	NN
en-wikipedia-org-1345	33	58	of	of	IN
en-wikipedia-org-1345	33	59	transmission	transmission	NN
en-wikipedia-org-1345	33	60	of	of	IN
en-wikipedia-org-1345	33	61	intelligence	intelligence	NN
en-wikipedia-org-1345	33	62	,	,	,
en-wikipedia-org-1345	33	63	m	m	NNP
en-wikipedia-org-1345	33	64	is	be	VBZ
en-wikipedia-org-1345	33	65	the	the	DT
en-wikipedia-org-1345	33	66	number	number	NN
en-wikipedia-org-1345	33	67	of	of	IN
en-wikipedia-org-1345	33	68	different	different	JJ
en-wikipedia-org-1345	33	69	voltage	voltage	NN
en-wikipedia-org-1345	33	70	levels	level	NNS
en-wikipedia-org-1345	33	71	to	to	TO
en-wikipedia-org-1345	33	72	choose	choose	VB
en-wikipedia-org-1345	33	73	from	from	IN
en-wikipedia-org-1345	33	74	at	at	IN
en-wikipedia-org-1345	33	75	each	each	DT
en-wikipedia-org-1345	33	76	time	time	NN
en-wikipedia-org-1345	33	77	step	step	NN
en-wikipedia-org-1345	33	78	,	,	,
en-wikipedia-org-1345	33	79	and	and	CC
en-wikipedia-org-1345	33	80	K	K	NNP
en-wikipedia-org-1345	33	81	is	be	VBZ
en-wikipedia-org-1345	33	82	a	a	DT
en-wikipedia-org-1345	33	83	constant	constant	NN
en-wikipedia-org-1345	33	84	.	.	.
en-wikipedia-org-1345	34	1	Ralph	Ralph	NNP
en-wikipedia-org-1345	34	2	Hartley	Hartley	NNP
en-wikipedia-org-1345	34	3	's	's	POS
en-wikipedia-org-1345	34	4	1928	1928	CD
en-wikipedia-org-1345	34	5	paper	paper	NN
en-wikipedia-org-1345	34	6	,	,	,
en-wikipedia-org-1345	34	7	Transmission	Transmission	NNP
en-wikipedia-org-1345	34	8	of	of	IN
en-wikipedia-org-1345	34	9	Information	Information	NNP
en-wikipedia-org-1345	34	10	,	,	,
en-wikipedia-org-1345	34	11	uses	use	VBZ
en-wikipedia-org-1345	34	12	the	the	DT
en-wikipedia-org-1345	34	13	word	word	NN
en-wikipedia-org-1345	34	14	information	information	NN
en-wikipedia-org-1345	34	15	as	as	IN
en-wikipedia-org-1345	34	16	a	a	DT
en-wikipedia-org-1345	34	17	measurable	measurable	JJ
en-wikipedia-org-1345	34	18	quantity	quantity	NN
en-wikipedia-org-1345	34	19	,	,	,
en-wikipedia-org-1345	34	20	reflecting	reflect	VBG
en-wikipedia-org-1345	34	21	the	the	DT
en-wikipedia-org-1345	34	22	receiver	receiver	NN
en-wikipedia-org-1345	34	23	's	's	POS
en-wikipedia-org-1345	34	24	ability	ability	NN
en-wikipedia-org-1345	34	25	to	to	TO
en-wikipedia-org-1345	34	26	distinguish	distinguish	VB
en-wikipedia-org-1345	34	27	one	one	CD
en-wikipedia-org-1345	34	28	sequence	sequence	NN
en-wikipedia-org-1345	34	29	of	of	IN
en-wikipedia-org-1345	34	30	symbols	symbol	NNS
en-wikipedia-org-1345	34	31	from	from	IN
en-wikipedia-org-1345	34	32	any	any	DT
en-wikipedia-org-1345	34	33	other	other	JJ
en-wikipedia-org-1345	34	34	,	,	,
en-wikipedia-org-1345	34	35	thus	thus	RB
en-wikipedia-org-1345	34	36	quantifying	quantify	VBG
en-wikipedia-org-1345	34	37	information	information	NN
en-wikipedia-org-1345	34	38	as	as	IN
en-wikipedia-org-1345	34	39	H	h	NN
en-wikipedia-org-1345	34	40	=	=	-RRB-
en-wikipedia-org-1345	34	41	log	log	NN
en-wikipedia-org-1345	34	42	Sn	Sn	NNP
en-wikipedia-org-1345	34	43	=	=	SYM
en-wikipedia-org-1345	34	44	n	n	NNP
en-wikipedia-org-1345	34	45	log	log	NN
en-wikipedia-org-1345	34	46	S	S	NNP
en-wikipedia-org-1345	34	47	,	,	,
en-wikipedia-org-1345	34	48	where	where	WRB
en-wikipedia-org-1345	34	49	S	S	NNP
en-wikipedia-org-1345	34	50	was	be	VBD
en-wikipedia-org-1345	34	51	the	the	DT
en-wikipedia-org-1345	34	52	number	number	NN
en-wikipedia-org-1345	34	53	of	of	IN
en-wikipedia-org-1345	34	54	possible	possible	JJ
en-wikipedia-org-1345	34	55	symbols	symbol	NNS
en-wikipedia-org-1345	34	56	,	,	,
en-wikipedia-org-1345	34	57	and	and	CC
en-wikipedia-org-1345	34	58	n	n	CC
en-wikipedia-org-1345	34	59	the	the	DT
en-wikipedia-org-1345	34	60	number	number	NN
en-wikipedia-org-1345	34	61	of	of	IN
en-wikipedia-org-1345	34	62	symbols	symbol	NNS
en-wikipedia-org-1345	34	63	in	in	IN
en-wikipedia-org-1345	34	64	a	a	DT
en-wikipedia-org-1345	34	65	transmission	transmission	NN
en-wikipedia-org-1345	34	66	.	.	.
en-wikipedia-org-1345	35	1	The	the	DT
en-wikipedia-org-1345	35	2	unit	unit	NN
en-wikipedia-org-1345	35	3	of	of	IN
en-wikipedia-org-1345	35	4	information	information	NN
en-wikipedia-org-1345	35	5	was	be	VBD
en-wikipedia-org-1345	35	6	therefore	therefore	RB
en-wikipedia-org-1345	35	7	the	the	DT
en-wikipedia-org-1345	35	8	decimal	decimal	JJ
en-wikipedia-org-1345	35	9	digit	digit	NN
en-wikipedia-org-1345	35	10	,	,	,
en-wikipedia-org-1345	35	11	which	which	WDT
en-wikipedia-org-1345	35	12	has	have	VBZ
en-wikipedia-org-1345	35	13	since	since	IN
en-wikipedia-org-1345	35	14	sometimes	sometimes	RB
en-wikipedia-org-1345	35	15	been	be	VBN
en-wikipedia-org-1345	35	16	called	call	VBN
en-wikipedia-org-1345	35	17	the	the	DT
en-wikipedia-org-1345	35	18	hartley	hartley	NN
en-wikipedia-org-1345	35	19	in	in	IN
en-wikipedia-org-1345	35	20	his	-PRON-	PRP$
en-wikipedia-org-1345	35	21	honor	honor	NN
en-wikipedia-org-1345	35	22	as	as	IN
en-wikipedia-org-1345	35	23	a	a	DT
en-wikipedia-org-1345	35	24	unit	unit	NN
en-wikipedia-org-1345	35	25	or	or	CC
en-wikipedia-org-1345	35	26	scale	scale	NN
en-wikipedia-org-1345	35	27	or	or	CC
en-wikipedia-org-1345	35	28	measure	measure	NN
en-wikipedia-org-1345	35	29	of	of	IN
en-wikipedia-org-1345	35	30	information	information	NN
en-wikipedia-org-1345	35	31	.	.	.
en-wikipedia-org-1345	36	1	Alan	Alan	NNP
en-wikipedia-org-1345	36	2	Turing	Turing	NNP
en-wikipedia-org-1345	36	3	in	in	IN
en-wikipedia-org-1345	36	4	1940	1940	CD
en-wikipedia-org-1345	36	5	used	use	VBD
en-wikipedia-org-1345	36	6	similar	similar	JJ
en-wikipedia-org-1345	36	7	ideas	idea	NNS
en-wikipedia-org-1345	36	8	as	as	IN
en-wikipedia-org-1345	36	9	part	part	NN
en-wikipedia-org-1345	36	10	of	of	IN
en-wikipedia-org-1345	36	11	the	the	DT
en-wikipedia-org-1345	36	12	statistical	statistical	JJ
en-wikipedia-org-1345	36	13	analysis	analysis	NN
en-wikipedia-org-1345	36	14	of	of	IN
en-wikipedia-org-1345	36	15	the	the	DT
en-wikipedia-org-1345	36	16	breaking	breaking	NN
en-wikipedia-org-1345	36	17	of	of	IN
en-wikipedia-org-1345	36	18	the	the	DT
en-wikipedia-org-1345	36	19	German	german	JJ
en-wikipedia-org-1345	36	20	second	second	JJ
en-wikipedia-org-1345	36	21	world	world	NN
en-wikipedia-org-1345	36	22	war	war	NN
en-wikipedia-org-1345	36	23	Enigma	Enigma	NNP
en-wikipedia-org-1345	36	24	ciphers	cipher	NNS
en-wikipedia-org-1345	36	25	.	.	.
en-wikipedia-org-1345	37	1	Much	much	JJ
en-wikipedia-org-1345	37	2	of	of	IN
en-wikipedia-org-1345	37	3	the	the	DT
en-wikipedia-org-1345	37	4	mathematics	mathematic	NNS
en-wikipedia-org-1345	37	5	behind	behind	IN
en-wikipedia-org-1345	37	6	information	information	NN
en-wikipedia-org-1345	37	7	theory	theory	NN
en-wikipedia-org-1345	37	8	with	with	IN
en-wikipedia-org-1345	37	9	events	event	NNS
en-wikipedia-org-1345	37	10	of	of	IN
en-wikipedia-org-1345	37	11	different	different	JJ
en-wikipedia-org-1345	37	12	probabilities	probability	NNS
en-wikipedia-org-1345	37	13	were	be	VBD
en-wikipedia-org-1345	37	14	developed	develop	VBN
en-wikipedia-org-1345	37	15	for	for	IN
en-wikipedia-org-1345	37	16	the	the	DT
en-wikipedia-org-1345	37	17	field	field	NN
en-wikipedia-org-1345	37	18	of	of	IN
en-wikipedia-org-1345	37	19	thermodynamics	thermodynamic	NNS
en-wikipedia-org-1345	37	20	by	by	IN
en-wikipedia-org-1345	37	21	Ludwig	Ludwig	NNP
en-wikipedia-org-1345	37	22	Boltzmann	Boltzmann	NNP
en-wikipedia-org-1345	37	23	and	and	CC
en-wikipedia-org-1345	37	24	J.	J.	NNP
en-wikipedia-org-1345	37	25	Willard	Willard	NNP
en-wikipedia-org-1345	37	26	Gibbs	Gibbs	NNPS
en-wikipedia-org-1345	37	27	.	.	.
en-wikipedia-org-1345	38	1	Connections	connection	NNS
en-wikipedia-org-1345	38	2	between	between	IN
en-wikipedia-org-1345	38	3	information	information	NN
en-wikipedia-org-1345	38	4	-	-	HYPH
en-wikipedia-org-1345	38	5	theoretic	theoretic	NN
en-wikipedia-org-1345	38	6	entropy	entropy	NN
en-wikipedia-org-1345	38	7	and	and	CC
en-wikipedia-org-1345	38	8	thermodynamic	thermodynamic	NN
en-wikipedia-org-1345	38	9	entropy	entropy	NN
en-wikipedia-org-1345	38	10	,	,	,
en-wikipedia-org-1345	38	11	including	include	VBG
en-wikipedia-org-1345	38	12	the	the	DT
en-wikipedia-org-1345	38	13	important	important	JJ
en-wikipedia-org-1345	38	14	contributions	contribution	NNS
en-wikipedia-org-1345	38	15	by	by	IN
en-wikipedia-org-1345	38	16	Rolf	Rolf	NNP
en-wikipedia-org-1345	38	17	Landauer	Landauer	NNP
en-wikipedia-org-1345	38	18	in	in	IN
en-wikipedia-org-1345	38	19	the	the	DT
en-wikipedia-org-1345	38	20	1960s	1960	NNS
en-wikipedia-org-1345	38	21	,	,	,
en-wikipedia-org-1345	38	22	are	be	VBP
en-wikipedia-org-1345	38	23	explored	explore	VBN
en-wikipedia-org-1345	38	24	in	in	IN
en-wikipedia-org-1345	38	25	Entropy	Entropy	NNP
en-wikipedia-org-1345	38	26	in	in	IN
en-wikipedia-org-1345	38	27	thermodynamics	thermodynamic	NNS
en-wikipedia-org-1345	38	28	and	and	CC
en-wikipedia-org-1345	38	29	information	information	NN
en-wikipedia-org-1345	38	30	theory	theory	NN
en-wikipedia-org-1345	38	31	.	.	.
en-wikipedia-org-1345	39	1	In	in	IN
en-wikipedia-org-1345	39	2	Shannon	Shannon	NNP
en-wikipedia-org-1345	39	3	's	's	POS
en-wikipedia-org-1345	39	4	revolutionary	revolutionary	JJ
en-wikipedia-org-1345	39	5	and	and	CC
en-wikipedia-org-1345	39	6	groundbreaking	groundbreake	VBG
en-wikipedia-org-1345	39	7	paper	paper	NN
en-wikipedia-org-1345	39	8	,	,	,
en-wikipedia-org-1345	39	9	the	the	DT
en-wikipedia-org-1345	39	10	work	work	NN
en-wikipedia-org-1345	39	11	for	for	IN
en-wikipedia-org-1345	39	12	which	which	WDT
en-wikipedia-org-1345	39	13	had	have	VBD
en-wikipedia-org-1345	39	14	been	be	VBN
en-wikipedia-org-1345	39	15	substantially	substantially	RB
en-wikipedia-org-1345	39	16	completed	complete	VBN
en-wikipedia-org-1345	39	17	at	at	IN
en-wikipedia-org-1345	39	18	Bell	Bell	NNP
en-wikipedia-org-1345	39	19	Labs	Labs	NNPS
en-wikipedia-org-1345	39	20	by	by	IN
en-wikipedia-org-1345	39	21	the	the	DT
en-wikipedia-org-1345	39	22	end	end	NN
en-wikipedia-org-1345	39	23	of	of	IN
en-wikipedia-org-1345	39	24	1944	1944	CD
en-wikipedia-org-1345	39	25	,	,	,
en-wikipedia-org-1345	39	26	Shannon	Shannon	NNP
en-wikipedia-org-1345	39	27	for	for	IN
en-wikipedia-org-1345	39	28	the	the	DT
en-wikipedia-org-1345	39	29	first	first	JJ
en-wikipedia-org-1345	39	30	time	time	NN
en-wikipedia-org-1345	39	31	introduced	introduce	VBD
en-wikipedia-org-1345	39	32	the	the	DT
en-wikipedia-org-1345	39	33	qualitative	qualitative	JJ
en-wikipedia-org-1345	39	34	and	and	CC
en-wikipedia-org-1345	39	35	quantitative	quantitative	JJ
en-wikipedia-org-1345	39	36	model	model	NN
en-wikipedia-org-1345	39	37	of	of	IN
en-wikipedia-org-1345	39	38	communication	communication	NN
en-wikipedia-org-1345	39	39	as	as	IN
en-wikipedia-org-1345	39	40	a	a	DT
en-wikipedia-org-1345	39	41	statistical	statistical	JJ
en-wikipedia-org-1345	39	42	process	process	NN
en-wikipedia-org-1345	39	43	underlying	underlie	VBG
en-wikipedia-org-1345	39	44	information	information	NN
en-wikipedia-org-1345	39	45	theory	theory	NN
en-wikipedia-org-1345	39	46	,	,	,
en-wikipedia-org-1345	39	47	opening	open	VBG
en-wikipedia-org-1345	39	48	with	with	IN
en-wikipedia-org-1345	39	49	the	the	DT
en-wikipedia-org-1345	39	50	assertion	assertion	NN
en-wikipedia-org-1345	39	51	that	that	IN
en-wikipedia-org-1345	39	52	"	"	``
en-wikipedia-org-1345	39	53	The	the	DT
en-wikipedia-org-1345	39	54	fundamental	fundamental	JJ
en-wikipedia-org-1345	39	55	problem	problem	NN
en-wikipedia-org-1345	39	56	of	of	IN
en-wikipedia-org-1345	39	57	communication	communication	NN
en-wikipedia-org-1345	39	58	is	be	VBZ
en-wikipedia-org-1345	39	59	that	that	DT
en-wikipedia-org-1345	39	60	of	of	IN
en-wikipedia-org-1345	39	61	reproducing	reproduce	VBG
en-wikipedia-org-1345	39	62	at	at	IN
en-wikipedia-org-1345	39	63	one	one	CD
en-wikipedia-org-1345	39	64	point	point	NN
en-wikipedia-org-1345	39	65	,	,	,
en-wikipedia-org-1345	39	66	either	either	CC
en-wikipedia-org-1345	39	67	exactly	exactly	RB
en-wikipedia-org-1345	39	68	or	or	CC
en-wikipedia-org-1345	39	69	approximately	approximately	RB
en-wikipedia-org-1345	39	70	,	,	,
en-wikipedia-org-1345	39	71	a	a	DT
en-wikipedia-org-1345	39	72	message	message	NN
en-wikipedia-org-1345	39	73	selected	select	VBN
en-wikipedia-org-1345	39	74	at	at	IN
en-wikipedia-org-1345	39	75	another	another	DT
en-wikipedia-org-1345	39	76	point	point	NN
en-wikipedia-org-1345	39	77	.	.	.
en-wikipedia-org-1345	39	78	"	"	''
en-wikipedia-org-1345	40	1	With	with	IN
en-wikipedia-org-1345	40	2	it	-PRON-	PRP
en-wikipedia-org-1345	40	3	came	come	VBD
en-wikipedia-org-1345	40	4	the	the	DT
en-wikipedia-org-1345	40	5	ideas	idea	NNS
en-wikipedia-org-1345	40	6	of	of	IN
en-wikipedia-org-1345	40	7	the	the	DT
en-wikipedia-org-1345	40	8	information	information	NN
en-wikipedia-org-1345	40	9	entropy	entropy	JJ
en-wikipedia-org-1345	40	10	and	and	CC
en-wikipedia-org-1345	40	11	redundancy	redundancy	NN
en-wikipedia-org-1345	40	12	of	of	IN
en-wikipedia-org-1345	40	13	a	a	DT
en-wikipedia-org-1345	40	14	source	source	NN
en-wikipedia-org-1345	40	15	,	,	,
en-wikipedia-org-1345	40	16	and	and	CC
en-wikipedia-org-1345	40	17	its	-PRON-	PRP$
en-wikipedia-org-1345	40	18	relevance	relevance	NN
en-wikipedia-org-1345	40	19	through	through	IN
en-wikipedia-org-1345	40	20	the	the	DT
en-wikipedia-org-1345	40	21	source	source	NN
en-wikipedia-org-1345	40	22	coding	code	VBG
en-wikipedia-org-1345	40	23	theorem	theorem	NN
en-wikipedia-org-1345	40	24	;	;	:
en-wikipedia-org-1345	40	25	the	the	DT
en-wikipedia-org-1345	40	26	mutual	mutual	JJ
en-wikipedia-org-1345	40	27	information	information	NN
en-wikipedia-org-1345	40	28	,	,	,
en-wikipedia-org-1345	40	29	and	and	CC
en-wikipedia-org-1345	40	30	the	the	DT
en-wikipedia-org-1345	40	31	channel	channel	NN
en-wikipedia-org-1345	40	32	capacity	capacity	NN
en-wikipedia-org-1345	40	33	of	of	IN
en-wikipedia-org-1345	40	34	a	a	DT
en-wikipedia-org-1345	40	35	noisy	noisy	JJ
en-wikipedia-org-1345	40	36	channel	channel	NN
en-wikipedia-org-1345	40	37	,	,	,
en-wikipedia-org-1345	40	38	including	include	VBG
en-wikipedia-org-1345	40	39	the	the	DT
en-wikipedia-org-1345	40	40	promise	promise	NN
en-wikipedia-org-1345	40	41	of	of	IN
en-wikipedia-org-1345	40	42	perfect	perfect	JJ
en-wikipedia-org-1345	40	43	loss	loss	NN
en-wikipedia-org-1345	40	44	-	-	HYPH
en-wikipedia-org-1345	40	45	free	free	JJ
en-wikipedia-org-1345	40	46	communication	communication	NN
en-wikipedia-org-1345	40	47	given	give	VBN
en-wikipedia-org-1345	40	48	by	by	IN
en-wikipedia-org-1345	40	49	the	the	DT
en-wikipedia-org-1345	40	50	noisy	noisy	NNP
en-wikipedia-org-1345	40	51	-	-	HYPH
en-wikipedia-org-1345	40	52	channel	channel	NNP
en-wikipedia-org-1345	40	53	coding	coding	NN
en-wikipedia-org-1345	40	54	theorem	theorem	NN
en-wikipedia-org-1345	40	55	;	;	:
en-wikipedia-org-1345	40	56	the	the	DT
en-wikipedia-org-1345	40	57	practical	practical	JJ
en-wikipedia-org-1345	40	58	result	result	NN
en-wikipedia-org-1345	40	59	of	of	IN
en-wikipedia-org-1345	40	60	the	the	DT
en-wikipedia-org-1345	40	61	Shannon	Shannon	NNP
en-wikipedia-org-1345	40	62	–	–	:
en-wikipedia-org-1345	40	63	Hartley	Hartley	NNP
en-wikipedia-org-1345	40	64	law	law	NN
en-wikipedia-org-1345	40	65	for	for	IN
en-wikipedia-org-1345	40	66	the	the	DT
en-wikipedia-org-1345	40	67	channel	channel	NN
en-wikipedia-org-1345	40	68	capacity	capacity	NN
en-wikipedia-org-1345	40	69	of	of	IN
en-wikipedia-org-1345	40	70	a	a	DT
en-wikipedia-org-1345	40	71	Gaussian	gaussian	JJ
en-wikipedia-org-1345	40	72	channel	channel	NN
en-wikipedia-org-1345	40	73	;	;	:
en-wikipedia-org-1345	40	74	as	as	RB
en-wikipedia-org-1345	40	75	well	well	RB
en-wikipedia-org-1345	40	76	as	as	IN
en-wikipedia-org-1345	40	77	the	the	DT
en-wikipedia-org-1345	40	78	bit	bit	NN
en-wikipedia-org-1345	40	79	—	—	:
en-wikipedia-org-1345	40	80	a	a	DT
en-wikipedia-org-1345	40	81	new	new	JJ
en-wikipedia-org-1345	40	82	way	way	NN
en-wikipedia-org-1345	40	83	of	of	IN
en-wikipedia-org-1345	40	84	seeing	see	VBG
en-wikipedia-org-1345	40	85	the	the	DT
en-wikipedia-org-1345	40	86	most	most	RBS
en-wikipedia-org-1345	40	87	fundamental	fundamental	JJ
en-wikipedia-org-1345	40	88	unit	unit	NN
en-wikipedia-org-1345	40	89	of	of	IN
en-wikipedia-org-1345	40	90	information	information	NN
en-wikipedia-org-1345	40	91	.	.	.
en-wikipedia-org-1345	41	1	Quantities	quantity	NNS
en-wikipedia-org-1345	41	2	of	of	IN
en-wikipedia-org-1345	41	3	information[edit	information[edit	LS
en-wikipedia-org-1345	41	4	]	]	-RRB-
en-wikipedia-org-1345	41	5	Main	main	JJ
en-wikipedia-org-1345	41	6	article	article	NN
en-wikipedia-org-1345	41	7	:	:	:
en-wikipedia-org-1345	41	8	Quantities	quantity	NNS
en-wikipedia-org-1345	41	9	of	of	IN
en-wikipedia-org-1345	41	10	information	information	NN
en-wikipedia-org-1345	41	11	Information	information	NN
en-wikipedia-org-1345	41	12	theory	theory	NN
en-wikipedia-org-1345	41	13	is	be	VBZ
en-wikipedia-org-1345	41	14	based	base	VBN
en-wikipedia-org-1345	41	15	on	on	IN
en-wikipedia-org-1345	41	16	probability	probability	NN
en-wikipedia-org-1345	41	17	theory	theory	NN
en-wikipedia-org-1345	41	18	and	and	CC
en-wikipedia-org-1345	41	19	statistics	statistic	NNS
en-wikipedia-org-1345	41	20	.	.	.
en-wikipedia-org-1345	42	1	Information	information	NN
en-wikipedia-org-1345	42	2	theory	theory	NN
en-wikipedia-org-1345	42	3	often	often	RB
en-wikipedia-org-1345	42	4	concerns	concern	VBZ
en-wikipedia-org-1345	42	5	itself	-PRON-	PRP
en-wikipedia-org-1345	42	6	with	with	IN
en-wikipedia-org-1345	42	7	measures	measure	NNS
en-wikipedia-org-1345	42	8	of	of	IN
en-wikipedia-org-1345	42	9	information	information	NN
en-wikipedia-org-1345	42	10	of	of	IN
en-wikipedia-org-1345	42	11	the	the	DT
en-wikipedia-org-1345	42	12	distributions	distribution	NNS
en-wikipedia-org-1345	42	13	associated	associate	VBN
en-wikipedia-org-1345	42	14	with	with	IN
en-wikipedia-org-1345	42	15	random	random	JJ
en-wikipedia-org-1345	42	16	variables	variable	NNS
en-wikipedia-org-1345	42	17	.	.	.
en-wikipedia-org-1345	43	1	Important	important	JJ
en-wikipedia-org-1345	43	2	quantities	quantity	NNS
en-wikipedia-org-1345	43	3	of	of	IN
en-wikipedia-org-1345	43	4	information	information	NN
en-wikipedia-org-1345	43	5	are	be	VBP
en-wikipedia-org-1345	43	6	entropy	entropy	JJ
en-wikipedia-org-1345	43	7	,	,	,
en-wikipedia-org-1345	43	8	a	a	DT
en-wikipedia-org-1345	43	9	measure	measure	NN
en-wikipedia-org-1345	43	10	of	of	IN
en-wikipedia-org-1345	43	11	information	information	NN
en-wikipedia-org-1345	43	12	in	in	IN
en-wikipedia-org-1345	43	13	a	a	DT
en-wikipedia-org-1345	43	14	single	single	JJ
en-wikipedia-org-1345	43	15	random	random	JJ
en-wikipedia-org-1345	43	16	variable	variable	NN
en-wikipedia-org-1345	43	17	,	,	,
en-wikipedia-org-1345	43	18	and	and	CC
en-wikipedia-org-1345	43	19	mutual	mutual	JJ
en-wikipedia-org-1345	43	20	information	information	NN
en-wikipedia-org-1345	43	21	,	,	,
en-wikipedia-org-1345	43	22	a	a	DT
en-wikipedia-org-1345	43	23	measure	measure	NN
en-wikipedia-org-1345	43	24	of	of	IN
en-wikipedia-org-1345	43	25	information	information	NN
en-wikipedia-org-1345	43	26	in	in	IN
en-wikipedia-org-1345	43	27	common	common	JJ
en-wikipedia-org-1345	43	28	between	between	IN
en-wikipedia-org-1345	43	29	two	two	CD
en-wikipedia-org-1345	43	30	random	random	JJ
en-wikipedia-org-1345	43	31	variables	variable	NNS
en-wikipedia-org-1345	43	32	.	.	.
en-wikipedia-org-1345	44	1	The	the	DT
en-wikipedia-org-1345	44	2	former	former	JJ
en-wikipedia-org-1345	44	3	quantity	quantity	NN
en-wikipedia-org-1345	44	4	is	be	VBZ
en-wikipedia-org-1345	44	5	a	a	DT
en-wikipedia-org-1345	44	6	property	property	NN
en-wikipedia-org-1345	44	7	of	of	IN
en-wikipedia-org-1345	44	8	the	the	DT
en-wikipedia-org-1345	44	9	probability	probability	NN
en-wikipedia-org-1345	44	10	distribution	distribution	NN
en-wikipedia-org-1345	44	11	of	of	IN
en-wikipedia-org-1345	44	12	a	a	DT
en-wikipedia-org-1345	44	13	random	random	JJ
en-wikipedia-org-1345	44	14	variable	variable	NN
en-wikipedia-org-1345	44	15	and	and	CC
en-wikipedia-org-1345	44	16	gives	give	VBZ
en-wikipedia-org-1345	44	17	a	a	DT
en-wikipedia-org-1345	44	18	limit	limit	NN
en-wikipedia-org-1345	44	19	on	on	IN
en-wikipedia-org-1345	44	20	the	the	DT
en-wikipedia-org-1345	44	21	rate	rate	NN
en-wikipedia-org-1345	44	22	at	at	IN
en-wikipedia-org-1345	44	23	which	which	WDT
en-wikipedia-org-1345	44	24	data	datum	NNS
en-wikipedia-org-1345	44	25	generated	generate	VBN
en-wikipedia-org-1345	44	26	by	by	IN
en-wikipedia-org-1345	44	27	independent	independent	JJ
en-wikipedia-org-1345	44	28	samples	sample	NNS
en-wikipedia-org-1345	44	29	with	with	IN
en-wikipedia-org-1345	44	30	the	the	DT
en-wikipedia-org-1345	44	31	given	give	VBN
en-wikipedia-org-1345	44	32	distribution	distribution	NN
en-wikipedia-org-1345	44	33	can	can	MD
en-wikipedia-org-1345	44	34	be	be	VB
en-wikipedia-org-1345	44	35	reliably	reliably	RB
en-wikipedia-org-1345	44	36	compressed	compress	VBN
en-wikipedia-org-1345	44	37	.	.	.
en-wikipedia-org-1345	45	1	The	the	DT
en-wikipedia-org-1345	45	2	latter	latter	NN
en-wikipedia-org-1345	45	3	is	be	VBZ
en-wikipedia-org-1345	45	4	a	a	DT
en-wikipedia-org-1345	45	5	property	property	NN
en-wikipedia-org-1345	45	6	of	of	IN
en-wikipedia-org-1345	45	7	the	the	DT
en-wikipedia-org-1345	45	8	joint	joint	JJ
en-wikipedia-org-1345	45	9	distribution	distribution	NN
en-wikipedia-org-1345	45	10	of	of	IN
en-wikipedia-org-1345	45	11	two	two	CD
en-wikipedia-org-1345	45	12	random	random	JJ
en-wikipedia-org-1345	45	13	variables	variable	NNS
en-wikipedia-org-1345	45	14	,	,	,
en-wikipedia-org-1345	45	15	and	and	CC
en-wikipedia-org-1345	45	16	is	be	VBZ
en-wikipedia-org-1345	45	17	the	the	DT
en-wikipedia-org-1345	45	18	maximum	maximum	JJ
en-wikipedia-org-1345	45	19	rate	rate	NN
en-wikipedia-org-1345	45	20	of	of	IN
en-wikipedia-org-1345	45	21	reliable	reliable	JJ
en-wikipedia-org-1345	45	22	communication	communication	NN
en-wikipedia-org-1345	45	23	across	across	IN
en-wikipedia-org-1345	45	24	a	a	DT
en-wikipedia-org-1345	45	25	noisy	noisy	JJ
en-wikipedia-org-1345	45	26	channel	channel	NN
en-wikipedia-org-1345	45	27	in	in	IN
en-wikipedia-org-1345	45	28	the	the	DT
en-wikipedia-org-1345	45	29	limit	limit	NN
en-wikipedia-org-1345	45	30	of	of	IN
en-wikipedia-org-1345	45	31	long	long	JJ
en-wikipedia-org-1345	45	32	block	block	NN
en-wikipedia-org-1345	45	33	lengths	length	NNS
en-wikipedia-org-1345	45	34	,	,	,
en-wikipedia-org-1345	45	35	when	when	WRB
en-wikipedia-org-1345	45	36	the	the	DT
en-wikipedia-org-1345	45	37	channel	channel	NN
en-wikipedia-org-1345	45	38	statistics	statistic	NNS
en-wikipedia-org-1345	45	39	are	be	VBP
en-wikipedia-org-1345	45	40	determined	determine	VBN
en-wikipedia-org-1345	45	41	by	by	IN
en-wikipedia-org-1345	45	42	the	the	DT
en-wikipedia-org-1345	45	43	joint	joint	JJ
en-wikipedia-org-1345	45	44	distribution	distribution	NN
en-wikipedia-org-1345	45	45	.	.	.
en-wikipedia-org-1345	46	1	The	the	DT
en-wikipedia-org-1345	46	2	choice	choice	NN
en-wikipedia-org-1345	46	3	of	of	IN
en-wikipedia-org-1345	46	4	logarithmic	logarithmic	JJ
en-wikipedia-org-1345	46	5	base	base	NN
en-wikipedia-org-1345	46	6	in	in	IN
en-wikipedia-org-1345	46	7	the	the	DT
en-wikipedia-org-1345	46	8	following	follow	VBG
en-wikipedia-org-1345	46	9	formulae	formulae	NNP
en-wikipedia-org-1345	46	10	determines	determine	VBZ
en-wikipedia-org-1345	46	11	the	the	DT
en-wikipedia-org-1345	46	12	unit	unit	NN
en-wikipedia-org-1345	46	13	of	of	IN
en-wikipedia-org-1345	46	14	information	information	NN
en-wikipedia-org-1345	46	15	entropy	entropy	JJ
en-wikipedia-org-1345	46	16	that	that	WDT
en-wikipedia-org-1345	46	17	is	be	VBZ
en-wikipedia-org-1345	46	18	used	use	VBN
en-wikipedia-org-1345	46	19	.	.	.
en-wikipedia-org-1345	47	1	A	a	DT
en-wikipedia-org-1345	47	2	common	common	JJ
en-wikipedia-org-1345	47	3	unit	unit	NN
en-wikipedia-org-1345	47	4	of	of	IN
en-wikipedia-org-1345	47	5	information	information	NN
en-wikipedia-org-1345	47	6	is	be	VBZ
en-wikipedia-org-1345	47	7	the	the	DT
en-wikipedia-org-1345	47	8	bit	bit	NN
en-wikipedia-org-1345	47	9	,	,	,
en-wikipedia-org-1345	47	10	based	base	VBN
en-wikipedia-org-1345	47	11	on	on	IN
en-wikipedia-org-1345	47	12	the	the	DT
en-wikipedia-org-1345	47	13	binary	binary	JJ
en-wikipedia-org-1345	47	14	logarithm	logarithm	NN
en-wikipedia-org-1345	47	15	.	.	.
en-wikipedia-org-1345	48	1	Other	other	JJ
en-wikipedia-org-1345	48	2	units	unit	NNS
en-wikipedia-org-1345	48	3	include	include	VBP
en-wikipedia-org-1345	48	4	the	the	DT
en-wikipedia-org-1345	48	5	nat	nat	NNP
en-wikipedia-org-1345	48	6	,	,	,
en-wikipedia-org-1345	48	7	which	which	WDT
en-wikipedia-org-1345	48	8	is	be	VBZ
en-wikipedia-org-1345	48	9	based	base	VBN
en-wikipedia-org-1345	48	10	on	on	IN
en-wikipedia-org-1345	48	11	the	the	DT
en-wikipedia-org-1345	48	12	natural	natural	JJ
en-wikipedia-org-1345	48	13	logarithm	logarithm	NN
en-wikipedia-org-1345	48	14	,	,	,
en-wikipedia-org-1345	48	15	and	and	CC
en-wikipedia-org-1345	48	16	the	the	DT
en-wikipedia-org-1345	48	17	decimal	decimal	JJ
en-wikipedia-org-1345	48	18	digit	digit	NN
en-wikipedia-org-1345	48	19	,	,	,
en-wikipedia-org-1345	48	20	which	which	WDT
en-wikipedia-org-1345	48	21	is	be	VBZ
en-wikipedia-org-1345	48	22	based	base	VBN
en-wikipedia-org-1345	48	23	on	on	IN
en-wikipedia-org-1345	48	24	the	the	DT
en-wikipedia-org-1345	48	25	common	common	JJ
en-wikipedia-org-1345	48	26	logarithm	logarithm	NN
en-wikipedia-org-1345	48	27	.	.	.
en-wikipedia-org-1345	49	1	In	in	IN
en-wikipedia-org-1345	49	2	what	what	WP
en-wikipedia-org-1345	49	3	follows	follow	VBZ
en-wikipedia-org-1345	49	4	,	,	,
en-wikipedia-org-1345	49	5	an	an	DT
en-wikipedia-org-1345	49	6	expression	expression	NN
en-wikipedia-org-1345	49	7	of	of	IN
en-wikipedia-org-1345	49	8	the	the	DT
en-wikipedia-org-1345	49	9	form	form	NN
en-wikipedia-org-1345	49	10	p	p	NN
en-wikipedia-org-1345	49	11	log	log	NNP
en-wikipedia-org-1345	49	12	p	p	NNP
en-wikipedia-org-1345	49	13	is	be	VBZ
en-wikipedia-org-1345	49	14	considered	consider	VBN
en-wikipedia-org-1345	49	15	by	by	IN
en-wikipedia-org-1345	49	16	convention	convention	NN
en-wikipedia-org-1345	49	17	to	to	TO
en-wikipedia-org-1345	49	18	be	be	VB
en-wikipedia-org-1345	49	19	equal	equal	JJ
en-wikipedia-org-1345	49	20	to	to	IN
en-wikipedia-org-1345	49	21	zero	zero	CD
en-wikipedia-org-1345	49	22	whenever	whenever	WRB
en-wikipedia-org-1345	49	23	p	p	NN
en-wikipedia-org-1345	49	24	=	=	SYM
en-wikipedia-org-1345	49	25	0	0	NFP
en-wikipedia-org-1345	49	26	.	.	.
en-wikipedia-org-1345	50	1	This	this	DT
en-wikipedia-org-1345	50	2	is	be	VBZ
en-wikipedia-org-1345	50	3	justified	justified	JJ
en-wikipedia-org-1345	50	4	because	because	IN
en-wikipedia-org-1345	50	5	lim	lim	NNP
en-wikipedia-org-1345	50	6	p	p	NNP
en-wikipedia-org-1345	50	7	→	→	SYM
en-wikipedia-org-1345	50	8	0	0	CD
en-wikipedia-org-1345	50	9	+	+	CC
en-wikipedia-org-1345	50	10	p	p	NN
en-wikipedia-org-1345	50	11	log	log	NN
en-wikipedia-org-1345	50	12	⁡	⁡	NNP
en-wikipedia-org-1345	50	13	p	p	NN
en-wikipedia-org-1345	50	14	=	=	SYM
en-wikipedia-org-1345	50	15	0	0	NFP
en-wikipedia-org-1345	50	16	{	{	-LRB-
en-wikipedia-org-1345	50	17	\displaystyle	\displaystyle	CD
en-wikipedia-org-1345	50	18	\lim	\lim	CD
en-wikipedia-org-1345	50	19	_	_	NNP
en-wikipedia-org-1345	50	20	{	{	-LRB-
en-wikipedia-org-1345	50	21	p\rightarrow	p\rightarrow	NN
en-wikipedia-org-1345	50	22	0+}p\log	0+}p\log	NFP
en-wikipedia-org-1345	50	23	p=0	p=0	NNS
en-wikipedia-org-1345	50	24	}	}	-RRB-
en-wikipedia-org-1345	50	25	for	for	IN
en-wikipedia-org-1345	50	26	any	any	DT
en-wikipedia-org-1345	50	27	logarithmic	logarithmic	JJ
en-wikipedia-org-1345	50	28	base	base	NN
en-wikipedia-org-1345	50	29	.	.	.
en-wikipedia-org-1345	51	1	Entropy	entropy	JJ
en-wikipedia-org-1345	51	2	of	of	IN
en-wikipedia-org-1345	51	3	an	an	DT
en-wikipedia-org-1345	51	4	information	information	NN
en-wikipedia-org-1345	51	5	source[edit	source[edit	LS
en-wikipedia-org-1345	51	6	]	]	-RRB-
en-wikipedia-org-1345	51	7	Based	base	VBN
en-wikipedia-org-1345	51	8	on	on	IN
en-wikipedia-org-1345	51	9	the	the	DT
en-wikipedia-org-1345	51	10	probability	probability	NN
en-wikipedia-org-1345	51	11	mass	mass	NN
en-wikipedia-org-1345	51	12	function	function	NN
en-wikipedia-org-1345	51	13	of	of	IN
en-wikipedia-org-1345	51	14	each	each	DT
en-wikipedia-org-1345	51	15	source	source	NN
en-wikipedia-org-1345	51	16	symbol	symbol	NN
en-wikipedia-org-1345	51	17	to	to	TO
en-wikipedia-org-1345	51	18	be	be	VB
en-wikipedia-org-1345	51	19	communicated	communicate	VBN
en-wikipedia-org-1345	51	20	,	,	,
en-wikipedia-org-1345	51	21	the	the	DT
en-wikipedia-org-1345	51	22	Shannon	Shannon	NNP
en-wikipedia-org-1345	51	23	entropy	entropy	JJ
en-wikipedia-org-1345	51	24	H	H	NNP
en-wikipedia-org-1345	51	25	,	,	,
en-wikipedia-org-1345	51	26	in	in	IN
en-wikipedia-org-1345	51	27	units	unit	NNS
en-wikipedia-org-1345	51	28	of	of	IN
en-wikipedia-org-1345	51	29	bits	bit	NNS
en-wikipedia-org-1345	51	30	(	(	-LRB-
en-wikipedia-org-1345	51	31	per	per	IN
en-wikipedia-org-1345	51	32	symbol	symbol	NN
en-wikipedia-org-1345	51	33	)	)	-RRB-
en-wikipedia-org-1345	51	34	,	,	,
en-wikipedia-org-1345	51	35	is	be	VBZ
en-wikipedia-org-1345	51	36	given	give	VBN
en-wikipedia-org-1345	51	37	by	by	IN
en-wikipedia-org-1345	51	38	H	h	NN
en-wikipedia-org-1345	51	39	=	=	SYM
en-wikipedia-org-1345	51	40	−	−	NNP
en-wikipedia-org-1345	51	41	∑	∑	.
en-wikipedia-org-1345	51	42	i	i	PRP
en-wikipedia-org-1345	51	43	p	p	VBP
en-wikipedia-org-1345	51	44	i	i	PRP
en-wikipedia-org-1345	51	45	log	log	VBP
en-wikipedia-org-1345	51	46	2	2	CD
en-wikipedia-org-1345	51	47	⁡	⁡	CD
en-wikipedia-org-1345	51	48	(	(	-LRB-
en-wikipedia-org-1345	51	49	p	p	NN
en-wikipedia-org-1345	51	50	i	i	NN
en-wikipedia-org-1345	51	51	)	)	-RRB-
en-wikipedia-org-1345	51	52	{	{	-LRB-
en-wikipedia-org-1345	51	53	\displaystyle	\displaystyle	CD
en-wikipedia-org-1345	51	54	H=-\sum	h=-\sum	UH
en-wikipedia-org-1345	51	55	_	_	NNP
en-wikipedia-org-1345	51	56	{	{	-LRB-
en-wikipedia-org-1345	51	57	i}p_{i}\log	i}p_{i}\log	NNP
en-wikipedia-org-1345	51	58	_	_	NNP
en-wikipedia-org-1345	51	59	{	{	-LRB-
en-wikipedia-org-1345	51	60	2}(p_{i	2}(p_{i	CD
en-wikipedia-org-1345	51	61	}	}	-RRB-
en-wikipedia-org-1345	51	62	)	)	-RRB-
en-wikipedia-org-1345	51	63	}	}	-RRB-
en-wikipedia-org-1345	51	64	where	where	WRB
en-wikipedia-org-1345	51	65	pi	pi	NN
en-wikipedia-org-1345	51	66	is	be	VBZ
en-wikipedia-org-1345	51	67	the	the	DT
en-wikipedia-org-1345	51	68	probability	probability	NN
en-wikipedia-org-1345	51	69	of	of	IN
en-wikipedia-org-1345	51	70	occurrence	occurrence	NN
en-wikipedia-org-1345	51	71	of	of	IN
en-wikipedia-org-1345	51	72	the	the	DT
en-wikipedia-org-1345	51	73	i	i	NN
en-wikipedia-org-1345	51	74	-	-	HYPH
en-wikipedia-org-1345	51	75	th	th	XX
en-wikipedia-org-1345	51	76	possible	possible	JJ
en-wikipedia-org-1345	51	77	value	value	NN
en-wikipedia-org-1345	51	78	of	of	IN
en-wikipedia-org-1345	51	79	the	the	DT
en-wikipedia-org-1345	51	80	source	source	NN
en-wikipedia-org-1345	51	81	symbol	symbol	NN
en-wikipedia-org-1345	51	82	.	.	.
en-wikipedia-org-1345	52	1	This	this	DT
en-wikipedia-org-1345	52	2	equation	equation	NN
en-wikipedia-org-1345	52	3	gives	give	VBZ
en-wikipedia-org-1345	52	4	the	the	DT
en-wikipedia-org-1345	52	5	entropy	entropy	JJ
en-wikipedia-org-1345	52	6	in	in	IN
en-wikipedia-org-1345	52	7	the	the	DT
en-wikipedia-org-1345	52	8	units	unit	NNS
en-wikipedia-org-1345	52	9	of	of	IN
en-wikipedia-org-1345	52	10	"	"	``
en-wikipedia-org-1345	52	11	bits	bit	NNS
en-wikipedia-org-1345	52	12	"	"	''
en-wikipedia-org-1345	52	13	(	(	-LRB-
en-wikipedia-org-1345	52	14	per	per	IN
en-wikipedia-org-1345	52	15	symbol	symbol	NN
en-wikipedia-org-1345	52	16	)	)	-RRB-
en-wikipedia-org-1345	52	17	because	because	IN
en-wikipedia-org-1345	52	18	it	-PRON-	PRP
en-wikipedia-org-1345	52	19	uses	use	VBZ
en-wikipedia-org-1345	52	20	a	a	DT
en-wikipedia-org-1345	52	21	logarithm	logarithm	NN
en-wikipedia-org-1345	52	22	of	of	IN
en-wikipedia-org-1345	52	23	base	base	NN
en-wikipedia-org-1345	52	24	2	2	CD
en-wikipedia-org-1345	52	25	,	,	,
en-wikipedia-org-1345	52	26	and	and	CC
en-wikipedia-org-1345	52	27	this	this	DT
en-wikipedia-org-1345	52	28	base-2	base-2	NNP
en-wikipedia-org-1345	52	29	measure	measure	NN
en-wikipedia-org-1345	52	30	of	of	IN
en-wikipedia-org-1345	52	31	entropy	entropy	NN
en-wikipedia-org-1345	52	32	has	have	VBZ
en-wikipedia-org-1345	52	33	sometimes	sometimes	RB
en-wikipedia-org-1345	52	34	been	be	VBN
en-wikipedia-org-1345	52	35	called	call	VBN
en-wikipedia-org-1345	52	36	the	the	DT
en-wikipedia-org-1345	52	37	shannon	shannon	NN
en-wikipedia-org-1345	52	38	in	in	IN
en-wikipedia-org-1345	52	39	his	-PRON-	PRP$
en-wikipedia-org-1345	52	40	honor	honor	NN
en-wikipedia-org-1345	52	41	.	.	.
en-wikipedia-org-1345	53	1	Entropy	Entropy	NNP
en-wikipedia-org-1345	53	2	is	be	VBZ
en-wikipedia-org-1345	53	3	also	also	RB
en-wikipedia-org-1345	53	4	commonly	commonly	RB
en-wikipedia-org-1345	53	5	computed	compute	VBN
en-wikipedia-org-1345	53	6	using	use	VBG
en-wikipedia-org-1345	53	7	the	the	DT
en-wikipedia-org-1345	53	8	natural	natural	JJ
en-wikipedia-org-1345	53	9	logarithm	logarithm	NNP
en-wikipedia-org-1345	53	10	(	(	-LRB-
en-wikipedia-org-1345	53	11	base	base	NNP
en-wikipedia-org-1345	53	12	e	e	NNP
en-wikipedia-org-1345	53	13	,	,	,
en-wikipedia-org-1345	53	14	where	where	WRB
en-wikipedia-org-1345	53	15	e	e	NNP
en-wikipedia-org-1345	53	16	is	be	VBZ
en-wikipedia-org-1345	53	17	Euler	Euler	NNP
en-wikipedia-org-1345	53	18	's	's	POS
en-wikipedia-org-1345	53	19	number	number	NN
en-wikipedia-org-1345	53	20	)	)	-RRB-
en-wikipedia-org-1345	53	21	,	,	,
en-wikipedia-org-1345	53	22	which	which	WDT
en-wikipedia-org-1345	53	23	produces	produce	VBZ
en-wikipedia-org-1345	53	24	a	a	DT
en-wikipedia-org-1345	53	25	measurement	measurement	NN
en-wikipedia-org-1345	53	26	of	of	IN
en-wikipedia-org-1345	53	27	entropy	entropy	JJ
en-wikipedia-org-1345	53	28	in	in	IN
en-wikipedia-org-1345	53	29	nats	nat	NNS
en-wikipedia-org-1345	53	30	per	per	IN
en-wikipedia-org-1345	53	31	symbol	symbol	NN
en-wikipedia-org-1345	53	32	and	and	CC
en-wikipedia-org-1345	53	33	sometimes	sometimes	RB
en-wikipedia-org-1345	53	34	simplifies	simplify	VBZ
en-wikipedia-org-1345	53	35	the	the	DT
en-wikipedia-org-1345	53	36	analysis	analysis	NN
en-wikipedia-org-1345	53	37	by	by	IN
en-wikipedia-org-1345	53	38	avoiding	avoid	VBG
en-wikipedia-org-1345	53	39	the	the	DT
en-wikipedia-org-1345	53	40	need	need	NN
en-wikipedia-org-1345	53	41	to	to	TO
en-wikipedia-org-1345	53	42	include	include	VB
en-wikipedia-org-1345	53	43	extra	extra	JJ
en-wikipedia-org-1345	53	44	constants	constant	NNS
en-wikipedia-org-1345	53	45	in	in	IN
en-wikipedia-org-1345	53	46	the	the	DT
en-wikipedia-org-1345	53	47	formulas	formula	NNS
en-wikipedia-org-1345	53	48	.	.	.
en-wikipedia-org-1345	54	1	Other	other	JJ
en-wikipedia-org-1345	54	2	bases	basis	NNS
en-wikipedia-org-1345	54	3	are	be	VBP
en-wikipedia-org-1345	54	4	also	also	RB
en-wikipedia-org-1345	54	5	possible	possible	JJ
en-wikipedia-org-1345	54	6	,	,	,
en-wikipedia-org-1345	54	7	but	but	CC
en-wikipedia-org-1345	54	8	less	less	RBR
en-wikipedia-org-1345	54	9	commonly	commonly	RB
en-wikipedia-org-1345	54	10	used	use	VBN
en-wikipedia-org-1345	54	11	.	.	.
en-wikipedia-org-1345	55	1	For	for	IN
en-wikipedia-org-1345	55	2	example	example	NN
en-wikipedia-org-1345	55	3	,	,	,
en-wikipedia-org-1345	55	4	a	a	DT
en-wikipedia-org-1345	55	5	logarithm	logarithm	NN
en-wikipedia-org-1345	55	6	of	of	IN
en-wikipedia-org-1345	55	7	base	base	NN
en-wikipedia-org-1345	55	8	28	28	CD
en-wikipedia-org-1345	55	9	=	=	SYM
en-wikipedia-org-1345	55	10	256	256	CD
en-wikipedia-org-1345	55	11	will	will	MD
en-wikipedia-org-1345	55	12	produce	produce	VB
en-wikipedia-org-1345	55	13	a	a	DT
en-wikipedia-org-1345	55	14	measurement	measurement	NN
en-wikipedia-org-1345	55	15	in	in	IN
en-wikipedia-org-1345	55	16	bytes	byte	NNS
en-wikipedia-org-1345	55	17	per	per	IN
en-wikipedia-org-1345	55	18	symbol	symbol	NN
en-wikipedia-org-1345	55	19	,	,	,
en-wikipedia-org-1345	55	20	and	and	CC
en-wikipedia-org-1345	55	21	a	a	DT
en-wikipedia-org-1345	55	22	logarithm	logarithm	NN
en-wikipedia-org-1345	55	23	of	of	IN
en-wikipedia-org-1345	55	24	base	base	NN
en-wikipedia-org-1345	55	25	10	10	CD
en-wikipedia-org-1345	55	26	will	will	MD
en-wikipedia-org-1345	55	27	produce	produce	VB
en-wikipedia-org-1345	55	28	a	a	DT
en-wikipedia-org-1345	55	29	measurement	measurement	NN
en-wikipedia-org-1345	55	30	in	in	IN
en-wikipedia-org-1345	55	31	decimal	decimal	JJ
en-wikipedia-org-1345	55	32	digits	digit	NNS
en-wikipedia-org-1345	55	33	(	(	-LRB-
en-wikipedia-org-1345	55	34	or	or	CC
en-wikipedia-org-1345	55	35	hartleys	hartley	NNS
en-wikipedia-org-1345	55	36	)	)	-RRB-
en-wikipedia-org-1345	55	37	per	per	IN
en-wikipedia-org-1345	55	38	symbol	symbol	NN
en-wikipedia-org-1345	55	39	.	.	.
en-wikipedia-org-1345	56	1	Intuitively	intuitively	RB
en-wikipedia-org-1345	56	2	,	,	,
en-wikipedia-org-1345	56	3	the	the	DT
en-wikipedia-org-1345	56	4	entropy	entropy	JJ
en-wikipedia-org-1345	56	5	HX	hx	NN
en-wikipedia-org-1345	56	6	of	of	IN
en-wikipedia-org-1345	56	7	a	a	DT
en-wikipedia-org-1345	56	8	discrete	discrete	JJ
en-wikipedia-org-1345	56	9	random	random	JJ
en-wikipedia-org-1345	56	10	variable	variable	JJ
en-wikipedia-org-1345	56	11	X	x	NN
en-wikipedia-org-1345	56	12	is	be	VBZ
en-wikipedia-org-1345	56	13	a	a	DT
en-wikipedia-org-1345	56	14	measure	measure	NN
en-wikipedia-org-1345	56	15	of	of	IN
en-wikipedia-org-1345	56	16	the	the	DT
en-wikipedia-org-1345	56	17	amount	amount	NN
en-wikipedia-org-1345	56	18	of	of	IN
en-wikipedia-org-1345	56	19	uncertainty	uncertainty	NN
en-wikipedia-org-1345	56	20	associated	associate	VBN
en-wikipedia-org-1345	56	21	with	with	IN
en-wikipedia-org-1345	56	22	the	the	DT
en-wikipedia-org-1345	56	23	value	value	NN
en-wikipedia-org-1345	56	24	of	of	IN
en-wikipedia-org-1345	56	25	X	x	NN
en-wikipedia-org-1345	56	26	when	when	WRB
en-wikipedia-org-1345	56	27	only	only	RB
en-wikipedia-org-1345	56	28	its	-PRON-	PRP$
en-wikipedia-org-1345	56	29	distribution	distribution	NN
en-wikipedia-org-1345	56	30	is	be	VBZ
en-wikipedia-org-1345	56	31	known	know	VBN
en-wikipedia-org-1345	56	32	.	.	.
en-wikipedia-org-1345	57	1	The	the	DT
en-wikipedia-org-1345	57	2	entropy	entropy	NN
en-wikipedia-org-1345	57	3	of	of	IN
en-wikipedia-org-1345	57	4	a	a	DT
en-wikipedia-org-1345	57	5	source	source	NN
en-wikipedia-org-1345	57	6	that	that	WDT
en-wikipedia-org-1345	57	7	emits	emit	VBZ
en-wikipedia-org-1345	57	8	a	a	DT
en-wikipedia-org-1345	57	9	sequence	sequence	NN
en-wikipedia-org-1345	57	10	of	of	IN
en-wikipedia-org-1345	57	11	N	n	CD
en-wikipedia-org-1345	57	12	symbols	symbol	NNS
en-wikipedia-org-1345	57	13	that	that	WDT
en-wikipedia-org-1345	57	14	are	be	VBP
en-wikipedia-org-1345	57	15	independent	independent	JJ
en-wikipedia-org-1345	57	16	and	and	CC
en-wikipedia-org-1345	57	17	identically	identically	RB
en-wikipedia-org-1345	57	18	distributed	distribute	VBN
en-wikipedia-org-1345	57	19	(	(	-LRB-
en-wikipedia-org-1345	57	20	iid	iid	NNP
en-wikipedia-org-1345	57	21	)	)	-RRB-
en-wikipedia-org-1345	57	22	is	be	VBZ
en-wikipedia-org-1345	57	23	N	N	NNP
en-wikipedia-org-1345	57	24	⋅	⋅	JJ
en-wikipedia-org-1345	57	25	H	h	NN
en-wikipedia-org-1345	57	26	bits	bit	NNS
en-wikipedia-org-1345	57	27	(	(	-LRB-
en-wikipedia-org-1345	57	28	per	per	IN
en-wikipedia-org-1345	57	29	message	message	NN
en-wikipedia-org-1345	57	30	of	of	IN
en-wikipedia-org-1345	57	31	N	n	CD
en-wikipedia-org-1345	57	32	symbols	symbol	NNS
en-wikipedia-org-1345	57	33	)	)	-RRB-
en-wikipedia-org-1345	57	34	.	.	.
en-wikipedia-org-1345	58	1	If	if	IN
en-wikipedia-org-1345	58	2	the	the	DT
en-wikipedia-org-1345	58	3	source	source	NN
en-wikipedia-org-1345	58	4	data	data	NN
en-wikipedia-org-1345	58	5	symbols	symbol	NNS
en-wikipedia-org-1345	58	6	are	be	VBP
en-wikipedia-org-1345	58	7	identically	identically	RB
en-wikipedia-org-1345	58	8	distributed	distribute	VBN
en-wikipedia-org-1345	58	9	but	but	CC
en-wikipedia-org-1345	58	10	not	not	RB
en-wikipedia-org-1345	58	11	independent	independent	JJ
en-wikipedia-org-1345	58	12	,	,	,
en-wikipedia-org-1345	58	13	the	the	DT
en-wikipedia-org-1345	58	14	entropy	entropy	JJ
en-wikipedia-org-1345	58	15	of	of	IN
en-wikipedia-org-1345	58	16	a	a	DT
en-wikipedia-org-1345	58	17	message	message	NN
en-wikipedia-org-1345	58	18	of	of	IN
en-wikipedia-org-1345	58	19	length	length	NN
en-wikipedia-org-1345	58	20	N	n	NN
en-wikipedia-org-1345	58	21	will	will	MD
en-wikipedia-org-1345	58	22	be	be	VB
en-wikipedia-org-1345	58	23	less	less	JJR
en-wikipedia-org-1345	58	24	than	than	IN
en-wikipedia-org-1345	58	25	N	n	NN
en-wikipedia-org-1345	58	26	⋅	⋅	NN
en-wikipedia-org-1345	58	27	H.	h.	NN
en-wikipedia-org-1345	58	28	The	the	DT
en-wikipedia-org-1345	58	29	entropy	entropy	NN
en-wikipedia-org-1345	58	30	of	of	IN
en-wikipedia-org-1345	58	31	a	a	DT
en-wikipedia-org-1345	58	32	Bernoulli	Bernoulli	NNP
en-wikipedia-org-1345	58	33	trial	trial	NN
en-wikipedia-org-1345	58	34	as	as	IN
en-wikipedia-org-1345	58	35	a	a	DT
en-wikipedia-org-1345	58	36	function	function	NN
en-wikipedia-org-1345	58	37	of	of	IN
en-wikipedia-org-1345	58	38	success	success	JJ
en-wikipedia-org-1345	58	39	probability	probability	NN
en-wikipedia-org-1345	58	40	,	,	,
en-wikipedia-org-1345	58	41	often	often	RB
en-wikipedia-org-1345	58	42	called	call	VBD
en-wikipedia-org-1345	58	43	the	the	DT
en-wikipedia-org-1345	58	44	binary	binary	JJ
en-wikipedia-org-1345	58	45	entropy	entropy	JJ
en-wikipedia-org-1345	58	46	function	function	NN
en-wikipedia-org-1345	58	47	,	,	,
en-wikipedia-org-1345	58	48	Hb(p	Hb(p	NNP
en-wikipedia-org-1345	58	49	)	)	-RRB-
en-wikipedia-org-1345	58	50	.	.	.
en-wikipedia-org-1345	59	1	The	the	DT
en-wikipedia-org-1345	59	2	entropy	entropy	JJ
en-wikipedia-org-1345	59	3	is	be	VBZ
en-wikipedia-org-1345	59	4	maximized	maximize	VBN
en-wikipedia-org-1345	59	5	at	at	IN
en-wikipedia-org-1345	59	6	1	1	CD
en-wikipedia-org-1345	59	7	bit	bit	NN
en-wikipedia-org-1345	59	8	per	per	IN
en-wikipedia-org-1345	59	9	trial	trial	NN
en-wikipedia-org-1345	59	10	when	when	WRB
en-wikipedia-org-1345	59	11	the	the	DT
en-wikipedia-org-1345	59	12	two	two	CD
en-wikipedia-org-1345	59	13	possible	possible	JJ
en-wikipedia-org-1345	59	14	outcomes	outcome	NNS
en-wikipedia-org-1345	59	15	are	be	VBP
en-wikipedia-org-1345	59	16	equally	equally	RB
en-wikipedia-org-1345	59	17	probable	probable	JJ
en-wikipedia-org-1345	59	18	,	,	,
en-wikipedia-org-1345	59	19	as	as	IN
en-wikipedia-org-1345	59	20	in	in	IN
en-wikipedia-org-1345	59	21	an	an	DT
en-wikipedia-org-1345	59	22	unbiased	unbiased	JJ
en-wikipedia-org-1345	59	23	coin	coin	NN
en-wikipedia-org-1345	59	24	toss	toss	NN
en-wikipedia-org-1345	59	25	.	.	.
en-wikipedia-org-1345	60	1	If	if	IN
en-wikipedia-org-1345	60	2	one	one	CD
en-wikipedia-org-1345	60	3	transmits	transmit	VBZ
en-wikipedia-org-1345	60	4	1000	1000	CD
en-wikipedia-org-1345	60	5	bits	bit	NNS
en-wikipedia-org-1345	60	6	(	(	-LRB-
en-wikipedia-org-1345	60	7	0s	0s	NNP
en-wikipedia-org-1345	60	8	and	and	CC
en-wikipedia-org-1345	60	9	1s	1	NNS
en-wikipedia-org-1345	60	10	)	)	-RRB-
en-wikipedia-org-1345	60	11	,	,	,
en-wikipedia-org-1345	60	12	and	and	CC
en-wikipedia-org-1345	60	13	the	the	DT
en-wikipedia-org-1345	60	14	value	value	NN
en-wikipedia-org-1345	60	15	of	of	IN
en-wikipedia-org-1345	60	16	each	each	DT
en-wikipedia-org-1345	60	17	of	of	IN
en-wikipedia-org-1345	60	18	these	these	DT
en-wikipedia-org-1345	60	19	bits	bit	NNS
en-wikipedia-org-1345	60	20	is	be	VBZ
en-wikipedia-org-1345	60	21	known	know	VBN
en-wikipedia-org-1345	60	22	to	to	IN
en-wikipedia-org-1345	60	23	the	the	DT
en-wikipedia-org-1345	60	24	receiver	receiver	NN
en-wikipedia-org-1345	60	25	(	(	-LRB-
en-wikipedia-org-1345	60	26	has	have	VBZ
en-wikipedia-org-1345	60	27	a	a	DT
en-wikipedia-org-1345	60	28	specific	specific	JJ
en-wikipedia-org-1345	60	29	value	value	NN
en-wikipedia-org-1345	60	30	with	with	IN
en-wikipedia-org-1345	60	31	certainty	certainty	NN
en-wikipedia-org-1345	60	32	)	)	-RRB-
en-wikipedia-org-1345	60	33	ahead	ahead	RB
en-wikipedia-org-1345	60	34	of	of	IN
en-wikipedia-org-1345	60	35	transmission	transmission	NN
en-wikipedia-org-1345	60	36	,	,	,
en-wikipedia-org-1345	60	37	it	-PRON-	PRP
en-wikipedia-org-1345	60	38	is	be	VBZ
en-wikipedia-org-1345	60	39	clear	clear	JJ
en-wikipedia-org-1345	60	40	that	that	IN
en-wikipedia-org-1345	60	41	no	no	DT
en-wikipedia-org-1345	60	42	information	information	NN
en-wikipedia-org-1345	60	43	is	be	VBZ
en-wikipedia-org-1345	60	44	transmitted	transmit	VBN
en-wikipedia-org-1345	60	45	.	.	.
en-wikipedia-org-1345	61	1	If	if	IN
en-wikipedia-org-1345	61	2	,	,	,
en-wikipedia-org-1345	61	3	however	however	RB
en-wikipedia-org-1345	61	4	,	,	,
en-wikipedia-org-1345	61	5	each	each	DT
en-wikipedia-org-1345	61	6	bit	bit	NN
en-wikipedia-org-1345	61	7	is	be	VBZ
en-wikipedia-org-1345	61	8	independently	independently	RB
en-wikipedia-org-1345	61	9	equally	equally	RB
en-wikipedia-org-1345	61	10	likely	likely	JJ
en-wikipedia-org-1345	61	11	to	to	TO
en-wikipedia-org-1345	61	12	be	be	VB
en-wikipedia-org-1345	61	13	0	0	CD
en-wikipedia-org-1345	61	14	or	or	CC
en-wikipedia-org-1345	61	15	1	1	CD
en-wikipedia-org-1345	61	16	,	,	,
en-wikipedia-org-1345	61	17	1000	1000	CD
en-wikipedia-org-1345	61	18	shannons	shannon	NNS
en-wikipedia-org-1345	61	19	of	of	IN
en-wikipedia-org-1345	61	20	information	information	NN
en-wikipedia-org-1345	61	21	(	(	-LRB-
en-wikipedia-org-1345	61	22	more	more	RBR
en-wikipedia-org-1345	61	23	often	often	RB
en-wikipedia-org-1345	61	24	called	call	VBN
en-wikipedia-org-1345	61	25	bits	bit	NNS
en-wikipedia-org-1345	61	26	)	)	-RRB-
en-wikipedia-org-1345	61	27	have	have	VBP
en-wikipedia-org-1345	61	28	been	be	VBN
en-wikipedia-org-1345	61	29	transmitted	transmit	VBN
en-wikipedia-org-1345	61	30	.	.	.
en-wikipedia-org-1345	62	1	Between	between	IN
en-wikipedia-org-1345	62	2	these	these	DT
en-wikipedia-org-1345	62	3	two	two	CD
en-wikipedia-org-1345	62	4	extremes	extreme	NNS
en-wikipedia-org-1345	62	5	,	,	,
en-wikipedia-org-1345	62	6	information	information	NN
en-wikipedia-org-1345	62	7	can	can	MD
en-wikipedia-org-1345	62	8	be	be	VB
en-wikipedia-org-1345	62	9	quantified	quantify	VBN
en-wikipedia-org-1345	62	10	as	as	IN
en-wikipedia-org-1345	62	11	follows	follow	VBZ
en-wikipedia-org-1345	62	12	.	.	.
en-wikipedia-org-1345	63	1	If	if	IN
en-wikipedia-org-1345	63	2	𝕏	𝕏	NNP
en-wikipedia-org-1345	63	3	is	be	VBZ
en-wikipedia-org-1345	63	4	the	the	DT
en-wikipedia-org-1345	63	5	set	set	NN
en-wikipedia-org-1345	63	6	of	of	IN
en-wikipedia-org-1345	63	7	all	all	DT
en-wikipedia-org-1345	63	8	messages	message	NNS
en-wikipedia-org-1345	63	9	{	{	-LRB-
en-wikipedia-org-1345	63	10	x1	x1	NNP
en-wikipedia-org-1345	63	11	,	,	,
en-wikipedia-org-1345	63	12	...	...	:
en-wikipedia-org-1345	63	13	,	,	,
en-wikipedia-org-1345	63	14	xn	xn	NNP
en-wikipedia-org-1345	63	15	}	}	-RRB-
en-wikipedia-org-1345	63	16	that	that	IN
en-wikipedia-org-1345	63	17	X	X	NNP
en-wikipedia-org-1345	63	18	could	could	MD
en-wikipedia-org-1345	63	19	be	be	VB
en-wikipedia-org-1345	63	20	,	,	,
en-wikipedia-org-1345	63	21	and	and	CC
en-wikipedia-org-1345	63	22	p(x	p(x	ADD
en-wikipedia-org-1345	63	23	)	)	-RRB-
en-wikipedia-org-1345	63	24	is	be	VBZ
en-wikipedia-org-1345	63	25	the	the	DT
en-wikipedia-org-1345	63	26	probability	probability	NN
en-wikipedia-org-1345	63	27	of	of	IN
en-wikipedia-org-1345	63	28	some	some	DT
en-wikipedia-org-1345	63	29	x	x	NNS
en-wikipedia-org-1345	63	30	∈	∈	NNP
en-wikipedia-org-1345	63	31	X	x	NN
en-wikipedia-org-1345	63	32	{	{	-LRB-
en-wikipedia-org-1345	63	33	\displaystyle	\displaystyle	CD
en-wikipedia-org-1345	63	34	x\in	x\in	NNP
en-wikipedia-org-1345	63	35	\mathbb	\mathbb	CD
en-wikipedia-org-1345	63	36	{	{	-LRB-
en-wikipedia-org-1345	63	37	X	x	NN
en-wikipedia-org-1345	63	38	}	}	-RRB-
en-wikipedia-org-1345	63	39	}	}	-RRB-
en-wikipedia-org-1345	63	40	,	,	,
en-wikipedia-org-1345	63	41	then	then	RB
en-wikipedia-org-1345	63	42	the	the	DT
en-wikipedia-org-1345	63	43	entropy	entropy	JJ
en-wikipedia-org-1345	63	44	,	,	,
en-wikipedia-org-1345	63	45	H	h	NN
en-wikipedia-org-1345	63	46	,	,	,
en-wikipedia-org-1345	63	47	of	of	IN
en-wikipedia-org-1345	63	48	X	x	NN
en-wikipedia-org-1345	63	49	is	be	VBZ
en-wikipedia-org-1345	63	50	defined:[9	defined:[9	NN
en-wikipedia-org-1345	63	51	]	]	-RRB-
en-wikipedia-org-1345	63	52	H	h	NN
en-wikipedia-org-1345	63	53	(	(	-LRB-
en-wikipedia-org-1345	63	54	X	x	NN
en-wikipedia-org-1345	63	55	)	)	-RRB-
en-wikipedia-org-1345	63	56	=	=	NFP
en-wikipedia-org-1345	63	57	E	e	NN
en-wikipedia-org-1345	63	58	X	x	NN
en-wikipedia-org-1345	63	59	[	[	-LRB-
en-wikipedia-org-1345	63	60	I	-PRON-	PRP
en-wikipedia-org-1345	63	61	(	(	-LRB-
en-wikipedia-org-1345	63	62	x	x	SYM
en-wikipedia-org-1345	63	63	)	)	-RRB-
en-wikipedia-org-1345	63	64	]	]	-RRB-
en-wikipedia-org-1345	63	65	=	=	NFP
en-wikipedia-org-1345	63	66	−	−	NNP
en-wikipedia-org-1345	63	67	∑	∑	.
en-wikipedia-org-1345	63	68	x	x	SYM
en-wikipedia-org-1345	63	69	∈	∈	NNP
en-wikipedia-org-1345	63	70	X	x	NN
en-wikipedia-org-1345	63	71	p	p	NN
en-wikipedia-org-1345	63	72	(	(	-LRB-
en-wikipedia-org-1345	63	73	x	x	NN
en-wikipedia-org-1345	63	74	)	)	-RRB-
en-wikipedia-org-1345	63	75	log	log	NNP
en-wikipedia-org-1345	63	76	⁡	⁡	NNP
en-wikipedia-org-1345	63	77	p	p	NN
en-wikipedia-org-1345	63	78	(	(	-LRB-
en-wikipedia-org-1345	63	79	x	x	NNP
en-wikipedia-org-1345	63	80	)	)	-RRB-
en-wikipedia-org-1345	63	81	.	.	.
en-wikipedia-org-1345	64	1	{	{	-LRB-
en-wikipedia-org-1345	64	2	\displaystyle	\displaystyle	CD
en-wikipedia-org-1345	64	3	H(X)=\mathbb	H(X)=\mathbb	NNP
en-wikipedia-org-1345	64	4	{	{	-LRB-
en-wikipedia-org-1345	64	5	E	E	NNP
en-wikipedia-org-1345	64	6	}	}	-RRB-
en-wikipedia-org-1345	64	7	_	_	NNP
en-wikipedia-org-1345	64	8	{	{	-LRB-
en-wikipedia-org-1345	64	9	X}[I(x)]=-\sum	X}[I(x)]=-\sum	NNP
en-wikipedia-org-1345	64	10	_	_	NNP
en-wikipedia-org-1345	64	11	{	{	-LRB-
en-wikipedia-org-1345	64	12	x\in	x\in	NNP
en-wikipedia-org-1345	64	13	\mathbb	\mathbb	CD
en-wikipedia-org-1345	64	14	{	{	-LRB-
en-wikipedia-org-1345	64	15	X	x	NN
en-wikipedia-org-1345	64	16	}	}	-RRB-
en-wikipedia-org-1345	64	17	}	}	-RRB-
en-wikipedia-org-1345	64	18	p(x)\log	p(x)\log	NN
en-wikipedia-org-1345	64	19	p(x	p(x	NN
en-wikipedia-org-1345	64	20	)	)	-RRB-
en-wikipedia-org-1345	64	21	.	.	.
en-wikipedia-org-1345	64	22	}	}	-RRB-
en-wikipedia-org-1345	65	1	(	(	-LRB-
en-wikipedia-org-1345	65	2	Here	here	RB
en-wikipedia-org-1345	65	3	,	,	,
en-wikipedia-org-1345	65	4	I(x	i(x	UH
en-wikipedia-org-1345	65	5	)	)	-RRB-
en-wikipedia-org-1345	65	6	is	be	VBZ
en-wikipedia-org-1345	65	7	the	the	DT
en-wikipedia-org-1345	65	8	self	self	NN
en-wikipedia-org-1345	65	9	-	-	HYPH
en-wikipedia-org-1345	65	10	information	information	NN
en-wikipedia-org-1345	65	11	,	,	,
en-wikipedia-org-1345	65	12	which	which	WDT
en-wikipedia-org-1345	65	13	is	be	VBZ
en-wikipedia-org-1345	65	14	the	the	DT
en-wikipedia-org-1345	65	15	entropy	entropy	JJ
en-wikipedia-org-1345	65	16	contribution	contribution	NN
en-wikipedia-org-1345	65	17	of	of	IN
en-wikipedia-org-1345	65	18	an	an	DT
en-wikipedia-org-1345	65	19	individual	individual	JJ
en-wikipedia-org-1345	65	20	message	message	NN
en-wikipedia-org-1345	65	21	,	,	,
en-wikipedia-org-1345	65	22	and	and	CC
en-wikipedia-org-1345	65	23	𝔼X	𝔼X	NNP
en-wikipedia-org-1345	65	24	is	be	VBZ
en-wikipedia-org-1345	65	25	the	the	DT
en-wikipedia-org-1345	65	26	expected	expect	VBN
en-wikipedia-org-1345	65	27	value	value	NN
en-wikipedia-org-1345	65	28	.	.	.
en-wikipedia-org-1345	65	29	)	)	-RRB-
en-wikipedia-org-1345	66	1	A	a	DT
en-wikipedia-org-1345	66	2	property	property	NN
en-wikipedia-org-1345	66	3	of	of	IN
en-wikipedia-org-1345	66	4	entropy	entropy	JJ
en-wikipedia-org-1345	66	5	is	be	VBZ
en-wikipedia-org-1345	66	6	that	that	IN
en-wikipedia-org-1345	66	7	it	-PRON-	PRP
en-wikipedia-org-1345	66	8	is	be	VBZ
en-wikipedia-org-1345	66	9	maximized	maximize	VBN
en-wikipedia-org-1345	66	10	when	when	WRB
en-wikipedia-org-1345	66	11	all	all	PDT
en-wikipedia-org-1345	66	12	the	the	DT
en-wikipedia-org-1345	66	13	messages	message	NNS
en-wikipedia-org-1345	66	14	in	in	IN
en-wikipedia-org-1345	66	15	the	the	DT
en-wikipedia-org-1345	66	16	message	message	NN
en-wikipedia-org-1345	66	17	space	space	NN
en-wikipedia-org-1345	66	18	are	be	VBP
en-wikipedia-org-1345	66	19	equiprobable	equiprobable	JJ
en-wikipedia-org-1345	66	20	p(x	p(x	NN
en-wikipedia-org-1345	66	21	)	)	-RRB-
en-wikipedia-org-1345	66	22	=	=	SYM
en-wikipedia-org-1345	66	23	1	1	CD
en-wikipedia-org-1345	66	24	/	/	SYM
en-wikipedia-org-1345	66	25	n	n	CD
en-wikipedia-org-1345	66	26	;	;	:
en-wikipedia-org-1345	66	27	i.e.	i.e.	FW
en-wikipedia-org-1345	66	28	,	,	,
en-wikipedia-org-1345	66	29	most	most	RBS
en-wikipedia-org-1345	66	30	unpredictable	unpredictable	JJ
en-wikipedia-org-1345	66	31	,	,	,
en-wikipedia-org-1345	66	32	in	in	IN
en-wikipedia-org-1345	66	33	which	which	WDT
en-wikipedia-org-1345	66	34	case	case	NN
en-wikipedia-org-1345	66	35	H(X	H(X	NNP
en-wikipedia-org-1345	66	36	)	)	-RRB-
en-wikipedia-org-1345	66	37	=	=	NFP
en-wikipedia-org-1345	66	38	log	log	NNP
en-wikipedia-org-1345	66	39	n.	n.	NNP
en-wikipedia-org-1345	66	40	The	the	DT
en-wikipedia-org-1345	66	41	special	special	JJ
en-wikipedia-org-1345	66	42	case	case	NN
en-wikipedia-org-1345	66	43	of	of	IN
en-wikipedia-org-1345	66	44	information	information	NN
en-wikipedia-org-1345	66	45	entropy	entropy	JJ
en-wikipedia-org-1345	66	46	for	for	IN
en-wikipedia-org-1345	66	47	a	a	DT
en-wikipedia-org-1345	66	48	random	random	JJ
en-wikipedia-org-1345	66	49	variable	variable	NN
en-wikipedia-org-1345	66	50	with	with	IN
en-wikipedia-org-1345	66	51	two	two	CD
en-wikipedia-org-1345	66	52	outcomes	outcome	NNS
en-wikipedia-org-1345	66	53	is	be	VBZ
en-wikipedia-org-1345	66	54	the	the	DT
en-wikipedia-org-1345	66	55	binary	binary	JJ
en-wikipedia-org-1345	66	56	entropy	entropy	JJ
en-wikipedia-org-1345	66	57	function	function	NN
en-wikipedia-org-1345	66	58	,	,	,
en-wikipedia-org-1345	66	59	usually	usually	RB
en-wikipedia-org-1345	66	60	taken	take	VBN
en-wikipedia-org-1345	66	61	to	to	IN
en-wikipedia-org-1345	66	62	the	the	DT
en-wikipedia-org-1345	66	63	logarithmic	logarithmic	JJ
en-wikipedia-org-1345	66	64	base	base	NN
en-wikipedia-org-1345	66	65	2	2	CD
en-wikipedia-org-1345	66	66	,	,	,
en-wikipedia-org-1345	66	67	thus	thus	RB
en-wikipedia-org-1345	66	68	having	have	VBG
en-wikipedia-org-1345	66	69	the	the	DT
en-wikipedia-org-1345	66	70	shannon	shannon	NNP
en-wikipedia-org-1345	66	71	(	(	-LRB-
en-wikipedia-org-1345	66	72	Sh	Sh	NNP
en-wikipedia-org-1345	66	73	)	)	-RRB-
en-wikipedia-org-1345	66	74	as	as	IN
en-wikipedia-org-1345	66	75	unit	unit	NN
en-wikipedia-org-1345	66	76	:	:	:
en-wikipedia-org-1345	66	77	H	H	NNP
en-wikipedia-org-1345	66	78	b	b	NNP
en-wikipedia-org-1345	66	79	(	(	-LRB-
en-wikipedia-org-1345	66	80	p	p	NN
en-wikipedia-org-1345	66	81	)	)	-RRB-
en-wikipedia-org-1345	66	82	=	=	NFP
en-wikipedia-org-1345	66	83	−	−	NNP
en-wikipedia-org-1345	66	84	p	p	NN
en-wikipedia-org-1345	66	85	log	log	NN
en-wikipedia-org-1345	66	86	2	2	CD
en-wikipedia-org-1345	66	87	⁡	⁡	NNP
en-wikipedia-org-1345	66	88	p	p	NNP
en-wikipedia-org-1345	66	89	−	−	NNP
en-wikipedia-org-1345	66	90	(	(	-LRB-
en-wikipedia-org-1345	66	91	1	1	CD
en-wikipedia-org-1345	66	92	−	−	NNP
en-wikipedia-org-1345	66	93	p	p	NN
en-wikipedia-org-1345	66	94	)	)	-RRB-
en-wikipedia-org-1345	66	95	log	log	NN
en-wikipedia-org-1345	66	96	2	2	CD
en-wikipedia-org-1345	66	97	⁡	⁡	CD
en-wikipedia-org-1345	66	98	(	(	-LRB-
en-wikipedia-org-1345	66	99	1	1	CD
en-wikipedia-org-1345	66	100	−	−	NNP
en-wikipedia-org-1345	66	101	p	p	NN
en-wikipedia-org-1345	66	102	)	)	-RRB-
en-wikipedia-org-1345	66	103	.	.	.
en-wikipedia-org-1345	67	1	{	{	-LRB-
en-wikipedia-org-1345	67	2	\displaystyle	\displaystyle	CD
en-wikipedia-org-1345	67	3	H_{\mathrm	h_{\mathrm	NN
en-wikipedia-org-1345	67	4	{	{	-LRB-
en-wikipedia-org-1345	67	5	b	b	NN
en-wikipedia-org-1345	67	6	}	}	-RRB-
en-wikipedia-org-1345	67	7	}	}	-RRB-
en-wikipedia-org-1345	67	8	(	(	-LRB-
en-wikipedia-org-1345	67	9	p)=-p\log	p)=-p\log	NNP
en-wikipedia-org-1345	67	10	_	_	NNP
en-wikipedia-org-1345	67	11	{	{	-LRB-
en-wikipedia-org-1345	67	12	2}p-(1-p)\log	2}p-(1-p)\log	CD
en-wikipedia-org-1345	67	13	_	_	NNP
en-wikipedia-org-1345	67	14	{	{	-LRB-
en-wikipedia-org-1345	67	15	2}(1-p	2}(1-p	CD
en-wikipedia-org-1345	67	16	)	)	-RRB-
en-wikipedia-org-1345	67	17	.	.	.
en-wikipedia-org-1345	67	18	}	}	-RRB-
en-wikipedia-org-1345	68	1	Joint	Joint	NNP
en-wikipedia-org-1345	68	2	entropy[edit	entropy[edit	NFP
en-wikipedia-org-1345	68	3	]	]	-RRB-
en-wikipedia-org-1345	68	4	The	the	DT
en-wikipedia-org-1345	68	5	joint	joint	JJ
en-wikipedia-org-1345	68	6	entropy	entropy	NN
en-wikipedia-org-1345	68	7	of	of	IN
en-wikipedia-org-1345	68	8	two	two	CD
en-wikipedia-org-1345	68	9	discrete	discrete	JJ
en-wikipedia-org-1345	68	10	random	random	JJ
en-wikipedia-org-1345	68	11	variables	variable	NNS
en-wikipedia-org-1345	68	12	X	x	NN
en-wikipedia-org-1345	68	13	and	and	CC
en-wikipedia-org-1345	68	14	Y	Y	NNP
en-wikipedia-org-1345	68	15	is	be	VBZ
en-wikipedia-org-1345	68	16	merely	merely	RB
en-wikipedia-org-1345	68	17	the	the	DT
en-wikipedia-org-1345	68	18	entropy	entropy	NN
en-wikipedia-org-1345	68	19	of	of	IN
en-wikipedia-org-1345	68	20	their	-PRON-	PRP$
en-wikipedia-org-1345	68	21	pairing	pairing	NN
en-wikipedia-org-1345	68	22	:	:	:
en-wikipedia-org-1345	68	23	(	(	-LRB-
en-wikipedia-org-1345	68	24	X	x	NN
en-wikipedia-org-1345	68	25	,	,	,
en-wikipedia-org-1345	68	26	Y	Y	NNP
en-wikipedia-org-1345	68	27	)	)	-RRB-
en-wikipedia-org-1345	68	28	.	.	.
en-wikipedia-org-1345	69	1	This	this	DT
en-wikipedia-org-1345	69	2	implies	imply	VBZ
en-wikipedia-org-1345	69	3	that	that	IN
en-wikipedia-org-1345	69	4	if	if	IN
en-wikipedia-org-1345	69	5	X	X	NNP
en-wikipedia-org-1345	69	6	and	and	CC
en-wikipedia-org-1345	69	7	Y	y	PRP
en-wikipedia-org-1345	69	8	are	be	VBP
en-wikipedia-org-1345	69	9	independent	independent	JJ
en-wikipedia-org-1345	69	10	,	,	,
en-wikipedia-org-1345	69	11	then	then	RB
en-wikipedia-org-1345	69	12	their	-PRON-	PRP$
en-wikipedia-org-1345	69	13	joint	joint	JJ
en-wikipedia-org-1345	69	14	entropy	entropy	NN
en-wikipedia-org-1345	69	15	is	be	VBZ
en-wikipedia-org-1345	69	16	the	the	DT
en-wikipedia-org-1345	69	17	sum	sum	NN
en-wikipedia-org-1345	69	18	of	of	IN
en-wikipedia-org-1345	69	19	their	-PRON-	PRP$
en-wikipedia-org-1345	69	20	individual	individual	JJ
en-wikipedia-org-1345	69	21	entropies	entropy	NNS
en-wikipedia-org-1345	69	22	.	.	.
en-wikipedia-org-1345	70	1	For	for	IN
en-wikipedia-org-1345	70	2	example	example	NN
en-wikipedia-org-1345	70	3	,	,	,
en-wikipedia-org-1345	70	4	if	if	IN
en-wikipedia-org-1345	70	5	(	(	-LRB-
en-wikipedia-org-1345	70	6	X	X	NNP
en-wikipedia-org-1345	70	7	,	,	,
en-wikipedia-org-1345	70	8	Y	y	NN
en-wikipedia-org-1345	70	9	)	)	-RRB-
en-wikipedia-org-1345	70	10	represents	represent	VBZ
en-wikipedia-org-1345	70	11	the	the	DT
en-wikipedia-org-1345	70	12	position	position	NN
en-wikipedia-org-1345	70	13	of	of	IN
en-wikipedia-org-1345	70	14	a	a	DT
en-wikipedia-org-1345	70	15	chess	chess	NN
en-wikipedia-org-1345	70	16	piece	piece	NN
en-wikipedia-org-1345	70	17	—	—	:
en-wikipedia-org-1345	70	18	X	x	VB
en-wikipedia-org-1345	70	19	the	the	DT
en-wikipedia-org-1345	70	20	row	row	NN
en-wikipedia-org-1345	70	21	and	and	CC
en-wikipedia-org-1345	70	22	Y	Y	NNP
en-wikipedia-org-1345	70	23	the	the	DT
en-wikipedia-org-1345	70	24	column	column	NN
en-wikipedia-org-1345	70	25	,	,	,
en-wikipedia-org-1345	70	26	then	then	RB
en-wikipedia-org-1345	70	27	the	the	DT
en-wikipedia-org-1345	70	28	joint	joint	JJ
en-wikipedia-org-1345	70	29	entropy	entropy	NN
en-wikipedia-org-1345	70	30	of	of	IN
en-wikipedia-org-1345	70	31	the	the	DT
en-wikipedia-org-1345	70	32	row	row	NN
en-wikipedia-org-1345	70	33	of	of	IN
en-wikipedia-org-1345	70	34	the	the	DT
en-wikipedia-org-1345	70	35	piece	piece	NN
en-wikipedia-org-1345	70	36	and	and	CC
en-wikipedia-org-1345	70	37	the	the	DT
en-wikipedia-org-1345	70	38	column	column	NN
en-wikipedia-org-1345	70	39	of	of	IN
en-wikipedia-org-1345	70	40	the	the	DT
en-wikipedia-org-1345	70	41	piece	piece	NN
en-wikipedia-org-1345	70	42	will	will	MD
en-wikipedia-org-1345	70	43	be	be	VB
en-wikipedia-org-1345	70	44	the	the	DT
en-wikipedia-org-1345	70	45	entropy	entropy	JJ
en-wikipedia-org-1345	70	46	of	of	IN
en-wikipedia-org-1345	70	47	the	the	DT
en-wikipedia-org-1345	70	48	position	position	NN
en-wikipedia-org-1345	70	49	of	of	IN
en-wikipedia-org-1345	70	50	the	the	DT
en-wikipedia-org-1345	70	51	piece	piece	NN
en-wikipedia-org-1345	70	52	.	.	.
en-wikipedia-org-1345	71	1	H	H	NNP
en-wikipedia-org-1345	71	2	(	(	-LRB-
en-wikipedia-org-1345	71	3	X	X	NNP
en-wikipedia-org-1345	71	4	,	,	,
en-wikipedia-org-1345	71	5	Y	y	NN
en-wikipedia-org-1345	71	6	)	)	-RRB-
en-wikipedia-org-1345	71	7	=	=	NFP
en-wikipedia-org-1345	71	8	E	e	NN
en-wikipedia-org-1345	71	9	X	x	NN
en-wikipedia-org-1345	71	10	,	,	,
en-wikipedia-org-1345	71	11	Y	Y	NNP
en-wikipedia-org-1345	71	12	[	[	-LRB-
en-wikipedia-org-1345	71	13	−	−	NNP
en-wikipedia-org-1345	71	14	log	log	NNP
en-wikipedia-org-1345	71	15	⁡	⁡	VBN
en-wikipedia-org-1345	71	16	p	p	NN
en-wikipedia-org-1345	71	17	(	(	-LRB-
en-wikipedia-org-1345	71	18	x	x	NNP
en-wikipedia-org-1345	71	19	,	,	,
en-wikipedia-org-1345	71	20	y	y	NNP
en-wikipedia-org-1345	71	21	)	)	-RRB-
en-wikipedia-org-1345	71	22	]	]	-RRB-
en-wikipedia-org-1345	71	23	=	=	NFP
en-wikipedia-org-1345	71	24	−	−	NNP
en-wikipedia-org-1345	71	25	∑	∑	.
en-wikipedia-org-1345	71	26	x	x	NNP
en-wikipedia-org-1345	71	27	,	,	,
en-wikipedia-org-1345	71	28	y	y	NNP
en-wikipedia-org-1345	71	29	p	p	NNP
en-wikipedia-org-1345	71	30	(	(	-LRB-
en-wikipedia-org-1345	71	31	x	x	NNP
en-wikipedia-org-1345	71	32	,	,	,
en-wikipedia-org-1345	71	33	y	y	NNP
en-wikipedia-org-1345	71	34	)	)	-RRB-
en-wikipedia-org-1345	71	35	log	log	NNP
en-wikipedia-org-1345	71	36	⁡	⁡	NNP
en-wikipedia-org-1345	71	37	p	p	NNP
en-wikipedia-org-1345	71	38	(	(	-LRB-
en-wikipedia-org-1345	71	39	x	x	NNP
en-wikipedia-org-1345	71	40	,	,	,
en-wikipedia-org-1345	71	41	y	y	NNP
en-wikipedia-org-1345	71	42	)	)	-RRB-
en-wikipedia-org-1345	71	43	{	{	-LRB-
en-wikipedia-org-1345	71	44	\displaystyle	\displaystyle	CD
en-wikipedia-org-1345	71	45	H(X	H(X	NNS
en-wikipedia-org-1345	71	46	,	,	,
en-wikipedia-org-1345	71	47	Y)=\mathbb	Y)=\mathbb	NNP
en-wikipedia-org-1345	71	48	{	{	-LRB-
en-wikipedia-org-1345	71	49	E	E	NNP
en-wikipedia-org-1345	71	50	}	}	-RRB-
en-wikipedia-org-1345	71	51	_	_	NNP
en-wikipedia-org-1345	71	52	{	{	-LRB-
en-wikipedia-org-1345	71	53	X	X	NNP
en-wikipedia-org-1345	71	54	,	,	,
en-wikipedia-org-1345	71	55	Y}[-\log	Y}[-\log	NNP
en-wikipedia-org-1345	71	56	p(x	p(x	NNP
en-wikipedia-org-1345	71	57	,	,	,
en-wikipedia-org-1345	71	58	y)]=-\sum	y)]=-\sum	NNP
en-wikipedia-org-1345	71	59	_	_	NNP
en-wikipedia-org-1345	71	60	{	{	-LRB-
en-wikipedia-org-1345	71	61	x	x	NNP
en-wikipedia-org-1345	71	62	,	,	,
en-wikipedia-org-1345	71	63	y}p(x	y}p(x	NNP
en-wikipedia-org-1345	71	64	,	,	,
en-wikipedia-org-1345	71	65	y)\log	y)\log	CD
en-wikipedia-org-1345	71	66	p(x	p(x	NNP
en-wikipedia-org-1345	71	67	,	,	,
en-wikipedia-org-1345	71	68	y)\	y)\	NNP
en-wikipedia-org-1345	71	69	,	,	,
en-wikipedia-org-1345	71	70	}	}	-RRB-
en-wikipedia-org-1345	71	71	Despite	despite	IN
en-wikipedia-org-1345	71	72	similar	similar	JJ
en-wikipedia-org-1345	71	73	notation	notation	NN
en-wikipedia-org-1345	71	74	,	,	,
en-wikipedia-org-1345	71	75	joint	joint	JJ
en-wikipedia-org-1345	71	76	entropy	entropy	NN
en-wikipedia-org-1345	71	77	should	should	MD
en-wikipedia-org-1345	71	78	not	not	RB
en-wikipedia-org-1345	71	79	be	be	VB
en-wikipedia-org-1345	71	80	confused	confuse	VBN
en-wikipedia-org-1345	71	81	with	with	IN
en-wikipedia-org-1345	71	82	cross	cross	NN
en-wikipedia-org-1345	71	83	entropy	entropy	JJ
en-wikipedia-org-1345	71	84	.	.	.
en-wikipedia-org-1345	72	1	Conditional	conditional	JJ
en-wikipedia-org-1345	72	2	entropy	entropy	JJ
en-wikipedia-org-1345	72	3	(	(	-LRB-
en-wikipedia-org-1345	72	4	equivocation)[edit	equivocation)[edit	NNP
en-wikipedia-org-1345	72	5	]	]	-RRB-
en-wikipedia-org-1345	72	6	The	the	DT
en-wikipedia-org-1345	72	7	conditional	conditional	JJ
en-wikipedia-org-1345	72	8	entropy	entropy	JJ
en-wikipedia-org-1345	72	9	or	or	CC
en-wikipedia-org-1345	72	10	conditional	conditional	JJ
en-wikipedia-org-1345	72	11	uncertainty	uncertainty	NN
en-wikipedia-org-1345	72	12	of	of	IN
en-wikipedia-org-1345	72	13	X	x	NN
en-wikipedia-org-1345	72	14	given	give	VBN
en-wikipedia-org-1345	72	15	random	random	JJ
en-wikipedia-org-1345	72	16	variable	variable	FW
en-wikipedia-org-1345	72	17	Y	Y	NNP
en-wikipedia-org-1345	72	18	(	(	-LRB-
en-wikipedia-org-1345	72	19	also	also	RB
en-wikipedia-org-1345	72	20	called	call	VBN
en-wikipedia-org-1345	72	21	the	the	DT
en-wikipedia-org-1345	72	22	equivocation	equivocation	NN
en-wikipedia-org-1345	72	23	of	of	IN
en-wikipedia-org-1345	72	24	X	X	NNP
en-wikipedia-org-1345	72	25	about	about	IN
en-wikipedia-org-1345	72	26	Y	y	NN
en-wikipedia-org-1345	72	27	)	)	-RRB-
en-wikipedia-org-1345	72	28	is	be	VBZ
en-wikipedia-org-1345	72	29	the	the	DT
en-wikipedia-org-1345	72	30	average	average	JJ
en-wikipedia-org-1345	72	31	conditional	conditional	JJ
en-wikipedia-org-1345	72	32	entropy	entropy	NN
en-wikipedia-org-1345	72	33	over	over	IN
en-wikipedia-org-1345	72	34	Y:[10	Y:[10	NNP
en-wikipedia-org-1345	72	35	]	]	-RRB-
en-wikipedia-org-1345	72	36	H	h	NN
en-wikipedia-org-1345	72	37	(	(	-LRB-
en-wikipedia-org-1345	72	38	X	x	NN
en-wikipedia-org-1345	72	39	|	|	NNP
en-wikipedia-org-1345	72	40	Y	y	NN
en-wikipedia-org-1345	72	41	)	)	-RRB-
en-wikipedia-org-1345	72	42	=	=	NFP
en-wikipedia-org-1345	72	43	E	e	NN
en-wikipedia-org-1345	72	44	Y	y	NN
en-wikipedia-org-1345	72	45	[	[	-LRB-
en-wikipedia-org-1345	72	46	H	h	NN
en-wikipedia-org-1345	72	47	(	(	-LRB-
en-wikipedia-org-1345	72	48	X	X	NNP
en-wikipedia-org-1345	72	49	|	|	NNP
en-wikipedia-org-1345	72	50	y	y	NNP
en-wikipedia-org-1345	72	51	)	)	-RRB-
en-wikipedia-org-1345	72	52	]	]	-RRB-
en-wikipedia-org-1345	72	53	=	=	NFP
en-wikipedia-org-1345	72	54	−	−	NNP
en-wikipedia-org-1345	72	55	∑	∑	.
en-wikipedia-org-1345	72	56	y	y	NNP
en-wikipedia-org-1345	72	57	∈	∈	NNP
en-wikipedia-org-1345	72	58	Y	Y	NNP
en-wikipedia-org-1345	72	59	p	p	NN
en-wikipedia-org-1345	72	60	(	(	-LRB-
en-wikipedia-org-1345	72	61	y	y	NN
en-wikipedia-org-1345	72	62	)	)	-RRB-
en-wikipedia-org-1345	72	63	∑	∑	.
en-wikipedia-org-1345	72	64	x	x	SYM
en-wikipedia-org-1345	72	65	∈	∈	NNP
en-wikipedia-org-1345	72	66	X	x	NN
en-wikipedia-org-1345	72	67	p	p	NN
en-wikipedia-org-1345	72	68	(	(	-LRB-
en-wikipedia-org-1345	72	69	x	x	NNP
en-wikipedia-org-1345	72	70	|	|	NNP
en-wikipedia-org-1345	72	71	y	y	NNP
en-wikipedia-org-1345	72	72	)	)	-RRB-
en-wikipedia-org-1345	72	73	log	log	NNP
en-wikipedia-org-1345	72	74	⁡	⁡	NNP
en-wikipedia-org-1345	72	75	p	p	NNP
en-wikipedia-org-1345	72	76	(	(	-LRB-
en-wikipedia-org-1345	72	77	x	x	NNP
en-wikipedia-org-1345	72	78	|	|	NNP
en-wikipedia-org-1345	72	79	y	y	NNP
en-wikipedia-org-1345	72	80	)	)	-RRB-
en-wikipedia-org-1345	72	81	=	=	NFP
en-wikipedia-org-1345	72	82	−	−	NNP
en-wikipedia-org-1345	72	83	∑	∑	.
en-wikipedia-org-1345	72	84	x	x	NNP
en-wikipedia-org-1345	72	85	,	,	,
en-wikipedia-org-1345	72	86	y	y	NNP
en-wikipedia-org-1345	72	87	p	p	NNP
en-wikipedia-org-1345	72	88	(	(	-LRB-
en-wikipedia-org-1345	72	89	x	x	NNP
en-wikipedia-org-1345	72	90	,	,	,
en-wikipedia-org-1345	72	91	y	y	NNP
en-wikipedia-org-1345	72	92	)	)	-RRB-
en-wikipedia-org-1345	72	93	log	log	NNP
en-wikipedia-org-1345	72	94	⁡	⁡	NNP
en-wikipedia-org-1345	72	95	p	p	NNP
en-wikipedia-org-1345	72	96	(	(	-LRB-
en-wikipedia-org-1345	72	97	x	x	NNP
en-wikipedia-org-1345	72	98	|	|	NNP
en-wikipedia-org-1345	72	99	y	y	NNP
en-wikipedia-org-1345	72	100	)	)	-RRB-
en-wikipedia-org-1345	72	101	.	.	.
en-wikipedia-org-1345	73	1	{	{	-LRB-
en-wikipedia-org-1345	73	2	\displaystyle	\displaystyle	CD
en-wikipedia-org-1345	73	3	H(X|Y)=\mathbb	h(x|y)=\mathbb	NN
en-wikipedia-org-1345	73	4	{	{	-LRB-
en-wikipedia-org-1345	73	5	E	E	NNP
en-wikipedia-org-1345	73	6	}	}	-RRB-
en-wikipedia-org-1345	73	7	_	_	NNP
en-wikipedia-org-1345	73	8	{	{	-LRB-
en-wikipedia-org-1345	73	9	Y}[H(X|y)]=-\sum	Y}[H(X|y)]=-\sum	NNP
en-wikipedia-org-1345	73	10	_	_	NNP
en-wikipedia-org-1345	73	11	{	{	-LRB-
en-wikipedia-org-1345	73	12	y\in	y\in	NNP
en-wikipedia-org-1345	73	13	Y}p(y)\sum	Y}p(y)\sum	NNPS
en-wikipedia-org-1345	73	14	_	_	NNP
en-wikipedia-org-1345	73	15	{	{	-LRB-
en-wikipedia-org-1345	73	16	x\in	x\in	NNP
en-wikipedia-org-1345	73	17	X}p(x|y)\log	X}p(x|y)\log	NNP
en-wikipedia-org-1345	73	18	p(x|y)=-\sum	p(x|y)=-\sum	NNP
en-wikipedia-org-1345	73	19	_	_	NNP
en-wikipedia-org-1345	73	20	{	{	-LRB-
en-wikipedia-org-1345	73	21	x	x	NNP
en-wikipedia-org-1345	73	22	,	,	,
en-wikipedia-org-1345	73	23	y}p(x	y}p(x	NNP
en-wikipedia-org-1345	73	24	,	,	,
en-wikipedia-org-1345	73	25	y)\log	y)\log	CD
en-wikipedia-org-1345	73	26	p(x|y	p(x|y	NNP
en-wikipedia-org-1345	73	27	)	)	-RRB-
en-wikipedia-org-1345	73	28	.	.	.
en-wikipedia-org-1345	73	29	}	}	-RRB-
en-wikipedia-org-1345	74	1	Because	because	IN
en-wikipedia-org-1345	74	2	entropy	entropy	JJ
en-wikipedia-org-1345	74	3	can	can	MD
en-wikipedia-org-1345	74	4	be	be	VB
en-wikipedia-org-1345	74	5	conditioned	condition	VBN
en-wikipedia-org-1345	74	6	on	on	IN
en-wikipedia-org-1345	74	7	a	a	DT
en-wikipedia-org-1345	74	8	random	random	JJ
en-wikipedia-org-1345	74	9	variable	variable	NN
en-wikipedia-org-1345	74	10	or	or	CC
en-wikipedia-org-1345	74	11	on	on	IN
en-wikipedia-org-1345	74	12	that	that	DT
en-wikipedia-org-1345	74	13	random	random	JJ
en-wikipedia-org-1345	74	14	variable	variable	JJ
en-wikipedia-org-1345	74	15	being	be	VBG
en-wikipedia-org-1345	74	16	a	a	DT
en-wikipedia-org-1345	74	17	certain	certain	JJ
en-wikipedia-org-1345	74	18	value	value	NN
en-wikipedia-org-1345	74	19	,	,	,
en-wikipedia-org-1345	74	20	care	care	NN
en-wikipedia-org-1345	74	21	should	should	MD
en-wikipedia-org-1345	74	22	be	be	VB
en-wikipedia-org-1345	74	23	taken	take	VBN
en-wikipedia-org-1345	74	24	not	not	RB
en-wikipedia-org-1345	74	25	to	to	TO
en-wikipedia-org-1345	74	26	confuse	confuse	VB
en-wikipedia-org-1345	74	27	these	these	DT
en-wikipedia-org-1345	74	28	two	two	CD
en-wikipedia-org-1345	74	29	definitions	definition	NNS
en-wikipedia-org-1345	74	30	of	of	IN
en-wikipedia-org-1345	74	31	conditional	conditional	JJ
en-wikipedia-org-1345	74	32	entropy	entropy	NN
en-wikipedia-org-1345	74	33	,	,	,
en-wikipedia-org-1345	74	34	the	the	DT
en-wikipedia-org-1345	74	35	former	former	JJ
en-wikipedia-org-1345	74	36	of	of	IN
en-wikipedia-org-1345	74	37	which	which	WDT
en-wikipedia-org-1345	74	38	is	be	VBZ
en-wikipedia-org-1345	74	39	in	in	IN
en-wikipedia-org-1345	74	40	more	more	RBR
en-wikipedia-org-1345	74	41	common	common	JJ
en-wikipedia-org-1345	74	42	use	use	NN
en-wikipedia-org-1345	74	43	.	.	.
en-wikipedia-org-1345	75	1	A	a	DT
en-wikipedia-org-1345	75	2	basic	basic	JJ
en-wikipedia-org-1345	75	3	property	property	NN
en-wikipedia-org-1345	75	4	of	of	IN
en-wikipedia-org-1345	75	5	this	this	DT
en-wikipedia-org-1345	75	6	form	form	NN
en-wikipedia-org-1345	75	7	of	of	IN
en-wikipedia-org-1345	75	8	conditional	conditional	JJ
en-wikipedia-org-1345	75	9	entropy	entropy	JJ
en-wikipedia-org-1345	75	10	is	be	VBZ
en-wikipedia-org-1345	75	11	that	that	DT
en-wikipedia-org-1345	75	12	:	:	:
en-wikipedia-org-1345	75	13	H	h	NN
en-wikipedia-org-1345	75	14	(	(	-LRB-
en-wikipedia-org-1345	75	15	X	x	NN
en-wikipedia-org-1345	75	16	|	|	NNP
en-wikipedia-org-1345	75	17	Y	y	NN
en-wikipedia-org-1345	75	18	)	)	-RRB-
en-wikipedia-org-1345	75	19	=	=	NFP
en-wikipedia-org-1345	75	20	H	h	NN
en-wikipedia-org-1345	75	21	(	(	-LRB-
en-wikipedia-org-1345	75	22	X	x	NN
en-wikipedia-org-1345	75	23	,	,	,
en-wikipedia-org-1345	75	24	Y	Y	NNP
en-wikipedia-org-1345	75	25	)	)	-RRB-
en-wikipedia-org-1345	75	26	−	−	NNP
en-wikipedia-org-1345	75	27	H	H	NNP
en-wikipedia-org-1345	75	28	(	(	-LRB-
en-wikipedia-org-1345	75	29	Y	Y	NNP
en-wikipedia-org-1345	75	30	)	)	-RRB-
en-wikipedia-org-1345	75	31	.	.	.
en-wikipedia-org-1345	76	1	{	{	-LRB-
en-wikipedia-org-1345	76	2	\displaystyle	\displaystyle	CD
en-wikipedia-org-1345	76	3	H(X|Y)=H(X	H(X|Y)=H(X	NNP
en-wikipedia-org-1345	76	4	,	,	,
en-wikipedia-org-1345	76	5	Y)-H(Y).\	y)-h(y).\	NN
en-wikipedia-org-1345	76	6	,	,	,
en-wikipedia-org-1345	76	7	}	}	-RRB-
en-wikipedia-org-1345	76	8	Mutual	mutual	JJ
en-wikipedia-org-1345	76	9	information	information	NN
en-wikipedia-org-1345	76	10	(	(	-LRB-
en-wikipedia-org-1345	76	11	transinformation)[edit	transinformation)[edit	NNP
en-wikipedia-org-1345	76	12	]	]	-RRB-
en-wikipedia-org-1345	76	13	Mutual	mutual	JJ
en-wikipedia-org-1345	76	14	information	information	NN
en-wikipedia-org-1345	76	15	measures	measure	NNS
en-wikipedia-org-1345	76	16	the	the	DT
en-wikipedia-org-1345	76	17	amount	amount	NN
en-wikipedia-org-1345	76	18	of	of	IN
en-wikipedia-org-1345	76	19	information	information	NN
en-wikipedia-org-1345	76	20	that	that	WDT
en-wikipedia-org-1345	76	21	can	can	MD
en-wikipedia-org-1345	76	22	be	be	VB
en-wikipedia-org-1345	76	23	obtained	obtain	VBN
en-wikipedia-org-1345	76	24	about	about	IN
en-wikipedia-org-1345	76	25	one	one	CD
en-wikipedia-org-1345	76	26	random	random	JJ
en-wikipedia-org-1345	76	27	variable	variable	JJ
en-wikipedia-org-1345	76	28	by	by	IN
en-wikipedia-org-1345	76	29	observing	observe	VBG
en-wikipedia-org-1345	76	30	another	another	DT
en-wikipedia-org-1345	76	31	.	.	.
en-wikipedia-org-1345	77	1	It	-PRON-	PRP
en-wikipedia-org-1345	77	2	is	be	VBZ
en-wikipedia-org-1345	77	3	important	important	JJ
en-wikipedia-org-1345	77	4	in	in	IN
en-wikipedia-org-1345	77	5	communication	communication	NN
en-wikipedia-org-1345	77	6	where	where	WRB
en-wikipedia-org-1345	77	7	it	-PRON-	PRP
en-wikipedia-org-1345	77	8	can	can	MD
en-wikipedia-org-1345	77	9	be	be	VB
en-wikipedia-org-1345	77	10	used	use	VBN
en-wikipedia-org-1345	77	11	to	to	TO
en-wikipedia-org-1345	77	12	maximize	maximize	VB
en-wikipedia-org-1345	77	13	the	the	DT
en-wikipedia-org-1345	77	14	amount	amount	NN
en-wikipedia-org-1345	77	15	of	of	IN
en-wikipedia-org-1345	77	16	information	information	NN
en-wikipedia-org-1345	77	17	shared	share	VBN
en-wikipedia-org-1345	77	18	between	between	IN
en-wikipedia-org-1345	77	19	sent	send	VBN
en-wikipedia-org-1345	77	20	and	and	CC
en-wikipedia-org-1345	77	21	received	receive	VBD
en-wikipedia-org-1345	77	22	signals	signal	NNS
en-wikipedia-org-1345	77	23	.	.	.
en-wikipedia-org-1345	78	1	The	the	DT
en-wikipedia-org-1345	78	2	mutual	mutual	JJ
en-wikipedia-org-1345	78	3	information	information	NN
en-wikipedia-org-1345	78	4	of	of	IN
en-wikipedia-org-1345	78	5	X	x	NN
en-wikipedia-org-1345	78	6	relative	relative	JJ
en-wikipedia-org-1345	78	7	to	to	IN
en-wikipedia-org-1345	78	8	Y	Y	NNP
en-wikipedia-org-1345	78	9	is	be	VBZ
en-wikipedia-org-1345	78	10	given	give	VBN
en-wikipedia-org-1345	78	11	by	by	IN
en-wikipedia-org-1345	78	12	:	:	:
en-wikipedia-org-1345	78	13	I	-PRON-	PRP
en-wikipedia-org-1345	78	14	(	(	-LRB-
en-wikipedia-org-1345	78	15	X	X	NNP
en-wikipedia-org-1345	78	16	;	;	:
en-wikipedia-org-1345	78	17	Y	Y	NNP
en-wikipedia-org-1345	78	18	)	)	-RRB-
en-wikipedia-org-1345	78	19	=	=	NFP
en-wikipedia-org-1345	78	20	E	e	NN
en-wikipedia-org-1345	78	21	X	x	NN
en-wikipedia-org-1345	78	22	,	,	,
en-wikipedia-org-1345	78	23	Y	y	UH
en-wikipedia-org-1345	78	24	[	[	-LRB-
en-wikipedia-org-1345	78	25	S	s	NN
en-wikipedia-org-1345	78	26	I	-PRON-	PRP
en-wikipedia-org-1345	78	27	(	(	-LRB-
en-wikipedia-org-1345	78	28	x	x	NNP
en-wikipedia-org-1345	78	29	,	,	,
en-wikipedia-org-1345	78	30	y	y	NNP
en-wikipedia-org-1345	78	31	)	)	-RRB-
en-wikipedia-org-1345	78	32	]	]	-RRB-
en-wikipedia-org-1345	78	33	=	=	NFP
en-wikipedia-org-1345	78	34	∑	∑	XX
en-wikipedia-org-1345	78	35	x	x	NN
en-wikipedia-org-1345	78	36	,	,	,
en-wikipedia-org-1345	78	37	y	y	NNP
en-wikipedia-org-1345	78	38	p	p	NNP
en-wikipedia-org-1345	78	39	(	(	-LRB-
en-wikipedia-org-1345	78	40	x	x	NNP
en-wikipedia-org-1345	78	41	,	,	,
en-wikipedia-org-1345	78	42	y	y	NNP
en-wikipedia-org-1345	78	43	)	)	-RRB-
en-wikipedia-org-1345	78	44	log	log	NNP
en-wikipedia-org-1345	78	45	⁡	⁡	NNP
en-wikipedia-org-1345	78	46	p	p	NNP
en-wikipedia-org-1345	78	47	(	(	-LRB-
en-wikipedia-org-1345	78	48	x	x	NNP
en-wikipedia-org-1345	78	49	,	,	,
en-wikipedia-org-1345	78	50	y	y	NNP
en-wikipedia-org-1345	78	51	)	)	-RRB-
en-wikipedia-org-1345	78	52	p	p	NNP
en-wikipedia-org-1345	78	53	(	(	-LRB-
en-wikipedia-org-1345	78	54	x	x	NNP
en-wikipedia-org-1345	78	55	)	)	-RRB-
en-wikipedia-org-1345	78	56	p	p	NNP
en-wikipedia-org-1345	78	57	(	(	-LRB-
en-wikipedia-org-1345	78	58	y	y	NN
en-wikipedia-org-1345	78	59	)	)	-RRB-
en-wikipedia-org-1345	78	60	{	{	-LRB-
en-wikipedia-org-1345	78	61	\displaystyle	\displaystyle	CD
en-wikipedia-org-1345	78	62	I(X;Y)=\mathbb	i(x;y)=\mathbb	FW
en-wikipedia-org-1345	78	63	{	{	-LRB-
en-wikipedia-org-1345	78	64	E	e	NN
en-wikipedia-org-1345	78	65	}	}	-RRB-
en-wikipedia-org-1345	78	66	_	_	NNP
en-wikipedia-org-1345	78	67	{	{	-LRB-
en-wikipedia-org-1345	78	68	X	X	NNP
en-wikipedia-org-1345	78	69	,	,	,
en-wikipedia-org-1345	78	70	Y}[SI(x	Y}[SI(x	NNP
en-wikipedia-org-1345	78	71	,	,	,
en-wikipedia-org-1345	78	72	y)]=\sum	y)]=\sum	NNP
en-wikipedia-org-1345	78	73	_	_	NNP
en-wikipedia-org-1345	78	74	{	{	-LRB-
en-wikipedia-org-1345	78	75	x	x	NNP
en-wikipedia-org-1345	78	76	,	,	,
en-wikipedia-org-1345	78	77	y}p(x	y}p(x	NNP
en-wikipedia-org-1345	78	78	,	,	,
en-wikipedia-org-1345	78	79	y)\log	y)\log	NN
en-wikipedia-org-1345	78	80	{	{	-LRB-
en-wikipedia-org-1345	78	81	\frac	\frac	CD
en-wikipedia-org-1345	78	82	{	{	-LRB-
en-wikipedia-org-1345	78	83	p(x	p(x	NNP
en-wikipedia-org-1345	78	84	,	,	,
en-wikipedia-org-1345	78	85	y)}{p(x)\,p(y	y)}{p(x)\,p(y	NNP
en-wikipedia-org-1345	78	86	)	)	-RRB-
en-wikipedia-org-1345	78	87	}	}	-RRB-
en-wikipedia-org-1345	78	88	}	}	-RRB-
en-wikipedia-org-1345	78	89	}	}	-RRB-
en-wikipedia-org-1345	78	90	where	where	WRB
en-wikipedia-org-1345	78	91	SI	SI	NNP
en-wikipedia-org-1345	78	92	(	(	-LRB-
en-wikipedia-org-1345	78	93	Specific	specific	JJ
en-wikipedia-org-1345	78	94	mutual	mutual	JJ
en-wikipedia-org-1345	78	95	Information	information	NN
en-wikipedia-org-1345	78	96	)	)	-RRB-
en-wikipedia-org-1345	78	97	is	be	VBZ
en-wikipedia-org-1345	78	98	the	the	DT
en-wikipedia-org-1345	78	99	pointwise	pointwise	NN
en-wikipedia-org-1345	78	100	mutual	mutual	JJ
en-wikipedia-org-1345	78	101	information	information	NN
en-wikipedia-org-1345	78	102	.	.	.
en-wikipedia-org-1345	79	1	A	a	DT
en-wikipedia-org-1345	79	2	basic	basic	JJ
en-wikipedia-org-1345	79	3	property	property	NN
en-wikipedia-org-1345	79	4	of	of	IN
en-wikipedia-org-1345	79	5	the	the	DT
en-wikipedia-org-1345	79	6	mutual	mutual	JJ
en-wikipedia-org-1345	79	7	information	information	NN
en-wikipedia-org-1345	79	8	is	be	VBZ
en-wikipedia-org-1345	79	9	that	that	IN
en-wikipedia-org-1345	79	10	I	-PRON-	PRP
en-wikipedia-org-1345	79	11	(	(	-LRB-
en-wikipedia-org-1345	79	12	X	X	NNP
en-wikipedia-org-1345	79	13	;	;	:
en-wikipedia-org-1345	79	14	Y	Y	NNP
en-wikipedia-org-1345	79	15	)	)	-RRB-
en-wikipedia-org-1345	79	16	=	=	NFP
en-wikipedia-org-1345	79	17	H	h	NN
en-wikipedia-org-1345	79	18	(	(	-LRB-
en-wikipedia-org-1345	79	19	X	x	NN
en-wikipedia-org-1345	79	20	)	)	-RRB-
en-wikipedia-org-1345	79	21	−	−	NNP
en-wikipedia-org-1345	79	22	H	H	NNP
en-wikipedia-org-1345	79	23	(	(	-LRB-
en-wikipedia-org-1345	79	24	X	x	NN
en-wikipedia-org-1345	79	25	|	|	NNP
en-wikipedia-org-1345	79	26	Y	y	NN
en-wikipedia-org-1345	79	27	)	)	-RRB-
en-wikipedia-org-1345	79	28	.	.	.
en-wikipedia-org-1345	80	1	{	{	-LRB-
en-wikipedia-org-1345	80	2	\displaystyle	\displaystyle	CD
en-wikipedia-org-1345	80	3	I(X;Y)=H(X)-H(X|Y).\	I(X;Y)=H(X)-H(X|Y).\	NNP
en-wikipedia-org-1345	80	4	,	,	,
en-wikipedia-org-1345	80	5	}	}	-RRB-
en-wikipedia-org-1345	80	6	That	that	RB
en-wikipedia-org-1345	80	7	is	is	RB
en-wikipedia-org-1345	80	8	,	,	,
en-wikipedia-org-1345	80	9	knowing	know	VBG
en-wikipedia-org-1345	80	10	Y	Y	NNP
en-wikipedia-org-1345	80	11	,	,	,
en-wikipedia-org-1345	80	12	we	-PRON-	PRP
en-wikipedia-org-1345	80	13	can	can	MD
en-wikipedia-org-1345	80	14	save	save	VB
en-wikipedia-org-1345	80	15	an	an	DT
en-wikipedia-org-1345	80	16	average	average	NN
en-wikipedia-org-1345	80	17	of	of	IN
en-wikipedia-org-1345	80	18	I(X	i(x	JJ
en-wikipedia-org-1345	80	19	;	;	:
en-wikipedia-org-1345	80	20	Y	Y	NNP
en-wikipedia-org-1345	80	21	)	)	-RRB-
en-wikipedia-org-1345	80	22	bits	bit	VBZ
en-wikipedia-org-1345	80	23	in	in	IN
en-wikipedia-org-1345	80	24	encoding	encode	VBG
en-wikipedia-org-1345	80	25	X	x	NN
en-wikipedia-org-1345	80	26	compared	compare	VBN
en-wikipedia-org-1345	80	27	to	to	IN
en-wikipedia-org-1345	80	28	not	not	RB
en-wikipedia-org-1345	80	29	knowing	know	VBG
en-wikipedia-org-1345	80	30	Y.	Y.	NNP
en-wikipedia-org-1345	81	1	Mutual	mutual	JJ
en-wikipedia-org-1345	81	2	information	information	NN
en-wikipedia-org-1345	81	3	is	be	VBZ
en-wikipedia-org-1345	81	4	symmetric	symmetric	JJ
en-wikipedia-org-1345	81	5	:	:	:
en-wikipedia-org-1345	81	6	I	-PRON-	PRP
en-wikipedia-org-1345	81	7	(	(	-LRB-
en-wikipedia-org-1345	81	8	X	X	NNP
en-wikipedia-org-1345	81	9	;	;	:
en-wikipedia-org-1345	81	10	Y	Y	NNP
en-wikipedia-org-1345	81	11	)	)	-RRB-
en-wikipedia-org-1345	81	12	=	=	NFP
en-wikipedia-org-1345	81	13	I	-PRON-	PRP
en-wikipedia-org-1345	81	14	(	(	-LRB-
en-wikipedia-org-1345	81	15	Y	Y	NNP
en-wikipedia-org-1345	81	16	;	;	:
en-wikipedia-org-1345	81	17	X	X	NNP
en-wikipedia-org-1345	81	18	)	)	-RRB-
en-wikipedia-org-1345	81	19	=	=	NFP
en-wikipedia-org-1345	81	20	H	h	NN
en-wikipedia-org-1345	81	21	(	(	-LRB-
en-wikipedia-org-1345	81	22	X	x	NN
en-wikipedia-org-1345	81	23	)	)	-RRB-
en-wikipedia-org-1345	81	24	+	+	NFP
en-wikipedia-org-1345	81	25	H	h	NN
en-wikipedia-org-1345	81	26	(	(	-LRB-
en-wikipedia-org-1345	81	27	Y	y	NN
en-wikipedia-org-1345	81	28	)	)	-RRB-
en-wikipedia-org-1345	81	29	−	−	NNP
en-wikipedia-org-1345	81	30	H	H	NNP
en-wikipedia-org-1345	81	31	(	(	-LRB-
en-wikipedia-org-1345	81	32	X	X	NNP
en-wikipedia-org-1345	81	33	,	,	,
en-wikipedia-org-1345	81	34	Y	Y	NNP
en-wikipedia-org-1345	81	35	)	)	-RRB-
en-wikipedia-org-1345	81	36	.	.	.
en-wikipedia-org-1345	82	1	{	{	-LRB-
en-wikipedia-org-1345	82	2	\displaystyle	\displaystyle	CD
en-wikipedia-org-1345	82	3	I(X;Y)=I(Y;X)=H(X)+H(Y)-H(X	I(X;Y)=I(Y;X)=H(X)+H(Y)-H(X	NNS
en-wikipedia-org-1345	82	4	,	,	,
en-wikipedia-org-1345	82	5	Y).\	y).\	FW
en-wikipedia-org-1345	82	6	,	,	,
en-wikipedia-org-1345	82	7	}	}	-RRB-
en-wikipedia-org-1345	82	8	Mutual	mutual	JJ
en-wikipedia-org-1345	82	9	information	information	NN
en-wikipedia-org-1345	82	10	can	can	MD
en-wikipedia-org-1345	82	11	be	be	VB
en-wikipedia-org-1345	82	12	expressed	express	VBN
en-wikipedia-org-1345	82	13	as	as	IN
en-wikipedia-org-1345	82	14	the	the	DT
en-wikipedia-org-1345	82	15	average	average	JJ
en-wikipedia-org-1345	82	16	Kullback	Kullback	NNP
en-wikipedia-org-1345	82	17	–	–	:
en-wikipedia-org-1345	82	18	Leibler	Leibler	NNP
en-wikipedia-org-1345	82	19	divergence	divergence	NN
en-wikipedia-org-1345	82	20	(	(	-LRB-
en-wikipedia-org-1345	82	21	information	information	NN
en-wikipedia-org-1345	82	22	gain	gain	NN
en-wikipedia-org-1345	82	23	)	)	-RRB-
en-wikipedia-org-1345	82	24	between	between	IN
en-wikipedia-org-1345	82	25	the	the	DT
en-wikipedia-org-1345	82	26	posterior	posterior	JJ
en-wikipedia-org-1345	82	27	probability	probability	NN
en-wikipedia-org-1345	82	28	distribution	distribution	NN
en-wikipedia-org-1345	82	29	of	of	IN
en-wikipedia-org-1345	82	30	X	x	NN
en-wikipedia-org-1345	82	31	given	give	VBD
en-wikipedia-org-1345	82	32	the	the	DT
en-wikipedia-org-1345	82	33	value	value	NN
en-wikipedia-org-1345	82	34	of	of	IN
en-wikipedia-org-1345	82	35	Y	Y	NNP
en-wikipedia-org-1345	82	36	and	and	CC
en-wikipedia-org-1345	82	37	the	the	DT
en-wikipedia-org-1345	82	38	prior	prior	JJ
en-wikipedia-org-1345	82	39	distribution	distribution	NN
en-wikipedia-org-1345	82	40	on	on	IN
en-wikipedia-org-1345	82	41	X	X	NNP
en-wikipedia-org-1345	82	42	:	:	:
en-wikipedia-org-1345	82	43	I	-PRON-	PRP
en-wikipedia-org-1345	82	44	(	(	-LRB-
en-wikipedia-org-1345	82	45	X	X	NNP
en-wikipedia-org-1345	82	46	;	;	:
en-wikipedia-org-1345	82	47	Y	Y	NNP
en-wikipedia-org-1345	82	48	)	)	-RRB-
en-wikipedia-org-1345	82	49	=	=	NFP
en-wikipedia-org-1345	82	50	E	E	NNP
en-wikipedia-org-1345	82	51	p	p	NN
en-wikipedia-org-1345	82	52	(	(	-LRB-
en-wikipedia-org-1345	82	53	y	y	NN
en-wikipedia-org-1345	82	54	)	)	-RRB-
en-wikipedia-org-1345	82	55	[	[	-LRB-
en-wikipedia-org-1345	82	56	D	D	NNP
en-wikipedia-org-1345	82	57	K	k	NN
en-wikipedia-org-1345	82	58	L	l	NN
en-wikipedia-org-1345	82	59	(	(	-LRB-
en-wikipedia-org-1345	82	60	p	p	NNP
en-wikipedia-org-1345	82	61	(	(	-LRB-
en-wikipedia-org-1345	82	62	X	X	NNP
en-wikipedia-org-1345	82	63	|	|	NNP
en-wikipedia-org-1345	82	64	Y	y	NN
en-wikipedia-org-1345	82	65	=	=	SYM
en-wikipedia-org-1345	82	66	y	y	NN
en-wikipedia-org-1345	82	67	)	)	-RRB-
en-wikipedia-org-1345	82	68	‖	‖	CD
en-wikipedia-org-1345	82	69	p	p	NN
en-wikipedia-org-1345	82	70	(	(	-LRB-
en-wikipedia-org-1345	82	71	X	x	NN
en-wikipedia-org-1345	82	72	)	)	-RRB-
en-wikipedia-org-1345	82	73	)	)	-RRB-
en-wikipedia-org-1345	82	74	]	]	-RRB-
en-wikipedia-org-1345	82	75	.	.	.
en-wikipedia-org-1345	83	1	{	{	-LRB-
en-wikipedia-org-1345	83	2	\displaystyle	\displaystyle	CD
en-wikipedia-org-1345	83	3	I(X;Y)=\mathbb	i(x;y)=\mathbb	FW
en-wikipedia-org-1345	83	4	{	{	-LRB-
en-wikipedia-org-1345	83	5	E	e	NN
en-wikipedia-org-1345	83	6	}	}	-RRB-
en-wikipedia-org-1345	83	7	_	_	NNP
en-wikipedia-org-1345	83	8	{	{	-LRB-
en-wikipedia-org-1345	83	9	p(y)}[D_{\mathrm	p(y)}[D_{\mathrm	NNP
en-wikipedia-org-1345	83	10	{	{	-LRB-
en-wikipedia-org-1345	83	11	KL	KL	NNP
en-wikipedia-org-1345	83	12	}	}	-RRB-
en-wikipedia-org-1345	83	13	}	}	-RRB-
en-wikipedia-org-1345	83	14	(	(	-LRB-
en-wikipedia-org-1345	83	15	p(X|Y	p(x|y	NN
en-wikipedia-org-1345	83	16	=	=	SYM
en-wikipedia-org-1345	83	17	y)\|p(X	y)\|p(x	FW
en-wikipedia-org-1345	83	18	)	)	-RRB-
en-wikipedia-org-1345	83	19	)	)	-RRB-
en-wikipedia-org-1345	83	20	]	]	-RRB-
en-wikipedia-org-1345	83	21	.	.	.
en-wikipedia-org-1345	83	22	}	}	-RRB-
en-wikipedia-org-1345	84	1	In	in	IN
en-wikipedia-org-1345	84	2	other	other	JJ
en-wikipedia-org-1345	84	3	words	word	NNS
en-wikipedia-org-1345	84	4	,	,	,
en-wikipedia-org-1345	84	5	this	this	DT
en-wikipedia-org-1345	84	6	is	be	VBZ
en-wikipedia-org-1345	84	7	a	a	DT
en-wikipedia-org-1345	84	8	measure	measure	NN
en-wikipedia-org-1345	84	9	of	of	IN
en-wikipedia-org-1345	84	10	how	how	WRB
en-wikipedia-org-1345	84	11	much	much	JJ
en-wikipedia-org-1345	84	12	,	,	,
en-wikipedia-org-1345	84	13	on	on	IN
en-wikipedia-org-1345	84	14	the	the	DT
en-wikipedia-org-1345	84	15	average	average	NN
en-wikipedia-org-1345	84	16	,	,	,
en-wikipedia-org-1345	84	17	the	the	DT
en-wikipedia-org-1345	84	18	probability	probability	NN
en-wikipedia-org-1345	84	19	distribution	distribution	NN
en-wikipedia-org-1345	84	20	on	on	IN
en-wikipedia-org-1345	84	21	X	X	NNP
en-wikipedia-org-1345	84	22	will	will	MD
en-wikipedia-org-1345	84	23	change	change	VB
en-wikipedia-org-1345	84	24	if	if	IN
en-wikipedia-org-1345	84	25	we	-PRON-	PRP
en-wikipedia-org-1345	84	26	are	be	VBP
en-wikipedia-org-1345	84	27	given	give	VBN
en-wikipedia-org-1345	84	28	the	the	DT
en-wikipedia-org-1345	84	29	value	value	NN
en-wikipedia-org-1345	84	30	of	of	IN
en-wikipedia-org-1345	84	31	Y.	Y.	NNP
en-wikipedia-org-1345	85	1	This	this	DT
en-wikipedia-org-1345	85	2	is	be	VBZ
en-wikipedia-org-1345	85	3	often	often	RB
en-wikipedia-org-1345	85	4	recalculated	recalculate	VBN
en-wikipedia-org-1345	85	5	as	as	IN
en-wikipedia-org-1345	85	6	the	the	DT
en-wikipedia-org-1345	85	7	divergence	divergence	NN
en-wikipedia-org-1345	85	8	from	from	IN
en-wikipedia-org-1345	85	9	the	the	DT
en-wikipedia-org-1345	85	10	product	product	NN
en-wikipedia-org-1345	85	11	of	of	IN
en-wikipedia-org-1345	85	12	the	the	DT
en-wikipedia-org-1345	85	13	marginal	marginal	JJ
en-wikipedia-org-1345	85	14	distributions	distribution	NNS
en-wikipedia-org-1345	85	15	to	to	IN
en-wikipedia-org-1345	85	16	the	the	DT
en-wikipedia-org-1345	85	17	actual	actual	JJ
en-wikipedia-org-1345	85	18	joint	joint	JJ
en-wikipedia-org-1345	85	19	distribution	distribution	NN
en-wikipedia-org-1345	85	20	:	:	:
en-wikipedia-org-1345	85	21	I	-PRON-	PRP
en-wikipedia-org-1345	85	22	(	(	-LRB-
en-wikipedia-org-1345	85	23	X	X	NNP
en-wikipedia-org-1345	85	24	;	;	:
en-wikipedia-org-1345	85	25	Y	Y	NNP
en-wikipedia-org-1345	85	26	)	)	-RRB-
en-wikipedia-org-1345	85	27	=	=	NFP
en-wikipedia-org-1345	85	28	D	D	NNP
en-wikipedia-org-1345	85	29	K	k	NN
en-wikipedia-org-1345	85	30	L	l	NN
en-wikipedia-org-1345	85	31	(	(	-LRB-
en-wikipedia-org-1345	85	32	p	p	NNP
en-wikipedia-org-1345	85	33	(	(	-LRB-
en-wikipedia-org-1345	85	34	X	X	NNP
en-wikipedia-org-1345	85	35	,	,	,
en-wikipedia-org-1345	85	36	Y	y	NN
en-wikipedia-org-1345	85	37	)	)	-RRB-
en-wikipedia-org-1345	85	38	‖	‖	CD
en-wikipedia-org-1345	85	39	p	p	NN
en-wikipedia-org-1345	85	40	(	(	-LRB-
en-wikipedia-org-1345	85	41	X	x	NN
en-wikipedia-org-1345	85	42	)	)	-RRB-
en-wikipedia-org-1345	85	43	p	p	NN
en-wikipedia-org-1345	85	44	(	(	-LRB-
en-wikipedia-org-1345	85	45	Y	y	NN
en-wikipedia-org-1345	85	46	)	)	-RRB-
en-wikipedia-org-1345	85	47	)	)	-RRB-
en-wikipedia-org-1345	85	48	.	.	.
en-wikipedia-org-1345	86	1	{	{	-LRB-
en-wikipedia-org-1345	86	2	\displaystyle	\displaystyle	CD
en-wikipedia-org-1345	86	3	I(X;Y)=D_{\mathrm	I(X;Y)=D_{\mathrm	NNP
en-wikipedia-org-1345	86	4	{	{	-LRB-
en-wikipedia-org-1345	86	5	KL	KL	NNP
en-wikipedia-org-1345	86	6	}	}	-RRB-
en-wikipedia-org-1345	86	7	}	}	-RRB-
en-wikipedia-org-1345	86	8	(	(	-LRB-
en-wikipedia-org-1345	86	9	p(X	p(x	FW
en-wikipedia-org-1345	86	10	,	,	,
en-wikipedia-org-1345	86	11	Y)\|p(X)p(Y	Y)\|p(X)p(Y	NNP
en-wikipedia-org-1345	86	12	)	)	-RRB-
en-wikipedia-org-1345	86	13	)	)	-RRB-
en-wikipedia-org-1345	86	14	.	.	.
en-wikipedia-org-1345	86	15	}	}	-RRB-
en-wikipedia-org-1345	87	1	Mutual	mutual	JJ
en-wikipedia-org-1345	87	2	information	information	NN
en-wikipedia-org-1345	87	3	is	be	VBZ
en-wikipedia-org-1345	87	4	closely	closely	RB
en-wikipedia-org-1345	87	5	related	related	JJ
en-wikipedia-org-1345	87	6	to	to	IN
en-wikipedia-org-1345	87	7	the	the	DT
en-wikipedia-org-1345	87	8	log	log	NN
en-wikipedia-org-1345	87	9	-	-	HYPH
en-wikipedia-org-1345	87	10	likelihood	likelihood	NN
en-wikipedia-org-1345	87	11	ratio	ratio	NN
en-wikipedia-org-1345	87	12	test	test	NN
en-wikipedia-org-1345	87	13	in	in	IN
en-wikipedia-org-1345	87	14	the	the	DT
en-wikipedia-org-1345	87	15	context	context	NN
en-wikipedia-org-1345	87	16	of	of	IN
en-wikipedia-org-1345	87	17	contingency	contingency	NN
en-wikipedia-org-1345	87	18	tables	table	NNS
en-wikipedia-org-1345	87	19	and	and	CC
en-wikipedia-org-1345	87	20	the	the	DT
en-wikipedia-org-1345	87	21	multinomial	multinomial	JJ
en-wikipedia-org-1345	87	22	distribution	distribution	NN
en-wikipedia-org-1345	87	23	and	and	CC
en-wikipedia-org-1345	87	24	to	to	IN
en-wikipedia-org-1345	87	25	Pearson	Pearson	NNP
en-wikipedia-org-1345	87	26	's	's	POS
en-wikipedia-org-1345	87	27	χ2	χ2	NN
en-wikipedia-org-1345	87	28	test	test	NN
en-wikipedia-org-1345	87	29	:	:	:
en-wikipedia-org-1345	87	30	mutual	mutual	JJ
en-wikipedia-org-1345	87	31	information	information	NN
en-wikipedia-org-1345	87	32	can	can	MD
en-wikipedia-org-1345	87	33	be	be	VB
en-wikipedia-org-1345	87	34	considered	consider	VBN
en-wikipedia-org-1345	87	35	a	a	DT
en-wikipedia-org-1345	87	36	statistic	statistic	NN
en-wikipedia-org-1345	87	37	for	for	IN
en-wikipedia-org-1345	87	38	assessing	assess	VBG
en-wikipedia-org-1345	87	39	independence	independence	NN
en-wikipedia-org-1345	87	40	between	between	IN
en-wikipedia-org-1345	87	41	a	a	DT
en-wikipedia-org-1345	87	42	pair	pair	NN
en-wikipedia-org-1345	87	43	of	of	IN
en-wikipedia-org-1345	87	44	variables	variable	NNS
en-wikipedia-org-1345	87	45	,	,	,
en-wikipedia-org-1345	87	46	and	and	CC
en-wikipedia-org-1345	87	47	has	have	VBZ
en-wikipedia-org-1345	87	48	a	a	DT
en-wikipedia-org-1345	87	49	well	well	RB
en-wikipedia-org-1345	87	50	-	-	HYPH
en-wikipedia-org-1345	87	51	specified	specify	VBN
en-wikipedia-org-1345	87	52	asymptotic	asymptotic	JJ
en-wikipedia-org-1345	87	53	distribution	distribution	NN
en-wikipedia-org-1345	87	54	.	.	.
en-wikipedia-org-1345	88	1	Kullback	Kullback	NNP
en-wikipedia-org-1345	88	2	–	–	:
en-wikipedia-org-1345	88	3	Leibler	Leibler	NNP
en-wikipedia-org-1345	88	4	divergence	divergence	NN
en-wikipedia-org-1345	88	5	(	(	-LRB-
en-wikipedia-org-1345	88	6	information	information	NN
en-wikipedia-org-1345	88	7	gain)[edit	gain)[edit	NNP
en-wikipedia-org-1345	88	8	]	]	-RRB-
en-wikipedia-org-1345	88	9	The	the	DT
en-wikipedia-org-1345	88	10	Kullback	Kullback	NNP
en-wikipedia-org-1345	88	11	–	–	:
en-wikipedia-org-1345	88	12	Leibler	Leibler	NNP
en-wikipedia-org-1345	88	13	divergence	divergence	NN
en-wikipedia-org-1345	88	14	(	(	-LRB-
en-wikipedia-org-1345	88	15	or	or	CC
en-wikipedia-org-1345	88	16	information	information	NN
en-wikipedia-org-1345	88	17	divergence	divergence	NN
en-wikipedia-org-1345	88	18	,	,	,
en-wikipedia-org-1345	88	19	information	information	NN
en-wikipedia-org-1345	88	20	gain	gain	NN
en-wikipedia-org-1345	88	21	,	,	,
en-wikipedia-org-1345	88	22	or	or	CC
en-wikipedia-org-1345	88	23	relative	relative	JJ
en-wikipedia-org-1345	88	24	entropy	entropy	RB
en-wikipedia-org-1345	88	25	)	)	-RRB-
en-wikipedia-org-1345	88	26	is	be	VBZ
en-wikipedia-org-1345	88	27	a	a	DT
en-wikipedia-org-1345	88	28	way	way	NN
en-wikipedia-org-1345	88	29	of	of	IN
en-wikipedia-org-1345	88	30	comparing	compare	VBG
en-wikipedia-org-1345	88	31	two	two	CD
en-wikipedia-org-1345	88	32	distributions	distribution	NNS
en-wikipedia-org-1345	88	33	:	:	:
en-wikipedia-org-1345	88	34	a	a	DT
en-wikipedia-org-1345	88	35	"	"	``
en-wikipedia-org-1345	88	36	true	true	JJ
en-wikipedia-org-1345	88	37	"	"	''
en-wikipedia-org-1345	88	38	probability	probability	NN
en-wikipedia-org-1345	88	39	distribution	distribution	NN
en-wikipedia-org-1345	88	40	p(X	p(x	FW
en-wikipedia-org-1345	88	41	)	)	-RRB-
en-wikipedia-org-1345	88	42	,	,	,
en-wikipedia-org-1345	88	43	and	and	CC
en-wikipedia-org-1345	88	44	an	an	DT
en-wikipedia-org-1345	88	45	arbitrary	arbitrary	JJ
en-wikipedia-org-1345	88	46	probability	probability	NN
en-wikipedia-org-1345	88	47	distribution	distribution	NN
en-wikipedia-org-1345	88	48	q(X	q(x	FW
en-wikipedia-org-1345	88	49	)	)	-RRB-
en-wikipedia-org-1345	88	50	.	.	.
en-wikipedia-org-1345	89	1	If	if	IN
en-wikipedia-org-1345	89	2	we	-PRON-	PRP
en-wikipedia-org-1345	89	3	compress	compress	VBP
en-wikipedia-org-1345	89	4	data	datum	NNS
en-wikipedia-org-1345	89	5	in	in	IN
en-wikipedia-org-1345	89	6	a	a	DT
en-wikipedia-org-1345	89	7	manner	manner	NN
en-wikipedia-org-1345	89	8	that	that	WDT
en-wikipedia-org-1345	89	9	assumes	assume	VBZ
en-wikipedia-org-1345	89	10	q(X	q(X	NNP
en-wikipedia-org-1345	89	11	)	)	-RRB-
en-wikipedia-org-1345	89	12	is	be	VBZ
en-wikipedia-org-1345	89	13	the	the	DT
en-wikipedia-org-1345	89	14	distribution	distribution	NN
en-wikipedia-org-1345	89	15	underlying	underlie	VBG
en-wikipedia-org-1345	89	16	some	some	DT
en-wikipedia-org-1345	89	17	data	datum	NNS
en-wikipedia-org-1345	89	18	,	,	,
en-wikipedia-org-1345	89	19	when	when	WRB
en-wikipedia-org-1345	89	20	,	,	,
en-wikipedia-org-1345	89	21	in	in	IN
en-wikipedia-org-1345	89	22	reality	reality	NN
en-wikipedia-org-1345	89	23	,	,	,
en-wikipedia-org-1345	89	24	p(X	p(x	FW
en-wikipedia-org-1345	89	25	)	)	-RRB-
en-wikipedia-org-1345	89	26	is	be	VBZ
en-wikipedia-org-1345	89	27	the	the	DT
en-wikipedia-org-1345	89	28	correct	correct	JJ
en-wikipedia-org-1345	89	29	distribution	distribution	NN
en-wikipedia-org-1345	89	30	,	,	,
en-wikipedia-org-1345	89	31	the	the	DT
en-wikipedia-org-1345	89	32	Kullback	Kullback	NNP
en-wikipedia-org-1345	89	33	–	–	:
en-wikipedia-org-1345	89	34	Leibler	Leibler	NNP
en-wikipedia-org-1345	89	35	divergence	divergence	NN
en-wikipedia-org-1345	89	36	is	be	VBZ
en-wikipedia-org-1345	89	37	the	the	DT
en-wikipedia-org-1345	89	38	number	number	NN
en-wikipedia-org-1345	89	39	of	of	IN
en-wikipedia-org-1345	89	40	average	average	JJ
en-wikipedia-org-1345	89	41	additional	additional	JJ
en-wikipedia-org-1345	89	42	bits	bit	NNS
en-wikipedia-org-1345	89	43	per	per	IN
en-wikipedia-org-1345	89	44	datum	datum	NN
en-wikipedia-org-1345	89	45	necessary	necessary	JJ
en-wikipedia-org-1345	89	46	for	for	IN
en-wikipedia-org-1345	89	47	compression	compression	NN
en-wikipedia-org-1345	89	48	.	.	.
en-wikipedia-org-1345	90	1	It	-PRON-	PRP
en-wikipedia-org-1345	90	2	is	be	VBZ
en-wikipedia-org-1345	90	3	thus	thus	RB
en-wikipedia-org-1345	90	4	defined	define	VBN
en-wikipedia-org-1345	90	5	D	D	NNP
en-wikipedia-org-1345	90	6	K	K	NNP
en-wikipedia-org-1345	90	7	L	L	NNP
en-wikipedia-org-1345	90	8	(	(	-LRB-
en-wikipedia-org-1345	90	9	p	p	NNP
en-wikipedia-org-1345	90	10	(	(	-LRB-
en-wikipedia-org-1345	90	11	X	X	NNP
en-wikipedia-org-1345	90	12	)	)	-RRB-
en-wikipedia-org-1345	90	13	‖	‖	CD
en-wikipedia-org-1345	90	14	q	q	NNP
en-wikipedia-org-1345	90	15	(	(	-LRB-
en-wikipedia-org-1345	90	16	X	X	NNP
en-wikipedia-org-1345	90	17	)	)	-RRB-
en-wikipedia-org-1345	90	18	)	)	-RRB-
en-wikipedia-org-1345	90	19	=	=	NFP
en-wikipedia-org-1345	90	20	∑	∑	.
en-wikipedia-org-1345	90	21	x	x	SYM
en-wikipedia-org-1345	90	22	∈	∈	NNP
en-wikipedia-org-1345	90	23	X	X	NNS
en-wikipedia-org-1345	90	24	−	−	NNP
en-wikipedia-org-1345	90	25	p	p	NN
en-wikipedia-org-1345	90	26	(	(	-LRB-
en-wikipedia-org-1345	90	27	x	x	NNP
en-wikipedia-org-1345	90	28	)	)	-RRB-
en-wikipedia-org-1345	90	29	log	log	NNP
en-wikipedia-org-1345	90	30	⁡	⁡	NNP
en-wikipedia-org-1345	90	31	q	q	NNP
en-wikipedia-org-1345	90	32	(	(	-LRB-
en-wikipedia-org-1345	90	33	x	x	NNP
en-wikipedia-org-1345	90	34	)	)	-RRB-
en-wikipedia-org-1345	90	35	−	−	NNP
en-wikipedia-org-1345	90	36	∑	∑	.
en-wikipedia-org-1345	90	37	x	x	SYM
en-wikipedia-org-1345	90	38	∈	∈	NNP
en-wikipedia-org-1345	90	39	X	X	NNS
en-wikipedia-org-1345	90	40	−	−	NNP
en-wikipedia-org-1345	90	41	p	p	NN
en-wikipedia-org-1345	90	42	(	(	-LRB-
en-wikipedia-org-1345	90	43	x	x	NNP
en-wikipedia-org-1345	90	44	)	)	-RRB-
en-wikipedia-org-1345	90	45	log	log	NNP
en-wikipedia-org-1345	90	46	⁡	⁡	NNP
en-wikipedia-org-1345	90	47	p	p	NN
en-wikipedia-org-1345	90	48	(	(	-LRB-
en-wikipedia-org-1345	90	49	x	x	NN
en-wikipedia-org-1345	90	50	)	)	-RRB-
en-wikipedia-org-1345	90	51	=	=	NFP
en-wikipedia-org-1345	90	52	∑	∑	.
en-wikipedia-org-1345	90	53	x	x	SYM
en-wikipedia-org-1345	90	54	∈	∈	NNP
en-wikipedia-org-1345	90	55	X	x	NN
en-wikipedia-org-1345	90	56	p	p	NN
en-wikipedia-org-1345	90	57	(	(	-LRB-
en-wikipedia-org-1345	90	58	x	x	NN
en-wikipedia-org-1345	90	59	)	)	-RRB-
en-wikipedia-org-1345	90	60	log	log	NNP
en-wikipedia-org-1345	90	61	⁡	⁡	NNP
en-wikipedia-org-1345	90	62	p	p	NNP
en-wikipedia-org-1345	90	63	(	(	-LRB-
en-wikipedia-org-1345	90	64	x	x	NNP
en-wikipedia-org-1345	90	65	)	)	-RRB-
en-wikipedia-org-1345	90	66	q	q	NNP
en-wikipedia-org-1345	90	67	(	(	-LRB-
en-wikipedia-org-1345	90	68	x	x	NNP
en-wikipedia-org-1345	90	69	)	)	-RRB-
en-wikipedia-org-1345	90	70	.	.	.
en-wikipedia-org-1345	91	1	{	{	-LRB-
en-wikipedia-org-1345	91	2	\displaystyle	\displaystyle	CD
en-wikipedia-org-1345	91	3	D_{\mathrm	d_{\mathrm	NN
en-wikipedia-org-1345	91	4	{	{	-LRB-
en-wikipedia-org-1345	91	5	KL	KL	NNP
en-wikipedia-org-1345	91	6	}	}	-RRB-
en-wikipedia-org-1345	91	7	}	}	-RRB-
en-wikipedia-org-1345	91	8	(	(	-LRB-
en-wikipedia-org-1345	91	9	p(X)\|q(X))=\sum	p(X)\|q(X))=\sum	NNP
en-wikipedia-org-1345	91	10	_	_	NNP
en-wikipedia-org-1345	91	11	{	{	-LRB-
en-wikipedia-org-1345	91	12	x\in	x\in	NNP
en-wikipedia-org-1345	91	13	X}-p(x)\log	X}-p(x)\log	NNP
en-wikipedia-org-1345	91	14	{	{	-LRB-
en-wikipedia-org-1345	91	15	q(x)}\,-\,\sum	q(x)}\,-\,\sum	NNP
en-wikipedia-org-1345	91	16	_	_	NNP
en-wikipedia-org-1345	91	17	{	{	-LRB-
en-wikipedia-org-1345	91	18	x\in	x\in	NNP
en-wikipedia-org-1345	91	19	X}-p(x)\log	X}-p(x)\log	NNP
en-wikipedia-org-1345	91	20	{	{	-LRB-
en-wikipedia-org-1345	91	21	p(x)}=\sum	p(x)}=\sum	NNP
en-wikipedia-org-1345	91	22	_	_	NNP
en-wikipedia-org-1345	91	23	{	{	-LRB-
en-wikipedia-org-1345	91	24	x\in	x\in	NNP
en-wikipedia-org-1345	91	25	X}p(x)\log	X}p(x)\log	NNP
en-wikipedia-org-1345	91	26	{	{	-LRB-
en-wikipedia-org-1345	91	27	\frac	\frac	NNP
en-wikipedia-org-1345	91	28	{	{	-LRB-
en-wikipedia-org-1345	91	29	p(x)}{q(x	p(x)}{q(x	NN
en-wikipedia-org-1345	91	30	)	)	-RRB-
en-wikipedia-org-1345	91	31	}	}	-RRB-
en-wikipedia-org-1345	91	32	}	}	-RRB-
en-wikipedia-org-1345	91	33	.	.	.
en-wikipedia-org-1345	91	34	}	}	-RRB-
en-wikipedia-org-1345	92	1	Although	although	IN
en-wikipedia-org-1345	92	2	it	-PRON-	PRP
en-wikipedia-org-1345	92	3	is	be	VBZ
en-wikipedia-org-1345	92	4	sometimes	sometimes	RB
en-wikipedia-org-1345	92	5	used	use	VBN
en-wikipedia-org-1345	92	6	as	as	IN
en-wikipedia-org-1345	92	7	a	a	DT
en-wikipedia-org-1345	92	8	'	'	``
en-wikipedia-org-1345	92	9	distance	distance	NN
en-wikipedia-org-1345	92	10	metric	metric	NN
en-wikipedia-org-1345	92	11	'	'	''
en-wikipedia-org-1345	92	12	,	,	,
en-wikipedia-org-1345	92	13	KL	KL	NNP
en-wikipedia-org-1345	92	14	divergence	divergence	NN
en-wikipedia-org-1345	92	15	is	be	VBZ
en-wikipedia-org-1345	92	16	not	not	RB
en-wikipedia-org-1345	92	17	a	a	DT
en-wikipedia-org-1345	92	18	true	true	JJ
en-wikipedia-org-1345	92	19	metric	metric	JJ
en-wikipedia-org-1345	92	20	since	since	IN
en-wikipedia-org-1345	92	21	it	-PRON-	PRP
en-wikipedia-org-1345	92	22	is	be	VBZ
en-wikipedia-org-1345	92	23	not	not	RB
en-wikipedia-org-1345	92	24	symmetric	symmetric	JJ
en-wikipedia-org-1345	92	25	and	and	CC
en-wikipedia-org-1345	92	26	does	do	VBZ
en-wikipedia-org-1345	92	27	not	not	RB
en-wikipedia-org-1345	92	28	satisfy	satisfy	VB
en-wikipedia-org-1345	92	29	the	the	DT
en-wikipedia-org-1345	92	30	triangle	triangle	NN
en-wikipedia-org-1345	92	31	inequality	inequality	NN
en-wikipedia-org-1345	92	32	(	(	-LRB-
en-wikipedia-org-1345	92	33	making	make	VBG
en-wikipedia-org-1345	92	34	it	-PRON-	PRP
en-wikipedia-org-1345	92	35	a	a	DT
en-wikipedia-org-1345	92	36	semi	semi	JJ
en-wikipedia-org-1345	92	37	-	-	JJ
en-wikipedia-org-1345	92	38	quasimetric	quasimetric	JJ
en-wikipedia-org-1345	92	39	)	)	-RRB-
en-wikipedia-org-1345	92	40	.	.	.
en-wikipedia-org-1345	93	1	Another	another	DT
en-wikipedia-org-1345	93	2	interpretation	interpretation	NN
en-wikipedia-org-1345	93	3	of	of	IN
en-wikipedia-org-1345	93	4	the	the	DT
en-wikipedia-org-1345	93	5	KL	KL	NNP
en-wikipedia-org-1345	93	6	divergence	divergence	NN
en-wikipedia-org-1345	93	7	is	be	VBZ
en-wikipedia-org-1345	93	8	the	the	DT
en-wikipedia-org-1345	93	9	"	"	``
en-wikipedia-org-1345	93	10	unnecessary	unnecessary	JJ
en-wikipedia-org-1345	93	11	surprise	surprise	NN
en-wikipedia-org-1345	93	12	"	"	''
en-wikipedia-org-1345	93	13	introduced	introduce	VBN
en-wikipedia-org-1345	93	14	by	by	IN
en-wikipedia-org-1345	93	15	a	a	DT
en-wikipedia-org-1345	93	16	prior	prior	NN
en-wikipedia-org-1345	93	17	from	from	IN
en-wikipedia-org-1345	93	18	the	the	DT
en-wikipedia-org-1345	93	19	truth	truth	NN
en-wikipedia-org-1345	93	20	:	:	:
en-wikipedia-org-1345	93	21	suppose	suppose	VB
en-wikipedia-org-1345	93	22	a	a	DT
en-wikipedia-org-1345	93	23	number	number	NN
en-wikipedia-org-1345	93	24	X	x	NN
en-wikipedia-org-1345	93	25	is	be	VBZ
en-wikipedia-org-1345	93	26	about	about	JJ
en-wikipedia-org-1345	93	27	to	to	TO
en-wikipedia-org-1345	93	28	be	be	VB
en-wikipedia-org-1345	93	29	drawn	draw	VBN
en-wikipedia-org-1345	93	30	randomly	randomly	RB
en-wikipedia-org-1345	93	31	from	from	IN
en-wikipedia-org-1345	93	32	a	a	DT
en-wikipedia-org-1345	93	33	discrete	discrete	JJ
en-wikipedia-org-1345	93	34	set	set	NN
en-wikipedia-org-1345	93	35	with	with	IN
en-wikipedia-org-1345	93	36	probability	probability	NN
en-wikipedia-org-1345	93	37	distribution	distribution	NN
en-wikipedia-org-1345	93	38	p(x	p(x	NN
en-wikipedia-org-1345	93	39	)	)	-RRB-
en-wikipedia-org-1345	93	40	.	.	.
en-wikipedia-org-1345	94	1	If	if	IN
en-wikipedia-org-1345	94	2	Alice	Alice	NNP
en-wikipedia-org-1345	94	3	knows	know	VBZ
en-wikipedia-org-1345	94	4	the	the	DT
en-wikipedia-org-1345	94	5	true	true	JJ
en-wikipedia-org-1345	94	6	distribution	distribution	NN
en-wikipedia-org-1345	94	7	p(x	p(x	NNP
en-wikipedia-org-1345	94	8	)	)	-RRB-
en-wikipedia-org-1345	94	9	,	,	,
en-wikipedia-org-1345	94	10	while	while	IN
en-wikipedia-org-1345	94	11	Bob	Bob	NNP
en-wikipedia-org-1345	94	12	believes	believe	VBZ
en-wikipedia-org-1345	94	13	(	(	-LRB-
en-wikipedia-org-1345	94	14	has	have	VBZ
en-wikipedia-org-1345	94	15	a	a	DT
en-wikipedia-org-1345	94	16	prior	prior	JJ
en-wikipedia-org-1345	94	17	)	)	-RRB-
en-wikipedia-org-1345	94	18	that	that	IN
en-wikipedia-org-1345	94	19	the	the	DT
en-wikipedia-org-1345	94	20	distribution	distribution	NN
en-wikipedia-org-1345	94	21	is	be	VBZ
en-wikipedia-org-1345	94	22	q(x	q(x	NNP
en-wikipedia-org-1345	94	23	)	)	-RRB-
en-wikipedia-org-1345	94	24	,	,	,
en-wikipedia-org-1345	94	25	then	then	RB
en-wikipedia-org-1345	94	26	Bob	Bob	NNP
en-wikipedia-org-1345	94	27	will	will	MD
en-wikipedia-org-1345	94	28	be	be	VB
en-wikipedia-org-1345	94	29	more	more	RBR
en-wikipedia-org-1345	94	30	surprised	surprised	JJ
en-wikipedia-org-1345	94	31	than	than	IN
en-wikipedia-org-1345	94	32	Alice	Alice	NNP
en-wikipedia-org-1345	94	33	,	,	,
en-wikipedia-org-1345	94	34	on	on	IN
en-wikipedia-org-1345	94	35	average	average	JJ
en-wikipedia-org-1345	94	36	,	,	,
en-wikipedia-org-1345	94	37	upon	upon	IN
en-wikipedia-org-1345	94	38	seeing	see	VBG
en-wikipedia-org-1345	94	39	the	the	DT
en-wikipedia-org-1345	94	40	value	value	NN
en-wikipedia-org-1345	94	41	of	of	IN
en-wikipedia-org-1345	94	42	X.	X.	NNP
en-wikipedia-org-1345	95	1	The	the	DT
en-wikipedia-org-1345	95	2	KL	KL	NNP
en-wikipedia-org-1345	95	3	divergence	divergence	NN
en-wikipedia-org-1345	95	4	is	be	VBZ
en-wikipedia-org-1345	95	5	the	the	DT
en-wikipedia-org-1345	95	6	(	(	-LRB-
en-wikipedia-org-1345	95	7	objective	objective	NN
en-wikipedia-org-1345	95	8	)	)	-RRB-
en-wikipedia-org-1345	95	9	expected	expect	VBN
en-wikipedia-org-1345	95	10	value	value	NN
en-wikipedia-org-1345	95	11	of	of	IN
en-wikipedia-org-1345	95	12	Bob	Bob	NNP
en-wikipedia-org-1345	95	13	's	's	POS
en-wikipedia-org-1345	95	14	(	(	-LRB-
en-wikipedia-org-1345	95	15	subjective	subjective	JJ
en-wikipedia-org-1345	95	16	)	)	-RRB-
en-wikipedia-org-1345	95	17	surprisal	surprisal	NNP
en-wikipedia-org-1345	95	18	minus	minus	CC
en-wikipedia-org-1345	95	19	Alice	Alice	NNP
en-wikipedia-org-1345	95	20	's	's	POS
en-wikipedia-org-1345	95	21	surprisal	surprisal	NN
en-wikipedia-org-1345	95	22	,	,	,
en-wikipedia-org-1345	95	23	measured	measure	VBN
en-wikipedia-org-1345	95	24	in	in	IN
en-wikipedia-org-1345	95	25	bits	bit	NNS
en-wikipedia-org-1345	95	26	if	if	IN
en-wikipedia-org-1345	95	27	the	the	DT
en-wikipedia-org-1345	95	28	log	log	NN
en-wikipedia-org-1345	95	29	is	be	VBZ
en-wikipedia-org-1345	95	30	in	in	IN
en-wikipedia-org-1345	95	31	base	base	NN
en-wikipedia-org-1345	95	32	2	2	CD
en-wikipedia-org-1345	95	33	.	.	.
en-wikipedia-org-1345	96	1	In	in	IN
en-wikipedia-org-1345	96	2	this	this	DT
en-wikipedia-org-1345	96	3	way	way	NN
en-wikipedia-org-1345	96	4	,	,	,
en-wikipedia-org-1345	96	5	the	the	DT
en-wikipedia-org-1345	96	6	extent	extent	NN
en-wikipedia-org-1345	96	7	to	to	TO
en-wikipedia-org-1345	96	8	which	which	WDT
en-wikipedia-org-1345	96	9	Bob	Bob	NNP
en-wikipedia-org-1345	96	10	's	's	POS
en-wikipedia-org-1345	96	11	prior	prior	NN
en-wikipedia-org-1345	96	12	is	be	VBZ
en-wikipedia-org-1345	96	13	"	"	``
en-wikipedia-org-1345	96	14	wrong	wrong	JJ
en-wikipedia-org-1345	96	15	"	"	''
en-wikipedia-org-1345	96	16	can	can	MD
en-wikipedia-org-1345	96	17	be	be	VB
en-wikipedia-org-1345	96	18	quantified	quantify	VBN
en-wikipedia-org-1345	96	19	in	in	IN
en-wikipedia-org-1345	96	20	terms	term	NNS
en-wikipedia-org-1345	96	21	of	of	IN
en-wikipedia-org-1345	96	22	how	how	WRB
en-wikipedia-org-1345	96	23	"	"	``
en-wikipedia-org-1345	96	24	unnecessarily	unnecessarily	RB
en-wikipedia-org-1345	96	25	surprised	surprise	VBD
en-wikipedia-org-1345	96	26	"	"	''
en-wikipedia-org-1345	96	27	it	-PRON-	PRP
en-wikipedia-org-1345	96	28	is	be	VBZ
en-wikipedia-org-1345	96	29	expected	expect	VBN
en-wikipedia-org-1345	96	30	to	to	TO
en-wikipedia-org-1345	96	31	make	make	VB
en-wikipedia-org-1345	96	32	him	-PRON-	PRP
en-wikipedia-org-1345	96	33	.	.	.
en-wikipedia-org-1345	97	1	Other	other	JJ
en-wikipedia-org-1345	97	2	quantities[edit	quantities[edit	CD
en-wikipedia-org-1345	97	3	]	]	-RRB-
en-wikipedia-org-1345	97	4	Other	other	JJ
en-wikipedia-org-1345	97	5	important	important	JJ
en-wikipedia-org-1345	97	6	information	information	NN
en-wikipedia-org-1345	97	7	theoretic	theoretic	JJ
en-wikipedia-org-1345	97	8	quantities	quantity	NNS
en-wikipedia-org-1345	97	9	include	include	VBP
en-wikipedia-org-1345	97	10	Rényi	Rényi	NNP
en-wikipedia-org-1345	97	11	entropy	entropy	JJ
en-wikipedia-org-1345	97	12	(	(	-LRB-
en-wikipedia-org-1345	97	13	a	a	DT
en-wikipedia-org-1345	97	14	generalization	generalization	NN
en-wikipedia-org-1345	97	15	of	of	IN
en-wikipedia-org-1345	97	16	entropy	entropy	JJ
en-wikipedia-org-1345	97	17	)	)	-RRB-
en-wikipedia-org-1345	97	18	,	,	,
en-wikipedia-org-1345	97	19	differential	differential	NN
en-wikipedia-org-1345	97	20	entropy	entropy	JJ
en-wikipedia-org-1345	97	21	(	(	-LRB-
en-wikipedia-org-1345	97	22	a	a	DT
en-wikipedia-org-1345	97	23	generalization	generalization	NN
en-wikipedia-org-1345	97	24	of	of	IN
en-wikipedia-org-1345	97	25	quantities	quantity	NNS
en-wikipedia-org-1345	97	26	of	of	IN
en-wikipedia-org-1345	97	27	information	information	NN
en-wikipedia-org-1345	97	28	to	to	IN
en-wikipedia-org-1345	97	29	continuous	continuous	JJ
en-wikipedia-org-1345	97	30	distributions	distribution	NNS
en-wikipedia-org-1345	97	31	)	)	-RRB-
en-wikipedia-org-1345	97	32	,	,	,
en-wikipedia-org-1345	97	33	and	and	CC
en-wikipedia-org-1345	97	34	the	the	DT
en-wikipedia-org-1345	97	35	conditional	conditional	JJ
en-wikipedia-org-1345	97	36	mutual	mutual	JJ
en-wikipedia-org-1345	97	37	information	information	NN
en-wikipedia-org-1345	97	38	.	.	.
en-wikipedia-org-1345	98	1	Coding	code	VBG
en-wikipedia-org-1345	98	2	theory[edit	theory[edit	CD
en-wikipedia-org-1345	98	3	]	]	-RRB-
en-wikipedia-org-1345	98	4	Main	Main	NNP
en-wikipedia-org-1345	98	5	article	article	NN
en-wikipedia-org-1345	98	6	:	:	:
en-wikipedia-org-1345	98	7	Coding	code	VBG
en-wikipedia-org-1345	98	8	theory	theory	NN
en-wikipedia-org-1345	98	9	A	a	DT
en-wikipedia-org-1345	98	10	picture	picture	NN
en-wikipedia-org-1345	98	11	showing	show	VBG
en-wikipedia-org-1345	98	12	scratches	scratch	NNS
en-wikipedia-org-1345	98	13	on	on	IN
en-wikipedia-org-1345	98	14	the	the	DT
en-wikipedia-org-1345	98	15	readable	readable	JJ
en-wikipedia-org-1345	98	16	surface	surface	NN
en-wikipedia-org-1345	98	17	of	of	IN
en-wikipedia-org-1345	98	18	a	a	DT
en-wikipedia-org-1345	98	19	CD	CD	NNP
en-wikipedia-org-1345	98	20	-	-	HYPH
en-wikipedia-org-1345	98	21	R.	R.	NNP
en-wikipedia-org-1345	98	22	Music	Music	NNP
en-wikipedia-org-1345	98	23	and	and	CC
en-wikipedia-org-1345	98	24	data	datum	NNS
en-wikipedia-org-1345	98	25	CDs	cd	NNS
en-wikipedia-org-1345	98	26	are	be	VBP
en-wikipedia-org-1345	98	27	coded	code	VBN
en-wikipedia-org-1345	98	28	using	use	VBG
en-wikipedia-org-1345	98	29	error	error	NN
en-wikipedia-org-1345	98	30	correcting	correct	VBG
en-wikipedia-org-1345	98	31	codes	code	NNS
en-wikipedia-org-1345	98	32	and	and	CC
en-wikipedia-org-1345	98	33	thus	thus	RB
en-wikipedia-org-1345	98	34	can	can	MD
en-wikipedia-org-1345	98	35	still	still	RB
en-wikipedia-org-1345	98	36	be	be	VB
en-wikipedia-org-1345	98	37	read	read	VBN
en-wikipedia-org-1345	98	38	even	even	RB
en-wikipedia-org-1345	98	39	if	if	IN
en-wikipedia-org-1345	98	40	they	-PRON-	PRP
en-wikipedia-org-1345	98	41	have	have	VBP
en-wikipedia-org-1345	98	42	minor	minor	JJ
en-wikipedia-org-1345	98	43	scratches	scratch	NNS
en-wikipedia-org-1345	98	44	using	use	VBG
en-wikipedia-org-1345	98	45	error	error	NN
en-wikipedia-org-1345	98	46	detection	detection	NN
en-wikipedia-org-1345	98	47	and	and	CC
en-wikipedia-org-1345	98	48	correction	correction	NN
en-wikipedia-org-1345	98	49	.	.	.
en-wikipedia-org-1345	99	1	Coding	code	VBG
en-wikipedia-org-1345	99	2	theory	theory	NN
en-wikipedia-org-1345	99	3	is	be	VBZ
en-wikipedia-org-1345	99	4	one	one	CD
en-wikipedia-org-1345	99	5	of	of	IN
en-wikipedia-org-1345	99	6	the	the	DT
en-wikipedia-org-1345	99	7	most	most	RBS
en-wikipedia-org-1345	99	8	important	important	JJ
en-wikipedia-org-1345	99	9	and	and	CC
en-wikipedia-org-1345	99	10	direct	direct	JJ
en-wikipedia-org-1345	99	11	applications	application	NNS
en-wikipedia-org-1345	99	12	of	of	IN
en-wikipedia-org-1345	99	13	information	information	NN
en-wikipedia-org-1345	99	14	theory	theory	NN
en-wikipedia-org-1345	99	15	.	.	.
en-wikipedia-org-1345	100	1	It	-PRON-	PRP
en-wikipedia-org-1345	100	2	can	can	MD
en-wikipedia-org-1345	100	3	be	be	VB
en-wikipedia-org-1345	100	4	subdivided	subdivide	VBN
en-wikipedia-org-1345	100	5	into	into	IN
en-wikipedia-org-1345	100	6	source	source	NN
en-wikipedia-org-1345	100	7	coding	code	VBG
en-wikipedia-org-1345	100	8	theory	theory	NN
en-wikipedia-org-1345	100	9	and	and	CC
en-wikipedia-org-1345	100	10	channel	channel	NN
en-wikipedia-org-1345	100	11	coding	code	VBG
en-wikipedia-org-1345	100	12	theory	theory	NN
en-wikipedia-org-1345	100	13	.	.	.
en-wikipedia-org-1345	101	1	Using	use	VBG
en-wikipedia-org-1345	101	2	a	a	DT
en-wikipedia-org-1345	101	3	statistical	statistical	JJ
en-wikipedia-org-1345	101	4	description	description	NN
en-wikipedia-org-1345	101	5	for	for	IN
en-wikipedia-org-1345	101	6	data	datum	NNS
en-wikipedia-org-1345	101	7	,	,	,
en-wikipedia-org-1345	101	8	information	information	NN
en-wikipedia-org-1345	101	9	theory	theory	NN
en-wikipedia-org-1345	101	10	quantifies	quantify	VBZ
en-wikipedia-org-1345	101	11	the	the	DT
en-wikipedia-org-1345	101	12	number	number	NN
en-wikipedia-org-1345	101	13	of	of	IN
en-wikipedia-org-1345	101	14	bits	bit	NNS
en-wikipedia-org-1345	101	15	needed	need	VBN
en-wikipedia-org-1345	101	16	to	to	TO
en-wikipedia-org-1345	101	17	describe	describe	VB
en-wikipedia-org-1345	101	18	the	the	DT
en-wikipedia-org-1345	101	19	data	datum	NNS
en-wikipedia-org-1345	101	20	,	,	,
en-wikipedia-org-1345	101	21	which	which	WDT
en-wikipedia-org-1345	101	22	is	be	VBZ
en-wikipedia-org-1345	101	23	the	the	DT
en-wikipedia-org-1345	101	24	information	information	NN
en-wikipedia-org-1345	101	25	entropy	entropy	JJ
en-wikipedia-org-1345	101	26	of	of	IN
en-wikipedia-org-1345	101	27	the	the	DT
en-wikipedia-org-1345	101	28	source	source	NN
en-wikipedia-org-1345	101	29	.	.	.
en-wikipedia-org-1345	102	1	Data	datum	NNS
en-wikipedia-org-1345	102	2	compression	compression	NN
en-wikipedia-org-1345	102	3	(	(	-LRB-
en-wikipedia-org-1345	102	4	source	source	NN
en-wikipedia-org-1345	102	5	coding	code	VBG
en-wikipedia-org-1345	102	6	)	)	-RRB-
en-wikipedia-org-1345	102	7	:	:	:
en-wikipedia-org-1345	102	8	There	there	EX
en-wikipedia-org-1345	102	9	are	be	VBP
en-wikipedia-org-1345	102	10	two	two	CD
en-wikipedia-org-1345	102	11	formulations	formulation	NNS
en-wikipedia-org-1345	102	12	for	for	IN
en-wikipedia-org-1345	102	13	the	the	DT
en-wikipedia-org-1345	102	14	compression	compression	NN
en-wikipedia-org-1345	102	15	problem	problem	NN
en-wikipedia-org-1345	102	16	:	:	:
en-wikipedia-org-1345	102	17	lossless	lossless	NNP
en-wikipedia-org-1345	102	18	data	data	NNP
en-wikipedia-org-1345	102	19	compression	compression	NN
en-wikipedia-org-1345	102	20	:	:	:
en-wikipedia-org-1345	102	21	the	the	DT
en-wikipedia-org-1345	102	22	data	datum	NNS
en-wikipedia-org-1345	102	23	must	must	MD
en-wikipedia-org-1345	102	24	be	be	VB
en-wikipedia-org-1345	102	25	reconstructed	reconstruct	VBN
en-wikipedia-org-1345	102	26	exactly	exactly	RB
en-wikipedia-org-1345	102	27	;	;	:
en-wikipedia-org-1345	102	28	lossy	lossy	JJ
en-wikipedia-org-1345	102	29	data	data	NN
en-wikipedia-org-1345	102	30	compression	compression	NN
en-wikipedia-org-1345	102	31	:	:	:
en-wikipedia-org-1345	102	32	allocates	allocate	NNS
en-wikipedia-org-1345	102	33	bits	bit	NNS
en-wikipedia-org-1345	102	34	needed	need	VBN
en-wikipedia-org-1345	102	35	to	to	TO
en-wikipedia-org-1345	102	36	reconstruct	reconstruct	VB
en-wikipedia-org-1345	102	37	the	the	DT
en-wikipedia-org-1345	102	38	data	datum	NNS
en-wikipedia-org-1345	102	39	,	,	,
en-wikipedia-org-1345	102	40	within	within	IN
en-wikipedia-org-1345	102	41	a	a	DT
en-wikipedia-org-1345	102	42	specified	specified	JJ
en-wikipedia-org-1345	102	43	fidelity	fidelity	NN
en-wikipedia-org-1345	102	44	level	level	NN
en-wikipedia-org-1345	102	45	measured	measure	VBN
en-wikipedia-org-1345	102	46	by	by	IN
en-wikipedia-org-1345	102	47	a	a	DT
en-wikipedia-org-1345	102	48	distortion	distortion	NN
en-wikipedia-org-1345	102	49	function	function	NN
en-wikipedia-org-1345	102	50	.	.	.
en-wikipedia-org-1345	103	1	This	this	DT
en-wikipedia-org-1345	103	2	subset	subset	NN
en-wikipedia-org-1345	103	3	of	of	IN
en-wikipedia-org-1345	103	4	information	information	NN
en-wikipedia-org-1345	103	5	theory	theory	NN
en-wikipedia-org-1345	103	6	is	be	VBZ
en-wikipedia-org-1345	103	7	called	call	VBN
en-wikipedia-org-1345	103	8	rate	rate	NN
en-wikipedia-org-1345	103	9	–	–	:
en-wikipedia-org-1345	103	10	distortion	distortion	NN
en-wikipedia-org-1345	103	11	theory	theory	NN
en-wikipedia-org-1345	103	12	.	.	.
en-wikipedia-org-1345	104	1	Error	error	NN
en-wikipedia-org-1345	104	2	-	-	HYPH
en-wikipedia-org-1345	104	3	correcting	correct	VBG
en-wikipedia-org-1345	104	4	codes	code	NNS
en-wikipedia-org-1345	104	5	(	(	-LRB-
en-wikipedia-org-1345	104	6	channel	channel	NNP
en-wikipedia-org-1345	104	7	coding	code	VBG
en-wikipedia-org-1345	104	8	)	)	-RRB-
en-wikipedia-org-1345	104	9	:	:	:
en-wikipedia-org-1345	104	10	While	while	IN
en-wikipedia-org-1345	104	11	data	datum	NNS
en-wikipedia-org-1345	104	12	compression	compression	NN
en-wikipedia-org-1345	104	13	removes	remove	VBZ
en-wikipedia-org-1345	104	14	as	as	RB
en-wikipedia-org-1345	104	15	much	much	JJ
en-wikipedia-org-1345	104	16	redundancy	redundancy	NN
en-wikipedia-org-1345	104	17	as	as	IN
en-wikipedia-org-1345	104	18	possible	possible	JJ
en-wikipedia-org-1345	104	19	,	,	,
en-wikipedia-org-1345	104	20	an	an	DT
en-wikipedia-org-1345	104	21	error	error	NN
en-wikipedia-org-1345	104	22	-	-	HYPH
en-wikipedia-org-1345	104	23	correcting	correct	VBG
en-wikipedia-org-1345	104	24	code	code	NN
en-wikipedia-org-1345	104	25	adds	add	VBZ
en-wikipedia-org-1345	104	26	just	just	RB
en-wikipedia-org-1345	104	27	the	the	DT
en-wikipedia-org-1345	104	28	right	right	JJ
en-wikipedia-org-1345	104	29	kind	kind	NN
en-wikipedia-org-1345	104	30	of	of	IN
en-wikipedia-org-1345	104	31	redundancy	redundancy	NN
en-wikipedia-org-1345	104	32	(	(	-LRB-
en-wikipedia-org-1345	104	33	i.e.	i.e.	FW
en-wikipedia-org-1345	104	34	,	,	,
en-wikipedia-org-1345	104	35	error	error	NN
en-wikipedia-org-1345	104	36	correction	correction	NN
en-wikipedia-org-1345	104	37	)	)	-RRB-
en-wikipedia-org-1345	104	38	needed	need	VBN
en-wikipedia-org-1345	104	39	to	to	TO
en-wikipedia-org-1345	104	40	transmit	transmit	VB
en-wikipedia-org-1345	104	41	the	the	DT
en-wikipedia-org-1345	104	42	data	datum	NNS
en-wikipedia-org-1345	104	43	efficiently	efficiently	RB
en-wikipedia-org-1345	104	44	and	and	CC
en-wikipedia-org-1345	104	45	faithfully	faithfully	RB
en-wikipedia-org-1345	104	46	across	across	IN
en-wikipedia-org-1345	104	47	a	a	DT
en-wikipedia-org-1345	104	48	noisy	noisy	JJ
en-wikipedia-org-1345	104	49	channel	channel	NN
en-wikipedia-org-1345	104	50	.	.	.
en-wikipedia-org-1345	105	1	This	this	DT
en-wikipedia-org-1345	105	2	division	division	NN
en-wikipedia-org-1345	105	3	of	of	IN
en-wikipedia-org-1345	105	4	coding	code	VBG
en-wikipedia-org-1345	105	5	theory	theory	NN
en-wikipedia-org-1345	105	6	into	into	IN
en-wikipedia-org-1345	105	7	compression	compression	NN
en-wikipedia-org-1345	105	8	and	and	CC
en-wikipedia-org-1345	105	9	transmission	transmission	NN
en-wikipedia-org-1345	105	10	is	be	VBZ
en-wikipedia-org-1345	105	11	justified	justify	VBN
en-wikipedia-org-1345	105	12	by	by	IN
en-wikipedia-org-1345	105	13	the	the	DT
en-wikipedia-org-1345	105	14	information	information	NN
en-wikipedia-org-1345	105	15	transmission	transmission	NN
en-wikipedia-org-1345	105	16	theorems	theorem	NNS
en-wikipedia-org-1345	105	17	,	,	,
en-wikipedia-org-1345	105	18	or	or	CC
en-wikipedia-org-1345	105	19	source	source	NN
en-wikipedia-org-1345	105	20	–	–	:
en-wikipedia-org-1345	105	21	channel	channel	NNP
en-wikipedia-org-1345	105	22	separation	separation	NN
en-wikipedia-org-1345	105	23	theorems	theorem	NNS
en-wikipedia-org-1345	105	24	that	that	WDT
en-wikipedia-org-1345	105	25	justify	justify	VBP
en-wikipedia-org-1345	105	26	the	the	DT
en-wikipedia-org-1345	105	27	use	use	NN
en-wikipedia-org-1345	105	28	of	of	IN
en-wikipedia-org-1345	105	29	bits	bit	NNS
en-wikipedia-org-1345	105	30	as	as	IN
en-wikipedia-org-1345	105	31	the	the	DT
en-wikipedia-org-1345	105	32	universal	universal	JJ
en-wikipedia-org-1345	105	33	currency	currency	NN
en-wikipedia-org-1345	105	34	for	for	IN
en-wikipedia-org-1345	105	35	information	information	NN
en-wikipedia-org-1345	105	36	in	in	IN
en-wikipedia-org-1345	105	37	many	many	JJ
en-wikipedia-org-1345	105	38	contexts	contexts	NN
en-wikipedia-org-1345	105	39	.	.	.
en-wikipedia-org-1345	106	1	However	however	RB
en-wikipedia-org-1345	106	2	,	,	,
en-wikipedia-org-1345	106	3	these	these	DT
en-wikipedia-org-1345	106	4	theorems	theorem	NNS
en-wikipedia-org-1345	106	5	only	only	RB
en-wikipedia-org-1345	106	6	hold	hold	VBP
en-wikipedia-org-1345	106	7	in	in	IN
en-wikipedia-org-1345	106	8	the	the	DT
en-wikipedia-org-1345	106	9	situation	situation	NN
en-wikipedia-org-1345	106	10	where	where	WRB
en-wikipedia-org-1345	106	11	one	one	CD
en-wikipedia-org-1345	106	12	transmitting	transmit	VBG
en-wikipedia-org-1345	106	13	user	user	NN
en-wikipedia-org-1345	106	14	wishes	wish	VBZ
en-wikipedia-org-1345	106	15	to	to	TO
en-wikipedia-org-1345	106	16	communicate	communicate	VB
en-wikipedia-org-1345	106	17	to	to	IN
en-wikipedia-org-1345	106	18	one	one	CD
en-wikipedia-org-1345	106	19	receiving	receiving	NN
en-wikipedia-org-1345	106	20	user	user	NN
en-wikipedia-org-1345	106	21	.	.	.
en-wikipedia-org-1345	107	1	In	in	IN
en-wikipedia-org-1345	107	2	scenarios	scenario	NNS
en-wikipedia-org-1345	107	3	with	with	IN
en-wikipedia-org-1345	107	4	more	more	JJR
en-wikipedia-org-1345	107	5	than	than	IN
en-wikipedia-org-1345	107	6	one	one	CD
en-wikipedia-org-1345	107	7	transmitter	transmitter	NN
en-wikipedia-org-1345	107	8	(	(	-LRB-
en-wikipedia-org-1345	107	9	the	the	DT
en-wikipedia-org-1345	107	10	multiple	multiple	JJ
en-wikipedia-org-1345	107	11	-	-	HYPH
en-wikipedia-org-1345	107	12	access	access	NN
en-wikipedia-org-1345	107	13	channel	channel	NN
en-wikipedia-org-1345	107	14	)	)	-RRB-
en-wikipedia-org-1345	107	15	,	,	,
en-wikipedia-org-1345	107	16	more	more	JJR
en-wikipedia-org-1345	107	17	than	than	IN
en-wikipedia-org-1345	107	18	one	one	CD
en-wikipedia-org-1345	107	19	receiver	receiver	NN
en-wikipedia-org-1345	107	20	(	(	-LRB-
en-wikipedia-org-1345	107	21	the	the	DT
en-wikipedia-org-1345	107	22	broadcast	broadcast	NN
en-wikipedia-org-1345	107	23	channel	channel	NN
en-wikipedia-org-1345	107	24	)	)	-RRB-
en-wikipedia-org-1345	107	25	or	or	CC
en-wikipedia-org-1345	107	26	intermediary	intermediary	JJ
en-wikipedia-org-1345	107	27	"	"	``
en-wikipedia-org-1345	107	28	helpers	helper	NNS
en-wikipedia-org-1345	107	29	"	"	''
en-wikipedia-org-1345	107	30	(	(	-LRB-
en-wikipedia-org-1345	107	31	the	the	DT
en-wikipedia-org-1345	107	32	relay	relay	NN
en-wikipedia-org-1345	107	33	channel	channel	NN
en-wikipedia-org-1345	107	34	)	)	-RRB-
en-wikipedia-org-1345	107	35	,	,	,
en-wikipedia-org-1345	107	36	or	or	CC
en-wikipedia-org-1345	107	37	more	more	JJR
en-wikipedia-org-1345	107	38	general	general	JJ
en-wikipedia-org-1345	107	39	networks	network	NNS
en-wikipedia-org-1345	107	40	,	,	,
en-wikipedia-org-1345	107	41	compression	compression	NN
en-wikipedia-org-1345	107	42	followed	follow	VBN
en-wikipedia-org-1345	107	43	by	by	IN
en-wikipedia-org-1345	107	44	transmission	transmission	NN
en-wikipedia-org-1345	107	45	may	may	MD
en-wikipedia-org-1345	107	46	no	no	RB
en-wikipedia-org-1345	107	47	longer	longer	RB
en-wikipedia-org-1345	107	48	be	be	VB
en-wikipedia-org-1345	107	49	optimal	optimal	JJ
en-wikipedia-org-1345	107	50	.	.	.
en-wikipedia-org-1345	108	1	Network	network	NN
en-wikipedia-org-1345	108	2	information	information	NN
en-wikipedia-org-1345	108	3	theory	theory	NN
en-wikipedia-org-1345	108	4	refers	refer	VBZ
en-wikipedia-org-1345	108	5	to	to	IN
en-wikipedia-org-1345	108	6	these	these	DT
en-wikipedia-org-1345	108	7	multi	multi	JJ
en-wikipedia-org-1345	108	8	-	-	JJ
en-wikipedia-org-1345	108	9	agent	agent	JJ
en-wikipedia-org-1345	108	10	communication	communication	NN
en-wikipedia-org-1345	108	11	models	model	NNS
en-wikipedia-org-1345	108	12	.	.	.
en-wikipedia-org-1345	109	1	Source	source	NN
en-wikipedia-org-1345	109	2	theory[edit	theory[edit	CD
en-wikipedia-org-1345	109	3	]	]	-RRB-
en-wikipedia-org-1345	109	4	Any	any	DT
en-wikipedia-org-1345	109	5	process	process	NN
en-wikipedia-org-1345	109	6	that	that	WDT
en-wikipedia-org-1345	109	7	generates	generate	VBZ
en-wikipedia-org-1345	109	8	successive	successive	JJ
en-wikipedia-org-1345	109	9	messages	message	NNS
en-wikipedia-org-1345	109	10	can	can	MD
en-wikipedia-org-1345	109	11	be	be	VB
en-wikipedia-org-1345	109	12	considered	consider	VBN
en-wikipedia-org-1345	109	13	a	a	DT
en-wikipedia-org-1345	109	14	source	source	NN
en-wikipedia-org-1345	109	15	of	of	IN
en-wikipedia-org-1345	109	16	information	information	NN
en-wikipedia-org-1345	109	17	.	.	.
en-wikipedia-org-1345	110	1	A	a	DT
en-wikipedia-org-1345	110	2	memoryless	memoryless	JJ
en-wikipedia-org-1345	110	3	source	source	NN
en-wikipedia-org-1345	110	4	is	be	VBZ
en-wikipedia-org-1345	110	5	one	one	CD
en-wikipedia-org-1345	110	6	in	in	IN
en-wikipedia-org-1345	110	7	which	which	WDT
en-wikipedia-org-1345	110	8	each	each	DT
en-wikipedia-org-1345	110	9	message	message	NN
en-wikipedia-org-1345	110	10	is	be	VBZ
en-wikipedia-org-1345	110	11	an	an	DT
en-wikipedia-org-1345	110	12	independent	independent	JJ
en-wikipedia-org-1345	110	13	identically	identically	RB
en-wikipedia-org-1345	110	14	distributed	distribute	VBN
en-wikipedia-org-1345	110	15	random	random	JJ
en-wikipedia-org-1345	110	16	variable	variable	NN
en-wikipedia-org-1345	110	17	,	,	,
en-wikipedia-org-1345	110	18	whereas	whereas	IN
en-wikipedia-org-1345	110	19	the	the	DT
en-wikipedia-org-1345	110	20	properties	property	NNS
en-wikipedia-org-1345	110	21	of	of	IN
en-wikipedia-org-1345	110	22	ergodicity	ergodicity	NN
en-wikipedia-org-1345	110	23	and	and	CC
en-wikipedia-org-1345	110	24	stationarity	stationarity	NN
en-wikipedia-org-1345	110	25	impose	impose	VBP
en-wikipedia-org-1345	110	26	less	less	RBR
en-wikipedia-org-1345	110	27	restrictive	restrictive	JJ
en-wikipedia-org-1345	110	28	constraints	constraint	NNS
en-wikipedia-org-1345	110	29	.	.	.
en-wikipedia-org-1345	111	1	All	all	DT
en-wikipedia-org-1345	111	2	such	such	JJ
en-wikipedia-org-1345	111	3	sources	source	NNS
en-wikipedia-org-1345	111	4	are	be	VBP
en-wikipedia-org-1345	111	5	stochastic	stochastic	JJ
en-wikipedia-org-1345	111	6	.	.	.
en-wikipedia-org-1345	112	1	These	these	DT
en-wikipedia-org-1345	112	2	terms	term	NNS
en-wikipedia-org-1345	112	3	are	be	VBP
en-wikipedia-org-1345	112	4	well	well	RB
en-wikipedia-org-1345	112	5	studied	studied	JJ
en-wikipedia-org-1345	112	6	in	in	IN
en-wikipedia-org-1345	112	7	their	-PRON-	PRP$
en-wikipedia-org-1345	112	8	own	own	JJ
en-wikipedia-org-1345	112	9	right	right	JJ
en-wikipedia-org-1345	112	10	outside	outside	JJ
en-wikipedia-org-1345	112	11	information	information	NN
en-wikipedia-org-1345	112	12	theory	theory	NN
en-wikipedia-org-1345	112	13	.	.	.
en-wikipedia-org-1345	113	1	Rate[edit	rate[edit	VB
en-wikipedia-org-1345	113	2	]	]	-RRB-
en-wikipedia-org-1345	113	3	Information	information	NN
en-wikipedia-org-1345	113	4	rate	rate	NN
en-wikipedia-org-1345	113	5	is	be	VBZ
en-wikipedia-org-1345	113	6	the	the	DT
en-wikipedia-org-1345	113	7	average	average	JJ
en-wikipedia-org-1345	113	8	entropy	entropy	JJ
en-wikipedia-org-1345	113	9	per	per	IN
en-wikipedia-org-1345	113	10	symbol	symbol	NN
en-wikipedia-org-1345	113	11	.	.	.
en-wikipedia-org-1345	114	1	For	for	IN
en-wikipedia-org-1345	114	2	memoryless	memoryless	JJ
en-wikipedia-org-1345	114	3	sources	source	NNS
en-wikipedia-org-1345	114	4	,	,	,
en-wikipedia-org-1345	114	5	this	this	DT
en-wikipedia-org-1345	114	6	is	be	VBZ
en-wikipedia-org-1345	114	7	merely	merely	RB
en-wikipedia-org-1345	114	8	the	the	DT
en-wikipedia-org-1345	114	9	entropy	entropy	NN
en-wikipedia-org-1345	114	10	of	of	IN
en-wikipedia-org-1345	114	11	each	each	DT
en-wikipedia-org-1345	114	12	symbol	symbol	NN
en-wikipedia-org-1345	114	13	,	,	,
en-wikipedia-org-1345	114	14	while	while	IN
en-wikipedia-org-1345	114	15	,	,	,
en-wikipedia-org-1345	114	16	in	in	IN
en-wikipedia-org-1345	114	17	the	the	DT
en-wikipedia-org-1345	114	18	case	case	NN
en-wikipedia-org-1345	114	19	of	of	IN
en-wikipedia-org-1345	114	20	a	a	DT
en-wikipedia-org-1345	114	21	stationary	stationary	JJ
en-wikipedia-org-1345	114	22	stochastic	stochastic	JJ
en-wikipedia-org-1345	114	23	process	process	NN
en-wikipedia-org-1345	114	24	,	,	,
en-wikipedia-org-1345	114	25	it	-PRON-	PRP
en-wikipedia-org-1345	114	26	is	be	VBZ
en-wikipedia-org-1345	114	27	r	r	NN
en-wikipedia-org-1345	114	28	=	=	SYM
en-wikipedia-org-1345	114	29	lim	lim	NNP
en-wikipedia-org-1345	114	30	n	n	NNP
en-wikipedia-org-1345	114	31	→	→	SYM
en-wikipedia-org-1345	114	32	∞	∞	NN
en-wikipedia-org-1345	114	33	H	h	NN
en-wikipedia-org-1345	114	34	(	(	-LRB-
en-wikipedia-org-1345	114	35	X	X	NNP
en-wikipedia-org-1345	114	36	n	n	NN
en-wikipedia-org-1345	114	37	|	|	NNP
en-wikipedia-org-1345	114	38	X	X	NNP
en-wikipedia-org-1345	114	39	n	n	NN
en-wikipedia-org-1345	114	40	−	−	NNP
en-wikipedia-org-1345	114	41	1	1	CD
en-wikipedia-org-1345	114	42	,	,	,
en-wikipedia-org-1345	114	43	X	X	NNP
en-wikipedia-org-1345	114	44	n	n	NN
en-wikipedia-org-1345	114	45	−	−	NNP
en-wikipedia-org-1345	114	46	2	2	CD
en-wikipedia-org-1345	114	47	,	,	,
en-wikipedia-org-1345	114	48	X	X	NNP
en-wikipedia-org-1345	114	49	n	n	NN
en-wikipedia-org-1345	114	50	−	−	NNP
en-wikipedia-org-1345	114	51	3	3	CD
en-wikipedia-org-1345	114	52	,	,	,
en-wikipedia-org-1345	114	53	…	…	NFP
en-wikipedia-org-1345	114	54	)	)	-RRB-
en-wikipedia-org-1345	114	55	;	;	:
en-wikipedia-org-1345	114	56	{	{	-LRB-
en-wikipedia-org-1345	114	57	\displaystyle	\displaystyle	NN
en-wikipedia-org-1345	114	58	r=\lim	r=\lim	NNPS
en-wikipedia-org-1345	114	59	_	_	NNP
en-wikipedia-org-1345	114	60	{	{	-LRB-
en-wikipedia-org-1345	114	61	n\to	n\to	NNP
en-wikipedia-org-1345	114	62	\infty	\infty	CD
en-wikipedia-org-1345	114	63	}	}	-RRB-
en-wikipedia-org-1345	114	64	H(X_{n}|X_{n-1},X_{n-2},X_{n-3},\ldots	h(x_{n}|x_{n-1},x_{n-2},x_{n-3},\ldot	NNS
en-wikipedia-org-1345	114	65	)	)	-RRB-
en-wikipedia-org-1345	114	66	;	;	:
en-wikipedia-org-1345	114	67	}	}	-RRB-
en-wikipedia-org-1345	114	68	that	that	RB
en-wikipedia-org-1345	114	69	is	is	RB
en-wikipedia-org-1345	114	70	,	,	,
en-wikipedia-org-1345	114	71	the	the	DT
en-wikipedia-org-1345	114	72	conditional	conditional	JJ
en-wikipedia-org-1345	114	73	entropy	entropy	NN
en-wikipedia-org-1345	114	74	of	of	IN
en-wikipedia-org-1345	114	75	a	a	DT
en-wikipedia-org-1345	114	76	symbol	symbol	NN
en-wikipedia-org-1345	114	77	given	give	VBN
en-wikipedia-org-1345	114	78	all	all	PDT
en-wikipedia-org-1345	114	79	the	the	DT
en-wikipedia-org-1345	114	80	previous	previous	JJ
en-wikipedia-org-1345	114	81	symbols	symbol	NNS
en-wikipedia-org-1345	114	82	generated	generate	VBN
en-wikipedia-org-1345	114	83	.	.	.
en-wikipedia-org-1345	115	1	For	for	IN
en-wikipedia-org-1345	115	2	the	the	DT
en-wikipedia-org-1345	115	3	more	more	RBR
en-wikipedia-org-1345	115	4	general	general	JJ
en-wikipedia-org-1345	115	5	case	case	NN
en-wikipedia-org-1345	115	6	of	of	IN
en-wikipedia-org-1345	115	7	a	a	DT
en-wikipedia-org-1345	115	8	process	process	NN
en-wikipedia-org-1345	115	9	that	that	WDT
en-wikipedia-org-1345	115	10	is	be	VBZ
en-wikipedia-org-1345	115	11	not	not	RB
en-wikipedia-org-1345	115	12	necessarily	necessarily	RB
en-wikipedia-org-1345	115	13	stationary	stationary	JJ
en-wikipedia-org-1345	115	14	,	,	,
en-wikipedia-org-1345	115	15	the	the	DT
en-wikipedia-org-1345	115	16	average	average	JJ
en-wikipedia-org-1345	115	17	rate	rate	NN
en-wikipedia-org-1345	115	18	is	be	VBZ
en-wikipedia-org-1345	115	19	r	r	NN
en-wikipedia-org-1345	115	20	=	=	SYM
en-wikipedia-org-1345	115	21	lim	lim	NNP
en-wikipedia-org-1345	115	22	n	n	NNP
en-wikipedia-org-1345	115	23	→	→	SYM
en-wikipedia-org-1345	115	24	∞	∞	NN
en-wikipedia-org-1345	115	25	1	1	CD
en-wikipedia-org-1345	115	26	n	n	CC
en-wikipedia-org-1345	115	27	H	h	NN
en-wikipedia-org-1345	115	28	(	(	-LRB-
en-wikipedia-org-1345	115	29	X	X	NNP
en-wikipedia-org-1345	115	30	1	1	CD
en-wikipedia-org-1345	115	31	,	,	,
en-wikipedia-org-1345	115	32	X	x	NN
en-wikipedia-org-1345	115	33	2	2	CD
en-wikipedia-org-1345	115	34	,	,	,
en-wikipedia-org-1345	115	35	…	…	NFP
en-wikipedia-org-1345	115	36	X	x	NN
en-wikipedia-org-1345	115	37	n	n	CC
en-wikipedia-org-1345	115	38	)	)	-RRB-
en-wikipedia-org-1345	115	39	;	;	:
en-wikipedia-org-1345	115	40	{	{	-LRB-
en-wikipedia-org-1345	115	41	\displaystyle	\displaystyle	NN
en-wikipedia-org-1345	115	42	r=\lim	r=\lim	NNPS
en-wikipedia-org-1345	115	43	_	_	NNP
en-wikipedia-org-1345	115	44	{	{	-LRB-
en-wikipedia-org-1345	115	45	n\to	n\to	NNP
en-wikipedia-org-1345	115	46	\infty	\infty	CD
en-wikipedia-org-1345	115	47	}	}	-RRB-
en-wikipedia-org-1345	115	48	{	{	-LRB-
en-wikipedia-org-1345	115	49	\frac	\frac	CD
en-wikipedia-org-1345	115	50	{	{	-LRB-
en-wikipedia-org-1345	115	51	1}{n}}H(X_{1},X_{2},\dots	1}{n}}h(x_{1},x_{2},\dots	CD
en-wikipedia-org-1345	115	52	X_{n	X_{n	NNP
en-wikipedia-org-1345	115	53	}	}	-RRB-
en-wikipedia-org-1345	115	54	)	)	-RRB-
en-wikipedia-org-1345	115	55	;	;	:
en-wikipedia-org-1345	115	56	}	}	-RRB-
en-wikipedia-org-1345	115	57	that	that	RB
en-wikipedia-org-1345	115	58	is	is	RB
en-wikipedia-org-1345	115	59	,	,	,
en-wikipedia-org-1345	115	60	the	the	DT
en-wikipedia-org-1345	115	61	limit	limit	NN
en-wikipedia-org-1345	115	62	of	of	IN
en-wikipedia-org-1345	115	63	the	the	DT
en-wikipedia-org-1345	115	64	joint	joint	JJ
en-wikipedia-org-1345	115	65	entropy	entropy	JJ
en-wikipedia-org-1345	115	66	per	per	IN
en-wikipedia-org-1345	115	67	symbol	symbol	NN
en-wikipedia-org-1345	115	68	.	.	.
en-wikipedia-org-1345	116	1	For	for	IN
en-wikipedia-org-1345	116	2	stationary	stationary	JJ
en-wikipedia-org-1345	116	3	sources	source	NNS
en-wikipedia-org-1345	116	4	,	,	,
en-wikipedia-org-1345	116	5	these	these	DT
en-wikipedia-org-1345	116	6	two	two	CD
en-wikipedia-org-1345	116	7	expressions	expression	NNS
en-wikipedia-org-1345	116	8	give	give	VBP
en-wikipedia-org-1345	116	9	the	the	DT
en-wikipedia-org-1345	116	10	same	same	JJ
en-wikipedia-org-1345	116	11	result	result	NN
en-wikipedia-org-1345	116	12	.	.	.
en-wikipedia-org-1345	117	1	[	[	-LRB-
en-wikipedia-org-1345	117	2	11	11	CD
en-wikipedia-org-1345	117	3	]	]	-RRB-
en-wikipedia-org-1345	117	4	It	-PRON-	PRP
en-wikipedia-org-1345	117	5	is	be	VBZ
en-wikipedia-org-1345	117	6	common	common	JJ
en-wikipedia-org-1345	117	7	in	in	IN
en-wikipedia-org-1345	117	8	information	information	NN
en-wikipedia-org-1345	117	9	theory	theory	NN
en-wikipedia-org-1345	117	10	to	to	TO
en-wikipedia-org-1345	117	11	speak	speak	VB
en-wikipedia-org-1345	117	12	of	of	IN
en-wikipedia-org-1345	117	13	the	the	DT
en-wikipedia-org-1345	117	14	"	"	``
en-wikipedia-org-1345	117	15	rate	rate	NN
en-wikipedia-org-1345	117	16	"	"	''
en-wikipedia-org-1345	117	17	or	or	CC
en-wikipedia-org-1345	117	18	"	"	``
en-wikipedia-org-1345	117	19	entropy	entropy	JJ
en-wikipedia-org-1345	117	20	"	"	''
en-wikipedia-org-1345	117	21	of	of	IN
en-wikipedia-org-1345	117	22	a	a	DT
en-wikipedia-org-1345	117	23	language	language	NN
en-wikipedia-org-1345	117	24	.	.	.
en-wikipedia-org-1345	118	1	This	this	DT
en-wikipedia-org-1345	118	2	is	be	VBZ
en-wikipedia-org-1345	118	3	appropriate	appropriate	JJ
en-wikipedia-org-1345	118	4	,	,	,
en-wikipedia-org-1345	118	5	for	for	IN
en-wikipedia-org-1345	118	6	example	example	NN
en-wikipedia-org-1345	118	7	,	,	,
en-wikipedia-org-1345	118	8	when	when	WRB
en-wikipedia-org-1345	118	9	the	the	DT
en-wikipedia-org-1345	118	10	source	source	NN
en-wikipedia-org-1345	118	11	of	of	IN
en-wikipedia-org-1345	118	12	information	information	NN
en-wikipedia-org-1345	118	13	is	be	VBZ
en-wikipedia-org-1345	118	14	English	English	NNP
en-wikipedia-org-1345	118	15	prose	prose	NN
en-wikipedia-org-1345	118	16	.	.	.
en-wikipedia-org-1345	119	1	The	the	DT
en-wikipedia-org-1345	119	2	rate	rate	NN
en-wikipedia-org-1345	119	3	of	of	IN
en-wikipedia-org-1345	119	4	a	a	DT
en-wikipedia-org-1345	119	5	source	source	NN
en-wikipedia-org-1345	119	6	of	of	IN
en-wikipedia-org-1345	119	7	information	information	NN
en-wikipedia-org-1345	119	8	is	be	VBZ
en-wikipedia-org-1345	119	9	related	relate	VBN
en-wikipedia-org-1345	119	10	to	to	IN
en-wikipedia-org-1345	119	11	its	-PRON-	PRP$
en-wikipedia-org-1345	119	12	redundancy	redundancy	NN
en-wikipedia-org-1345	119	13	and	and	CC
en-wikipedia-org-1345	119	14	how	how	WRB
en-wikipedia-org-1345	119	15	well	well	RB
en-wikipedia-org-1345	119	16	it	-PRON-	PRP
en-wikipedia-org-1345	119	17	can	can	MD
en-wikipedia-org-1345	119	18	be	be	VB
en-wikipedia-org-1345	119	19	compressed	compress	VBN
en-wikipedia-org-1345	119	20	,	,	,
en-wikipedia-org-1345	119	21	the	the	DT
en-wikipedia-org-1345	119	22	subject	subject	NN
en-wikipedia-org-1345	119	23	of	of	IN
en-wikipedia-org-1345	119	24	source	source	NN
en-wikipedia-org-1345	119	25	coding	code	VBG
en-wikipedia-org-1345	119	26	.	.	.
en-wikipedia-org-1345	120	1	Channel	Channel	NNP
en-wikipedia-org-1345	120	2	capacity[edit	capacity[edit	,
en-wikipedia-org-1345	120	3	]	]	-RRB-
en-wikipedia-org-1345	120	4	Main	main	JJ
en-wikipedia-org-1345	120	5	article	article	NN
en-wikipedia-org-1345	120	6	:	:	:
en-wikipedia-org-1345	120	7	Channel	Channel	NNP
en-wikipedia-org-1345	120	8	capacity	capacity	NN
en-wikipedia-org-1345	120	9	Communications	Communications	NNPS
en-wikipedia-org-1345	120	10	over	over	IN
en-wikipedia-org-1345	120	11	a	a	DT
en-wikipedia-org-1345	120	12	channel	channel	NN
en-wikipedia-org-1345	120	13	—	—	:
en-wikipedia-org-1345	120	14	such	such	JJ
en-wikipedia-org-1345	120	15	as	as	IN
en-wikipedia-org-1345	120	16	an	an	DT
en-wikipedia-org-1345	120	17	ethernet	ethernet	NN
en-wikipedia-org-1345	120	18	cable	cable	NN
en-wikipedia-org-1345	120	19	—	—	:
en-wikipedia-org-1345	120	20	is	be	VBZ
en-wikipedia-org-1345	120	21	the	the	DT
en-wikipedia-org-1345	120	22	primary	primary	JJ
en-wikipedia-org-1345	120	23	motivation	motivation	NN
en-wikipedia-org-1345	120	24	of	of	IN
en-wikipedia-org-1345	120	25	information	information	NN
en-wikipedia-org-1345	120	26	theory	theory	NN
en-wikipedia-org-1345	120	27	.	.	.
en-wikipedia-org-1345	121	1	However	however	RB
en-wikipedia-org-1345	121	2	,	,	,
en-wikipedia-org-1345	121	3	such	such	JJ
en-wikipedia-org-1345	121	4	channels	channel	NNS
en-wikipedia-org-1345	121	5	often	often	RB
en-wikipedia-org-1345	121	6	fail	fail	VBP
en-wikipedia-org-1345	121	7	to	to	TO
en-wikipedia-org-1345	121	8	produce	produce	VB
en-wikipedia-org-1345	121	9	exact	exact	JJ
en-wikipedia-org-1345	121	10	reconstruction	reconstruction	NN
en-wikipedia-org-1345	121	11	of	of	IN
en-wikipedia-org-1345	121	12	a	a	DT
en-wikipedia-org-1345	121	13	signal	signal	NN
en-wikipedia-org-1345	121	14	;	;	:
en-wikipedia-org-1345	121	15	noise	noise	NN
en-wikipedia-org-1345	121	16	,	,	,
en-wikipedia-org-1345	121	17	periods	period	NNS
en-wikipedia-org-1345	121	18	of	of	IN
en-wikipedia-org-1345	121	19	silence	silence	NN
en-wikipedia-org-1345	121	20	,	,	,
en-wikipedia-org-1345	121	21	and	and	CC
en-wikipedia-org-1345	121	22	other	other	JJ
en-wikipedia-org-1345	121	23	forms	form	NNS
en-wikipedia-org-1345	121	24	of	of	IN
en-wikipedia-org-1345	121	25	signal	signal	JJ
en-wikipedia-org-1345	121	26	corruption	corruption	NN
en-wikipedia-org-1345	121	27	often	often	RB
en-wikipedia-org-1345	121	28	degrade	degrade	VBP
en-wikipedia-org-1345	121	29	quality	quality	NN
en-wikipedia-org-1345	121	30	.	.	.
en-wikipedia-org-1345	122	1	Consider	consider	VB
en-wikipedia-org-1345	122	2	the	the	DT
en-wikipedia-org-1345	122	3	communications	communication	NNS
en-wikipedia-org-1345	122	4	process	process	NN
en-wikipedia-org-1345	122	5	over	over	IN
en-wikipedia-org-1345	122	6	a	a	DT
en-wikipedia-org-1345	122	7	discrete	discrete	JJ
en-wikipedia-org-1345	122	8	channel	channel	NN
en-wikipedia-org-1345	122	9	.	.	.
en-wikipedia-org-1345	123	1	A	a	DT
en-wikipedia-org-1345	123	2	simple	simple	JJ
en-wikipedia-org-1345	123	3	model	model	NN
en-wikipedia-org-1345	123	4	of	of	IN
en-wikipedia-org-1345	123	5	the	the	DT
en-wikipedia-org-1345	123	6	process	process	NN
en-wikipedia-org-1345	123	7	is	be	VBZ
en-wikipedia-org-1345	123	8	shown	show	VBN
en-wikipedia-org-1345	123	9	below	below	IN
en-wikipedia-org-1345	123	10	:	:	:
en-wikipedia-org-1345	123	11	Here	here	RB
en-wikipedia-org-1345	123	12	X	X	NNP
en-wikipedia-org-1345	123	13	represents	represent	VBZ
en-wikipedia-org-1345	123	14	the	the	DT
en-wikipedia-org-1345	123	15	space	space	NN
en-wikipedia-org-1345	123	16	of	of	IN
en-wikipedia-org-1345	123	17	messages	message	NNS
en-wikipedia-org-1345	123	18	transmitted	transmit	VBN
en-wikipedia-org-1345	123	19	,	,	,
en-wikipedia-org-1345	123	20	and	and	CC
en-wikipedia-org-1345	123	21	Y	Y	NNP
en-wikipedia-org-1345	123	22	the	the	DT
en-wikipedia-org-1345	123	23	space	space	NN
en-wikipedia-org-1345	123	24	of	of	IN
en-wikipedia-org-1345	123	25	messages	message	NNS
en-wikipedia-org-1345	123	26	received	receive	VBN
en-wikipedia-org-1345	123	27	during	during	IN
en-wikipedia-org-1345	123	28	a	a	DT
en-wikipedia-org-1345	123	29	unit	unit	NN
en-wikipedia-org-1345	123	30	time	time	NN
en-wikipedia-org-1345	123	31	over	over	IN
en-wikipedia-org-1345	123	32	our	-PRON-	PRP$
en-wikipedia-org-1345	123	33	channel	channel	NN
en-wikipedia-org-1345	123	34	.	.	.
en-wikipedia-org-1345	124	1	Let	let	VB
en-wikipedia-org-1345	124	2	p(y|x	p(y|x	NN
en-wikipedia-org-1345	124	3	)	)	-RRB-
en-wikipedia-org-1345	124	4	be	be	VB
en-wikipedia-org-1345	124	5	the	the	DT
en-wikipedia-org-1345	124	6	conditional	conditional	JJ
en-wikipedia-org-1345	124	7	probability	probability	NN
en-wikipedia-org-1345	124	8	distribution	distribution	NN
en-wikipedia-org-1345	124	9	function	function	NN
en-wikipedia-org-1345	124	10	of	of	IN
en-wikipedia-org-1345	124	11	Y	y	NN
en-wikipedia-org-1345	124	12	given	give	VBN
en-wikipedia-org-1345	124	13	X.	X.	NNP
en-wikipedia-org-1345	125	1	We	-PRON-	PRP
en-wikipedia-org-1345	125	2	will	will	MD
en-wikipedia-org-1345	125	3	consider	consider	VB
en-wikipedia-org-1345	125	4	p(y|x	p(y|x	XX
en-wikipedia-org-1345	125	5	)	)	-RRB-
en-wikipedia-org-1345	125	6	to	to	TO
en-wikipedia-org-1345	125	7	be	be	VB
en-wikipedia-org-1345	125	8	an	an	DT
en-wikipedia-org-1345	125	9	inherent	inherent	JJ
en-wikipedia-org-1345	125	10	fixed	fix	VBN
en-wikipedia-org-1345	125	11	property	property	NN
en-wikipedia-org-1345	125	12	of	of	IN
en-wikipedia-org-1345	125	13	our	-PRON-	PRP$
en-wikipedia-org-1345	125	14	communications	communication	NNS
en-wikipedia-org-1345	125	15	channel	channel	NN
en-wikipedia-org-1345	125	16	(	(	-LRB-
en-wikipedia-org-1345	125	17	representing	represent	VBG
en-wikipedia-org-1345	125	18	the	the	DT
en-wikipedia-org-1345	125	19	nature	nature	NN
en-wikipedia-org-1345	125	20	of	of	IN
en-wikipedia-org-1345	125	21	the	the	DT
en-wikipedia-org-1345	125	22	noise	noise	NN
en-wikipedia-org-1345	125	23	of	of	IN
en-wikipedia-org-1345	125	24	our	-PRON-	PRP$
en-wikipedia-org-1345	125	25	channel	channel	NN
en-wikipedia-org-1345	125	26	)	)	-RRB-
en-wikipedia-org-1345	125	27	.	.	.
en-wikipedia-org-1345	126	1	Then	then	RB
en-wikipedia-org-1345	126	2	the	the	DT
en-wikipedia-org-1345	126	3	joint	joint	JJ
en-wikipedia-org-1345	126	4	distribution	distribution	NN
en-wikipedia-org-1345	126	5	of	of	IN
en-wikipedia-org-1345	126	6	X	x	NN
en-wikipedia-org-1345	126	7	and	and	CC
en-wikipedia-org-1345	126	8	Y	Y	NNP
en-wikipedia-org-1345	126	9	is	be	VBZ
en-wikipedia-org-1345	126	10	completely	completely	RB
en-wikipedia-org-1345	126	11	determined	determine	VBN
en-wikipedia-org-1345	126	12	by	by	IN
en-wikipedia-org-1345	126	13	our	-PRON-	PRP$
en-wikipedia-org-1345	126	14	channel	channel	NN
en-wikipedia-org-1345	126	15	and	and	CC
en-wikipedia-org-1345	126	16	by	by	IN
en-wikipedia-org-1345	126	17	our	-PRON-	PRP$
en-wikipedia-org-1345	126	18	choice	choice	NN
en-wikipedia-org-1345	126	19	of	of	IN
en-wikipedia-org-1345	126	20	f(x	f(x	NNP
en-wikipedia-org-1345	126	21	)	)	-RRB-
en-wikipedia-org-1345	126	22	,	,	,
en-wikipedia-org-1345	126	23	the	the	DT
en-wikipedia-org-1345	126	24	marginal	marginal	JJ
en-wikipedia-org-1345	126	25	distribution	distribution	NN
en-wikipedia-org-1345	126	26	of	of	IN
en-wikipedia-org-1345	126	27	messages	message	NNS
en-wikipedia-org-1345	126	28	we	-PRON-	PRP
en-wikipedia-org-1345	126	29	choose	choose	VBP
en-wikipedia-org-1345	126	30	to	to	TO
en-wikipedia-org-1345	126	31	send	send	VB
en-wikipedia-org-1345	126	32	over	over	RP
en-wikipedia-org-1345	126	33	the	the	DT
en-wikipedia-org-1345	126	34	channel	channel	NN
en-wikipedia-org-1345	126	35	.	.	.
en-wikipedia-org-1345	127	1	Under	under	IN
en-wikipedia-org-1345	127	2	these	these	DT
en-wikipedia-org-1345	127	3	constraints	constraint	NNS
en-wikipedia-org-1345	127	4	,	,	,
en-wikipedia-org-1345	127	5	we	-PRON-	PRP
en-wikipedia-org-1345	127	6	would	would	MD
en-wikipedia-org-1345	127	7	like	like	VB
en-wikipedia-org-1345	127	8	to	to	TO
en-wikipedia-org-1345	127	9	maximize	maximize	VB
en-wikipedia-org-1345	127	10	the	the	DT
en-wikipedia-org-1345	127	11	rate	rate	NN
en-wikipedia-org-1345	127	12	of	of	IN
en-wikipedia-org-1345	127	13	information	information	NN
en-wikipedia-org-1345	127	14	,	,	,
en-wikipedia-org-1345	127	15	or	or	CC
en-wikipedia-org-1345	127	16	the	the	DT
en-wikipedia-org-1345	127	17	signal	signal	NN
en-wikipedia-org-1345	127	18	,	,	,
en-wikipedia-org-1345	127	19	we	-PRON-	PRP
en-wikipedia-org-1345	127	20	can	can	MD
en-wikipedia-org-1345	127	21	communicate	communicate	VB
en-wikipedia-org-1345	127	22	over	over	IN
en-wikipedia-org-1345	127	23	the	the	DT
en-wikipedia-org-1345	127	24	channel	channel	NN
en-wikipedia-org-1345	127	25	.	.	.
en-wikipedia-org-1345	128	1	The	the	DT
en-wikipedia-org-1345	128	2	appropriate	appropriate	JJ
en-wikipedia-org-1345	128	3	measure	measure	NN
en-wikipedia-org-1345	128	4	for	for	IN
en-wikipedia-org-1345	128	5	this	this	DT
en-wikipedia-org-1345	128	6	is	be	VBZ
en-wikipedia-org-1345	128	7	the	the	DT
en-wikipedia-org-1345	128	8	mutual	mutual	JJ
en-wikipedia-org-1345	128	9	information	information	NN
en-wikipedia-org-1345	128	10	,	,	,
en-wikipedia-org-1345	128	11	and	and	CC
en-wikipedia-org-1345	128	12	this	this	DT
en-wikipedia-org-1345	128	13	maximum	maximum	JJ
en-wikipedia-org-1345	128	14	mutual	mutual	JJ
en-wikipedia-org-1345	128	15	information	information	NN
en-wikipedia-org-1345	128	16	is	be	VBZ
en-wikipedia-org-1345	128	17	called	call	VBN
en-wikipedia-org-1345	128	18	the	the	DT
en-wikipedia-org-1345	128	19	channel	channel	NN
en-wikipedia-org-1345	128	20	capacity	capacity	NN
en-wikipedia-org-1345	128	21	and	and	CC
en-wikipedia-org-1345	128	22	is	be	VBZ
en-wikipedia-org-1345	128	23	given	give	VBN
en-wikipedia-org-1345	128	24	by	by	IN
en-wikipedia-org-1345	128	25	:	:	:
en-wikipedia-org-1345	128	26	C	C	NNP
en-wikipedia-org-1345	128	27	=	=	SYM
en-wikipedia-org-1345	128	28	max	max	NNP
en-wikipedia-org-1345	128	29	f	f	NNP
en-wikipedia-org-1345	128	30	I	i	NN
en-wikipedia-org-1345	128	31	(	(	-LRB-
en-wikipedia-org-1345	128	32	X	X	NNP
en-wikipedia-org-1345	128	33	;	;	:
en-wikipedia-org-1345	128	34	Y	Y	NNP
en-wikipedia-org-1345	128	35	)	)	-RRB-
en-wikipedia-org-1345	128	36	.	.	.
en-wikipedia-org-1345	129	1	{	{	-LRB-
en-wikipedia-org-1345	129	2	\displaystyle	\displaystyle	CD
en-wikipedia-org-1345	129	3	C=\max	C=\max	NNP
en-wikipedia-org-1345	129	4	_	_	NNP
en-wikipedia-org-1345	129	5	{	{	-LRB-
en-wikipedia-org-1345	129	6	f}I(X;Y).\	f}i(x;y).\	NN
en-wikipedia-org-1345	129	7	!	!	.
en-wikipedia-org-1345	129	8	}	}	-RRB-
en-wikipedia-org-1345	130	1	This	this	DT
en-wikipedia-org-1345	130	2	capacity	capacity	NN
en-wikipedia-org-1345	130	3	has	have	VBZ
en-wikipedia-org-1345	130	4	the	the	DT
en-wikipedia-org-1345	130	5	following	follow	VBG
en-wikipedia-org-1345	130	6	property	property	NN
en-wikipedia-org-1345	130	7	related	relate	VBN
en-wikipedia-org-1345	130	8	to	to	IN
en-wikipedia-org-1345	130	9	communicating	communicate	VBG
en-wikipedia-org-1345	130	10	at	at	IN
en-wikipedia-org-1345	130	11	information	information	NN
en-wikipedia-org-1345	130	12	rate	rate	NN
en-wikipedia-org-1345	130	13	R	r	NN
en-wikipedia-org-1345	130	14	(	(	-LRB-
en-wikipedia-org-1345	130	15	where	where	WRB
en-wikipedia-org-1345	130	16	R	r	NN
en-wikipedia-org-1345	130	17	is	be	VBZ
en-wikipedia-org-1345	130	18	usually	usually	RB
en-wikipedia-org-1345	130	19	bits	bit	NNS
en-wikipedia-org-1345	130	20	per	per	IN
en-wikipedia-org-1345	130	21	symbol	symbol	NN
en-wikipedia-org-1345	130	22	)	)	-RRB-
en-wikipedia-org-1345	130	23	.	.	.
en-wikipedia-org-1345	131	1	For	for	IN
en-wikipedia-org-1345	131	2	any	any	DT
en-wikipedia-org-1345	131	3	information	information	NN
en-wikipedia-org-1345	131	4	rate	rate	NN
en-wikipedia-org-1345	131	5	R	R	NNP
en-wikipedia-org-1345	131	6	<	<	XX
en-wikipedia-org-1345	131	7	C	C	NNP
en-wikipedia-org-1345	131	8	and	and	CC
en-wikipedia-org-1345	131	9	coding	code	VBG
en-wikipedia-org-1345	131	10	error	error	NN
en-wikipedia-org-1345	131	11	ε	ε	NNP
en-wikipedia-org-1345	131	12	>	>	XX
en-wikipedia-org-1345	131	13	0	0	NFP
en-wikipedia-org-1345	131	14	,	,	,
en-wikipedia-org-1345	131	15	for	for	IN
en-wikipedia-org-1345	131	16	large	large	JJ
en-wikipedia-org-1345	131	17	enough	enough	JJ
en-wikipedia-org-1345	131	18	N	n	NN
en-wikipedia-org-1345	131	19	,	,	,
en-wikipedia-org-1345	131	20	there	there	EX
en-wikipedia-org-1345	131	21	exists	exist	VBZ
en-wikipedia-org-1345	131	22	a	a	DT
en-wikipedia-org-1345	131	23	code	code	NN
en-wikipedia-org-1345	131	24	of	of	IN
en-wikipedia-org-1345	131	25	length	length	NN
en-wikipedia-org-1345	131	26	N	n	NN
en-wikipedia-org-1345	131	27	and	and	CC
en-wikipedia-org-1345	131	28	rate	rate	NN
en-wikipedia-org-1345	131	29	≥	≥	NN
en-wikipedia-org-1345	131	30	R	r	NN
en-wikipedia-org-1345	131	31	and	and	CC
en-wikipedia-org-1345	131	32	a	a	DT
en-wikipedia-org-1345	131	33	decoding	decode	VBG
en-wikipedia-org-1345	131	34	algorithm	algorithm	NN
en-wikipedia-org-1345	131	35	,	,	,
en-wikipedia-org-1345	131	36	such	such	JJ
en-wikipedia-org-1345	131	37	that	that	IN
en-wikipedia-org-1345	131	38	the	the	DT
en-wikipedia-org-1345	131	39	maximal	maximal	JJ
en-wikipedia-org-1345	131	40	probability	probability	NN
en-wikipedia-org-1345	131	41	of	of	IN
en-wikipedia-org-1345	131	42	block	block	NN
en-wikipedia-org-1345	131	43	error	error	NN
en-wikipedia-org-1345	131	44	is	be	VBZ
en-wikipedia-org-1345	131	45	≤	≤	NNP
en-wikipedia-org-1345	131	46	ε	ε	NNPS
en-wikipedia-org-1345	131	47	;	;	:
en-wikipedia-org-1345	131	48	that	that	RB
en-wikipedia-org-1345	131	49	is	is	RB
en-wikipedia-org-1345	131	50	,	,	,
en-wikipedia-org-1345	131	51	it	-PRON-	PRP
en-wikipedia-org-1345	131	52	is	be	VBZ
en-wikipedia-org-1345	131	53	always	always	RB
en-wikipedia-org-1345	131	54	possible	possible	JJ
en-wikipedia-org-1345	131	55	to	to	TO
en-wikipedia-org-1345	131	56	transmit	transmit	VB
en-wikipedia-org-1345	131	57	with	with	IN
en-wikipedia-org-1345	131	58	arbitrarily	arbitrarily	RB
en-wikipedia-org-1345	131	59	small	small	JJ
en-wikipedia-org-1345	131	60	block	block	NN
en-wikipedia-org-1345	131	61	error	error	NN
en-wikipedia-org-1345	131	62	.	.	.
en-wikipedia-org-1345	132	1	In	in	IN
en-wikipedia-org-1345	132	2	addition	addition	NN
en-wikipedia-org-1345	132	3	,	,	,
en-wikipedia-org-1345	132	4	for	for	IN
en-wikipedia-org-1345	132	5	any	any	DT
en-wikipedia-org-1345	132	6	rate	rate	NN
en-wikipedia-org-1345	132	7	R	r	NN
en-wikipedia-org-1345	132	8	>	>	NN
en-wikipedia-org-1345	132	9	C	c	NN
en-wikipedia-org-1345	132	10	,	,	,
en-wikipedia-org-1345	132	11	it	-PRON-	PRP
en-wikipedia-org-1345	132	12	is	be	VBZ
en-wikipedia-org-1345	132	13	impossible	impossible	JJ
en-wikipedia-org-1345	132	14	to	to	TO
en-wikipedia-org-1345	132	15	transmit	transmit	VB
en-wikipedia-org-1345	132	16	with	with	IN
en-wikipedia-org-1345	132	17	arbitrarily	arbitrarily	RB
en-wikipedia-org-1345	132	18	small	small	JJ
en-wikipedia-org-1345	132	19	block	block	NN
en-wikipedia-org-1345	132	20	error	error	NN
en-wikipedia-org-1345	132	21	.	.	.
en-wikipedia-org-1345	133	1	Channel	Channel	NNP
en-wikipedia-org-1345	133	2	coding	coding	NN
en-wikipedia-org-1345	133	3	is	be	VBZ
en-wikipedia-org-1345	133	4	concerned	concern	VBN
en-wikipedia-org-1345	133	5	with	with	IN
en-wikipedia-org-1345	133	6	finding	find	VBG
en-wikipedia-org-1345	133	7	such	such	JJ
en-wikipedia-org-1345	133	8	nearly	nearly	RB
en-wikipedia-org-1345	133	9	optimal	optimal	JJ
en-wikipedia-org-1345	133	10	codes	code	NNS
en-wikipedia-org-1345	133	11	that	that	WDT
en-wikipedia-org-1345	133	12	can	can	MD
en-wikipedia-org-1345	133	13	be	be	VB
en-wikipedia-org-1345	133	14	used	use	VBN
en-wikipedia-org-1345	133	15	to	to	TO
en-wikipedia-org-1345	133	16	transmit	transmit	VB
en-wikipedia-org-1345	133	17	data	datum	NNS
en-wikipedia-org-1345	133	18	over	over	IN
en-wikipedia-org-1345	133	19	a	a	DT
en-wikipedia-org-1345	133	20	noisy	noisy	JJ
en-wikipedia-org-1345	133	21	channel	channel	NN
en-wikipedia-org-1345	133	22	with	with	IN
en-wikipedia-org-1345	133	23	a	a	DT
en-wikipedia-org-1345	133	24	small	small	JJ
en-wikipedia-org-1345	133	25	coding	coding	NN
en-wikipedia-org-1345	133	26	error	error	NN
en-wikipedia-org-1345	133	27	at	at	IN
en-wikipedia-org-1345	133	28	a	a	DT
en-wikipedia-org-1345	133	29	rate	rate	NN
en-wikipedia-org-1345	133	30	near	near	IN
en-wikipedia-org-1345	133	31	the	the	DT
en-wikipedia-org-1345	133	32	channel	channel	NN
en-wikipedia-org-1345	133	33	capacity	capacity	NN
en-wikipedia-org-1345	133	34	.	.	.
en-wikipedia-org-1345	134	1	Capacity	capacity	NN
en-wikipedia-org-1345	134	2	of	of	IN
en-wikipedia-org-1345	134	3	particular	particular	JJ
en-wikipedia-org-1345	134	4	channel	channel	NN
en-wikipedia-org-1345	134	5	models[edit	models[edit	LS
en-wikipedia-org-1345	134	6	]	]	-RRB-
en-wikipedia-org-1345	134	7	A	a	DT
en-wikipedia-org-1345	134	8	continuous	continuous	JJ
en-wikipedia-org-1345	134	9	-	-	HYPH
en-wikipedia-org-1345	134	10	time	time	NN
en-wikipedia-org-1345	134	11	analog	analog	NN
en-wikipedia-org-1345	134	12	communications	communication	NNS
en-wikipedia-org-1345	134	13	channel	channel	NN
en-wikipedia-org-1345	134	14	subject	subject	NN
en-wikipedia-org-1345	134	15	to	to	IN
en-wikipedia-org-1345	134	16	Gaussian	gaussian	JJ
en-wikipedia-org-1345	134	17	noise	noise	NN
en-wikipedia-org-1345	134	18	—	—	:
en-wikipedia-org-1345	134	19	see	see	VB
en-wikipedia-org-1345	134	20	Shannon	Shannon	NNP
en-wikipedia-org-1345	134	21	–	–	:
en-wikipedia-org-1345	134	22	Hartley	Hartley	NNP
en-wikipedia-org-1345	134	23	theorem	theorem	NN
en-wikipedia-org-1345	134	24	.	.	.
en-wikipedia-org-1345	135	1	A	a	DT
en-wikipedia-org-1345	135	2	binary	binary	JJ
en-wikipedia-org-1345	135	3	symmetric	symmetric	JJ
en-wikipedia-org-1345	135	4	channel	channel	NN
en-wikipedia-org-1345	135	5	(	(	-LRB-
en-wikipedia-org-1345	135	6	BSC	BSC	NNP
en-wikipedia-org-1345	135	7	)	)	-RRB-
en-wikipedia-org-1345	135	8	with	with	IN
en-wikipedia-org-1345	135	9	crossover	crossover	NNP
en-wikipedia-org-1345	135	10	probability	probability	NNP
en-wikipedia-org-1345	135	11	p	p	NNP
en-wikipedia-org-1345	135	12	is	be	VBZ
en-wikipedia-org-1345	135	13	a	a	DT
en-wikipedia-org-1345	135	14	binary	binary	JJ
en-wikipedia-org-1345	135	15	input	input	NN
en-wikipedia-org-1345	135	16	,	,	,
en-wikipedia-org-1345	135	17	binary	binary	JJ
en-wikipedia-org-1345	135	18	output	output	NN
en-wikipedia-org-1345	135	19	channel	channel	NN
en-wikipedia-org-1345	135	20	that	that	WDT
en-wikipedia-org-1345	135	21	flips	flip	VBZ
en-wikipedia-org-1345	135	22	the	the	DT
en-wikipedia-org-1345	135	23	input	input	NN
en-wikipedia-org-1345	135	24	bit	bit	NN
en-wikipedia-org-1345	135	25	with	with	IN
en-wikipedia-org-1345	135	26	probability	probability	NN
en-wikipedia-org-1345	135	27	p.	p.	NN
en-wikipedia-org-1345	135	28	The	the	DT
en-wikipedia-org-1345	135	29	BSC	BSC	NNP
en-wikipedia-org-1345	135	30	has	have	VBZ
en-wikipedia-org-1345	135	31	a	a	DT
en-wikipedia-org-1345	135	32	capacity	capacity	NN
en-wikipedia-org-1345	135	33	of	of	IN
en-wikipedia-org-1345	135	34	1	1	CD
en-wikipedia-org-1345	135	35	−	−	NNP
en-wikipedia-org-1345	135	36	Hb(p	Hb(p	NNP
en-wikipedia-org-1345	135	37	)	)	-RRB-
en-wikipedia-org-1345	135	38	bits	bit	NNS
en-wikipedia-org-1345	135	39	per	per	IN
en-wikipedia-org-1345	135	40	channel	channel	NN
en-wikipedia-org-1345	135	41	use	use	NN
en-wikipedia-org-1345	135	42	,	,	,
en-wikipedia-org-1345	135	43	where	where	WRB
en-wikipedia-org-1345	135	44	Hb	Hb	NNP
en-wikipedia-org-1345	135	45	is	be	VBZ
en-wikipedia-org-1345	135	46	the	the	DT
en-wikipedia-org-1345	135	47	binary	binary	JJ
en-wikipedia-org-1345	135	48	entropy	entropy	JJ
en-wikipedia-org-1345	135	49	function	function	NN
en-wikipedia-org-1345	135	50	to	to	IN
en-wikipedia-org-1345	135	51	the	the	DT
en-wikipedia-org-1345	135	52	base-2	base-2	NNP
en-wikipedia-org-1345	135	53	logarithm	logarithm	NN
en-wikipedia-org-1345	135	54	:	:	:
en-wikipedia-org-1345	135	55	A	a	DT
en-wikipedia-org-1345	135	56	binary	binary	JJ
en-wikipedia-org-1345	135	57	erasure	erasure	NN
en-wikipedia-org-1345	135	58	channel	channel	NN
en-wikipedia-org-1345	135	59	(	(	-LRB-
en-wikipedia-org-1345	135	60	BEC	BEC	NNP
en-wikipedia-org-1345	135	61	)	)	-RRB-
en-wikipedia-org-1345	135	62	with	with	IN
en-wikipedia-org-1345	135	63	erasure	erasure	JJ
en-wikipedia-org-1345	135	64	probability	probability	NN
en-wikipedia-org-1345	135	65	p	p	NN
en-wikipedia-org-1345	135	66	is	be	VBZ
en-wikipedia-org-1345	135	67	a	a	DT
en-wikipedia-org-1345	135	68	binary	binary	JJ
en-wikipedia-org-1345	135	69	input	input	NN
en-wikipedia-org-1345	135	70	,	,	,
en-wikipedia-org-1345	135	71	ternary	ternary	JJ
en-wikipedia-org-1345	135	72	output	output	NN
en-wikipedia-org-1345	135	73	channel	channel	NN
en-wikipedia-org-1345	135	74	.	.	.
en-wikipedia-org-1345	136	1	The	the	DT
en-wikipedia-org-1345	136	2	possible	possible	JJ
en-wikipedia-org-1345	136	3	channel	channel	NN
en-wikipedia-org-1345	136	4	outputs	output	NNS
en-wikipedia-org-1345	136	5	are	be	VBP
en-wikipedia-org-1345	136	6	0	0	CD
en-wikipedia-org-1345	136	7	,	,	,
en-wikipedia-org-1345	136	8	1	1	CD
en-wikipedia-org-1345	136	9	,	,	,
en-wikipedia-org-1345	136	10	and	and	CC
en-wikipedia-org-1345	136	11	a	a	DT
en-wikipedia-org-1345	136	12	third	third	JJ
en-wikipedia-org-1345	136	13	symbol	symbol	NN
en-wikipedia-org-1345	136	14	'	'	``
en-wikipedia-org-1345	136	15	e	e	NNP
en-wikipedia-org-1345	136	16	'	'	''
en-wikipedia-org-1345	136	17	called	call	VBD
en-wikipedia-org-1345	136	18	an	an	DT
en-wikipedia-org-1345	136	19	erasure	erasure	NN
en-wikipedia-org-1345	136	20	.	.	.
en-wikipedia-org-1345	137	1	The	the	DT
en-wikipedia-org-1345	137	2	erasure	erasure	NN
en-wikipedia-org-1345	137	3	represents	represent	VBZ
en-wikipedia-org-1345	137	4	complete	complete	JJ
en-wikipedia-org-1345	137	5	loss	loss	NN
en-wikipedia-org-1345	137	6	of	of	IN
en-wikipedia-org-1345	137	7	information	information	NN
en-wikipedia-org-1345	137	8	about	about	IN
en-wikipedia-org-1345	137	9	an	an	DT
en-wikipedia-org-1345	137	10	input	input	NN
en-wikipedia-org-1345	137	11	bit	bit	NN
en-wikipedia-org-1345	137	12	.	.	.
en-wikipedia-org-1345	138	1	The	the	DT
en-wikipedia-org-1345	138	2	capacity	capacity	NN
en-wikipedia-org-1345	138	3	of	of	IN
en-wikipedia-org-1345	138	4	the	the	DT
en-wikipedia-org-1345	138	5	BEC	BEC	NNP
en-wikipedia-org-1345	138	6	is	be	VBZ
en-wikipedia-org-1345	138	7	1	1	CD
en-wikipedia-org-1345	138	8	−	−	NNP
en-wikipedia-org-1345	138	9	p	p	NN
en-wikipedia-org-1345	138	10	bits	bit	NNS
en-wikipedia-org-1345	138	11	per	per	IN
en-wikipedia-org-1345	138	12	channel	channel	NN
en-wikipedia-org-1345	138	13	use	use	NN
en-wikipedia-org-1345	138	14	.	.	.
en-wikipedia-org-1345	139	1	Applications	application	NNS
en-wikipedia-org-1345	139	2	to	to	IN
en-wikipedia-org-1345	139	3	other	other	JJ
en-wikipedia-org-1345	139	4	fields[edit	fields[edit	,
en-wikipedia-org-1345	139	5	]	]	-RRB-
en-wikipedia-org-1345	139	6	Intelligence	intelligence	NN
en-wikipedia-org-1345	139	7	uses	use	NNS
en-wikipedia-org-1345	139	8	and	and	CC
en-wikipedia-org-1345	139	9	secrecy	secrecy	VBP
en-wikipedia-org-1345	139	10	applications[edit	applications[edit	LS
en-wikipedia-org-1345	139	11	]	]	-RRB-
en-wikipedia-org-1345	139	12	Information	information	NN
en-wikipedia-org-1345	139	13	theoretic	theoretic	JJ
en-wikipedia-org-1345	139	14	concepts	concept	NNS
en-wikipedia-org-1345	139	15	apply	apply	VBP
en-wikipedia-org-1345	139	16	to	to	IN
en-wikipedia-org-1345	139	17	cryptography	cryptography	NN
en-wikipedia-org-1345	139	18	and	and	CC
en-wikipedia-org-1345	139	19	cryptanalysis	cryptanalysis	NN
en-wikipedia-org-1345	139	20	.	.	.
en-wikipedia-org-1345	140	1	Turing	Turing	NNP
en-wikipedia-org-1345	140	2	's	's	POS
en-wikipedia-org-1345	140	3	information	information	NN
en-wikipedia-org-1345	140	4	unit	unit	NN
en-wikipedia-org-1345	140	5	,	,	,
en-wikipedia-org-1345	140	6	the	the	DT
en-wikipedia-org-1345	140	7	ban	ban	NN
en-wikipedia-org-1345	140	8	,	,	,
en-wikipedia-org-1345	140	9	was	be	VBD
en-wikipedia-org-1345	140	10	used	use	VBN
en-wikipedia-org-1345	140	11	in	in	IN
en-wikipedia-org-1345	140	12	the	the	DT
en-wikipedia-org-1345	140	13	Ultra	Ultra	NNP
en-wikipedia-org-1345	140	14	project	project	NN
en-wikipedia-org-1345	140	15	,	,	,
en-wikipedia-org-1345	140	16	breaking	break	VBG
en-wikipedia-org-1345	140	17	the	the	DT
en-wikipedia-org-1345	140	18	German	german	JJ
en-wikipedia-org-1345	140	19	Enigma	Enigma	NNP
en-wikipedia-org-1345	140	20	machine	machine	NN
en-wikipedia-org-1345	140	21	code	code	NN
en-wikipedia-org-1345	140	22	and	and	CC
en-wikipedia-org-1345	140	23	hastening	hasten	VBG
en-wikipedia-org-1345	140	24	the	the	DT
en-wikipedia-org-1345	140	25	end	end	NN
en-wikipedia-org-1345	140	26	of	of	IN
en-wikipedia-org-1345	140	27	World	World	NNP
en-wikipedia-org-1345	140	28	War	War	NNP
en-wikipedia-org-1345	140	29	II	II	NNP
en-wikipedia-org-1345	140	30	in	in	IN
en-wikipedia-org-1345	140	31	Europe	Europe	NNP
en-wikipedia-org-1345	140	32	.	.	.
en-wikipedia-org-1345	141	1	Shannon	Shannon	NNP
en-wikipedia-org-1345	141	2	himself	-PRON-	PRP
en-wikipedia-org-1345	141	3	defined	define	VBD
en-wikipedia-org-1345	141	4	an	an	DT
en-wikipedia-org-1345	141	5	important	important	JJ
en-wikipedia-org-1345	141	6	concept	concept	NN
en-wikipedia-org-1345	141	7	now	now	RB
en-wikipedia-org-1345	141	8	called	call	VBN
en-wikipedia-org-1345	141	9	the	the	DT
en-wikipedia-org-1345	141	10	unicity	unicity	NN
en-wikipedia-org-1345	141	11	distance	distance	NN
en-wikipedia-org-1345	141	12	.	.	.
en-wikipedia-org-1345	142	1	Based	base	VBN
en-wikipedia-org-1345	142	2	on	on	IN
en-wikipedia-org-1345	142	3	the	the	DT
en-wikipedia-org-1345	142	4	redundancy	redundancy	NN
en-wikipedia-org-1345	142	5	of	of	IN
en-wikipedia-org-1345	142	6	the	the	DT
en-wikipedia-org-1345	142	7	plaintext	plaintext	NN
en-wikipedia-org-1345	142	8	,	,	,
en-wikipedia-org-1345	142	9	it	-PRON-	PRP
en-wikipedia-org-1345	142	10	attempts	attempt	VBZ
en-wikipedia-org-1345	142	11	to	to	TO
en-wikipedia-org-1345	142	12	give	give	VB
en-wikipedia-org-1345	142	13	a	a	DT
en-wikipedia-org-1345	142	14	minimum	minimum	JJ
en-wikipedia-org-1345	142	15	amount	amount	NN
en-wikipedia-org-1345	142	16	of	of	IN
en-wikipedia-org-1345	142	17	ciphertext	ciphertext	NN
en-wikipedia-org-1345	142	18	necessary	necessary	JJ
en-wikipedia-org-1345	142	19	to	to	TO
en-wikipedia-org-1345	142	20	ensure	ensure	VB
en-wikipedia-org-1345	142	21	unique	unique	JJ
en-wikipedia-org-1345	142	22	decipherability	decipherability	NN
en-wikipedia-org-1345	142	23	.	.	.
en-wikipedia-org-1345	143	1	Information	information	NN
en-wikipedia-org-1345	143	2	theory	theory	NN
en-wikipedia-org-1345	143	3	leads	lead	VBZ
en-wikipedia-org-1345	143	4	us	-PRON-	PRP
en-wikipedia-org-1345	143	5	to	to	TO
en-wikipedia-org-1345	143	6	believe	believe	VB
en-wikipedia-org-1345	143	7	it	-PRON-	PRP
en-wikipedia-org-1345	143	8	is	be	VBZ
en-wikipedia-org-1345	143	9	much	much	RB
en-wikipedia-org-1345	143	10	more	more	RBR
en-wikipedia-org-1345	143	11	difficult	difficult	JJ
en-wikipedia-org-1345	143	12	to	to	TO
en-wikipedia-org-1345	143	13	keep	keep	VB
en-wikipedia-org-1345	143	14	secrets	secret	NNS
en-wikipedia-org-1345	143	15	than	than	IN
en-wikipedia-org-1345	143	16	it	-PRON-	PRP
en-wikipedia-org-1345	143	17	might	may	MD
en-wikipedia-org-1345	143	18	first	first	RB
en-wikipedia-org-1345	143	19	appear	appear	VB
en-wikipedia-org-1345	143	20	.	.	.
en-wikipedia-org-1345	144	1	A	a	DT
en-wikipedia-org-1345	144	2	brute	brute	JJ
en-wikipedia-org-1345	144	3	force	force	NN
en-wikipedia-org-1345	144	4	attack	attack	NN
en-wikipedia-org-1345	144	5	can	can	MD
en-wikipedia-org-1345	144	6	break	break	VB
en-wikipedia-org-1345	144	7	systems	system	NNS
en-wikipedia-org-1345	144	8	based	base	VBN
en-wikipedia-org-1345	144	9	on	on	IN
en-wikipedia-org-1345	144	10	asymmetric	asymmetric	JJ
en-wikipedia-org-1345	144	11	key	key	JJ
en-wikipedia-org-1345	144	12	algorithms	algorithm	NNS
en-wikipedia-org-1345	144	13	or	or	CC
en-wikipedia-org-1345	144	14	on	on	IN
en-wikipedia-org-1345	144	15	most	most	RBS
en-wikipedia-org-1345	144	16	commonly	commonly	RB
en-wikipedia-org-1345	144	17	used	use	VBN
en-wikipedia-org-1345	144	18	methods	method	NNS
en-wikipedia-org-1345	144	19	of	of	IN
en-wikipedia-org-1345	144	20	symmetric	symmetric	JJ
en-wikipedia-org-1345	144	21	key	key	JJ
en-wikipedia-org-1345	144	22	algorithms	algorithm	NNS
en-wikipedia-org-1345	144	23	(	(	-LRB-
en-wikipedia-org-1345	144	24	sometimes	sometimes	RB
en-wikipedia-org-1345	144	25	called	call	VBN
en-wikipedia-org-1345	144	26	secret	secret	JJ
en-wikipedia-org-1345	144	27	key	key	JJ
en-wikipedia-org-1345	144	28	algorithms	algorithm	NNS
en-wikipedia-org-1345	144	29	)	)	-RRB-
en-wikipedia-org-1345	144	30	,	,	,
en-wikipedia-org-1345	144	31	such	such	JJ
en-wikipedia-org-1345	144	32	as	as	IN
en-wikipedia-org-1345	144	33	block	block	NN
en-wikipedia-org-1345	144	34	ciphers	cipher	NNS
en-wikipedia-org-1345	144	35	.	.	.
en-wikipedia-org-1345	145	1	The	the	DT
en-wikipedia-org-1345	145	2	security	security	NN
en-wikipedia-org-1345	145	3	of	of	IN
en-wikipedia-org-1345	145	4	all	all	DT
en-wikipedia-org-1345	145	5	such	such	JJ
en-wikipedia-org-1345	145	6	methods	method	NNS
en-wikipedia-org-1345	145	7	currently	currently	RB
en-wikipedia-org-1345	145	8	comes	come	VBZ
en-wikipedia-org-1345	145	9	from	from	IN
en-wikipedia-org-1345	145	10	the	the	DT
en-wikipedia-org-1345	145	11	assumption	assumption	NN
en-wikipedia-org-1345	145	12	that	that	IN
en-wikipedia-org-1345	145	13	no	no	DT
en-wikipedia-org-1345	145	14	known	know	VBN
en-wikipedia-org-1345	145	15	attack	attack	NN
en-wikipedia-org-1345	145	16	can	can	MD
en-wikipedia-org-1345	145	17	break	break	VB
en-wikipedia-org-1345	145	18	them	-PRON-	PRP
en-wikipedia-org-1345	145	19	in	in	IN
en-wikipedia-org-1345	145	20	a	a	DT
en-wikipedia-org-1345	145	21	practical	practical	JJ
en-wikipedia-org-1345	145	22	amount	amount	NN
en-wikipedia-org-1345	145	23	of	of	IN
en-wikipedia-org-1345	145	24	time	time	NN
en-wikipedia-org-1345	145	25	.	.	.
en-wikipedia-org-1345	146	1	Information	information	NN
en-wikipedia-org-1345	146	2	theoretic	theoretic	JJ
en-wikipedia-org-1345	146	3	security	security	NN
en-wikipedia-org-1345	146	4	refers	refer	VBZ
en-wikipedia-org-1345	146	5	to	to	IN
en-wikipedia-org-1345	146	6	methods	method	NNS
en-wikipedia-org-1345	146	7	such	such	JJ
en-wikipedia-org-1345	146	8	as	as	IN
en-wikipedia-org-1345	146	9	the	the	DT
en-wikipedia-org-1345	146	10	one	one	CD
en-wikipedia-org-1345	146	11	-	-	HYPH
en-wikipedia-org-1345	146	12	time	time	NN
en-wikipedia-org-1345	146	13	pad	pad	NN
en-wikipedia-org-1345	146	14	that	that	WDT
en-wikipedia-org-1345	146	15	are	be	VBP
en-wikipedia-org-1345	146	16	not	not	RB
en-wikipedia-org-1345	146	17	vulnerable	vulnerable	JJ
en-wikipedia-org-1345	146	18	to	to	IN
en-wikipedia-org-1345	146	19	such	such	JJ
en-wikipedia-org-1345	146	20	brute	brute	JJ
en-wikipedia-org-1345	146	21	force	force	NN
en-wikipedia-org-1345	146	22	attacks	attack	NNS
en-wikipedia-org-1345	146	23	.	.	.
en-wikipedia-org-1345	147	1	In	in	IN
en-wikipedia-org-1345	147	2	such	such	JJ
en-wikipedia-org-1345	147	3	cases	case	NNS
en-wikipedia-org-1345	147	4	,	,	,
en-wikipedia-org-1345	147	5	the	the	DT
en-wikipedia-org-1345	147	6	positive	positive	JJ
en-wikipedia-org-1345	147	7	conditional	conditional	JJ
en-wikipedia-org-1345	147	8	mutual	mutual	JJ
en-wikipedia-org-1345	147	9	information	information	NN
en-wikipedia-org-1345	147	10	between	between	IN
en-wikipedia-org-1345	147	11	the	the	DT
en-wikipedia-org-1345	147	12	plaintext	plaintext	NN
en-wikipedia-org-1345	147	13	and	and	CC
en-wikipedia-org-1345	147	14	ciphertext	ciphertext	NNP
en-wikipedia-org-1345	147	15	(	(	-LRB-
en-wikipedia-org-1345	147	16	conditioned	condition	VBN
en-wikipedia-org-1345	147	17	on	on	IN
en-wikipedia-org-1345	147	18	the	the	DT
en-wikipedia-org-1345	147	19	key	key	NN
en-wikipedia-org-1345	147	20	)	)	-RRB-
en-wikipedia-org-1345	147	21	can	can	MD
en-wikipedia-org-1345	147	22	ensure	ensure	VB
en-wikipedia-org-1345	147	23	proper	proper	JJ
en-wikipedia-org-1345	147	24	transmission	transmission	NN
en-wikipedia-org-1345	147	25	,	,	,
en-wikipedia-org-1345	147	26	while	while	IN
en-wikipedia-org-1345	147	27	the	the	DT
en-wikipedia-org-1345	147	28	unconditional	unconditional	JJ
en-wikipedia-org-1345	147	29	mutual	mutual	JJ
en-wikipedia-org-1345	147	30	information	information	NN
en-wikipedia-org-1345	147	31	between	between	IN
en-wikipedia-org-1345	147	32	the	the	DT
en-wikipedia-org-1345	147	33	plaintext	plaintext	JJ
en-wikipedia-org-1345	147	34	and	and	CC
en-wikipedia-org-1345	147	35	ciphertext	ciphertext	NN
en-wikipedia-org-1345	147	36	remains	remain	VBZ
en-wikipedia-org-1345	147	37	zero	zero	CD
en-wikipedia-org-1345	147	38	,	,	,
en-wikipedia-org-1345	147	39	resulting	result	VBG
en-wikipedia-org-1345	147	40	in	in	IN
en-wikipedia-org-1345	147	41	absolutely	absolutely	RB
en-wikipedia-org-1345	147	42	secure	secure	JJ
en-wikipedia-org-1345	147	43	communications	communication	NNS
en-wikipedia-org-1345	147	44	.	.	.
en-wikipedia-org-1345	148	1	In	in	IN
en-wikipedia-org-1345	148	2	other	other	JJ
en-wikipedia-org-1345	148	3	words	word	NNS
en-wikipedia-org-1345	148	4	,	,	,
en-wikipedia-org-1345	148	5	an	an	DT
en-wikipedia-org-1345	148	6	eavesdropper	eavesdropper	NN
en-wikipedia-org-1345	148	7	would	would	MD
en-wikipedia-org-1345	148	8	not	not	RB
en-wikipedia-org-1345	148	9	be	be	VB
en-wikipedia-org-1345	148	10	able	able	JJ
en-wikipedia-org-1345	148	11	to	to	TO
en-wikipedia-org-1345	148	12	improve	improve	VB
en-wikipedia-org-1345	148	13	his	-PRON-	PRP$
en-wikipedia-org-1345	148	14	or	or	CC
en-wikipedia-org-1345	148	15	her	-PRON-	PRP$
en-wikipedia-org-1345	148	16	guess	guess	NN
en-wikipedia-org-1345	148	17	of	of	IN
en-wikipedia-org-1345	148	18	the	the	DT
en-wikipedia-org-1345	148	19	plaintext	plaintext	NN
en-wikipedia-org-1345	148	20	by	by	IN
en-wikipedia-org-1345	148	21	gaining	gain	VBG
en-wikipedia-org-1345	148	22	knowledge	knowledge	NN
en-wikipedia-org-1345	148	23	of	of	IN
en-wikipedia-org-1345	148	24	the	the	DT
en-wikipedia-org-1345	148	25	ciphertext	ciphertext	NN
en-wikipedia-org-1345	148	26	but	but	CC
en-wikipedia-org-1345	148	27	not	not	RB
en-wikipedia-org-1345	148	28	of	of	IN
en-wikipedia-org-1345	148	29	the	the	DT
en-wikipedia-org-1345	148	30	key	key	NN
en-wikipedia-org-1345	148	31	.	.	.
en-wikipedia-org-1345	149	1	However	however	RB
en-wikipedia-org-1345	149	2	,	,	,
en-wikipedia-org-1345	149	3	as	as	IN
en-wikipedia-org-1345	149	4	in	in	IN
en-wikipedia-org-1345	149	5	any	any	DT
en-wikipedia-org-1345	149	6	other	other	JJ
en-wikipedia-org-1345	149	7	cryptographic	cryptographic	JJ
en-wikipedia-org-1345	149	8	system	system	NN
en-wikipedia-org-1345	149	9	,	,	,
en-wikipedia-org-1345	149	10	care	care	NN
en-wikipedia-org-1345	149	11	must	must	MD
en-wikipedia-org-1345	149	12	be	be	VB
en-wikipedia-org-1345	149	13	used	use	VBN
en-wikipedia-org-1345	149	14	to	to	TO
en-wikipedia-org-1345	149	15	correctly	correctly	RB
en-wikipedia-org-1345	149	16	apply	apply	VB
en-wikipedia-org-1345	149	17	even	even	RB
en-wikipedia-org-1345	149	18	information	information	NN
en-wikipedia-org-1345	149	19	-	-	:
en-wikipedia-org-1345	149	20	theoretically	theoretically	RB
en-wikipedia-org-1345	149	21	secure	secure	JJ
en-wikipedia-org-1345	149	22	methods	method	NNS
en-wikipedia-org-1345	149	23	;	;	,
en-wikipedia-org-1345	149	24	the	the	DT
en-wikipedia-org-1345	149	25	Venona	Venona	NNP
en-wikipedia-org-1345	149	26	project	project	NN
en-wikipedia-org-1345	149	27	was	be	VBD
en-wikipedia-org-1345	149	28	able	able	JJ
en-wikipedia-org-1345	149	29	to	to	TO
en-wikipedia-org-1345	149	30	crack	crack	VB
en-wikipedia-org-1345	149	31	the	the	DT
en-wikipedia-org-1345	149	32	one	one	CD
en-wikipedia-org-1345	149	33	-	-	HYPH
en-wikipedia-org-1345	149	34	time	time	NN
en-wikipedia-org-1345	149	35	pads	pad	NNS
en-wikipedia-org-1345	149	36	of	of	IN
en-wikipedia-org-1345	149	37	the	the	DT
en-wikipedia-org-1345	149	38	Soviet	Soviet	NNP
en-wikipedia-org-1345	149	39	Union	Union	NNP
en-wikipedia-org-1345	149	40	due	due	IN
en-wikipedia-org-1345	149	41	to	to	IN
en-wikipedia-org-1345	149	42	their	-PRON-	PRP$
en-wikipedia-org-1345	149	43	improper	improper	JJ
en-wikipedia-org-1345	149	44	reuse	reuse	NN
en-wikipedia-org-1345	149	45	of	of	IN
en-wikipedia-org-1345	149	46	key	key	JJ
en-wikipedia-org-1345	149	47	material	material	NN
en-wikipedia-org-1345	149	48	.	.	.
en-wikipedia-org-1345	150	1	Pseudorandom	pseudorandom	JJ
en-wikipedia-org-1345	150	2	number	number	NN
en-wikipedia-org-1345	150	3	generation[edit	generation[edit	NFP
en-wikipedia-org-1345	150	4	]	]	-RRB-
en-wikipedia-org-1345	150	5	Pseudorandom	pseudorandom	NN
en-wikipedia-org-1345	150	6	number	number	NN
en-wikipedia-org-1345	150	7	generators	generator	NNS
en-wikipedia-org-1345	150	8	are	be	VBP
en-wikipedia-org-1345	150	9	widely	widely	RB
en-wikipedia-org-1345	150	10	available	available	JJ
en-wikipedia-org-1345	150	11	in	in	IN
en-wikipedia-org-1345	150	12	computer	computer	NN
en-wikipedia-org-1345	150	13	language	language	NN
en-wikipedia-org-1345	150	14	libraries	library	NNS
en-wikipedia-org-1345	150	15	and	and	CC
en-wikipedia-org-1345	150	16	application	application	NN
en-wikipedia-org-1345	150	17	programs	program	NNS
en-wikipedia-org-1345	150	18	.	.	.
en-wikipedia-org-1345	151	1	They	-PRON-	PRP
en-wikipedia-org-1345	151	2	are	be	VBP
en-wikipedia-org-1345	151	3	,	,	,
en-wikipedia-org-1345	151	4	almost	almost	RB
en-wikipedia-org-1345	151	5	universally	universally	RB
en-wikipedia-org-1345	151	6	,	,	,
en-wikipedia-org-1345	151	7	unsuited	unsuited	JJ
en-wikipedia-org-1345	151	8	to	to	IN
en-wikipedia-org-1345	151	9	cryptographic	cryptographic	JJ
en-wikipedia-org-1345	151	10	use	use	NN
en-wikipedia-org-1345	151	11	as	as	IN
en-wikipedia-org-1345	151	12	they	-PRON-	PRP
en-wikipedia-org-1345	151	13	do	do	VBP
en-wikipedia-org-1345	151	14	not	not	RB
en-wikipedia-org-1345	151	15	evade	evade	VB
en-wikipedia-org-1345	151	16	the	the	DT
en-wikipedia-org-1345	151	17	deterministic	deterministic	JJ
en-wikipedia-org-1345	151	18	nature	nature	NN
en-wikipedia-org-1345	151	19	of	of	IN
en-wikipedia-org-1345	151	20	modern	modern	JJ
en-wikipedia-org-1345	151	21	computer	computer	NN
en-wikipedia-org-1345	151	22	equipment	equipment	NN
en-wikipedia-org-1345	151	23	and	and	CC
en-wikipedia-org-1345	151	24	software	software	NN
en-wikipedia-org-1345	151	25	.	.	.
en-wikipedia-org-1345	152	1	A	a	DT
en-wikipedia-org-1345	152	2	class	class	NN
en-wikipedia-org-1345	152	3	of	of	IN
en-wikipedia-org-1345	152	4	improved	improve	VBN
en-wikipedia-org-1345	152	5	random	random	JJ
en-wikipedia-org-1345	152	6	number	number	NN
en-wikipedia-org-1345	152	7	generators	generator	NNS
en-wikipedia-org-1345	152	8	is	be	VBZ
en-wikipedia-org-1345	152	9	termed	term	VBN
en-wikipedia-org-1345	152	10	cryptographically	cryptographically	RB
en-wikipedia-org-1345	152	11	secure	secure	JJ
en-wikipedia-org-1345	152	12	pseudorandom	pseudorandom	NN
en-wikipedia-org-1345	152	13	number	number	NN
en-wikipedia-org-1345	152	14	generators	generator	NNS
en-wikipedia-org-1345	152	15	,	,	,
en-wikipedia-org-1345	152	16	but	but	CC
en-wikipedia-org-1345	152	17	even	even	RB
en-wikipedia-org-1345	152	18	they	-PRON-	PRP
en-wikipedia-org-1345	152	19	require	require	VBP
en-wikipedia-org-1345	152	20	random	random	JJ
en-wikipedia-org-1345	152	21	seeds	seed	NNS
en-wikipedia-org-1345	152	22	external	external	JJ
en-wikipedia-org-1345	152	23	to	to	IN
en-wikipedia-org-1345	152	24	the	the	DT
en-wikipedia-org-1345	152	25	software	software	NN
en-wikipedia-org-1345	152	26	to	to	TO
en-wikipedia-org-1345	152	27	work	work	VB
en-wikipedia-org-1345	152	28	as	as	IN
en-wikipedia-org-1345	152	29	intended	intend	VBN
en-wikipedia-org-1345	152	30	.	.	.
en-wikipedia-org-1345	153	1	These	these	DT
en-wikipedia-org-1345	153	2	can	can	MD
en-wikipedia-org-1345	153	3	be	be	VB
en-wikipedia-org-1345	153	4	obtained	obtain	VBN
en-wikipedia-org-1345	153	5	via	via	IN
en-wikipedia-org-1345	153	6	extractors	extractor	NNS
en-wikipedia-org-1345	153	7	,	,	,
en-wikipedia-org-1345	153	8	if	if	IN
en-wikipedia-org-1345	153	9	done	do	VBN
en-wikipedia-org-1345	153	10	carefully	carefully	RB
en-wikipedia-org-1345	153	11	.	.	.
en-wikipedia-org-1345	154	1	The	the	DT
en-wikipedia-org-1345	154	2	measure	measure	NN
en-wikipedia-org-1345	154	3	of	of	IN
en-wikipedia-org-1345	154	4	sufficient	sufficient	JJ
en-wikipedia-org-1345	154	5	randomness	randomness	NN
en-wikipedia-org-1345	154	6	in	in	IN
en-wikipedia-org-1345	154	7	extractors	extractor	NNS
en-wikipedia-org-1345	154	8	is	be	VBZ
en-wikipedia-org-1345	154	9	min	min	NNP
en-wikipedia-org-1345	154	10	-	-	HYPH
en-wikipedia-org-1345	154	11	entropy	entropy	NNP
en-wikipedia-org-1345	154	12	,	,	,
en-wikipedia-org-1345	154	13	a	a	DT
en-wikipedia-org-1345	154	14	value	value	NN
en-wikipedia-org-1345	154	15	related	relate	VBN
en-wikipedia-org-1345	154	16	to	to	IN
en-wikipedia-org-1345	154	17	Shannon	Shannon	NNP
en-wikipedia-org-1345	154	18	entropy	entropy	RB
en-wikipedia-org-1345	154	19	through	through	IN
en-wikipedia-org-1345	154	20	Rényi	Rényi	NNP
en-wikipedia-org-1345	154	21	entropy	entropy	RB
en-wikipedia-org-1345	154	22	;	;	:
en-wikipedia-org-1345	154	23	Rényi	Rényi	NNP
en-wikipedia-org-1345	154	24	entropy	entropy	RB
en-wikipedia-org-1345	154	25	is	be	VBZ
en-wikipedia-org-1345	154	26	also	also	RB
en-wikipedia-org-1345	154	27	used	use	VBN
en-wikipedia-org-1345	154	28	in	in	IN
en-wikipedia-org-1345	154	29	evaluating	evaluate	VBG
en-wikipedia-org-1345	154	30	randomness	randomness	NN
en-wikipedia-org-1345	154	31	in	in	IN
en-wikipedia-org-1345	154	32	cryptographic	cryptographic	JJ
en-wikipedia-org-1345	154	33	systems	system	NNS
en-wikipedia-org-1345	154	34	.	.	.
en-wikipedia-org-1345	155	1	Although	although	IN
en-wikipedia-org-1345	155	2	related	related	JJ
en-wikipedia-org-1345	155	3	,	,	,
en-wikipedia-org-1345	155	4	the	the	DT
en-wikipedia-org-1345	155	5	distinctions	distinction	NNS
en-wikipedia-org-1345	155	6	among	among	IN
en-wikipedia-org-1345	155	7	these	these	DT
en-wikipedia-org-1345	155	8	measures	measure	NNS
en-wikipedia-org-1345	155	9	mean	mean	VBP
en-wikipedia-org-1345	155	10	that	that	IN
en-wikipedia-org-1345	155	11	a	a	DT
en-wikipedia-org-1345	155	12	random	random	JJ
en-wikipedia-org-1345	155	13	variable	variable	NN
en-wikipedia-org-1345	155	14	with	with	IN
en-wikipedia-org-1345	155	15	high	high	JJ
en-wikipedia-org-1345	155	16	Shannon	Shannon	NNP
en-wikipedia-org-1345	155	17	entropy	entropy	NN
en-wikipedia-org-1345	155	18	is	be	VBZ
en-wikipedia-org-1345	155	19	not	not	RB
en-wikipedia-org-1345	155	20	necessarily	necessarily	RB
en-wikipedia-org-1345	155	21	satisfactory	satisfactory	JJ
en-wikipedia-org-1345	155	22	for	for	IN
en-wikipedia-org-1345	155	23	use	use	NN
en-wikipedia-org-1345	155	24	in	in	IN
en-wikipedia-org-1345	155	25	an	an	DT
en-wikipedia-org-1345	155	26	extractor	extractor	NN
en-wikipedia-org-1345	155	27	and	and	CC
en-wikipedia-org-1345	155	28	so	so	RB
en-wikipedia-org-1345	155	29	for	for	IN
en-wikipedia-org-1345	155	30	cryptography	cryptography	NN
en-wikipedia-org-1345	155	31	uses	use	NNS
en-wikipedia-org-1345	155	32	.	.	.
en-wikipedia-org-1345	156	1	Seismic	seismic	JJ
en-wikipedia-org-1345	156	2	exploration[edit	exploration[edit	VB
en-wikipedia-org-1345	156	3	]	]	-RRB-
en-wikipedia-org-1345	156	4	One	one	CD
en-wikipedia-org-1345	156	5	early	early	JJ
en-wikipedia-org-1345	156	6	commercial	commercial	JJ
en-wikipedia-org-1345	156	7	application	application	NN
en-wikipedia-org-1345	156	8	of	of	IN
en-wikipedia-org-1345	156	9	information	information	NN
en-wikipedia-org-1345	156	10	theory	theory	NN
en-wikipedia-org-1345	156	11	was	be	VBD
en-wikipedia-org-1345	156	12	in	in	IN
en-wikipedia-org-1345	156	13	the	the	DT
en-wikipedia-org-1345	156	14	field	field	NN
en-wikipedia-org-1345	156	15	of	of	IN
en-wikipedia-org-1345	156	16	seismic	seismic	JJ
en-wikipedia-org-1345	156	17	oil	oil	NN
en-wikipedia-org-1345	156	18	exploration	exploration	NN
en-wikipedia-org-1345	156	19	.	.	.
en-wikipedia-org-1345	157	1	Work	work	VB
en-wikipedia-org-1345	157	2	in	in	IN
en-wikipedia-org-1345	157	3	this	this	DT
en-wikipedia-org-1345	157	4	field	field	NN
en-wikipedia-org-1345	157	5	made	make	VBD
en-wikipedia-org-1345	157	6	it	-PRON-	PRP
en-wikipedia-org-1345	157	7	possible	possible	JJ
en-wikipedia-org-1345	157	8	to	to	TO
en-wikipedia-org-1345	157	9	strip	strip	VB
en-wikipedia-org-1345	157	10	off	off	RP
en-wikipedia-org-1345	157	11	and	and	CC
en-wikipedia-org-1345	157	12	separate	separate	VB
en-wikipedia-org-1345	157	13	the	the	DT
en-wikipedia-org-1345	157	14	unwanted	unwanted	JJ
en-wikipedia-org-1345	157	15	noise	noise	NN
en-wikipedia-org-1345	157	16	from	from	IN
en-wikipedia-org-1345	157	17	the	the	DT
en-wikipedia-org-1345	157	18	desired	desire	VBN
en-wikipedia-org-1345	157	19	seismic	seismic	JJ
en-wikipedia-org-1345	157	20	signal	signal	NN
en-wikipedia-org-1345	157	21	.	.	.
en-wikipedia-org-1345	158	1	Information	information	NN
en-wikipedia-org-1345	158	2	theory	theory	NN
en-wikipedia-org-1345	158	3	and	and	CC
en-wikipedia-org-1345	158	4	digital	digital	JJ
en-wikipedia-org-1345	158	5	signal	signal	NN
en-wikipedia-org-1345	158	6	processing	processing	NN
en-wikipedia-org-1345	158	7	offer	offer	VBP
en-wikipedia-org-1345	158	8	a	a	DT
en-wikipedia-org-1345	158	9	major	major	JJ
en-wikipedia-org-1345	158	10	improvement	improvement	NN
en-wikipedia-org-1345	158	11	of	of	IN
en-wikipedia-org-1345	158	12	resolution	resolution	NN
en-wikipedia-org-1345	158	13	and	and	CC
en-wikipedia-org-1345	158	14	image	image	NN
en-wikipedia-org-1345	158	15	clarity	clarity	NN
en-wikipedia-org-1345	158	16	over	over	IN
en-wikipedia-org-1345	158	17	previous	previous	JJ
en-wikipedia-org-1345	158	18	analog	analog	NN
en-wikipedia-org-1345	158	19	methods	method	NNS
en-wikipedia-org-1345	158	20	.	.	.
en-wikipedia-org-1345	159	1	[	[	-LRB-
en-wikipedia-org-1345	159	2	12	12	CD
en-wikipedia-org-1345	159	3	]	]	-RRB-
en-wikipedia-org-1345	159	4	Semiotics[edit	semiotics[edit	NN
en-wikipedia-org-1345	159	5	]	]	-RRB-
en-wikipedia-org-1345	159	6	Semioticians	Semioticians	NNPS
en-wikipedia-org-1345	159	7	Doede	Doede	NNP
en-wikipedia-org-1345	159	8	Nauta	Nauta	NNP
en-wikipedia-org-1345	159	9	and	and	CC
en-wikipedia-org-1345	159	10	Winfried	Winfried	NNP
en-wikipedia-org-1345	159	11	Nöth	Nöth	NNP
en-wikipedia-org-1345	159	12	both	both	DT
en-wikipedia-org-1345	159	13	considered	consider	VBD
en-wikipedia-org-1345	159	14	Charles	Charles	NNP
en-wikipedia-org-1345	159	15	Sanders	Sanders	NNPS
en-wikipedia-org-1345	159	16	Peirce	Peirce	NNP
en-wikipedia-org-1345	159	17	as	as	IN
en-wikipedia-org-1345	159	18	having	have	VBG
en-wikipedia-org-1345	159	19	created	create	VBN
en-wikipedia-org-1345	159	20	a	a	DT
en-wikipedia-org-1345	159	21	theory	theory	NN
en-wikipedia-org-1345	159	22	of	of	IN
en-wikipedia-org-1345	159	23	information	information	NN
en-wikipedia-org-1345	159	24	in	in	IN
en-wikipedia-org-1345	159	25	his	-PRON-	PRP$
en-wikipedia-org-1345	159	26	works	work	NNS
en-wikipedia-org-1345	159	27	on	on	IN
en-wikipedia-org-1345	159	28	semiotics	semiotic	NNS
en-wikipedia-org-1345	159	29	.	.	.
en-wikipedia-org-1345	160	1	[	[	-LRB-
en-wikipedia-org-1345	160	2	13]:171[14]:137	13]:171[14]:137	CD
en-wikipedia-org-1345	160	3	Nauta	Nauta	NNP
en-wikipedia-org-1345	160	4	defined	define	VBD
en-wikipedia-org-1345	160	5	semiotic	semiotic	JJ
en-wikipedia-org-1345	160	6	information	information	NN
en-wikipedia-org-1345	160	7	theory	theory	NN
en-wikipedia-org-1345	160	8	as	as	IN
en-wikipedia-org-1345	160	9	the	the	DT
en-wikipedia-org-1345	160	10	study	study	NN
en-wikipedia-org-1345	160	11	of	of	IN
en-wikipedia-org-1345	160	12	"	"	``
en-wikipedia-org-1345	160	13	the	the	DT
en-wikipedia-org-1345	160	14	internal	internal	JJ
en-wikipedia-org-1345	160	15	processes	process	NNS
en-wikipedia-org-1345	160	16	of	of	IN
en-wikipedia-org-1345	160	17	coding	code	VBG
en-wikipedia-org-1345	160	18	,	,	,
en-wikipedia-org-1345	160	19	filtering	filtering	NN
en-wikipedia-org-1345	160	20	,	,	,
en-wikipedia-org-1345	160	21	and	and	CC
en-wikipedia-org-1345	160	22	information	information	NN
en-wikipedia-org-1345	160	23	processing	processing	NN
en-wikipedia-org-1345	160	24	.	.	.
en-wikipedia-org-1345	161	1	"	"	``
en-wikipedia-org-1345	161	2	[	[	-LRB-
en-wikipedia-org-1345	161	3	13]:91	13]:91	CD
en-wikipedia-org-1345	161	4	Concepts	concept	NNS
en-wikipedia-org-1345	161	5	from	from	IN
en-wikipedia-org-1345	161	6	information	information	NN
en-wikipedia-org-1345	161	7	theory	theory	NN
en-wikipedia-org-1345	161	8	such	such	JJ
en-wikipedia-org-1345	161	9	as	as	IN
en-wikipedia-org-1345	161	10	redundancy	redundancy	NN
en-wikipedia-org-1345	161	11	and	and	CC
en-wikipedia-org-1345	161	12	code	code	NN
en-wikipedia-org-1345	161	13	control	control	NN
en-wikipedia-org-1345	161	14	have	have	VBP
en-wikipedia-org-1345	161	15	been	be	VBN
en-wikipedia-org-1345	161	16	used	use	VBN
en-wikipedia-org-1345	161	17	by	by	IN
en-wikipedia-org-1345	161	18	semioticians	semiotician	NNS
en-wikipedia-org-1345	161	19	such	such	JJ
en-wikipedia-org-1345	161	20	as	as	IN
en-wikipedia-org-1345	161	21	Umberto	Umberto	NNP
en-wikipedia-org-1345	161	22	Eco	Eco	NNP
en-wikipedia-org-1345	161	23	and	and	CC
en-wikipedia-org-1345	161	24	Ferruccio	Ferruccio	NNP
en-wikipedia-org-1345	161	25	Rossi	Rossi	NNP
en-wikipedia-org-1345	161	26	-	-	HYPH
en-wikipedia-org-1345	161	27	Landi	Landi	NNP
en-wikipedia-org-1345	161	28	to	to	TO
en-wikipedia-org-1345	161	29	explain	explain	VB
en-wikipedia-org-1345	161	30	ideology	ideology	NN
en-wikipedia-org-1345	161	31	as	as	IN
en-wikipedia-org-1345	161	32	a	a	DT
en-wikipedia-org-1345	161	33	form	form	NN
en-wikipedia-org-1345	161	34	of	of	IN
en-wikipedia-org-1345	161	35	message	message	NN
en-wikipedia-org-1345	161	36	transmission	transmission	NN
en-wikipedia-org-1345	161	37	whereby	whereby	WRB
en-wikipedia-org-1345	161	38	a	a	DT
en-wikipedia-org-1345	161	39	dominant	dominant	JJ
en-wikipedia-org-1345	161	40	social	social	JJ
en-wikipedia-org-1345	161	41	class	class	NN
en-wikipedia-org-1345	161	42	emits	emit	VBZ
en-wikipedia-org-1345	161	43	its	-PRON-	PRP$
en-wikipedia-org-1345	161	44	message	message	NN
en-wikipedia-org-1345	161	45	by	by	IN
en-wikipedia-org-1345	161	46	using	use	VBG
en-wikipedia-org-1345	161	47	signs	sign	NNS
en-wikipedia-org-1345	161	48	that	that	WDT
en-wikipedia-org-1345	161	49	exhibit	exhibit	VBP
en-wikipedia-org-1345	161	50	a	a	DT
en-wikipedia-org-1345	161	51	high	high	JJ
en-wikipedia-org-1345	161	52	degree	degree	NN
en-wikipedia-org-1345	161	53	of	of	IN
en-wikipedia-org-1345	161	54	redundancy	redundancy	NN
en-wikipedia-org-1345	161	55	such	such	JJ
en-wikipedia-org-1345	161	56	that	that	IN
en-wikipedia-org-1345	161	57	only	only	RB
en-wikipedia-org-1345	161	58	one	one	CD
en-wikipedia-org-1345	161	59	message	message	NN
en-wikipedia-org-1345	161	60	is	be	VBZ
en-wikipedia-org-1345	161	61	decoded	decode	VBN
en-wikipedia-org-1345	161	62	among	among	IN
en-wikipedia-org-1345	161	63	a	a	DT
en-wikipedia-org-1345	161	64	selection	selection	NN
en-wikipedia-org-1345	161	65	of	of	IN
en-wikipedia-org-1345	161	66	competing	compete	VBG
en-wikipedia-org-1345	161	67	ones	one	NNS
en-wikipedia-org-1345	161	68	.	.	.
en-wikipedia-org-1345	162	1	[	[	-LRB-
en-wikipedia-org-1345	162	2	15	15	CD
en-wikipedia-org-1345	162	3	]	]	-RRB-
en-wikipedia-org-1345	162	4	Miscellaneous	miscellaneous	JJ
en-wikipedia-org-1345	162	5	applications[edit	applications[edit	NFP
en-wikipedia-org-1345	162	6	]	]	-RRB-
en-wikipedia-org-1345	162	7	Information	information	NN
en-wikipedia-org-1345	162	8	theory	theory	NN
en-wikipedia-org-1345	162	9	also	also	RB
en-wikipedia-org-1345	162	10	has	have	VBZ
en-wikipedia-org-1345	162	11	applications	application	NNS
en-wikipedia-org-1345	162	12	in	in	IN
en-wikipedia-org-1345	162	13	Gambling	gambling	NN
en-wikipedia-org-1345	162	14	and	and	CC
en-wikipedia-org-1345	162	15	information	information	NN
en-wikipedia-org-1345	162	16	theory	theory	NN
en-wikipedia-org-1345	162	17	,	,	,
en-wikipedia-org-1345	162	18	black	black	JJ
en-wikipedia-org-1345	162	19	holes	hole	NNS
en-wikipedia-org-1345	162	20	,	,	,
en-wikipedia-org-1345	162	21	and	and	CC
en-wikipedia-org-1345	162	22	bioinformatics	bioinformatic	NNS
en-wikipedia-org-1345	162	23	.	.	.
en-wikipedia-org-1345	163	1	See	see	VB
en-wikipedia-org-1345	163	2	also[edit	also[edit	LS
en-wikipedia-org-1345	163	3	]	]	-RRB-
en-wikipedia-org-1345	163	4	Mathematics	mathematic	NNS
en-wikipedia-org-1345	163	5	portal	portal	JJ
en-wikipedia-org-1345	163	6	Algorithmic	algorithmic	JJ
en-wikipedia-org-1345	163	7	probability	probability	NN
en-wikipedia-org-1345	163	8	Bayesian	bayesian	JJ
en-wikipedia-org-1345	163	9	inference	inference	NN
en-wikipedia-org-1345	163	10	Communication	communication	NN
en-wikipedia-org-1345	163	11	theory	theory	NN
en-wikipedia-org-1345	163	12	Constructor	Constructor	NNP
en-wikipedia-org-1345	163	13	theory	theory	NN
en-wikipedia-org-1345	163	14	-	-	:
en-wikipedia-org-1345	163	15	a	a	DT
en-wikipedia-org-1345	163	16	generalization	generalization	NN
en-wikipedia-org-1345	163	17	of	of	IN
en-wikipedia-org-1345	163	18	information	information	NN
en-wikipedia-org-1345	163	19	theory	theory	NN
en-wikipedia-org-1345	163	20	that	that	WDT
en-wikipedia-org-1345	163	21	includes	include	VBZ
en-wikipedia-org-1345	163	22	quantum	quantum	JJ
en-wikipedia-org-1345	163	23	information	information	NN
en-wikipedia-org-1345	163	24	Inductive	inductive	JJ
en-wikipedia-org-1345	163	25	probability	probability	NN
en-wikipedia-org-1345	163	26	Info	Info	NNP
en-wikipedia-org-1345	163	27	-	-	HYPH
en-wikipedia-org-1345	163	28	metrics	metric	NNS
en-wikipedia-org-1345	163	29	Minimum	minimum	JJ
en-wikipedia-org-1345	163	30	message	message	NN
en-wikipedia-org-1345	163	31	length	length	NN
en-wikipedia-org-1345	163	32	Minimum	minimum	JJ
en-wikipedia-org-1345	163	33	description	description	NN
en-wikipedia-org-1345	163	34	length	length	NN
en-wikipedia-org-1345	163	35	List	list	NN
en-wikipedia-org-1345	163	36	of	of	IN
en-wikipedia-org-1345	163	37	important	important	JJ
en-wikipedia-org-1345	163	38	publications	publication	NNS
en-wikipedia-org-1345	163	39	Philosophy	philosophy	NN
en-wikipedia-org-1345	163	40	of	of	IN
en-wikipedia-org-1345	163	41	information	information	NN
en-wikipedia-org-1345	163	42	Applications[edit	Applications[edit	''
en-wikipedia-org-1345	163	43	]	]	-RRB-
en-wikipedia-org-1345	163	44	Active	active	JJ
en-wikipedia-org-1345	163	45	networking	networking	NN
en-wikipedia-org-1345	163	46	Cryptanalysis	Cryptanalysis	NNP
en-wikipedia-org-1345	163	47	Cryptography	Cryptography	NNP
en-wikipedia-org-1345	163	48	Cybernetics	Cybernetics	NNP
en-wikipedia-org-1345	163	49	Entropy	Entropy	NNP
en-wikipedia-org-1345	163	50	in	in	IN
en-wikipedia-org-1345	163	51	thermodynamics	thermodynamic	NNS
en-wikipedia-org-1345	163	52	and	and	CC
en-wikipedia-org-1345	163	53	information	information	NN
en-wikipedia-org-1345	163	54	theory	theory	NN
en-wikipedia-org-1345	163	55	Gambling	Gambling	NNP
en-wikipedia-org-1345	163	56	Intelligence	Intelligence	NNP
en-wikipedia-org-1345	163	57	(	(	-LRB-
en-wikipedia-org-1345	163	58	information	information	NN
en-wikipedia-org-1345	163	59	gathering	gather	VBG
en-wikipedia-org-1345	163	60	)	)	-RRB-
en-wikipedia-org-1345	163	61	Seismic	seismic	JJ
en-wikipedia-org-1345	163	62	exploration	exploration	NN
en-wikipedia-org-1345	163	63	History[edit	history[edit	NN
en-wikipedia-org-1345	163	64	]	]	-RRB-
en-wikipedia-org-1345	163	65	Hartley	Hartley	NNP
en-wikipedia-org-1345	163	66	,	,	,
en-wikipedia-org-1345	163	67	R.V.L.	R.V.L.	NNP
en-wikipedia-org-1345	164	1	History	history	NN
en-wikipedia-org-1345	164	2	of	of	IN
en-wikipedia-org-1345	164	3	information	information	NN
en-wikipedia-org-1345	164	4	theory	theory	NN
en-wikipedia-org-1345	164	5	Shannon	Shannon	NNP
en-wikipedia-org-1345	164	6	,	,	,
en-wikipedia-org-1345	164	7	C.E.	C.E.	NNP
en-wikipedia-org-1345	165	1	Timeline	timeline	NN
en-wikipedia-org-1345	165	2	of	of	IN
en-wikipedia-org-1345	165	3	information	information	NN
en-wikipedia-org-1345	165	4	theory	theory	NN
en-wikipedia-org-1345	165	5	Yockey	Yockey	NNP
en-wikipedia-org-1345	165	6	,	,	,
en-wikipedia-org-1345	165	7	H.P.	H.P.	NNP
en-wikipedia-org-1345	166	1	Theory[edit	theory[edit	LS
en-wikipedia-org-1345	166	2	]	]	-RRB-
en-wikipedia-org-1345	166	3	Coding	code	VBG
en-wikipedia-org-1345	166	4	theory	theory	NN
en-wikipedia-org-1345	166	5	Detection	detection	NN
en-wikipedia-org-1345	166	6	theory	theory	NN
en-wikipedia-org-1345	166	7	Estimation	estimation	NN
en-wikipedia-org-1345	166	8	theory	theory	NN
en-wikipedia-org-1345	166	9	Fisher	Fisher	NNP
en-wikipedia-org-1345	166	10	information	information	NN
en-wikipedia-org-1345	166	11	Information	information	NN
en-wikipedia-org-1345	166	12	algebra	algebra	NN
en-wikipedia-org-1345	166	13	Information	Information	NNP
en-wikipedia-org-1345	166	14	asymmetry	asymmetry	NN
en-wikipedia-org-1345	166	15	Information	information	NN
en-wikipedia-org-1345	166	16	field	field	NN
en-wikipedia-org-1345	166	17	theory	theory	NN
en-wikipedia-org-1345	166	18	Information	information	NN
en-wikipedia-org-1345	166	19	geometry	geometry	NN
en-wikipedia-org-1345	166	20	Information	information	NN
en-wikipedia-org-1345	166	21	theory	theory	NN
en-wikipedia-org-1345	166	22	and	and	CC
en-wikipedia-org-1345	166	23	measure	measure	NN
en-wikipedia-org-1345	166	24	theory	theory	NN
en-wikipedia-org-1345	166	25	Kolmogorov	kolmogorov	VB
en-wikipedia-org-1345	166	26	complexity	complexity	NN
en-wikipedia-org-1345	166	27	List	list	NN
en-wikipedia-org-1345	166	28	of	of	IN
en-wikipedia-org-1345	166	29	unsolved	unsolved	JJ
en-wikipedia-org-1345	166	30	problems	problem	NNS
en-wikipedia-org-1345	166	31	in	in	IN
en-wikipedia-org-1345	166	32	information	information	NN
en-wikipedia-org-1345	166	33	theory	theory	NN
en-wikipedia-org-1345	166	34	Logic	logic	NN
en-wikipedia-org-1345	166	35	of	of	IN
en-wikipedia-org-1345	166	36	information	information	NN
en-wikipedia-org-1345	166	37	Network	Network	NNP
en-wikipedia-org-1345	166	38	coding	code	VBG
en-wikipedia-org-1345	166	39	Philosophy	philosophy	NN
en-wikipedia-org-1345	166	40	of	of	IN
en-wikipedia-org-1345	166	41	information	information	NN
en-wikipedia-org-1345	166	42	Quantum	Quantum	NNP
en-wikipedia-org-1345	166	43	information	information	NN
en-wikipedia-org-1345	166	44	science	science	NN
en-wikipedia-org-1345	166	45	Source	Source	NNP
en-wikipedia-org-1345	166	46	coding	code	VBG
en-wikipedia-org-1345	166	47	Concepts[edit	concepts[edit	NN
en-wikipedia-org-1345	166	48	]	]	-RRB-
en-wikipedia-org-1345	166	49	Ban	Ban	NNP
en-wikipedia-org-1345	166	50	(	(	-LRB-
en-wikipedia-org-1345	166	51	unit	unit	NN
en-wikipedia-org-1345	166	52	)	)	-RRB-
en-wikipedia-org-1345	166	53	Channel	Channel	NNP
en-wikipedia-org-1345	166	54	capacity	capacity	NN
en-wikipedia-org-1345	166	55	Communication	Communication	NNP
en-wikipedia-org-1345	166	56	channel	channel	NN
en-wikipedia-org-1345	166	57	Communication	communication	NN
en-wikipedia-org-1345	166	58	source	source	NN
en-wikipedia-org-1345	166	59	Conditional	conditional	JJ
en-wikipedia-org-1345	166	60	entropy	entropy	JJ
en-wikipedia-org-1345	166	61	Covert	Covert	NNP
en-wikipedia-org-1345	166	62	channel	channel	NN
en-wikipedia-org-1345	166	63	Data	Data	NNP
en-wikipedia-org-1345	166	64	compression	compression	NN
en-wikipedia-org-1345	166	65	Decoder	Decoder	NNP
en-wikipedia-org-1345	166	66	Differential	Differential	NNP
en-wikipedia-org-1345	166	67	entropy	entropy	JJ
en-wikipedia-org-1345	166	68	Fungible	fungible	JJ
en-wikipedia-org-1345	166	69	information	information	NN
en-wikipedia-org-1345	166	70	Information	information	NN
en-wikipedia-org-1345	166	71	fluctuation	fluctuation	NN
en-wikipedia-org-1345	166	72	complexity	complexity	NN
en-wikipedia-org-1345	166	73	Information	information	NN
en-wikipedia-org-1345	166	74	entropy	entropy	JJ
en-wikipedia-org-1345	166	75	Joint	joint	JJ
en-wikipedia-org-1345	166	76	entropy	entropy	JJ
en-wikipedia-org-1345	166	77	Kullback	Kullback	NNP
en-wikipedia-org-1345	166	78	–	–	:
en-wikipedia-org-1345	166	79	Leibler	Leibler	NNP
en-wikipedia-org-1345	166	80	divergence	divergence	NN
en-wikipedia-org-1345	166	81	Mutual	mutual	JJ
en-wikipedia-org-1345	166	82	information	information	NN
en-wikipedia-org-1345	166	83	Pointwise	Pointwise	NNP
en-wikipedia-org-1345	166	84	mutual	mutual	JJ
en-wikipedia-org-1345	166	85	information	information	NN
en-wikipedia-org-1345	166	86	(	(	-LRB-
en-wikipedia-org-1345	166	87	PMI	PMI	NNP
en-wikipedia-org-1345	166	88	)	)	-RRB-
en-wikipedia-org-1345	166	89	Receiver	Receiver	NNP
en-wikipedia-org-1345	166	90	(	(	-LRB-
en-wikipedia-org-1345	166	91	information	information	NN
en-wikipedia-org-1345	166	92	theory	theory	NN
en-wikipedia-org-1345	166	93	)	)	-RRB-
en-wikipedia-org-1345	166	94	Redundancy	Redundancy	NNP
en-wikipedia-org-1345	166	95	Rényi	Rényi	NNP
en-wikipedia-org-1345	166	96	entropy	entropy	JJ
en-wikipedia-org-1345	166	97	Self	self	NN
en-wikipedia-org-1345	166	98	-	-	HYPH
en-wikipedia-org-1345	166	99	information	information	NN
en-wikipedia-org-1345	166	100	Unicity	Unicity	NNP
en-wikipedia-org-1345	166	101	distance	distance	NN
en-wikipedia-org-1345	166	102	Variety	Variety	NNP
en-wikipedia-org-1345	166	103	Hamming	Hamming	NNP
en-wikipedia-org-1345	166	104	distance	distance	NN
en-wikipedia-org-1345	166	105	References[edit	references[edit	NN
en-wikipedia-org-1345	166	106	]	]	-RRB-
en-wikipedia-org-1345	166	107	^	^	.
en-wikipedia-org-1345	166	108	Burnham	Burnham	NNP
en-wikipedia-org-1345	166	109	,	,	,
en-wikipedia-org-1345	166	110	K.	K.	NNP
en-wikipedia-org-1345	166	111	P.	P.	NNP
en-wikipedia-org-1345	166	112	and	and	CC
en-wikipedia-org-1345	166	113	Anderson	Anderson	NNP
en-wikipedia-org-1345	166	114	D.	D.	NNP
en-wikipedia-org-1345	166	115	R.	R.	NNP
en-wikipedia-org-1345	166	116	(	(	-LRB-
en-wikipedia-org-1345	166	117	2002	2002	CD
en-wikipedia-org-1345	166	118	)	)	-RRB-
en-wikipedia-org-1345	166	119	Model	Model	NNP
en-wikipedia-org-1345	166	120	Selection	Selection	NNP
en-wikipedia-org-1345	166	121	and	and	CC
en-wikipedia-org-1345	166	122	Multimodel	Multimodel	NNP
en-wikipedia-org-1345	166	123	Inference	Inference	NNP
en-wikipedia-org-1345	166	124	:	:	:
en-wikipedia-org-1345	166	125	A	a	DT
en-wikipedia-org-1345	166	126	Practical	Practical	NNP
en-wikipedia-org-1345	166	127	Information	information	NN
en-wikipedia-org-1345	166	128	-	-	HYPH
en-wikipedia-org-1345	166	129	Theoretic	Theoretic	NNP
en-wikipedia-org-1345	166	130	Approach	Approach	NNP
en-wikipedia-org-1345	166	131	,	,	,
en-wikipedia-org-1345	166	132	Second	Second	NNP
en-wikipedia-org-1345	166	133	Edition	Edition	NNP
en-wikipedia-org-1345	166	134	(	(	-LRB-
en-wikipedia-org-1345	166	135	Springer	Springer	NNP
en-wikipedia-org-1345	166	136	Science	Science	NNP
en-wikipedia-org-1345	166	137	,	,	,
en-wikipedia-org-1345	166	138	New	New	NNP
en-wikipedia-org-1345	166	139	York	York	NNP
en-wikipedia-org-1345	166	140	)	)	-RRB-
en-wikipedia-org-1345	166	141	ISBN	ISBN	NNP
en-wikipedia-org-1345	166	142	 	  	_SP
en-wikipedia-org-1345	166	143	978	978	CD
en-wikipedia-org-1345	166	144	-	-	HYPH
en-wikipedia-org-1345	166	145	0	0	CD
en-wikipedia-org-1345	166	146	-	-	HYPH
en-wikipedia-org-1345	166	147	387	387	CD
en-wikipedia-org-1345	166	148	-	-	HYPH
en-wikipedia-org-1345	166	149	95364	95364	CD
en-wikipedia-org-1345	166	150	-	-	SYM
en-wikipedia-org-1345	166	151	9	9	CD
en-wikipedia-org-1345	166	152	.	.	.
en-wikipedia-org-1345	167	1	^	^	NNP
en-wikipedia-org-1345	167	2	a	a	DT
en-wikipedia-org-1345	167	3	b	b	NNP
en-wikipedia-org-1345	167	4	F.	F.	NNP
en-wikipedia-org-1345	167	5	Rieke	Rieke	NNP
en-wikipedia-org-1345	167	6	;	;	:
en-wikipedia-org-1345	167	7	D.	D.	NNP
en-wikipedia-org-1345	167	8	Warland	Warland	NNP
en-wikipedia-org-1345	167	9	;	;	:
en-wikipedia-org-1345	167	10	R	R	NNP
en-wikipedia-org-1345	167	11	Ruyter	Ruyter	NNP
en-wikipedia-org-1345	167	12	van	van	NNP
en-wikipedia-org-1345	167	13	Steveninck	Steveninck	NNP
en-wikipedia-org-1345	167	14	;	;	:
en-wikipedia-org-1345	167	15	W	W	NNP
en-wikipedia-org-1345	167	16	Bialek	Bialek	NNP
en-wikipedia-org-1345	167	17	(	(	-LRB-
en-wikipedia-org-1345	167	18	1997	1997	CD
en-wikipedia-org-1345	167	19	)	)	-RRB-
en-wikipedia-org-1345	167	20	.	.	.
en-wikipedia-org-1345	168	1	Spikes	spike	NNS
en-wikipedia-org-1345	168	2	:	:	:
en-wikipedia-org-1345	168	3	Exploring	explore	VBG
en-wikipedia-org-1345	168	4	the	the	DT
en-wikipedia-org-1345	168	5	Neural	Neural	NNP
en-wikipedia-org-1345	168	6	Code	Code	NNP
en-wikipedia-org-1345	168	7	.	.	.
en-wikipedia-org-1345	169	1	The	the	DT
en-wikipedia-org-1345	169	2	MIT	MIT	NNP
en-wikipedia-org-1345	169	3	press	press	NN
en-wikipedia-org-1345	169	4	.	.	.
en-wikipedia-org-1345	170	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	170	2	 	  	_SP
en-wikipedia-org-1345	170	3	978	978	CD
en-wikipedia-org-1345	170	4	-	-	HYPH
en-wikipedia-org-1345	170	5	0262681087	0262681087	CD
en-wikipedia-org-1345	170	6	.	.	.
en-wikipedia-org-1345	171	1	^	^	NNP
en-wikipedia-org-1345	171	2	Delgado	Delgado	NNP
en-wikipedia-org-1345	171	3	-	-	HYPH
en-wikipedia-org-1345	171	4	Bonal	Bonal	NNP
en-wikipedia-org-1345	171	5	,	,	,
en-wikipedia-org-1345	171	6	Alfonso	Alfonso	NNP
en-wikipedia-org-1345	171	7	;	;	:
en-wikipedia-org-1345	171	8	Martín	Martín	NNP
en-wikipedia-org-1345	171	9	-	-	HYPH
en-wikipedia-org-1345	171	10	Torres	Torres	NNP
en-wikipedia-org-1345	171	11	,	,	,
en-wikipedia-org-1345	171	12	Javier	Javier	NNP
en-wikipedia-org-1345	171	13	(	(	-LRB-
en-wikipedia-org-1345	171	14	2016	2016	CD
en-wikipedia-org-1345	171	15	-	-	SYM
en-wikipedia-org-1345	171	16	11	11	CD
en-wikipedia-org-1345	171	17	-	-	HYPH
en-wikipedia-org-1345	171	18	03	03	CD
en-wikipedia-org-1345	171	19	)	)	-RRB-
en-wikipedia-org-1345	171	20	.	.	.
en-wikipedia-org-1345	172	1	"	"	``
en-wikipedia-org-1345	172	2	Human	human	JJ
en-wikipedia-org-1345	172	3	vision	vision	NN
en-wikipedia-org-1345	172	4	is	be	VBZ
en-wikipedia-org-1345	172	5	determined	determine	VBN
en-wikipedia-org-1345	172	6	based	base	VBN
en-wikipedia-org-1345	172	7	on	on	IN
en-wikipedia-org-1345	172	8	information	information	NN
en-wikipedia-org-1345	172	9	theory	theory	NN
en-wikipedia-org-1345	172	10	"	"	''
en-wikipedia-org-1345	172	11	.	.	.
en-wikipedia-org-1345	173	1	Scientific	Scientific	NNP
en-wikipedia-org-1345	173	2	Reports	report	NNS
en-wikipedia-org-1345	173	3	.	.	.
en-wikipedia-org-1345	174	1	6	6	CD
en-wikipedia-org-1345	174	2	(	(	-LRB-
en-wikipedia-org-1345	174	3	1	1	CD
en-wikipedia-org-1345	174	4	)	)	-RRB-
en-wikipedia-org-1345	174	5	:	:	:
en-wikipedia-org-1345	174	6	36038	36038	CD
en-wikipedia-org-1345	174	7	.	.	.
en-wikipedia-org-1345	175	1	Bibcode:2016NatSR	bibcode:2016natsr	LS
en-wikipedia-org-1345	175	2	...	...	.
en-wikipedia-org-1345	175	3	636038D.	636038d.	UH
en-wikipedia-org-1345	176	1	doi:10.1038	doi:10.1038	NNP
en-wikipedia-org-1345	176	2	/	/	SYM
en-wikipedia-org-1345	176	3	srep36038	srep36038	CD
en-wikipedia-org-1345	176	4	.	.	.
en-wikipedia-org-1345	177	1	ISSN	issn	NN
en-wikipedia-org-1345	177	2	 	  	_SP
en-wikipedia-org-1345	177	3	2045	2045	CD
en-wikipedia-org-1345	177	4	-	-	SYM
en-wikipedia-org-1345	177	5	2322	2322	CD
en-wikipedia-org-1345	177	6	.	.	.
en-wikipedia-org-1345	178	1	PMC	PMC	NNP
en-wikipedia-org-1345	178	2	 	  	_SP
en-wikipedia-org-1345	178	3	5093619	5093619	CD
en-wikipedia-org-1345	178	4	.	.	.
en-wikipedia-org-1345	179	1	PMID	PMID	NNP
en-wikipedia-org-1345	179	2	 	  	_SP
en-wikipedia-org-1345	179	3	27808236	27808236	CD
en-wikipedia-org-1345	179	4	.	.	.
en-wikipedia-org-1345	180	1	^	^	NNP
en-wikipedia-org-1345	180	2	cf	cf	NNP
en-wikipedia-org-1345	180	3	;	;	:
en-wikipedia-org-1345	180	4	Huelsenbeck	Huelsenbeck	NNP
en-wikipedia-org-1345	180	5	,	,	,
en-wikipedia-org-1345	180	6	J.	J.	NNP
en-wikipedia-org-1345	180	7	P.	P.	NNP
en-wikipedia-org-1345	180	8	;	;	:
en-wikipedia-org-1345	180	9	Ronquist	Ronquist	NNP
en-wikipedia-org-1345	180	10	,	,	,
en-wikipedia-org-1345	180	11	F.	F.	NNP
en-wikipedia-org-1345	180	12	;	;	:
en-wikipedia-org-1345	180	13	Nielsen	Nielsen	NNP
en-wikipedia-org-1345	180	14	,	,	,
en-wikipedia-org-1345	180	15	R.	R.	NNP
en-wikipedia-org-1345	180	16	;	;	:
en-wikipedia-org-1345	180	17	Bollback	Bollback	NNP
en-wikipedia-org-1345	180	18	,	,	,
en-wikipedia-org-1345	180	19	J.	J.	NNP
en-wikipedia-org-1345	180	20	P.	P.	NNP
en-wikipedia-org-1345	180	21	(	(	-LRB-
en-wikipedia-org-1345	180	22	2001	2001	CD
en-wikipedia-org-1345	180	23	)	)	-RRB-
en-wikipedia-org-1345	180	24	.	.	.
en-wikipedia-org-1345	181	1	"	"	``
en-wikipedia-org-1345	181	2	Bayesian	bayesian	JJ
en-wikipedia-org-1345	181	3	inference	inference	NN
en-wikipedia-org-1345	181	4	of	of	IN
en-wikipedia-org-1345	181	5	phylogeny	phylogeny	NN
en-wikipedia-org-1345	181	6	and	and	CC
en-wikipedia-org-1345	181	7	its	-PRON-	PRP$
en-wikipedia-org-1345	181	8	impact	impact	NN
en-wikipedia-org-1345	181	9	on	on	IN
en-wikipedia-org-1345	181	10	evolutionary	evolutionary	JJ
en-wikipedia-org-1345	181	11	biology	biology	NN
en-wikipedia-org-1345	181	12	"	"	''
en-wikipedia-org-1345	181	13	.	.	.
en-wikipedia-org-1345	182	1	Science	science	NN
en-wikipedia-org-1345	182	2	.	.	.
en-wikipedia-org-1345	183	1	294	294	CD
en-wikipedia-org-1345	183	2	(	(	-LRB-
en-wikipedia-org-1345	183	3	5550	5550	CD
en-wikipedia-org-1345	183	4	)	)	-RRB-
en-wikipedia-org-1345	183	5	:	:	:
en-wikipedia-org-1345	183	6	2310–2314	2310–2314	CD
en-wikipedia-org-1345	183	7	.	.	.
en-wikipedia-org-1345	184	1	Bibcode:2001Sci	Bibcode:2001Sci	NNS
en-wikipedia-org-1345	184	2	...	...	NFP
en-wikipedia-org-1345	184	3	294.2310H.	294.2310h.	CD
en-wikipedia-org-1345	185	1	doi:10.1126	doi:10.1126	VB
en-wikipedia-org-1345	185	2	/	/	SYM
en-wikipedia-org-1345	185	3	science.1065889	science.1065889	NN
en-wikipedia-org-1345	185	4	.	.	.
en-wikipedia-org-1345	186	1	PMID	PMID	NNP
en-wikipedia-org-1345	186	2	 	  	_SP
en-wikipedia-org-1345	186	3	11743192	11743192	CD
en-wikipedia-org-1345	186	4	.	.	.
en-wikipedia-org-1345	187	1	S2CID	S2CID	NNS
en-wikipedia-org-1345	187	2	 	  	_SP
en-wikipedia-org-1345	187	3	2138288	2138288	CD
en-wikipedia-org-1345	187	4	.	.	.
en-wikipedia-org-1345	188	1	^	^	NNP
en-wikipedia-org-1345	188	2	Allikmets	Allikmets	NNPS
en-wikipedia-org-1345	188	3	,	,	,
en-wikipedia-org-1345	188	4	Rando	Rando	NNP
en-wikipedia-org-1345	188	5	;	;	:
en-wikipedia-org-1345	188	6	Wasserman	Wasserman	NNP
en-wikipedia-org-1345	188	7	,	,	,
en-wikipedia-org-1345	188	8	Wyeth	Wyeth	NNP
en-wikipedia-org-1345	188	9	W.	W.	NNP
en-wikipedia-org-1345	188	10	;	;	:
en-wikipedia-org-1345	188	11	Hutchinson	Hutchinson	NNP
en-wikipedia-org-1345	188	12	,	,	,
en-wikipedia-org-1345	188	13	Amy	Amy	NNP
en-wikipedia-org-1345	188	14	;	;	:
en-wikipedia-org-1345	188	15	Smallwood	Smallwood	NNP
en-wikipedia-org-1345	188	16	,	,	,
en-wikipedia-org-1345	188	17	Philip	Philip	NNP
en-wikipedia-org-1345	188	18	;	;	:
en-wikipedia-org-1345	188	19	Nathans	Nathans	NNP
en-wikipedia-org-1345	188	20	,	,	,
en-wikipedia-org-1345	188	21	Jeremy	Jeremy	NNP
en-wikipedia-org-1345	188	22	;	;	:
en-wikipedia-org-1345	188	23	Rogan	Rogan	NNP
en-wikipedia-org-1345	188	24	,	,	,
en-wikipedia-org-1345	188	25	Peter	Peter	NNP
en-wikipedia-org-1345	188	26	K.	K.	NNP
en-wikipedia-org-1345	188	27	(	(	-LRB-
en-wikipedia-org-1345	188	28	1998	1998	CD
en-wikipedia-org-1345	188	29	)	)	-RRB-
en-wikipedia-org-1345	188	30	.	.	.
en-wikipedia-org-1345	189	1	"	"	``
en-wikipedia-org-1345	189	2	Thomas	Thomas	NNP
en-wikipedia-org-1345	189	3	D.	D.	NNP
en-wikipedia-org-1345	189	4	Schneider	Schneider	NNP
en-wikipedia-org-1345	189	5	]	]	-RRB-
en-wikipedia-org-1345	189	6	,	,	,
en-wikipedia-org-1345	189	7	Michael	Michael	NNP
en-wikipedia-org-1345	189	8	Dean	Dean	NNP
en-wikipedia-org-1345	189	9	(	(	-LRB-
en-wikipedia-org-1345	189	10	1998	1998	CD
en-wikipedia-org-1345	189	11	)	)	-RRB-
en-wikipedia-org-1345	189	12	Organization	organization	NN
en-wikipedia-org-1345	189	13	of	of	IN
en-wikipedia-org-1345	189	14	the	the	DT
en-wikipedia-org-1345	189	15	ABCR	ABCR	NNP
en-wikipedia-org-1345	189	16	gene	gene	NN
en-wikipedia-org-1345	189	17	:	:	:
en-wikipedia-org-1345	189	18	analysis	analysis	NN
en-wikipedia-org-1345	189	19	of	of	IN
en-wikipedia-org-1345	189	20	promoter	promoter	NN
en-wikipedia-org-1345	189	21	and	and	CC
en-wikipedia-org-1345	189	22	splice	splice	NN
en-wikipedia-org-1345	189	23	junction	junction	NN
en-wikipedia-org-1345	189	24	sequences	sequence	NNS
en-wikipedia-org-1345	189	25	"	"	''
en-wikipedia-org-1345	189	26	.	.	.
en-wikipedia-org-1345	190	1	Gene	gene	NN
en-wikipedia-org-1345	190	2	.	.	.
en-wikipedia-org-1345	191	1	215	215	CD
en-wikipedia-org-1345	191	2	(	(	-LRB-
en-wikipedia-org-1345	191	3	1	1	CD
en-wikipedia-org-1345	191	4	)	)	-RRB-
en-wikipedia-org-1345	191	5	:	:	:
en-wikipedia-org-1345	191	6	111–122	111–122	CD
en-wikipedia-org-1345	191	7	.	.	.
en-wikipedia-org-1345	192	1	doi:10.1016	doi:10.1016	JJ
en-wikipedia-org-1345	192	2	/	/	SYM
en-wikipedia-org-1345	192	3	s0378	s0378	NNP
en-wikipedia-org-1345	192	4	-	-	HYPH
en-wikipedia-org-1345	192	5	1119(98)00269	1119(98)00269	NNP
en-wikipedia-org-1345	192	6	-	-	HYPH
en-wikipedia-org-1345	192	7	8	8	CD
en-wikipedia-org-1345	192	8	.	.	.
en-wikipedia-org-1345	193	1	PMID	PMID	NNP
en-wikipedia-org-1345	193	2	 	  	_SP
en-wikipedia-org-1345	193	3	9666097	9666097	CD
en-wikipedia-org-1345	193	4	.	.	.
en-wikipedia-org-1345	194	1	^	^	NNP
en-wikipedia-org-1345	194	2	Jaynes	Jaynes	NNP
en-wikipedia-org-1345	194	3	,	,	,
en-wikipedia-org-1345	194	4	E.	E.	NNP
en-wikipedia-org-1345	194	5	T.	T.	NNP
en-wikipedia-org-1345	194	6	(	(	-LRB-
en-wikipedia-org-1345	194	7	1957	1957	CD
en-wikipedia-org-1345	194	8	)	)	-RRB-
en-wikipedia-org-1345	194	9	.	.	.
en-wikipedia-org-1345	195	1	"	"	``
en-wikipedia-org-1345	195	2	Information	Information	NNP
en-wikipedia-org-1345	195	3	Theory	Theory	NNP
en-wikipedia-org-1345	195	4	and	and	CC
en-wikipedia-org-1345	195	5	Statistical	Statistical	NNP
en-wikipedia-org-1345	195	6	Mechanics	Mechanics	NNP
en-wikipedia-org-1345	195	7	"	"	''
en-wikipedia-org-1345	195	8	.	.	.
en-wikipedia-org-1345	196	1	Phys	phys	NN
en-wikipedia-org-1345	196	2	.	.	.
en-wikipedia-org-1345	197	1	Rev.	Rev.	NNP
en-wikipedia-org-1345	198	1	106	106	CD
en-wikipedia-org-1345	198	2	(	(	-LRB-
en-wikipedia-org-1345	198	3	4	4	CD
en-wikipedia-org-1345	198	4	)	)	-RRB-
en-wikipedia-org-1345	198	5	:	:	:
en-wikipedia-org-1345	198	6	620	620	CD
en-wikipedia-org-1345	198	7	.	.	.
en-wikipedia-org-1345	199	1	Bibcode:1957PhRv	bibcode:1957phrv	ADD
en-wikipedia-org-1345	199	2	..	..	NFP
en-wikipedia-org-1345	199	3	106	106	CD
en-wikipedia-org-1345	199	4	..	..	NFP
en-wikipedia-org-1345	199	5	620J.	620j.	CD
en-wikipedia-org-1345	200	1	doi:10.1103	doi:10.1103	NNP
en-wikipedia-org-1345	200	2	/	/	SYM
en-wikipedia-org-1345	200	3	physrev.106.620	physrev.106.620	NNP
en-wikipedia-org-1345	200	4	.	.	.
en-wikipedia-org-1345	201	1	^	^	NNP
en-wikipedia-org-1345	201	2	Bennett	Bennett	NNP
en-wikipedia-org-1345	201	3	,	,	,
en-wikipedia-org-1345	201	4	Charles	Charles	NNP
en-wikipedia-org-1345	201	5	H.	H.	NNP
en-wikipedia-org-1345	201	6	;	;	:
en-wikipedia-org-1345	201	7	Li	Li	NNP
en-wikipedia-org-1345	201	8	,	,	,
en-wikipedia-org-1345	201	9	Ming	Ming	NNP
en-wikipedia-org-1345	201	10	;	;	:
en-wikipedia-org-1345	201	11	Ma	Ma	NNP
en-wikipedia-org-1345	201	12	,	,	,
en-wikipedia-org-1345	201	13	Bin	Bin	NNP
en-wikipedia-org-1345	201	14	(	(	-LRB-
en-wikipedia-org-1345	201	15	2003	2003	CD
en-wikipedia-org-1345	201	16	)	)	-RRB-
en-wikipedia-org-1345	201	17	.	.	.
en-wikipedia-org-1345	202	1	"	"	``
en-wikipedia-org-1345	202	2	Chain	Chain	NNP
en-wikipedia-org-1345	202	3	Letters	Letters	NNPS
en-wikipedia-org-1345	202	4	and	and	CC
en-wikipedia-org-1345	202	5	Evolutionary	Evolutionary	NNP
en-wikipedia-org-1345	202	6	Histories	Histories	NNPS
en-wikipedia-org-1345	202	7	"	"	''
en-wikipedia-org-1345	202	8	.	.	.
en-wikipedia-org-1345	203	1	Scientific	scientific	JJ
en-wikipedia-org-1345	203	2	American	American	NNP
en-wikipedia-org-1345	203	3	.	.	.
en-wikipedia-org-1345	204	1	288	288	CD
en-wikipedia-org-1345	204	2	(	(	-LRB-
en-wikipedia-org-1345	204	3	6	6	CD
en-wikipedia-org-1345	204	4	)	)	-RRB-
en-wikipedia-org-1345	204	5	:	:	:
en-wikipedia-org-1345	204	6	76–81	76–81	LS
en-wikipedia-org-1345	204	7	.	.	.
en-wikipedia-org-1345	205	1	Bibcode:2003SciAm.288f	Bibcode:2003SciAm.288f	NNP
en-wikipedia-org-1345	205	2	..	..	.
en-wikipedia-org-1345	205	3	76B.	76b.	LS
en-wikipedia-org-1345	206	1	doi:10.1038	doi:10.1038	NNP
en-wikipedia-org-1345	206	2	/	/	SYM
en-wikipedia-org-1345	206	3	scientificamerican0603	scientificamerican0603	NNP
en-wikipedia-org-1345	206	4	-	-	HYPH
en-wikipedia-org-1345	206	5	76	76	NNP
en-wikipedia-org-1345	206	6	.	.	.
en-wikipedia-org-1345	207	1	PMID	PMID	NNP
en-wikipedia-org-1345	207	2	 	  	_SP
en-wikipedia-org-1345	207	3	12764940	12764940	CD
en-wikipedia-org-1345	207	4	.	.	.
en-wikipedia-org-1345	208	1	Archived	archived	JJ
en-wikipedia-org-1345	208	2	from	from	IN
en-wikipedia-org-1345	208	3	the	the	DT
en-wikipedia-org-1345	208	4	original	original	NN
en-wikipedia-org-1345	208	5	on	on	IN
en-wikipedia-org-1345	208	6	2007	2007	CD
en-wikipedia-org-1345	208	7	-	-	SYM
en-wikipedia-org-1345	208	8	10	10	CD
en-wikipedia-org-1345	208	9	-	-	SYM
en-wikipedia-org-1345	208	10	07	07	CD
en-wikipedia-org-1345	208	11	.	.	.
en-wikipedia-org-1345	209	1	Retrieved	retrieve	VBN
en-wikipedia-org-1345	209	2	2008	2008	CD
en-wikipedia-org-1345	209	3	-	-	SYM
en-wikipedia-org-1345	209	4	03	03	CD
en-wikipedia-org-1345	209	5	-	-	HYPH
en-wikipedia-org-1345	209	6	11	11	CD
en-wikipedia-org-1345	209	7	.	.	.
en-wikipedia-org-1345	210	1	^	^	NNP
en-wikipedia-org-1345	210	2	David	David	NNP
en-wikipedia-org-1345	210	3	R.	R.	NNP
en-wikipedia-org-1345	210	4	Anderson	Anderson	NNP
en-wikipedia-org-1345	210	5	(	(	-LRB-
en-wikipedia-org-1345	210	6	November	November	NNP
en-wikipedia-org-1345	210	7	1	1	CD
en-wikipedia-org-1345	210	8	,	,	,
en-wikipedia-org-1345	210	9	2003	2003	CD
en-wikipedia-org-1345	210	10	)	)	-RRB-
en-wikipedia-org-1345	210	11	.	.	.
en-wikipedia-org-1345	211	1	"	"	``
en-wikipedia-org-1345	211	2	Some	some	DT
en-wikipedia-org-1345	211	3	background	background	NN
en-wikipedia-org-1345	211	4	on	on	IN
en-wikipedia-org-1345	211	5	why	why	WRB
en-wikipedia-org-1345	211	6	people	people	NNS
en-wikipedia-org-1345	211	7	in	in	IN
en-wikipedia-org-1345	211	8	the	the	DT
en-wikipedia-org-1345	211	9	empirical	empirical	JJ
en-wikipedia-org-1345	211	10	sciences	science	NNS
en-wikipedia-org-1345	211	11	may	may	MD
en-wikipedia-org-1345	211	12	want	want	VB
en-wikipedia-org-1345	211	13	to	to	TO
en-wikipedia-org-1345	211	14	better	well	RBR
en-wikipedia-org-1345	211	15	understand	understand	VB
en-wikipedia-org-1345	211	16	the	the	DT
en-wikipedia-org-1345	211	17	information	information	NN
en-wikipedia-org-1345	211	18	-	-	HYPH
en-wikipedia-org-1345	211	19	theoretic	theoretic	JJ
en-wikipedia-org-1345	211	20	methods	method	NNS
en-wikipedia-org-1345	211	21	"	"	''
en-wikipedia-org-1345	211	22	(	(	-LRB-
en-wikipedia-org-1345	211	23	PDF	PDF	NNP
en-wikipedia-org-1345	211	24	)	)	-RRB-
en-wikipedia-org-1345	211	25	.	.	.
en-wikipedia-org-1345	212	1	Archived	archived	JJ
en-wikipedia-org-1345	212	2	from	from	IN
en-wikipedia-org-1345	212	3	the	the	DT
en-wikipedia-org-1345	212	4	original	original	JJ
en-wikipedia-org-1345	212	5	(	(	-LRB-
en-wikipedia-org-1345	212	6	PDF	PDF	NNP
en-wikipedia-org-1345	212	7	)	)	-RRB-
en-wikipedia-org-1345	212	8	on	on	IN
en-wikipedia-org-1345	212	9	July	July	NNP
en-wikipedia-org-1345	212	10	23	23	CD
en-wikipedia-org-1345	212	11	,	,	,
en-wikipedia-org-1345	212	12	2011	2011	CD
en-wikipedia-org-1345	212	13	.	.	.
en-wikipedia-org-1345	213	1	Retrieved	Retrieved	NNP
en-wikipedia-org-1345	213	2	2010	2010	CD
en-wikipedia-org-1345	213	3	-	-	SYM
en-wikipedia-org-1345	213	4	06	06	CD
en-wikipedia-org-1345	213	5	-	-	HYPH
en-wikipedia-org-1345	213	6	23	23	CD
en-wikipedia-org-1345	213	7	.	.	.
en-wikipedia-org-1345	214	1	^	^	NNP
en-wikipedia-org-1345	214	2	Fazlollah	Fazlollah	NNP
en-wikipedia-org-1345	214	3	M.	M.	NNP
en-wikipedia-org-1345	214	4	Reza	Reza	NNP
en-wikipedia-org-1345	214	5	(	(	-LRB-
en-wikipedia-org-1345	214	6	1994	1994	CD
en-wikipedia-org-1345	214	7	)	)	-RRB-
en-wikipedia-org-1345	214	8	[	[	-LRB-
en-wikipedia-org-1345	214	9	1961	1961	CD
en-wikipedia-org-1345	214	10	]	]	-RRB-
en-wikipedia-org-1345	214	11	.	.	.
en-wikipedia-org-1345	215	1	An	an	DT
en-wikipedia-org-1345	215	2	Introduction	introduction	NN
en-wikipedia-org-1345	215	3	to	to	IN
en-wikipedia-org-1345	215	4	Information	information	NN
en-wikipedia-org-1345	215	5	Theory	Theory	NNP
en-wikipedia-org-1345	215	6	.	.	.
en-wikipedia-org-1345	216	1	Dover	Dover	NNP
en-wikipedia-org-1345	216	2	Publications	Publications	NNP
en-wikipedia-org-1345	216	3	,	,	,
en-wikipedia-org-1345	216	4	Inc.	Inc.	NNP
en-wikipedia-org-1345	216	5	,	,	,
en-wikipedia-org-1345	216	6	New	New	NNP
en-wikipedia-org-1345	216	7	York	York	NNP
en-wikipedia-org-1345	216	8	.	.	.
en-wikipedia-org-1345	217	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	217	2	 	  	_SP
en-wikipedia-org-1345	217	3	0	0	CD
en-wikipedia-org-1345	217	4	-	-	HYPH
en-wikipedia-org-1345	217	5	486	486	CD
en-wikipedia-org-1345	217	6	-	-	HYPH
en-wikipedia-org-1345	217	7	68210	68210	CD
en-wikipedia-org-1345	217	8	-	-	HYPH
en-wikipedia-org-1345	217	9	2	2	CD
en-wikipedia-org-1345	217	10	.	.	.
en-wikipedia-org-1345	218	1	^	^	NN
en-wikipedia-org-1345	218	2	Robert	Robert	NNP
en-wikipedia-org-1345	218	3	B.	B.	NNP
en-wikipedia-org-1345	218	4	Ash	Ash	NNP
en-wikipedia-org-1345	218	5	(	(	-LRB-
en-wikipedia-org-1345	218	6	1990	1990	CD
en-wikipedia-org-1345	218	7	)	)	-RRB-
en-wikipedia-org-1345	218	8	[	[	-LRB-
en-wikipedia-org-1345	218	9	1965	1965	CD
en-wikipedia-org-1345	218	10	]	]	-RRB-
en-wikipedia-org-1345	218	11	.	.	.
en-wikipedia-org-1345	219	1	Information	Information	NNP
en-wikipedia-org-1345	219	2	Theory	Theory	NNP
en-wikipedia-org-1345	219	3	.	.	.
en-wikipedia-org-1345	220	1	Dover	Dover	NNP
en-wikipedia-org-1345	220	2	Publications	Publications	NNP
en-wikipedia-org-1345	220	3	,	,	,
en-wikipedia-org-1345	220	4	Inc.	Inc.	NNP
en-wikipedia-org-1345	220	5	ISBN	ISBN	NNP
en-wikipedia-org-1345	220	6	 	  	_SP
en-wikipedia-org-1345	220	7	0	0	CD
en-wikipedia-org-1345	220	8	-	-	HYPH
en-wikipedia-org-1345	220	9	486	486	CD
en-wikipedia-org-1345	220	10	-	-	HYPH
en-wikipedia-org-1345	220	11	66521	66521	CD
en-wikipedia-org-1345	220	12	-	-	HYPH
en-wikipedia-org-1345	220	13	6	6	CD
en-wikipedia-org-1345	220	14	.	.	.
en-wikipedia-org-1345	221	1	^	^	NNP
en-wikipedia-org-1345	221	2	Jerry	Jerry	NNP
en-wikipedia-org-1345	221	3	D.	D.	NNP
en-wikipedia-org-1345	221	4	Gibson	Gibson	NNP
en-wikipedia-org-1345	221	5	(	(	-LRB-
en-wikipedia-org-1345	221	6	1998	1998	CD
en-wikipedia-org-1345	221	7	)	)	-RRB-
en-wikipedia-org-1345	221	8	.	.	.
en-wikipedia-org-1345	222	1	Digital	Digital	NNP
en-wikipedia-org-1345	222	2	Compression	Compression	NNP
en-wikipedia-org-1345	222	3	for	for	IN
en-wikipedia-org-1345	222	4	Multimedia	Multimedia	NNP
en-wikipedia-org-1345	222	5	:	:	:
en-wikipedia-org-1345	222	6	Principles	Principles	NNPS
en-wikipedia-org-1345	222	7	and	and	CC
en-wikipedia-org-1345	222	8	Standards	Standards	NNPS
en-wikipedia-org-1345	222	9	.	.	.
en-wikipedia-org-1345	223	1	Morgan	Morgan	NNP
en-wikipedia-org-1345	223	2	Kaufmann	Kaufmann	NNP
en-wikipedia-org-1345	223	3	.	.	.
en-wikipedia-org-1345	224	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	224	2	 	  	_SP
en-wikipedia-org-1345	224	3	1	1	CD
en-wikipedia-org-1345	224	4	-	-	HYPH
en-wikipedia-org-1345	224	5	55860	55860	CD
en-wikipedia-org-1345	224	6	-	-	HYPH
en-wikipedia-org-1345	224	7	369	369	CD
en-wikipedia-org-1345	224	8	-	-	SYM
en-wikipedia-org-1345	224	9	7	7	CD
en-wikipedia-org-1345	224	10	.	.	.
en-wikipedia-org-1345	225	1	^	^	NNP
en-wikipedia-org-1345	225	2	Haggerty	Haggerty	NNP
en-wikipedia-org-1345	225	3	,	,	,
en-wikipedia-org-1345	225	4	Patrick	Patrick	NNP
en-wikipedia-org-1345	225	5	E.	E.	NNP
en-wikipedia-org-1345	225	6	(	(	-LRB-
en-wikipedia-org-1345	225	7	1981	1981	CD
en-wikipedia-org-1345	225	8	)	)	-RRB-
en-wikipedia-org-1345	225	9	.	.	.
en-wikipedia-org-1345	226	1	"	"	``
en-wikipedia-org-1345	226	2	The	the	DT
en-wikipedia-org-1345	226	3	corporation	corporation	NN
en-wikipedia-org-1345	226	4	and	and	CC
en-wikipedia-org-1345	226	5	innovation	innovation	NN
en-wikipedia-org-1345	226	6	"	"	''
en-wikipedia-org-1345	226	7	.	.	.
en-wikipedia-org-1345	227	1	Strategic	Strategic	NNP
en-wikipedia-org-1345	227	2	Management	Management	NNP
en-wikipedia-org-1345	227	3	Journal	Journal	NNP
en-wikipedia-org-1345	227	4	.	.	.
en-wikipedia-org-1345	228	1	2	2	CD
en-wikipedia-org-1345	228	2	(	(	-LRB-
en-wikipedia-org-1345	228	3	2	2	CD
en-wikipedia-org-1345	228	4	)	)	-RRB-
en-wikipedia-org-1345	228	5	:	:	:
en-wikipedia-org-1345	228	6	97–118	97–118	NN
en-wikipedia-org-1345	228	7	.	.	.
en-wikipedia-org-1345	229	1	doi:10.1002	doi:10.1002	NNP
en-wikipedia-org-1345	229	2	/	/	SYM
en-wikipedia-org-1345	229	3	smj.4250020202	smj.4250020202	ADD
en-wikipedia-org-1345	229	4	.	.	.
en-wikipedia-org-1345	230	1	^	^	NNP
en-wikipedia-org-1345	230	2	a	a	DT
en-wikipedia-org-1345	230	3	b	b	NN
en-wikipedia-org-1345	230	4	Nauta	Nauta	NNP
en-wikipedia-org-1345	230	5	,	,	,
en-wikipedia-org-1345	230	6	Doede	Doede	NNP
en-wikipedia-org-1345	230	7	(	(	-LRB-
en-wikipedia-org-1345	230	8	1972	1972	CD
en-wikipedia-org-1345	230	9	)	)	-RRB-
en-wikipedia-org-1345	230	10	.	.	.
en-wikipedia-org-1345	231	1	The	the	DT
en-wikipedia-org-1345	231	2	Meaning	Meaning	NNP
en-wikipedia-org-1345	231	3	of	of	IN
en-wikipedia-org-1345	231	4	Information	Information	NNP
en-wikipedia-org-1345	231	5	.	.	.
en-wikipedia-org-1345	232	1	The	the	DT
en-wikipedia-org-1345	232	2	Hague	Hague	NNP
en-wikipedia-org-1345	232	3	:	:	:
en-wikipedia-org-1345	232	4	Mouton	Mouton	NNP
en-wikipedia-org-1345	232	5	.	.	.
en-wikipedia-org-1345	233	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	233	2	 	  	_SP
en-wikipedia-org-1345	233	3	9789027919960	9789027919960	CD
en-wikipedia-org-1345	233	4	.	.	.
en-wikipedia-org-1345	234	1	^	^	NNP
en-wikipedia-org-1345	234	2	Nöth	Nöth	NNP
en-wikipedia-org-1345	234	3	,	,	,
en-wikipedia-org-1345	234	4	Winfried	Winfried	NNP
en-wikipedia-org-1345	234	5	(	(	-LRB-
en-wikipedia-org-1345	234	6	January	January	NNP
en-wikipedia-org-1345	234	7	2012	2012	CD
en-wikipedia-org-1345	234	8	)	)	-RRB-
en-wikipedia-org-1345	234	9	.	.	.
en-wikipedia-org-1345	235	1	"	"	``
en-wikipedia-org-1345	235	2	Charles	Charles	NNP
en-wikipedia-org-1345	235	3	S.	S.	NNP
en-wikipedia-org-1345	235	4	Peirce	Peirce	NNP
en-wikipedia-org-1345	235	5	's	's	POS
en-wikipedia-org-1345	235	6	theory	theory	NN
en-wikipedia-org-1345	235	7	of	of	IN
en-wikipedia-org-1345	235	8	information	information	NN
en-wikipedia-org-1345	235	9	:	:	:
en-wikipedia-org-1345	235	10	a	a	DT
en-wikipedia-org-1345	235	11	theory	theory	NN
en-wikipedia-org-1345	235	12	of	of	IN
en-wikipedia-org-1345	235	13	the	the	DT
en-wikipedia-org-1345	235	14	growth	growth	NN
en-wikipedia-org-1345	235	15	of	of	IN
en-wikipedia-org-1345	235	16	symbols	symbol	NNS
en-wikipedia-org-1345	235	17	and	and	CC
en-wikipedia-org-1345	235	18	of	of	IN
en-wikipedia-org-1345	235	19	knowledge	knowledge	NN
en-wikipedia-org-1345	235	20	"	"	''
en-wikipedia-org-1345	235	21	.	.	.
en-wikipedia-org-1345	236	1	Cybernetics	Cybernetics	NNP
en-wikipedia-org-1345	236	2	and	and	CC
en-wikipedia-org-1345	236	3	Human	Human	NNP
en-wikipedia-org-1345	236	4	Knowing	Knowing	NNP
en-wikipedia-org-1345	236	5	.	.	.
en-wikipedia-org-1345	237	1	19	19	CD
en-wikipedia-org-1345	237	2	(	(	-LRB-
en-wikipedia-org-1345	237	3	1–2	1–2	CD
en-wikipedia-org-1345	237	4	)	)	-RRB-
en-wikipedia-org-1345	237	5	:	:	:
en-wikipedia-org-1345	237	6	137–161	137–161	CD
en-wikipedia-org-1345	237	7	.	.	.
en-wikipedia-org-1345	238	1	^	^	NNP
en-wikipedia-org-1345	238	2	Nöth	Nöth	NNP
en-wikipedia-org-1345	238	3	,	,	,
en-wikipedia-org-1345	238	4	Winfried	Winfried	NNP
en-wikipedia-org-1345	238	5	(	(	-LRB-
en-wikipedia-org-1345	238	6	1981	1981	CD
en-wikipedia-org-1345	238	7	)	)	-RRB-
en-wikipedia-org-1345	238	8	.	.	.
en-wikipedia-org-1345	239	1	"	"	``
en-wikipedia-org-1345	239	2	Semiotics	Semiotics	NNPS
en-wikipedia-org-1345	239	3	of	of	IN
en-wikipedia-org-1345	239	4	ideology	ideology	NN
en-wikipedia-org-1345	239	5	"	"	''
en-wikipedia-org-1345	239	6	.	.	.
en-wikipedia-org-1345	240	1	Semiotica	Semiotica	NNP
en-wikipedia-org-1345	240	2	,	,	,
en-wikipedia-org-1345	240	3	Issue	Issue	NNP
en-wikipedia-org-1345	240	4	148	148	CD
en-wikipedia-org-1345	240	5	.	.	.
en-wikipedia-org-1345	241	1	The	the	DT
en-wikipedia-org-1345	241	2	classic	classic	JJ
en-wikipedia-org-1345	241	3	work[edit	work[edit	CD
en-wikipedia-org-1345	241	4	]	]	-RRB-
en-wikipedia-org-1345	241	5	Shannon	Shannon	NNP
en-wikipedia-org-1345	241	6	,	,	,
en-wikipedia-org-1345	241	7	C.E.	C.E.	NNP
en-wikipedia-org-1345	242	1	(	(	-LRB-
en-wikipedia-org-1345	242	2	1948	1948	CD
en-wikipedia-org-1345	242	3	)	)	-RRB-
en-wikipedia-org-1345	242	4	,	,	,
en-wikipedia-org-1345	242	5	"	"	``
en-wikipedia-org-1345	242	6	A	a	DT
en-wikipedia-org-1345	242	7	Mathematical	mathematical	JJ
en-wikipedia-org-1345	242	8	Theory	Theory	NNP
en-wikipedia-org-1345	242	9	of	of	IN
en-wikipedia-org-1345	242	10	Communication	Communication	NNP
en-wikipedia-org-1345	242	11	"	"	''
en-wikipedia-org-1345	242	12	,	,	,
en-wikipedia-org-1345	242	13	Bell	Bell	NNP
en-wikipedia-org-1345	242	14	System	System	NNP
en-wikipedia-org-1345	242	15	Technical	Technical	NNP
en-wikipedia-org-1345	242	16	Journal	Journal	NNP
en-wikipedia-org-1345	242	17	,	,	,
en-wikipedia-org-1345	242	18	27	27	CD
en-wikipedia-org-1345	242	19	,	,	,
en-wikipedia-org-1345	242	20	pp	pp	NNP
en-wikipedia-org-1345	242	21	.	.	.
en-wikipedia-org-1345	243	1	379–423	379–423	CD
en-wikipedia-org-1345	243	2	&	&	CC
en-wikipedia-org-1345	243	3	623–656	623–656	NNP
en-wikipedia-org-1345	243	4	,	,	,
en-wikipedia-org-1345	243	5	July	July	NNP
en-wikipedia-org-1345	243	6	&	&	CC
en-wikipedia-org-1345	243	7	October	October	NNP
en-wikipedia-org-1345	243	8	,	,	,
en-wikipedia-org-1345	243	9	1948	1948	CD
en-wikipedia-org-1345	243	10	.	.	.
en-wikipedia-org-1345	244	1	PDF	PDF	NNP
en-wikipedia-org-1345	244	2	.	.	.
en-wikipedia-org-1345	245	1	Notes	note	NNS
en-wikipedia-org-1345	245	2	and	and	CC
en-wikipedia-org-1345	245	3	other	other	JJ
en-wikipedia-org-1345	245	4	formats	format	NNS
en-wikipedia-org-1345	245	5	.	.	.
en-wikipedia-org-1345	246	1	R.V.L.	R.V.L.	NNP
en-wikipedia-org-1345	247	1	Hartley	Hartley	NNP
en-wikipedia-org-1345	247	2	,	,	,
en-wikipedia-org-1345	247	3	"	"	``
en-wikipedia-org-1345	247	4	Transmission	Transmission	NNP
en-wikipedia-org-1345	247	5	of	of	IN
en-wikipedia-org-1345	247	6	Information	Information	NNP
en-wikipedia-org-1345	247	7	"	"	''
en-wikipedia-org-1345	247	8	,	,	,
en-wikipedia-org-1345	247	9	Bell	Bell	NNP
en-wikipedia-org-1345	247	10	System	System	NNP
en-wikipedia-org-1345	247	11	Technical	Technical	NNP
en-wikipedia-org-1345	247	12	Journal	Journal	NNP
en-wikipedia-org-1345	247	13	,	,	,
en-wikipedia-org-1345	247	14	July	July	NNP
en-wikipedia-org-1345	247	15	1928	1928	CD
en-wikipedia-org-1345	247	16	Andrey	Andrey	NNP
en-wikipedia-org-1345	247	17	Kolmogorov	Kolmogorov	NNP
en-wikipedia-org-1345	247	18	(	(	-LRB-
en-wikipedia-org-1345	247	19	1968	1968	CD
en-wikipedia-org-1345	247	20	)	)	-RRB-
en-wikipedia-org-1345	247	21	,	,	,
en-wikipedia-org-1345	247	22	"	"	``
en-wikipedia-org-1345	247	23	Three	three	CD
en-wikipedia-org-1345	247	24	approaches	approach	NNS
en-wikipedia-org-1345	247	25	to	to	IN
en-wikipedia-org-1345	247	26	the	the	DT
en-wikipedia-org-1345	247	27	quantitative	quantitative	JJ
en-wikipedia-org-1345	247	28	definition	definition	NN
en-wikipedia-org-1345	247	29	of	of	IN
en-wikipedia-org-1345	247	30	information	information	NN
en-wikipedia-org-1345	247	31	"	"	''
en-wikipedia-org-1345	247	32	in	in	IN
en-wikipedia-org-1345	247	33	International	International	NNP
en-wikipedia-org-1345	247	34	Journal	Journal	NNP
en-wikipedia-org-1345	247	35	of	of	IN
en-wikipedia-org-1345	247	36	Computer	Computer	NNP
en-wikipedia-org-1345	247	37	Mathematics	Mathematics	NNP
en-wikipedia-org-1345	247	38	.	.	.
en-wikipedia-org-1345	248	1	Other	other	JJ
en-wikipedia-org-1345	248	2	journal	journal	NN
en-wikipedia-org-1345	248	3	articles[edit	articles[edit	,
en-wikipedia-org-1345	248	4	]	]	-RRB-
en-wikipedia-org-1345	248	5	J.	J.	NNP
en-wikipedia-org-1345	248	6	L.	L.	NNP
en-wikipedia-org-1345	248	7	Kelly	Kelly	NNP
en-wikipedia-org-1345	248	8	,	,	,
en-wikipedia-org-1345	248	9	Jr.	Jr.	NNP
en-wikipedia-org-1345	248	10	,	,	,
en-wikipedia-org-1345	248	11	Princeton	Princeton	NNP
en-wikipedia-org-1345	248	12	,	,	,
en-wikipedia-org-1345	248	13	"	"	``
en-wikipedia-org-1345	248	14	A	a	DT
en-wikipedia-org-1345	248	15	New	new	JJ
en-wikipedia-org-1345	248	16	Interpretation	interpretation	NN
en-wikipedia-org-1345	248	17	of	of	IN
en-wikipedia-org-1345	248	18	Information	information	NN
en-wikipedia-org-1345	248	19	Rate	Rate	NNP
en-wikipedia-org-1345	248	20	"	"	''
en-wikipedia-org-1345	248	21	Bell	Bell	NNP
en-wikipedia-org-1345	248	22	System	System	NNP
en-wikipedia-org-1345	248	23	Technical	Technical	NNP
en-wikipedia-org-1345	248	24	Journal	Journal	NNP
en-wikipedia-org-1345	248	25	,	,	,
en-wikipedia-org-1345	248	26	Vol	Vol	NNP
en-wikipedia-org-1345	248	27	.	.	.
en-wikipedia-org-1345	249	1	35	35	CD
en-wikipedia-org-1345	249	2	,	,	,
en-wikipedia-org-1345	249	3	July	July	NNP
en-wikipedia-org-1345	249	4	1956	1956	CD
en-wikipedia-org-1345	249	5	,	,	,
en-wikipedia-org-1345	249	6	pp	pp	NNP
en-wikipedia-org-1345	249	7	.	.	.
en-wikipedia-org-1345	250	1	917–26	917–26	CD
en-wikipedia-org-1345	250	2	.	.	.
en-wikipedia-org-1345	251	1	R.	R.	NNP
en-wikipedia-org-1345	251	2	Landauer	Landauer	NNP
en-wikipedia-org-1345	251	3	,	,	,
en-wikipedia-org-1345	251	4	IEEE.org	ieee.org	ADD
en-wikipedia-org-1345	251	5	,	,	,
en-wikipedia-org-1345	251	6	"	"	``
en-wikipedia-org-1345	251	7	Information	information	NN
en-wikipedia-org-1345	251	8	is	be	VBZ
en-wikipedia-org-1345	251	9	Physical	physical	JJ
en-wikipedia-org-1345	251	10	"	"	``
en-wikipedia-org-1345	251	11	Proc	Proc	NNP
en-wikipedia-org-1345	251	12	.	.	.
en-wikipedia-org-1345	252	1	Workshop	Workshop	NNP
en-wikipedia-org-1345	252	2	on	on	IN
en-wikipedia-org-1345	252	3	Physics	Physics	NNP
en-wikipedia-org-1345	252	4	and	and	CC
en-wikipedia-org-1345	252	5	Computation	Computation	NNP
en-wikipedia-org-1345	252	6	PhysComp'92	PhysComp'92	''
en-wikipedia-org-1345	252	7	(	(	-LRB-
en-wikipedia-org-1345	252	8	IEEE	IEEE	NNP
en-wikipedia-org-1345	252	9	Comp	Comp	NNP
en-wikipedia-org-1345	252	10	.	.	.
en-wikipedia-org-1345	253	1	Sci	Sci	NNP
en-wikipedia-org-1345	253	2	.	.	.
en-wikipedia-org-1345	253	3	Press	Press	NNP
en-wikipedia-org-1345	253	4	,	,	,
en-wikipedia-org-1345	253	5	Los	Los	NNP
en-wikipedia-org-1345	253	6	Alamitos	Alamitos	NNP
en-wikipedia-org-1345	253	7	,	,	,
en-wikipedia-org-1345	253	8	1993	1993	CD
en-wikipedia-org-1345	253	9	)	)	-RRB-
en-wikipedia-org-1345	253	10	pp	pp	NNP
en-wikipedia-org-1345	253	11	.	.	.
en-wikipedia-org-1345	254	1	1–4	1–4	LS
en-wikipedia-org-1345	254	2	.	.	.
en-wikipedia-org-1345	255	1	Landauer	Landauer	NNP
en-wikipedia-org-1345	255	2	,	,	,
en-wikipedia-org-1345	255	3	R.	R.	NNP
en-wikipedia-org-1345	255	4	(	(	-LRB-
en-wikipedia-org-1345	255	5	1961	1961	CD
en-wikipedia-org-1345	255	6	)	)	-RRB-
en-wikipedia-org-1345	255	7	.	.	.
en-wikipedia-org-1345	256	1	"	"	``
en-wikipedia-org-1345	256	2	Irreversibility	Irreversibility	NNP
en-wikipedia-org-1345	256	3	and	and	CC
en-wikipedia-org-1345	256	4	Heat	Heat	NNP
en-wikipedia-org-1345	256	5	Generation	Generation	NNP
en-wikipedia-org-1345	256	6	in	in	IN
en-wikipedia-org-1345	256	7	the	the	DT
en-wikipedia-org-1345	256	8	Computing	Computing	NNP
en-wikipedia-org-1345	256	9	Process	Process	NNP
en-wikipedia-org-1345	256	10	"	"	''
en-wikipedia-org-1345	256	11	(	(	-LRB-
en-wikipedia-org-1345	256	12	PDF	PDF	NNP
en-wikipedia-org-1345	256	13	)	)	-RRB-
en-wikipedia-org-1345	256	14	.	.	.
en-wikipedia-org-1345	257	1	IBM	IBM	NNP
en-wikipedia-org-1345	257	2	J.	J.	NNP
en-wikipedia-org-1345	257	3	Res	Res	NNP
en-wikipedia-org-1345	257	4	.	.	.
en-wikipedia-org-1345	258	1	Dev	Dev	NNP
en-wikipedia-org-1345	258	2	.	.	.
en-wikipedia-org-1345	259	1	5	5	CD
en-wikipedia-org-1345	259	2	(	(	-LRB-
en-wikipedia-org-1345	259	3	3	3	CD
en-wikipedia-org-1345	259	4	)	)	-RRB-
en-wikipedia-org-1345	259	5	:	:	:
en-wikipedia-org-1345	259	6	183–191	183–191	CD
en-wikipedia-org-1345	259	7	.	.	.
en-wikipedia-org-1345	260	1	doi:10.1147	doi:10.1147	NNP
en-wikipedia-org-1345	260	2	/	/	SYM
en-wikipedia-org-1345	260	3	rd.53.0183	rd.53.0183	JJ
en-wikipedia-org-1345	260	4	.	.	.
en-wikipedia-org-1345	261	1	Timme	Timme	NNP
en-wikipedia-org-1345	261	2	,	,	,
en-wikipedia-org-1345	261	3	Nicholas	Nicholas	NNP
en-wikipedia-org-1345	261	4	;	;	:
en-wikipedia-org-1345	261	5	Alford	Alford	NNP
en-wikipedia-org-1345	261	6	,	,	,
en-wikipedia-org-1345	261	7	Wesley	Wesley	NNP
en-wikipedia-org-1345	261	8	;	;	:
en-wikipedia-org-1345	261	9	Flecker	Flecker	NNP
en-wikipedia-org-1345	261	10	,	,	,
en-wikipedia-org-1345	261	11	Benjamin	Benjamin	NNP
en-wikipedia-org-1345	261	12	;	;	:
en-wikipedia-org-1345	261	13	Beggs	Beggs	NNP
en-wikipedia-org-1345	261	14	,	,	,
en-wikipedia-org-1345	261	15	John	John	NNP
en-wikipedia-org-1345	261	16	M.	M.	NNP
en-wikipedia-org-1345	261	17	(	(	-LRB-
en-wikipedia-org-1345	261	18	2012	2012	CD
en-wikipedia-org-1345	261	19	)	)	-RRB-
en-wikipedia-org-1345	261	20	.	.	.
en-wikipedia-org-1345	262	1	"	"	``
en-wikipedia-org-1345	262	2	Multivariate	multivariate	JJ
en-wikipedia-org-1345	262	3	information	information	NN
en-wikipedia-org-1345	262	4	measures	measure	NNS
en-wikipedia-org-1345	262	5	:	:	:
en-wikipedia-org-1345	262	6	an	an	DT
en-wikipedia-org-1345	262	7	experimentalist	experimentalist	NN
en-wikipedia-org-1345	262	8	's	's	POS
en-wikipedia-org-1345	262	9	perspective	perspective	NN
en-wikipedia-org-1345	262	10	"	"	''
en-wikipedia-org-1345	262	11	.	.	.
en-wikipedia-org-1345	263	1	arXiv:1111.6857	arxiv:1111.6857	NN
en-wikipedia-org-1345	263	2	[	[	-LRB-
en-wikipedia-org-1345	263	3	cs	cs	NNP
en-wikipedia-org-1345	263	4	.	.	.
en-wikipedia-org-1345	263	5	IT	it	NN
en-wikipedia-org-1345	263	6	]	]	-RRB-
en-wikipedia-org-1345	263	7	.	.	.
en-wikipedia-org-1345	264	1	Textbooks	textbook	NNS
en-wikipedia-org-1345	264	2	on	on	IN
en-wikipedia-org-1345	264	3	information	information	NN
en-wikipedia-org-1345	264	4	theory[edit	theory[edit	CD
en-wikipedia-org-1345	264	5	]	]	-RRB-
en-wikipedia-org-1345	264	6	Arndt	Arndt	NNP
en-wikipedia-org-1345	264	7	,	,	,
en-wikipedia-org-1345	264	8	C.	C.	NNP
en-wikipedia-org-1345	264	9	Information	Information	NNP
en-wikipedia-org-1345	264	10	Measures	Measures	NNPS
en-wikipedia-org-1345	264	11	,	,	,
en-wikipedia-org-1345	264	12	Information	information	NN
en-wikipedia-org-1345	264	13	and	and	CC
en-wikipedia-org-1345	264	14	its	-PRON-	PRP$
en-wikipedia-org-1345	264	15	Description	description	NN
en-wikipedia-org-1345	264	16	in	in	IN
en-wikipedia-org-1345	264	17	Science	Science	NNP
en-wikipedia-org-1345	264	18	and	and	CC
en-wikipedia-org-1345	264	19	Engineering	Engineering	NNP
en-wikipedia-org-1345	264	20	(	(	-LRB-
en-wikipedia-org-1345	264	21	Springer	Springer	NNP
en-wikipedia-org-1345	264	22	Series	Series	NNP
en-wikipedia-org-1345	264	23	:	:	:
en-wikipedia-org-1345	264	24	Signals	signal	NNS
en-wikipedia-org-1345	264	25	and	and	CC
en-wikipedia-org-1345	264	26	Communication	Communication	NNP
en-wikipedia-org-1345	264	27	Technology	Technology	NNP
en-wikipedia-org-1345	264	28	)	)	-RRB-
en-wikipedia-org-1345	264	29	,	,	,
en-wikipedia-org-1345	264	30	2004	2004	CD
en-wikipedia-org-1345	264	31	,	,	,
en-wikipedia-org-1345	264	32	ISBN	ISBN	NNP
en-wikipedia-org-1345	264	33	 	  	_SP
en-wikipedia-org-1345	264	34	978	978	CD
en-wikipedia-org-1345	264	35	-	-	HYPH
en-wikipedia-org-1345	264	36	3	3	CD
en-wikipedia-org-1345	264	37	-	-	HYPH
en-wikipedia-org-1345	264	38	540	540	CD
en-wikipedia-org-1345	264	39	-	-	HYPH
en-wikipedia-org-1345	264	40	40855	40855	CD
en-wikipedia-org-1345	264	41	-	-	HYPH
en-wikipedia-org-1345	264	42	0	0	NFP
en-wikipedia-org-1345	264	43	Ash	Ash	NNP
en-wikipedia-org-1345	264	44	,	,	,
en-wikipedia-org-1345	264	45	RB	RB	NNP
en-wikipedia-org-1345	264	46	.	.	.
en-wikipedia-org-1345	265	1	Information	Information	NNP
en-wikipedia-org-1345	265	2	Theory	Theory	NNP
en-wikipedia-org-1345	265	3	.	.	.
en-wikipedia-org-1345	266	1	New	New	NNP
en-wikipedia-org-1345	266	2	York	York	NNP
en-wikipedia-org-1345	266	3	:	:	:
en-wikipedia-org-1345	266	4	Interscience	interscience	NN
en-wikipedia-org-1345	266	5	,	,	,
en-wikipedia-org-1345	266	6	1965	1965	CD
en-wikipedia-org-1345	266	7	.	.	.
en-wikipedia-org-1345	267	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	267	2	 	  	_SP
en-wikipedia-org-1345	267	3	0	0	CD
en-wikipedia-org-1345	267	4	-	-	HYPH
en-wikipedia-org-1345	267	5	470	470	CD
en-wikipedia-org-1345	267	6	-	-	HYPH
en-wikipedia-org-1345	267	7	03445	03445	CD
en-wikipedia-org-1345	267	8	-	-	HYPH
en-wikipedia-org-1345	267	9	9	9	CD
en-wikipedia-org-1345	267	10	.	.	.
en-wikipedia-org-1345	268	1	New	New	NNP
en-wikipedia-org-1345	268	2	York	York	NNP
en-wikipedia-org-1345	268	3	:	:	:
en-wikipedia-org-1345	268	4	Dover	Dover	NNP
en-wikipedia-org-1345	268	5	1990	1990	CD
en-wikipedia-org-1345	268	6	.	.	.
en-wikipedia-org-1345	269	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	269	2	 	  	_SP
en-wikipedia-org-1345	269	3	0	0	CD
en-wikipedia-org-1345	269	4	-	-	HYPH
en-wikipedia-org-1345	269	5	486	486	CD
en-wikipedia-org-1345	269	6	-	-	HYPH
en-wikipedia-org-1345	269	7	66521	66521	CD
en-wikipedia-org-1345	269	8	-	-	HYPH
en-wikipedia-org-1345	269	9	6	6	CD
en-wikipedia-org-1345	269	10	Gallager	Gallager	NNP
en-wikipedia-org-1345	269	11	,	,	,
en-wikipedia-org-1345	269	12	R.	R.	NNP
en-wikipedia-org-1345	269	13	Information	Information	NNP
en-wikipedia-org-1345	269	14	Theory	Theory	NNP
en-wikipedia-org-1345	269	15	and	and	CC
en-wikipedia-org-1345	269	16	Reliable	Reliable	NNP
en-wikipedia-org-1345	269	17	Communication	communication	NN
en-wikipedia-org-1345	269	18	.	.	.
en-wikipedia-org-1345	270	1	New	New	NNP
en-wikipedia-org-1345	270	2	York	York	NNP
en-wikipedia-org-1345	270	3	:	:	:
en-wikipedia-org-1345	270	4	John	John	NNP
en-wikipedia-org-1345	270	5	Wiley	Wiley	NNP
en-wikipedia-org-1345	270	6	and	and	CC
en-wikipedia-org-1345	270	7	Sons	Sons	NNPS
en-wikipedia-org-1345	270	8	,	,	,
en-wikipedia-org-1345	270	9	1968	1968	CD
en-wikipedia-org-1345	270	10	.	.	.
en-wikipedia-org-1345	271	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	271	2	 	  	_SP
en-wikipedia-org-1345	271	3	0	0	CD
en-wikipedia-org-1345	271	4	-	-	HYPH
en-wikipedia-org-1345	271	5	471	471	CD
en-wikipedia-org-1345	271	6	-	-	HYPH
en-wikipedia-org-1345	271	7	29048	29048	CD
en-wikipedia-org-1345	271	8	-	-	HYPH
en-wikipedia-org-1345	271	9	3	3	CD
en-wikipedia-org-1345	271	10	Goldman	Goldman	NNP
en-wikipedia-org-1345	271	11	,	,	,
en-wikipedia-org-1345	271	12	S.	S.	NNP
en-wikipedia-org-1345	271	13	Information	Information	NNP
en-wikipedia-org-1345	271	14	Theory	Theory	NNP
en-wikipedia-org-1345	271	15	.	.	.
en-wikipedia-org-1345	272	1	New	New	NNP
en-wikipedia-org-1345	272	2	York	York	NNP
en-wikipedia-org-1345	272	3	:	:	:
en-wikipedia-org-1345	272	4	Prentice	Prentice	NNP
en-wikipedia-org-1345	272	5	Hall	Hall	NNP
en-wikipedia-org-1345	272	6	,	,	,
en-wikipedia-org-1345	272	7	1953	1953	CD
en-wikipedia-org-1345	272	8	.	.	.
en-wikipedia-org-1345	273	1	New	New	NNP
en-wikipedia-org-1345	273	2	York	York	NNP
en-wikipedia-org-1345	273	3	:	:	:
en-wikipedia-org-1345	273	4	Dover	Dover	NNP
en-wikipedia-org-1345	273	5	1968	1968	CD
en-wikipedia-org-1345	273	6	ISBN	ISBN	NNP
en-wikipedia-org-1345	273	7	 	  	_SP
en-wikipedia-org-1345	273	8	0	0	CD
en-wikipedia-org-1345	273	9	-	-	HYPH
en-wikipedia-org-1345	273	10	486	486	CD
en-wikipedia-org-1345	273	11	-	-	HYPH
en-wikipedia-org-1345	273	12	62209	62209	CD
en-wikipedia-org-1345	273	13	-	-	SYM
en-wikipedia-org-1345	273	14	6	6	CD
en-wikipedia-org-1345	273	15	,	,	,
en-wikipedia-org-1345	273	16	2005	2005	CD
en-wikipedia-org-1345	273	17	ISBN	ISBN	NNP
en-wikipedia-org-1345	273	18	 	  	_SP
en-wikipedia-org-1345	273	19	0	0	CD
en-wikipedia-org-1345	273	20	-	-	HYPH
en-wikipedia-org-1345	273	21	486	486	CD
en-wikipedia-org-1345	273	22	-	-	HYPH
en-wikipedia-org-1345	273	23	44271	44271	CD
en-wikipedia-org-1345	273	24	-	-	SYM
en-wikipedia-org-1345	273	25	3	3	CD
en-wikipedia-org-1345	273	26	Cover	Cover	NNP
en-wikipedia-org-1345	273	27	,	,	,
en-wikipedia-org-1345	273	28	Thomas	Thomas	NNP
en-wikipedia-org-1345	273	29	;	;	:
en-wikipedia-org-1345	273	30	Thomas	Thomas	NNP
en-wikipedia-org-1345	273	31	,	,	,
en-wikipedia-org-1345	273	32	Joy	Joy	NNP
en-wikipedia-org-1345	273	33	A.	A.	NNP
en-wikipedia-org-1345	274	1	(	(	-LRB-
en-wikipedia-org-1345	274	2	2006	2006	CD
en-wikipedia-org-1345	274	3	)	)	-RRB-
en-wikipedia-org-1345	274	4	.	.	.
en-wikipedia-org-1345	275	1	Elements	element	NNS
en-wikipedia-org-1345	275	2	of	of	IN
en-wikipedia-org-1345	275	3	information	information	NN
en-wikipedia-org-1345	275	4	theory	theory	NN
en-wikipedia-org-1345	275	5	(	(	-LRB-
en-wikipedia-org-1345	275	6	2nd	2nd	NNP
en-wikipedia-org-1345	275	7	ed	ed	NNP
en-wikipedia-org-1345	275	8	.	.	.
en-wikipedia-org-1345	275	9	)	)	-RRB-
en-wikipedia-org-1345	275	10	.	.	.
en-wikipedia-org-1345	276	1	New	New	NNP
en-wikipedia-org-1345	276	2	York	York	NNP
en-wikipedia-org-1345	276	3	:	:	:
en-wikipedia-org-1345	276	4	Wiley	Wiley	NNP
en-wikipedia-org-1345	276	5	-	-	HYPH
en-wikipedia-org-1345	276	6	Interscience	Interscience	NNP
en-wikipedia-org-1345	276	7	.	.	.
en-wikipedia-org-1345	277	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	277	2	 	  	_SP
en-wikipedia-org-1345	277	3	0	0	CD
en-wikipedia-org-1345	277	4	-	-	HYPH
en-wikipedia-org-1345	277	5	471	471	CD
en-wikipedia-org-1345	277	6	-	-	HYPH
en-wikipedia-org-1345	277	7	24195	24195	CD
en-wikipedia-org-1345	277	8	-	-	SYM
en-wikipedia-org-1345	277	9	4	4	CD
en-wikipedia-org-1345	277	10	.	.	.
en-wikipedia-org-1345	278	1	Csiszar	Csiszar	NNP
en-wikipedia-org-1345	278	2	,	,	,
en-wikipedia-org-1345	278	3	I	-PRON-	PRP
en-wikipedia-org-1345	278	4	,	,	,
en-wikipedia-org-1345	278	5	Korner	Korner	NNP
en-wikipedia-org-1345	278	6	,	,	,
en-wikipedia-org-1345	278	7	J.	J.	NNP
en-wikipedia-org-1345	279	1	Information	information	NN
en-wikipedia-org-1345	279	2	Theory	theory	NN
en-wikipedia-org-1345	279	3	:	:	:
en-wikipedia-org-1345	279	4	Coding	code	VBG
en-wikipedia-org-1345	279	5	Theorems	Theorems	NNPS
en-wikipedia-org-1345	279	6	for	for	IN
en-wikipedia-org-1345	279	7	Discrete	Discrete	NNP
en-wikipedia-org-1345	279	8	Memoryless	Memoryless	NNP
en-wikipedia-org-1345	279	9	Systems	Systems	NNP
en-wikipedia-org-1345	279	10	Akademiai	Akademiai	NNP
en-wikipedia-org-1345	279	11	Kiado	Kiado	NNP
en-wikipedia-org-1345	279	12	:	:	:
en-wikipedia-org-1345	279	13	2nd	2nd	NNP
en-wikipedia-org-1345	279	14	edition	edition	NN
en-wikipedia-org-1345	279	15	,	,	,
en-wikipedia-org-1345	279	16	1997	1997	CD
en-wikipedia-org-1345	279	17	.	.	.
en-wikipedia-org-1345	280	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	280	2	 	  	_SP
en-wikipedia-org-1345	280	3	963	963	CD
en-wikipedia-org-1345	280	4	-	-	HYPH
en-wikipedia-org-1345	280	5	05	05	CD
en-wikipedia-org-1345	280	6	-	-	HYPH
en-wikipedia-org-1345	280	7	7440	7440	CD
en-wikipedia-org-1345	280	8	-	-	HYPH
en-wikipedia-org-1345	280	9	3	3	CD
en-wikipedia-org-1345	280	10	MacKay	MacKay	NNP
en-wikipedia-org-1345	280	11	,	,	,
en-wikipedia-org-1345	280	12	David	David	NNP
en-wikipedia-org-1345	280	13	J.	J.	NNP
en-wikipedia-org-1345	281	1	C	C	NNP
en-wikipedia-org-1345	281	2	..	..	.
en-wikipedia-org-1345	281	3	Information	Information	NNP
en-wikipedia-org-1345	281	4	Theory	Theory	NNP
en-wikipedia-org-1345	281	5	,	,	,
en-wikipedia-org-1345	281	6	Inference	Inference	NNP
en-wikipedia-org-1345	281	7	,	,	,
en-wikipedia-org-1345	281	8	and	and	CC
en-wikipedia-org-1345	281	9	Learning	Learning	NNP
en-wikipedia-org-1345	281	10	Algorithms	Algorithms	NNP
en-wikipedia-org-1345	281	11	Cambridge	Cambridge	NNP
en-wikipedia-org-1345	281	12	:	:	:
en-wikipedia-org-1345	281	13	Cambridge	Cambridge	NNP
en-wikipedia-org-1345	281	14	University	University	NNP
en-wikipedia-org-1345	281	15	Press	Press	NNP
en-wikipedia-org-1345	281	16	,	,	,
en-wikipedia-org-1345	281	17	2003	2003	CD
en-wikipedia-org-1345	281	18	.	.	.
en-wikipedia-org-1345	282	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	282	2	 	  	_SP
en-wikipedia-org-1345	282	3	0	0	CD
en-wikipedia-org-1345	282	4	-	-	HYPH
en-wikipedia-org-1345	282	5	521	521	CD
en-wikipedia-org-1345	282	6	-	-	HYPH
en-wikipedia-org-1345	282	7	64298	64298	CD
en-wikipedia-org-1345	282	8	-	-	HYPH
en-wikipedia-org-1345	282	9	1	1	CD
en-wikipedia-org-1345	282	10	Mansuripur	Mansuripur	NNP
en-wikipedia-org-1345	282	11	,	,	,
en-wikipedia-org-1345	282	12	M.	M.	NNP
en-wikipedia-org-1345	282	13	Introduction	Introduction	NNP
en-wikipedia-org-1345	282	14	to	to	IN
en-wikipedia-org-1345	282	15	Information	Information	NNP
en-wikipedia-org-1345	282	16	Theory	Theory	NNP
en-wikipedia-org-1345	282	17	.	.	.
en-wikipedia-org-1345	283	1	New	New	NNP
en-wikipedia-org-1345	283	2	York	York	NNP
en-wikipedia-org-1345	283	3	:	:	:
en-wikipedia-org-1345	283	4	Prentice	Prentice	NNP
en-wikipedia-org-1345	283	5	Hall	Hall	NNP
en-wikipedia-org-1345	283	6	,	,	,
en-wikipedia-org-1345	283	7	1987	1987	CD
en-wikipedia-org-1345	283	8	.	.	.
en-wikipedia-org-1345	284	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	284	2	 	  	_SP
en-wikipedia-org-1345	284	3	0	0	CD
en-wikipedia-org-1345	284	4	-	-	SYM
en-wikipedia-org-1345	284	5	13	13	CD
en-wikipedia-org-1345	284	6	-	-	HYPH
en-wikipedia-org-1345	284	7	484668	484668	CD
en-wikipedia-org-1345	284	8	-	-	SYM
en-wikipedia-org-1345	284	9	0	0	CD
en-wikipedia-org-1345	284	10	McEliece	McEliece	NNP
en-wikipedia-org-1345	284	11	,	,	,
en-wikipedia-org-1345	284	12	R.	R.	NNP
en-wikipedia-org-1345	284	13	The	the	DT
en-wikipedia-org-1345	284	14	Theory	Theory	NNP
en-wikipedia-org-1345	284	15	of	of	IN
en-wikipedia-org-1345	284	16	Information	Information	NNP
en-wikipedia-org-1345	284	17	and	and	CC
en-wikipedia-org-1345	284	18	Coding	Coding	NNP
en-wikipedia-org-1345	284	19	"	"	''
en-wikipedia-org-1345	284	20	.	.	.
en-wikipedia-org-1345	285	1	Cambridge	Cambridge	NNP
en-wikipedia-org-1345	285	2	,	,	,
en-wikipedia-org-1345	285	3	2002	2002	CD
en-wikipedia-org-1345	285	4	.	.	.
en-wikipedia-org-1345	286	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	286	2	 	  	_SP
en-wikipedia-org-1345	286	3	978	978	CD
en-wikipedia-org-1345	286	4	-	-	HYPH
en-wikipedia-org-1345	286	5	0521831857	0521831857	CD
en-wikipedia-org-1345	286	6	Pierce	Pierce	NNP
en-wikipedia-org-1345	286	7	,	,	,
en-wikipedia-org-1345	286	8	JR	JR	NNP
en-wikipedia-org-1345	286	9	.	.	.
en-wikipedia-org-1345	286	10	"	"	''
en-wikipedia-org-1345	286	11	An	an	DT
en-wikipedia-org-1345	286	12	introduction	introduction	NN
en-wikipedia-org-1345	286	13	to	to	IN
en-wikipedia-org-1345	286	14	information	information	NN
en-wikipedia-org-1345	286	15	theory	theory	NN
en-wikipedia-org-1345	286	16	:	:	:
en-wikipedia-org-1345	286	17	symbols	symbol	NNS
en-wikipedia-org-1345	286	18	,	,	,
en-wikipedia-org-1345	286	19	signals	signal	NNS
en-wikipedia-org-1345	286	20	and	and	CC
en-wikipedia-org-1345	286	21	noise	noise	VBP
en-wikipedia-org-1345	286	22	"	"	''
en-wikipedia-org-1345	286	23	.	.	.
en-wikipedia-org-1345	287	1	Dover	Dover	NNP
en-wikipedia-org-1345	287	2	(	(	-LRB-
en-wikipedia-org-1345	287	3	2nd	2nd	NNP
en-wikipedia-org-1345	287	4	Edition	Edition	NNP
en-wikipedia-org-1345	287	5	)	)	-RRB-
en-wikipedia-org-1345	287	6	.	.	.
en-wikipedia-org-1345	288	1	1961	1961	CD
en-wikipedia-org-1345	288	2	(	(	-LRB-
en-wikipedia-org-1345	288	3	reprinted	reprint	VBN
en-wikipedia-org-1345	288	4	by	by	IN
en-wikipedia-org-1345	288	5	Dover	Dover	NNP
en-wikipedia-org-1345	288	6	1980	1980	CD
en-wikipedia-org-1345	288	7	)	)	-RRB-
en-wikipedia-org-1345	288	8	.	.	.
en-wikipedia-org-1345	289	1	Reza	Reza	NNP
en-wikipedia-org-1345	289	2	,	,	,
en-wikipedia-org-1345	289	3	F.	F.	NNP
en-wikipedia-org-1345	289	4	An	an	DT
en-wikipedia-org-1345	289	5	Introduction	introduction	NN
en-wikipedia-org-1345	289	6	to	to	IN
en-wikipedia-org-1345	289	7	Information	information	NN
en-wikipedia-org-1345	289	8	Theory	Theory	NNP
en-wikipedia-org-1345	289	9	.	.	.
en-wikipedia-org-1345	290	1	New	New	NNP
en-wikipedia-org-1345	290	2	York	York	NNP
en-wikipedia-org-1345	290	3	:	:	:
en-wikipedia-org-1345	290	4	McGraw	McGraw	NNP
en-wikipedia-org-1345	290	5	-	-	HYPH
en-wikipedia-org-1345	290	6	Hill	Hill	NNP
en-wikipedia-org-1345	290	7	1961	1961	CD
en-wikipedia-org-1345	290	8	.	.	.
en-wikipedia-org-1345	291	1	New	New	NNP
en-wikipedia-org-1345	291	2	York	York	NNP
en-wikipedia-org-1345	291	3	:	:	:
en-wikipedia-org-1345	291	4	Dover	Dover	NNP
en-wikipedia-org-1345	291	5	1994	1994	CD
en-wikipedia-org-1345	291	6	.	.	.
en-wikipedia-org-1345	292	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	292	2	 	  	_SP
en-wikipedia-org-1345	292	3	0	0	CD
en-wikipedia-org-1345	292	4	-	-	HYPH
en-wikipedia-org-1345	292	5	486	486	CD
en-wikipedia-org-1345	292	6	-	-	HYPH
en-wikipedia-org-1345	292	7	68210	68210	CD
en-wikipedia-org-1345	292	8	-	-	HYPH
en-wikipedia-org-1345	292	9	2	2	CD
en-wikipedia-org-1345	292	10	Shannon	Shannon	NNP
en-wikipedia-org-1345	292	11	,	,	,
en-wikipedia-org-1345	292	12	Claude	Claude	NNP
en-wikipedia-org-1345	292	13	;	;	:
en-wikipedia-org-1345	292	14	Weaver	Weaver	NNP
en-wikipedia-org-1345	292	15	,	,	,
en-wikipedia-org-1345	292	16	Warren	Warren	NNP
en-wikipedia-org-1345	292	17	(	(	-LRB-
en-wikipedia-org-1345	292	18	1949	1949	CD
en-wikipedia-org-1345	292	19	)	)	-RRB-
en-wikipedia-org-1345	292	20	.	.	.
en-wikipedia-org-1345	293	1	The	the	DT
en-wikipedia-org-1345	293	2	Mathematical	Mathematical	NNP
en-wikipedia-org-1345	293	3	Theory	Theory	NNP
en-wikipedia-org-1345	293	4	of	of	IN
en-wikipedia-org-1345	293	5	Communication	Communication	NNP
en-wikipedia-org-1345	293	6	(	(	-LRB-
en-wikipedia-org-1345	293	7	PDF	PDF	NNP
en-wikipedia-org-1345	293	8	)	)	-RRB-
en-wikipedia-org-1345	293	9	.	.	.
en-wikipedia-org-1345	294	1	Urbana	Urbana	NNP
en-wikipedia-org-1345	294	2	,	,	,
en-wikipedia-org-1345	294	3	Illinois	Illinois	NNP
en-wikipedia-org-1345	294	4	:	:	:
en-wikipedia-org-1345	294	5	University	University	NNP
en-wikipedia-org-1345	294	6	of	of	IN
en-wikipedia-org-1345	294	7	Illinois	Illinois	NNP
en-wikipedia-org-1345	294	8	Press	Press	NNP
en-wikipedia-org-1345	294	9	.	.	.
en-wikipedia-org-1345	295	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	295	2	 	  	_SP
en-wikipedia-org-1345	295	3	0	0	CD
en-wikipedia-org-1345	295	4	-	-	HYPH
en-wikipedia-org-1345	295	5	252	252	CD
en-wikipedia-org-1345	295	6	-	-	HYPH
en-wikipedia-org-1345	295	7	72548	72548	CD
en-wikipedia-org-1345	295	8	-	-	HYPH
en-wikipedia-org-1345	295	9	4	4	CD
en-wikipedia-org-1345	295	10	.	.	.
en-wikipedia-org-1345	296	1	LCCN	LCCN	NNS
en-wikipedia-org-1345	296	2	 	  	_SP
en-wikipedia-org-1345	296	3	49	49	CD
en-wikipedia-org-1345	296	4	-	-	SYM
en-wikipedia-org-1345	296	5	11922	11922	CD
en-wikipedia-org-1345	296	6	.	.	.
en-wikipedia-org-1345	297	1	Stone	Stone	NNP
en-wikipedia-org-1345	297	2	,	,	,
en-wikipedia-org-1345	297	3	JV	JV	NNP
en-wikipedia-org-1345	297	4	.	.	.
en-wikipedia-org-1345	298	1	Chapter	chapter	NN
en-wikipedia-org-1345	298	2	1	1	CD
en-wikipedia-org-1345	298	3	of	of	IN
en-wikipedia-org-1345	298	4	book	book	NN
en-wikipedia-org-1345	298	5	"	"	''
en-wikipedia-org-1345	298	6	Information	Information	NNP
en-wikipedia-org-1345	298	7	Theory	theory	NN
en-wikipedia-org-1345	298	8	:	:	:
en-wikipedia-org-1345	298	9	A	a	DT
en-wikipedia-org-1345	298	10	Tutorial	Tutorial	NNP
en-wikipedia-org-1345	298	11	Introduction	Introduction	NNP
en-wikipedia-org-1345	298	12	"	"	''
en-wikipedia-org-1345	298	13	,	,	,
en-wikipedia-org-1345	298	14	University	University	NNP
en-wikipedia-org-1345	298	15	of	of	IN
en-wikipedia-org-1345	298	16	Sheffield	Sheffield	NNP
en-wikipedia-org-1345	298	17	,	,	,
en-wikipedia-org-1345	298	18	England	England	NNP
en-wikipedia-org-1345	298	19	,	,	,
en-wikipedia-org-1345	298	20	2014	2014	CD
en-wikipedia-org-1345	298	21	.	.	.
en-wikipedia-org-1345	299	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	299	2	 	  	_SP
en-wikipedia-org-1345	299	3	978	978	CD
en-wikipedia-org-1345	299	4	-	-	HYPH
en-wikipedia-org-1345	299	5	0956372857	0956372857	CD
en-wikipedia-org-1345	299	6	.	.	.
en-wikipedia-org-1345	300	1	Yeung	Yeung	NNP
en-wikipedia-org-1345	300	2	,	,	,
en-wikipedia-org-1345	300	3	RW	RW	NNP
en-wikipedia-org-1345	300	4	.	.	.
en-wikipedia-org-1345	301	1	A	a	DT
en-wikipedia-org-1345	301	2	First	first	JJ
en-wikipedia-org-1345	301	3	Course	course	NN
en-wikipedia-org-1345	301	4	in	in	IN
en-wikipedia-org-1345	301	5	Information	Information	NNP
en-wikipedia-org-1345	301	6	Theory	Theory	NNP
en-wikipedia-org-1345	301	7	Kluwer	Kluwer	NNP
en-wikipedia-org-1345	301	8	Academic	Academic	NNP
en-wikipedia-org-1345	301	9	/	/	SYM
en-wikipedia-org-1345	301	10	Plenum	Plenum	NNP
en-wikipedia-org-1345	301	11	Publishers	Publishers	NNPS
en-wikipedia-org-1345	301	12	,	,	,
en-wikipedia-org-1345	301	13	2002	2002	CD
en-wikipedia-org-1345	301	14	.	.	.
en-wikipedia-org-1345	302	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	302	2	 	  	_SP
en-wikipedia-org-1345	302	3	0	0	CD
en-wikipedia-org-1345	302	4	-	-	HYPH
en-wikipedia-org-1345	302	5	306	306	CD
en-wikipedia-org-1345	302	6	-	-	HYPH
en-wikipedia-org-1345	302	7	46791	46791	CD
en-wikipedia-org-1345	302	8	-	-	SYM
en-wikipedia-org-1345	302	9	7	7	CD
en-wikipedia-org-1345	302	10	.	.	.
en-wikipedia-org-1345	303	1	Yeung	Yeung	NNP
en-wikipedia-org-1345	303	2	,	,	,
en-wikipedia-org-1345	303	3	RW	RW	NNP
en-wikipedia-org-1345	303	4	.	.	.
en-wikipedia-org-1345	304	1	Information	Information	NNP
en-wikipedia-org-1345	304	2	Theory	Theory	NNP
en-wikipedia-org-1345	304	3	and	and	CC
en-wikipedia-org-1345	304	4	Network	Network	NNP
en-wikipedia-org-1345	304	5	Coding	Coding	NNP
en-wikipedia-org-1345	304	6	Springer	Springer	NNP
en-wikipedia-org-1345	304	7	2008	2008	CD
en-wikipedia-org-1345	304	8	,	,	,
en-wikipedia-org-1345	304	9	2002	2002	CD
en-wikipedia-org-1345	304	10	.	.	.
en-wikipedia-org-1345	305	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	305	2	 	  	_SP
en-wikipedia-org-1345	305	3	978	978	CD
en-wikipedia-org-1345	305	4	-	-	HYPH
en-wikipedia-org-1345	305	5	0	0	CD
en-wikipedia-org-1345	305	6	-	-	HYPH
en-wikipedia-org-1345	305	7	387	387	CD
en-wikipedia-org-1345	305	8	-	-	HYPH
en-wikipedia-org-1345	305	9	79233	79233	CD
en-wikipedia-org-1345	305	10	-	-	HYPH
en-wikipedia-org-1345	305	11	0	0	CD
en-wikipedia-org-1345	305	12	Other	other	JJ
en-wikipedia-org-1345	305	13	books[edit	books[edit	,
en-wikipedia-org-1345	305	14	]	]	-RRB-
en-wikipedia-org-1345	305	15	Leon	Leon	NNP
en-wikipedia-org-1345	305	16	Brillouin	Brillouin	NNP
en-wikipedia-org-1345	305	17	,	,	,
en-wikipedia-org-1345	305	18	Science	Science	NNP
en-wikipedia-org-1345	305	19	and	and	CC
en-wikipedia-org-1345	305	20	Information	Information	NNP
en-wikipedia-org-1345	305	21	Theory	Theory	NNP
en-wikipedia-org-1345	305	22	,	,	,
en-wikipedia-org-1345	305	23	Mineola	Mineola	NNP
en-wikipedia-org-1345	305	24	,	,	,
en-wikipedia-org-1345	305	25	N.Y.	New York	NNP
en-wikipedia-org-1345	305	26	:	:	:
en-wikipedia-org-1345	305	27	Dover	Dover	NNP
en-wikipedia-org-1345	305	28	,	,	,
en-wikipedia-org-1345	305	29	[	[	-LRB-
en-wikipedia-org-1345	305	30	1956	1956	CD
en-wikipedia-org-1345	305	31	,	,	,
en-wikipedia-org-1345	305	32	1962	1962	CD
en-wikipedia-org-1345	305	33	]	]	-RRB-
en-wikipedia-org-1345	305	34	2004	2004	CD
en-wikipedia-org-1345	305	35	.	.	.
en-wikipedia-org-1345	306	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	306	2	 	  	_SP
en-wikipedia-org-1345	306	3	0	0	CD
en-wikipedia-org-1345	306	4	-	-	HYPH
en-wikipedia-org-1345	306	5	486	486	CD
en-wikipedia-org-1345	306	6	-	-	HYPH
en-wikipedia-org-1345	306	7	43918	43918	CD
en-wikipedia-org-1345	306	8	-	-	HYPH
en-wikipedia-org-1345	306	9	6	6	CD
en-wikipedia-org-1345	306	10	James	James	NNP
en-wikipedia-org-1345	306	11	Gleick	Gleick	NNP
en-wikipedia-org-1345	306	12	,	,	,
en-wikipedia-org-1345	306	13	The	the	DT
en-wikipedia-org-1345	306	14	Information	information	NN
en-wikipedia-org-1345	306	15	:	:	:
en-wikipedia-org-1345	306	16	A	a	DT
en-wikipedia-org-1345	306	17	History	history	NN
en-wikipedia-org-1345	306	18	,	,	,
en-wikipedia-org-1345	306	19	a	a	DT
en-wikipedia-org-1345	306	20	Theory	Theory	NNP
en-wikipedia-org-1345	306	21	,	,	,
en-wikipedia-org-1345	306	22	a	a	DT
en-wikipedia-org-1345	306	23	Flood	Flood	NNP
en-wikipedia-org-1345	306	24	,	,	,
en-wikipedia-org-1345	306	25	New	New	NNP
en-wikipedia-org-1345	306	26	York	York	NNP
en-wikipedia-org-1345	306	27	:	:	:
en-wikipedia-org-1345	306	28	Pantheon	Pantheon	NNP
en-wikipedia-org-1345	306	29	,	,	,
en-wikipedia-org-1345	306	30	2011	2011	CD
en-wikipedia-org-1345	306	31	.	.	.
en-wikipedia-org-1345	307	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	307	2	 	  	_SP
en-wikipedia-org-1345	307	3	978	978	CD
en-wikipedia-org-1345	307	4	-	-	HYPH
en-wikipedia-org-1345	307	5	0	0	CD
en-wikipedia-org-1345	307	6	-	-	HYPH
en-wikipedia-org-1345	307	7	375	375	CD
en-wikipedia-org-1345	307	8	-	-	HYPH
en-wikipedia-org-1345	307	9	42372	42372	CD
en-wikipedia-org-1345	307	10	-	-	SYM
en-wikipedia-org-1345	307	11	7	7	CD
en-wikipedia-org-1345	307	12	A.	a.	NN
en-wikipedia-org-1345	307	13	I.	I.	NNP
en-wikipedia-org-1345	307	14	Khinchin	Khinchin	NNP
en-wikipedia-org-1345	307	15	,	,	,
en-wikipedia-org-1345	307	16	Mathematical	Mathematical	NNP
en-wikipedia-org-1345	307	17	Foundations	Foundations	NNPS
en-wikipedia-org-1345	307	18	of	of	IN
en-wikipedia-org-1345	307	19	Information	Information	NNP
en-wikipedia-org-1345	307	20	Theory	Theory	NNP
en-wikipedia-org-1345	307	21	,	,	,
en-wikipedia-org-1345	307	22	New	New	NNP
en-wikipedia-org-1345	307	23	York	York	NNP
en-wikipedia-org-1345	307	24	:	:	:
en-wikipedia-org-1345	307	25	Dover	Dover	NNP
en-wikipedia-org-1345	307	26	,	,	,
en-wikipedia-org-1345	307	27	1957	1957	CD
en-wikipedia-org-1345	307	28	.	.	.
en-wikipedia-org-1345	308	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	308	2	 	  	_SP
en-wikipedia-org-1345	308	3	0	0	CD
en-wikipedia-org-1345	308	4	-	-	HYPH
en-wikipedia-org-1345	308	5	486	486	CD
en-wikipedia-org-1345	308	6	-	-	HYPH
en-wikipedia-org-1345	308	7	60434	60434	CD
en-wikipedia-org-1345	308	8	-	-	HYPH
en-wikipedia-org-1345	308	9	9	9	CD
en-wikipedia-org-1345	308	10	H.	H.	NNP
en-wikipedia-org-1345	308	11	S.	S.	NNP
en-wikipedia-org-1345	308	12	Leff	Leff	NNP
en-wikipedia-org-1345	308	13	and	and	CC
en-wikipedia-org-1345	308	14	A.	A.	NNP
en-wikipedia-org-1345	308	15	F.	F.	NNP
en-wikipedia-org-1345	308	16	Rex	Rex	NNP
en-wikipedia-org-1345	308	17	,	,	,
en-wikipedia-org-1345	308	18	Editors	Editors	NNP
en-wikipedia-org-1345	308	19	,	,	,
en-wikipedia-org-1345	308	20	Maxwell	Maxwell	NNP
en-wikipedia-org-1345	308	21	's	's	POS
en-wikipedia-org-1345	308	22	Demon	Demon	NNP
en-wikipedia-org-1345	308	23	:	:	:
en-wikipedia-org-1345	308	24	Entropy	Entropy	NNP
en-wikipedia-org-1345	308	25	,	,	,
en-wikipedia-org-1345	308	26	Information	information	NN
en-wikipedia-org-1345	308	27	,	,	,
en-wikipedia-org-1345	308	28	Computing	Computing	NNP
en-wikipedia-org-1345	308	29	,	,	,
en-wikipedia-org-1345	308	30	Princeton	Princeton	NNP
en-wikipedia-org-1345	308	31	University	University	NNP
en-wikipedia-org-1345	308	32	Press	Press	NNP
en-wikipedia-org-1345	308	33	,	,	,
en-wikipedia-org-1345	308	34	Princeton	Princeton	NNP
en-wikipedia-org-1345	308	35	,	,	,
en-wikipedia-org-1345	308	36	New	New	NNP
en-wikipedia-org-1345	308	37	Jersey	Jersey	NNP
en-wikipedia-org-1345	308	38	(	(	-LRB-
en-wikipedia-org-1345	308	39	1990	1990	CD
en-wikipedia-org-1345	308	40	)	)	-RRB-
en-wikipedia-org-1345	308	41	.	.	.
en-wikipedia-org-1345	309	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	309	2	 	  	_SP
en-wikipedia-org-1345	309	3	0	0	CD
en-wikipedia-org-1345	309	4	-	-	HYPH
en-wikipedia-org-1345	309	5	691	691	CD
en-wikipedia-org-1345	309	6	-	-	HYPH
en-wikipedia-org-1345	309	7	08727-X	08727-x	CD
en-wikipedia-org-1345	309	8	Robert	Robert	NNP
en-wikipedia-org-1345	309	9	K.	K.	NNP
en-wikipedia-org-1345	309	10	Logan	Logan	NNP
en-wikipedia-org-1345	309	11	.	.	.
en-wikipedia-org-1345	310	1	What	what	WP
en-wikipedia-org-1345	310	2	is	be	VBZ
en-wikipedia-org-1345	310	3	Information	information	NN
en-wikipedia-org-1345	310	4	?	?	.
en-wikipedia-org-1345	311	1	-	-	:
en-wikipedia-org-1345	311	2	Propagating	propagate	VBG
en-wikipedia-org-1345	311	3	Organization	Organization	NNP
en-wikipedia-org-1345	311	4	in	in	IN
en-wikipedia-org-1345	311	5	the	the	DT
en-wikipedia-org-1345	311	6	Biosphere	Biosphere	NNP
en-wikipedia-org-1345	311	7	,	,	,
en-wikipedia-org-1345	311	8	the	the	DT
en-wikipedia-org-1345	311	9	Symbolosphere	Symbolosphere	NNP
en-wikipedia-org-1345	311	10	,	,	,
en-wikipedia-org-1345	311	11	the	the	DT
en-wikipedia-org-1345	311	12	Technosphere	Technosphere	NNP
en-wikipedia-org-1345	311	13	and	and	CC
en-wikipedia-org-1345	311	14	the	the	DT
en-wikipedia-org-1345	311	15	Econosphere	Econosphere	NNP
en-wikipedia-org-1345	311	16	,	,	,
en-wikipedia-org-1345	311	17	Toronto	Toronto	NNP
en-wikipedia-org-1345	311	18	:	:	:
en-wikipedia-org-1345	311	19	DEMO	DEMO	NNP
en-wikipedia-org-1345	311	20	Publishing	Publishing	NNP
en-wikipedia-org-1345	311	21	.	.	.
en-wikipedia-org-1345	312	1	Tom	Tom	NNP
en-wikipedia-org-1345	312	2	Siegfried	Siegfried	NNP
en-wikipedia-org-1345	312	3	,	,	,
en-wikipedia-org-1345	312	4	The	the	DT
en-wikipedia-org-1345	312	5	Bit	Bit	NNP
en-wikipedia-org-1345	312	6	and	and	CC
en-wikipedia-org-1345	312	7	the	the	DT
en-wikipedia-org-1345	312	8	Pendulum	Pendulum	NNP
en-wikipedia-org-1345	312	9	,	,	,
en-wikipedia-org-1345	312	10	Wiley	Wiley	NNP
en-wikipedia-org-1345	312	11	,	,	,
en-wikipedia-org-1345	312	12	2000	2000	CD
en-wikipedia-org-1345	312	13	.	.	.
en-wikipedia-org-1345	313	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	313	2	 	  	_SP
en-wikipedia-org-1345	313	3	0	0	CD
en-wikipedia-org-1345	313	4	-	-	HYPH
en-wikipedia-org-1345	313	5	471	471	CD
en-wikipedia-org-1345	313	6	-	-	HYPH
en-wikipedia-org-1345	313	7	32174	32174	CD
en-wikipedia-org-1345	313	8	-	-	HYPH
en-wikipedia-org-1345	313	9	5	5	CD
en-wikipedia-org-1345	313	10	Charles	Charles	NNP
en-wikipedia-org-1345	313	11	Seife	Seife	NNP
en-wikipedia-org-1345	313	12	,	,	,
en-wikipedia-org-1345	313	13	Decoding	decode	VBG
en-wikipedia-org-1345	313	14	the	the	DT
en-wikipedia-org-1345	313	15	Universe	Universe	NNP
en-wikipedia-org-1345	313	16	,	,	,
en-wikipedia-org-1345	313	17	Viking	Viking	NNP
en-wikipedia-org-1345	313	18	,	,	,
en-wikipedia-org-1345	313	19	2006	2006	CD
en-wikipedia-org-1345	313	20	.	.	.
en-wikipedia-org-1345	314	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	314	2	 	  	_SP
en-wikipedia-org-1345	314	3	0	0	CD
en-wikipedia-org-1345	314	4	-	-	HYPH
en-wikipedia-org-1345	314	5	670	670	CD
en-wikipedia-org-1345	314	6	-	-	HYPH
en-wikipedia-org-1345	314	7	03441-X	03441-x	CD
en-wikipedia-org-1345	314	8	Jeremy	Jeremy	NNP
en-wikipedia-org-1345	314	9	Campbell	Campbell	NNP
en-wikipedia-org-1345	314	10	,	,	,
en-wikipedia-org-1345	314	11	Grammatical	Grammatical	NNP
en-wikipedia-org-1345	314	12	Man	Man	NNP
en-wikipedia-org-1345	314	13	,	,	,
en-wikipedia-org-1345	314	14	Touchstone	Touchstone	NNP
en-wikipedia-org-1345	314	15	/	/	SYM
en-wikipedia-org-1345	314	16	Simon	Simon	NNP
en-wikipedia-org-1345	314	17	&	&	CC
en-wikipedia-org-1345	314	18	Schuster	Schuster	NNP
en-wikipedia-org-1345	314	19	,	,	,
en-wikipedia-org-1345	314	20	1982	1982	CD
en-wikipedia-org-1345	314	21	,	,	,
en-wikipedia-org-1345	314	22	ISBN	ISBN	NNP
en-wikipedia-org-1345	314	23	 	  	_SP
en-wikipedia-org-1345	314	24	0	0	CD
en-wikipedia-org-1345	314	25	-	-	SYM
en-wikipedia-org-1345	314	26	671	671	CD
en-wikipedia-org-1345	314	27	-	-	HYPH
en-wikipedia-org-1345	314	28	44062	44062	CD
en-wikipedia-org-1345	314	29	-	-	SYM
en-wikipedia-org-1345	314	30	4	4	CD
en-wikipedia-org-1345	314	31	Henri	Henri	NNP
en-wikipedia-org-1345	314	32	Theil	Theil	NNP
en-wikipedia-org-1345	314	33	,	,	,
en-wikipedia-org-1345	314	34	Economics	Economics	NNP
en-wikipedia-org-1345	314	35	and	and	CC
en-wikipedia-org-1345	314	36	Information	Information	NNP
en-wikipedia-org-1345	314	37	Theory	Theory	NNP
en-wikipedia-org-1345	314	38	,	,	,
en-wikipedia-org-1345	314	39	Rand	Rand	NNP
en-wikipedia-org-1345	314	40	McNally	McNally	NNP
en-wikipedia-org-1345	314	41	&	&	CC
en-wikipedia-org-1345	314	42	Company	Company	NNP
en-wikipedia-org-1345	314	43	-	-	HYPH
en-wikipedia-org-1345	314	44	Chicago	Chicago	NNP
en-wikipedia-org-1345	314	45	,	,	,
en-wikipedia-org-1345	314	46	1967	1967	CD
en-wikipedia-org-1345	314	47	.	.	.
en-wikipedia-org-1345	315	1	Escolano	Escolano	NNP
en-wikipedia-org-1345	315	2	,	,	,
en-wikipedia-org-1345	315	3	Suau	Suau	NNP
en-wikipedia-org-1345	315	4	,	,	,
en-wikipedia-org-1345	315	5	Bonev	Bonev	NNP
en-wikipedia-org-1345	315	6	,	,	,
en-wikipedia-org-1345	315	7	Information	Information	NNP
en-wikipedia-org-1345	315	8	Theory	Theory	NNP
en-wikipedia-org-1345	315	9	in	in	IN
en-wikipedia-org-1345	315	10	Computer	Computer	NNP
en-wikipedia-org-1345	315	11	Vision	Vision	NNP
en-wikipedia-org-1345	315	12	and	and	CC
en-wikipedia-org-1345	315	13	Pattern	Pattern	NNP
en-wikipedia-org-1345	315	14	Recognition	Recognition	NNP
en-wikipedia-org-1345	315	15	,	,	,
en-wikipedia-org-1345	315	16	Springer	Springer	NNP
en-wikipedia-org-1345	315	17	,	,	,
en-wikipedia-org-1345	315	18	2009	2009	CD
en-wikipedia-org-1345	315	19	.	.	.
en-wikipedia-org-1345	316	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	316	2	 	  	_SP
en-wikipedia-org-1345	316	3	978	978	CD
en-wikipedia-org-1345	316	4	-	-	HYPH
en-wikipedia-org-1345	316	5	1	1	CD
en-wikipedia-org-1345	316	6	-	-	HYPH
en-wikipedia-org-1345	316	7	84882	84882	CD
en-wikipedia-org-1345	316	8	-	-	HYPH
en-wikipedia-org-1345	316	9	296	296	CD
en-wikipedia-org-1345	316	10	-	-	HYPH
en-wikipedia-org-1345	316	11	2	2	CD
en-wikipedia-org-1345	316	12	Vlatko	Vlatko	NNP
en-wikipedia-org-1345	316	13	Vedral	Vedral	NNP
en-wikipedia-org-1345	316	14	,	,	,
en-wikipedia-org-1345	316	15	Decoding	decode	VBG
en-wikipedia-org-1345	316	16	Reality	reality	NN
en-wikipedia-org-1345	316	17	:	:	:
en-wikipedia-org-1345	316	18	The	the	DT
en-wikipedia-org-1345	316	19	Universe	Universe	NNP
en-wikipedia-org-1345	316	20	as	as	IN
en-wikipedia-org-1345	316	21	Quantum	Quantum	NNP
en-wikipedia-org-1345	316	22	Information	Information	NNP
en-wikipedia-org-1345	316	23	,	,	,
en-wikipedia-org-1345	316	24	Oxford	Oxford	NNP
en-wikipedia-org-1345	316	25	University	University	NNP
en-wikipedia-org-1345	316	26	Press	Press	NNP
en-wikipedia-org-1345	316	27	2010	2010	CD
en-wikipedia-org-1345	316	28	.	.	.
en-wikipedia-org-1345	317	1	ISBN	ISBN	NNP
en-wikipedia-org-1345	317	2	 	  	_SP
en-wikipedia-org-1345	317	3	0	0	CD
en-wikipedia-org-1345	317	4	-	-	HYPH
en-wikipedia-org-1345	317	5	19	19	CD
en-wikipedia-org-1345	317	6	-	-	HYPH
en-wikipedia-org-1345	317	7	923769	923769	CD
en-wikipedia-org-1345	317	8	-	-	HYPH
en-wikipedia-org-1345	317	9	7	7	CD
en-wikipedia-org-1345	317	10	MOOC	MOOC	NNP
en-wikipedia-org-1345	317	11	on	on	IN
en-wikipedia-org-1345	317	12	information	information	NN
en-wikipedia-org-1345	317	13	theory[edit	theory[edit	CD
en-wikipedia-org-1345	317	14	]	]	-RRB-
en-wikipedia-org-1345	317	15	Raymond	Raymond	NNP
en-wikipedia-org-1345	317	16	W.	W.	NNP
en-wikipedia-org-1345	317	17	Yeung	Yeung	NNP
en-wikipedia-org-1345	317	18	,	,	,
en-wikipedia-org-1345	317	19	"	"	``
en-wikipedia-org-1345	317	20	Information	information	NN
en-wikipedia-org-1345	317	21	Theory	theory	NN
en-wikipedia-org-1345	317	22	"	"	''
en-wikipedia-org-1345	317	23	(	(	-LRB-
en-wikipedia-org-1345	317	24	The	the	DT
en-wikipedia-org-1345	317	25	Chinese	Chinese	NNP
en-wikipedia-org-1345	317	26	University	University	NNP
en-wikipedia-org-1345	317	27	of	of	IN
en-wikipedia-org-1345	317	28	Hong	Hong	NNP
en-wikipedia-org-1345	317	29	Kong	Kong	NNP
en-wikipedia-org-1345	317	30	)	)	-RRB-
en-wikipedia-org-1345	317	31	External	External	NNP
en-wikipedia-org-1345	317	32	links[edit	links[edit	,
en-wikipedia-org-1345	317	33	]	]	-RRB-
en-wikipedia-org-1345	317	34	Wikiquote	Wikiquote	NNP
en-wikipedia-org-1345	317	35	has	have	VBZ
en-wikipedia-org-1345	317	36	quotations	quotation	NNS
en-wikipedia-org-1345	317	37	related	relate	VBN
en-wikipedia-org-1345	317	38	to	to	IN
en-wikipedia-org-1345	317	39	:	:	:
en-wikipedia-org-1345	317	40	Information	information	NN
en-wikipedia-org-1345	317	41	theory	theory	NN
en-wikipedia-org-1345	317	42	Library	library	JJ
en-wikipedia-org-1345	317	43	resources	resource	NNS
en-wikipedia-org-1345	317	44	about	about	IN
en-wikipedia-org-1345	317	45	Information	information	NN
en-wikipedia-org-1345	317	46	theory	theory	NN
en-wikipedia-org-1345	317	47	Resources	resource	NNS
en-wikipedia-org-1345	317	48	in	in	IN
en-wikipedia-org-1345	317	49	your	-PRON-	PRP$
en-wikipedia-org-1345	317	50	library	library	NN
en-wikipedia-org-1345	317	51	Resources	Resources	NNPS
en-wikipedia-org-1345	317	52	in	in	IN
en-wikipedia-org-1345	317	53	other	other	JJ
en-wikipedia-org-1345	317	54	libraries	library	NNS
en-wikipedia-org-1345	317	55	"	"	``
en-wikipedia-org-1345	317	56	Information	information	NN
en-wikipedia-org-1345	317	57	"	"	''
en-wikipedia-org-1345	317	58	,	,	,
en-wikipedia-org-1345	317	59	Encyclopedia	Encyclopedia	NNP
en-wikipedia-org-1345	317	60	of	of	IN
en-wikipedia-org-1345	317	61	Mathematics	Mathematics	NNP
en-wikipedia-org-1345	317	62	,	,	,
en-wikipedia-org-1345	317	63	EMS	EMS	NNP
en-wikipedia-org-1345	317	64	Press	Press	NNP
en-wikipedia-org-1345	317	65	,	,	,
en-wikipedia-org-1345	317	66	2001	2001	CD
en-wikipedia-org-1345	317	67	[	[	-LRB-
en-wikipedia-org-1345	317	68	1994	1994	CD
en-wikipedia-org-1345	317	69	]	]	-RRB-
en-wikipedia-org-1345	317	70	Lambert	Lambert	NNP
en-wikipedia-org-1345	317	71	F.	F.	NNP
en-wikipedia-org-1345	317	72	L.	L.	NNP
en-wikipedia-org-1345	317	73	(	(	-LRB-
en-wikipedia-org-1345	317	74	1999	1999	CD
en-wikipedia-org-1345	317	75	)	)	-RRB-
en-wikipedia-org-1345	317	76	,	,	,
en-wikipedia-org-1345	317	77	"	"	``
en-wikipedia-org-1345	317	78	Shuffled	Shuffled	NNP
en-wikipedia-org-1345	317	79	Cards	Cards	NNP
en-wikipedia-org-1345	317	80	,	,	,
en-wikipedia-org-1345	317	81	Messy	Messy	NNP
en-wikipedia-org-1345	317	82	Desks	Desks	NNPS
en-wikipedia-org-1345	317	83	,	,	,
en-wikipedia-org-1345	317	84	and	and	CC
en-wikipedia-org-1345	317	85	Disorderly	Disorderly	NNP
en-wikipedia-org-1345	317	86	Dorm	Dorm	NNP
en-wikipedia-org-1345	317	87	Rooms	room	NNS
en-wikipedia-org-1345	317	88	-	-	HYPH
en-wikipedia-org-1345	317	89	Examples	Examples	NNPS
en-wikipedia-org-1345	317	90	of	of	IN
en-wikipedia-org-1345	317	91	Entropy	entropy	JJ
en-wikipedia-org-1345	317	92	Increase	Increase	NNP
en-wikipedia-org-1345	317	93	?	?	.
en-wikipedia-org-1345	318	1	Nonsense	nonsense	NN
en-wikipedia-org-1345	318	2	!	!	.
en-wikipedia-org-1345	319	1	"	"	``
en-wikipedia-org-1345	319	2	,	,	,
en-wikipedia-org-1345	319	3	Journal	Journal	NNP
en-wikipedia-org-1345	319	4	of	of	IN
en-wikipedia-org-1345	319	5	Chemical	Chemical	NNP
en-wikipedia-org-1345	319	6	Education	Education	NNP
en-wikipedia-org-1345	319	7	IEEE	IEEE	NNP
en-wikipedia-org-1345	319	8	Information	Information	NNP
en-wikipedia-org-1345	319	9	Theory	Theory	NNP
en-wikipedia-org-1345	319	10	Society	Society	NNP
en-wikipedia-org-1345	319	11	and	and	CC
en-wikipedia-org-1345	319	12	ITSOC	ITSOC	NNP
en-wikipedia-org-1345	319	13	Monographs	Monographs	NNP
en-wikipedia-org-1345	319	14	,	,	,
en-wikipedia-org-1345	319	15	Surveys	Surveys	NNP
en-wikipedia-org-1345	319	16	,	,	,
en-wikipedia-org-1345	319	17	and	and	CC
en-wikipedia-org-1345	319	18	Reviews	Reviews	NNP
en-wikipedia-org-1345	319	19	v	v	IN
en-wikipedia-org-1345	319	20	t	t	NN
en-wikipedia-org-1345	319	21	e	e	NNP
en-wikipedia-org-1345	319	22	Subfields	Subfields	NNPS
en-wikipedia-org-1345	319	23	of	of	IN
en-wikipedia-org-1345	319	24	and	and	CC
en-wikipedia-org-1345	319	25	cyberneticians	cybernetician	NNS
en-wikipedia-org-1345	319	26	involved	involve	VBN
en-wikipedia-org-1345	319	27	in	in	IN
en-wikipedia-org-1345	319	28	cybernetics	cybernetic	NNS
en-wikipedia-org-1345	319	29	Subfields	Subfields	NNP
en-wikipedia-org-1345	319	30	Artificial	Artificial	NNP
en-wikipedia-org-1345	319	31	intelligence	intelligence	NN
en-wikipedia-org-1345	319	32	Biological	biological	JJ
en-wikipedia-org-1345	319	33	cybernetics	cybernetic	NNS
en-wikipedia-org-1345	319	34	Biomedical	biomedical	JJ
en-wikipedia-org-1345	319	35	cybernetics	cybernetic	NNS
en-wikipedia-org-1345	319	36	Biorobotics	Biorobotics	NNP
en-wikipedia-org-1345	319	37	Biosemiotics	Biosemiotics	NNPS
en-wikipedia-org-1345	319	38	Neurocybernetics	Neurocybernetics	NNP
en-wikipedia-org-1345	319	39	Catastrophe	Catastrophe	NNP
en-wikipedia-org-1345	319	40	theory	theory	NN
en-wikipedia-org-1345	319	41	Computational	computational	JJ
en-wikipedia-org-1345	319	42	neuroscience	neuroscience	NN
en-wikipedia-org-1345	319	43	Connectionism	Connectionism	NNP
en-wikipedia-org-1345	319	44	Control	Control	NNP
en-wikipedia-org-1345	319	45	theory	theory	NN
en-wikipedia-org-1345	319	46	Cybernetics	cybernetic	NNS
en-wikipedia-org-1345	319	47	in	in	IN
en-wikipedia-org-1345	319	48	the	the	DT
en-wikipedia-org-1345	319	49	Soviet	Soviet	NNP
en-wikipedia-org-1345	319	50	Union	Union	NNP
en-wikipedia-org-1345	319	51	Decision	Decision	NNP
en-wikipedia-org-1345	319	52	theory	theory	NN
en-wikipedia-org-1345	319	53	Emergence	Emergence	NNP
en-wikipedia-org-1345	319	54	Engineering	Engineering	NNP
en-wikipedia-org-1345	319	55	cybernetics	cybernetic	NNS
en-wikipedia-org-1345	319	56	Homeostasis	Homeostasis	NNP
en-wikipedia-org-1345	319	57	Information	Information	NNP
en-wikipedia-org-1345	319	58	theory	theory	NN
en-wikipedia-org-1345	319	59	Management	Management	NNP
en-wikipedia-org-1345	319	60	cybernetics	cybernetic	NNS
en-wikipedia-org-1345	319	61	Medical	medical	JJ
en-wikipedia-org-1345	319	62	cybernetics	cybernetic	NNS
en-wikipedia-org-1345	319	63	Second	second	JJ
en-wikipedia-org-1345	319	64	-	-	HYPH
en-wikipedia-org-1345	319	65	order	order	NN
en-wikipedia-org-1345	319	66	cybernetics	cybernetic	NNS
en-wikipedia-org-1345	319	67	Semiotics	Semiotics	NNPS
en-wikipedia-org-1345	319	68	Sociocybernetics	Sociocybernetics	NNP
en-wikipedia-org-1345	319	69	Polycontexturality	Polycontexturality	NNP
en-wikipedia-org-1345	319	70	Synergetics	Synergetics	NNP
en-wikipedia-org-1345	319	71	Cyberneticians	Cyberneticians	NNP
en-wikipedia-org-1345	319	72	Alexander	Alexander	NNP
en-wikipedia-org-1345	319	73	Lerner	Lerner	NNP
en-wikipedia-org-1345	319	74	Alexey	Alexey	NNP
en-wikipedia-org-1345	319	75	Lyapunov	Lyapunov	NNP
en-wikipedia-org-1345	319	76	Alfred	Alfred	NNP
en-wikipedia-org-1345	319	77	Radcliffe	Radcliffe	NNP
en-wikipedia-org-1345	319	78	-	-	HYPH
en-wikipedia-org-1345	319	79	Brown	Brown	NNP
en-wikipedia-org-1345	319	80	Allenna	Allenna	NNP
en-wikipedia-org-1345	319	81	Leonard	Leonard	NNP
en-wikipedia-org-1345	319	82	Anthony	Anthony	NNP
en-wikipedia-org-1345	319	83	Wilden	Wilden	NNP
en-wikipedia-org-1345	319	84	Buckminster	Buckminster	NNP
en-wikipedia-org-1345	319	85	Fuller	Fuller	NNP
en-wikipedia-org-1345	319	86	Charles	Charles	NNP
en-wikipedia-org-1345	319	87	François	François	NNP
en-wikipedia-org-1345	319	88	Claude	Claude	NNP
en-wikipedia-org-1345	319	89	Bernard	Bernard	NNP
en-wikipedia-org-1345	319	90	Cliff	Cliff	NNP
en-wikipedia-org-1345	319	91	Joslyn	Joslyn	NNP
en-wikipedia-org-1345	319	92	Erich	Erich	NNP
en-wikipedia-org-1345	319	93	von	von	NNP
en-wikipedia-org-1345	319	94	Holst	Holst	NNP
en-wikipedia-org-1345	319	95	Ernst	Ernst	NNP
en-wikipedia-org-1345	319	96	von	von	NNP
en-wikipedia-org-1345	319	97	Glasersfeld	Glasersfeld	NNP
en-wikipedia-org-1345	319	98	Francis	Francis	NNP
en-wikipedia-org-1345	319	99	Heylighen	Heylighen	NNP
en-wikipedia-org-1345	319	100	Francisco	Francisco	NNP
en-wikipedia-org-1345	319	101	Varela	Varela	NNP
en-wikipedia-org-1345	319	102	Frederic	Frederic	NNP
en-wikipedia-org-1345	319	103	Vester	Vester	NNP
en-wikipedia-org-1345	319	104	Charles	Charles	NNP
en-wikipedia-org-1345	319	105	Geoffrey	Geoffrey	NNP
en-wikipedia-org-1345	319	106	Vickers	Vickers	NNP
en-wikipedia-org-1345	319	107	Gordon	Gordon	NNP
en-wikipedia-org-1345	319	108	Pask	Pask	NNP
en-wikipedia-org-1345	319	109	Gordon	Gordon	NNP
en-wikipedia-org-1345	319	110	S.	S.	NNP
en-wikipedia-org-1345	319	111	Brown	Brown	NNP
en-wikipedia-org-1345	319	112	Gregory	Gregory	NNP
en-wikipedia-org-1345	319	113	Bateson	Bateson	NNP
en-wikipedia-org-1345	319	114	Heinz	Heinz	NNP
en-wikipedia-org-1345	319	115	von	von	NNP
en-wikipedia-org-1345	319	116	Foerster	Foerster	NNP
en-wikipedia-org-1345	319	117	Humberto	Humberto	NNP
en-wikipedia-org-1345	319	118	Maturana	Maturana	NNP
en-wikipedia-org-1345	319	119	I.	I.	NNP
en-wikipedia-org-1345	320	1	A.	A.	NNP
en-wikipedia-org-1345	320	2	Richards	Richards	NNP
en-wikipedia-org-1345	320	3	Igor	Igor	NNP
en-wikipedia-org-1345	320	4	Aleksander	Aleksander	NNP
en-wikipedia-org-1345	320	5	Jacque	Jacque	NNP
en-wikipedia-org-1345	320	6	Fresco	Fresco	NNP
en-wikipedia-org-1345	320	7	Jakob	Jakob	NNP
en-wikipedia-org-1345	320	8	von	von	NNP
en-wikipedia-org-1345	320	9	Uexküll	Uexküll	NNP
en-wikipedia-org-1345	320	10	Jason	Jason	NNP
en-wikipedia-org-1345	320	11	Jixuan	Jixuan	NNP
en-wikipedia-org-1345	320	12	Hu	Hu	NNP
en-wikipedia-org-1345	320	13	Jay	Jay	NNP
en-wikipedia-org-1345	320	14	Wright	Wright	NNP
en-wikipedia-org-1345	320	15	Forrester	Forrester	NNP
en-wikipedia-org-1345	320	16	Jennifer	Jennifer	NNP
en-wikipedia-org-1345	320	17	Wilby	Wilby	NNP
en-wikipedia-org-1345	320	18	John	John	NNP
en-wikipedia-org-1345	320	19	N.	N.	NNP
en-wikipedia-org-1345	320	20	Warfield	Warfield	NNP
en-wikipedia-org-1345	320	21	Kevin	Kevin	NNP
en-wikipedia-org-1345	320	22	Warwick	Warwick	NNP
en-wikipedia-org-1345	320	23	Ludwig	Ludwig	NNP
en-wikipedia-org-1345	320	24	von	von	NNP
en-wikipedia-org-1345	320	25	Bertalanffy	Bertalanffy	NNP
en-wikipedia-org-1345	320	26	Maleyka	Maleyka	NNP
en-wikipedia-org-1345	320	27	Abbaszadeh	Abbaszadeh	NNP
en-wikipedia-org-1345	320	28	Manfred	Manfred	NNP
en-wikipedia-org-1345	320	29	Clynes	Clynes	NNP
en-wikipedia-org-1345	320	30	Margaret	Margaret	NNP
en-wikipedia-org-1345	320	31	Mead	Mead	NNP
en-wikipedia-org-1345	320	32	Marian	Marian	NNP
en-wikipedia-org-1345	320	33	Mazur	Mazur	NNP
en-wikipedia-org-1345	320	34	N.	N.	NNP
en-wikipedia-org-1345	320	35	Katherine	Katherine	NNP
en-wikipedia-org-1345	320	36	Hayles	Hayles	NNP
en-wikipedia-org-1345	320	37	Natalia	Natalia	NNP
en-wikipedia-org-1345	320	38	Bekhtereva	Bekhtereva	NNP
en-wikipedia-org-1345	320	39	Niklas	Niklas	NNP
en-wikipedia-org-1345	320	40	Luhmann	Luhmann	NNP
en-wikipedia-org-1345	320	41	Norbert	Norbert	NNP
en-wikipedia-org-1345	320	42	Wiener	Wiener	NNP
en-wikipedia-org-1345	320	43	Pyotr	Pyotr	NNP
en-wikipedia-org-1345	320	44	Grigorenko	Grigorenko	NNP
en-wikipedia-org-1345	320	45	Qian	Qian	NNP
en-wikipedia-org-1345	320	46	Xuesen	Xuesen	NNP
en-wikipedia-org-1345	320	47	Ranulph	Ranulph	NNP
en-wikipedia-org-1345	320	48	Glanville	Glanville	NNP
en-wikipedia-org-1345	320	49	Robert	Robert	NNP
en-wikipedia-org-1345	320	50	Trappl	Trappl	NNP
en-wikipedia-org-1345	320	51	Sergei	Sergei	NNP
en-wikipedia-org-1345	320	52	P.	P.	NNP
en-wikipedia-org-1345	320	53	Kurdyumov	Kurdyumov	NNP
en-wikipedia-org-1345	320	54	Anthony	Anthony	NNP
en-wikipedia-org-1345	320	55	Stafford	Stafford	NNP
en-wikipedia-org-1345	320	56	Beer	Beer	NNP
en-wikipedia-org-1345	320	57	Stuart	Stuart	NNP
en-wikipedia-org-1345	320	58	Kauffman	Kauffman	NNP
en-wikipedia-org-1345	320	59	Stuart	Stuart	NNP
en-wikipedia-org-1345	320	60	Umpleby	Umpleby	NNP
en-wikipedia-org-1345	320	61	Talcott	Talcott	NNP
en-wikipedia-org-1345	320	62	Parsons	Parsons	NNP
en-wikipedia-org-1345	320	63	Ulla	Ulla	NNP
en-wikipedia-org-1345	320	64	Mitzdorf	Mitzdorf	NNP
en-wikipedia-org-1345	320	65	Valentin	Valentin	NNP
en-wikipedia-org-1345	320	66	Turchin	Turchin	NNP
en-wikipedia-org-1345	320	67	Valentin	Valentin	NNP
en-wikipedia-org-1345	320	68	Braitenberg	Braitenberg	NNP
en-wikipedia-org-1345	320	69	William	William	NNP
en-wikipedia-org-1345	320	70	Ross	Ross	NNP
en-wikipedia-org-1345	320	71	Ashby	Ashby	NNP
en-wikipedia-org-1345	320	72	Walter	Walter	NNP
en-wikipedia-org-1345	320	73	Bradford	Bradford	NNP
en-wikipedia-org-1345	320	74	Cannon	Cannon	NNP
en-wikipedia-org-1345	320	75	Walter	Walter	NNP
en-wikipedia-org-1345	320	76	Pitts	Pitts	NNP
en-wikipedia-org-1345	320	77	Warren	Warren	NNP
en-wikipedia-org-1345	320	78	McCulloch	McCulloch	NNP
en-wikipedia-org-1345	320	79	William	William	NNP
en-wikipedia-org-1345	320	80	Grey	Grey	NNP
en-wikipedia-org-1345	320	81	Walter	Walter	NNP
en-wikipedia-org-1345	320	82	v	v	NNP
en-wikipedia-org-1345	320	83	t	t	NNP
en-wikipedia-org-1345	320	84	e	e	NNP
en-wikipedia-org-1345	320	85	Data	Data	NNP
en-wikipedia-org-1345	320	86	compression	compression	NN
en-wikipedia-org-1345	320	87	methods	method	NNS
en-wikipedia-org-1345	320	88	Lossless	Lossless	NNP
en-wikipedia-org-1345	320	89	Entropy	Entropy	NNP
en-wikipedia-org-1345	320	90	type	type	NN
en-wikipedia-org-1345	320	91	Arithmetic	Arithmetic	NNP
en-wikipedia-org-1345	320	92	Asymmetric	Asymmetric	NNP
en-wikipedia-org-1345	320	93	numeral	numeral	JJ
en-wikipedia-org-1345	320	94	systems	system	NNS
en-wikipedia-org-1345	320	95	Golomb	Golomb	NNP
en-wikipedia-org-1345	320	96	Huffman	Huffman	NNP
en-wikipedia-org-1345	320	97	Adaptive	Adaptive	NNP
en-wikipedia-org-1345	320	98	Canonical	Canonical	NNP
en-wikipedia-org-1345	320	99	Modified	Modified	NNP
en-wikipedia-org-1345	320	100	Range	Range	NNP
en-wikipedia-org-1345	320	101	Shannon	Shannon	NNP
en-wikipedia-org-1345	320	102	Shannon	Shannon	NNP
en-wikipedia-org-1345	320	103	–	–	:
en-wikipedia-org-1345	320	104	Fano	Fano	NNP
en-wikipedia-org-1345	320	105	Shannon	Shannon	NNP
en-wikipedia-org-1345	320	106	–	–	:
en-wikipedia-org-1345	320	107	Fano	fano	NN
en-wikipedia-org-1345	320	108	–	–	:
en-wikipedia-org-1345	320	109	Elias	Elias	NNP
en-wikipedia-org-1345	320	110	Tunstall	Tunstall	NNP
en-wikipedia-org-1345	320	111	Unary	Unary	NNP
en-wikipedia-org-1345	320	112	Universal	Universal	NNP
en-wikipedia-org-1345	320	113	Exp	Exp	NNP
en-wikipedia-org-1345	320	114	-	-	HYPH
en-wikipedia-org-1345	320	115	Golomb	Golomb	NNP
en-wikipedia-org-1345	320	116	Fibonacci	Fibonacci	NNP
en-wikipedia-org-1345	320	117	Gamma	Gamma	NNP
en-wikipedia-org-1345	320	118	Levenshtein	Levenshtein	NNP
en-wikipedia-org-1345	320	119	Dictionary	Dictionary	NNP
en-wikipedia-org-1345	320	120	type	type	NN
en-wikipedia-org-1345	320	121	Byte	Byte	NNP
en-wikipedia-org-1345	320	122	pair	pair	NN
en-wikipedia-org-1345	320	123	encoding	encode	VBG
en-wikipedia-org-1345	320	124	Lempel	Lempel	NNP
en-wikipedia-org-1345	320	125	–	–	:
en-wikipedia-org-1345	320	126	Ziv	Ziv	NNP
en-wikipedia-org-1345	320	127	Brotli	Brotli	NNP
en-wikipedia-org-1345	320	128	DEFLATE	DEFLATE	NNP
en-wikipedia-org-1345	320	129	LZ4	LZ4	NNP
en-wikipedia-org-1345	320	130	LZFSE	LZFSE	NNP
en-wikipedia-org-1345	320	131	LZJB	LZJB	NNP
en-wikipedia-org-1345	320	132	LZMA	lzma	NN
en-wikipedia-org-1345	320	133	LZO	LZO	NNP
en-wikipedia-org-1345	320	134	LZRW	LZRW	NNP
en-wikipedia-org-1345	320	135	LZS	LZS	NNP
en-wikipedia-org-1345	320	136	LZSS	LZSS	NNP
en-wikipedia-org-1345	320	137	LZW	LZW	NNP
en-wikipedia-org-1345	320	138	LZWL	LZWL	NNP
en-wikipedia-org-1345	320	139	LZX	LZX	NNP
en-wikipedia-org-1345	320	140	Snappy	Snappy	NNP
en-wikipedia-org-1345	320	141	Zstandard	Zstandard	NNP
en-wikipedia-org-1345	320	142	Other	other	JJ
en-wikipedia-org-1345	320	143	types	type	NNS
en-wikipedia-org-1345	320	144	BWT	BWT	NNP
en-wikipedia-org-1345	320	145	CTW	CTW	NNP
en-wikipedia-org-1345	320	146	Delta	Delta	NNP
en-wikipedia-org-1345	320	147	DMC	DMC	NNP
en-wikipedia-org-1345	320	148	DPCM	DPCM	NNP
en-wikipedia-org-1345	320	149	LDCT	LDCT	NNP
en-wikipedia-org-1345	320	150	MTF	MTF	NNP
en-wikipedia-org-1345	320	151	PAQ	PAQ	NNP
en-wikipedia-org-1345	320	152	PPM	PPM	NNP
en-wikipedia-org-1345	320	153	RLE	RLE	NNP
en-wikipedia-org-1345	320	154	Lossy	Lossy	NNP
en-wikipedia-org-1345	320	155	Transform	Transform	NNP
en-wikipedia-org-1345	320	156	type	type	NN
en-wikipedia-org-1345	320	157	Discrete	discrete	JJ
en-wikipedia-org-1345	320	158	cosine	cosine	NN
en-wikipedia-org-1345	320	159	transform	transform	NN
en-wikipedia-org-1345	320	160	DCT	DCT	NNP
en-wikipedia-org-1345	320	161	MDCT	MDCT	NNP
en-wikipedia-org-1345	320	162	DST	DST	NNP
en-wikipedia-org-1345	320	163	FFT	FFT	NNP
en-wikipedia-org-1345	320	164	Wavelet	Wavelet	NNP
en-wikipedia-org-1345	320	165	Daubechies	Daubechies	NNP
en-wikipedia-org-1345	320	166	DWT	DWT	NNP
en-wikipedia-org-1345	320	167	SPIHT	SPIHT	NNP
en-wikipedia-org-1345	320	168	Predictive	predictive	JJ
en-wikipedia-org-1345	320	169	type	type	NN
en-wikipedia-org-1345	320	170	DPCM	DPCM	NNP
en-wikipedia-org-1345	320	171	ADPCM	ADPCM	NNP
en-wikipedia-org-1345	320	172	LPC	LPC	NNP
en-wikipedia-org-1345	320	173	ACELP	ACELP	NNP
en-wikipedia-org-1345	320	174	CELP	CELP	NNP
en-wikipedia-org-1345	320	175	LAR	LAR	NNP
en-wikipedia-org-1345	320	176	LSP	LSP	NNP
en-wikipedia-org-1345	320	177	WLPC	WLPC	NNP
en-wikipedia-org-1345	320	178	Motion	Motion	NNP
en-wikipedia-org-1345	320	179	Compensation	Compensation	NNP
en-wikipedia-org-1345	320	180	Estimation	Estimation	NNP
en-wikipedia-org-1345	320	181	Vector	Vector	NNP
en-wikipedia-org-1345	320	182	Psychoacoustic	Psychoacoustic	NNP
en-wikipedia-org-1345	320	183	Audio	Audio	NNP
en-wikipedia-org-1345	320	184	Concepts	Concepts	NNP
en-wikipedia-org-1345	320	185	Bit	Bit	NNP
en-wikipedia-org-1345	320	186	rate	rate	NN
en-wikipedia-org-1345	320	187	ABR	ABR	NNP
en-wikipedia-org-1345	320	188	CBR	CBR	NNP
en-wikipedia-org-1345	320	189	VBR	VBR	NNP
en-wikipedia-org-1345	320	190	Companding	Companding	NNP
en-wikipedia-org-1345	320	191	Convolution	Convolution	NNP
en-wikipedia-org-1345	320	192	Dynamic	Dynamic	NNP
en-wikipedia-org-1345	320	193	range	range	NN
en-wikipedia-org-1345	320	194	Latency	Latency	NNP
en-wikipedia-org-1345	320	195	Nyquist	Nyquist	NNP
en-wikipedia-org-1345	320	196	–	–	:
en-wikipedia-org-1345	320	197	Shannon	Shannon	NNP
en-wikipedia-org-1345	320	198	theorem	theorem	NN
en-wikipedia-org-1345	320	199	Sampling	Sampling	NNP
en-wikipedia-org-1345	320	200	Sound	sound	JJ
en-wikipedia-org-1345	320	201	quality	quality	NN
en-wikipedia-org-1345	320	202	Speech	speech	NN
en-wikipedia-org-1345	320	203	coding	code	VBG
en-wikipedia-org-1345	320	204	Sub	Sub	NNP
en-wikipedia-org-1345	320	205	-	-	HYPH
en-wikipedia-org-1345	320	206	band	band	NN
en-wikipedia-org-1345	320	207	coding	code	VBG
en-wikipedia-org-1345	320	208	Codec	Codec	NNP
en-wikipedia-org-1345	320	209	parts	part	VBZ
en-wikipedia-org-1345	320	210	A	a	NN
en-wikipedia-org-1345	320	211	-	-	HYPH
en-wikipedia-org-1345	320	212	law	law	NN
en-wikipedia-org-1345	320	213	μ	μ	NN
en-wikipedia-org-1345	320	214	-	-	HYPH
en-wikipedia-org-1345	320	215	law	law	NN
en-wikipedia-org-1345	320	216	DPCM	dpcm	NN
en-wikipedia-org-1345	320	217	ADPCM	ADPCM	NNP
en-wikipedia-org-1345	320	218	DM	DM	NNP
en-wikipedia-org-1345	320	219	FT	FT	NNP
en-wikipedia-org-1345	320	220	FFT	FFT	NNP
en-wikipedia-org-1345	320	221	LPC	LPC	NNP
en-wikipedia-org-1345	320	222	ACELP	ACELP	NNP
en-wikipedia-org-1345	320	223	CELP	CELP	NNP
en-wikipedia-org-1345	320	224	LAR	LAR	NNP
en-wikipedia-org-1345	320	225	LSP	LSP	NNP
en-wikipedia-org-1345	320	226	WLPC	WLPC	NNP
en-wikipedia-org-1345	320	227	MDCT	MDCT	NNP
en-wikipedia-org-1345	320	228	Psychoacoustic	Psychoacoustic	NNP
en-wikipedia-org-1345	320	229	model	model	NN
en-wikipedia-org-1345	320	230	Image	Image	NNP
en-wikipedia-org-1345	320	231	Concepts	Concepts	NNP
en-wikipedia-org-1345	320	232	Chroma	Chroma	NNP
en-wikipedia-org-1345	320	233	subsampling	subsample	VBG
en-wikipedia-org-1345	320	234	Coding	Coding	NNP
en-wikipedia-org-1345	320	235	tree	tree	NN
en-wikipedia-org-1345	320	236	unit	unit	NN
en-wikipedia-org-1345	320	237	Color	color	NN
en-wikipedia-org-1345	320	238	space	space	NN
en-wikipedia-org-1345	320	239	Compression	Compression	NNP
en-wikipedia-org-1345	320	240	artifact	artifact	JJ
en-wikipedia-org-1345	320	241	Image	Image	NNP
en-wikipedia-org-1345	320	242	resolution	resolution	NN
en-wikipedia-org-1345	320	243	Macroblock	Macroblock	NNP
en-wikipedia-org-1345	320	244	Pixel	Pixel	NNP
en-wikipedia-org-1345	320	245	PSNR	PSNR	NNP
en-wikipedia-org-1345	320	246	Quantization	Quantization	NNP
en-wikipedia-org-1345	320	247	Standard	standard	JJ
en-wikipedia-org-1345	320	248	test	test	NN
en-wikipedia-org-1345	320	249	image	image	NN
en-wikipedia-org-1345	320	250	Methods	Methods	NNP
en-wikipedia-org-1345	320	251	Chain	Chain	NNP
en-wikipedia-org-1345	320	252	code	code	NN
en-wikipedia-org-1345	320	253	DCT	DCT	NNP
en-wikipedia-org-1345	320	254	DEFLATE	DEFLATE	NNP
en-wikipedia-org-1345	320	255	Fractal	Fractal	NNP
en-wikipedia-org-1345	320	256	KLT	KLT	NNP
en-wikipedia-org-1345	320	257	LP	LP	NNP
en-wikipedia-org-1345	320	258	RLE	RLE	NNP
en-wikipedia-org-1345	320	259	Wavelet	Wavelet	NNP
en-wikipedia-org-1345	320	260	Daubechies	Daubechies	NNP
en-wikipedia-org-1345	320	261	DWT	DWT	NNP
en-wikipedia-org-1345	320	262	EZW	EZW	NNP
en-wikipedia-org-1345	320	263	SPIHT	SPIHT	NNP
en-wikipedia-org-1345	320	264	Video	video	NN
en-wikipedia-org-1345	320	265	Concepts	concept	NNS
en-wikipedia-org-1345	320	266	Bit	bit	NN
en-wikipedia-org-1345	320	267	rate	rate	NN
en-wikipedia-org-1345	320	268	ABR	ABR	NNP
en-wikipedia-org-1345	320	269	CBR	CBR	NNP
en-wikipedia-org-1345	320	270	VBR	VBR	NNP
en-wikipedia-org-1345	320	271	Display	Display	NNP
en-wikipedia-org-1345	320	272	resolution	resolution	NN
en-wikipedia-org-1345	320	273	Frame	Frame	NNP
en-wikipedia-org-1345	320	274	Frame	Frame	NNP
en-wikipedia-org-1345	320	275	rate	rate	NN
en-wikipedia-org-1345	320	276	Frame	Frame	NNP
en-wikipedia-org-1345	320	277	types	type	NNS
en-wikipedia-org-1345	320	278	Interlace	Interlace	NNP
en-wikipedia-org-1345	320	279	Video	video	NN
en-wikipedia-org-1345	320	280	characteristics	characteristic	NNS
en-wikipedia-org-1345	320	281	Video	video	NN
en-wikipedia-org-1345	320	282	quality	quality	NN
en-wikipedia-org-1345	320	283	Codec	Codec	NNP
en-wikipedia-org-1345	320	284	parts	part	NNS
en-wikipedia-org-1345	320	285	DCT	dct	NN
en-wikipedia-org-1345	320	286	DPCM	DPCM	NNP
en-wikipedia-org-1345	320	287	Deblocking	deblocke	VBG
en-wikipedia-org-1345	320	288	filter	filt	JJR
en-wikipedia-org-1345	320	289	Lapped	lap	VBN
en-wikipedia-org-1345	320	290	transform	transform	NN
en-wikipedia-org-1345	320	291	Motion	Motion	NNP
en-wikipedia-org-1345	320	292	Compensation	Compensation	NNP
en-wikipedia-org-1345	320	293	Estimation	Estimation	NNP
en-wikipedia-org-1345	320	294	Vector	Vector	NNP
en-wikipedia-org-1345	320	295	Wavelet	Wavelet	NNP
en-wikipedia-org-1345	320	296	Daubechies	Daubechies	NNP
en-wikipedia-org-1345	320	297	DWT	DWT	NNP
en-wikipedia-org-1345	320	298	Theory	theory	NN
en-wikipedia-org-1345	320	299	Entropy	Entropy	NNP
en-wikipedia-org-1345	320	300	Information	Information	NNP
en-wikipedia-org-1345	320	301	theory	theory	NN
en-wikipedia-org-1345	320	302	Timeline	Timeline	NNP
en-wikipedia-org-1345	320	303	Kolmogorov	Kolmogorov	NNP
en-wikipedia-org-1345	320	304	complexity	complexity	NN
en-wikipedia-org-1345	320	305	Quantization	Quantization	NNP
en-wikipedia-org-1345	320	306	Rate	rate	NN
en-wikipedia-org-1345	320	307	–	–	:
en-wikipedia-org-1345	320	308	distortion	distortion	NN
en-wikipedia-org-1345	320	309	Redundancy	Redundancy	NNP
en-wikipedia-org-1345	320	310	Compression	Compression	NNP
en-wikipedia-org-1345	320	311	formats	format	VBZ
en-wikipedia-org-1345	320	312	Compression	Compression	NNP
en-wikipedia-org-1345	320	313	software	software	NN
en-wikipedia-org-1345	320	314	(	(	-LRB-
en-wikipedia-org-1345	320	315	codecs	codecs	NN
en-wikipedia-org-1345	320	316	)	)	-RRB-
en-wikipedia-org-1345	320	317	v	v	NNP
en-wikipedia-org-1345	320	318	t	t	NNP
en-wikipedia-org-1345	320	319	e	e	NNP
en-wikipedia-org-1345	320	320	Mathematics	Mathematics	NNP
en-wikipedia-org-1345	320	321	(	(	-LRB-
en-wikipedia-org-1345	320	322	areas	area	NNS
en-wikipedia-org-1345	320	323	of	of	IN
en-wikipedia-org-1345	320	324	mathematics	mathematic	NNS
en-wikipedia-org-1345	320	325	)	)	-RRB-
en-wikipedia-org-1345	320	326	Foundations	Foundations	NNPS
en-wikipedia-org-1345	320	327	Category	category	NN
en-wikipedia-org-1345	320	328	theory	theory	NN
en-wikipedia-org-1345	320	329	Information	information	NN
en-wikipedia-org-1345	320	330	theory	theory	NN
en-wikipedia-org-1345	320	331	Mathematical	mathematical	JJ
en-wikipedia-org-1345	320	332	logic	logic	NN
en-wikipedia-org-1345	320	333	Philosophy	Philosophy	NNP
en-wikipedia-org-1345	320	334	of	of	IN
en-wikipedia-org-1345	320	335	mathematics	mathematic	NNS
en-wikipedia-org-1345	320	336	Set	set	NN
en-wikipedia-org-1345	320	337	theory	theory	NN
en-wikipedia-org-1345	320	338	Algebra	Algebra	NNP
en-wikipedia-org-1345	320	339	Abstract	Abstract	NNP
en-wikipedia-org-1345	320	340	Commutative	Commutative	NNP
en-wikipedia-org-1345	320	341	Elementary	Elementary	NNP
en-wikipedia-org-1345	320	342	Group	Group	NNP
en-wikipedia-org-1345	320	343	theory	theory	NN
en-wikipedia-org-1345	320	344	Linear	Linear	NNP
en-wikipedia-org-1345	320	345	Multilinear	Multilinear	NNP
en-wikipedia-org-1345	320	346	Universal	Universal	NNP
en-wikipedia-org-1345	320	347	Analysis	Analysis	NNP
en-wikipedia-org-1345	320	348	Calculus	Calculus	NNP
en-wikipedia-org-1345	320	349	Real	real	JJ
en-wikipedia-org-1345	320	350	analysis	analysis	NN
en-wikipedia-org-1345	320	351	Complex	complex	JJ
en-wikipedia-org-1345	320	352	analysis	analysis	NN
en-wikipedia-org-1345	320	353	Differential	differential	NN
en-wikipedia-org-1345	320	354	equations	equation	NNS
en-wikipedia-org-1345	320	355	Functional	functional	JJ
en-wikipedia-org-1345	320	356	analysis	analysis	NN
en-wikipedia-org-1345	320	357	Harmonic	harmonic	JJ
en-wikipedia-org-1345	320	358	analysis	analysis	NN
en-wikipedia-org-1345	320	359	Discrete	Discrete	NNP
en-wikipedia-org-1345	320	360	Combinatorics	Combinatorics	NNPS
en-wikipedia-org-1345	320	361	Graph	Graph	NNP
en-wikipedia-org-1345	320	362	theory	theory	NN
en-wikipedia-org-1345	320	363	Order	order	NN
en-wikipedia-org-1345	320	364	theory	theory	NN
en-wikipedia-org-1345	320	365	Game	game	NN
en-wikipedia-org-1345	320	366	theory	theory	NN
en-wikipedia-org-1345	320	367	Geometry	Geometry	NNP
en-wikipedia-org-1345	320	368	Algebraic	Algebraic	NNP
en-wikipedia-org-1345	320	369	Analytic	Analytic	NNP
en-wikipedia-org-1345	320	370	Differential	Differential	NNP
en-wikipedia-org-1345	320	371	Discrete	Discrete	NNP
en-wikipedia-org-1345	320	372	Euclidean	Euclidean	NNP
en-wikipedia-org-1345	320	373	Finite	Finite	NNP
en-wikipedia-org-1345	320	374	Number	Number	NNP
en-wikipedia-org-1345	320	375	theory	theory	NN
en-wikipedia-org-1345	320	376	Arithmetic	Arithmetic	NNP
en-wikipedia-org-1345	320	377	Algebraic	Algebraic	NNP
en-wikipedia-org-1345	320	378	number	number	NN
en-wikipedia-org-1345	320	379	theory	theory	NN
en-wikipedia-org-1345	320	380	Analytic	analytic	JJ
en-wikipedia-org-1345	320	381	number	number	NN
en-wikipedia-org-1345	320	382	theory	theory	NN
en-wikipedia-org-1345	320	383	Diophantine	Diophantine	NNP
en-wikipedia-org-1345	320	384	geometry	geometry	NN
en-wikipedia-org-1345	320	385	Topology	Topology	NNP
en-wikipedia-org-1345	320	386	Algebraic	Algebraic	NNP
en-wikipedia-org-1345	320	387	Differential	Differential	NNP
en-wikipedia-org-1345	320	388	Geometric	Geometric	NNP
en-wikipedia-org-1345	320	389	Applied	Applied	NNP
en-wikipedia-org-1345	320	390	Control	Control	NNP
en-wikipedia-org-1345	320	391	theory	theory	NN
en-wikipedia-org-1345	320	392	Mathematical	mathematical	JJ
en-wikipedia-org-1345	320	393	biology	biology	NN
en-wikipedia-org-1345	320	394	Mathematical	mathematical	JJ
en-wikipedia-org-1345	320	395	chemistry	chemistry	NN
en-wikipedia-org-1345	320	396	Mathematical	Mathematical	NNP
en-wikipedia-org-1345	320	397	economics	economic	NNS
en-wikipedia-org-1345	320	398	Mathematical	Mathematical	NNP
en-wikipedia-org-1345	320	399	finance	finance	NN
en-wikipedia-org-1345	320	400	Mathematical	mathematical	JJ
en-wikipedia-org-1345	320	401	physics	physics	NN
en-wikipedia-org-1345	320	402	Mathematical	mathematical	JJ
en-wikipedia-org-1345	320	403	psychology	psychology	NN
en-wikipedia-org-1345	320	404	Mathematical	mathematical	JJ
en-wikipedia-org-1345	320	405	sociology	sociology	NN
en-wikipedia-org-1345	320	406	Mathematical	Mathematical	NNP
en-wikipedia-org-1345	320	407	statistics	statistics	NNPS
en-wikipedia-org-1345	320	408	Operations	Operations	NNPS
en-wikipedia-org-1345	320	409	research	research	NN
en-wikipedia-org-1345	320	410	Probability	Probability	NNP
en-wikipedia-org-1345	320	411	Statistics	Statistics	NNPS
en-wikipedia-org-1345	320	412	Computational	Computational	NNP
en-wikipedia-org-1345	320	413	Computer	Computer	NNP
en-wikipedia-org-1345	320	414	science	science	NN
en-wikipedia-org-1345	320	415	Theory	theory	NN
en-wikipedia-org-1345	320	416	of	of	IN
en-wikipedia-org-1345	320	417	computation	computation	NN
en-wikipedia-org-1345	320	418	Numerical	numerical	JJ
en-wikipedia-org-1345	320	419	analysis	analysis	NN
en-wikipedia-org-1345	320	420	Optimization	Optimization	NNP
en-wikipedia-org-1345	320	421	Computer	Computer	NNP
en-wikipedia-org-1345	320	422	algebra	algebra	NN
en-wikipedia-org-1345	320	423	Related	relate	VBN
en-wikipedia-org-1345	320	424	topics	topic	NNS
en-wikipedia-org-1345	320	425	History	history	NN
en-wikipedia-org-1345	320	426	of	of	IN
en-wikipedia-org-1345	320	427	mathematics	mathematic	NNS
en-wikipedia-org-1345	320	428	Recreational	recreational	JJ
en-wikipedia-org-1345	320	429	mathematics	mathematic	NNS
en-wikipedia-org-1345	320	430	Mathematics	Mathematics	NNP
en-wikipedia-org-1345	320	431	and	and	CC
en-wikipedia-org-1345	320	432	art	art	NN
en-wikipedia-org-1345	320	433	Mathematics	Mathematics	NNP
en-wikipedia-org-1345	320	434	education	education	NN
en-wikipedia-org-1345	320	435	Category	Category	NNP
en-wikipedia-org-1345	320	436	Portal	Portal	NNP
en-wikipedia-org-1345	320	437	Commons	Commons	NNPS
en-wikipedia-org-1345	320	438	WikiProject	WikiProject	NNP
en-wikipedia-org-1345	320	439	v	v	NN
en-wikipedia-org-1345	320	440	t	t	NN
en-wikipedia-org-1345	320	441	e	e	NN
en-wikipedia-org-1345	320	442	Computer	computer	NN
en-wikipedia-org-1345	320	443	science	science	NN
en-wikipedia-org-1345	320	444	Note	note	NN
en-wikipedia-org-1345	320	445	:	:	:
en-wikipedia-org-1345	320	446	This	this	DT
en-wikipedia-org-1345	320	447	template	template	NN
en-wikipedia-org-1345	320	448	roughly	roughly	RB
en-wikipedia-org-1345	320	449	follows	follow	VBZ
en-wikipedia-org-1345	320	450	the	the	DT
en-wikipedia-org-1345	320	451	2012	2012	CD
en-wikipedia-org-1345	320	452	ACM	ACM	NNP
en-wikipedia-org-1345	320	453	Computing	Computing	NNP
en-wikipedia-org-1345	320	454	Classification	Classification	NNP
en-wikipedia-org-1345	320	455	System	system	NN
en-wikipedia-org-1345	320	456	.	.	.
en-wikipedia-org-1345	321	1	Hardware	Hardware	NNP
en-wikipedia-org-1345	321	2	Printed	Printed	NNP
en-wikipedia-org-1345	321	3	circuit	circuit	NN
en-wikipedia-org-1345	321	4	board	board	NN
en-wikipedia-org-1345	321	5	Peripheral	Peripheral	NNP
en-wikipedia-org-1345	321	6	Integrated	Integrated	NNP
en-wikipedia-org-1345	321	7	circuit	circuit	NN
en-wikipedia-org-1345	321	8	Very	very	RB
en-wikipedia-org-1345	321	9	Large	large	JJ
en-wikipedia-org-1345	321	10	Scale	Scale	NNP
en-wikipedia-org-1345	321	11	Integration	integration	NN
en-wikipedia-org-1345	321	12	Systems	Systems	NNPS
en-wikipedia-org-1345	321	13	on	on	IN
en-wikipedia-org-1345	321	14	Chip	Chip	NNP
en-wikipedia-org-1345	321	15	(	(	-LRB-
en-wikipedia-org-1345	321	16	SoCs	SoCs	NNP
en-wikipedia-org-1345	321	17	)	)	-RRB-
en-wikipedia-org-1345	321	18	Energy	energy	NN
en-wikipedia-org-1345	321	19	consumption	consumption	NN
en-wikipedia-org-1345	321	20	(	(	-LRB-
en-wikipedia-org-1345	321	21	Green	green	JJ
en-wikipedia-org-1345	321	22	computing	computing	NN
en-wikipedia-org-1345	321	23	)	)	-RRB-
en-wikipedia-org-1345	321	24	Electronic	electronic	JJ
en-wikipedia-org-1345	321	25	design	design	NN
en-wikipedia-org-1345	321	26	automation	automation	NN
en-wikipedia-org-1345	321	27	Hardware	hardware	NN
en-wikipedia-org-1345	321	28	acceleration	acceleration	NN
en-wikipedia-org-1345	321	29	Computer	Computer	NNP
en-wikipedia-org-1345	321	30	systems	system	NNS
en-wikipedia-org-1345	321	31	organization	organization	NN
en-wikipedia-org-1345	321	32	Computer	Computer	NNP
en-wikipedia-org-1345	321	33	architecture	architecture	NN
en-wikipedia-org-1345	321	34	Embedded	Embedded	NNP
en-wikipedia-org-1345	321	35	system	system	NN
en-wikipedia-org-1345	321	36	Real	real	JJ
en-wikipedia-org-1345	321	37	-	-	HYPH
en-wikipedia-org-1345	321	38	time	time	NN
en-wikipedia-org-1345	321	39	computing	compute	VBG
en-wikipedia-org-1345	321	40	Dependability	Dependability	NNP
en-wikipedia-org-1345	321	41	Networks	Networks	NNP
en-wikipedia-org-1345	321	42	Network	Network	NNP
en-wikipedia-org-1345	321	43	architecture	architecture	NN
en-wikipedia-org-1345	321	44	Network	Network	NNP
en-wikipedia-org-1345	321	45	protocol	protocol	NN
en-wikipedia-org-1345	321	46	Network	Network	NNP
en-wikipedia-org-1345	321	47	components	component	VBZ
en-wikipedia-org-1345	321	48	Network	Network	NNP
en-wikipedia-org-1345	321	49	scheduler	scheduler	NN
en-wikipedia-org-1345	321	50	Network	Network	NNP
en-wikipedia-org-1345	321	51	performance	performance	NN
en-wikipedia-org-1345	321	52	evaluation	evaluation	NN
en-wikipedia-org-1345	321	53	Network	Network	NNP
en-wikipedia-org-1345	321	54	service	service	NN
en-wikipedia-org-1345	321	55	Software	Software	NNP
en-wikipedia-org-1345	321	56	organization	organization	NN
en-wikipedia-org-1345	321	57	Interpreter	Interpreter	NNP
en-wikipedia-org-1345	321	58	Middleware	Middleware	NNP
en-wikipedia-org-1345	321	59	Virtual	virtual	JJ
en-wikipedia-org-1345	321	60	machine	machine	NN
en-wikipedia-org-1345	321	61	Operating	operating	NN
en-wikipedia-org-1345	321	62	system	system	NN
en-wikipedia-org-1345	321	63	Software	Software	NNP
en-wikipedia-org-1345	321	64	quality	quality	NN
en-wikipedia-org-1345	321	65	Software	software	NN
en-wikipedia-org-1345	321	66	notations	notation	NNS
en-wikipedia-org-1345	321	67	and	and	CC
en-wikipedia-org-1345	321	68	tools	tool	NNS
en-wikipedia-org-1345	321	69	Programming	Programming	NNP
en-wikipedia-org-1345	321	70	paradigm	paradigm	NN
en-wikipedia-org-1345	321	71	Programming	Programming	NNP
en-wikipedia-org-1345	321	72	language	language	NN
en-wikipedia-org-1345	321	73	Compiler	Compiler	NNP
en-wikipedia-org-1345	321	74	Domain	domain	NN
en-wikipedia-org-1345	321	75	-	-	HYPH
en-wikipedia-org-1345	321	76	specific	specific	JJ
en-wikipedia-org-1345	321	77	language	language	NN
en-wikipedia-org-1345	321	78	Modeling	Modeling	NNP
en-wikipedia-org-1345	321	79	language	language	NN
en-wikipedia-org-1345	321	80	Software	Software	NNP
en-wikipedia-org-1345	321	81	framework	framework	NN
en-wikipedia-org-1345	321	82	Integrated	integrated	JJ
en-wikipedia-org-1345	321	83	development	development	NN
en-wikipedia-org-1345	321	84	environment	environment	NN
en-wikipedia-org-1345	321	85	Software	software	NN
en-wikipedia-org-1345	321	86	configuration	configuration	NN
en-wikipedia-org-1345	321	87	management	management	NN
en-wikipedia-org-1345	321	88	Software	Software	NNP
en-wikipedia-org-1345	321	89	library	library	NN
en-wikipedia-org-1345	321	90	Software	Software	NNP
en-wikipedia-org-1345	321	91	repository	repository	NN
en-wikipedia-org-1345	321	92	Software	Software	NNP
en-wikipedia-org-1345	321	93	development	development	NN
en-wikipedia-org-1345	321	94	Control	Control	NNP
en-wikipedia-org-1345	321	95	variable	variable	JJ
en-wikipedia-org-1345	321	96	Software	Software	NNP
en-wikipedia-org-1345	321	97	development	development	NN
en-wikipedia-org-1345	321	98	process	process	NN
en-wikipedia-org-1345	321	99	Requirements	requirement	NNS
en-wikipedia-org-1345	321	100	analysis	analysis	NN
en-wikipedia-org-1345	321	101	Software	software	NN
en-wikipedia-org-1345	321	102	design	design	NN
en-wikipedia-org-1345	321	103	Software	software	NN
en-wikipedia-org-1345	321	104	construction	construction	NN
en-wikipedia-org-1345	321	105	Software	Software	NNP
en-wikipedia-org-1345	321	106	deployment	deployment	NN
en-wikipedia-org-1345	321	107	Software	Software	NNP
en-wikipedia-org-1345	321	108	maintenance	maintenance	NN
en-wikipedia-org-1345	321	109	Programming	Programming	NNP
en-wikipedia-org-1345	321	110	team	team	NN
en-wikipedia-org-1345	321	111	Open	open	JJ
en-wikipedia-org-1345	321	112	-	-	HYPH
en-wikipedia-org-1345	321	113	source	source	NN
en-wikipedia-org-1345	321	114	model	model	NN
en-wikipedia-org-1345	321	115	Theory	theory	NN
en-wikipedia-org-1345	321	116	of	of	IN
en-wikipedia-org-1345	321	117	computation	computation	NN
en-wikipedia-org-1345	321	118	Model	model	NN
en-wikipedia-org-1345	321	119	of	of	IN
en-wikipedia-org-1345	321	120	computation	computation	NN
en-wikipedia-org-1345	321	121	Formal	formal	JJ
en-wikipedia-org-1345	321	122	language	language	NN
en-wikipedia-org-1345	321	123	Automata	Automata	NNP
en-wikipedia-org-1345	321	124	theory	theory	NN
en-wikipedia-org-1345	321	125	Computability	computability	NN
en-wikipedia-org-1345	321	126	theory	theory	NN
en-wikipedia-org-1345	321	127	Computational	computational	JJ
en-wikipedia-org-1345	321	128	complexity	complexity	NN
en-wikipedia-org-1345	321	129	theory	theory	NN
en-wikipedia-org-1345	321	130	Logic	Logic	NNP
en-wikipedia-org-1345	321	131	Semantics	Semantics	NNPS
en-wikipedia-org-1345	321	132	Algorithms	Algorithms	NNP
en-wikipedia-org-1345	321	133	Algorithm	Algorithm	NNP
en-wikipedia-org-1345	321	134	design	design	VBP
en-wikipedia-org-1345	321	135	Analysis	Analysis	NNP
en-wikipedia-org-1345	321	136	of	of	IN
en-wikipedia-org-1345	321	137	algorithms	algorithm	NNS
en-wikipedia-org-1345	321	138	Algorithmic	algorithmic	JJ
en-wikipedia-org-1345	321	139	efficiency	efficiency	NN
en-wikipedia-org-1345	321	140	Randomized	randomized	JJ
en-wikipedia-org-1345	321	141	algorithm	algorithm	NN
en-wikipedia-org-1345	321	142	Computational	Computational	NNP
en-wikipedia-org-1345	321	143	geometry	geometry	NN
en-wikipedia-org-1345	321	144	Mathematics	Mathematics	NNPS
en-wikipedia-org-1345	321	145	of	of	IN
en-wikipedia-org-1345	321	146	computing	compute	VBG
en-wikipedia-org-1345	321	147	Discrete	discrete	JJ
en-wikipedia-org-1345	321	148	mathematics	mathematic	NNS
en-wikipedia-org-1345	321	149	Probability	Probability	NNP
en-wikipedia-org-1345	321	150	Statistics	Statistics	NNPS
en-wikipedia-org-1345	321	151	Mathematical	mathematical	JJ
en-wikipedia-org-1345	321	152	software	software	NN
en-wikipedia-org-1345	321	153	Information	information	NN
en-wikipedia-org-1345	321	154	theory	theory	NN
en-wikipedia-org-1345	321	155	Mathematical	mathematical	JJ
en-wikipedia-org-1345	321	156	analysis	analysis	NN
en-wikipedia-org-1345	321	157	Numerical	numerical	JJ
en-wikipedia-org-1345	321	158	analysis	analysis	NN
en-wikipedia-org-1345	321	159	Information	Information	NNP
en-wikipedia-org-1345	321	160	systems	system	NNS
en-wikipedia-org-1345	321	161	Database	Database	NNP
en-wikipedia-org-1345	321	162	management	management	NN
en-wikipedia-org-1345	321	163	system	system	NN
en-wikipedia-org-1345	321	164	Information	information	NN
en-wikipedia-org-1345	321	165	storage	storage	NN
en-wikipedia-org-1345	321	166	systems	system	NNS
en-wikipedia-org-1345	321	167	Enterprise	enterprise	NN
en-wikipedia-org-1345	321	168	information	information	NN
en-wikipedia-org-1345	321	169	system	system	NN
en-wikipedia-org-1345	321	170	Social	social	JJ
en-wikipedia-org-1345	321	171	information	information	NN
en-wikipedia-org-1345	321	172	systems	system	NNS
en-wikipedia-org-1345	321	173	Geographic	geographic	JJ
en-wikipedia-org-1345	321	174	information	information	NN
en-wikipedia-org-1345	321	175	system	system	NN
en-wikipedia-org-1345	321	176	Decision	decision	NN
en-wikipedia-org-1345	321	177	support	support	NN
en-wikipedia-org-1345	321	178	system	system	NN
en-wikipedia-org-1345	321	179	Process	process	NN
en-wikipedia-org-1345	321	180	control	control	NN
en-wikipedia-org-1345	321	181	system	system	NN
en-wikipedia-org-1345	321	182	Multimedia	Multimedia	NNP
en-wikipedia-org-1345	321	183	information	information	NN
en-wikipedia-org-1345	321	184	system	system	NN
en-wikipedia-org-1345	321	185	Data	Data	NNP
en-wikipedia-org-1345	321	186	mining	mining	NN
en-wikipedia-org-1345	321	187	Digital	Digital	NNP
en-wikipedia-org-1345	321	188	library	library	NN
en-wikipedia-org-1345	321	189	Computing	Computing	NNP
en-wikipedia-org-1345	321	190	platform	platform	NN
en-wikipedia-org-1345	321	191	Digital	Digital	NNP
en-wikipedia-org-1345	321	192	marketing	marketing	NN
en-wikipedia-org-1345	321	193	World	World	NNP
en-wikipedia-org-1345	321	194	Wide	Wide	NNP
en-wikipedia-org-1345	321	195	Web	Web	NNP
en-wikipedia-org-1345	321	196	Information	Information	NNP
en-wikipedia-org-1345	321	197	retrieval	retrieval	NN
en-wikipedia-org-1345	321	198	Security	Security	NNP
en-wikipedia-org-1345	321	199	Cryptography	Cryptography	NNP
en-wikipedia-org-1345	321	200	Formal	Formal	NNP
en-wikipedia-org-1345	321	201	methods	method	NNS
en-wikipedia-org-1345	321	202	Security	security	NN
en-wikipedia-org-1345	321	203	services	service	NNS
en-wikipedia-org-1345	321	204	Intrusion	intrusion	NN
en-wikipedia-org-1345	321	205	detection	detection	NN
en-wikipedia-org-1345	321	206	system	system	NN
en-wikipedia-org-1345	321	207	Hardware	Hardware	NNP
en-wikipedia-org-1345	321	208	security	security	NN
en-wikipedia-org-1345	321	209	Network	Network	NNP
en-wikipedia-org-1345	321	210	security	security	NN
en-wikipedia-org-1345	321	211	Information	Information	NNP
en-wikipedia-org-1345	321	212	security	security	NN
en-wikipedia-org-1345	321	213	Application	Application	NNP
en-wikipedia-org-1345	321	214	security	security	NN
en-wikipedia-org-1345	321	215	Human	human	NN
en-wikipedia-org-1345	321	216	–	–	:
en-wikipedia-org-1345	321	217	computer	computer	NN
en-wikipedia-org-1345	321	218	interaction	interaction	NN
en-wikipedia-org-1345	321	219	Interaction	Interaction	NNP
en-wikipedia-org-1345	321	220	design	design	NN
en-wikipedia-org-1345	321	221	Social	social	JJ
en-wikipedia-org-1345	321	222	computing	compute	VBG
en-wikipedia-org-1345	321	223	Ubiquitous	ubiquitous	JJ
en-wikipedia-org-1345	321	224	computing	computing	NN
en-wikipedia-org-1345	321	225	Visualization	visualization	NN
en-wikipedia-org-1345	321	226	Accessibility	Accessibility	NNP
en-wikipedia-org-1345	321	227	Concurrency	Concurrency	NNP
en-wikipedia-org-1345	321	228	Concurrent	Concurrent	NNP
en-wikipedia-org-1345	321	229	computing	compute	VBG
en-wikipedia-org-1345	321	230	Parallel	parallel	JJ
en-wikipedia-org-1345	321	231	computing	compute	VBG
en-wikipedia-org-1345	321	232	Distributed	distribute	VBN
en-wikipedia-org-1345	321	233	computing	compute	VBG
en-wikipedia-org-1345	321	234	Multithreading	multithreade	VBG
en-wikipedia-org-1345	321	235	Multiprocessing	multiprocesse	VBG
en-wikipedia-org-1345	321	236	Artificial	artificial	JJ
en-wikipedia-org-1345	321	237	intelligence	intelligence	NN
en-wikipedia-org-1345	321	238	Natural	natural	JJ
en-wikipedia-org-1345	321	239	language	language	NN
en-wikipedia-org-1345	321	240	processing	process	VBG
en-wikipedia-org-1345	321	241	Knowledge	knowledge	NN
en-wikipedia-org-1345	321	242	representation	representation	NN
en-wikipedia-org-1345	321	243	and	and	CC
en-wikipedia-org-1345	321	244	reasoning	reason	VBG
en-wikipedia-org-1345	321	245	Computer	Computer	NNP
en-wikipedia-org-1345	321	246	vision	vision	NN
en-wikipedia-org-1345	321	247	Automated	Automated	NNP
en-wikipedia-org-1345	321	248	planning	planning	NN
en-wikipedia-org-1345	321	249	and	and	CC
en-wikipedia-org-1345	321	250	scheduling	scheduling	NN
en-wikipedia-org-1345	321	251	Search	Search	NNP
en-wikipedia-org-1345	321	252	methodology	methodology	NN
en-wikipedia-org-1345	321	253	Control	Control	NNP
en-wikipedia-org-1345	321	254	method	method	NN
en-wikipedia-org-1345	321	255	Philosophy	Philosophy	NNP
en-wikipedia-org-1345	321	256	of	of	IN
en-wikipedia-org-1345	321	257	artificial	artificial	JJ
en-wikipedia-org-1345	321	258	intelligence	intelligence	NN
en-wikipedia-org-1345	321	259	Distributed	distribute	VBN
en-wikipedia-org-1345	321	260	artificial	artificial	JJ
en-wikipedia-org-1345	321	261	intelligence	intelligence	NN
en-wikipedia-org-1345	321	262	Machine	Machine	NNP
en-wikipedia-org-1345	321	263	learning	learn	VBG
en-wikipedia-org-1345	321	264	Supervised	supervise	VBN
en-wikipedia-org-1345	321	265	learning	learn	VBG
en-wikipedia-org-1345	321	266	Unsupervised	unsupervised	JJ
en-wikipedia-org-1345	321	267	learning	learn	VBG
en-wikipedia-org-1345	321	268	Reinforcement	reinforcement	NN
en-wikipedia-org-1345	321	269	learning	learn	VBG
en-wikipedia-org-1345	321	270	Multi	multi	JJ
en-wikipedia-org-1345	321	271	-	-	JJ
en-wikipedia-org-1345	321	272	task	task	JJ
en-wikipedia-org-1345	321	273	learning	learn	VBG
en-wikipedia-org-1345	321	274	Cross	cross	JJ
en-wikipedia-org-1345	321	275	-	-	JJ
en-wikipedia-org-1345	321	276	validation	validation	NN
en-wikipedia-org-1345	321	277	Graphics	Graphics	NNP
en-wikipedia-org-1345	321	278	Animation	Animation	NNP
en-wikipedia-org-1345	321	279	Rendering	Rendering	NNP
en-wikipedia-org-1345	321	280	Image	Image	NNP
en-wikipedia-org-1345	321	281	manipulation	manipulation	NN
en-wikipedia-org-1345	321	282	Graphics	Graphics	NNP
en-wikipedia-org-1345	321	283	processing	processing	NN
en-wikipedia-org-1345	321	284	unit	unit	NN
en-wikipedia-org-1345	321	285	Mixed	mix	VBN
en-wikipedia-org-1345	321	286	reality	reality	NN
en-wikipedia-org-1345	321	287	Virtual	virtual	JJ
en-wikipedia-org-1345	321	288	reality	reality	NN
en-wikipedia-org-1345	321	289	Image	image	NN
en-wikipedia-org-1345	321	290	compression	compression	NN
en-wikipedia-org-1345	321	291	Solid	solid	JJ
en-wikipedia-org-1345	321	292	modeling	model	VBG
en-wikipedia-org-1345	321	293	Applied	applied	JJ
en-wikipedia-org-1345	321	294	computing	computing	NN
en-wikipedia-org-1345	321	295	E	e	NN
en-wikipedia-org-1345	321	296	-	-	NN
en-wikipedia-org-1345	321	297	commerce	commerce	NN
en-wikipedia-org-1345	321	298	Enterprise	enterprise	NN
en-wikipedia-org-1345	321	299	software	software	NN
en-wikipedia-org-1345	321	300	Computational	computational	JJ
en-wikipedia-org-1345	321	301	mathematics	mathematic	NNS
en-wikipedia-org-1345	321	302	Computational	computational	JJ
en-wikipedia-org-1345	321	303	physics	physics	NN
en-wikipedia-org-1345	321	304	Computational	computational	JJ
en-wikipedia-org-1345	321	305	chemistry	chemistry	NN
en-wikipedia-org-1345	321	306	Computational	computational	JJ
en-wikipedia-org-1345	321	307	biology	biology	NN
en-wikipedia-org-1345	321	308	Computational	computational	JJ
en-wikipedia-org-1345	321	309	social	social	JJ
en-wikipedia-org-1345	321	310	science	science	NN
en-wikipedia-org-1345	321	311	Computational	Computational	NNP
en-wikipedia-org-1345	321	312	engineering	engineering	NN
en-wikipedia-org-1345	321	313	Computational	Computational	NNP
en-wikipedia-org-1345	321	314	healthcare	healthcare	NN
en-wikipedia-org-1345	321	315	Digital	Digital	NNP
en-wikipedia-org-1345	321	316	art	art	NN
en-wikipedia-org-1345	321	317	Electronic	electronic	JJ
en-wikipedia-org-1345	321	318	publishing	publishing	NN
en-wikipedia-org-1345	321	319	Cyberwarfare	Cyberwarfare	NNP
en-wikipedia-org-1345	321	320	Electronic	electronic	JJ
en-wikipedia-org-1345	321	321	voting	voting	NN
en-wikipedia-org-1345	321	322	Video	video	NN
en-wikipedia-org-1345	321	323	games	game	NNS
en-wikipedia-org-1345	321	324	Word	Word	NNP
en-wikipedia-org-1345	321	325	processing	processing	NN
en-wikipedia-org-1345	321	326	Operations	Operations	NNPS
en-wikipedia-org-1345	321	327	research	research	NN
en-wikipedia-org-1345	321	328	Educational	educational	JJ
en-wikipedia-org-1345	321	329	technology	technology	NN
en-wikipedia-org-1345	321	330	Document	Document	NNP
en-wikipedia-org-1345	321	331	management	management	NN
en-wikipedia-org-1345	321	332	Book	Book	NNP
en-wikipedia-org-1345	321	333	Category	Category	NNP
en-wikipedia-org-1345	321	334	Outline	Outline	NNP
en-wikipedia-org-1345	321	335	WikiProject	WikiProject	NNP
en-wikipedia-org-1345	321	336	Commons	Commons	NNPS
en-wikipedia-org-1345	321	337	Authority	Authority	NNP
en-wikipedia-org-1345	321	338	control	control	NN
en-wikipedia-org-1345	321	339	GND	GND	NNP
en-wikipedia-org-1345	321	340	:	:	:
en-wikipedia-org-1345	321	341	4026927	4026927	CD
en-wikipedia-org-1345	321	342	-	-	SYM
en-wikipedia-org-1345	321	343	9	9	CD
en-wikipedia-org-1345	321	344	NDL	NDL	NNP
en-wikipedia-org-1345	321	345	:	:	:
en-wikipedia-org-1345	321	346	00575012	00575012	CD
en-wikipedia-org-1345	321	347	Retrieved	retrieve	VBN
en-wikipedia-org-1345	321	348	from	from	IN
en-wikipedia-org-1345	321	349	"	"	``
en-wikipedia-org-1345	321	350	https://en.wikipedia.org/w/index.php?title=Information_theory&oldid=993880166	https://en.wikipedia.org/w/index.php?title=Information_theory&oldid=993880166	NNP
en-wikipedia-org-1345	321	351	"	"	''
en-wikipedia-org-1345	321	352	Categories	category	NNS
en-wikipedia-org-1345	321	353	:	:	:
en-wikipedia-org-1345	321	354	Information	information	NN
en-wikipedia-org-1345	321	355	theory	theory	NN
en-wikipedia-org-1345	321	356	Computer	computer	NN
en-wikipedia-org-1345	321	357	-	-	HYPH
en-wikipedia-org-1345	321	358	related	relate	VBN
en-wikipedia-org-1345	321	359	introductions	introduction	NNS
en-wikipedia-org-1345	321	360	in	in	IN
en-wikipedia-org-1345	321	361	1948	1948	CD
en-wikipedia-org-1345	321	362	Computer	Computer	NNP
en-wikipedia-org-1345	321	363	science	science	NN
en-wikipedia-org-1345	321	364	Cybernetics	Cybernetics	NNP
en-wikipedia-org-1345	321	365	Formal	Formal	NNP
en-wikipedia-org-1345	321	366	sciences	science	VBZ
en-wikipedia-org-1345	321	367	Information	Information	NNP
en-wikipedia-org-1345	321	368	Age	Age	NNP
en-wikipedia-org-1345	321	369	Claude	Claude	NNP
en-wikipedia-org-1345	321	370	Shannon	Shannon	NNP
en-wikipedia-org-1345	321	371	Hidden	Hidden	NNP
en-wikipedia-org-1345	321	372	categories	category	NNS
en-wikipedia-org-1345	321	373	:	:	:
en-wikipedia-org-1345	321	374	Articles	article	NNS
en-wikipedia-org-1345	321	375	with	with	IN
en-wikipedia-org-1345	321	376	short	short	JJ
en-wikipedia-org-1345	321	377	description	description	NN
en-wikipedia-org-1345	321	378	Short	short	JJ
en-wikipedia-org-1345	321	379	description	description	NN
en-wikipedia-org-1345	321	380	is	be	VBZ
en-wikipedia-org-1345	321	381	different	different	JJ
en-wikipedia-org-1345	321	382	from	from	IN
en-wikipedia-org-1345	321	383	Wikidata	Wikidata	NNP
en-wikipedia-org-1345	321	384	Articles	Articles	NNPS
en-wikipedia-org-1345	321	385	with	with	IN
en-wikipedia-org-1345	321	386	too	too	RB
en-wikipedia-org-1345	321	387	many	many	JJ
en-wikipedia-org-1345	321	388	examples	example	NNS
en-wikipedia-org-1345	321	389	from	from	IN
en-wikipedia-org-1345	321	390	May	May	NNP
en-wikipedia-org-1345	321	391	2020	2020	CD
en-wikipedia-org-1345	321	392	All	all	DT
en-wikipedia-org-1345	321	393	articles	article	NNS
en-wikipedia-org-1345	321	394	with	with	IN
en-wikipedia-org-1345	321	395	too	too	RB
en-wikipedia-org-1345	321	396	many	many	JJ
en-wikipedia-org-1345	321	397	examples	example	NNS
en-wikipedia-org-1345	321	398	Wikipedia	wikipedia	JJ
en-wikipedia-org-1345	321	399	articles	article	NNS
en-wikipedia-org-1345	321	400	with	with	IN
en-wikipedia-org-1345	321	401	style	style	NN
en-wikipedia-org-1345	321	402	issues	issue	NNS
en-wikipedia-org-1345	321	403	from	from	IN
en-wikipedia-org-1345	321	404	May	May	NNP
en-wikipedia-org-1345	321	405	2020	2020	CD
en-wikipedia-org-1345	321	406	Wikipedia	Wikipedia	NNP
en-wikipedia-org-1345	321	407	articles	article	NNS
en-wikipedia-org-1345	321	408	with	with	IN
en-wikipedia-org-1345	321	409	GND	GND	NNP
en-wikipedia-org-1345	321	410	identifiers	identifier	NNS
en-wikipedia-org-1345	321	411	Wikipedia	Wikipedia	NNP
en-wikipedia-org-1345	321	412	articles	article	NNS
en-wikipedia-org-1345	321	413	with	with	IN
en-wikipedia-org-1345	321	414	NDL	NDL	NNP
en-wikipedia-org-1345	321	415	identifiers	identifier	NNS
en-wikipedia-org-1345	321	416	Navigation	Navigation	NNP
en-wikipedia-org-1345	321	417	menu	menu	NN
en-wikipedia-org-1345	321	418	Personal	personal	JJ
en-wikipedia-org-1345	321	419	tools	tool	NNS
en-wikipedia-org-1345	321	420	Not	not	RB
en-wikipedia-org-1345	321	421	logged	log	VBN
en-wikipedia-org-1345	321	422	in	in	IN
en-wikipedia-org-1345	321	423	Talk	Talk	NNP
en-wikipedia-org-1345	321	424	Contributions	Contributions	NNP
en-wikipedia-org-1345	321	425	Create	Create	NNP
en-wikipedia-org-1345	321	426	account	account	NN
en-wikipedia-org-1345	321	427	Log	Log	NNP
en-wikipedia-org-1345	321	428	in	in	IN
en-wikipedia-org-1345	321	429	Namespaces	Namespaces	NNP
en-wikipedia-org-1345	321	430	Article	Article	NNP
en-wikipedia-org-1345	321	431	Talk	talk	NN
en-wikipedia-org-1345	321	432	Variants	variant	VBZ
en-wikipedia-org-1345	321	433	Views	view	NNS
en-wikipedia-org-1345	321	434	Read	read	VBP
en-wikipedia-org-1345	321	435	Edit	edit	NN
en-wikipedia-org-1345	321	436	View	View	NNP
en-wikipedia-org-1345	321	437	history	history	NN
en-wikipedia-org-1345	321	438	More	More	JJR
en-wikipedia-org-1345	321	439	Search	Search	NNP
en-wikipedia-org-1345	321	440	Navigation	Navigation	NNP
en-wikipedia-org-1345	321	441	Main	Main	NNP
en-wikipedia-org-1345	321	442	page	page	NN
en-wikipedia-org-1345	321	443	Contents	content	VBZ
en-wikipedia-org-1345	321	444	Current	current	JJ
en-wikipedia-org-1345	321	445	events	event	NNS
en-wikipedia-org-1345	321	446	Random	random	JJ
en-wikipedia-org-1345	321	447	article	article	NN
en-wikipedia-org-1345	321	448	About	about	IN
en-wikipedia-org-1345	321	449	Wikipedia	Wikipedia	NNP
en-wikipedia-org-1345	321	450	Contact	Contact	NNP
en-wikipedia-org-1345	321	451	us	-PRON-	PRP
en-wikipedia-org-1345	321	452	Donate	Donate	NNP
en-wikipedia-org-1345	321	453	Contribute	contribute	NN
en-wikipedia-org-1345	321	454	Help	help	NN
en-wikipedia-org-1345	321	455	Learn	learn	VB
en-wikipedia-org-1345	321	456	to	to	TO
en-wikipedia-org-1345	321	457	edit	edit	VB
en-wikipedia-org-1345	321	458	Community	community	NN
en-wikipedia-org-1345	321	459	portal	portal	JJ
en-wikipedia-org-1345	321	460	Recent	recent	JJ
en-wikipedia-org-1345	321	461	changes	change	NNS
en-wikipedia-org-1345	321	462	Upload	upload	JJ
en-wikipedia-org-1345	321	463	file	file	NN
en-wikipedia-org-1345	321	464	Tools	tool	NNS
en-wikipedia-org-1345	321	465	What	what	WP
en-wikipedia-org-1345	321	466	links	link	NNS
en-wikipedia-org-1345	321	467	here	here	RB
en-wikipedia-org-1345	321	468	Related	relate	VBN
en-wikipedia-org-1345	321	469	changes	change	VBZ
en-wikipedia-org-1345	321	470	Upload	upload	JJ
en-wikipedia-org-1345	321	471	file	file	VBP
en-wikipedia-org-1345	321	472	Special	special	JJ
en-wikipedia-org-1345	321	473	pages	page	NNS
en-wikipedia-org-1345	321	474	Permanent	permanent	JJ
en-wikipedia-org-1345	321	475	link	link	NN
en-wikipedia-org-1345	321	476	Page	Page	NNP
en-wikipedia-org-1345	321	477	information	information	NN
en-wikipedia-org-1345	321	478	Cite	cite	VB
en-wikipedia-org-1345	321	479	this	this	DT
en-wikipedia-org-1345	321	480	page	page	NN
en-wikipedia-org-1345	321	481	Wikidata	wikidata	NN
en-wikipedia-org-1345	321	482	item	item	NN
en-wikipedia-org-1345	321	483	Print	print	NN
en-wikipedia-org-1345	321	484	/	/	SYM
en-wikipedia-org-1345	321	485	export	export	NN
en-wikipedia-org-1345	321	486	Download	Download	NNP
en-wikipedia-org-1345	321	487	as	as	IN
en-wikipedia-org-1345	321	488	PDF	PDF	NNP
en-wikipedia-org-1345	321	489	Printable	Printable	NNP
en-wikipedia-org-1345	321	490	version	version	NN
en-wikipedia-org-1345	321	491	In	in	IN
en-wikipedia-org-1345	321	492	other	other	JJ
en-wikipedia-org-1345	321	493	projects	project	NNS
en-wikipedia-org-1345	321	494	Wikimedia	Wikimedia	NNP
en-wikipedia-org-1345	321	495	Commons	Commons	NNPS
en-wikipedia-org-1345	321	496	Wikiquote	Wikiquote	NNP
en-wikipedia-org-1345	321	497	Languages	Languages	NNPS
en-wikipedia-org-1345	321	498	Afrikaans	Afrikaans	NNPS
en-wikipedia-org-1345	321	499	العربية	العربية	NN
en-wikipedia-org-1345	321	500	Asturianu	Asturianu	NNP
en-wikipedia-org-1345	321	501	Azərbaycanca	Azərbaycanca	NNP
en-wikipedia-org-1345	321	502	বাংলা	বাংলা	NNP
en-wikipedia-org-1345	321	503	Башҡортса	Башҡортса	NNP
en-wikipedia-org-1345	321	504	Беларуская	Беларуская	NNP
en-wikipedia-org-1345	321	505	Български	Български	NNP
en-wikipedia-org-1345	321	506	Boarisch	Boarisch	NNP
en-wikipedia-org-1345	321	507	Català	Català	NNP
en-wikipedia-org-1345	321	508	Čeština	Čeština	NNP
en-wikipedia-org-1345	321	509	Dansk	Dansk	NNP
en-wikipedia-org-1345	321	510	Deutsch	Deutsch	NNP
en-wikipedia-org-1345	321	511	Eesti	Eesti	NNP
en-wikipedia-org-1345	321	512	Ελληνικά	Ελληνικά	NNP
en-wikipedia-org-1345	321	513	Español	Español	NNP
en-wikipedia-org-1345	321	514	Esperanto	Esperanto	NNP
en-wikipedia-org-1345	321	515	فارسی	فارسی	JJ
en-wikipedia-org-1345	321	516	Français	Français	NNP
en-wikipedia-org-1345	321	517	Gaeilge	Gaeilge	NNP
en-wikipedia-org-1345	321	518	Galego	Galego	NNP
en-wikipedia-org-1345	321	519	한국어	한국어	NN
en-wikipedia-org-1345	321	520	Հայերեն	Հայերեն	NNP
en-wikipedia-org-1345	321	521	Hrvatski	Hrvatski	NNP
en-wikipedia-org-1345	321	522	Ido	Ido	NNP
en-wikipedia-org-1345	321	523	Bahasa	Bahasa	NNP
en-wikipedia-org-1345	321	524	Indonesia	Indonesia	NNP
en-wikipedia-org-1345	321	525	Interlingua	Interlingua	NNP
en-wikipedia-org-1345	321	526	Italiano	Italiano	NNP
en-wikipedia-org-1345	321	527	עברית	עברית	NN
en-wikipedia-org-1345	321	528	ქართული	ქართული	NN
en-wikipedia-org-1345	321	529	Қазақша	Қазақша	NNP
en-wikipedia-org-1345	321	530	Latviešu	Latviešu	NNP
en-wikipedia-org-1345	321	531	Lietuvių	Lietuvių	NNP
en-wikipedia-org-1345	321	532	Magyar	Magyar	NNP
en-wikipedia-org-1345	321	533	Македонски	Македонски	NNP
en-wikipedia-org-1345	321	534	മലയാളം	മലയാളം	IN
en-wikipedia-org-1345	321	535	Bahasa	Bahasa	NNP
en-wikipedia-org-1345	321	536	Melayu	Melayu	NNP
en-wikipedia-org-1345	321	537	Mirandés	Mirandés	NNP
en-wikipedia-org-1345	321	538	Монгол	Монгол	NNP
en-wikipedia-org-1345	321	539	မြန်မာဘာသာ	မြန်မာဘာသာ	NNP
en-wikipedia-org-1345	321	540	Nederlands	Nederlands	NNP
en-wikipedia-org-1345	321	541	日本語	日本語	NNP
en-wikipedia-org-1345	321	542	Norsk	Norsk	NNP
en-wikipedia-org-1345	321	543	bokmål	bokmål	NN
en-wikipedia-org-1345	321	544	Norsk	Norsk	NNP
en-wikipedia-org-1345	321	545	nynorsk	nynorsk	NNP
en-wikipedia-org-1345	321	546	Occitan	Occitan	NNP
en-wikipedia-org-1345	321	547	Oʻzbekcha/ўзбекча	Oʻzbekcha/ўзбекча	NNP
en-wikipedia-org-1345	321	548	پنجابی	پنجابی	NNP
en-wikipedia-org-1345	321	549	Polski	Polski	NNP
en-wikipedia-org-1345	321	550	Português	Português	NNP
en-wikipedia-org-1345	321	551	Română	Română	NNP
en-wikipedia-org-1345	321	552	Русский	Русский	NNP
en-wikipedia-org-1345	321	553	Simple	Simple	NNP
en-wikipedia-org-1345	321	554	English	English	NNP
en-wikipedia-org-1345	321	555	Slovenčina	Slovenčina	NNP
en-wikipedia-org-1345	321	556	Slovenščina	Slovenščina	NNP
en-wikipedia-org-1345	321	557	کوردی	کوردی	NN
en-wikipedia-org-1345	321	558	Српски	Српски	NNP
en-wikipedia-org-1345	321	559	/	/	SYM
en-wikipedia-org-1345	321	560	srpski	srpski	JJ
en-wikipedia-org-1345	321	561	Srpskohrvatski	Srpskohrvatski	NNP
en-wikipedia-org-1345	321	562	/	/	SYM
en-wikipedia-org-1345	321	563	српскохрватски	српскохрватски	NN
en-wikipedia-org-1345	321	564	Suomi	Suomi	NNP
en-wikipedia-org-1345	321	565	Svenska	Svenska	NNP
en-wikipedia-org-1345	321	566	Tagalog	Tagalog	NNP
en-wikipedia-org-1345	321	567	தமிழ்	தமிழ்	,
en-wikipedia-org-1345	321	568	ไทย	ไทย	NN
en-wikipedia-org-1345	321	569	Türkçe	Türkçe	NNP
en-wikipedia-org-1345	321	570	Українська	Українська	NNP
en-wikipedia-org-1345	321	571	اردو	اردو	NN
en-wikipedia-org-1345	321	572	Tiếng	Tiếng	NNP
en-wikipedia-org-1345	321	573	Việt	Việt	NNP
en-wikipedia-org-1345	321	574	吴语	吴语	NNP
en-wikipedia-org-1345	321	575	粵語	粵語	NNP
en-wikipedia-org-1345	321	576	中文	中文	NNP
en-wikipedia-org-1345	321	577	Edit	Edit	NNP
en-wikipedia-org-1345	321	578	links	link	NNS
en-wikipedia-org-1345	321	579	This	this	DT
en-wikipedia-org-1345	321	580	page	page	NN
en-wikipedia-org-1345	321	581	was	be	VBD
en-wikipedia-org-1345	321	582	last	last	RB
en-wikipedia-org-1345	321	583	edited	edit	VBN
en-wikipedia-org-1345	321	584	on	on	IN
en-wikipedia-org-1345	321	585	13	13	CD
en-wikipedia-org-1345	321	586	December	December	NNP
en-wikipedia-org-1345	321	587	2020	2020	CD
en-wikipedia-org-1345	321	588	,	,	,
en-wikipedia-org-1345	321	589	at	at	IN
en-wikipedia-org-1345	321	590	00:07	00:07	CD
en-wikipedia-org-1345	321	591	 	  	_SP
en-wikipedia-org-1345	321	592	(	(	-LRB-
en-wikipedia-org-1345	321	593	UTC	UTC	NNP
en-wikipedia-org-1345	321	594	)	)	-RRB-
en-wikipedia-org-1345	321	595	.	.	.
en-wikipedia-org-1345	322	1	Text	text	NN
en-wikipedia-org-1345	322	2	is	be	VBZ
en-wikipedia-org-1345	322	3	available	available	JJ
en-wikipedia-org-1345	322	4	under	under	IN
en-wikipedia-org-1345	322	5	the	the	DT
en-wikipedia-org-1345	322	6	Creative	Creative	NNP
en-wikipedia-org-1345	322	7	Commons	Commons	NNP
en-wikipedia-org-1345	322	8	Attribution	Attribution	NNP
en-wikipedia-org-1345	322	9	-	-	HYPH
en-wikipedia-org-1345	322	10	ShareAlike	ShareAlike	NNP
en-wikipedia-org-1345	322	11	License	License	NNP
en-wikipedia-org-1345	322	12	;	;	,
en-wikipedia-org-1345	322	13	additional	additional	JJ
en-wikipedia-org-1345	322	14	terms	term	NNS
en-wikipedia-org-1345	322	15	may	may	MD
en-wikipedia-org-1345	322	16	apply	apply	VB
en-wikipedia-org-1345	322	17	.	.	.
en-wikipedia-org-1345	323	1	By	by	IN
en-wikipedia-org-1345	323	2	using	use	VBG
en-wikipedia-org-1345	323	3	this	this	DT
en-wikipedia-org-1345	323	4	site	site	NN
en-wikipedia-org-1345	323	5	,	,	,
en-wikipedia-org-1345	323	6	you	-PRON-	PRP
en-wikipedia-org-1345	323	7	agree	agree	VBP
en-wikipedia-org-1345	323	8	to	to	IN
en-wikipedia-org-1345	323	9	the	the	DT
en-wikipedia-org-1345	323	10	Terms	term	NNS
en-wikipedia-org-1345	323	11	of	of	IN
en-wikipedia-org-1345	323	12	Use	Use	NNP
en-wikipedia-org-1345	323	13	and	and	CC
en-wikipedia-org-1345	323	14	Privacy	Privacy	NNP
en-wikipedia-org-1345	323	15	Policy	Policy	NNP
en-wikipedia-org-1345	323	16	.	.	.
en-wikipedia-org-1345	324	1	Wikipedia	Wikipedia	NNP
en-wikipedia-org-1345	324	2	®	®	NNPS
en-wikipedia-org-1345	324	3	is	be	VBZ
en-wikipedia-org-1345	324	4	a	a	DT
en-wikipedia-org-1345	324	5	registered	registered	JJ
en-wikipedia-org-1345	324	6	trademark	trademark	NN
en-wikipedia-org-1345	324	7	of	of	IN
en-wikipedia-org-1345	324	8	the	the	DT
en-wikipedia-org-1345	324	9	Wikimedia	Wikimedia	NNP
en-wikipedia-org-1345	324	10	Foundation	Foundation	NNP
en-wikipedia-org-1345	324	11	,	,	,
en-wikipedia-org-1345	324	12	Inc.	Inc.	NNP
en-wikipedia-org-1345	324	13	,	,	,
en-wikipedia-org-1345	324	14	a	a	DT
en-wikipedia-org-1345	324	15	non	non	JJ
en-wikipedia-org-1345	324	16	-	-	JJ
en-wikipedia-org-1345	324	17	profit	profit	JJ
en-wikipedia-org-1345	324	18	organization	organization	NN
en-wikipedia-org-1345	324	19	.	.	.
en-wikipedia-org-1345	325	1	Privacy	privacy	NN
en-wikipedia-org-1345	325	2	policy	policy	NN
en-wikipedia-org-1345	325	3	About	about	IN
en-wikipedia-org-1345	325	4	Wikipedia	Wikipedia	NNP
en-wikipedia-org-1345	325	5	Disclaimers	Disclaimers	NNPS
en-wikipedia-org-1345	325	6	Contact	Contact	NNP
en-wikipedia-org-1345	325	7	Wikipedia	Wikipedia	NNP
en-wikipedia-org-1345	325	8	Mobile	Mobile	NNP
en-wikipedia-org-1345	325	9	view	view	NN
en-wikipedia-org-1345	325	10	Developers	Developers	NNP
en-wikipedia-org-1345	325	11	Statistics	Statistics	NNP
en-wikipedia-org-1345	325	12	Cookie	Cookie	NNP
en-wikipedia-org-1345	325	13	statement	statement	NN