BÀI TẬP LỚN MÔN XỬ LÝ NGÔN NGỮ TỰ NHIÊN Tìm hiểu về bài toán phân loại văn bản và thu thập thông tin - Pdf 30





!"#$%

 &'()(*+,-

 
 
 
!" #
$%& #

 ! "
2
0
1
1
2
Bài tập lớn môn Xử lý ngôn ngữ tự nhiên
Mục lục

H0ST.BFA4U+&T+O*+8V6+=+30@WU*F
X5&VYZ+6+H00+6+4[0F+&B,WJF\A2]
3+F+620ST.BFA5^_O8++&=H0ST.BFA4U0P
B<N0+3,60!2+&`+&F0SJR6A+6+5aO6'
RST.BFA2A.b5R 4"WC++aB_OH00c./06
A+6+4U+d0Sd<3,A0F+&B.BFA+&T+F+&B+6++6
200060/2]F\,WJF\0ST.BFA5H0F+&B,WJF\
+6+0POe+TVf8O`5g<C+0cO*++h0c0H,N<C+ViO*+O6'
2O60%4"0PB0,"F+&B,V+0+6+5
AO+6+T41<;O0]+6+,"*+I0@+h0c0,+6+,"
O6+&X,+h0c0I+4*5
00O6'.BFA8++&=TOc04*0H00+6+F+&B
.N.I.BFA88j4.IHX+7&0k&C+"+&+c0
0k+"O9+&.BFAO00Oc081+-0+&N04PV68+A&5\.
0@,C4"F0081+-0+&N04P0YONNO/04-00/+=0@0
X5R0O/04-0F0l4,0081+-0+.0X
4&+&0]0/+=500+6+8]O6+&X+4h+'
0XV67&4=4"0Y0081+-0,4&0081+-0ON5
R0+&+c04P0P+=FNV.H00.d<++&XH0%0P+=F
Ol2AB00+&X*..BFA555O0XV6'.
&4[0V+3O6'00A+l5$'+3HZ0c,"+
A+&+c0+&0ST.BFADmF>.>GS0,>&G+<S>E&4X,N<
+8.BFADG+)EFO+&+1OZ0c5R0++TZ
0c,00+7++,"&-+A1+I,A0Z4U4[08./,+
4[0BV3+2]&C+2+&`(0123+4HOI?&555
)*+Sl<+2+&`+&8.BFA,_<]4[0Wn+43
  F  00  <  +  o>W+  RFSSp0+qH  o>W+  ^O&r+qH  ,   o>W+
R+>&r+q5
&Z+3N4U0P&C+"+06+&4"+81FN8,_<]00
Z0c0@Us )H+&008k+-AOT)sT00,A

00+6+V+3H00<Z0cV`05G!8./RST.BFA,
+&I+4*0@+h0c0F&C+8h<3,4>OFI"F[-0VF+&B,
WJF\H+V6+=2Z4[0&x0k&C+".I+6+V04[0
F+&B.N.I,_<]57O0-0]+&00+6+4[0F+&00
0ST.BFA+'8FN+&Sl0j0%4[0+h0c0.N.I,_<]5
AH00+h0c04U8./06A+6+,2]F\A+l06
,_C+XH,-./00A+lSJ./+S.>5Z4P0Y+d0SdF
002]F\F;.BFA,_<]H00C800060/V0cH0k.BFA,y
+d0SdxO.N.I,_<]5Rj+00P00]+7+81FIH+'OV3O
+FAH00060/+&-0F`0+6+xOO/04-0+lVZH8+A+&+c0H
&23+4+&d0+38+&Z00;.BFAV=5
$N+d0+34PH,C4"4e+&FFO+30j+0P+=V+04[0
B+6+B-0+a00;+FA,_<]P05R0;.BFA
8]4[0WJF\+34=X.!0P+=0PB060/+d4*
+&[j8+&,A08+A+&+c0,V+0+6+5Mz&H0j+
8]=&z<]0C+0@.BFA,_<]H=&z004e0+&0@00.BFAFI
4=0P+=0P4[0B888F70+3+5
$A0V+0+6++a00;.BFA,_<]+&00+h0c0$A+
O0f00f8].d,BV3+2]Z0c,",_<]P0H,"
.BFA,_<],00Vt+7+WJF\4U4[08++&=+&Z+3N5ZH
B,_<]+3$A+FI0PB4e0+&&Z0@P50P+=7+C
4[0SdV0<A+,"Oe+V-88H0j88,B88+3$A++&00
,_<]S,N006B8h<3+&Z+3N+3KH+385$7
+'B4e0+&]T+34300Vt+7+V8.BFA,_
<]H+08]0PBV\+7+ON4=0P+=+7./4[0B+3
0@+3$A+0%]23+4[0B8c0+I8+&+3$A+5
93:;<=>-*?@A-
932*B+(+,CDE-+(+()
 !"#$%&'(
$A0SJ./0ST.BFA,I+4*0@O*++h0c04U4[08++&=

0P+=+'O4[0+a<C+V'O*+R^G0YBOy8![8,NO/0
4-0+'OV3OON4[0`F+&+c05Sv0PBOSl4=400+Z
0-OyCL+VPU=K+V7B()7WKPEDCEX-3
:*ON0@Oy'8/+*0,V8IO,203H0P+=4l,N
A+le04l,NX.!5$-./,N.BFA0@O*+06+H2+&'
8.BFA+'O&4[0O*+F7+[+c0+4[0]O,O!+T
,!8- f0H4l,NA+l+'&C+ONH+&N0V0"0P<C+0cO*+
0<*F78V3I00%7&4[04"200<0+0-5
-B./0@Oy0P+=44[02SdFZ243O/04-0+'O
V3O5$NO*+0<*8/+&0<]+&'O+-T06++'F7++&ZV60P
+&HOe0.!FON4l,N+5
RP+=2064IV8+&+c00P&C+"Oy4[0FC&
V68]Oy0%0P+&H0P+=FONHB-0FI+O+XH
4e0<A+FV8./00Vt+7+.d+&Z+lVZ5G4PF68]0P00+Z
0-,00O400Oy4W>OWn+HV6+O+X5
POFIH8.BFA+d0&0P+=0FO*+2+&'W04Oy+a
00G+m&>S>HSJ./00Vt+7+S}0P`0OH7.IH+lVZH
81I555,00Vt+7+4[08++&=<TZ0c+&-+A1+I
)I?&1+ID>+&F>+m&VEH00+7++.+&"D>>&0
F&+OEH2I8F7+&F>&>.0+E555
0P+=Wn+43O*+Sl<+0-4l,NZ0c,"8.B
FA
? )*D0FSSp0+E('OO*+WID81FIE+aO*+Oy
.BFA,O*++&00FN80+&N05
? )+,-D&>&>SSE('OO*+WI;2+aO*+Oy.BFA
,O*+<3.d40P+&+d0
POQR) >5

m><S+>+OI55500Z0c,"0ST.BFA&4X,B_O
HX++T&x0P+=FO`FI+6+.N.I.BFA0P0C+&j05
+&Z+d0+3S_O8++&=HX+,y.!00A+lF
+&BT.I,_<],+7O+&-0k0PWN.!+XWZ5a4P
X+0P+=+&x00S]89O8.BFA,_<]0P+=0P+&
+OI0&C+"FS,N00S]89O8.BFA+&"
+lV05Z+0%0P+=+C&x00Vt+7+8.BFA
,_<]8c0+I8"S,N00Vt+7+8.BFA+&"+l<T,'
8]+d0A+&Z.BFA,_<],l4UT.I80C+&j0,0P+-OX
DprrE5
)*+,-./0<+V8.BFA,_<]HV81+-000<<
Z0cV`0H+0P00+6+S(
? oS+&>SSFO*+<AFZ24344q
? oS+&>SSWC+A0P+=.+3)Z+&Oq
? oRW0P+=_0]O*+Sl0c44q
? o)ZFO*+Z+l4"0W+dZ+&Oq
^V81+-000+6+2+&`HA+l08]4&00
SF10/+=O+-00OI(
? o3/+)Z0P+=1&O*+Sl<A44q
Mz&T410PSd81+-0SF7TOc04*05:=4I+4[0V_
,708]0PB06+&'Z0c,"+&-+A1+I+Z+35
POQR) >6
81+-0+lVZ,81+-000FZV3+5R0<N00kFISvV80],_
<]44@+a+7800,_<]H,-./81FN8,_<]5
)/0+Z0l0!0@>W+)+XF4XFlA2]H+AH,
4e0+&4=+&'.,+'OV3O00+78[8&*FN0@00,_<]5G4PH
00Vt+7+0-0@>W+)0P+=4[08181&+00AO,/
O0j+d0AVWJF\V8,_<](FI+6+O0j0P+=+&-0
&,FI81+-04[0+d0A<T0j5
R0FI+6+4[0+&-0&0P+=F(
? BP(*Y(Z•]SJH4[0FZV3+,NO{,_<]F+7800U00
++0V8+&+c04[0+d0A+&Z00U0@O{,_
<]5P0H0P+=]SJ&x00U+c,N00+a
VHO{O*++aV0P2A,NO*+0@4"0/+=4P5
? BP-TZg41]SJ&xO*+,_<]4[0U,N+a+a
WC+A+&,_<]4P5
? BP-*?[-()NZg41,NO{,_<]+'O+C000{+aH0{
+a4P+*0,"O*+Fu,d04P,.4P,A0+'OV8,_
<]4[0+d0A+&Z00VAO4[0U0O{,_
POQR) >7
2
0
1

8,9:29;<C+0cO*+O6+=+V05R0A
+l81FI,_<]+XFO,A0,NO*+ <=2 DF>&
F&+OE57++4P4[000C8O*++78Oy4=8/0,/0,A0.I`05
78Oy<;OO*++7800+d0+=0PU4[081FN8+&N00P
.IDWHET4PWF+d0+=4[081FN8HFUD81FN8E4[00
P5$N00C0ST,7HVO*++d0+=4[000C80A+lHPSv
0lfS&O*+O+`0+a+784+IOy,WI+d0+=ON4P,
O*+81FN851FN8,_<]F<+,40PB<N08++&=
3+Sc02+&`OZ10@3.Sd8++&=OIOv410@
00+6+Z+&d0+35
1! 2 !  .#/0)*
345678 .9 :7
)*+888+lVZ81FN8,_<]4[04"V=<TO*++a4=
0@4"0P810C84[04"WC+588SJ./O*++a4=,NO*+
0C+&j04]5a4=0P+=.I4[0..+&ZO*++78[8+FA
POQR) >8
2
0
1
1
2

<C+Vi2ABu+Z09V=0H8H€
R10@4"4[0+h0c0+O*+810C8HP0F+h0c0+
O*+OIDV4PO*+Sl0@4"0P+=+*0O*+,j+0@01810C8E5
•]+7++'OV3O0@4"+&Z+a4=0%;O0P8(+'OV3O0@
4"4D0@4"FE,Sd+&"F+&`Sl0@0@4"+&Z015d0+3HP+&]FXH
001•S(+NOc04*+'+FASv8!,N0@4"4U0†)*+01
•,74[0+&]FX0O{0@4"&Z<A+5&+&X[84]C+H
+&`Sl0@O*+0@4"FSlD+SC+E00+a+cH+&.S0+aH4[0
+'O+C+&+FA„…5
+c0@]+7+0P+&0AOF+&"00+SC++'O+C
+&Z01„…5$N8]+7+H0j+0P+=0Y&&xO*++FA4"078
430@,"B4*,7+0P,jHB4*,7++1O"OHB4*,7+8
S+Tj+FH8![8,N0@4","B4*,7+H00S,7+Sl,+dZ
V6Tj+F5
POQR) >9
2
0
1
1
2
Bài tập lớn môn Xử lý ngôn ngữ tự nhiên

I

I
0

E
J
„…5g418n8+-+h4[0+d0A+C+0]00+FA0P
S}GH
I

E
F8n84Sd8![80@+FA,N0@4"ˆH,
0


FSlFWC+A
0@+a0@4"V+&+FA5
6OH0j+V6++I<C+0c]+7+4+074=
+'O&8n844*8![8
I

E
0@00+FA000Fu,d0O*+004*0F785
,4PHO*+8n84,74[04<x+<T0ZH,S
4PA+l4[0CFA+&Z[800+FA5R00Z0P+=8]
+XWZB+&`Sl+-0[8<x+000+FA5
R]00+3807Z0&x4[0FO<_+5:=+&4"4PH
,NO*+8n8+4jH,NB4"+4@‰8H0P+=]+3+&xB
,_<]+&Z,"0@4"V6<XWC+A+&B,_<]

I

I
KEJ

ED
HT4P


=
#
I

#EK ‹
F+&+&<'0@
I

E
20ST.B
POQR) >10
2

%
043
V,N+NO*+j+F54PHU0@j+4[00%
I
5:Sl008N
8881FI,7SJ./<=.,_<]T.I81H,,700
010%4[0<=..N.I815)*+,-./,"0123+44[0
OI+&'5
)*+888V]+.!4=CFAO*+0123+481FI2

xOT03F[028EL„…5R3F[0SvV=O+&W>OFA+C+0]00
POQR) >11
lúa mì lúa mì
nông trại nông trại giạ giạ
thương nghiệp
thương nghiệp xuất khẩu
xuất khẩu
nông nghiệp
tấn tấn
nông nghiệp
lúa mìlúa mì
lúa mì
lúa mì
lúa mì
lúa mì lúa mì
lúa mì
Hình 1: Một ví dụ về cây quyết định

0`+7+B
0
T4PSvW]&++028HO*+888Fd0`F0`
+>F[-0+6+>+&85ZHO*+01•2FNFZ•0P+=<S78H
3000124e0<A+,N.BFACFA5
:Sl008N88.I0123+4,7<;OO*+8
88+ZO01,O*+888Wn<N+014=FI<•B24e0
<A+„…5
93h'+-&B(-*?-*[I-*H()-+(e(i&RC^-+&(RD-R+D5^=jg
B!$C D
+78+6+Dsp&O+M>+&>,FEFO*++&B<+V
8.BFA,_<]5 +0@3+78+&,,A0+'O&00+FA
+&O*++78[800+FA0PS}+>O*+4"VA4P5R04"VA
0P+=FO*++&,CO*+,_<]5
4"VA4,FO*++&,CH<+Sv4&00SF74=+'O
&4e0+&0@01+&,C4PHS4PSS,N004e0+&0@00+FA
0PS}4=+'O&00+FA8![8C+,N01+&,C4P5&<+H
O6'0@<+,N<+^>&0b>5ZH<+++78
+6+F<+4[08++&=TOc04*05:l,N<+^>&0
b>H01+&,C4,F+78[800AO5,N<+++78
+6+H01+&,C4,0P+=FO*+01,_0PBu5A+lSv+'O
0081+-0Bu0@01+&,C4=+'O&4e0+&0@P5
POQR) >12


Nhận kết quả
Đánh giá kết quả
Tốt ?
Dừng lại
Đúng
Công thức hoá lại
Sai
Hình 2. Mô hình thu thập thông @n chuẩn
2
0
1
1
2
Bài tập lớn môn Xử lý ngôn ngữ tự nhiên
$A0++78+6+0P+=4[04u0<C+0cO*+FI+6+
,-./V=,_<]H']H1O+555ZHT410j+0Y4"
07843,A0++78,_<]<T,_<]FO*+FI+6+O8+c0
+d0A,Vt+7+WJF\4]5RP+=COI&x00Vt+7+
0%0P+=4[08./0++78+6+48+A5
R0Vt+7+++78+6+0P+=4[00&+FI(
? R0Vt+7+09

{ }
0I
% H555HH

=
HT4P+

FO*++7+BWC+A+&+FA%
I
5)*+
+&,C4[0<=.<xO*+<=+c0F00@00+7+B<;O00
++JKGHLMH,L5
$-./,N+&,C(
RSNTU#NUVOOVWB
POQR) >14
2
0
1
1
2
Bài tập lớn môn Xử lý ngôn ngữ tự nhiên

:&O*++7800+FA,O*++&,C
{ }
U
### H555HH

,O*++&,C
|H0j+4+-+&0@OSSKNR#

O5:=74[000+FA
FZ2H0j+0Sf8W3800+FA]O.0@OSS,<•4+C+0]
00+FAc,NOSS•O*+6[240+&N05•
0P+=4[04uO*++&OSSKe0FO*+-+&SS,N
O*+,_<]4P50+c0FNC+0@Vt+7+F+'O4[0000`
+&•0f+8![85
:=+d0AO6'+'OV3O F>H0j+0P+=SJ./O*+SlVt
+7+A2]5ZH00+7++4PV64[04"078+&<Z
0c5
POQR) >15
2
0
1

0@+aV5
#SNJ

J

(((J
U
O
$-./HV81+-0+FA#

,#

F<Z0cHFZ2
43<A414H+0P,>0?+4[0I+&Z4;+?0"S(
POQR) >16
2
0
1
1
2
Bài tập lớn môn Xử lý ngôn ngữ tự nhiên

(0.6, 0.2)
Hình 3. Đồ thị biểu diễn các vec-tơ của bài báo D
1
và D
2
1.
0
1.
0
Magê
Đau đầu
D1
D2
query
Hình 4: Đồ thị biểu diễn quan hệ giữa truy vấn (query) và các tài liệu
D1, D2
2
0
1
1
2

55 +=
„…

WF>,+00F>+

F=

%d

T4Pd

FW0SC+WC+A+7+BX

+&+FA51Sl+&%d4[0
+-+<x888]+-0,NV]_WC+AX

+&+FA5
(Q( (( ( _6;A+ND8E-O
00+&`Sl00+7+B4[0W04H0j+0O*+OSf8W38
4=44*+4;B00,>0?++&,C,+FA5)*+Sl8n844*
+4;4[0+=A.N415g4P|,GFF[+F00+78+7+B+&
+&,C,+&,_<](
#R ∩
06+c04]C+
%R
#R
+


ASl0@G0>

)*+44*+4;+6+XH4[0<3+4340S
„…HW04P0B,>0?++FA,,>0?++&,C<T8n8+-+O*+
V3+2]*+I5:e0<A+H4+X4[0+-,N4*.0@,>0?+5:*
+4;4[0W04+>06+c0.N41„…(
∑ ∑

= =
=
==








J
J
R#
R#
R#D
 


5
5
EHD
•]SJ0]+&,C,+FA4[009<T4*.0@0jH06+c0
Sv+&TZ4](

2
0
1
1
2
Bài tập lớn môn Xử lý ngôn ngữ tự nhiên
:=N0F[A2]0@8n809H0j+SJ./<'8Sl
F[00+7+B+&O*++FA81Sl095$N00+&X[8
+FAf+'8n8+-WC8WYV64[00-W0H+ZVt+7+0%
0PO*+Sl4=OS(
? ’T0@V-0+N0+FA+&TZV60P\u,N<C+0c
FI095
? :*8c0+I8+-+•&C+"S,N00Vt+7++&N041
? RP+=+-++&N0
,7H4*+4;0P+=4[0+d0A<T06+c0S(
G+&>OVS
EHD


=
=

+h2+0@OI?&D>&F>+m&VE5
POQR) >20
2
0
1
1
2
Bài tập lớn môn Xử lý ngôn ngữ tự nhiên
$N,A0SJ./OI?&H0j+0P+=<=.O*+8+[
+&+&+c0+&Fu,d00@<+H,0P+=4[0SJ./+06+&
A+l++78+6+5
(Q( ( ((/,8;PE
:=0P+==FO+3OI?&0P+=8./0WJF\++78
+6+H0j+Sv4uO*+SlVAO4[0SJ./+&F\+Z+
OI?&5
w1.d00Vl0@O6'+-+0OI?&+004,
`FiNME%MOO&C+"004e0+-0@&?&S`0„…H
P4jF00j+OI4[0O68•+>00?&0@4*,7+5
g00j+OIT'+=A008n8+F0KG5:&0@j+
OISvD3004,4"D5P4[0+d0A<T8n8SS,N
+&•NOOO`4&4"0P5=ZF,A0+d0A8n8F0

1
2
Bài tập lớn môn Xử lý ngôn ngữ tự nhiên
(Q( ( (( KE-6:28*
)6'4[04"WC+FO*+O6'<FN8(
? N800+7+B+&,CD00j+OI4,EQ|F>&
? N800+FAD00j+OI4&EQGF>&
? N8000YO/0D00j+9EQF>&
&'H0j+0P00V\AS(
?
+

?0YO/0+7+B
?
G

?+FA
?
|

?+7+B+&,C0@X.!
?
8
ˆ
?+&`SlV3+lB_0@OI+7+B,O*+_0@
OI+FA
?
2

?+&`SlFZV3+B+7+B0@+&,C,+7+B+


2
0
1
1
2
Bài tập lớn môn Xử lý ngôn ngữ tự nhiên
N8+7+B+&,C<=.00Z0X.!5){O*+j+FO*+
+7+B+&+&,C5N8+FA<=.+7800+FA5){j+203
43O*++FA5R0j++&FN80P00FZV3+0"0P+&`SlH+=A
Sd+4;B00+FA5•+&+4;4[0+-+<T+&`Sl
Bu0@00+7+B+&O{+FA5N800+7+BFFN84*5){
j+<=.O*++7+B4[040YO/05R0FZV3+0P+&B00j+
F00V3+FlB00+7+B+&8+&,C5
R0FZV3+0P+&`SlB00_+*0FN8+7+B0P0Y.y,00
_+*0FN8+7+B
I
<=.V]_\u0@+7+B

+&
+FA#
I
5ZV3+0P+&`Sl,

4u4*2+&`0@+7+B

+&
+<*+h[800+FA5R0+&VT40@00+&`Sl0P+=4[0
+&`yZe0,N<C+0c00W0453+&yZ4[0SJ
./H0P+=+Sv8]4lOe+,N00,C4"S(

2
0
1
1
2
Bài tập lớn môn Xử lý ngôn ngữ tự nhiên
? ++78+6+
? `0
++78+6+<f+4VX.!J0A+lO*+Z0
D+X4[0,3+.N.I6B+dZE5ŠZ04[081+-0,
+cFN8|Sv4[0W1.d5){_+&FN8|4[0FZV3+,NO*+
_+&FN8,N0!+7+B5ZV3+Sv<f+44[0V-0I+.`0
+>00OlFZV3+,

5){_0@FN87O*++-A+aFN8|Sv+-+
&x4*V-0I+,S4P+&"P+NOI5
&+&X[84P0PV]_0P+=W]&(
? &"F+-A+N_V0+aD+d4*+-+FIZ0E
? &"FP+N_4P+aG
&+&X[8+cHO{_0@FN8GSv+-O*++&V-0I+
8]WI4*+4;BZ0,+FA5R0+FA++784[0Sf8W38

POQR) >24
2
0
1
1
2
Bài tập lớn môn Xử lý ngôn ngữ tự nhiên
h3BP)+a+I*BIBIMk()P*&+D-(^CD;DDE-+(+()
h324P-RW()Pc^5_(`a(-+A()+,-
3$A+FO*+&A;„…H4e04=O<2++<*4e0
+&+3$A+,"Oe+B1OHBu,B885G4PH0j+8]+3
Z0c4e04=O0@+3$A+4=0P+=0P4[0BN
Z0c0/+=,",_<]+3$A+5
B1!72?:>O
B+>7P78:>
&+3$A+H0%+&00,_<]+3$A+H+0P+=+C1
FO*++8V2+&`5&V-88HO{+34c4*0F78H,+0P
+=8+A4[0001+&0]+3P0%+&,_<]„…5
Q((((1EL&
B1O0-FOe+1O0@6B5IS+FI8]Z0cV-
0I0@6B+3$A+5:PF,'+&Z+d0+3H00c./FZ243


Nhờ tải bản gốc

Tài liệu, ebook tham khảo khác

Music ♫

Copyright: Tài liệu đại học © DMCA.com Protection Status