{"id":26763,"date":"2023-12-07T03:06:41","date_gmt":"2023-12-07T03:06:41","guid":{"rendered":"https:\/\/masterskills.org\/blog\/du-lieu-lon-big-data-la-gi-nhung-kho-khan-khi-su-dung-du-lieu-lon.html"},"modified":"2023-12-22T14:49:28","modified_gmt":"2023-12-22T07:49:28","slug":"du-lieu-lon-big-data-la-gi-nhung-kho-khan-khi-su-dung-du-lieu-lon","status":"publish","type":"post","link":"https:\/\/masterskills.org\/blog\/du-lieu-lon-big-data-la-gi-nhung-kho-khan-khi-su-dung-du-lieu-lon.html","title":{"rendered":"D\u1eef li\u1ec7u l\u1edbn (Big data) l\u00e0 g\u00ec? Nh\u1eefng kh\u00f3 kh\u0103n khi s\u1eed d\u1ee5ng d\u1eef li\u1ec7u l\u1edbn"},"content":{"rendered":"
\n
\n
<\/div>\n
\n

H\u00ecnh minh h\u1ecda. Ngu\u1ed3n: nttdata.com<\/i><\/p>\n<\/div>\n<\/div>\n

D\u1eef li\u1ec7u l\u1edbn<\/font><\/h2>\n

D\u1eef li\u1ec7u l\u1edbn<\/b> trong ti\u1ebfng Anh l\u00e0 Big data<\/b>.<\/p>\n

D\u1eef li\u1ec7u l\u1edbn\u00a0<\/b>l\u00e0 m\u1ed9t thu\u1eadt ng\u1eef \u0111\u01b0\u1ee3c s\u1eed d\u1ee5ng t\u1eeb cu\u1ed1i nh\u1eefng n\u0103m 1990, d\u00f9ng \u0111\u1ec3 ch\u1ec9 l\u01b0\u1ee3ng d\u1eef li\u1ec7u kh\u1ed5ng l\u1ed3 \u0111\u01b0\u1ee3c t\u1ea1o ra b\u1edfi c\u00e1c c\u00f4ng ty ho\u1ea1t \u0111\u1ed9ng \u1edf c\u00e1c ng\u00e0nh ngh\u1ec1 kh\u00e1c nhau, ch\u00ednh ph\u1ee7, c\u00e1 nh\u00e2n v\u00e0 c\u00e1c thi\u1ebft b\u1ecb \u0111i\u1ec7n t\u1eed.<\/p>\n

Ph\u00e2n lo\u1ea1i d\u1eef li\u1ec7u l\u1edbn<\/font><\/h3>\n

D\u1eef li\u1ec7u l\u1edbn bao g\u1ed3m d\u1eef li\u1ec7u truy\u1ec1n th\u1ed1ng<\/b> v\u00e0 d\u1eef li\u1ec7u phi truy\u1ec1n th\u1ed1ng<\/b><\/p>\n

D\u1eef li\u1ec7u truy\u1ec1n th\u1ed1ng bao g\u1ed3m:<\/b><\/p>\n

– D\u1eef li\u1ec7u c\u1ee7a c\u00f4ng ty d\u01b0\u1edbi d\u1ea1ng b\u00e1o c\u00e1o h\u00e0ng n\u0103m, h\u1ed3 s\u01a1 theo qui \u0111\u1ecbnh, s\u1ed1 li\u1ec7u b\u00e1n h\u00e0ng v\u00e0 thu nh\u1eadp v\u00e0 c\u00e1c cu\u1ed9c h\u1ed9i ngh\u1ecb b\u1eb1ng \u0111i\u1ec7n tho\u1ea1i (conference calls)<\/p>\n

– D\u1eef li\u1ec7u \u0111\u01b0\u1ee3c t\u1ea1o ra tr\u00ean th\u1ecb tr\u01b0\u1eddng t\u00e0i ch\u00ednh, bao g\u1ed3m gi\u00e1 v\u00e0 kh\u1ed1i l\u01b0\u1ee3ng giao d\u1ecbch<\/p>\n

– Th\u1ed1ng k\u00ea c\u1ee7a ch\u00ednh ph\u1ee7<\/p>\n

D\u1eef li\u1ec7u phi truy\u1ec1n th\u1ed1ng bao g\u1ed3m:<\/b><\/p>\n

– D\u1eef li\u1ec7u t\u1eeb c\u00e1 nh\u00e2n: B\u00e0i \u0111\u0103ng tr\u00ean c\u00e1c m\u1ea1ng x\u00e3 h\u1ed9i, c\u00e1c \u0111\u00e1nh gi\u00e1 tr\u1ef1c tuy\u1ebfn, email v\u00e0 vi\u1ec7c truy c\u1eadp trang web<\/p>\n

– D\u1eef li\u1ec7u t\u1eeb c\u00e1c doanh nghi\u1ec7p: H\u1ed3 s\u01a1 ng\u00e2n h\u00e0ng v\u00e0 d\u1eef li\u1ec7u m\u00e1y qu\u00e9t b\u00e1n l\u1ebb<\/p>\n

– D\u1eef li\u1ec7u t\u1eeb c\u00e1c thi\u1ebft b\u1ecb \u0111i\u1ec7n t\u1eed: D\u1eef li\u1ec7u \u0111\u01b0\u1ee3c t\u1ea1o ra t\u1eeb nhi\u1ec1u lo\u1ea1i thi\u1ebft b\u1ecb, bao g\u1ed3m \u0111i\u1ec7n tho\u1ea1i th\u00f4ng minh, m\u00e1y \u1ea3nh, micr\u00f4, \u0111\u1ea7u \u0111\u1ecdc nh\u1eadn d\u1ea1ng t\u1ea7n s\u1ed1 v\u00f4 tuy\u1ebfn (RFID), c\u1ea3m bi\u1ebfn kh\u00f4ng d\u00e2y v\u00e0 v\u1ec7 tinh.<\/p>\n

Khi Internet v\u00e0 c\u00e1c thi\u1ebft b\u1ecb n\u1ed1i m\u1ea1ng ng\u00e0y c\u00e0ng ph\u00e1t tri\u1ec3n, vi\u1ec7c s\u1eed d\u1ee5ng c\u00e1c ngu\u1ed3n d\u1eef li\u1ec7u phi truy\u1ec1n th\u1ed1ng \u0111\u00e3 t\u0103ng l\u00ean, bao g\u1ed3m th\u00f4ng tin tr\u00ean c\u00e1c m\u1ea1ng x\u00e3 h\u1ed9i, email v\u00e0 c\u00e1c ph\u01b0\u01a1ng th\u1ee9c giao ti\u1ebfp b\u1eb1ng v\u0103n b\u1ea3n, l\u01b0u l\u01b0\u1ee3ng truy c\u1eadp trang web, trang tin t\u1ee9c tr\u1ef1c tuy\u1ebfn v\u00e0 c\u00e1c ngu\u1ed3n th\u00f4ng tin \u0111i\u1ec7n t\u1eed kh\u00e1c.<\/p>\n

\u0110\u1eb7c tr\u01b0ng c\u1ee7a d\u1eef li\u1ec7u l\u1edbn<\/font><\/h3>\n

– V\u1ec1 kh\u1ed1i l\u01b0\u1ee3ng (Volume):<\/b> L\u01b0\u1ee3ng d\u1eef li\u1ec7u \u0111\u01b0\u1ee3c thu th\u1eadp l\u00e0 r\u1ea5t l\u1edbn, l\u00ean t\u1edbi h\u00e0ng tri\u1ec7u, h\u00e0ng t\u1ec9 \u0111\u01a1n v\u1ecb d\u1eef li\u1ec7u<\/p>\n

– V\u1ec1 t\u1ed1c \u0111\u1ed9 (Velocity):<\/b> T\u1ed1c \u0111\u1ed9 truy\u1ec1n d\u1eef li\u1ec7u r\u1ea5t cao. D\u1eef li\u1ec7u th\u1eddi gian th\u1ef1c (real-time) ho\u1eb7c g\u1ea7n th\u1eddi gian th\u1ef1c (near-real-time) \u0111\u00e3 tr\u1edf th\u00e0nh ti\u00eau chu\u1ea9n trong nhi\u1ec1u l\u0129nh v\u1ef1c<\/p>\n

– V\u1ec1 m\u1ee9c \u0111\u1ed9 \u0111a d\u1ea1ng (Variety):<\/b> D\u1eef li\u1ec7u \u0111\u01b0\u1ee3c thu th\u1eadp t\u1eeb nhi\u1ec1u ngu\u1ed3n kh\u00e1c nhau v\u00e0 \u1edf nhi\u1ec1u \u0111\u1ecbnh d\u1ea1ng kh\u00e1c nhau, bao g\u1ed3m d\u1eef li\u1ec7u c\u00f3 c\u1ea5u tr\u00fac (v\u00ed d\u1ee5: b\u1ea3ng SQL, t\u1ec7p CSV), d\u1eef li\u1ec7u b\u00e1n c\u1ea5u tr\u00fac (v\u00ed d\u1ee5: m\u00e3 HTML) v\u00e0 d\u1eef li\u1ec7u phi c\u1ea5u tr\u00fac (v\u00ed d\u1ee5: tin nh\u1eafn video)<\/p>\n

\n
<\/div>\n
\n

\u0110\u1eb7c tr\u01b0ng c\u1ee7a d\u1eef li\u1ec7u l\u1edbn<\/p>\n<\/div>\n<\/div>\n

Kh\u00f3 kh\u0103n khi s\u1eed d\u1ee5ng d\u1eef li\u1ec7u l\u1edbn<\/font><\/h3>\n

C\u00e1c kh\u00f3 kh\u0103n khi s\u1eed d\u1ee5ng d\u1eef li\u1ec7u l\u1edbn, bao g\u1ed3m: Ch\u1ea5t l\u01b0\u1ee3ng, kh\u1ed1i l\u01b0\u1ee3ng v\u00e0 t\u00ednh ph\u00f9 h\u1ee3p c\u1ee7a d\u1eef li\u1ec7u.<\/p>\n

C\u00e1c c\u00e2u h\u1ecfi c\u1ea7n \u0111\u1eb7t ra khi s\u1eed d\u1ee5ng d\u1eef li\u1ec7u l\u1edbn:<\/p>\n

1. T\u1eadp d\u1eef li\u1ec7u c\u00f3 sai s\u1ed1 t\u1eeb vi\u1ec7c l\u1ef1a ch\u1ecdn \u0111\u1ed1i t\u01b0\u1ee3ng (Selection bias), thi\u1ebfu d\u1eef li\u1ec7u ho\u1eb7c c\u00f3 d\u1eef li\u1ec7u ngo\u1ea1i lai (Data outliers) kh\u00f4ng?<\/p>\n

2. Kh\u1ed1i l\u01b0\u1ee3ng d\u1eef li\u1ec7u thu th\u1eadp c\u00f3 \u0111\u1ee7 hay kh\u00f4ng?<\/p>\n

3. D\u1eef li\u1ec7u c\u00f3 ph\u00f9 h\u1ee3p cho vi\u1ec7c ph\u00e2n t\u00edch hay kh\u00f4ng?<\/p>\n

Trong h\u1ea7u h\u1ebft c\u00e1c tr\u01b0\u1eddng h\u1ee3p, d\u1eef li\u1ec7u ph\u1ea3i \u0111\u01b0\u1ee3c l\u1ea5y t\u1eeb ngu\u1ed3n ban \u0111\u1ea7u, sau \u0111\u00f3 l\u00e0m s\u1ea1ch v\u00e0 s\u1eafp x\u1ebfp tr\u01b0\u1edbc khi ph\u00e2n t\u00edch. Qu\u00e1 tr\u00ecnh n\u00e0y r\u1ea5t kh\u00f3 kh\u0103n \u0111\u1ed1i v\u1edbi d\u1eef li\u1ec7u phi truy\u1ec1n th\u1ed1ng do c\u00e1c \u0111\u1eb7c \u0111i\u1ec3m phi c\u1ea5u tr\u00fac c\u1ee7a d\u1eef li\u1ec7u li\u00ean quan, th\u01b0\u1eddng mang t\u00ednh \u0111\u1ecbnh t\u00ednh (v\u00ed d\u1ee5: V\u0103n b\u1ea3n, \u1ea3nh v\u00e0 video) h\u01a1n l\u00e0 \u0111\u1ecbnh l\u01b0\u1ee3ng.<\/p>\n

(T\u00e0i li\u1ec7u tham kh\u1ea3o: Gi\u00e1o tr\u00ecnh CFA level I n\u0103m nay<\/i>)<\/p>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"

\n D\u1eef li\u1ec7u l\u1edbn (ti\u1ebfng Anh: Big data) l\u00e0 m\u1ed9t thu\u1eadt ng\u1eef \u0111\u01b0\u1ee3c s\u1eed d\u1ee5ng t\u1eeb cu\u1ed1i nh\u1eefng n\u0103m 1990, d\u00f9ng \u0111\u1ec3 ch\u1ec9 l\u01b0\u1ee3ng d\u1eef li\u1ec7u kh\u1ed5ng l\u1ed3 \u0111\u01b0\u1ee3c t\u1ea1o ra b\u1edfi c\u00e1c c\u00f4ng ty ho\u1ea1t \u0111\u1ed9ng \u1edf c\u00e1c ng\u00e0nh ngh\u1ec1 kh\u00e1c nhau, ch\u00ednh ph\u1ee7, c\u00e1 nh\u00e2n v\u00e0 c\u00e1c thi\u1ebft b\u1ecb \u0111i\u1ec7n t\u1eed.\n <\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[414],"tags":[],"_links":{"self":[{"href":"https:\/\/masterskills.org\/blog\/wp-json\/wp\/v2\/posts\/26763"}],"collection":[{"href":"https:\/\/masterskills.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/masterskills.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/masterskills.org\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/masterskills.org\/blog\/wp-json\/wp\/v2\/comments?post=26763"}],"version-history":[{"count":0,"href":"https:\/\/masterskills.org\/blog\/wp-json\/wp\/v2\/posts\/26763\/revisions"}],"wp:attachment":[{"href":"https:\/\/masterskills.org\/blog\/wp-json\/wp\/v2\/media?parent=26763"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/masterskills.org\/blog\/wp-json\/wp\/v2\/categories?post=26763"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/masterskills.org\/blog\/wp-json\/wp\/v2\/tags?post=26763"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}