hdfsToServer

Definition

HDFS ํŒŒ์ผ/ํด๋”๋ฅผ ์›๊ฒฉ ์„œ๋ฒ„์— ๋ณต์‚ฌ ํ•˜๋Š” ๋…ธ๋“œ์ž…๋‹ˆ๋‹ค.
์ขŒ์ธก [Flow๊ตฌ์„ฑ]๋…ธ๋“œ ์ค‘ [hdfsToServer]๋…ธ๋“œ๋ฅผ drag & drop ํ•œ ํ›„ Property ํ•ญ๋ชฉ์„ ์ž…๋ ฅํ•ฉ๋‹ˆ๋‹ค.

Set

[setting], [scheduler], [parameter] ์„ค์ •์€ [์›Œํฌํ”Œ๋กœ์šฐ] > [์ƒ์„ฑ] > [๊ธฐ๋ณธ๊ตฌ์„ฑ]์„ ์ฐธ๊ณ ํ•ฉ๋‹ˆ๋‹ค.

property

[Node Description] ์ž‘์„ฑ ์ค‘์ธ ๋…ธ๋“œ๋ช… ์ž…๋ ฅ

hdfstoserver01

  1. HDFS ํŒŒ์ผ ๊ฒฝ๋กœ(๋ถˆ๋Ÿฌ์˜ค๊ธฐ) : ๋ณต์‚ฌํ•  ํŒŒ์ผ ๊ฒฝ๋กœ ์„ ํƒ
  2. dest : ์›๊ฒฉ์„œ๋ฒ„ ์ •๋ณด
    • IP์ฃผ์†Œ : ์›๊ฒฉ์„œ๋ฒ„ IP ์ •๋ณด
    • ์ €์žฅ๊ฒฝ๋กœ(path) : ํŒŒ์ผ์„ ์ €์žฅํ•  ๊ฒฝ๋กœ
    • PORT : SCP ํ™œ์šฉ ๊ฐ€๋Šฅ ํฌํŠธ
  3. user : SCP์— ํ™œ์šฉํ•  ๊ณ„์ •
  4. password : SCP์— ํ™œ์šฉํ•  password

Example

kbtest ํด๋Ÿฌ์Šคํ„ฐ hdfs์— ์ ์žฌ๋œ ํŒŒ์ผ์„ ์™ธ๋ถ€์„œ๋ฒ„์— ์ „๋‹ฌํ•ฉ๋‹ˆ๋‹ค.

  1. [hdfsToServer] ๋…ธ๋“œ property ๊ตฌ์„ฑ
    hdfstoserver02
  2. ์›Œํฌํ”Œ๋กœ์šฐ ์‹คํ–‰ ํ›„ ํŒŒ์ผ์ด ์™ธ๋ถ€์„œ๋ฒ„์— ์ „์†ก ํ™•์ธ
    hdfstoserver03