hdfsToServer

Definition

HDFS ํŒŒ์ผ/ํด๋”๋ฅผ ์›๊ฒฉ ์„œ๋ฒ„์— ๋ณต์‚ฌ ํ•˜๋Š” ๋…ธ๋“œ์ด๋‹ค. ์ขŒ์ธก [Flow๊ตฌ์„ฑ]๋…ธ๋“œ ์ค‘ [hdfsToServer]๋…ธ๋“œ๋ฅผ drag & drop ํ•œ ํ›„ Property ํ•ญ๋ชฉ์„ ์ž…๋ ฅํ•œ๋‹ค.

Set

[setting], [scheduler], [parameter] ์„ค์ •์€ [์›Œํฌํ”Œ๋กœ์šฐ ์ƒ์„ฑ] > [์„ค์ •]์„ ์ฐธ๊ณ ํ•œ๋‹ค.

property

[Node Description] ์ž‘์„ฑ ์ค‘์ธ ๋…ธ๋“œ๋ช… ์ž…๋ ฅ

flow008

  1. hdfsํŒŒ์ผ๊ฒฝ๋กœ(๋ถˆ๋Ÿฌ์˜ค๊ธฐ) : ๋ณต์‚ฌํ•  ํŒŒ์ผ ๊ฒฝ๋กœ ์„ ํƒ
  2. dest : ์›๊ฒฉ์„œ๋ฒ„ ์ •๋ณด
  • IP์ฃผ์†Œ : ์›๊ฒฉ์„œ๋ฒ„ IP ์ •๋ณด
  • ์ €์žฅ๊ฒฝ๋กœ(path) : ํŒŒ์ผ์„ ์ €์žฅํ•  ๊ฒฝ๋กœ
  • PORT : SCP ํ™œ์šฉ ๊ฐ€๋Šฅ ํฌํŠธ
  1. user : SCP์— ํ™œ์šฉํ•  ๊ณ„์ •
  2. password : SCP์— ํ™œ์šฉํ•  password

Example

kbtest ํด๋Ÿฌ์Šคํ„ฐ hdfs์— ์ ์žฌ๋œ ํŒŒ์ผ์„ ์™ธ๋ถ€์„œ๋ฒ„์— ์ „๋‹ฌํ•œ๋‹ค.

  1. [hdfsToServer] ๋…ธ๋“œ property ๊ตฌ์„ฑ

flow044

  1. ์›Œํฌํ”Œ๋กœ์šฐ ์‹คํ–‰ ํ›„ ํŒŒ์ผ์ด ์™ธ๋ถ€์„œ๋ฒ„์— ์ „์†ก๋˜์—ˆ๋‹ค.

flow044