2013年8月10日星期六

hadoop enter multiple files issue

hadoop jar streaming-input ....
Now I have the following documents
ishopping2012-05-01_1.log
.
.
.
.
ishopping2012-09-26_1.log
ishopping2012-09-26_2.log
ishopping2012-09-26_3.log
ishopping2012-09-26_4.log
log files for several months , there is no good way to these files can be entered together ?
thanked in advance !
------ Solution ---------------------------------------- ----
simple , they rewrite a InputFormat
------ Solution --------------------- -----------------------
specified directory
------ For reference only ---------- -----------------------------
I use hadoop streaming, do not want to rewrite those things , but still thanks
------ For reference only -------------------------------------- -
support, refueling landlord
------ For reference only ------------------------- --------------
specify an input directory to

没有评论:

发表评论