Hadoop - force task attempt to start on different node -


i submitted job cluster of 4 hosts, can see correctly spread among 4 nodes, 1 map task per node.

later on, 1 of node failed.

i stopped tasktracker on failed node, added id of node excludes file , updated list of nodes hadoop mradmin -refreshnodes. failed node disappeared list of available nodes on hadoop administration pages.

then started tasktracker again, updated nodes mradmin, , observed node appeared in job tracker list again.

during time of node being down, hadoop re-scheduled map task execution on node, started run 2 map jobs. i've got cluster unbalanced:

  • 2 nodes running 1 task each,
  • 1 node running 2 tasks
  • and 1 node (the 1 restarted) running no tasks.

i killed job hadoop job -kill-task attempt_201308010141_0001_m_000000_1 , looks never starts again - can see 3 nodes running 1 task each, 1 node no tasks @ , 1 pending task in list.

am missing something? correct way of 'moving' task 1 node one?

jobs keep list of blacklisted tasktrackers (there global blacklist , per job one). think that's why new attempt don't start again @ end on restarted task tracker.

you can try commands :

hadoop job -unblacklist <jobid> <hostname> hadoop job -unblacklist-tracker <hostname>

from http://doc.mapr.com/display/mapr/tasktracker+blacklisting


Comments

Post a Comment

Popular posts from this blog

basic authentication with http post params android -

i doing basic authentication passing username , password , using basicnamevaluepair sending post params response service. my method: public stringbuilder callservicehttppost(string username, string password, string type) { // create new httpclient , post header httpclient httpclient = new defaulthttpclient(); httppost httppost = new httppost(webservice + type); httpresponse response = null; stringbuilder total = new stringbuilder(); try { url url = new url(webservice + type); /*string base64encodedcredentials = base64.encodetostring((username + ":" + password).getbytes(), base64.url_safe | base64.no_wrap);*/ string base64encodedcredentials = "basic " + base64.encodetostring( (username + ":" + password).getbytes(), base64.no_wrap); httppost.setheader("auth...
Read more

vb.net - Virtual Keyboard commands -

i wondering difference between virtual these keyboard commands is: keyeventf_extendedkey , keyeventf_keyup is. everywhere have looked gives me description based off integers , not want know each of them does. you've tagged question vb.net, these have nothing @ vb.net. they're constants defined in windows header files, use win32 api functions. as far difference, can't tell looking @ values. individual values not particularly important, that's why named identifiers used. what's important used , documentation functions tells mean. the first one, keyeventf_extendedkey , used keybdinput structure (which used along e.g. sendinput function) pass information synthesized keyboard input. if flag used, means scan code should interpreted extended key. technically, means scan code preceded prefix byte value 224 (&he0 in hexadecimal notation). the second one, keyeventf_keyup , 1 of flags available use structure. means key being released (going up)...
Read more

How to get multiresult with multicondition in Sql Server -

i need solve this. hopefully can giving me advices. for sample, i've got data : proclib.march 1 first 10 rows flight date depart orig dest miles boarded capacity ----------------------------------------------------------------- 114 01mar94 7:10 lga lax 2475 172 210 202 01mar94 10:43 lga ord 740 151 210 219 01mar94 9:31 lga lon 3442 198 250 622 01mar94 12:19 lga fra 3857 207 250 132 01mar94 15:35 lga yyz 366 115 178 271 01mar94 13:17 lga par 3635 138 250 302 01mar94 20:22 lga 229 105 180 114 02mar94 7:10 lga lax 2475 119 210 202 02mar94 10:43 lga ord 740 120 210 219 02mar94 9:31 lga lon 344...
Read more