作者gmoz ( This can't do that. )
看板Cloud
标题[问题] 关於stragglers的Backup task
时间Tue Sep 7 11:58:17 2010
这几天在对MapReduce做一些survey
不过有个地方我不太了解细节 o.o
就是google用来解决starggles的Backup Task
原文如下:
We have a general mechanism to alleviate the problem
of stragglers. When a MapReduce operation is close
to completion, the master schedules backup executions
of the remaining in-progress tasks. The task is marked
as completed whenever either the primary or the backup
execution completes.
请问有人知道这个实际运作的细节
或是哪边有资料可以看吗?
--
※ 发信站: 批踢踢实业坊(ptt.cc)
◆ From: 134.208.2.78
1F:推 yauhh:是这样的,MapReduce派送每个工作都只是送出去给别台机器, 09/07 13:24
2F:→ yauhh:回文好了 09/07 13:24