博客
关于我
强烈建议你试试无所不能的chatGPT,快点击我
hadoop测试题目-每天5题,总35题,第四天
阅读量:4563 次
发布时间:2019-06-08

本文共 1572 字,大约阅读时间需要 5 分钟。

地址:                     

Q16. Suppose Hadoop spawned 100 tasks for a job and one of the task failed. What willhadoop do ? It will restart the task again on some other task tracker and only if the task fails more than 4 (default setting and can be changed) times will it kill the job(从其它tasktracker重启任务,失败超过4次的任务将被移除) Q17. Hadoop achieves parallelism by dividing the tasks across many nodes, it is possible for a few slow nodes to rate-limit the rest of the program and slow down the program. What mechanism Hadoop provides to combat this  Speculative Execution(如何解决一些运行时间长的任务拖延时间的问题)

通过执行推测式任务(speculative task)处理,重新运行任务,哪个任务先完成,使用哪个结果,其它的被删除。

参考:  

Q18. How does speculative execution works in Hadoop  (Hadoop的推测式任务如何运行) Job tracker makes different task trackers process same input. When tasks complete, they announce this fact to the Job Tracker. Whichever copy of a task finishes first becomes the definitive copy. If other copies were executing speculatively, Hadoop tells the Task Trackers to abandon the tasks and discard their outputs. The Reducers then receive their inputs from whichever Mapper completed successfully, first.(reducers从最先完成的节点接收数据) Q19. Using command line in Linux, how will you - see all jobs running in the hadoop cluster(命令: hadoop job -list) - kill a job(命令: hadoop job -kill jobid)

Q20. What is Hadoop Streaming  Streaming is a generic API that allows programs written in virtually any language to be used as Hadoop Mapper and Reducer implementations(让hadoop的进程能以任意的语言实现MR操作)

利用streaming完成任务语言实现MR操作。

转载于:https://www.cnblogs.com/jarlean/archive/2013/04/11/3013583.html

你可能感兴趣的文章
HeadFIrst Ruby 第二章总结 methods and classes
查看>>
STM32 通用定时器相关寄存器
查看>>
【题解】1621. 未命名
查看>>
字符串加密算法
查看>>
Oracle的实例恢复解析
查看>>
UICollectionView cellForItemAt 不被调用
查看>>
巧用网盘托管私人Git项目
查看>>
python全栈脱产第19天------常用模块---shelve模块、xml模块、configparser模块、hashlib模块...
查看>>
[LeetCode] House Robber
查看>>
virtualbox中kali虚拟机安装增强功能
查看>>
java生成六位验证码
查看>>
iOS的MVP设计模式
查看>>
stringstream
查看>>
【转】HDU 6194 string string string (2017沈阳网赛-后缀数组)
查看>>
前后端分离
查看>>
渗透测试学习 一、环境搭建
查看>>
处理图片透明操作
查看>>
Postman-OAuth 2.0授权
查看>>
mac pycharm打不开问题
查看>>
iOS项目之苹果审核被拒
查看>>