精华推荐
打造专业硬件工程师
打基础！探索前端开
全面掌握PyTorch项
云端运维大师自动化
31集非常难得的飞塔
审计架构解密 JAVA
|
1789| 11
|
见过最好的Hadoop源代码分析文档 西安电子科技大学 Hadoop文件系统分析报告 70页
[复制链接]
|
|
Hadoop 文件系统分析报告 ............................................................................................. - 1 -
1 修订记录 ...................................................................................................................... - 4 - 2 摘要 .............................................................................................................................. - 5 - 3 org.apache.hadoop.fs 包总述 ........................................................................................ - 5 - 4 Hadoop 文件系统概述 .................................................................................................. - 5 - 4.1 类层次结构 ............................................................................................................... - 5 - 4.2 输入输出流 ............................................................................................................... - 7 - 4.2.1 Java 中的IO .......................................................................................................... - 8 - 4.2.2 Hadoop 的输入输出流 .......................................................................................... - 10 - 5 FileSystem 深入分析 .................................................................................................... - 10 - 5.1 fs 中的接口................................................................................................................. - 10 - 5.2 FileSystem .................................................................................................................. - 10 - 5.2.1 Configured 基类和Closeable 接口 ...................................................................... - 10 - 5.2.2 FileSystem 的内部类和属性 ................................................................................ - 11 - 5.2.3 文件系统的获取 .................................................................................................. - 15 - 5.2.4 文件系统的关闭 .................................................................................................. - 17 - 5.2.5 读取数据 .............................................................................................................. - 17 - 5.2.6 写入数据 .............................................................................................................. - 18 - 5.2.7 文件操作 .............................................................................................................. - 20 - 5.2.8 查询文件系统 ...................................................................................................... - 23 - 5.2.9 其它方法 .............................................................................................................. - 24 - 5.3 FilterFileSystem .......................................................................................................... - 25 - 5.4 ChecksumFileSystem ................................................................................................. - 26 - 5.5 LocalFileSystem ......................................................................................................... - 27 - 6 输入输出流分析 .......................................................................................................... - 28 - 6.1 FSInputStream 抽象类 ............................................................................................... - 28 - 6.2 输出流 ....................................................................................................................... - 33 - 6.3 FSInputChecker .......................................................................................................... - 35 - 6.4 FSOutputSummer ....................................................................................................... - 37 - 6.5 FSDataInputStream ..................................................................................................... - 39 - 6.6 FSDataOutputStream .................................................................................................. - 40 - 7 AbstractFileSystem 分析 ............................................................................................... - 41 - 7.1 AbstractFileSystem 抽象类 ........................................................................................ - 42 - 7.2 FilterFs 抽象类 ........................................................................................................... - 42 - 7.3 ChecksumFs 抽象类 ................................................................................................... - 43 - 7.4 LocalFs 类 ................................................................................................................... - 44 - 7.5 DelegateToFileSystem 抽象类 ................................................................................... - 44 - 7.6 FileContext 类 ............................................................................................................ - 45 - 7.6.1 Hadoop 中的路径 .................................................................................................. - 46 - 7.6.2 server side 属性 .................................................................................................... - 47 - 7.6.3 FileContext ............................................................................................................ - 48 - 8 其它类 .......................................................................................................................... - 51 - 8.1 Hadoop Shell 命令 ..................................................................................................... - 51 - 8.2 杂类 ........................................................................................................................... - 59 - 8.2.1 BlockLocation ........................................................................................................ - 59 - 8.2.2 异常与错误 .......................................................................................................... - 60 - 8.2.3 配置 ...................................................................................................................... - 61 - 8.2.4 ContentSummary ................................................................................................... - 64 - 8.2.5 CreateFlag .............................................................................................................. - 64 - 8.2.6 FileChecksum ........................................................................................................ - 64 - 8.2.7 FileUtil ................................................................................................................... - 65 - 8.2.8 FsStatus .................................................................................................................. - 66 - 8.2.9 FsUrlConnection .................................................................................................... - 66 - 8.2.10 GlobExpander ...................................................................................................... - 67 - 8.2.11 LocalDirAllocator ................................................................................................ - 67 - 8.2.12 Options ................................................................................................................. - 68 - 8.2.13 Trash .................................................................................................................... - 68 - 9 结论与进一步的工作 .................................................................................................. - 69 -
购买主题
本主题需向作者支付 8 金币 才能浏览
| |
发表于 2015-1-29 21:19:47
| ||
发表于 2015-1-30 00:32:24
| ||
| ||
| ||
| ||
| ||
| ||