如何在hdfs上将文件下载

I have a very large (e.g. 100GB) .gz file and would like to it into smaller like 8GB/each for storage/copying. How to split a gzip file to several small ones on ?

我有一个非常大的文件（例如100GB）。gz文件，想将其成较小的例如8GB /每一个，用于存储/复制。 如何在上将gzip文件拆分为几个小文件？

You may use the tool to split a file by sizes.

您可以使用工具按大小拆分文件。

An example to split a large.tgz to at most 8GB smaller files is as follows.

下面是一个将large.tgz拆分为最多8GB的较小文件的示例。

split -b 8G large.tgz large.tgz.part-

The split files names are the prefix with appendix like ‘aa’, ‘ab’, ‘ac’ as follows.

拆分文件的名称是带有前缀的前缀，例如“ aa”，“ ab”，“ ac”，如下所示。

$ ll -htotal 35G-rw-rw-r-- 1 user user  18G Jun 25 10:57 large.tgz-rw-rw-r-- 1 user user 8.0G Jun 25 12:10 large.tgz.part-aa-rw-rw-r-- 1 user user 8.0G Jun 25 12:15 large.tgz.part-ab-rw-rw-r-- 1 user user 1.2G Jun 25 12:16 large.tgz.part-ac

翻译自:

如何在hdfs上将文件下载