CPC G06F 11/1469 (2013.01) [G06F 9/45558 (2013.01); G06F 11/1451 (2013.01); G06F 11/1446 (2013.01); G06F 11/1448 (2013.01); G06F 11/1453 (2013.01); G06F 11/1456 (2013.01); G06F 11/1458 (2013.01); G06F 11/1461 (2013.01); G06F 11/1464 (2013.01); G06F 11/1466 (2013.01); G06F 2009/45562 (2013.01); G06F 2009/45591 (2013.01)] | 20 Claims |
1. A method comprising:
sharding a file in a fileset into a plurality of shard files, wherein the plurality of shard files correspond to a plurality of partitions of the fileset, and wherein sharding the file is based at least in part on metadata associated with the file;
distributing the plurality of shard files to a plurality of nodes, wherein at least a first shard file of the plurality of shard files is distributed to a first node of the plurality of nodes and at least a second shard file of the plurality of shard files is distributed to a second node of the plurality of nodes; and
using the plurality of nodes to generate a plurality of snapshots corresponding to the file, wherein at least a first snapshot of the plurality of snapshots is generated at the first node based at least in part on the first shard file and at least a second snapshot of the plurality of snapshots is generated at the second node based at least in part on the second shard file.
|