US 9,811,546 B1
Storing data and metadata in respective virtual shards on sharded storage systems
John M. Bent, Los Alamos, NM (US); Sorin Faibish, Newtown, MA (US); Zhenhua Zhang, Beijing (CN); Xuezhao Liu, Beijing (CN); and Jingwang Zhang, Beijing (CN)
Assigned to EMC IP Holding Company LLC, Hopkinton, MA (US)
Filed by EMC IP Holding Company LLC, Hopkinton, MA (US)
Filed on Jun. 30, 2014, as Appl. No. 14/319,301.
Int. Cl. G06F 17/30 (2006.01)
CPC G06F 17/30321 (2013.01) [G06F 17/30091 (2013.01); G06F 17/30194 (2013.01)] 23 Claims
OG exemplary drawing
 
1. A method for processing data in a sharded distributed data storage system, wherein the sharded distributed data storage system stores said data in a plurality of shards on one or more storage nodes, said method comprising:
providing a plurality of addressable virtual shards within each of said plurality of shards, wherein at least a first one of said plurality of addressable virtual shards stores said data and wherein at least a second different one of said plurality of addressable virtual shards separately stores metadata related to said data, wherein said data and said corresponding metadata related to said data are stored within said first and second addressable virtual shards, respectively, with a same object offset;
obtaining, at a first burst buffer appliance, said data for a given shard from at least a second burst buffer appliance connected to said first burst buffer appliance by an interconnect network; and
providing, by said first burst buffer appliance, said data for said given shard and said metadata related to said data for said given shard to said sharded distributed data storage system using a single write operation for storage in said respective first and second addressable virtual shards.