CPC G06F 16/215 (2019.01) [H03M 7/40 (2013.01)] | 18 Claims |
1. A method for data processing, including:
determining, based on sizes of multiple data segments included in data to be processed, a first time required to perform a matching operation for each data segment, wherein the matching operation is used to determine non-duplicate data segments;
determining, based on the size of each data segment and a compression level for the data to be processed, a second time required to perform a compression operation for each data segment, wherein a different compression level corresponds to a different compression ratio, different storage space that compressed data requires, and different time requirements to process;
determining, based on the first time, the second time, and a de-duplication rate for the data to be processed, a target mode for processing the multiple data segments from a first mode and a second mode,
wherein in the first mode, a compression operation is performed only on the non-duplicate data segments in the multiple data segments based on a time required to process the data using the first mode, the first time, the second time, and the de-duplication rate of the data to be processed, and
wherein in the second mode, a compression operation is performed on each of the multiple data segments; and
performing the matching operation and the compression operation based on the target mode.
|