CPC G06F 16/24542 (2019.01) [G06F 16/24537 (2019.01); G06F 16/24539 (2019.01)] | 21 Claims |
1. A method comprising:
receiving, by one or more processors, a query directed at a data set;
generating a query plan to execute the query, the query plan including a plurality of operators connected by links;
identifying a portion of the query plan that is eligible for fragment processing based on the type of link connecting at least two operators of the plurality of operators;
executing, by a parent query coordinator using one or more computing resources of a first set of computing resources assigned to the parent query coordinator, the identified portion of the query plan on a first batch of files of the data set to generate a first batch result;
transmitting instructions to a fragment query coordinator for the fragment query coordinator to execute the identified portion of the query on a second batch of files of the data set to generate a second batch result using a second set of computing resources assigned to the fragment query coordinator;
combining the first batch result and the second batch result to generate combined results; and
executing remaining portion of the query plan on the combined results to generate a response to the query.
|