US 11,741,174 B2
Direct leg access for proxy web scraping
Eivydas Vilcinskas, Siauliai (LT); Arnas Petruskevicius, Vilnius (LT); Giedrius Stalioraitis, Vilnius (LT); Martynas Juravicius, Vilnius (LT); and Rimantas Stankevicius, Vilnius (LT)
Assigned to Oxylabs, UAB, Vilnius (LT)
Filed by Oxylabs, UAB, Vilnius (LT)
Filed on Mar. 21, 2022, as Appl. No. 17/699,939.
Application 17/699,939 is a continuation of application No. 17/373,570, filed on Jul. 12, 2021, granted, now 11,281,730.
Claims priority of provisional application 63/219,660, filed on Jul. 8, 2021.
Prior Publication US 2023/0017698 A1, Jan. 19, 2023
Int. Cl. G06F 16/95 (2019.01); G06F 16/951 (2019.01); H04L 9/40 (2022.01); G06F 9/54 (2006.01); H04L 67/133 (2022.01); G06Q 10/105 (2023.01); G06F 9/48 (2006.01); G06F 16/953 (2019.01)
CPC G06F 16/951 (2019.01) [G06F 9/4881 (2013.01); G06F 9/547 (2013.01); G06F 16/953 (2019.01); G06Q 10/105 (2013.01); H04L 63/083 (2013.01); H04L 67/133 (2022.05)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for securing a web scraping system, comprising:
(a) receiving, at a load balancer, an API request to scrape content from a target website from a client computing device, wherein the load balancer is identified based on a hostname in the API request;
(b) generating a token indicating an identity of a client associated with the API request;
(c) identifying a server configured to initiate a scraping process on the web scraping system based on the hostname in the API request;
(d) transmitting the API request along with the token to the server;
at the server configured to initiate the scraping process on the web scraping system:
(e) authorizing the client using the token; and
(f) causing the web scraping system to scrape the target website in response to the authorization.