Associated article: Web Scraping Proxy
Tags: Web Development
Published source code accompanying the article by Howard Katseff in which he presents WSP, a Web scraping proxy server implemented in Perl. WSP uses the socket library to communicate with the browser client and the server. Also see WEBPROXY.ZIP.
Web Scraping Proxy by Howard P. Katseff Listing One # Request: http://www.amazon.com/ $request = new HTTP::Request('GET' => "http://www.amazon.com/"); # HTTP/1.1 302 Found # Set-Cookie: skin=; domain=.amazon.com; path=/; # expires=Wed, 01-Aug-01 12:00:00 GMT # Request: http://...