Comments on: Scraping Bing SERP

By: nux

nux — Tue, 30 Aug 2011 15:38:17 +0000

Thanks for this. I’ve modified it a bit to allow for searching through pages.

$bing_url = ‘http://www.bing.com/search?q=‘ . urlencode($keyword) . ‘&first=’;

for ($page = 0; $page < 9; $page++) {
// Grab website
$curl = curl_init();
if ($page == 0) {
curl_setopt ($curl, CURLOPT_URL, $bing_url . '1');
} else {
curl_setopt ($curl, CURLOPT_URL, $bing_url . $page . 1);
}

I didn't use the getPage() function, but using the bing_url and actually passing either$ bing_url . '1' (first = 1) or $bing_url . $page . 1 (first=11, 21, etc) allows you to parse the pages.

By: Atef

Atef — Sun, 07 Aug 2011 22:55:43 +0000

for not making bing show local results when using a proxy with a country like china add this to the link

&mkt=En-us

By: seozero

seozero — Fri, 17 Jun 2011 09:51:46 +0000

Awesome. Thanks for sharing!

By: Noel

Noel — Wed, 15 Jun 2011 20:16:22 +0000

I needed something quick and easy to test out some theories with on MANY linux machines, so I whipped up something similar using PHP and libCurl. I’ve posted the source @ http://pushandpop.blogspot.com/2011/06/simple-php-bing-serp-ranking-checker.html .

By: Kerigen

Kerigen — Wed, 10 Nov 2010 11:11:33 +0000

Hello Simone,
I have the same Problem. Do you find any solution?

By: Wanderer

Wanderer — Wed, 15 Sep 2010 21:05:15 +0000

Thanks for that tiny script! Works pretty well. Do you know y the “Link:” or “LinkDomain:” operator doesn´t work any more?

By: Simone

Simone — Tue, 24 Aug 2010 07:21:19 +0000

Hi to all! I’ve got the same trouble of Toni.

My function is recursive and look for all the pages of Bing, but
- I cannot access more then 20 pages
- (or) I can use this URL http://www.bing.com/search?q=ip%3a216.239.34.21&count=50&first=199 like last one

I also tryed writing and sending back cookies to Bing, without luck.

By: Toni

Toni — Tue, 16 Mar 2010 09:59:44 +0000

Have anyone managed to scrap the first 100 Bing results page:
http://www.bing.com/search?q=twitter&count=100

I get the following in return:
HTTP/1.1 200 OK Cache-Control: no-cache Date: Tue, 16 Mar 2010 09:50:41 GMT Content-Length: 0 Connection: keep-alive Set-Cookie: OVR=flt=0&flt2=0&DomainVertical=0&Cashback=cbtest4&MSCorp=kievfinal&GeoPerf=0&Release=osf1; domain=.bing.com; path=/

If you figured it out please send an email at tonixx AT gmail.com

Thx!

By: seozero

seozero — Mon, 08 Feb 2010 07:23:13 +0000

sent you email

By: ukescuba

ukescuba — Sun, 07 Feb 2010 20:06:39 +0000

ill share mine with you when im done with it

when you get chance can you drop me an email id like to show something that you can use with your scraped content