Hello There, Guest! RegistrateRegister La Hora Current time: 11-19-2017, 03:06 AM

[FREE] Google Result pages scraper
Views 1765
Replies 3
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Users browsing this thread: 1 Guest(s)
#1
Wink 
Hi BWF,

I'm just starting in IM and some people from BWF have been helping me a lot (especially from the IRC), so now I feel like it's my turn to give some [Image: smile.png]

I'm a developer and I just made a very simple tool, it checks the numbers of result from google for each query.

It takes for input an Excel file named "data.csv", with, in the first column, the queries you want to run in Google, I originally made it to check how many pages where indexed from my websites, so query that looks like "site:mydomain.com", but it should work with any other kind of query.

It will then output in the column, the date as header, and then the number of pages found from each query, it will add a new column each time you run it, the output is made in the same csv file, (data.csv), so make sure you close the file before you run it.

Link: http://sheraf.wtf/google_results.rar
VirusTotal: https://www.virustotal.com/en/file/9...is/1450477207/

It is coded in Python, and packaged as a standalone .exe using PyInstaller, looks like there is a false positive...
Source code for the suspicious: http://pastebin.com/VxWSxZU5

You will need Firefox to be installed, it will actually open a Firefox window and start querying google from it, it may sometimes ask for captcha, as i say, it's a very simple code.

Enjoy, Thanks to the community.


Reply
#2
This is very nicely done. It might be worth adding proxy functionality so people dont get blocked by google. I was wondering if you could explain to me a little how I would go about using a foreach loop to put the data into a database table with the colums TITLE, LINK & DESCRIPTION.  Dot net Training in Chennai  |  Cloud Computing Training in Chennai | Salesforce Training in Chennai  | Linux Training in Chennai


Reply
#3
helllo dear buddies Is it possible to scrape the Google search results page using PHP to pull out the total number of search results found? 
Web Designing Training in Chennai  |  PHP Training in Chennai  |   Web Designing Training in Chennai


Reply
#4
You will need Firefox to be installed, it will actually open a Firefox window and start querying google from it, it may sometimes ask for captcha, as i say, it's a very simple code.


Reply


Forum Jump:

Users browsing this thread: 1 Guest(s)
All the content on BLACKWORLDFORUM is user generated and linked to 3rd party websites. BLACKWORLDFORUM.com does not host any files at its servers,it basically provides and indexing service. BWF; Its owners and its staff can not be held responsible for any type of content. To remove a link please contact webmaster via Contactus.