Robots and Crawlers

Control Panel

Go to the live plataform!

To be or not to be.. a robot

This site - robot.bubaweb.com - have as principal intention to democratise the powerful toy (or tool) known as "Web Crawler".

Web crawlers are computer programs that can 'read' a web page and return some kind of data that you can use for statistical purposes. Google has the most important web crawler of the internet and 'how it works' ins't a secret for web developers, what they do with the data that comes out of it is.
A bit of history. A few years ago when Yahoo, Lycos and Altavista were placing links manually into their database. This manual process was expensive, that is why they used to charge for it (and still do), but yet more accurate that a web program could be able to do at the time. the Big G went to another direction and started developing their own web robot, with their own set of rules that, in the end, were proven to be more precise and accurate than the competitor's manual process. Google was crawling up to success.
Now many search engines and web directories are using web robots to beep-up their company's repetitive actions as well.

Your little monster

Now you can start using this powerful tool as well. This is the 'Democratic Crawler' and you can use it to 'see' any page of the internet and analyse it the way you want.

We are still improving it, but soon you will be able to do many online tasks with it, including SEO benchmark, HTML analyse, page-loading speed process and much more.

For more details of how to use it, go to the Democratic Crawler introduction page.

About us

This website is part of a 'grand' IT project hosted by Bubaweb.com with the intention of drive attention to what really matters on a entrepreneurial website, like yours might be. We target developers who want to be part of a strong community for their own good and wealth. PHP is the main technology used (because it's simple, easy and able to do everything possible on the web) and SEO/SEM/PPC are the path for promoting yours - and ours - web-businesses.

Next to come

'TODO' list:

          - User registration system for people to be able save their crawled pages
          - SEO standard and premium analysis tool
          - Competition benchmark (crawl and compare competitor's web sites)
          - Profitable keywords analysis and suggestions

Note: this website is still under development.