main

Google goooing down?

Mr magoo   on 14 June 2003 - 22:04 · 69 comments & 9746 views

Advertisement (Why?)
Thanks to nicedreams on the forums for this piece of speculation...

"A rumour is spreading like the plague over the infinite paths of the Internet: Google has reached overbooking. The most popular creature in the virtual universe has space problems, or, more precisely, it could have them in the future. In fact, is seems that the most popular search engine in the world is about to reach the limit of its capacity of listed pages: 4,294,967,296. A numeric problem that is mainly due to a calculation error.

In Google’s giant database, each link can occupy the space of only 4 bytes. In other words, even though the home page of the system has counted something like three million web pages, it is probable that the engine is about to run out. Or, if they do not change their system of listing links, the Internet will continue to grow and expand behind Google’s back, but the new sites that will be created will be left out while its database will be full of an enormous quantity of obsolete pages that will crowd the pages of search results.

The analysts arrived at this conclusion by studying the recent “strange behaviour of the system” during the last renewal of its “contents.” In fact, more or less once a month, Google reorders its listed pages. During this process, the system calculates the so-called PageRank of each page, based on the number of visits received and therefore, based on order of importance. It then incorporates the new pages found into its list of available web sites, periodically modifying the search results. This process of updating is called Google Dance in jargon and lasts approximately four days. However, during the last Google Dance many pages changed their position in the classification in an unexplainable way. This, together with other anomalous events has created unrest among users.

Since the first Google became a reality on the Internet in 1997, this search system has evolved and become, without a doubt, the most powerful instrument on the Internet. Not only have its creators, Sergey Brin and Larry Page become multimillionaires, but they have also become two of the greatest heroes of the virtual community whose dominion extends all around the world, thanks in particular to their list of links. In a certain sense, Google is the spine of the Internet. And whatever problem afflicts its working can influence the growth of the very same Internet. But what can they do to continue to efficiently list a sea of pages that continue to multiply exorbitantly?"

View: Article @ GSM box


AdBlock
"AdBlock allows the user to specify a number of filters, which removes unwanted images based on their address. Filters are specified using the wildcard character (*) or regular expressions. Thus, it's possible to control in some detail what is displayed. Upon loading a page, AdBlock will scan through it and remove or hide the elements that matches the filters entered by the user. It doesn't prevent content from being downloaded, merely from being displayed. It's capable of removing both images and Flash animations."

The fact that it still downloads them makes ya feel a little less guilty :)

View: Adblock

Autoscroll

"AutoScroll is an addon for Firebird that emulates the autoscrolling functionality of Internet Explorer. For those unfamiliar with this, when you middle click on a page (typically by clicking a mouse wheel button) you can then move the mouse up and down to have the page scroll by you without further mouse movements."

An invaluable feature.
View: Autoscroll

LiveHTTPHeaders

"This developer oriented extension is to add information about the HTTP headers. More information on the project homepage."

Not invaluable, but a cool and useful tool for web gurus.

View: LiveHTTPHeaders

Popup ALT Attribute

"This extension displays the alt property of images as a tooltip, like Internet Explorer and Netscape 4.x does. "

View: Popup ALT Attribute


Mycroft

"This is a very powerful collection of extensions that allow you to add search engines to the Search bar in Firebird. To install a new search engine, go to the Download page and enter the Site Name (e.g. altavista, dictionary, etc.) and press Search. A list of matches should appear. Click on the one you want and that search engine should now be added to the list of available search engines in the Firebird Search bar!"

This is just super- a collection of adins that add extra search options to the search box in the top right.

View: Mycroft

User Agent Switcher

"This extension adds a menu to switch the user agent of the browser. It is designed to provide functionality similar to the "Browser Identification" feature of Opera."

Very very useful, allowing you to view sites deemed good enough only for IE :D.

View: User Agent Switcher

Web Developer

"The Web Developer extension for Mozilla Firebird adds a menu and a toolbar to the browser with various web developer tools." (ed - view his site for the full list- there are loads of things.)

One of my favorite tools, enabling a plethora of extra Web Developer functions.

View: Web Developer

Well - thats my favorite few. Hope you get as much fun out of them as i have!

Post a comment · Send to friend Comments · There are 69 additional comments
#1 headless_armadillo on 14 Jun 2003 - 22:08
NOOOOOOOO
(1 reply) #2 Tom Servo on 14 Jun 2003 - 22:14
QUOTE
I never claimed it's FUD, I just stated that the author of the article is a freakin' idiot because he can't count.

And regarding that FUD, well yeah, pretty much possible, because there is no source reference and who actually knows how Google works? Definitely not that GSMBox moron. And why didn't other sites mention such an issue? If this is such an issue, it would have been on /. already. And how do you fit an URL, website description and excerpt into 4 bytes anyhow? And do you really think the Google guys would have been so stupid and use 32bit identifiers? No way!


http://www.neowin.net/forum/index.php?s=80c923423587129db56909185d94e504&act=ST&f=8&t=85526&st=30
#2.1 YaddaMe on 15 Jun 2003 - 01:20
I dunno the legitamacy of the space issue... but Google has had some strange happenings of late. The SERPs relavacny has gone down in many ppls view. Many of the anti-spam techniques used, all of a sudden quit working with Dominic (Googles last update). Some says it's Google's biggest "tweak" to date which will require a few more updates to full tweak it... some say Google, in a way "broke"... etc etc.

Either way, the general concensus is that Dominic was a step backwards of sorts.... and then all kinda of rumors start to fly.

WebmasterWorld is probably the most reliable place for Google happenings ... even a Google employee participates (obviously, in a very general, non-specific manner.. but he's there)..... and I dont recall seeing anything about a space issue there... but there's no denying Dominic was "funky".
#3 Ferret on 14 Jun 2003 - 22:36
Google CAN'T go... I think the three most important features that people love so much about it, is; 1. The PageRank, 2. NO advertising banners, 3. Loads so damn quick

Thanks,
Ferret !
(1 reply) #4 nonick on 14 Jun 2003 - 23:14
heh, i bet they will release new versions of their search engine, google aint gion no where
#4.1 lj300 on 15 Jun 2003 - 00:43
yeah, eventualy the problem will be fixed
#5 fdiaz2day on 14 Jun 2003 - 23:28
I don't want to see them go...
#6 Solarix on 14 Jun 2003 - 23:31
its like saying microsoft is out of money
#7 Quick Reply on 14 Jun 2003 - 23:38
sounds like BS
(2 replies) #8 dandin1 on 15 Jun 2003 - 00:52
Well, if this information is right, there is still 1211642644 pages to go!
#8.1 ~*McoreD*~ on 15 Jun 2003 - 08:54
how did u calculate it?
#8.2 Sawyer12 on 15 Jun 2003 - 13:26
look on the google page and it says "Google - Searching 3,083,324,652 web pages" take that away from the capacity (4,294,967,296) theres your answer. i think. I think it changes quite quickly though. I read somewhere ages ago that 100 pages are added to the internet every second.
(1 reply) #9 oddBall on 15 Jun 2003 - 01:06
This is a load of bollocks. The people at Google are amongst the smartest in the world, just because someone says something and provides absolutely no evidence doesn't mean you should listen - I thought you guys only posted credible information.

Googles indexing system will be far more flexible than that - this isn't the 1960's!!!
#9.1 Dj Open Source on 15 Jun 2003 - 03:35
Does ur brain not interprete words like rumor and speculation? I think those two words hinted at the fact this may not be true. Wait oh ya im a rocket scientist though, that must explain it
(2 replies) #10 stuckwithme247 on 15 Jun 2003 - 01:30
google is my friend
#10.1 memNOC on 15 Jun 2003 - 01:34
you make me sad
#10.2 madjo on 15 Jun 2003 - 10:33
my preciousssssssss

my guess, is that this was all forged by one of the competitors of google, to create a hysteria among people who don't know any better, and stop using google... but that could be my paranoid mind working
(7 replies) #11 nifu on 15 Jun 2003 - 01:39
This may be off topic but..
I was wondering how the two guys that made Google are multi-millionaires. I mean, they don't get paid for any ads so... I just can't think of the way they make so much money at the moment, someone enlighten me
#11.1 Mgz on 15 Jun 2003 - 02:01
AOL and Yahoo use Google , do you thinks that AOl&Yahoo use Google for free like us
#11.2 timbo3 on 15 Jun 2003 - 03:04
They do have ads, they are right below the search bar in the results pages and also in the column on the right side.
#11.3 Dj Open Source on 15 Jun 2003 - 03:38
They have advertising, just not "banner" ads per say, eg/ those find lowest prices at ebay links. Also they get money by selling their tech to corporations, who want in house search engines
#11.4 CPUGuy on 15 Jun 2003 - 05:41
They also sell "google servers", which is basically hardware with the google search engine in it for large corporations.

We have one at my University.
#11.5 Sawyer12 on 15 Jun 2003 - 16:21
i dont understand what u mean by a google server ?
#11.6 JaggedFlame on 15 Jun 2003 - 21:21
You can set up a Google Search Appliance so that you can use the Google search engine on your own internal site. Is that what you're talking about, CPUGuy?
#11.7 YaddaMe on 15 Jun 2003 - 22:18
Yes he is.... many uses for it... on an intranet for employee-only sites, a massive website, etc etc. Anywhere a search feature might be useful.

And back to the guy who asked the inital question about money.
Investors, multi-million dollar partnerships with over130+ companies... adwords, sponsored listings (which is a minimum of $5k/month), servers, etc etc etc.

And to think... one of the most powerful websites on earth, and it's still a private company.

These are some smart cookies.... if ya always though google was just a web search look further:
Froogle
Google Answers
Google Catalogs
Google Voice Search - cool idea
Google Web API - limitless possiblities of uses, kudos to Google for this one
(3 replies) #12 Homie on 15 Jun 2003 - 01:49
more RAM?
#12.1 computerchan on 15 Jun 2003 - 03:13
well a 32-bit interger can create the max range of 0..4294967295
more RAM does not help to problem since it's the problem on the structure of the database
if they find another database system which support 64-bit or even 128-bit, it can support 18446744073709551615 records or 2^128 records (calculate it yourself ), the facing is basically solved.
however, the storage problem will be concerned .
#12.2 Sawyer12 on 15 Jun 2003 - 13:29
well wouldnt the database be held on a hard drive not in RAM. RAM would have the effect on how fast google can search and the ammount of searches it can handle at one time, and it would also have something to do with bandwidth.
#12.3 NXPdev on 16 Jun 2003 - 10:39
They can change to something like SQL Server 2000 Enterprise Edition 64-bit!
#13 engmike8 on 15 Jun 2003 - 02:19
This sounds like a glitch in the matrix. they will either have to start over with 7 .com and 6 .net sites and rebuild the whole thing, or lose everything
#14 ripgut on 15 Jun 2003 - 02:51
WTF this is absolute bull****
#15 slay on 15 Jun 2003 - 03:07
maybe we should send them some money to get more server?
#16 ryokurin on 15 Jun 2003 - 03:23
I would think that they would be smart enough to fix it if they knew that it was comming, and they arent dumb enough to not know its comming. FUD.
#17 Dj Open Source on 15 Jun 2003 - 03:43
I think that google would know and prepare for this fact long before we would even relise it, thats what they pay these people for. I still could be wrong, lets hope not though cause google rox
(1 reply) #18 waddle5000 on 15 Jun 2003 - 04:34
deos this mean i gotta use yahoo again
#18.1 ben_b on 15 Jun 2003 - 23:34
:lol:

Yahoo! uses Google!

:lol:
#19 Gary_Player on 15 Jun 2003 - 04:36
NOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO!!!

I like google...search engines as a rule suck but google is the least sucky of all of them...

All they need is more RAM, RAM sovles everything
#20 Xenobane on 15 Jun 2003 - 05:08
If GOOGLE died, It's time for me to move into a cave.
(1 reply) #21 goodness0001 on 15 Jun 2003 - 05:16
I use alltheweb.com...it has a more reliable ranking system and also it does not provide your private searching habits to whomever wants it much like google does. Google keeps track of your every move.

Give Alltheweb a try.
#21.1 iomayho on 15 Jun 2003 - 12:22
hey... this search engine is pretty good..., i wonder why i never heard of it...
(1 reply) #22 TC17 on 15 Jun 2003 - 05:44
Well if Google would quit archiving newsgroup posts from *many* years back, they would free up a ton of room.

Personally I think its an invasion of privacy for them to be doing that anyways even if people post in public forums. Most people intend their post for that specific group and no where else. Most people don't intend or care to have their post still shown 10 or 20 years later where future employers could read and judge you based on that.

#22.1 Schrodinger on 15 Jun 2003 - 20:10
I really don't think that the news have anything to do with it... the news and the web are two differents search engine with two differents database.
I personnaly think that the archiving of every news is one of the best feature of google (in fact Google didn't start this archiving... they just bought dejanews that had been archiving for many years before and make it much better!). You must see the news as a database of knowledge... if you want something private... send email!
#23 lieb39 on 15 Jun 2003 - 06:10
Screw all the other search engines. Google is the one and only. It does the job very nicely and it's super fast for slow 56k'ers (thats me ) If google would die today, i would die tomorrow just kidding.

-lieb39
(3 replies) #24 Quick Reply on 15 Jun 2003 - 06:21
I still don't understand how they come up with an exact figure on the max number of records possible! it looks like it's a random number, if it's not, what's the calculation to verify this ourselves?
#24.1 chilliadus on 15 Jun 2003 - 06:59
QUOTE
it looks like it's a random number


That's 2^32 = 4294967296, the max number that a 32bit integer can hold, SUPPOSING google is using the 32bit integer as a page's reference (inde.
#24.2 Quick Reply on 15 Jun 2003 - 09:50
are all sites 32bit integers? i.e. does neowin use a 32bit integer?
#24.3 Noxerus on 15 Jun 2003 - 14:25
Umm, a site can't exactly be an integer. Just that in Google's database, every page on the web gets an index number (like your ID), and that number is an integer. Whether it's a 32 or 64 bit integer is the question
(2 replies) #25 hotrod on 15 Jun 2003 - 06:51
YAHOO!!!
#25.1 whistlerxp on 15 Jun 2003 - 15:29
That better have been sarcasm.
#25.2 ben_b on 15 Jun 2003 - 23:40
Guess you love google cuzz Yahoo! uses Google!
#26 chilliadus on 15 Jun 2003 - 06:54
Humm, running out of space, sounds so familiar. When's the last time we heard of this? I hope those "analysts" would stop scare the public with every possible 2^n "barrier". In programming, we had the 64K memeory barrier, in PC hardware, we had the 540M, 2.1G, 8.4G, 137G HD capacity barriers, in the internet, we had the 32bit addresses barrier. NONE of them was insurmountable as they had predicted. In the case of Google, it's only a programming issue, or an archtecturing issue to the worst. I can think of 5 ways to break the 2^32 limit without going to 64bit programming. There must a physical limit that how many pages can a single origination archive in the foreseeable future, but the article faild to discuss it.
#27 mipra on 15 Jun 2003 - 07:16
man...no..it's not happening..tell me it's not happening
(1 reply) #28 Octol on 15 Jun 2003 - 07:36
Anyone wanting a slightly dated, but more or less accurate rendering of how Google works can look here:

All About Google (Thanks to Mohamed_E at WebmasterWorld)

Good luck understanding it.
#28.1 Xe|oN on 15 Jun 2003 - 10:21
Cheers, an interestng read
(2 replies) #29 Wodin on 15 Jun 2003 - 14:54


I can't imagine anyone needing more than a 4,294,967,296 web page database for a search engine.


#29.1 werejag on 15 Jun 2003 - 15:56
unless you the web master of the web page this is not part of 4,294,967,296 web page database. then you would be highly pissed
#29.2 russdaplaya on 15 Jun 2003 - 16:59
Some people just don't get the hidden humour!
#30 goodness0001 on 15 Jun 2003 - 16:16
I still like alltheweb.com
(1 reply) #31 kljs on 15 Jun 2003 - 16:30
Is Google broken?
#31.1 YaddaMe on 15 Jun 2003 - 20:50
No, not in the way you may be thinking....

But, yes there have been some funky happenings there (completely unrelated to this space-issue). Anti-spam techniques ceased to work with Dominic (meaning quite a few ppl that spammed to get their site atop the list, got just that, their sites atop the listings).
People that pay close attention to the changes in updates agree to a point that the last update reduced overall search relavancy.

Overall, the latest update was viewed by many as a negative, and possibly a step backwards....... why, no one knows.
#32 Knight' on 15 Jun 2003 - 19:53
No!
#33 cabletron2000 on 15 Jun 2003 - 22:26
Google have jsut started the newest update "Esmeralda " seems to be the biggest ever so

Esmeralda @ Webmasterworld
(2 replies) #34 Klownicle on 16 Jun 2003 - 01:39
Google goes, were all screwed =(
#34.1 Wodin on 16 Jun 2003 - 11:29
Like Google is the only search engine LOL. People amaze me sometimes.

Personally, I can't break away from Dogpile which is a metasearch engine. Searches thru all of the search engines at once. There are others too. But it always seems a different engine is pointing towards the type of results I'm looking for. Sometimes google, sometimes yahoo etc.
#34.2 insurektion on 16 Jun 2003 - 20:20
Google IS the only good search engine. Alltheweb is ok. but nothing does it fast like google.
#35 ripgut on 16 Jun 2003 - 02:06
WHY DOESNT APPLE JUST DIE, why google?
#36 mjames on 16 Jun 2003 - 02:39
QUOTE
During this process, the system calculates the so-called PageRank of each page, based on the number of visits received and therefore, based on order of importance.

This is incorrect. PageRank is not determined by visits or popularity, although it gauges it. PageRank measures a page's importance according to Google and it calculates this based on link popularity. The bigger/more popular sites that link to you, the higher your PageRank is. And vice-versa ...
#37 kwyjibo on 16 Jun 2003 - 12:38
What the hell is this idiot babbling about? He cites no facts and doesn't even explain what he believes the problem to be. What's that smell? Bullsh~1...
#38 SpUnKy MOnkY on 16 Jun 2003 - 20:33
WOULDNT IT BE LOGICAL TO GET MORE SERVERS WITH MORE 32-bit procecors.
Any way HOW COME NO ONE HAD THE IDEA TO ASK GOOGLE IF THEY ARE GOING TO DIE. SOME PEOPLE PROBABLY THINK THAT THEY ARE GOING TO REPLY THAT EVERYTHING IS FINE. I MEAN NOT MUCH WILL HAPPEN IF HUMANS FIND OUT.

Commenting has either been disabled on this article or you are not logged in. Click here to login or register, its free!

Note: Anonymous commenting is disabled in order to keep the quality of responses to a high standard.

Advertisement (Why?)