Deep Web, Secret Web, Second Web

Reply to Badge & Animal:

I actually wanted to finish this thread a few posts ago, but it seems the rabbit hole is deeper still.

Indeed, thanks for sharing. Ive already used your tip with success.

reply to post by Skyfloating



I must say I suspected something like this... I just wasn't sure there is a "second" web accessible - even in minuscule percentages - to the wider public...

Thanks very much. Very interesting!

reply to post by Skyfloating




P.S. Why does the copyright information on the CompletePlanet site list the copyright scope as "2000-2004"?

Anyone knows?






[edit on 20-12-2007 by Vanitas]

reply to post by Vanitas



Hmm, I must say that search engine was surprisingly low-performing...

Anyway, here is the Wikipedia entry on the "Deep Web":

Deep Web

It's definitely a subject worth more exposure than it currently has.

reply to post by Vanitas


I have no idea why it says 2004-2004 on that website.


One thing is for sure: The fact that not many people even know the expression "surface web" vs. "deep web" is strange. Instead, most are left with the impression that google contains it all.

And even if we up those 2% of acessible information to 100%, its still doubtful that "all" information is availible on the internet.

Stuff you wanna keep secret you dont put into the internet.

Which is why it is a mistake to carry out ones entire ressearch or even conspiracy-research in the Internet.

reply to post by Skyfloating

Well first of all hiding from search engines spiders and bots its common practice... see nonstandard HTML code nofollow... see Robots Exclusion Standard...see method For restricting bots... see Template:Bots....see rules for meta tags... the list go on and on.

Lots of reasons for this...you want to restrict access..
we do this is because we dont want normal web users to accidentally find themselves logged into the back-end or Admin side of a web site...

There's also a number of people like me who have servers set up for experimental code... not everything works the way I hoped it would and if it makes my browsers crash, and I'm not a normal surfer, Think what it would do to your computer?

Yes we are hiding content all the time you would too...especially in this sue your neighbour era...

As to part two
Internet two is still in the developmental stages but it looks stable...
Now why we have a Internet 2 is simple see the one we have now is doing things it was never meant to do... How we get it to accomplish these tasks is with huge patches that dont always work, in short were almost at the limit as to what can be done with the current standard...IT2 is the opportunity to start fresh with a new slate and make cutting edge computing both faster and leave room for even greater developments.
so what are some of the changes? well how about being able to download a full HDDVD in seconds rather than hours or in the case of dial-ups days? How about being able to never need software ever again...the master programs are kept in a server you just have to log on to use. Photo editing Publishing ...well you get the idea its time for a major overhaul...

How do I know all this? Well I'm a member of the ISOC
and the Open Source Initiative
But dont get me started on this you all know how we geeks can just go on and on and on and on....

Anyone care to collaborate on a web service?

Man the possibilities are endless...

Originally posted by titian
Anyone care to collaborate on a web service?

Man the possibilities are endless...

My thoughts exactly...

I found this article to be particularly illuminating:


Tried and True Methods for Locating Hidden Web Contents

reply to post by DaddyBare


Being a member of ISOC, you´re the expert, the ideal responder to this thread. I opened it because I wanted to learn more about the behind-the-scenes Internet....with a special interest in

"stuff the public doesnt know or isnt quite aware of"

I mean, we are all using the internet, but hardly anyone has a clue of how its sustained, who sustains it, how it is monitored, who monitors it, how the government might be waging info-wars over the internet, how it would be possible to conceal a large part of it, and so on. NOT A CLUE. I was even so stupid to believe I can find anything with google.

Care to reveal some real geek-insider stuff?

reply to post by Vanitas




This search engine certainly looks promising:


GIGABlast


(Funny results coming up...! )








[edit on 20-12-2007 by Vanitas]

reply to post by Vanitas


I liked this part of the article:

"The invisible internet is growing at a much faster rate than the visible internet. It is said to be of higher quality..."

I really had no idea.

Originally posted by Skyfloating
reply to post by Vanitas

 

I liked this part of the article:

"The invisible internet is growing at a much faster rate than the visible internet. It is said to be of higher quality..."

I really had no idea.

Nor did I.
Which is why I like dropping here every now and then...

Another cool way to dig up results that may not pop up on a generic search of the net is this:

type intitle: index of (enter search words) then push enter. Many times it will bring up more then just a basic search or an index search. Very neat stuff. Even google will dig up some files that dont show up on a normal search

reply to post by Skyfloating


By definition 'geek-insider' things can't be discussed.

I've been around since 1986, using a Unix shell account, so I got to see things develop first hand. Most people don't even know what that is, without looking it up.

reply to post by Badge01


Wow, flash from the past. Kinda like MUD or ADA. I remember thinking my TAs were the shizzle because they were always playing the latest MUDS when I went up to their offices...

Oh the good ole days.

Originally posted by Skyfloating
reply to post by DaddyBare

 

Being a member of ISOC, you´re the expert, the ideal responder to this thread. I opened it because I wanted to learn more about the behind-the-scenes Internet....with a special interest in

"stuff the public doesnt know or isnt quite aware of"

I mean, we are all using the internet, but hardly anyone has a clue of how its sustained,

Care to reveal some real geek-insider stuff?

First I make it a point to never talk down to anyone but in this case you dont have the foundation so let me put it this way...
Like an elevator you dont need to know anything else but how to push a few buttons to go where you want to be. admittedly there is a lot of things happening in the background to get those buttons to work and move you from floor to floor. Motors cables pulleys safety breaks sensors...its a rather long list...and yes that list can include a camera to see just what your doing in that elevator!

This very web site is made with hundreds, thousands of lines of code (Maybe PHP) that tell the server how to display all the info into something you want to see...most people dont want to know the coding they just want to see the web page... So who runs it? well people like you and me..people who what to present they???...anything to the world...

So are you being watched??? well yes and no... Yes the Government does require we open ports so if they want to the can peek in on what your doing? are they? well unless you surf kiddy porn sites or make threats against the Pres, most likely not...Its a man power issue...sure they can look but its not possible for any group to see whats in every computer out there...

is there a cyber war going on? you bet your bottom there is. and Its can be a bloody fight too... every day hackers try to break into systems looking for you credit card and account info...they want you name address and and anything else they can get there hands on... you also have bored kids who just want to cause mischief...once in a while groups of these kids get together and do stuff like attack Yahoo in mass just for the kick of doing it...On the other end you have web masters constantly watching for problems. you have network admins struggling to keep the systems up and running you have security experts who spend all day every day picking apart viruses looking to stop the next big threat...Oh yes theirs a war going on behind the scenes and its a nasty one too!

anyway this is not the place to try to teach how it all works...that would take a year of upper level college classes to even scratch the surface...but if you want some insight into how it all works go check out w3 schools Its run by the ISOC and if you click around you'll start to get an idea of why so much stays behind the scenes

[edit on 21-12-2007 by DaddyBare]

reply to post by DaddyBare


fair enough, thanks for taking the time.

One last question: Do you think its possible that viruses are covertly created by anti-virus companies?

Originally posted by Skyfloating
reply to post by DaddyBare

 

fair enough, thanks for taking the time.

One last question: Do you think its possible that viruses are covertly created by anti-virus companies?

Couldn't say for sure but I'll tell this...Back when I was in college and even to this day...everyone in the Biz Knows that if you create a new Virus bigger and badder than anyone has seen thus far...every last one of these anti-virus companies companies will be making you job offers and you could pretty much set your own asking wage...

Would they do it to make us pay for the latest update? well they really dont need to cause right now there are thousands of kids working on making them anyway...

how can it be deep search?

i searched using these two sets of words

indigo adults
map atlantis antarctica

both at this deep planet and google

deep planet results

indigo adults ----- 3 pages
map atlantis antarctica ----- 1 page

google.ca results
118000 and 129000 respectively

so, i dunno, maybe i am upside down, cause a 'deeper' search ought to bring more results then google? or am i way out there (here) somewhere?