Deep Web, Secret Web, Second Web

google boogle

isn't the internet merely an extension of big brother.......

Im certainly no expert with the old computer but heres a tip i was given on doing searches, type the following into google (haven't actually tried it on any others) and type in lets say, avi or mp3 at the end (without the plus)

intitle:"index of" +"index of" +size +name +description +modified

what you get is the directories /folders on computers where these are stored.

i have no idea if this is legal or if you are hacking into personal computers, i havent used it to download anything JUST IN CASE

Originally posted by Skyfloating
Whats always frustrated me is if I look for, lets say "Atlantis" related items I first get tons of stuff about Atlantis - The cartoon, Atlantis - the Holiday Resort, and have to minus all kinds of things out before even getting close to starting research. Your Library Index seems to help with that.

There's daily spiders or robots that search pages and index them, then there are the less frequent deeper robots that take the entire site into account, relate it to others, and rank them.

If you are searching "Atlantis" and say you want the mystery's about it, then add that word mystery, or add key words that relate. Be specifc, as if asking it a question. The search engine isn't psychic! Google will more than likely be displaying the results of whoever called their site "atlantis" or had the word "atlantis" more times on the page result than any others.

New sites will take longer to be recognized and indexed and should be submitted to every search engine and directory to speed things up, but not every new webmaster is aware of that. They also may have a good site, but without any SEO expertise, their pages will be missed. Not knowing how to write error-free search engine friendly html and overloading of pages which may cause the page to be missed when the spider visits is a prime reason.

Also some sites get banned and removed for a variety of reasons, and can even just plain vanish off the searches for months. Then you have sites or pages who don't want to be indexed, like RATS forum.

Google usually searches first for the page title, then content and popularity (has most sites linking to it). Yahoo searches differently, as does msn and others. Google changes the algorythm so smart webmasters can't figure out the secret formula to getting their site on the first pages to come up. With the competitiveness of optimizing a site to get the best ranking, it buries some good pages so deep, you'll never find them.

I would say the dis-satisfaction at finding pages you want is a combination of the spidering algorythms and the webmaster not learning how to optimize their site for google to index and rank - and ones that do know how and bump other sites down the list.

Just a quick add... I came across an article recently (don't recall where, so I can't offer a link... sorry) that said that Google is working doing OCR on even more PDFs that are on the web to add them to the index. Off the top of my head, PDFs and Flash content are the two (besides databases) that are hard to index / crawl.

reply to post by whoswatchinwho


Can you explain that more please?

reply to post by Munro_DreadGod


Just who are you, SIPRNET is D.O.D. and everyone who even tries to log on is flagged and tracked by them. Are you trying to get folks busted or something?

who is "them" - lol

have another glass of we need you to mask the true nature of UFO's fruit punch

The deep web is amazing once you learn about it. There's websites where you can literally buy illegal arms, drugs, child porn, or anything imaginable. I'm not endorsing any of this but this article here is very interesting. gawker.com...