It looks like you're using an Ad Blocker.

Please white-list or disable in your ad-blocking tool.

Thank you.


Some features of ATS will be disabled while you continue to use an ad-blocker.


Finding Domains that Don't Want to be Found

page: 1

log in


posted on Mar, 28 2004 @ 04:04 PM
I am curious whether anyone knows or is working on an alogirthm or implemenation to search the internet for domains. I am posting this now before I have given it very much thought to find out if anything is being done in this area (maybe something for r&d if not). Regular internet searching and even "deep" digging reveal very little. If capable, please advise.


posted on Mar, 28 2004 @ 04:32 PM
Ummm, you mean domain names? Expired domain names? Available domain names? or Pre-existing domain names?

Searching is never a problem. The problem is going to be the WLS via NetSol.

posted on Mar, 28 2004 @ 04:44 PM
I wasn't thinking of NetSol. More along the lines of nslookup() or dig() against the root name servers. However, its quite possible that hidden domains may reside on a completely separate network outside of the "www" universe we're all(most) trapped in.

Smirkley, I am speaking of domains, ip address ranges, etc., used by sources wishing anonimity. I am not proposing infilitrating anything US gov't related. I am thinking more off the radar than that.

posted on Mar, 28 2004 @ 04:53 PM
OK. I understand.

All IP #'s exist whether assigned or not. Phantom IP's are commonly used by spammer's.

I would not reccommend delving into the neighborhood you suggest, as you may attract the attention of organizations that you may wish you have not attracted.

posted on Mar, 28 2004 @ 05:17 PM
one thing you may try looking for is robot.txt files... robot.txt tells search engines to ignore certain sites, such as the robot.txt from the gov pages:
(notice the gov uses robots.txt instead of robot.txt... it does the same thing, and sometimes comes up with a search query of robot.txt)

Here's a quickie on robot.txt from Dreamweaver:

The robot.txt File at Dreamweaver

These should help you get to some of the pages you may be looking for, but not all. Another thing is that not all IP's you find will be web pages, but rather FTP servers, or just BBS txt type pages... I recommend using CameraShy when you are doing your searches. First, it doesn't leave a trace of where you've been, and secondly it finds the info sometimes put into GIF images. The only problem I have with CameraShy is that it doesn't allow pop-ups... basically every page will need to be viewed in the original browser window, but it's well worth it (and is a single exe file... no extra components are installed!).

There are multitudes of h4xT0yZ all over the internet that could help you accomplish whatever you are trying to do. Do searches for hacking toyz on

Also, definitly check out CDC's site (Cult of the Dead Cow). This is a good hacking group to check out, even though you aren't gonna be 'hacking' anything, per se. Basically it is probably the best place to start finding what you need in tips and open-source toolz.

Hope that helps out a bit! Happy hunting!

(be vewy, vewy quiet... I'm hunting web pages...)

posted on Mar, 28 2004 @ 05:31 PM
There's also something called "The invisible web" that's mostly database pages. Here's an article on that:

There exist ways to reach and search them... is always a good source for info.

posted on Mar, 28 2004 @ 06:01 PM
thank you Earthscum and Byrd, most helpful.

posted on Apr, 1 2004 @ 09:33 PM
link ---- ----

I am not responsible for any misuse legal or otherwise of the above IP Adresses.

top topics


log in