Another DDoS attack?

a reply to: ArJunaBug

It really is your fault. Good day to you!

a reply to: AMPTAH

I hope they are giving stars and flags for slowing ATS down.

I'm not working at the moment, so I can't donate, although ever since the message about adblock arrived, I have had ATS allowed. 3 ads per page max is worth it.

originally posted by: VivreLibre
Having same issues. CIA is extracting user data from the last month so it takes up a bit of bandwidth. I'm sure they'll be finished soon.

---

Actually, I think it's PARTIALLY because of this posting:

www.abovetopsecret.com...

The NSA, DIA, CIA, CSIS, CSE, MI5, MI6, GCHQ,
The Illuminati, the Bilderbergers, the Freemasons,
The Trilateral Commission, The Federal Reserve,
the Nephilim, the Annunaki, the Reptoids,
the Greys, the Blues and the Flying Elvii
are ALL in an uproar right now and ATS
has a heads up on all the intelligence booty!

The THREE GIGABYTE Wikileaks Insurance File
is ABOUT TO BE BROKEN and its password
posted here... if its all true of course!

The Breaking-AES-256-bit-encryption-algorithm that is!

originally posted by: StargateSG7

originally posted by: VivreLibre
Having same issues. CIA is extracting user data from the last month so it takes up a bit of bandwidth. I'm sure they'll be finished soon.

---

Actually, I think it's PARTIALLY because of this posting:

www.abovetopsecret.com...

The NSA, DIA, CIA, CSIS, CSE, MI5, MI6, GCHQ,
The Illuminati, the Bilderbergers, the Freemasons,
The Trilateral Commission, The Federal Reserve,
the Nephilim, the Annunaki, the Reptoids,
the Greys, the Blues and the Flying Elvii
are ALL in an uproar right now and ATS
has a heads up on all the intelligence booty!

The THREE GIGABYTE Wikileaks Insurance File
is ABOUT TO BE BROKEN and its password
posted here... if its all true of course!

The Breaking-AES-256-bit-encryption-algorithm that is!

Interesting but way over my head.

Not anymore, it did start last night when I was reading and participating in an article.

Everything worked fine (including other sites). I have 100 down and 26 up cable.

You can tell its happening to others too, when you begin to see more double posts. People hit reply and the upload stalls, so they hit reply twice and their post appears twice.

"Sorry, double post…"

originally posted by: Martin75
a reply to: Night Star

Please save ATS...You created a bunch of addicts! Lol

Bahahahaha! That's easy to do!

originally posted by: ratfintc
a reply to: Night Star

I have written the code for bots, spiders, and other indexing scripts and automatic crawlers of all sorts. They can take up a lot of site resources on large websites if no one bothers to write rules for their behavior. The crawlers and spiders that ignore these rules have to be IP banned if they do not behave. I run my spiders and bots through rotating proxies to index sites that deploy basic counter measures. Some are able to defeat my spiders and bot traffic. Most do not spend their resources effectively in order to block me. My clients pay me to get info for them from these connected sources. I do what I must to fulfill the contract. I mean no offense to the sites I target but I will fulfill my contract. Lets make a deal is my motto.

----

What we do on our sites is run/redirect all bot/crawler inquiries onto a separate
thread on other CPU cores that have access to a SECOND daily/weekly imaged copy
of the web pages database and NOT the main server copies. The bots get a version
that is at most a few hours old of the master web page indexes BUT they don't clog
up our main incoming user ports because those bot/crawler connections are forwarded
to the second server on secondary IP ports. This frees up bandwidth for more incoming
users. If you can live with your web pages NOT being indexed every few minutes then
create a second copy of your website on a 2nd server. Also you COULD if there is the
technical inclination to run all index queries on a GPU platform with pre-indexed pages
stored in VIDEO RAM of the GPU which can be IMMEDIATELY presented to the bots
and crawlers. This will completely reduce your main CPU usage by 50x because of
the REALLY FAST GPU being able to use it's stream processors to index to
individual characters in multiple strings of text SIMULTANEOUSLY!

I can't help you with your actual server-to-telco fibre connection
which I suspect is less than one gigabit per second but I have seen
US and Canadian telcos offer 40+-gigabit connections for a decent
price these days! There are places in USA and Canada
that offer MULTIPLE gigabit Ethernet lines for a ridicoulously
low price

Try these guys as a comparison:
www.broadconnect.ca...

the 10 Gigabits per sec option I thought wasn't a bad price
It depends if you can swing the monthly costs. Create multiple
servers with ONE 10 Gbps line each servicing a different part of
the country or quadrant of the world. Redirect all incoming ports
to the appropriate server is another thing to speed things up!

originally posted by: StargateSG7
Also you COULD if there is the
technical inclination to run all index queries on a GPU platform with pre-indexed pages
stored in VIDEO RAM of the GPU which can be IMMEDIATELY presented to the bots
and crawlers.

How much video RAM do you figure a site like ATS would need to do that?

Having no problems on ATS but my companies website is down.

a reply to: StargateSG7

Why on earth would you imagine ATS would have a need for 10gbps+ uplink? This isn't a streaming video site.

So, first let me say, I put DDoS attackers right up there with the Mossack Fonseca people in terms of the amount of character they have.

2nd, I love the idea of reviving the gear store! Not just ATS branded stuff, but also clever conspiray-related gear would be awesome. You know, Tshirts with smart-a$$ references to Bigfoot, Nessie, UFOs, political intrigue...yada yada.

Lastly... perhaps ATS could join a few of the more popular afilliate programs, and have just a couple of forums where the afilliate links are posted. I have seen hundreds of great books recvommended here... why not link to Amazon's afilliate program and earn a few % for every purchase from this site?

I believe ITunes has an afilliate program... I see great music posted from YT all the time... maybe place an afilliate link so users can purchas the music?

The number of people talking tech in this thread (without a clue) is too damn high! /meme

Considering malvertising (malware piggybacking on advertising networks) has only gotten more popular I can't blame anybody for running adblock across the internet as a whole, its just too big of a risk not to anymore. As nice and generous as members donating may be it wont even dent the bills I imagine, I doubt any investors will put money into the site since last I heard money was drying up all over the tech world as talk of another bubble bursting has been making the rounds and a website is going to be a lot harder to sell than some new gizmo or widget. In short ATS will have to come up with a way to generate money besides browbeating people for protecting themselves online or face extinction.

a reply to: Helig

I hope your more than plausible points get their due consideration.

Thanks.

originally posted by: Arbitrageur

originally posted by: StargateSG7
Also you COULD if there is the
technical inclination to run all index queries on a GPU platform with pre-indexed pages
stored in VIDEO RAM of the GPU which can be IMMEDIATELY presented to the bots
and crawlers.

How much video RAM do you figure a site like ATS would need to do that?

===

With ATS having ABOUT 5 million indexed pages using probably
about 200 index keys per page using a 64-bit hash for each of
the indexed strings and a 64-bit value that represents a file
offset value in a given set of web pages, that is only
about 16 gigabytes right there.

An AMD S9150 has 32 gigabytes of VRAM!

I will guess around 16 to 32 Gigabytes would be a good start
for GPU VRAM based string indexing. Our own systems are
MUCH MUCH LARGER than ATS's into the DOUBLE-DIGIT
EXABYTE RANGE NOW where our index tables START AT
128 Gigabytes and go into nearly a PetaByte in size where
we index to pixel blocks in multi-petabyte size video streams
and geomapping systems where each micro-tile is
512 by 512 pixels and the larger geomap images
are 256,000 by 256,000 pixels (32 bit RGBA
compressed to Wavelet for storage but tiled
RGBA32 for live use)

Most of our own servers already have over a Terabyte
just in main system RAM and then you add multiple
AMD S9150 GPU cards --- You could do the same type of setup!

ATS is NOT a very big site compared to others!
A few GPU cards in a server could make a
HUGE difference in string indexing.
Your SQL version has to support GPU indexing though!

You COULD recompile MySQL to support GPU based
string storage and indexing...heck I would go as far
as compiling it right into a Linux kernel basically doing
what Oracle does on their monster-size DBMS
(DataBase Management System) servers.

While ours is a proprietary commercial solution
using GPU-string storage and indexing, there are
open source versions of what we do!

originally posted by: pl3bscheese
a reply to: StargateSG7

Why on earth would you imagine ATS would have a need for 10gbps+ uplink? This isn't a streaming video site.

---

Sorry! I keep forgetting that!

We work with 2k, 4k and 8k video a lot so our
data uplinks are Akamai-sized, sometimes
even leasing dark fibre across the country
(Canada) to support 4k and 8k video at
60 fps and above real-time.

I keep think text and video are the same thing
when it comes to servers, so I tend to scale for
the worst-case scenario. Heck! Even multiple
OC-768 lines just ain't enough bandwidth
these days for 4k/8k video!

originally posted by: StargateSG7

originally posted by: ratfintc
a reply to: Night Star

I have written the code for bots, spiders, and other indexing scripts and automatic crawlers of all sorts. They can take up a lot of site resources on large websites if no one bothers to write rules for their behavior. The crawlers and spiders that ignore these rules have to be IP banned if they do not behave. I run my spiders and bots through rotating proxies to index sites that deploy basic counter measures. Some are able to defeat my spiders and bot traffic. Most do not spend their resources effectively in order to block me. My clients pay me to get info for them from these connected sources. I do what I must to fulfill the contract. I mean no offense to the sites I target but I will fulfill my contract. Lets make a deal is my motto.

----

What we do on our sites is run/redirect all bot/crawler inquiries onto a separate
thread on other CPU cores that have access to a SECOND daily/weekly imaged copy
of the web pages database and NOT the main server copies. The bots get a version
that is at most a few hours old of the master web page indexes BUT they don't clog
up our main incoming user ports because those bot/crawler connections are forwarded
to the second server on secondary IP ports. This frees up bandwidth for more incoming
users. If you can live with your web pages NOT being indexed every few minutes then
create a second copy of your website on a 2nd server. Also you COULD if there is the
technical inclination to run all index queries on a GPU platform with pre-indexed pages
stored in VIDEO RAM of the GPU which can be IMMEDIATELY presented to the bots
and crawlers. This will completely reduce your main CPU usage by 50x because of
the REALLY FAST GPU being able to use it's stream processors to index to
individual characters in multiple strings of text SIMULTANEOUSLY!

^^^^^^^^^^ THIS!!!! ^^^^^^^^

This information and assistance right here would cost a LOT of money!!!

This is excellent advice!

I honestly don't see how 15 reqs/s of database queries is significantly holding up the system, or why it would require exotic tech like SG7 is mentioning. Admin made it clear it was about ad-blockers and ddos. The ad-blocking is likely a reaction to the consequence of being black-listed from Google, which lead to the intrusiv ads to generate the equivalent revenue lost when dropped.

originally posted by: pl3bscheese
I honestly don't see how 15 reqs/s of database queries is significantly holding up the system, or why it would require exotic tech like SG7 is mentioning. Admin made it clear it was about ad-blockers and ddos. The ad-blocking is likely a reaction to the consequence of being black-listed from Google, which lead to the intrusiv ads to generate the equivalent revenue lost when dropped.

===

If I were to look at ATS website statistics I would PROBABLY FIND OUT that
Server PCI-BUS, Disk-to-Memory and Internal Communications is probably
NOT THE ISSUE --- I am going to go out on a limb here and say that the
handling of INDIVIDUAL USER packets that are held up in lineups
waiting for further processing is what the issue is.

By that, I think the only thing needed on an IMMEDIATE BASIS is adding
TWO network cards that have onboard TCP/IP/Packet Inspection processors
to your servers ($500 to $1000 each) One card ONLY handles the INCOMING
DATA REQUESTS on one IP Address and the OTHER CARD SENDS THE
DATA OUT TO THE CLIENT MACHINES from a SECOND IP ADDRESS.

The technology is called a TCP OffLoad Engine:

en.wikipedia.org...

Awesome Coprocessor-based Network Cards STARTING from $595 up to $2000+:
en.wikipedia.org...
www.chelsio.com...

Change to these cards and you will see AT LEAST a 25% increase
in AVERAGE SPEED over a 24 hour period just because the CPU
if REMOVED from handling IP address and port change requests.

The OTHER ISSUE is the Website NEEDS a separate server
(even a $1500 Best Buy cheapie computer) to handle the
Bots and Crawlers doing website indexes.

Present PRE-COMPILED web-page index lists to the
bots and crawlers and 1/3rd of your daily bandwidth
will be recovered. SO WHAT if the search engines
get a copy of the website that is 4 to 12 hours old!

Redirect all Bot and Index queries to the 2nd server
and save yourself the bandwidth of the main server
for users.

So for probably LESS THAN $4000 of server and
TCP/IP offload network card investment you can
save 33% of your gross bandwidth hours for
users and advertisers!

AND FINALLY if you can spend another $4000
get a THIRD server that grabs ads from your
partners and serves them DIRECTLY FROM
YOUR WEBSITE. What happens is that
ATS USER CONTENT gets sent FIRST
from the main server so the user
FEELS LIKE they're getting fast
response times.

Your webpage THEN asks
the THIRD ATS server to serve up
ads FROM YOUR AD SERVER IP ADDRESS ONLY.
This basically divides up the highway
(i.e. your total telco bandwidth)
into three lanes where Mainserver = user content,
2nd Server = Copy of website for bots and crawlers,
3rd Server = Asynchronously Serves up ads to user web pages.
The three lanes never interfere with each other
because the website functions are separated out.

The thing you WILL have to change on ATS web pages
is that the ads NEED to reference the 3rd ad server at
YOUR OWN ATS IP address and NOT of the 3rd party
ad provider which may be at a SLOWER and more
interference-prone web address.

The REASON why ATS is slow is that ads are
INTERFERING with the ACTUAL DISPLAY of
user content. Serve up the user content FIRST
with the Main Server Web Pages and then fill in
the blanks of the advertising banner areas
on a user's loaded ATS content using
ASYNCHRONOUS communications from
the ATS 3rd ADVERTISING server on an
IP port DIFFERENT from the HTML
port 80/8080. This ensures that users
who have MULTIPLE web browser pages
up and running onscreen don't all try
and use the same internet standard of
Port 80 or 8080 as the main web page
or ad pages communications highway.

This setup will keep your users and
advertisers happy AND save you
bandwidth costs.