Last month https://war.coffee‘s world-class firewall permanently blocked 250,000 bots from visiting the site.
In May I realized in today’s battlespace of big tech tyranny it is critical to block all bots.
Once I postured https://war.coffee to ‘block all bots’ something amazing happened: Google began sending more advanced bots which were not being blocked and I was still able to read all of the information about the bot from my firewall’s control panel.
In the User Agent field of my firewall’s bot description it said something to the effect of “This such and such bot scans the global internet multiple times a day.”
And after further research I discovered, indeed, these bots were CIA/NSA technology being used explicitly, publicly, not even trying to hide the fact, for so-call domestic terrorism mitigation–etc.
On top of that those bots are plugged into the Twitter algorithms which also steer events and perceptions in real-time across the information battlespace.
So what did I do? Because I have encountered several of these bots now.
I wrote custom code to catch and block all of those bots.
I still discover new bots every few days but it is mostly stopped.
Deep web means only smart humans with special instructions or permissions can access the information.
We are going there.