xovibot

This is a message forum open to the public to make comments about Quatloos! and for suggestions meant to improve the website.
User avatar
wserra
Quatloosian Federal Witness
Quatloosian Federal Witness
Posts: 7548
Joined: Sat Apr 26, 2003 6:39 pm

xovibot

Post by wserra »

The board has been lagging somewhat over the last several days, at least for me. When that happened, it seemed as though frequently there were a large number of guests. Just now there were 43. About 25 of them were iterations of the xovibot crawler. Rude behavior. Moreover, most of them were actually shown as "replying to message".

WTF? Is it time to keep these obnoxious bots off the board? web?
"A wise man proportions belief to the evidence."
- David Hume
User avatar
wserra
Quatloosian Federal Witness
Quatloosian Federal Witness
Posts: 7548
Joined: Sat Apr 26, 2003 6:39 pm

Re: xovibot

Post by wserra »

And now - two minutes later - every one of them is gone. There are a handful of baidu spiders, but at least they're reading. Strange, no? Almost looks like a DOS.
"A wise man proportions belief to the evidence."
- David Hume
fortinbras
Princeps Wooloosia
Posts: 3144
Joined: Sat May 24, 2008 4:50 pm

Re: xovibot

Post by fortinbras »

I am going to wait for a translation into English.
User avatar
The Observer
Further Moderator
Posts: 7502
Joined: Thu Feb 06, 2003 11:48 pm
Location: Virgin Islands Gunsmith

Re: xovibot

Post by The Observer »

"I could be dead wrong on this" - Irwin Schiff

"Do you realize I may even be delusional with respect to my income tax beliefs? " - Irwin Schiff
User avatar
webhick
Illuminati Obfuscation: Black Ops Div
Posts: 3994
Joined: Tue Jan 23, 2007 1:41 am

Re: xovibot

Post by webhick »

Rude little data aggregator. We had a similar problem with 80legs. I added it to the bot list. It usually clears up after they crawl the whole site.

Also, the whole "replying to post" thing is simply because it's following every stupid link. Rude.
When chosen for jury duty, tell the judge "fortune cookie says guilty" - A fortune cookie
User avatar
wserra
Quatloosian Federal Witness
Quatloosian Federal Witness
Posts: 7548
Joined: Sat Apr 26, 2003 6:39 pm

Re: xovibot

Post by wserra »

Now we've got 30 or so Ahrefs. When you get a second, web, please throw them in the bot list as well. Better yet, if I can do it without the risk of FUBARing the board, tell me how.

Thanks.
"A wise man proportions belief to the evidence."
- David Hume
Philistine
Admiral of the Quatloosian Seas
Admiral of the Quatloosian Seas
Posts: 274
Joined: Mon Apr 06, 2015 11:43 pm
Location: Turtle Island

Re: xovibot

Post by Philistine »

Look up robots.txt for your public-html (www) root directory...
You can define user-agents (bots) and directories to omit from scan by bots.
User avatar
webhick
Illuminati Obfuscation: Black Ops Div
Posts: 3994
Joined: Tue Jan 23, 2007 1:41 am

Re: xovibot

Post by webhick »

Philistine wrote:Look up robots.txt for your public-html (www) root directory...
You can define user-agents (bots) and directories to omit from scan by bots.
We only block malicious bots, like the screen scraper from a few years back. Others, we add to the phpbb bots list so it doesn't muddy the waters.
When chosen for jury duty, tell the judge "fortune cookie says guilty" - A fortune cookie