xovibot

This is a message forum open to the public to make comments about Quatloos! and for suggestions meant to improve the website.
User avatar
wserra
Quatloosian Federal Witness
Quatloosian Federal Witness
Posts: 6364
Joined: Sat Apr 26, 2003 7:39 pm

xovibot

Postby wserra » Tue Dec 29, 2015 12:49 pm

The board has been lagging somewhat over the last several days, at least for me. When that happened, it seemed as though frequently there were a large number of guests. Just now there were 43. About 25 of them were iterations of the xovibot crawler. Rude behavior. Moreover, most of them were actually shown as "replying to message".

WTF? Is it time to keep these obnoxious bots off the board? web?
"A wise man proportions belief to the evidence."
- David Hume

User avatar
wserra
Quatloosian Federal Witness
Quatloosian Federal Witness
Posts: 6364
Joined: Sat Apr 26, 2003 7:39 pm

Re: xovibot

Postby wserra » Tue Dec 29, 2015 12:52 pm

And now - two minutes later - every one of them is gone. There are a handful of baidu spiders, but at least they're reading. Strange, no? Almost looks like a DOS.
"A wise man proportions belief to the evidence."
- David Hume

fortinbras
Princeps Wooloosia
Posts: 2982
Joined: Sat May 24, 2008 5:50 pm

Re: xovibot

Postby fortinbras » Tue Dec 29, 2015 3:33 pm

I am going to wait for a translation into English.

User avatar
The Observer
Further Moderator
Posts: 6653
Joined: Fri Feb 07, 2003 12:48 am
Location: Virgin Islands Gunsmith

Re: xovibot

Postby The Observer » Tue Dec 29, 2015 9:41 pm

"I could be dead wrong on this" - Irwin Schiff

"Do you realize I may even be delusional with respect to my income tax beliefs? " - Irwin Schiff

User avatar
webhick
Illuminati Obfuscation: Black Ops Div
Posts: 3880
Joined: Tue Jan 23, 2007 2:41 am

Re: xovibot

Postby webhick » Tue Dec 29, 2015 9:49 pm

Rude little data aggregator. We had a similar problem with 80legs. I added it to the bot list. It usually clears up after they crawl the whole site.

Also, the whole "replying to post" thing is simply because it's following every stupid link. Rude.
When chosen for jury duty, tell the judge "fortune cookie says guilty" - A fortune cookie

User avatar
wserra
Quatloosian Federal Witness
Quatloosian Federal Witness
Posts: 6364
Joined: Sat Apr 26, 2003 7:39 pm

Re: xovibot

Postby wserra » Sat Jan 16, 2016 11:09 pm

Now we've got 30 or so Ahrefs. When you get a second, web, please throw them in the bot list as well. Better yet, if I can do it without the risk of FUBARing the board, tell me how.

Thanks.
"A wise man proportions belief to the evidence."
- David Hume

User avatar
Philistine
Pirate Captain
Pirate Captain
Posts: 216
Joined: Tue Apr 07, 2015 12:43 am
Location: Turtle Island

Re: xovibot

Postby Philistine » Thu Nov 23, 2017 7:52 pm

Look up robots.txt for your public-html (www) root directory...
You can define user-agents (bots) and directories to omit from scan by bots.

User avatar
webhick
Illuminati Obfuscation: Black Ops Div
Posts: 3880
Joined: Tue Jan 23, 2007 2:41 am

Re: xovibot

Postby webhick » Fri Nov 24, 2017 5:49 pm

Philistine wrote:Look up robots.txt for your public-html (www) root directory...
You can define user-agents (bots) and directories to omit from scan by bots.


We only block malicious bots, like the screen scraper from a few years back. Others, we add to the phpbb bots list so it doesn't muddy the waters.
When chosen for jury duty, tell the judge "fortune cookie says guilty" - A fortune cookie


Return to “About Quatloos and Site Comments”

Who is online

Users browsing this forum: Common Crawl [Bot] and 0 guests