This is a new one....
- Crusty
- Virtuoso
- Posts: 2324
- Joined: Sun 15 Jan 2006 04:52 PM
- Location: Absolute Stupidity, Missouri
- Contact:
This is a new one....
Got a "resource limit is reached" error trying to open the forums. Anyone else getting this?
Re: This is a new one....
I've seen it a few times recently.
Quality service since 3:00 last Tuesday
-
- Virtuoso
- Posts: 285
- Joined: Mon 19 Apr 2021 07:23 AM
Re: This is a new one....
Yes, I think it started for me on Tuesday
- Crusty
- Virtuoso
- Posts: 2324
- Joined: Sun 15 Jan 2006 04:52 PM
- Location: Absolute Stupidity, Missouri
- Contact:
Re: This is a new one....
I checked our disk and bandwidth usage and we are within limits. If it happens again to you before it does me try to get a screenshot or copy the text. Post the text and if screenshot I can give you an email address to send the screenshot to.
- Barry
- Virtuoso
- Posts: 4039
- Joined: Wed 29 Apr 2009 12:32 PM
- Location: St. Catharines, Ontario Canada
- Contact:
Re: This is a new one....
Yup!
Been getting it regularly for a few days, including just before I managed to login now.
Text message only, no server error number, just try again later.
Been getting it regularly for a few days, including just before I managed to login now.
Text message only, no server error number, just try again later.
"A little song, a little dance. A little seltzer down your pants." -Chuckles the Clown
Guitars: https://legend.barryeames.com
Music/Pix/Videos: https://getback.barryeames.com
Guitars: https://legend.barryeames.com
Music/Pix/Videos: https://getback.barryeames.com
- Crusty
- Virtuoso
- Posts: 2324
- Joined: Sun 15 Jan 2006 04:52 PM
- Location: Absolute Stupidity, Missouri
- Contact:
Re: This is a new one....
Well, I tracked down the issue and of course Webline was zero help. They SHOULD have seen the problem long before I found it.
RAM and CPU were maxed out so I couldn't get in to take the models section offline to troubleshoot. I grabbed the raw server logs and wham, it was staring me in the face. YandexBot (Russian) was literally hammering the site! They were grabbing EVERYTHING and not being nice about it. Multiple requests from numerous IPs per second. The SQL server just couldn't keep up. Fortunately they do obey the robots.txt file and once I disallowed them the issue went away in seconds. I tried to tell Webline there is no way in h-e-double toothpics we could eat up that much resources. Instead they suggested I contact a web developer to look into the problem. What am I, chopped liver?
Moral of the story: Don't bother asking the experts, you probably know more than they do anyway.
RAM and CPU were maxed out so I couldn't get in to take the models section offline to troubleshoot. I grabbed the raw server logs and wham, it was staring me in the face. YandexBot (Russian) was literally hammering the site! They were grabbing EVERYTHING and not being nice about it. Multiple requests from numerous IPs per second. The SQL server just couldn't keep up. Fortunately they do obey the robots.txt file and once I disallowed them the issue went away in seconds. I tried to tell Webline there is no way in h-e-double toothpics we could eat up that much resources. Instead they suggested I contact a web developer to look into the problem. What am I, chopped liver?
Moral of the story: Don't bother asking the experts, you probably know more than they do anyway.
- Barry
- Virtuoso
- Posts: 4039
- Joined: Wed 29 Apr 2009 12:32 PM
- Location: St. Catharines, Ontario Canada
- Contact:
Re: This is a new one....
Great customer service eh?
Bloody robots.
Glad that you were able to solve the problem, and lucky that the robot was obedient, or then what?!
Bloody robots.
Glad that you were able to solve the problem, and lucky that the robot was obedient, or then what?!
"A little song, a little dance. A little seltzer down your pants." -Chuckles the Clown
Guitars: https://legend.barryeames.com
Music/Pix/Videos: https://getback.barryeames.com
Guitars: https://legend.barryeames.com
Music/Pix/Videos: https://getback.barryeames.com
- Crusty
- Virtuoso
- Posts: 2324
- Joined: Sun 15 Jan 2006 04:52 PM
- Location: Absolute Stupidity, Missouri
- Contact:
Re: This is a new one....
He was probably smoking a Beedi at the time. Broken English.
Most major crawlers are fairly courteous. Google will grab a page or two then wait a while then another. Sometimes several days in between. Other literally scrape the site in a single go. Can you imagine how many pages they were grabbing per second to peg the CPU and RAM like that? Rapid fire.
Since the CPU and RAM were pegged I couldn't get into the stats to see who was hitting the site but the raw logs were accessible and that's how I figured it out. Pages of them sending request after request. Log downloads wasn't hindered. But, that's about all I could do. I had them kill all the PIDS connected to the site but that only stopped it for a little while.
Most major crawlers are fairly courteous. Google will grab a page or two then wait a while then another. Sometimes several days in between. Other literally scrape the site in a single go. Can you imagine how many pages they were grabbing per second to peg the CPU and RAM like that? Rapid fire.
Since the CPU and RAM were pegged I couldn't get into the stats to see who was hitting the site but the raw logs were accessible and that's how I figured it out. Pages of them sending request after request. Log downloads wasn't hindered. But, that's about all I could do. I had them kill all the PIDS connected to the site but that only stopped it for a little while.