[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[EP-tech] Apache log getting a lot of errors and Mysql Going away
Hi John!
Thanks a lot for pointing this out! I checked the access log and found the culprit. Someone from another university here probably has a script or something that harasses our server every minute or so. It was trying to load an Atom and a RSS export on our thesis types.
I have contacted the said university so they can look it up and I have blocked the ip with iptables.
Thanks all for your help! This techlist rocks!
Have a nice day all!
Mathieu Perron
Charg? de projet informatique et technologique
Service des technologies de l'information?
Universit? du Qu?bec ? Chicoutimi
555, boul. de l'Universit?
Chicoutimi (Qu?bec) G7H 2B1
-----Message d'origine-----
De?: eprints-tech-bounces at ecs.soton.ac.uk [mailto:eprints-tech-bounces at ecs.soton.ac.uk] De la part de John Salter
Envoy??: 28 mars 2017 05:51
??: eprints-tech at ecs.soton.ac.uk
Objet?: Re: [EP-tech] Apache log getting a lot of errors and Mysql Going away
Yep - something that regular looks very much like a robot!
I would investigate the access logs - and try to match the entries in the error log with requests. The timestamps might not match up exactly - but you should be able to see the same patterns.
In the error log you just get /eprints3/cgi/exportview - but in the access log you should get e.g. /cgi/exportview/[VIEWID]/[VALUE]/[Export Format]/[filename]
You should be able to see what is being requested. You can see how quickly the request responds for you (and also if there are things you can do to speed it up).
Try (note spaces around the 500!):
> grep 'exportview' [APACHE ACCESS LOG] | grep ' 500 '
The XML generated from an 'export' of a view can be quite large, and also take quite a while to process.
Cheers,
John
-----Original Message-----
From: eprints-tech-bounces at ecs.soton.ac.uk [mailto:eprints-tech-bounces at ecs.soton.ac.uk] On Behalf Of Yuri
Sent: 28 March 2017 09:37
To: eprints-tech at ecs.soton.ac.uk
Subject: Re: [EP-tech] Apache log getting a lot of errors and Mysql Going away
Seems like search engines, tryng to export something huge.
The
Il 27/03/2017 20:21, Mathieu Perron ha scritto:
>
> Hi all,
>
> Thank you for your advice. I have noticed something in my error log.
> The "connection abort" errors always happen at the same intervals.
>
> Here's a look at a part of my log:
>
> [Mon Mar 27 13:38:11 2017] [error] Software caused connection abort at
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:39:55 2017] [error] Software caused connection abort at
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:40:10 2017] [error] Software caused connection abort at
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:41:55 2017] [error] Software caused connection abort at
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:42:11 2017] [error] Software caused connection abort at
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:43:54 2017] [error] Software caused connection abort at
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:44:10 2017] [error] Software caused connection abort at
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:45:53 2017] [error] Software caused connection abort at
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:46:10 2017] [error] Software caused connection abort at
> /eprints3/cgi/exportview line 108.\n
>
> There's 2 recurring time gaps (1 min 45 secs then 15 secs then it
> starts over.)
>
> I'm a little lost where I should look to pinpoint what is causing this.
>
> I looked at my crons jobs and nothing there.
>
> All help is appreciated!
>
> Thank you again!
>
> *Mathieu Perron*
> Charg? de projet informatique et technologique
>
> *De :*eprints-tech-bounces at ecs.soton.ac.uk
> [mailto:eprints-tech-bounces at ecs.soton.ac.uk] *De la part de* Matthew
> Kerwin *Envoy? :* 27 mars 2017 07:06 *? :*
> eprints-tech at ecs.soton.ac.uk *Objet :* Re: [EP-tech] Apache log
> getting a lot of errors and Mysql Going away
>
> Yeah, for what it's worth we've had a history of these sorts of
> errors. Eventually I resolved a lot of it by reducing the number of
> Apache processes and recycling them a little more aggressively. In
> our case, it was a choice between: a few failed connects, or a lot of
> successful connects that don't go anywhere.
>
> Your mileage may vary, of course.
>
> Cheers
>
> --
>
> *Matthew**Kerwin* |Senior Web Developer|Applications &
> Development<https://wiki.qut.edu.au/display/lib/Digital+Repository+Tea
> m>
>
> ----------------------------------------------------------------------
> --
>
> *From:*eprints-tech-bounces at ecs.soton.ac.uk
> <mailto:eprints-tech-bounces at ecs.soton.ac.uk>
> <eprints-tech-bounces at ecs.soton.ac.uk
> <mailto:eprints-tech-bounces at ecs.soton.ac.uk>> on behalf of Yuri
> <yurj at alfa.it <mailto:yurj at alfa.it>>
> *Sent:* 27 March 2017 17:03
> *To:* eprints-tech at ecs.soton.ac.uk
> <mailto:eprints-tech at ecs.soton.ac.uk>
> *Subject:* Re: [EP-tech] Apache log getting a lot of errors and Mysql
> Going away
>
> I think it happens when you've a lot of connections on mysql. Rise up
> the number of connection in mysql and use some script in a cronjob to
> check if mysql has gone away and notify you.
>
> The problem can go even worse when you've a lot of Apache threads and
> it eats al the RAM available, you've to rise or lower the apache
> threads according to the load.
>
>
> Il 24/03/2017 19:26, Mathieu Perron ha scritto:
> >
> > Hi,
> >
> > We are using ePrints v3.3.13 and lately we have been experiencing
> > some crashes due to MySQL going away. I looked in the Apache log
> > and I see a lot of the following errors:
> >
> > "[error] Software caused connection abort at
> > /eprints3/cgi/exportview line 108.\n"
> >
> > I looked at the cgi script and searched in the files and this script
> > has something to do with the Views.pm module. I can't seem to make
> > the error happen on demand and I'm wondering if anyone could help me
> > with this. I don't know if the MySQL server going away is related
> > to these errors or not.
> >
> > Thank you for your time!
> >
> > *Mathieu Perron*
> > Charg? de projet informatique et technologique
> >
> >
> > Service des technologies de l'information Universit? du Qu?bec ?
> > Chicoutimi 555, boul. de l'Universit? Chicoutimi (Qu?bec) G7H 2B1
> >
> > *Mathieu_Perron at uqac.ca* <mailto:*Mathieu_Perron at uqac.ca*>
> <mailto:Mathieu_Perron at uqac.ca>
> >
> >
> >
> > *logo uqac* <http://www.uqac.ca/>
> >
> > Le pr?sent document (y compris les pi?ces qui y sont annex?es, le
> > cas
> > ?ch?ant) s'adresse au destinataire indiqu? et peut contenir des
> > renseignements de caract?re priv? ou confidentiel. Si vous n'?tes
> > pas le destinataire de ce document, nous vous signalons qu'il est
> > strictement interdit de le diffuser, de le distribuer ou de le
> > reproduire. Si ce message vous a ?t? transmis par erreur, veuillez
> > en informer l'exp?diteur et le supprimer imm?diatement. Avant
> > d'imprimer, pensez ? l'environnement!
> >
> >
> >
> > *** Options:
> http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
> > *** Archive: http://www.eprints.org/tech.php/
> > *** EPrints community wiki: http://wiki.eprints.org/
> > *** EPrints developers Forum: http://forum.eprints.org/
>
>
> *** Options:
> http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
> *** Archive: http://www.eprints.org/tech.php/
> *** EPrints community wiki: http://wiki.eprints.org/
> *** EPrints developers Forum: http://forum.eprints.org/
>
>
>
> *** Options:
> http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
> *** Archive: http://www.eprints.org/tech.php/
> *** EPrints community wiki: http://wiki.eprints.org/
> *** EPrints developers Forum: http://forum.eprints.org/
*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
*** Archive: http://www.eprints.org/tech.php/
*** EPrints community wiki: http://wiki.eprints.org/
*** EPrints developers Forum: http://forum.eprints.org/
*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
*** Archive: http://www.eprints.org/tech.php/
*** EPrints community wiki: http://wiki.eprints.org/
*** EPrints developers Forum: http://forum.eprints.org/