[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[EP-tech] Apache log getting a lot of errors and Mysql Going away



Yep - something that regular looks very much like a robot!

I would investigate the access logs - and try to match the entries in the error log with requests. The timestamps might not match up exactly - but you should be able to see the same patterns.
In the error log you just get /eprints3/cgi/exportview - but in the access log you should get e.g. /cgi/exportview/[VIEWID]/[VALUE]/[Export Format]/[filename]

You should be able to see what is being requested. You can see how quickly the request responds for you (and also if there are things you can do to speed it up).

Try (note spaces around the 500!):
> grep 'exportview' [APACHE ACCESS LOG] | grep ' 500 ' 

The XML generated from an 'export' of a view can be quite large, and also take quite a while to process.

Cheers,
John


-----Original Message-----
From: eprints-tech-bounces at ecs.soton.ac.uk [mailto:eprints-tech-bounces at ecs.soton.ac.uk] On Behalf Of Yuri
Sent: 28 March 2017 09:37
To: eprints-tech at ecs.soton.ac.uk
Subject: Re: [EP-tech] Apache log getting a lot of errors and Mysql Going away

Seems like search engines, tryng to export something huge.

The 

Il 27/03/2017 20:21, Mathieu Perron ha scritto:
>
> Hi all,
>
> Thank you for your advice.  I have noticed something in my error log.  
> The "connection abort" errors always happen at the same intervals.
>
> Here's a look at a part of my log:
>
> [Mon Mar 27 13:38:11 2017] [error] Software caused connection abort at 
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:39:55 2017] [error] Software caused connection abort at 
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:40:10 2017] [error] Software caused connection abort at 
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:41:55 2017] [error] Software caused connection abort at 
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:42:11 2017] [error] Software caused connection abort at 
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:43:54 2017] [error] Software caused connection abort at 
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:44:10 2017] [error] Software caused connection abort at 
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:45:53 2017] [error] Software caused connection abort at 
> /eprints3/cgi/exportview line 108.\n
>
> [Mon Mar 27 13:46:10 2017] [error] Software caused connection abort at 
> /eprints3/cgi/exportview line 108.\n
>
> There's 2 recurring time gaps (1 min 45 secs then 15 secs then it 
> starts over.)
>
> I'm a little lost where I should look to pinpoint what is causing this.
>
> I looked at my crons jobs and nothing there.
>
> All help is appreciated!
>
> Thank you again!
>
> *Mathieu Perron*
> Charg? de projet informatique et technologique
>
> *De :*eprints-tech-bounces at ecs.soton.ac.uk 
> [mailto:eprints-tech-bounces at ecs.soton.ac.uk] *De la part de* Matthew 
> Kerwin
> *Envoy? :* 27 mars 2017 07:06
> *? :* eprints-tech at ecs.soton.ac.uk
> *Objet :* Re: [EP-tech] Apache log getting a lot of errors and Mysql 
> Going away
>
> Yeah, for what it's worth we've had a history of these sorts of 
> errors. Eventually I resolved a lot of it by reducing the number of 
> Apache processes and recycling them a little more aggressively.  In 
> our case, it was a choice between: a few failed connects, or a lot of 
> successful connects that don't go anywhere.
>
> Your mileage may vary, of course.
>
> Cheers
>
> -- 
>
> *Matthew**Kerwin*  |Senior Web Developer|Applications & 
> Development<https://wiki.qut.edu.au/display/lib/Digital+Repository+Team>
>
> ------------------------------------------------------------------------
>
> *From:*eprints-tech-bounces at ecs.soton.ac.uk 
> <mailto:eprints-tech-bounces at ecs.soton.ac.uk> 
> <eprints-tech-bounces at ecs.soton.ac.uk 
> <mailto:eprints-tech-bounces at ecs.soton.ac.uk>> on behalf of Yuri 
> <yurj at alfa.it <mailto:yurj at alfa.it>>
> *Sent:* 27 March 2017 17:03
> *To:* eprints-tech at ecs.soton.ac.uk <mailto:eprints-tech at ecs.soton.ac.uk>
> *Subject:* Re: [EP-tech] Apache log getting a lot of errors and Mysql 
> Going away
>
> I think it happens when you've a lot of connections on mysql. Rise up
> the number of connection in mysql and use some script in a cronjob to
> check if mysql has gone away and notify you.
>
> The problem can go even worse when you've a lot of Apache threads and it
> eats al the RAM available, you've to rise or lower the apache threads
> according to the load.
>
>
> Il 24/03/2017 19:26, Mathieu Perron ha scritto:
> >
> > Hi,
> >
> > We are using ePrints v3.3.13 and lately we have been experiencing some
> > crashes due to MySQL going away.  I looked in the Apache log and I see
> > a lot of the following errors:
> >
> > "[error] Software caused connection abort at /eprints3/cgi/exportview
> > line 108.\n"
> >
> > I looked at the cgi script and searched in the files and this script
> > has something to do with the Views.pm module.  I can't seem to make
> > the error happen on demand and I'm wondering if anyone could help me
> > with this.  I don't know if the MySQL server going away is related to
> > these errors or not.
> >
> > Thank you for your time!
> >
> > *Mathieu Perron*
> > Charg? de projet informatique et technologique
> >
> >
> > Service des technologies de l'information
> > Universit? du Qu?bec ? Chicoutimi
> > 555, boul. de l'Universit?
> > Chicoutimi (Qu?bec) G7H 2B1
> >
> > *Mathieu_Perron at uqac.ca* <mailto:*Mathieu_Perron at uqac.ca*> 
> <mailto:Mathieu_Perron at uqac.ca>
> >
> >
> >
> > *logo uqac* <http://www.uqac.ca/>
> >
> > Le pr?sent document (y compris les pi?ces qui y sont annex?es, le cas
> > ?ch?ant) s'adresse au destinataire indiqu? et peut contenir des
> > renseignements de caract?re priv? ou confidentiel. Si vous n'?tes pas
> > le destinataire de ce document, nous vous signalons qu'il est
> > strictement interdit de le diffuser, de le distribuer ou de le
> > reproduire. Si ce message vous a ?t? transmis par erreur, veuillez en
> > informer l'exp?diteur et le supprimer imm?diatement. Avant d'imprimer,
> > pensez ? l'environnement!
> >
> >
> >
> > *** Options: 
> http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
> > *** Archive: http://www.eprints.org/tech.php/
> > *** EPrints community wiki: http://wiki.eprints.org/
> > *** EPrints developers Forum: http://forum.eprints.org/
>
>
> *** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
> *** Archive: http://www.eprints.org/tech.php/
> *** EPrints community wiki: http://wiki.eprints.org/
> *** EPrints developers Forum: http://forum.eprints.org/
>
>
>
> *** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
> *** Archive: http://www.eprints.org/tech.php/
> *** EPrints community wiki: http://wiki.eprints.org/
> *** EPrints developers Forum: http://forum.eprints.org/


*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
*** Archive: http://www.eprints.org/tech.php/
*** EPrints community wiki: http://wiki.eprints.org/
*** EPrints developers Forum: http://forum.eprints.org/