[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[EP-tech] File Size Limit



Hi David,

I managed to find a timeout value buried away in Apache and it was set for
300 seconds. I think my problem came from the user doing big(ish) uploads
from off-campus. In the end I asked the user to send me their files and I
uploaded them. The only one that timed out was one at 1.6GB and that was
after three minutes I checked it three times and this was consistent). I
think it might be something on the Elements side of it. In the end I
uploaded a smaller fake file with the same name and then switched it over
manually on the server and tweaked very small parts of the database such as
the file size.

Anyway, it all got sorted and the mystery shall remain mysterious for now...

Thanks for all your help!

James

On Mon, Jul 8, 2019 at 2:48 PM Newman D.R. <drn at ecs.soton.ac.uk> wrote:

> Hi James,
>
> A limit of 150MB is possible but that does not sound like a limit that
> would be set as a default anywhere in EPrints, so it would be something
> set specifically by someone configuring your repository if at all.  The
> timeout certainly sounds like the most likely issue, especially when
> the client (Elements) or the server (EPrints/Apache) may be employing a
> timeout.
>
> Regards
>
> David Newman
>
> On Mon, 2019-07-08 at 13:57 +0100, James Kerwin wrote:
> > Hi David,
> >
> > Thanks for the pointers. I had done those greps, so it's a relief
> > they were suggested. Unfortunately they've not returned anything.
> >
> > I think the timeout is my next one to check.
> >
> > One of the users files was 142.5 MB which went on with no problem,
> > the one not going on is 171 MB. I would guess the limit exists
> > somewhere between those two values. It might be a setting in
> > Elements, but I've looked over the RT1 connection settings and
> > there's nothing there screaming out at me.
> >
> > In the very worst case I'll bodge it by putting the files on the
> > server and meticulously updating the database, but I REALLY don't
> > want to do that.
> >
> > Thanks for your help, it's really appreciated.
> >
> > James
> >
> > On Mon, Jul 8, 2019 at 12:48 PM Newman D.R. <drn at ecs.soton.ac.uk>
> > wrote:
> > > Hi James,
> > >
> > > As you will circumvent any Javascript on the upload form that will
> > > restrict the file size of your upload.  As you do not have an
> > > upload.pl
> > > then you should not have this restriction.  Although it may appear
> > > somewhere else, so it is worth grepping for "upload_limit" in your
> > > archive's cfg/ and cgi/ directories and core directories under the
> > > EPrints path such as lib, perl_lib (site_lib, if you have it) and
> > > cgi.
> > >
> > > I am not aware of anywhere else in 3.3.12+ EPrints that would
> > > restrict
> > > your max upload limit.  That said, Apache 2.4.x does not have any
> > > max
> > > upload limit set by default as far as I am aware.  LimitRequestBody
> > > is
> > > the only option that might be an issue but the default is to set no
> > > limit.
> > >
> > > What is the size of file you are having problems with and what is
> > > the
> > > biggest file you can successfully upload?  What sort of time are
> > > these
> > > files taking to upload? As it could be a timeout issue.
> > >
> > > Regards
> > >
> > > David Newman
> > >
> > > On Mon, 2019-07-08 at 12:13 +0100, James Kerwin via Eprints-tech
> > > wrote:
> > > > Hi All,
> > > >
> > > > Our setup is Elements feeding Eprints via RT1.
> > > >
> > > > Somebody is attempting to upload some larger-then-usual files and
> > > > we're having difficulty getting them to upload. I'm assuming it's
> > > due
> > > > to the file size and that there's a limit somewhere. We don't
> > > have an
> > > > upload.pl in the local repo config. I've looked at the usual
> > > > locations in the Apache config and can't find anything.
> > > >
> > > > If my hunch about the file size limit is correct, where should I
> > > > look? the EPrints side of things or Apache?
> > > >
> > > > Thanks,
> > > > James
> > > > *** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/epri
> > > nts-
> > > > tech
> > > > *** Archive: https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C93a4b648ddf840f87a0a08d70478d8ab%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=Jvs%2BaRRoJOlRMcn56fj4Bj7o7o87nZ2dBReMkiQDebU%3D&amp;reserved=0
> > > > *** EPrints community wiki: https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C93a4b648ddf840f87a0a08d70478d8ab%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=qEH2mo%2BS%2B143zWh7y9p38KG1oQgdw49o9evinE4%2BrFY%3D&amp;reserved=0
> > > > *** EPrints developers Forum: https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fforum.eprints.org%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C93a4b648ddf840f87a0a08d70478d8ab%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=4ws24zsu6%2BoTPCqv8sSYeK27fOSBqiMxlDRQtKnsNVM%3D&amp;reserved=0
> > >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ecs.soton.ac.uk/pipermail/eprints-tech/attachments/20190709/8c1059ba/attachment.html