[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[EP-tech] Re: Eprints Server Freezes Often



Il 22/05/2012 08:43, Francis Jayakanth ha scritto:
> On Mon, 21 May 2012, Yuri wrote:
>
>> Lower the number of child and forked processes in apache config. The
>> default config is usual for static pages. For example I've:
>>
>> <IfModule mpm_prefork_module>
>>      StartServers          4
>>      MinSpareServers       2
>>      MaxSpareServers       8
>>      MaxClients           30
>>      MaxRequestsPerChild  1000
>> </IfModule>
>>
>> It seems to work quite well. Also, I had to install mod_bw in apache to
>> limit the max number of connection from the same ip, to calm down search
>> engines and bots that download every pdf they find in the world... :-)
>>
> Thanks, Yuri, for the suggestions. I have incorporated the above changes
> in the apache config file. Keeping a watch on the web server behaviour.
> Will let the list know if the changes made to the apache config file is
> helping us or not.
>
> Also, I have noticed that the following error message has been reported
> quite often in the web server error log file:
>
> -----------------EPrints System Error ----------------------------
> Error connecting to MySQL server: Too many connections. To fix this
> increase max_connections in my.cnf:
>
> [mysqld]
> max_connections=300
>
> ------------------------------------------------------------------
>
> Should I incorporate the above 'mysqld' directive or will the changes made
> in the apache config take care of the MySQL error?

if they happens again, yes. But I think they're related to many 
connections you've.

  This are my my.cnf modifications for tuning:

key_buffer     = 16M
max_allowed_packet   = 16M
thread_stack      = 128K
thread_cache_size = 40
table_cache = 1024

# * Query Cache Configuration <- I don't know if this 2 are already default
#
query_cache_limit       = 1M
query_cache_size        = 16M


you can see how many queries your mysql is processing doing this:

show processlist;

opening mysql client. Then you can see how much loaded your mysql is.



>
> Thanks once again.
>
>    - Francis
>
> JRDTML, IISc
> Bengaluru, India
>
> eprints.iisc.ernet.in
>
>
>> Il 19/05/2012 13:22, Francis Jayakanth ha scritto:
>>> Dear Members, Our eprints server freezes (stops responding) almost every
>>> week or so. The only solution to bring up the server again is to do a hard
>>> boot.
>>>
>>> I have looked into the Web Server error log file and find that around the
>>> time the system freezes, the following error is recorded in the error log
>>> file:
>>>
>>> [Thu May 18 06:10:05 2012] [error] (12)Cannot allocate memory: fork:
>>> Unable to fork new process
>>>
>>> So, the obvious reason for the system freeze is, the system is running
>>> out of main memory. Once the server is re-booted, everything is back to
>>> normal, but with the passage of time, the free memory keeps gradually
>>> dropping.
>>>
>>> The 'top' command issued right ofter the re-boot, gives the
>>> following output:
>>>
>>> top - 12:41:49 up 2 days, 55 min,  1 user,  load average: 0.90, 0.52, 0.35
>>> Tasks: 167 total,   1 running, 166 sleeping,   0 stopped,   0 zombie
>>> Cpu(s):  1.1%us,  0.2%sy,  0.0%ni, 97.3%id,  1.3%wa,  0.0%hi,  0.0%si,
>>> 0.0%st
>>> Mem:   4051536k total,  1162736k used,  2888800k free,    23300k buffers
>>> Swap:  8193108k total,   378836k used,  7814272k free,   438404k cached
>>>
>>> Over the period of few hours, the the usage of the main memory gradually
>>> goes up.
>>>
>>> The output of the 'top' command after 3 hours is:
>>>
>>> top - 15:42:07 up 2 days,  4:02,  1 user,  load average: 0.23, 0.22, 0.18
>>> Tasks: 173 total,   1 running, 172 sleeping,   0 stopped,   0 zombie
>>> Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 99.6%id,  0.4%wa,  0.0%hi,  0.0%si,
>>> 0.0%st
>>> Mem:   4051536k total,  3048740k used,  1002796k free,   129020k buffers
>>> Swap:  8193108k total,   378828k used,  7814280k free,   796732k cached
>>>
>>> For a time gap of 3 hours, the free memory size has come down from
>>> 2888800k to 1002796k. The drop will continue over the period of time and
>>> eventually, the system freezes.
>>>
>>> I restarted the apache server after about 3 hours and the output of the
>>> 'top' command is:
>>>
>>> top - 15:52:59 up 2 days,  4:07,  1 user,  load average: 0.11, 0.14, 0.16
>>> Tasks: 168 total,   1 running, 167 sleeping,   0 stopped,   0 zombie
>>> Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 99.6%id,  0.4%wa,  0.0%hi,  0.0%si,
>>> 0.0%st
>>> Mem:   4051536k total,  1686412k used,  2365124k free,   130712k buffers
>>> Swap:  8193108k total,   378820k used,  7814288k free,   801620k cached
>>>
>>> More than 1.3 GB of memory has been freed after restarting the apache
>>> server.
>>>
>>> How do I ensure that memory level doesn't gradually drop and eventually
>>> cause the server to freeze? Should something be done at the apache
>>> configuration level?
>>>
>>> Any help/pointers to overcome the said problem will of great help to us.
>>>
>>> We have recently upgraded our eprints software from eprints-3.2.8 to
>>> eprints-3.3.9. The above behaviour was very much there with the 3.2.8
>>> version as well.
>>>
>>> Apache Server version: Apache/2.2.3 on 64-bit RHES
>>>
>>> Many thanks in advance for your attention.
>>>
>>>
>>>     - Francis
>>>
>>> JRD Tata Memorial Library
>>> IISc, Bengaluru, India
>>>
>> *** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
>> *** Archive: http://www.eprints.org/tech.php/
>> *** EPrints community wiki: http://wiki.eprints.org/
>>
>> -- 
>> This message has been scanned for viruses and
>> dangerous content by MailScanner, and is
>> believed to be clean.
>>