[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[EP-tech] Message during process_stats IRStat2



Hi Izwan,

Just to clarify the process_stats script can be run in two different 
ways.? One is an initial setup that does various one time task and then 
processes all of the existing access table records.? The other is just 
doing an incremental update of stats for the previous day.? The latter 
should be done via a daily cron job in the eprints crontab.? If you are 
referring to running the initial setup way, then it might be worth 
regenerating the stats from scratch, as over time you may have had a lot 
of internal requests over the lifetime of your repository that would now 
not be marked as such in your usage stats.? However, I don't expect a 
regular EPrints repository to make that many internal (i.e. from the 
eprints server itself) requests. It would only be if you have some 
bespoke functionality running on your repository that will request 
abstract pages or download documents.? However, if you were referring to 
just running the incremental daily update method (for process_stats), 
assuming that increment is only a day or a few days, then re-running 
this will not make any difference and regenerating all the stats from 
scratch would not be worth it, as you probably have very little if any 
internal requests in this timeframe.

I get a bit of a feeling that you are not running the process_stats 
script on a daily basis to make these incremental updates.? Check the 
out the wiki page that explains about this and how to setup a cron job:

https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwiki.eprints.org%2Fw%2FIRStats2%23Processing&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492325223%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=Q6Vk8zL9yns5dVdDWcnT3JecKWcPBcdELWkmLzj%2BzOI%3D&reserved=0

Regards

David Newman

On 13/08/2021 13:12, MOHD.IZWAN SALIM wrote:
> *CAUTION:* This e-mail originated outside the University of Southampton.
> Dear David
>
> Should I apply the change and re-run the script?
>
> I already ran it for 2 days?
>
> Is there any different?stat after I apply the change?
>
> Regards
>
> *Izwan*
> *UiTM Digital Library
> *https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fir.uitm.edu.my%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492325223%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=u3KSX3%2FSVpld8fpyg8pg4RrV3ZjsJ%2FMzRjQMeP49ygs%3D&reserved=0 
> <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fir.uitm.edu.my%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492325223%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=HpRM%2Bax1L%2FakVSl0WMPq5IE8wTECvSGRagOsXPPsbH8%3D&amp;reserved=0>
>
>
> On Fri, Aug 13, 2021 at 4:45 PM David R Newman <drn at ecs.soton.ac.uk 
> <mailto:drn at ecs.soton.ac.uk>> wrote:
>
>     Hi Izwan,
>
>     Looking at the line of code that has the error:
>
>     One of the these to variables is not set.? As there is a
>     comparison involving $hostname further up in the file, it must be
>     $self->{host} that is not set.? This is earlier set from line 24:
>
>     $self->{host} = $self->{session}->config( "host" );
>
>     My suspicion is that you have reconfigured your repository to be
>     HTTPS only and there only set $c->{securehost} and not $c->{host}
>     in your archive's cfg/cfg.d/10_core.pl
>     <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2F10_core.pl%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=zs10RudwY9fz6l7hp%2BeeywyFu9%2Fh%2BtjiwRjs5Em6gO0%3D&amp;reserved=0>
>     (or some other config file in the same directory).? If $c->{host}
>     is set to undef this would also return the same error message
>     here.? To resolve this problem you should go to line 24 of
>     /usr/share/eprints/lib/plugins/EPrints/Plugin/Stats/Processor/Access/Referrer.pm
>     and add the following line after it:
>
>     $self->{host} ||= $self->{session}->config( "securehost" );
>
>     This will set $self->{host} to the config value of securehost if
>     there is no value set for host.? I have had to make various
>     amendments to EPrints to support the no $c->{host} set means HTTPS
>     only, so that it does not break things that expect it to always be
>     set. However, not setting $c->{host} seemed like the most
>     intuitive way to allow system administrators to know they have
>     configured their repository for HTTPS only.
>
>     Unfortunately, there has not been a new release of IRStats 2 since
>     these changes were baked into recent versions of EPrints 3.4.? In
>     part due to this only affecting those who configured there
>     repositories for HTTPS only in this way.
>
>     Regards
>
>     David Newman
>
>     On 13/08/2021 09:26, MOHD.IZWAN SALIM via Eprints-tech wrote:
>>     *CAUTION:* This e-mail originated outside the University of
>>     Southampton.
>>     Dear all, I just?migrated and upgraded EPrints 3.3.16 to 3.4.3.
>>     Everything worked fine until I ran the process_stat --setup for
>>     IRSTAT2.
>>
>>     The statistic is running (i guess) but it only shows message
>>     Use of uninitialized value in string eq at
>>     /usr/share/eprints/lib/plugins/EPrints/Plugin/Stats/Processor/Access/Referrer.pm
>>     line 84.
>>     Use of uninitialized value in string eq at
>>     /usr/share/eprints/lib/plugins/EPrints/Plugin/Stats/Processor/Access/Referrer.pm
>>     line 84.
>>     Use of uninitialized value in string eq at
>>     /usr/share/eprints/lib/plugins/EPrints/Plugin/Stats/Processor/Access/Referrer.pm
>>     line 84.
>>     Access: incremental commit to DB
>>
>>     I'm using mysql 8. I want to get rid of that message.
>>
>>     Regards
>>
>>     *Izwan*
>>     *UiTM Digital Library
>>     *https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fir.uitm.edu.my%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=Cwua8b3igYwAfnx%2B9BJAhl6mqh19IfSE2XretXjtkJw%3D&amp;reserved=0
>>     <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fir.uitm.edu.my%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=Cwua8b3igYwAfnx%2B9BJAhl6mqh19IfSE2XretXjtkJw%3D&amp;reserved=0>*
>>     *
>>
>>     *PENAFIAN: *E-mel ini dan apa-apa fail yang dihantar
>>     bersama-samanya ("Mesej") adalah dihasratkan hanya untuk kegunaan
>>     penerima yang dinyatakan di atas dan mungkin mengandungi maklumat
>>     yang tidak umum, bermilik, istimewa, sulit dan dikecualikan dari
>>     penzahiran di bawah undang-undang yang terpakai termasuklah Akta
>>     Rahsia Rasmi 1972. BACA SELANJUTNYA...
>>     <https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.uitm.edu.my%2Findex.php%2Fcomponent%2Fcontent%2Farticle%3Fid%3D2%26Itemid%3D103&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=JN0UxPiS9oT%2BChzZuuB0GE1j5uv6%2FjGBl%2BEW6FcXX4E%3D&amp;reserved=0>
>>
>>     ------------------------------------------------------------------------
>>     *DISCLAIMER :*/This e-mail and any files transmitted with it
>>     ("Message") is intended only for the use of the recipient(s)
>>     named above and may contain information that is non-public,
>>     proprietary,? privileged,? confidential? and exempt? from?
>>     disclosure under applicable law including the Official Secrets
>>     Act 1972. /READ MORE...
>>     <https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.uitm.edu.my%2Findex.php%2Fcomponent%2Fcontent%2Farticle%3Fid%3D2%26Itemid%3D103&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=JN0UxPiS9oT%2BChzZuuB0GE1j5uv6%2FjGBl%2BEW6FcXX4E%3D&amp;reserved=0>
>>
>>     *** Options:http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech  <http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech>
>>     *** Archive:https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=1sGV4MqWoPV4JP116mSnIGtGzLUS30CNgbmv%2FxDAZkg%3D&amp;reserved=0  <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=1sGV4MqWoPV4JP116mSnIGtGzLUS30CNgbmv%2FxDAZkg%3D&amp;reserved=0>
>>     *** EPrints community wiki:https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=rm2q%2FRqU%2F064sd1UoeIpU3tgMTGSW%2BMNvMcuXVnO2Vk%3D&amp;reserved=0  <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=rm2q%2FRqU%2F064sd1UoeIpU3tgMTGSW%2BMNvMcuXVnO2Vk%3D&amp;reserved=0>
>
>     <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.avg.com%2Femail-signature%3Futm_medium%3Demail%26utm_source%3Dlink%26utm_campaign%3Dsig-email%26utm_content%3Demailclient&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=00nrwgLz50YkjI%2Bo94PwYd%2F855xm4W3cHs94oo3in1g%3D&amp;reserved=0>
>     	Virus-free. https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.avg.com%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=KrdBroCWsChPyeDEslO0Burn7ffZkSWcBhDkkK6CCvY%3D&amp;reserved=0
>     <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.avg.com%2Femail-signature%3Futm_medium%3Demail%26utm_source%3Dlink%26utm_campaign%3Dsig-email%26utm_content%3Demailclient&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=00nrwgLz50YkjI%2Bo94PwYd%2F855xm4W3cHs94oo3in1g%3D&amp;reserved=0>
>
>
>
> *PENAFIAN: *E-mel ini dan apa-apa fail yang dihantar bersama-samanya 
> ("Mesej") adalah dihasratkan hanya untuk kegunaan penerima yang 
> dinyatakan di atas dan mungkin mengandungi maklumat yang tidak umum, 
> bermilik, istimewa, sulit dan dikecualikan dari penzahiran di bawah 
> undang-undang yang terpakai termasuklah Akta Rahsia Rasmi 1972. BACA 
> SELANJUTNYA... 
> <https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.uitm.edu.my%2Findex.php%2Fcomponent%2Fcontent%2Farticle%3Fid%3D2%26Itemid%3D103&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=JN0UxPiS9oT%2BChzZuuB0GE1j5uv6%2FjGBl%2BEW6FcXX4E%3D&amp;reserved=0>
>
> ------------------------------------------------------------------------
> *DISCLAIMER :*/This e-mail and any files transmitted with it 
> ("Message") is intended only for the use of the recipient(s) named 
> above and may contain information that is non-public, proprietary,? 
> privileged,? confidential? and? exempt? from disclosure under 
> applicable law including the Official Secrets Act 1972. /READ MORE... 
> <https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.uitm.edu.my%2Findex.php%2Fcomponent%2Fcontent%2Farticle%3Fid%3D2%26Itemid%3D103&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=JN0UxPiS9oT%2BChzZuuB0GE1j5uv6%2FjGBl%2BEW6FcXX4E%3D&amp;reserved=0>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ecs.soton.ac.uk/pipermail/eprints-tech/attachments/20210813/4dce8285/attachment-0001.html