[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[EP-tech] Message during process_stats IRStat2



CAUTION: This e-mail originated outside the University of Southampton.
Dear David

I create cron job on previous server twice a day.

Thought on the new version (3.4.3) i would like to run everything from start to make sure it really works on the latest version.

I guess, i'll let it finish this weekend. And later apply your suggestion changes.

IRstat2 is the best plugin in EPrints. Hope can see others tech person to improve it.

Regards

Izwan
UiTM Digital Library

On Fri, Aug 13, 2021, 8:37 PM David R Newman <drn at ecs.soton.ac.uk<mailto:drn at ecs.soton.ac.uk>> wrote:

Hi Izwan,

Just to clarify the process_stats script can be run in two different ways.  One is an initial setup that does various one time task and then processes all of the existing access table records.  The other is just doing an incremental update of stats for the previous day.  The latter should be done via a daily cron job in the eprints crontab.  If you are referring to running the initial setup way, then it might be worth regenerating the stats from scratch, as over time you may have had a lot of internal requests over the lifetime of your repository that would now not be marked as such in your usage stats.  However, I don't expect a regular EPrints repository to make that many internal (i.e. from the eprints server itself) requests. It would only be if you have some bespoke functionality running on your repository that will request abstract pages or download documents.  However, if you were referring to just running the incremental daily update method (for process_stats), assuming that increment is only a day or a few days, then re-running this will not make any difference and regenerating all the stats from scratch would not be worth it, as you probably have very little if any internal requests in this timeframe.

I get a bit of a feeling that you are not running the process_stats script on a daily basis to make these incremental updates.  Check the out the wiki page that explains about this and how to setup a cron job:

https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwiki.eprints.org%2Fw%2FIRStats2%23Processing&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219177316%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=UtTyrrw5kRp2dCTmFJ7gvipVVbbEZ0S2z6sCJ7cdvKQ%3D&amp;reserved=0

Regards

David Newman

On 13/08/2021 13:12, MOHD.IZWAN SALIM wrote:
CAUTION: This e-mail originated outside the University of Southampton.
Dear David

Should I apply the change and re-run the script?

I already ran it for 2 days?

Is there any different stat after I apply the change?

Regards

Izwan
UiTM Digital Library
https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fir.uitm.edu.my%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219177316%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=SC6DG4yvVQ7i73VCd2yvpw33XGidNZtanGad9MHAMGc%3D&amp;reserved=0<https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fir.uitm.edu.my%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219177316%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=sBkoBgv5eqA7N3c0VGhGu5bQfVO3WclmkpoGTaNNZ6w%3D&amp;reserved=0>


On Fri, Aug 13, 2021 at 4:45 PM David R Newman <drn at ecs.soton.ac.uk<mailto:drn at ecs.soton.ac.uk>> wrote:

Hi Izwan,

Looking at the line of code that has the error:



One of the these to variables is not set.  As there is a comparison involving $hostname further up in the file, it must be $self->{host} that is not set.  This is earlier set from line 24:

$self->{host} = $self->{session}->config( "host" );

My suspicion is that you have reconfigured your repository to be HTTPS only and there only set $c->{securehost} and not $c->{host} in your archive's cfg/cfg.d/10_core.pl<https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2F10_core.pl%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219177316%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=T1LGvliKZxobre9QPNCDRFL3YrLKN4YbYu0ei2TDhnM%3D&amp;reserved=0> (or some other config file in the same directory).  If $c->{host} is set to undef this would also return the same error message here.  To resolve this problem you should go to line 24 of /usr/share/eprints/lib/plugins/EPrints/Plugin/Stats/Processor/Access/Referrer.pm and add the following line after it:

$self->{host} ||= $self->{session}->config( "securehost" );

This will set $self->{host} to the config value of securehost if there is no value set for host.  I have had to make various amendments to EPrints to support the no $c->{host} set means HTTPS only, so that it does not break things that expect it to always be set.  However, not setting $c->{host} seemed like the most intuitive way to allow system administrators to know they have configured their repository for HTTPS only.

Unfortunately, there has not been a new release of IRStats 2 since these changes were baked into recent versions of EPrints 3.4.  In part due to this only affecting those who configured there repositories for HTTPS only in this way.

Regards

David Newman

On 13/08/2021 09:26, MOHD.IZWAN SALIM via Eprints-tech wrote:
CAUTION: This e-mail originated outside the University of Southampton.
Dear all, I just migrated and upgraded EPrints 3.3.16 to 3.4.3. Everything worked fine until I ran the process_stat --setup for IRSTAT2.

The statistic is running (i guess) but it only shows message
Use of uninitialized value in string eq at /usr/share/eprints/lib/plugins/EPrints/Plugin/Stats/Processor/Access/Referrer.pm line 84.
Use of uninitialized value in string eq at /usr/share/eprints/lib/plugins/EPrints/Plugin/Stats/Processor/Access/Referrer.pm line 84.
Use of uninitialized value in string eq at /usr/share/eprints/lib/plugins/EPrints/Plugin/Stats/Processor/Access/Referrer.pm line 84.
Access: incremental commit to DB

I'm using mysql 8. I want to get rid of that message.

Regards

Izwan
UiTM Digital Library
https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fir.uitm.edu.my%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219177316%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=sBkoBgv5eqA7N3c0VGhGu5bQfVO3WclmkpoGTaNNZ6w%3D&amp;reserved=0<https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fir.uitm.edu.my%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219177316%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=sBkoBgv5eqA7N3c0VGhGu5bQfVO3WclmkpoGTaNNZ6w%3D&amp;reserved=0>


PENAFIAN: E-mel ini dan apa-apa fail yang dihantar bersama-samanya ("Mesej") adalah dihasratkan hanya untuk kegunaan penerima yang dinyatakan di atas dan mungkin mengandungi maklumat yang tidak umum, bermilik, istimewa, sulit dan dikecualikan dari penzahiran di bawah undang-undang yang terpakai termasuklah Akta Rahsia Rasmi 1972. BACA SELANJUTNYA...<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.uitm.edu.my%2Findex.php%2Fcomponent%2Fcontent%2Farticle%3Fid%3D2%26Itemid%3D103&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219177316%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=j7r%2Bd3dW2XNFpaF2kiHMR8TFpDXCrNgxSYgdNEVSEHc%3D&amp;reserved=0>

________________________________
DISCLAIMER : This e-mail and any files transmitted with it ("Message") is intended only for the use of the recipient(s) named above and may contain information that is non-public,  proprietary,  privileged,  confidential  and  exempt  from  disclosure under applicable law including the Official Secrets Act 1972. READ MORE...<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.uitm.edu.my%2Findex.php%2Fcomponent%2Fcontent%2Farticle%3Fid%3D2%26Itemid%3D103&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219177316%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=j7r%2Bd3dW2XNFpaF2kiHMR8TFpDXCrNgxSYgdNEVSEHc%3D&amp;reserved=0>



*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
*** Archive: https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219177316%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=LnX03miRmFwzQd8O5ZZ4skkNMmRNmBZviwpg6DFsujU%3D&amp;reserved=0<https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219177316%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=LnX03miRmFwzQd8O5ZZ4skkNMmRNmBZviwpg6DFsujU%3D&amp;reserved=0>
*** EPrints community wiki: https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219187273%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=gEKGKlQ53d0g1UpBkrfelqa7TA%2FsxHo54q3eXTbKYXU%3D&amp;reserved=0<https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219187273%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=gEKGKlQ53d0g1UpBkrfelqa7TA%2FsxHo54q3eXTbKYXU%3D&amp;reserved=0>

[https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fipmcdn.avast.com%2Fimages%2Ficons%2Ficon-envelope-tick-green-avg-v1.png&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219187273%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=PcRM44KcogE3WwwNftooM%2FmnXL4WuVWVg6SfhtaoGtY%3D&amp;reserved=0]<https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.avg.com%2Femail-signature%3Futm_medium%3Demail%26utm_source%3Dlink%26utm_campaign%3Dsig-email%26utm_content%3Demailclient&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219187273%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=Hd5g80AViUg5PelLd83FYbt%2BYB%2Bbz2OX%2FHN4BaPszCI%3D&amp;reserved=0>       Virus-free. https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.avg.com%2F&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219187273%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=SJUcN%2BPuQJKoFNlA%2BnBhsS%2FYDdoVvZOfV3i6e5T8ezg%3D&amp;reserved=0<https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.avg.com%2Femail-signature%3Futm_medium%3Demail%26utm_source%3Dlink%26utm_campaign%3Dsig-email%26utm_content%3Demailclient&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219187273%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=Hd5g80AViUg5PelLd83FYbt%2BYB%2Bbz2OX%2FHN4BaPszCI%3D&amp;reserved=0>


PENAFIAN: E-mel ini dan apa-apa fail yang dihantar bersama-samanya ("Mesej") adalah dihasratkan hanya untuk kegunaan penerima yang dinyatakan di atas dan mungkin mengandungi maklumat yang tidak umum, bermilik, istimewa, sulit dan dikecualikan dari penzahiran di bawah undang-undang yang terpakai termasuklah Akta Rahsia Rasmi 1972. BACA SELANJUTNYA...<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.uitm.edu.my%2Findex.php%2Fcomponent%2Fcontent%2Farticle%3Fid%3D2%26Itemid%3D103&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219187273%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=5uXGn4S9HmT8%2Fh9ifnZK7sbXe0f2rfIiSQE6fFH0Aik%3D&amp;reserved=0>

________________________________
DISCLAIMER : This e-mail and any files transmitted with it ("Message") is intended only for the use of the recipient(s) named above and may contain information that is non-public,  proprietary,  privileged,  confidential  and  exempt  from  disclosure under applicable law including the Official Secrets Act 1972. READ MORE...<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.uitm.edu.my%2Findex.php%2Fcomponent%2Fcontent%2Farticle%3Fid%3D2%26Itemid%3D103&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219187273%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=5uXGn4S9HmT8%2Fh9ifnZK7sbXe0f2rfIiSQE6fFH0Aik%3D&amp;reserved=0>


PENAFIAN: E-mel ini dan apa-apa fail yang dihantar bersama-samanya ("Mesej") adalah dihasratkan hanya untuk kegunaan penerima yang dinyatakan di atas dan mungkin mengandungi maklumat yang tidak umum, bermilik, istimewa, sulit dan dikecualikan dari penzahiran di bawah undang-undang yang terpakai termasuklah Akta Rahsia Rasmi 1972. BACA SELANJUTNYA...<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.uitm.edu.my%2Findex.php%2Fcomponent%2Fcontent%2Farticle%3Fid%3D2%26Itemid%3D103&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219187273%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=5uXGn4S9HmT8%2Fh9ifnZK7sbXe0f2rfIiSQE6fFH0Aik%3D&amp;reserved=0>

________________________________
DISCLAIMER : This e-mail and any files transmitted with it ("Message") is intended only for the use of the recipient(s) named above and may contain information that is non-public,  proprietary,  privileged,  confidential  and  exempt  from  disclosure under applicable law including the Official Secrets Act 1972. READ MORE...<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.uitm.edu.my%2Findex.php%2Fcomponent%2Fcontent%2Farticle%3Fid%3D2%26Itemid%3D103&amp;data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cd4f6c38ca7744fe51e6508d95e68e0f8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644629219187273%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=5uXGn4S9HmT8%2Fh9ifnZK7sbXe0f2rfIiSQE6fFH0Aik%3D&amp;reserved=0>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ecs.soton.ac.uk/pipermail/eprints-tech/attachments/20210813/de9c0aab/attachment-0001.html