EPrints Technical Mailing List Archive

Message: #09212

< Previous (by date) | Next (by date) > | < Previous (in thread) | Next (in thread) > | Messages - Most Recent First | Threads - Most Recent First

Re: [EP-tech] IRStats does not show full statistics

CAUTION: This e-mail originated outside the University of Southampton.

Hi Agung,

Try running this on the database server:

    SELECT datestamp_year, datestamp_month, COUNT(*) FROM access WHERE datestamp_year = 2023 GROUP BY datestamp_year, datestamp_month;

 

This will show you how many records there are to process for this year.

 

It might also be worth checking the database server error logs for any messages?

 

Cheers,

John

 

From: eprints-tech-bounces@ecs.soton.ac.uk [mailto:eprints-tech-bounces@ecs.soton.ac.uk] On Behalf Of Agung Prasetyo W. via Eprints-tech
Sent: 20 February 2023 12:02
To: Alan.Stiles [He/Him/They] <alan.stiles@open.ac.uk>
Cc: eprints-tech@ecs.soton.ac.uk
Subject: Re: [EP-tech] IRStats does not show full statistics

 

CAUTION: This e-mail originated outside the University of Southampton.

Hi,

 

Yes, I've run process_stats without --setup but still use --verbose flags. Does this really affect the update from irstats? Because after I run process_stats without the --setup flags, it says there are only 37 records. Does this mean the access table doesn't contain or store the data required by irstats?

 

Regards,

Agung PW

 

 

On Mon, Feb 20, 2023 at 3:51 PM Alan.Stiles [He/Him/They] <alan.stiles@open.ac.uk> wrote:

Is your local eprints running the process_stats call nightly via a cron job to update the stats after having been rebuilt from the beginning?

 

Like your command below, but without the –setup and –verbose flags ?

 

Alan

 

From: eprints-tech-bounces@ecs.soton.ac.uk <eprints-tech-bounces@ecs.soton.ac.uk> on behalf of Agung Prasetyo W. via Eprints-tech <eprints-tech@ecs.soton.ac.uk>
Date: Sunday, 19 February 2023 at 14:58
To: eprints-tech@ecs.soton.ac.uk <eprints-tech@ecs.soton.ac.uk>
Subject: [EP-tech] IRStats does not show full statistics

CAUTION: This mail comes from outside the University. Please consider this before opening attachments, clicking links, or acting on the content.

CAUTION: This e-mail originated outside the University of Southampton.

Hi,

 

I have around 18000 items in my local repository. 1 month ago, my IRStats displayed complete data up to the last month. Then I moved the eprints to the local server and then ran process_stats repos --setup --verbose and it took almost 3 days.. But as a result, statistics from last month to this month do not appear.
Here's the last process:
--------------------------------------
Access: incremental commit to DB
Access: processed 35700000 records so far.
Saving the state for dataset 'access'
Access: it took 188211 secs to parse 35735180 records ( average = 189.87 records/sec )
Access: 24667016 records kept out of 35735180 ( ratio = 69.03%)
About to process dataset 'history'
Creating table 'irstats2_history'
history: starting from record 0
history: 320571 records to process.
Leaving now
---------------------------
Is there something wrong with my database or maybe or is there a step I missed? Please advise me on what I should do.

 

Thank you.

 

Regards,

Agung PW