[EP-tech] indexing full text document pdf with tag get empty word in eprint__rindex table

[Mario.Beaudoin at uqtr.ca (Beaudoin, Mario)]

CAUTION: This e-mail originated outside the University of Southampton.
Hello,

We use eprints 3.4.3 and  14 repositories with a lot of pdf on each and we have an indexing bug with tagged PDF.
All the eprint__rindex tables with theses PDF got an empty ?word?.  They index only some documents word not all.
The sql command give to me all the bugged PDF
select * from eprint__rindex where word='';
[cid:image001.png at 01D967D0.A7FE7530]

The reindex of these eprint makes an error
./epadmin reindex eprints_fra1 --verbose eprint 75;
DBD::mysql::st execute failed: Duplicate entry 'documents--75' for key 'PRIMARY' at /opt/eprints3/bin/../perl_lib/EPrints/Database.pm line 1289.

I try to modify the file indexing.pl but they already include bypass empty word.

I check the indexcodes.txt for this document and it is complete with a lot of words not include in the database eprint__rindex

I download another PDF document for these eprints not tagged reindex the document with no error.

I think that epadmin reindex  got some empty word and stop to index soon as it got another empty word because it indexes some words but not all. The double ?verbose of the function gives that.

[eprints_fra1] Database execute debug: SELECT `eprintid`,`pos`,`projects` FROM `eprint_projects` WHERE `eprintid` IN (75)
Database execute debug: SELECT `eprintid`,`pos`,`skill_areas` FROM `eprint_skill_areas` WHERE `eprintid` IN (75)
[eprints_fra1] Database execute debug: SELECT `eprintid`,`pos`,`skill_areas` FROM `eprint_skill_areas` WHERE `eprintid` IN (75)
Database execute debug: INSERT INTO `eprint__rindex` (`eprintid`,`field`,`word`) VALUES (?,?,?)
[eprints_fra1] Database execute debug: INSERT INTO `eprint__rindex` (`eprintid`,`field`,`word`) VALUES (?,?,?)
DBD::mysql::st execute failed: Duplicate entry 'documents--75' for key 'PRIMARY' at /opt/eprints3/bin/../perl_lib/EPrints/Database.pm line 1289.
Database execute debug: INSERT INTO `eprint__rindex` (`eprintid`,`field`,`word`) VALUES (?,?,?)
[eprints_fra1] Database execute debug: INSERT INTO `eprint__rindex` (`eprintid`,`field`,`word`) VALUES (?,?,?)
Database execute debug: INSERT INTO `eprint__index_grep` (`eprintid`,`fieldname`,`grepstring`) VALUES (?,?,?)
[eprints_fra1] Database execute debug: INSERT INTO `eprint__index_grep` (`eprintid`,`fieldname`,`grepstring`) VALUES (?,?,?)
Database execute debug: INSERT INTO `eprint__rindex` (`eprintid`,`field`,`word`) VALUES (?,?,?)

I notice that if we take the bugged .pdf to .PS and convert to .pdf it work fine but it?s not a solution for us

Thank you for your help

Mario
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ecs.soton.ac.uk/pipermail/eprints-tech/attachments/20230405/f3b5878d/attachment-0001.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 6362 bytes
Desc: image001.png
Url : http://mailman.ecs.soton.ac.uk/pipermail/eprints-tech/attachments/20230405/f3b5878d/attachment-0001.png