0
Under review

Ubooquity on QNAP with absolute path finds already existing files as new ones at each new scan

QNAP 6 years ago updated 6 years ago 9

Hello,


I have installed Qtoolbox's version of Ubooquity on my TS253A and set my comic directory with absolute path.

Everything goes well except that some already existing comics are systematically considered as new comics every time I run a new scan, => they pollute the latest release tab.

I have configured a daily automatic scan.


Any idea how to solve that ? (Is it from Ubooquity or from QNAP?)


Thank you,




Hello QNAP,


can you please post here a log entry from your running ubooquity installation where a already scanned file is listed ?

And did you install ubooquity via qpkg from gnapclub or via manual installation - i didn't find any version from Qtoolbox...


Best regards 


TierparkToni

hello, 


I get it on comics with letters with accents : éèêëàáâîï etc


Problem while reading comic metadata


Package got from Stephane aka QoolBox


Thanks 

Hi QNAP,


your installed the qpkg-version - small tip : Stephane released some days ago the original 2.1.1 version as qpkg. 


I also had like you the problem with non-basic letters, in German specially "äöüß", so i renamed it into 

"international" writings (ä=ae, ö=oe, ü=ue and ß=ss) and voila : never see the double-scanned-file-entries again ... 

I dont know how this goes for your special letters, but it is only a workaround, not a solution... 

It may happen because the JAVA Runtime installed on your NAS cannot handle this special letters in your file system 

OR the database (or the scan engine) has some trouble using UTF8 ... ? 


@Tom : Did you implement in your DB (or the scan engine) the UTF8 or just ISO-8859-x codepage ? 


Hope that may explain your problem - but it is still not solved, just work-arounded ;-) .. 


Best regards from Munich !


TierparkToni

Hi Anton, Yes I have just installed 2.1.1 made by Stephane. 

And as everytime I upgrade my ubooquity, it redoes a full scan (it does not use the former DB). And as before, the same bug for the next scans.


I have seen in the forum an equivalent bug fixed by @Tom about comma in filenames : "Problem while reading comic metadata". 


A similar fix for "accented" letters in filenames may be made.


Cheers

Under review
@Tom : Did you implement in your DB (or the scan engine) the UTF8 or just ISO-8859-x codepage ?


Java is completely Unicode "compliant". As is the H2 database used in UBooquity. I even did a few tests with Japanese and Korean titles.


The problem comes from the underlying OS. If your environment is not configured to run processes with more than just the ASCII charset (as it happens on some NAS), you'll have issues.


There is no single workaround (different users reported different results with different system settings), but you can take a look at this thread:

https://ubooquity.userecho.com/forums/1-general/topics/84-comics-not-imported-umlaut-mark-bug/


Also, these ones might contain interesting info as well:

https://ubooquity.userecho.com/forums/1-general/topics/496-script-for-ubooquity-202-on-synology/

http://ubooquity.userecho.com/forums/1-general/topics/92-tutorial-install-ubooquity-on-a-synology-nas/

+1

Hello Tom,


thanks a lot for posting this links, the first seem to describe the solution : 


the qoolbox-qpkg version install the /etc/init.d/UbooQuity.sh only with the support for 

en_US.utf8
....
export LC_ALL=en_US.UTF-8
export LANG=en_US.UTF-8
export LC_CTYPE=en_US.UTF-8
....

I've changed it to fit my here needed German localisation 

de_DE.UTF-8....
....
export LC_ALL=de_DE.UTF-8
export LANG=de_DE.UTF-8
export LC_CTYPE=de_DE.UTF-8
....

, changed some already renamed files with "ue" letters to "ü" and start a new scanning, and - et voilà ! - it works !


@QNAP : select your country code from the following table


cs_CZ.UTF-8
da_DK.UTF-8
de_DE.UTF-8
en_US.UTF-8
es_ES.UTF-8
fr_FR.UTF-8
hu_HU.UTF-8
it_IT.UTF-8
ja_JP.UTF-8
ko_KR.UTF-8
nb_NO.UTF-8
nl_NL.UTF-8
pl_PL.UTF-8
pt_BR.UTF-8
pt_PT.UTF-8
ru_RU.UTF-8
sv_SE.UTF-8
tr_TR.UTF-8
zh_CN.UTF-8
zh_TW.UTF-8

 and replace any found

en_US.UTF-8

in your /etc/init.d/UbooQuity.sh with the previous selected.

Restart your Ubooquity-server, start a scan process and after it's finished, start a scan process again.

after the finish of the 2nd scan, check your log - the scan may now stopped reimporting previous imported comics/books..


Thanks again @ Tom


Hope that helps, QNAP


best regards ! 


TierparkToni


Works like a charm. 


Thanks

@ QNAP : your welcome !

@Tom: Thanks again for posting the links !

Within the help inside the first link provided this case can be closed, nothing more to do - just keep comic reading again ... 

Best regards 

TierparkToni

I have erased my DB and made a rescan : now scan skips files with "accents".