Under review

Scanning stops and restarts (loop)

6 years ago • updated 6 years ago • 2

Hi All

I got the docker installation and the mounts working, and added +1000 Comics and Books

I have no memory limits (even if the system log says limit 512MB) and the maximum I have seen so far on my docker UI is 3,4G ram !!!

And I still get the: Java error during scan (I have read this could be related to pdf files?)

Tried setting scan to work every 3 hours and advanced setting not to delete if unavailable

But that creates random covers for books during the day, the one that work before are scanned and have no covers later

Also see this in the log file: (So any conversion of PDF files to compliant PDF files I can run?)

20180402 12:26:30 [Scanner thread] ERROR com.ubooquity.data.feeder.a - Failed to insert /comics/101-200/bog - Nr_104 - Noegleroman.pdf

I also get logget out again and again, I have letsencrypt certificate in place and its working just fine with reverse proxy built in to the web service, but when I look in the log file I see this:

20180402 12:23:15 [main] ERROR com.ubooquity.d.e - Provided keystore is not valid, HTTPS will NOT be activated

I think the Synology just forwards the http to https with the certificate (So I might just ignore the error).

Settings:

reverseProxyPrefix: (Needs to be empty, since my reverse proxi in my Synology NAS only supports domains not a url path. But I have the green lock and the certificate in place.

Another strange thing, I created a user Henrik and in the log I see:

java.io.FileNotFoundException: Henrik (No such file or directory)

I really love the idea about having my own ebook server and love the work you have done with a clean and functional UI, but I need to keep scans, so they dont get scanned again and looses whatever was already scanned (Hope someone understands what I am trying to say :-)

Best regards

Caspersen

Vote

Replies 2
Oldest first
- Newest first
- Oldest first

Under review

6 years ago

> Also see this in the log file: (So any conversion of PDF files to compliant PDF files I can run?)

20180402 12:26:30 [Scanner thread] ERROR com.ubooquity.data.feeder.a - Failed to insert /comics/101-200/bog - Nr_104 - Noegleroman.pdf

I will need the next 10 or 20 lines of logs after this one (more info about what went wrong).

> 20180402 12:23:15 [main] ERROR com.ubooquity.d.e - Provided keystore is not valid, HTTPS will NOT be activated

It means you have setup the path to a file that is not a valid JKS file in the settings. If your connection is already wrapped in HTTPS by your NAS, you don't need to set anything for this setting. (the only impact of this error is that Ubooquity serves pages using HTTP, if you see them in HTTPS, then your NAS did the wrapping).

> Another strange thing, I created a user Henrik and in the log I see:

java.io.FileNotFoundException: Henrik (No such file or directory)

Same as above, I need the surrounding log lines.

6 years ago

I did a stop of the docker and removed all files under the config, to see if that would improve things....

But new logs here, after some time I cant even log in to the UI/Admin and I have to stop the docker in order for to login...

java.lang.OutOfMemoryError: Java heap space
20180402 21:08:59 [Scanner thread] INFO com.ubooquity.b.d - Reading metadata of comic file: /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_034 - Staalanden gaar i Faelden-FIXED.pdf
20180402 21:08:59 [Scanner thread] INFO com.ubooquity.fileformat.pdf.b - Reading metadata of pdf file: /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_034 - Staalanden gaar i Faelden-FIXED.pdf
20180402 21:09:03 [Scanner thread] INFO com.ubooquity.data.database.c - Inserting/updating comic entry in database : /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_034 - Staalanden gaar i Faelden-FIXED.pdf
20180402 21:09:03 [Scanner thread] INFO com.ubooquity.b.d - Reading metadata of comic file: /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_035 - Spil Op Anders And-FIXED.pdf
20180402 21:09:03 [Scanner thread] INFO com.ubooquity.fileformat.pdf.b - Reading metadata of pdf file: /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_035 - Spil Op Anders And-FIXED.pdf
20180402 21:09:07 [Scanner thread] ERROR com.ubooquity.data.feeder.a - Failed to insert /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_035 - Spil Op Anders And-FIXED.pdf
java.lang.OutOfMemoryError: Java heap space
20180402 21:09:07 [Scanner thread] INFO com.ubooquity.b.d - Reading metadata of comic file: /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_036 - Verden rundt med Mickey Mouse-FIXED.pdf
20180402 21:09:07 [Scanner thread] INFO com.ubooquity.fileformat.pdf.b - Reading metadata of pdf file: /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_036 - Verden rundt med Mickey Mouse-FIXED.pdf
20180402 21:09:08 [qtp1515638188-32] INFO com.ubooquity.provider.page.a - Henrik is reading /books/Adult/Pige-Special - 1990 Nr_09.pdf
20180402 21:09:09 [qtp1515638188-32] ERROR com.ubooquity.d.b - Request not handled (should never happen, this is a bug !): /bookreader/79
20180402 21:09:09 [qtp1515638188-32] WARN org.eclipse.jetty.server.HttpChannel - /bookreader/79
java.lang.OutOfMemoryError: Java heap space
20180402 21:09:10 [Scanner thread] INFO com.ubooquity.data.database.c - Inserting/updating comic entry in database : /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_036 - Verden rundt med Mickey Mouse-FIXED.pdf
20180402 21:09:11 [Scanner thread] INFO com.ubooquity.b.d - Reading metadata of comic file: /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_037 - Ikke Naebbet Anders-FIXED.pdf
20180402 21:09:11 [Scanner thread] INFO com.ubooquity.fileformat.pdf.b - Reading metadata of pdf file: /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_037 - Ikke Naebbet Anders-FIXED.pdf
20180402 21:09:14 [Scanner thread] ERROR com.ubooquity.data.feeder.a - Failed to insert /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_037 - Ikke Naebbet Anders-FIXED.pdf
java.lang.OutOfMemoryError: GC overhead limit exceeded
20180402 21:09:14 [Scanner thread] INFO com.ubooquity.b.d - Reading metadata of comic file: /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_038 - Anders And Kommer Ovenpaa-FIXED.pdf
20180402 21:09:14 [Scanner thread] INFO com.ubooquity.fileformat.pdf.b - Reading metadata of pdf file: /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_038 - Anders And Kommer Ovenpaa-FIXED.pdf
20180402 21:09:17 [Scanner thread] ERROR com.ubooquity.data.feeder.a - Failed to insert /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_038 - Anders And Kommer Ovenpaa-FIXED.pdf
java.lang.OutOfMemoryError: Java heap space

Goes on and on

ALL the FIXED PDF are file I have re-exported to PDF and checked that they are readable in ComicRack

I am looking into removing all PDF files to see if this resolves it! :-)

If you provide me with an e-mail I would be happy to email you the full logs.

Update some new one:

java.lang.OutOfMemoryError: Java heap space
20180402 21:08:11 [Scanner thread] INFO com.ubooquity.b.d - Reading metadata of comic file: /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_055 - Mickey Spraenger Rammerne.pdf
20180402 21:08:11 [Scanner thread] INFO com.ubooquity.fileformat.pdf.b - Reading metadata of pdf file: /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_055 - Mickey Spraenger Rammerne.pdf
20180402 21:08:14 [qtp1515638188-40] ERROR com.ubooquity.d.b - Request not handled (should never happen, this is a bug !): /admin-api/status
20180402 21:08:14 [Scanner thread] ERROR com.ubooquity.data.feeder.a - Failed to insert /comics/Disney/Jumbobog/001-100/Jumbobog - Nr_055 - Mickey Spraenger Rammerne.pdf
java.lang.OutOfMemoryError: Java heap space
20180402 21:08:14 [qtp1515638188-40] WARN org.eclipse.jetty.server.HttpChannel - /admin-api/status
java.lang.OutOfMemoryError: Java heap space

Best regards

Caspersen

Customer support service by UserEcho