0
Under review

Not seeing *some* pdfs

Ian Nusbaum 6 months ago updated by Tom 5 months ago 10

Hello, I am truing to switch to Ubooquitey from Calibre, but I am having an issue.

Specifically, it seems to be refusing to see some of my PDFs. For instance, in the folder in question I have 23 PDFs, but UB only shows 18. There is nothing in the logs (literally nothing). There is nothing in particular weird about the file names. 


I am very glad that I did not bulk move all my books. I would have no way of knowing (not initially, anyway) that some books were not getting picked up. a few misses out of thousands of books would have gone unnoticed.

Please advise

watch for special chars in the filename, ubooquity seems having problems with accentued chars. Specially for cbr and cbz.

nope. I renamed one of the books to "foo.pdf" I also checked the pdf properties, and there is nothing weird. It shows up in the scan, but does not get added to the books db.

also verified that its not a symlink (though apparently many of the books in my library are)

Under review

Hello Ian,

If you upload one of the problematic PDF somewhere and send me the link, I'll take a look.

oh hey. sorry. Here is a link. I have about 17 books in one of the folders that are not showing, this is one of them. I have a LOT of other folders and I am not sure how many others are missing

https://1drv.ms/b/s!AsH400huh6YUwNY439ZjKjJSetEsBA?e=X4UlSF


Hi Ian,

On my Ubooquity install I tryed your pdf with no issue, using the original file name.

There must be something else. Maybe the platform ? I'm using Ubooquity on Windows 10.

Hmmm. There must be something else at play then, yes. It should be right there next to the alpha draft, but it is not. It also only shows 34 books in the folder, but there are 51. I am not sure what is happening

Just in case: you didn't define an exclusion pattern in the advanced options ?

You may test in a single folder. Just to be sure. Put your file in a folder named "test" and browse Ubboquity to this folder

well, looks like a memory issue

20200327 15:12:50 [Scanner thread] WARN com.ubooquity.data.database.a - Could not find id of root path D:\test (ignore this warning if you just added a new root directory)
20200327 15:12:50 [Scanner thread] INFO com.ubooquity.data.database.a - Inserting/updating book entry in database : D:\test
20200327 15:12:50 [Thread-6203] INFO org.eclipse.jetty.server.Server - jetty-9.4.0.v20161208
20200327 15:12:50 [Thread-6203] INFO o.e.j.server.handler.ContextHandler - Started o.e.j.s.h.ContextHandler@bee218{/,null,AVAILABLE,@admin}
20200327 15:12:50 [Thread-6203] INFO o.e.j.server.handler.ContextHandler - Started o.e.j.s.h.ContextHandler@c55ec1{/,null,AVAILABLE,@library}
20200327 15:12:50 [Scanner thread] INFO com.ubooquity.fileformat.pdf.b - Reading metadata of pdf file: D:\test\Player's Handbook [Remastered+Deluxe][10th Print].pdf
20200327 15:12:50 [Thread-6203] INFO o.e.jetty.server.AbstractConnector - Started library@5ffe85{HTTP/1.1,[http/1.1]}{0.0.0.0:2202}
20200327 15:12:50 [Thread-6203] INFO o.e.jetty.server.AbstractConnector - Started admin@11a2b52{HTTP/1.1,[http/1.1]}{127.0.0.1:2203}
20200327 15:12:50 [Thread-6203] INFO org.eclipse.jetty.server.Server - Started @361406037ms
20200327 15:12:50 [Thread-6203] INFO com.ubooquity.b - Internal server started. Listening on port 2202 (library) and 2203 (admin)
20200327 15:12:55 [Scanner thread] ERROR com.ubooquity.data.feeder.a - Failed to insert D:\test\Player's Handbook [Remastered+Deluxe][10th Print].pdf
java.lang.OutOfMemoryError: Java heap space

Indeed.

The library currently used to read the PDF sometimes consumes a huge amount of memory for some files. The only workaround for now is to increase the memory allocated to Ubooquity.