Your comments

would you please be so kind as to post where you got  Mylar? (I'm looking for a d/l location and not sure if the who/what/wheres are the same Mylar that everyone is talking about) --- and then if it isn't too much trouble - could you also post install instructions of some sort? Apologies for being so demanding...and Thank you for any help!

Does anyone know why the scraper misses some entries?

For instance - "Event Comics" - (4010-651 ---- comicvine #) - Someone got it at some point - I've seen it in some of the "publisher" archives. -- But when I run the script - I only get 248 returns - but I seem to remember one of the archives as having over 1000.... I'm just confused at this point. any thoughts?

Is there a link (somewhere) - to the latest version of Mylar3? (and for us brain dead old folks installation instructions?) ... If I have a directory of "random" CBR/CBZ files would Mylar be able to help standardize the names, add (if needed) the info file into the archive with the correct metadata info? 

This is what I use as my Exclusion Pattern:

"(?i)(.*/\.[a-z]*.*/*|(pdf|mobi|azw|djvw))"

starting from left to right::

(?i) --- ignore case

( --- start outer block

.*/ --- any and all paths in the URL

\.[a-z] --- the \ is an "escape" so \. escapes the period which means treat as a literal "period" period! and [a-z] means any

              letter

*.* --- means anything....and and all character combinations

/* --- finishes the URL meaning anything...

so.......

ignoring case, any path that somewhere along the directory chain there is a directory that starts with a PERIOD

(this is an exclusion pattern so if there is a match - - the path gets ignored...

| --- the "pipe" is a logical OR... so it could be that first block OR any of the following

(pdf|mobi|azw|djvu) -- this is block #2 - and I should probably rewrite it... but it "should" force ubooquity to ignore PDF, MODI, AZW, and DJVU files... however - in looking at it... it will also block any file/path with "mobile" --- ".*\.(pdf|mobi|azw|djvu)$" might work better....

) --- ends the outer block

    I just tested this on the Java Regex Tester http://java-regex-tester.appspot.com/

    (?i)(.*/\.([a-z_]*.*|(pdf|mobi|azw|djvw)$))

    I added the "_" to the part that looks at the path ...  and that should do it.... ( I think ) - - - the tester says it works... but your mileage may vary... try it...

    Rich

    What is the current updated update to the updater that updates things?

    and where is it found?

    the main link in the OP says...

    page w/ theme is https://github.com/scooterpsu/Comixology_Ubooquity_2

    and an album looksy is kept here:https://imgur.com/a/786RDqI

    the github page shows code is untouched for two years... (is this true?)

    yes please, if possible, make files/folders available and I'll try to update missing info from comicvine via their api-- please..(and thank you!)

    before we sink our teeth into the complicated... what other themes do you have, and where are they?

    better yet, how are you starting up ubooquity?


    which OS? (I’ve used Nginx in the past... and had no probs).... so.... introduce us to your machine, and give us some history, please!


    Rich

    well, a few questions...

    How much memory is in your system?

    The second parameter is a hard allocation, the first is a limit, the last is for each thread.... so it gets complicated.. quickly.

    The system I setup has 16GB of ram... and I wanted to to see how large I could set things, and NOT trigger swap.. and for me, for my system, (which also has calibre-server, qbittorrent, nfs, apache2, etc)... I will also try various settings on a 4GB server, and possibly a little raspberry pi.... just remember - the 1st number .. memory max, 2nd amount to immediately allocate, 3rd amount for each thread... also pay attention to swap.

    memory commands (linux) of use.... "free", "swapon", "top/htop"... 

    As you tweak and test... shoot for minimal swap use..

    Does that help?

    screen allows you to run console applications (things that like to write to the terminal screen) in the background... (kinda/sorta)...

    When you run ubooquity in a terminal, it prints all sorts of stuff, and log messages, state of health, and so on... and when you are done-- you press 'q' to quit...


    Screen allows you to run just like that, except, that terminal session - terminal window, can be 'backgrounded', 'hidden', etc.(and then brought back)... 

    Yes, you can run as a daemon/headless and program runs in background... but you then lose the console error messages, (which can help w/identifying errors)

    I like to think of it as a container (its not) ...

    Rich

    what is the 'Expected' directory structure for this wonderful Theme?

    I have a 'deskful' of little servers (raspberry pi, seagate goflex home, goflex net, a few older laptops, etc) all told.. about a gazillion gigglebits of storage across 7 or so mount points...(linux on everything! That serves).. and tablets/phablets/phones/netbooks to read

    I've defined $UBOO-ROOT as 'the place' where everything will 'hang' (books, comics, files, etc)

    So... I'll let calibre-server do the initial book server stuff and hang it as 

    $UBOO-ROOT/books

    Files will be whatever as

    $UBOO-ROOT/files

    And then ubooquity top level as

    $UBOO-ROOT/comics


    Now, how 'best' to proceed?

    .../comics/Publishers

    .../comics/Favorites

    .../comics/series

    .../comics/arcs

    .../comics/misc

    .../comics/unsorted

    .../comics/Chronology-Projects

    Under Publishers we could put the standard 'Marvel' 'DC'

    Favorites we'll put Conan, Sandman, and Grendel

    Series, and arcs are either virtual constructs or duplicated/possibly retitled books

    Misc... well it just don't fit quite right elsewhere..(Power Factor, or Hero Alliance, or Elementals)

    Unsorted is the temp holding tank for things awaiting comictagger to add to them, or whatever

    And Projects might have collections of Weekly upload 'bundles' or books/publishers organized by time...

    Thought experiments aside, what structure does 'Ubooquity' look for (if any), and them what about Comicology2-Theme?

    Is there a view somewhere that shows the Path/Location of a given file?


    I sometimes find when searching in Ubooquity duplicate/triplicate books i wasnt expecting and it becomes difficult to find them (especially if book filename is wonkie)

    And could jQuery be used to generate a webpage of only 'broken books'.... archives that cant be read...(and should be replaced)

    I have all sorts of bash/shell scripts that do most of the management.. but it might be nicer to 'theme' it or somehow integrate it...

    Rich