Oversight Testing Release 2185

[lordy]

Thanks, for the feedback. I just looked on TMDB and there is no support for movies in multiple collections at the moment.

So this means that 'Carrie' will always be in Stephen King collection along with Green Mile and Shawshank.
Also Iron Man 1/2 are bound to the 'Avengers' collection, along with Hulk 2008, but not the earlier Hulk.

I think its back to IMDB, until the TMDB collections are revisited.

Quote:Posters from IMdb will be used if missing from TMdb.

The latest version should also make an attempt to grab missing fanart using a Bing image search.

[accident]

the api never giving image language has expose a real problem IMHO that the data is crap for what type of image your really getting..

Perhaps we can rally the htpc world to help out with cleaning up tmdb's data. I'm pretty sure with an account you can go in and mark the images correctly for what they are. thetvdb has a moderator staff that is on top of all new images to fix what the users flagged wrong when uploading an image.. but tmdb isn't as quick on this.

[Marco_HDX]

R2095--> It works now really fancy again on my two HDX 1000 systems, much appreciated. thanks for your great work

[aangeboden]

(03-29-2012 11:43 AM)lordy Wrote:  Thanks I'm investigating. In the mean time it looks like it will run if you disable wget.masquerading
by renaming or deleting the file /share/Apps/oversight/conf/use.wget.wrapper and rebooting.

http://code.google.com/p/oversight/wiki/...g_function

Not working.
I get this on my screen;

Requested file not exist! (404 Not Found)

[MickH]

Hi,
R2095 works better any my A110 is all happy again. I scanned the whole database and everything is good except for boxsets of "Home movies" which are not cataloged on the web.

One example is the following:

It made a box set for the movie “The Sound Of Sunday Micheal O Muircheartaigh”. In this boxset it put 4 movies, the correct one called “The Sound Of Sunday Micheal O Muircheartaigh” but it also added the following 3 movies, “Skiing Skills – Beginners And Beyond”, “Skiing Skills – Mastering Moguls” and “Skiing Skills – Piste Performance”.

I have .nfo files for all of these with id = –1 so I would expect it not to do any internet scanning.

I have sent Lordy an email with the logs but I want to post here also to see if others have similar problems,
Cheers,
Mick

[MikeHunter]

(03-31-2012 04:36 AM)aangeboden Wrote:  Not working.
I get this on my screen;

Requested file not exist! (404 Not Found)

Try installing 2006 and the 2095. As i posted in this thread (second post) i need to copy over three files.

[aangeboden]

(03-31-2012 06:49 AM)MikeHunter Wrote:  

(03-31-2012 04:36 AM)aangeboden Wrote:  Not working.
I get this on my screen;

Requested file not exist! (404 Not Found)

Try installing 2006 and the 2095. As i posted in this thread (second post) i need to copy over three files.

I've done this. Same result.
Copied also the three files. Same result.
Seems that the WEBSERVICES->OVERSIGHT is deleted during the install of 2095 on the Popcorn A-100.

I've done also a clean install of 2006 ->2095 (CSI, File->Install)
I've remove everything and done also a clean install of
2006 ->2077 (CSI, File->Install) ->2095 (CSI, File->Install)

Same Results. Not working.

[MikeHunter]

Can't confirm this behavior on c-200 - will test on my A-110.

[edit]
Just installed 2095 on my A-110 following these steps

1. make sure oversight pc-interface work proper
2. rename folder /share/Apps/oversight to oversight_2006
3. new folder /share/Apps/oversight
4. copy over 3 files (oversight.cgi, oversight.html, index.db)
5. install csi-file 2095
6. check pc-gui (worked)
7. configurate oversight, scan-path, scraping, ...
8. initiate a full scan (just running)

[MickH]

I had no problems installing R2095 on my A110. I basically did the same as Mike and everything is good.

[lordy]

(03-31-2012 04:45 AM)MickH Wrote:  Hi,
R2095 works better any my A110 is all happy again. I scanned the whole database and everything is good except for boxsets of "Home movies" which are not cataloged on the web.

One example is the following:

It made a box set for the movie “The Sound Of Sunday Micheal O Muircheartaigh”. In this boxset it put 4 movies, the correct one called “The Sound Of Sunday Micheal O Muircheartaigh” but it also added the following 3 movies, “Skiing Skills – Beginners And Beyond”, “Skiing Skills – Mastering Moguls” and “Skiing Skills – Piste Performance”.

I have .nfo files for all of these with id = –1 so I would expect it not to do any internet scanning.

I have sent Lordy an email with the logs but I want to post here also to see if others have similar problems,
Cheers,
Mick

Hi for some reason Oversight is seeing your <id>-1</id> tag, inside the plot tag. Can you check/send the xml?

The one for Michael is correct.

For the box set issue all double check code but can you zip & send your index.db file in the mean time.

---

@aangeboden, I'd like to see reports from anyone else with a A100 to decide best way forward. Can you zip & send install.log and reboot.log in the logs folder. When sending add info mentioned in http://code.google.com/p/oversight/wiki/...LogReports

[aangeboden]

(03-31-2012 07:20 AM)MikeHunter Wrote:  Can't confirm this behavior on c-200 - will test on my A-110.

[edit]
Just installed 2095 on my A-110 following these steps

1. make sure oversight pc-interface work proper
2. rename folder /share/Apps/oversight to oversight_2006
3. new folder /share/Apps/oversight
4. copy over 3 files (oversight.cgi, oversight.html, index.db)
5. install csi-file 2095
6. check pc-gui (worked)
7. configurate oversight, scan-path, scraping, ...
8. initiate a full scan (just running)

Same results not working.

CHECK 1. make sure oversight pc-interface work proper
CHECK 2. rename folder /share/Apps/oversight to oversight_2006
CHECK 3. new folder /share/Apps/oversight
CHECK 4. copy over 3 files (oversight.cgi, oversight.html, index.db)

These files I've copied from oversight_2006 to oversight folder
oversight.cgi 859.040 13-7-2011
oversight.html 297 30-9-2010
index.db 52124 28-03-2012

REMARK!!!: As soon I've renamed the oversight_2006 folder, the file
oversight.cgi DISAPPEAR!!! It's automatically deleted by the system/NMT but still in memory????
But I'm smart I've made also a backup to my NAS so from elsewhere I've managed to copy the oversight.cgi (859.040 13-7-2011) file to the new created folder oversight.

In oversight_2006 is no file oversight.cgi anymore! Can someone confirm me this step? I can't copy one to this oversight_2006 folder, because I get a warning; Can't copy or overwrite. STRANGE!

CHECK 5. install csi-file 2095 (CSI, File->Install)

After installed I've checked both folders

Oversight folder;
oversight.cgi 859.040 13-7-2011
oversight.html 297 30-9-2010
index.db 52124 28-03-2012

Oversight_2006 folder;
oversight.cgi 857.548 30-3-2012 <------ ???????
oversight.html 297 30-9-2010
index.db 52124 28-03-2012

STRANGE now in the Oversight_2006 the file oversight.cgi APPEARs
but now the filesize is different.

Now I can see in NMT CSI, installed programs:
oversight 2.0testing-r2006
oversight 2.0testing-r2095



NOCHECK 6. check pc-gui (worked) ----------------> BLANK SCREEN
After Reboot NMT ----------------> Requested file not exist! (404 Not Found)
NOCHECK 7. configurate oversight, scan-path, scraping, ...
NOCHECK 8. initiate a full scan (just running)


---------------------------------------------

MikeHunter can you inform us the filesize of OVERSIGHT.CGI in both folders?

---

---

(03-31-2012 05:26 PM)lordy Wrote:  

---

@aangeboden, I'd like to see reports from anyone else with a A100 to decide best way forward. Can you zip & send install.log and reboot.log in the logs folder. When sending add info mentioned in http://code.google.com/p/oversight/wiki/...LogReports

(03-31-2012 05:26 PM)lordy Wrote:  @aangeboden, I'd like to see reports from anyone else with a A100 to decide best way forward. Can you zip & send install.log and reboot.log in the logs folder. When sending add info mentioned in http://code.google.com/p/oversight/wiki/...LogReports

I've checked in both folders for the log files;
folder OVERSIGHT ----------> No any log files !!!!!!
OVERSIGHT_2006 ---> 4 log files + emptyscans folder

REBOOT.LOG

Code:

+ [ ! -L /share/Apps/oversight/bin/nmt100/find ]
+ ln -sf /share/Apps/oversight/bin/nmt100/busybox /share/Apps/oversight/bin/nmt100/find
+ ln -sf /share/Apps/oversight/bin/nmt100/oversight /share/Apps/oversight/oversight.cgi
+ install_as_wget
+ [ ! -f /share/Apps/oversight/conf/use.wget.wrapper ]
+ [ -f /share/Apps/oversight/conf/wget.wrapper.error ]
+ is_wget /bin/wget
+ [ -x /bin/wget ]
+ grep -iq GNU Wget /bin/wget
+ cp -a /bin/wget /share/Apps/oversight/wget.original
+ rm -f /bin/wget.real
+ mv /bin/wget /bin/wget.real
+ ln -sf /share/Apps/oversight/bin/nmt100/oversight /bin/wget
+ echo wget wrapper installed
wget wrapper installed
+ ln -sf /share/Apps/oversight/ /opt/sybhttpd/default/.
+ ln -sf /tmp/0 /share/Apps/oversight/logs/gui.log
+ awk -F= /^catalog_watch_frequency=/ { gsub(/"/,"",$2) ; print $2 } /share/Apps/oversight/conf/catalog.cfg
awk: /share/Apps/oversight/conf/catalog.cfg: No such file or directory
+ freq=
+ add_watch_cron  watch NEWSCAN CHECK_TRIGGER_FILES
+ [  != off ]
+ d=*
+ h=*
+ m=*
+ echo Unknown cron format
Unknown cron format
+ [ *** != *** ]
+ rm -f /share/Apps/oversight/catalog.status

INSTALL.LOG

Code:

+ /share/Apps/oversight/bin/oversight.sh UNINSTALL
+ NZBGET_UNPAK_INSTALL
+ NZBGET_UNPAK_UNINSTALL
+ CP /share/.nzbget/nzbget.conf /share/.nzbget/nzbget.conf.post_oversight
+ cp /share/.nzbget/nzbget.conf /share/.nzbget/nzbget.conf.post_oversight
+ chown -R nmt:nmt /share/.nzbget/nzbget.conf.post_oversight
+ awk
BEGIN { activeCount=0; }

/Changed By Oversight/ { getline ; next };
/^#PreOversight#/  {
    $0 = substr($0,15);
}

{ print }
/share/.nzbget/nzbget.conf.post_oversight
+ mv /share/.nzbget/nzbget.conf.new /share/.nzbget/nzbget.conf
+ CP /share/.nzbget/nzbget.conf /share/.nzbget/nzbget.conf.pre_oversight
+ cp /share/.nzbget/nzbget.conf /share/.nzbget/nzbget.conf.pre_oversight
+ chown -R nmt:nmt /share/.nzbget/nzbget.conf.pre_oversight
+ awk
function debug(x) {
    print "#INSTALL#"x
}
BEGIN {

    #Repair
    set["postprocess"]="/share/Apps/oversight/bin/unpak.sh" ;
    set["allowreprocess"]="yes" ;
    set["parcheck"]="no";
    set["renamebroken"]="no";

    # Logging
    set["detailtarget"]="none";
    set["debugtarget"]="none";
    set["infotarget"]="screen";
    set["warningtarget"]="both";
    set["errortarget"]="both";
    set["createlog"]="yes";
    set["createbrokenlog"]="yes";
    set["resetlog"]="yes";
    set["logbuffersize"]="100";

    #IO Performance
    set["directwrite"]="yes";
    set["continuepartial"]="no";

    # Added for standard nzbget.conf
    set["outputmode"]="loggable";
    set["nzbdirfileage"]="12";
    set["dupecheck"]="yes";
    set["threadlimit"]="10";

    pat="";
    for(k in set) { pat=pat"|"tolower(k) ; }
    pat="("substr(pat,2)")";
}

match(tolower($0),"^"pat"=") {
    k=substr($0,RSTART,RLENGTH-1);
    lc_k = tolower(k);
    found[lc_k]=1;
    v=set[lc_k];
    if (index(tolower($0),tolower(v)) == 0) {
        print "#Changed By Oversight#";
        print k"="v;
        $0="#PreOversight#"$0;
    }
}

{ print }

END {
    #Add all missing keywords
    for (k in set) {
        if (!(k in found)) {
            print "#Changed By Oversight#";
            print k"="set[k];
        }
    }
} /share/.nzbget/nzbget.conf.pre_oversight
+ mv /share/.nzbget/nzbget.conf.new /share/.nzbget/nzbget.conf
+ TRANSMISSION_UNPAK_INSTALL
+ [ -f /share/.transmission/unrar.sh ]
+ TRANSMISSION_UNPAK_UNINSTALL
+ [ -f /share/.transmission/unrar.sh ]
+ sed -i /unpak.sh torrent_seeding/ d /share/.transmission/unrar.sh
+ chown nmt:nmt /share/.transmission/unrar.sh
+ sed -i
2 i\
exec /share/Apps/oversight/bin/unpak.sh torrent_seeding "$@"
/share/.transmission/unrar.sh
+ chown nmt:nmt /share/.transmission/unrar.sh
+ cd /share/Apps/oversight/cache
+ rm -f tt[0-9]*[0-9]
+ [ -f /share/bin/wget ]
+ SKIN_INSTALL
+ [ -d templates.new ]
+ rm -fr templates.old
+ mv templates templates.old
mv: cannot rename 'templates': No such file or directory
+ true
+ mv templates.new templates
+ [ -d templates.old ]
+ [ -f /share/Apps/oversight/templates/blu/install.sh ]
+ /bin/sh /share/Apps/oversight/templates/blu/install.sh
+ [ -f /share/Apps/oversight/templates/classic/install.sh ]
+ /bin/sh /share/Apps/oversight/templates/classic/install.sh
+ [ -f /share/Apps/oversight/templates/default/install.sh ]
+ /bin/sh /share/Apps/oversight/templates/default/install.sh
+ [ -f /share/Apps/oversight/templates/oversight/install.sh ]
+ /bin/sh /share/Apps/oversight/templates/oversight/install.sh
+ rm -fr /share/Apps/oversight/templates/gaya
+ chmod -R 775 /share/Apps/oversight
+ chown -R nmt:nmt /share/Apps/oversight
+ /share/Apps/oversight/install.sh NMT_UNINSTALL oversight
+ /share/Apps/oversight/install.sh NMT_INSTALL oversight /share/Apps/oversight/bin/oversight.sh REBOOTFIX
+ /share/Apps/oversight/install.sh NMT_CRON_DEL nmt oversight
+ eval /share/Apps/oversight/bin/oversight.sh REBOOTFIX
+ /share/Apps/oversight/bin/oversight.sh REBOOTFIX
+ reboot_fix
+ set +x
+ /share/Apps/oversight/install.sh NMT_INSTALL_WS OverSight http://127.0.0.1:8883/oversight/oversight.cgi
+ UPGRADE_CONFIG conf/catalog.cfg catalog_config_version=1
+ [ ! -f conf/catalog.cfg ]
+ CP conf/catalog.cfg.example conf/catalog.cfg
+ cp conf/catalog.cfg.example conf/catalog.cfg
+ chown -R nmt:nmt conf/catalog.cfg
+ UPGRADE_CONFIG conf/oversight.cfg ovs_config_version=1
+ [ ! -f conf/oversight.cfg ]
+ CP conf/oversight.cfg.example conf/oversight.cfg
+ cp conf/oversight.cfg.example conf/oversight.cfg
+ chown -R nmt:nmt conf/oversight.cfg
+ [ ! -f index.db.idx ]
+ touch index.db
+ touch index.db.idx
+ touch conf/catalog.cfg conf/oversight.cfg conf/unpak.cfg
+ chmod a+r /dev/random /dev/urandom
+ BOUNCE_NZBGET
+ su -s /bin/sh nmt -c /share/Apps/oversight/bin/unpak.sh nzbget_cmd restart
from proc pid =
[INFO] unpak_nzbget_bin=
[INFO] unpak_nzbget_conf=
[ERROR] unpak_nzbget_bin unset
[INFO] Exit_Code 1
Exit_Code 1
+ /share/Apps/oversight/install.sh NMT_INSTALL_WS_BANNER OverSight Installation Complete
<body bgcolor="#000022" text="white" link="white"><center>
OverSight
<hr>
Installation Complete
         <br><a href="http://127.0.0.1:8883/webservices_list.html">Show Webservice List</a>
         <br><a href="http://127.0.0.1:8883/setups.cgi?%7FhiDe=9">Setup</a>

</center></body>

[MikeHunter]

oversight.cgi

oversight_2006: 838 kb 2012-03-30
oversight........: 838 kb 2012-03-30

just saw that oversight.cgi is linked to
/opt/sybhttpd/localhost.drives/HARD_DISK/Apps/oversight/bin/nmt100/oversight

oversight/oversight.cgi
lrwxrwxrwx 1 nmt nmt 76 Mar 31 06:58 oversight.cgi -> /opt/sybhttpd/localhost.drives/HARD_DISK/Apps/oversight/bin/nmt100/oversight

oversight_2006/oversight.cgi
lrwxrwxrwx 1 root nmt 42 Jan 23 18:21 oversight.cgi -> /share/Apps/oversight/bin/nmt100/oversight

[aangeboden]

(03-31-2012 06:59 PM)MikeHunter Wrote:  oversight.cgi

oversight_2006: 838 kb 2012-03-30
oversight........: 838 kb 2012-03-30

just saw that oversight.cgi is linked to
/opt/sybhttpd/localhost.drives/HARD_DISK/Apps/oversight/bin/nmt100/oversight

oversight/oversight.cgi
lrwxrwxrwx 1 nmt nmt 76 Mar 31 06:58 oversight.cgi -> /opt/sybhttpd/localhost.drives/HARD_DISK/Apps/oversight/bin/nmt100/oversight

oversight_2006/oversight.cgi
lrwxrwxrwx 1 root nmt 42 Jan 23 18:21 oversight.cgi -> /share/Apps/oversight/bin/nmt100/oversight

Thanks MikeHunter,

Still no results after copying the file oversight.CGI (857.548b 2012-03-30) to folder oversight.
Has also tried to replace the same file with no extension in folder
/opt/sybhttpd/localhost.drives/HARD_DISK/Apps/oversight_2006/bin/nmt100/oversight

I've also tried to rename "use.wget.wrapper" to "use.wget.wrapper.org" but again no luck.

Again many thanks. Now we must wait if other users with A-100 has the same problems.

[MikeHunter]

(03-31-2012 07:35 PM)aangeboden Wrote:  Thanks MikeHunter,

Still no results after copying the file oversight.CGI (857.548b 2012-03-30) to folder oversight.
Has also tried to replace the same file with no extension in folder
/opt/sybhttpd/localhost.drives/HARD_DISK/Apps/oversight_2006/bin/nmt100/oversight

I've also tried to rename "use.wget.wrapper" to "use.wget.wrapper.org" but again no luck.

Again many thanks. Now we must wait if other users with A-100 has the same problems.

So scan is finished - just want to take a look a the pc-gui...
...it's gone.

http://pch-a110:8883/oversight/oversight.cgi
oversight.cgi 0 kb

-> so this file do some strange things:
/opt/sybhttpd/localhost.drives/HARD_DISK/Apps/oversight/bin/nmt100/oversight

Copied over 'oversight' from zip.tar 2006 ends up in this

Code:

error parsing [themoviedb:052749]/opt/sybhttpd/default/oversight/oversight.cgi: dboverview.c: 869: parse_imdb_list: Assertion `0' failed.

Copied over fresh 'oversight' from zip.tar 2095 ends up in this

Code:

Requested file not exist! (404 Not Found)

[egon]

I'm using v2095 on A100 and have no problems.
First I had a "request cannot be processed" problem with v2077, but I renamed "use.wget.wrapper" with "use.wget.wrapper.bak" and rebooted and all worked ok.
Then when the new version 2095 came out I just installed it over the v2077 with CSI and all is working ok.
If I look at oversight conf folder I even have the file "use.wget.wrapper" and still all is working ok.