Feedtime 2 - 20100430-1

[sskankin]

I followed method one step by step and I get this error:

ERROR Thu, 29 Apr 2010 19:10:39 +0100 Error parsing nzb- file: :1882:
ERROR Thu, 29 Apr 2010 19:10:39 +0100 Error parsing nzb- file: parser
ERROR Thu, 29 Apr 2010 19:10:39 +0100 Error parsing nzb- file: error :
ERROR Thu, 29 Apr 2010 19:10:39 +0100 Error parsing nzb- file: Extra content at the end of the document
ERROR Thu, 29 Apr 2010 19:10:39 +0100 Error parsing nzb- file: ÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛÛ​
ERROR Thu, 29 Apr 2010 19:10:39 +0100 Error parsing nzb- file: ^
ERROR Thu, 29 Apr 2010 19:10:39 +0100 Failed to parse nzb- file

What does this mean??

Feedtime seems ok.. it reads:

Thu,29.Apr,19:10:39: nzbmatrix:ok a.league.of.their.own.uk.s01e07.720p.hdtv.x264.watbath.4 | 639 Mb 10% pars (10).
Thu,29.Apr,19:10:35 Login nzbmatrix.com OK
Thu,29.Apr,19:10:34 BEGIN name:nzbmatrix[4] nzb:1 rss:0
Thu,29.Apr,19:10:34 Getting nzbs : mode = LIVE feeds = 4

but nzbget read the error that is displayed above.

(04-29-2010 01:27 AM)lordy Wrote:  Hi,

you have to have the new fix, but if using the api I dont think you need the sitedefinition and if using the site definition you dont need the api key.

I couldn't say what you are doing wrong without seeing your config files. or getting a clear report of exact errors seen.

Maybe this is feedtimes fault but some error reports in this thread dont really give me enough detail to do anything.

Oddly enough nzbmatrix do have ssl (which on a normal site would have sorted out your security concerns) but on nzbmatrix, the rss feed itself is on a completely different website, which doesn't have ssl, and thus exposes the apikey in clear text. So in this case, you would be better served by using the site definition and https.

So I've just hit my nzbmatrix testing limit but either of the methods below should work for a secure NZBMatrix connection:

(I've just realised the RSS url itself returns links even if no key is provided! so we can invoke the RSS query without the apikey, and then later add the api key to the ssl download link, using a sed transformation, this is method 2 below)

Method 1 - Secure connection to nzbmatrix using https and cookies. (untested)

This also works with non-vip accounts.

1. Set Site Definition (note https: not just http)
user=your name
password=your password
login=https://nzbmatrix.com/account-login.php
login data=username=@USER@&password=@PASSWORD@
logout=https://nzbmatrix.com/account-logout.php
sed transformation=s/details/download/;s/api-//

2. Set RSS url - for HDTV. Make sure it does NOT contain page=download

http://rss.nzbmatrix.com/rss.php?subcat=41&term=hdtv+-web&ssl=1

Note
a: this is 'http:' not 'https'.
b: this feed is NOT locked down! The feed It just passes the api details to the download links. It doesn't check them itself! But because we are using a site definition (ie pretending to be a logged in browser with cookies) - we dont need the user/api details in the link.


That's it.


Method 2: Secure connection to nzbmatrix using https and authentication url

Dare I say it, another approach for those with working setups would be to
In the RSS URL
1. strip the username and apikey from the RSS url,
2. append &ssl=1 to the RSS url if it is not there already
3. Make sure the url contains 'page=download' eg
http://rss.nzbmatrix.com/rss.php?page=download&subcat=41&term=hdtv+-web&ssl=1

Then in the site definition:
1. Make sure the user name and password are blank
1. Change the sed transformation to

Code:

s/username=/username=YOURNAME/;s/apikey=/apikey=YOURKEY/

That's it.

In either case, If it doesnt work then you need to troubleshoot a bit.

- if you see 'view bad nzb' then click on it and report contents.
- verify your site definition settings as above
- verify your feed definition is as above.
- send exact exact error messages


I actually hate nzbmatrix now I've still no idea what is going wrong with so many people set ups?
Maybe its because nzbmatrix feed is on two servers (one without SSL) that is causing people all the problems.
I've not had any issues since addint new unzip commands to 20100427-1.

Let me know how you get on.

[sskankin]

I'm trying to understand how feedtime works. I did notice that with feedtime grabs a NZB it grabs the zip file not the nzb < being a vip it does not have to grab the zip> I'm trying to translate the sed transformation command "s/details/download/" could anyone explain this to me?

thank you.

[lordy]

@sskankin, feedtime only grabs what it is sent by the server. The problem is
NZBMatrix RSS sends different things depending on the exact rss url you are using.

If you are VIP:
use method 2.

If you are not VIP:
I will check method 1 (now it is 12 oclock!) and get back to you., In the mean time post
1) the exact RSS url you are using.
2) The version of nzbget you are running.
3) The version of feedtime you are running

---

@sskankin, I have replicated your error (for some reason I did realise you meant the error messages were in the nzbget window and not the feedtime window). I have also signed up for another free nzbmatrix account so I can make sure I get this working!

The problem is that nzbmatrix sometimes include the nfo file in the zip file. This gets appended to the nzb file, and nzbget complains as it is not valid xml!
This only happens I think if an nfo is present. So it's an intermittent problem.

[lordy]

@all, feedtime 20100430-1 is released. This should now work with non-vip nzbmatrix accounts AND vip accounts.

For setting up secure nzbmatrix downloads see http://code.google.com/p/feedtime/wiki/NZBMatrix

[jasch]

Lordy, I am having some trouble with the latest version.

It worked fine with the old one (March). But since the change, I have this "bad nzbs" errors.



You can download the err directory from here.

[bmurrell]

hey Lordy,

Would like to get up to date with the latest version

With the existing version already installed and running with feeds etc setup, if i just use the NMT Community Software Installer to install will it upgrade or whipe everything and i'll have to start fresh?

Thanks

[lordy]

@jasch, not sure, just tested nzbs.org ok here.

What version of feedtime are you running?
How did you install it?
Have you tried changing the concurrent_nzb setting?
Try removing the --ignore-length option from wget (this was only present because of tvnzb.com non-standard website)

Some files are emtpy which if often an authentication issue, but craig.ferguson worked. ok. As this is a smaller NZB, it may indeed be the ignore-length setting? Or a timeout which would be helped by switching off the concurrent setting?

---

(04-30-2010 08:14 PM)bmurrell Wrote:  hey Lordy,

Would like to get up to date with the latest version

With the existing version already installed and running with feeds etc setup, if i just use the NMT Community Software Installer to install will it upgrade or whipe everything and i'll have to start fresh?

Thanks

If you are already on an April version (which I suspect you are ) it will be OK.
If upgrading from March or earlier, then you will need to re-enter your feeds.

[sskankin]

@Lordy

ok, I understand. Is there a way to have to feedtime download the nzb file not the zip file to prevent this problem ? maybe change the link or something. Sorry if I'm asking but I was just wondering if this could be done.

---

The RSS feed i'm using is :
http://rss.nzbmatrix.com/rss.php?subcat=...-web&ssl=1

NZBget version:
NZBGet 0.7.0-testing-r380

Feedtime:
V20100427-1

(04-30-2010 12:58 AM)lordy Wrote:  @sskankin, feedtime only grabs what it is sent by the server. The problem is
NZBMatrix RSS sends different things depending on the exact rss url you are using.

If you are VIP:
use method 2.

If you are not VIP:
I will check method 1 (now it is 12 oclock!) and get back to you., In the mean time post
1) the exact RSS url you are using.
2) The version of nzbget you are running.
3) The version of feedtime you are running

---

@sskankin, I have replicated your error (for some reason I did realise you meant the error messages were in the nzbget window and not the feedtime window). I have also signed up for another free nzbmatrix account so I can make sure I get this working!

The problem is that nzbmatrix sometimes include the nfo file in the zip file. This gets appended to the nzb file, and nzbget complains as it is not valid xml!
This only happens I think if an nfo is present. So it's an intermittent problem.

[lordy]

@sskankin this is fixed in 20100430-1.
http://www.networkedmediatank.com/showth...#pid373305
Please try it and let me know how you get on.

It should work as is, downloading the zips but this happens in the background and should not affect you directly.

So Method 1 or Method 2 as described http://code.google.com/p/feedtime/wiki/NZBMatrix

I could also get Method 1 to download nzb directly but this would only work for VIP and just confuses everything more, and not much point if you have success with the latest version. Try the method 1 again with the latest release.

@all, this is a testing release. Please check CSI for latest versions, as I'm trying to upload bugfixes for known issues.
If not just hold off a while with bug reports or issues if not against the latest version, just as I get confused easily.
And between this and Oversight there is a lot to do! Tx!

And nzbmatrix has now replaced tvnzb as my least favourite nzb server! (from a technical pov, funny how it seems to be the popular ones!)

[jasch]

(04-30-2010 08:26 PM)lordy Wrote:  @jasch, not sure, just tested nzbs.org ok here.

What version of feedtime are you running?
How did you install it?
Have you tried changing the concurrent_nzb setting?
Try removing the --ignore-length option from wget (this was only present because of tvnzb.com non-standard website)

I was using the latest, 20100430-1, installed through shell directory.

I removed the --ignore-lenght option from wget, and it seems to be working.

If that option is not needed anymore, you might want to remove it from the trunk.

Thanks, I'll keep you posted.

---

(04-30-2010 08:26 PM)lordy Wrote:  @jasch, not sure, just tested nzbs.org ok here.

What version of feedtime are you running?
How did you install it?
Have you tried changing the concurrent_nzb setting?
Try removing the --ignore-length option from wget (this was only present because of tvnzb.com non-standard website)

I was using the latest, 20100430-1, installed through shell directory.

I removed the --ignore-lenght option from wget, and it seems to be working.

If that option is not needed anymore, you might want to remove it from the trunk.

Thanks, I'll keep you posted.

[lordy]

>> If that option is not needed anymore, you might want to remove it from the trunk.

Indeed. It crossed my mind before but I didn't want to change it without knowing the full impact!

[sskankin]

Just installed and tested out and everything seems to be working great!

Thanks for all your help Lordy!

(04-30-2010 09:53 PM)lordy Wrote:  @sskankin this is fixed in 20100430-1.
http://www.networkedmediatank.com/showth...#pid373305
Please try it and let me know how you get on.

It should work as is, downloading the zips but this happens in the background and should not affect you directly.

So Method 1 or Method 2 as described http://code.google.com/p/feedtime/wiki/NZBMatrix

I could also get Method 1 to download nzb directly but this would only work for VIP and just confuses everything more, and not much point if you have success with the latest version. Try the method 1 again with the latest release.

@all, this is a testing release. Please check CSI for latest versions, as I'm trying to upload bugfixes for known issues.
If not just hold off a while with bug reports or issues if not against the latest version, just as I get confused easily.
And between this and Oversight there is a lot to do! Tx!

And nzbmatrix has now replaced tvnzb as my least favourite nzb server! (from a technical pov, funny how it seems to be the popular ones!)

[lordy]

@sskankin, Phew! Thanks for the feedback BTW. Hope I didnt seem too grumpy sometimes

---

@all, I've made some changes so feedtime can run on a generic Linux distro.
I have tested on my Mandriva 2010 workstation, with nzbget.

It does not have a GUI however, but the config files are relatively straight forward to manage by hand.

If anyone wants to try it on thier non-NMT Linux based download station see LinuxDistro. If anyone wants to make a proper GUI I'll be happy to lend a helping hand.
I've made some notes here.

Here is a shortlist of feedtimes features (if you want to compalre to other nzb grabbers)

* supports http cookie authentication
* supports https/ssl
* supports link transformation/url re-writing to force rss links to be download links.
* supports auto-unzipping of .zipped nzbs.
* Uses a simple but powerful scoring system so you can avoid/reduce duplicates, but can still prioritise xvid if no 720p , or download a proper if one appears , or download from certain release groups if no other choice.
* If a download is superceded by one with a higher score it can attempt to cancel it from nzbget's queue.
* Filter nzbs by size.
* Filter nzbs by par percentage.
* For older versions of nzbget (ie with NMT firmware) it can do scheduling.
* Runs with full GUI on NMT platform using the built in sybhttpd webserver. (no apache, php needed)
* Runs 'headless' (no GUI) on Linux platform ( see LinuxDistro ) - a half feature

[sskankin]

No not at all.. I hope I was not being to annoying with my problems. You were very generous.

Thanks again!

(05-01-2010 02:53 AM)lordy Wrote:  @sskankin, Phew! Thanks for the feedback BTW. Hope I didnt seem too grumpy sometimes

---

@all, I've made some changes so feedtime can run on a generic Linux distro.
I have tested on my Mandriva 2010 workstation, with nzbget.

It does not have a GUI however, but the config files are relatively straight forward to manage by hand.

If anyone wants to try it on thier non-NMT Linux based download station see LinuxDistro. If anyone wants to make a proper GUI I'll be happy to lend a helping hand.
I've made some notes here.

Here is a shortlist of feedtimes features (if you want to compalre to other nzb grabbers)

* supports http cookie authentication
* supports https/ssl
* supports link transformation/url re-writing to force rss links to be download links.
* supports auto-unzipping of .zipped nzbs.
* Uses a simple but powerful scoring system so you can avoid/reduce duplicates, but can still prioritise xvid if no 720p , or download a proper if one appears , or download from certain release groups if no other choice.
* If a download is superceded by one with a higher score it can attempt to cancel it from nzbget's queue.
* Filter nzbs by size.
* Filter nzbs by par percentage.
* For older versions of nzbget (ie with NMT firmware) it can do scheduling.
* Runs with full GUI on NMT platform using the built in sybhttpd webserver. (no apache, php needed)
* Runs 'headless' (no GUI) on Linux platform ( see LinuxDistro ) - a half feature

[lordy]

Does anyone have any feedback on the nzb superceding feature. eg. propers, repacks, sd vs hd etc.

Does it work for you out of the box ?

Note the delay between nukes and propers may be long enough to allow duplicate downloads. But sd/hd are usually quite close together.