YAMJ,.... or How to LOCKUP a $4000 computer in 12 hours or less!

[Legion455]

With my big collection, and just now starting to use the Person indexes, ... YAMJ (or something) is beginning to get un-manageable.

Complete xml re-scans are taking 8-10-12 hours ... and more often than not,... Out of Heap Space, Out of Graphical Space,... "try rerunning YAMJ" message ... after 10 hours! I'm even getting random "lock-ups" .. program just stoppping.. Here's a good one ... start a fresh YAMJ run at night before going to bed, only to wake up and find that WinBlows 7 did an automatic Update in the middle of the night and rebooted my computer! Geesh!

I've had this before, a few years back, but changing the JAVA command line to

PHP Code:

java -Xms256m -Xmx2048m -classpath .;resources;lib/* com.moviejukebox.MovieJukebox %* 


seemed to fix it ... but now that I'm adding PERSON,CAST,WRITER, DIRECTOR, and PEOPLE to the mix,... is bringing back all the old horror stories again.

Things I'm thinking about: (and I'm not java savvy either)
I have a Win 7 64-bit machine (Water-Cooled i7 950, 12G Ram, RAID 0 Paired SSDs for the operating system, etc... Java 32 and 64 installed)

1. Does YAMJ run Java 32 or 64? if it's 32, would running 64-bit be better? How does one do that?
2. Is the above JAVA command line maxed out?
3. Could YAMJ be SPLIT-UP,for separate MOVIE RUNS & PERSON RUNS?

Also, I'm still trying to get my head around ,,, PEOPLE, PERSON, CAST, WRITER, DIRECTOR.

Has anyone ever really tried to explain this in layman's terms?
Link? (this would be so helpful) ...

Everytime I try to think about PERSON, PEOPLE, CAST, WRITER, DIRECTOR,.... my head starts hurting!!!!

time for some more YAMJ Aspirin!!!!

[accident]

welcome to the world of testing skins, mods, etc where you need to rescan a lot.. So your all over the place in this post and I have no clue what your actually asking about here.

[Omertron]

With 12Gb of ram, you can certainly up the amount allocated to Java. 32bit is what is used.
Xmx4096m should be sufficient unless you have a lot of VIDEO_TS and BDMV folders.

there is an open issue about making the people scan a separate process. But I just don't have the time to look into it. Perhaps Ilgizar (who's done most of the people changes) can look into it. Theres no reason why it can't be done.

[kollegah1338]

(02-15-2012 04:24 PM)Omertron Wrote:  With 12Gb of ram, you can certainly up the amount allocated to Java. 32bit is what is used.
[...]

Um, are you sure about that? I only have 64bit Java installed and YAMJ is running just fine that way.

e: Java 1.7.0_3 to be precise

[Legion455]

Thanks Omertron, I'll give xmx4096m a go and see what happens.

Right now, doing a fresh scan,... getting "Graphics tools: Error processing image file - out of memory, please run YAMJ again"
started at about movie (2400 out of 3730)

Any ideas about this one?

(02-15-2012 04:24 PM)Omertron Wrote:  With 12Gb of ram, you can certainly up the amount allocated to Java. 32bit is what is used.
Xmx4096m should be sufficient unless you have a lot of VIDEO_TS and BDMV folders.

there is an open issue about making the people scan a separate process. But I just don't have the time to look into it. Perhaps Ilgizar (who's done most of the people changes) can look into it. Theres no reason why it can't be done.

[Specter]

Sometimes the most expensive computer is not the best solution

Windows mostly instally updates that require a reboot every second Tuesday of the month. If you dont want windows rebooting after updates then configure your automatic updates to a setting that will not conflict with your work. I have mine set to download updates but prompt me to install them when i want to, never had a auto reboot issue

Have you tried it on a different computer?

How many process threads are you running?

I mean, all that writing to those SSDs can not be a good thing.

[Legion455]

Boo ya!

I just got a clean run with xmx4096m!!!!!
(people popularity = 8)

now let's see what popularity = 4 will do ....

[aangeboden]

Try using Oversight on your NMT. Rescan will be done by your NMT.
http://www.networkedmediatank.com/forumd...hp?fid=107

Or install YAMJ on your NAS (Synology).
http://missilehugger.com/203/howto-insta...ology-nas/
http://missilehugger.nl/99/yamj-installe...ology-nas/

Good Luck!!!

[Legion455]

50,000 small filed bringds a BIG Qnap to its knees!

(02-17-2012 06:50 AM)aangeboden Wrote:  Try using Oversight on your NMT. Rescan will be done by your NMT.
http://www.networkedmediatank.com/forumd...hp?fid=107

Or install YAMJ on your NAS (Synology).
http://missilehugger.com/203/howto-insta...ology-nas/
http://missilehugger.nl/99/yamj-installe...ology-nas/

Good Luck!!!

[Omertron]

Allen

How big a library do you have? And what is the coposition? I.e % mkv/avi, % ISO, % BDMV, etc?

[accident]

from previous posts he was right around 3500 titles according to yamj. but it's people support that's impacting him

[Legion455]

Library is 7.7 TB. (which includes 2 TB of TV) (new QNAP 859 pro+turbo w/ 8 Hitachi 3TB drives, RAid 6)
a Combo of 3300 Movies, plus TV Series ..

Movie are mostly avi.mkv ... no iso's or mt2s/vob garbage.
I used to have complete nfo's, but changed that to just pointers to imdb 3 or 4 weeks ago,...(and I used to always select scrape=no) .. which I think started some of my problems. (ie, more processing) (all in all though, I think have only imdb pointers in the nfo "is", long term, the best approach)

So far,... since I put the java command line to ..

PHP Code:

java -Xms256m -Xmx4096m -classpath .;resources;lib/* com.moviejukebox.MovieJukebox %* 


It's ran without so much as as hiccup. <fingers crossed> .. my last run was with People Popularity =2, ..

11,700 xmls in the People folder, Ditto for Person files in the jukebox.
The Jukebox has a total of 58000 files!!!!!!!

(NOW you know why I want that option of NOT outputing un-necessary poster/jpg files) .

Plus, the SSD in the A-300 is really unmanageable using "drive mapping" .. wayyyyyyyyyyyyy to long and slow getting thru those 58,000 files. I always have to remove it and connect directly to the PC. [note: I, for awhile, just connected up the USB3 cable to my usb3 port .. and that seemd to be working ... but I would get weird file errors .. on and off .. doing a run using this method to the SSD ... couldn't figure out if it was the A-300 firmware, USB3 port itself, or USB3 to SSD, that was screwing up .... so I just had to connect direct for YAMJ runs)

The best improvement so far has been changing the Java command line from 2048 to 4096, as I was getting lotz of errors when I added PEOPLE to the output. .. and Gees, I haven't even tried the new separate People runs yet.

I check that out when I get the chance.. been busy last night making up the new filmography page (modified evstreamed wall.poster.fanart) Did a video of it in action. .. Today I'll make a faster version (no swf's, no file splitting ,.. minimize "include statements", etc...)

and we'll see what shakes!! thanks guys!