First Subjective test application

Hello,

I just managed to get the time to pull myself together and get a first version of my subjective evaluation application out.

It is now part of Video Quality Studio and you can get it from here.

Constructive feedback is as always appreciated.

Wow, Everwicked.  I've read your introductory documentation.  It is extremely clear and easy to understand.  I'll be trying your lab tool out on my very next encode.

Nice - a helpful addition would be SSIM measurement.

An implementation of the algorithm can be found here.

Thanks for the comments guys.

Just to mention that the objective utility (PSNR, VQM) was released quite some time ago (see this  thread).

It's the subjective part that was just released for the first time.

Does not work with RMVB and AVS(RMVB)

Originally posted by Sirber
Does not work with RMVB and AVS(RMVB)

Now that's a pretty vague report.

Which application of the two are we talking about, and what is the error?

Won't open AVS files...
Only .avi files...
In quot;Openquot; dialog only quot;Video filesquot; are available as format (that is .avi is shown only in my case)...
Tried renaming avs to avi - no way - not working...

Solution?

Originally posted by iradic
Won't open AVS files...
Only .avi files...
In quot;Openquot; dialog only quot;Video filesquot; are available as format (that is .avi is shown only in my case)...
Tried renaming avs to avi - no way - not working...

Solution?

Just type in the filename and extension and it will work alright, although when I was testing this earlier avs files behaved somewhat peculiarly crashing the program when you close it.  everwicked knows of this though so no need to belabour the point I understand the problem is no fault of the program itself.

Yeah, maybe sh0dan can shed some light to this....

Sorry about the open file dialog, I forgot to add .avs. Rest assured it's gonna be in the next version

In the meantime just type *.* in the dialog and it will show everything..

Great work everwicked!

Haven't tried this new version, but a older one...

Great tool, but one thing bugs me !!!

Could you please make it output the results also in a *.txt file ???

Or is this already possible... Tia, Soulhunter

Originally posted by Soulhunter

Could you please make it output the results also in a *.txt file ???

Or is this already possible...

Uh.... a comma seperated file (.csv) IS a text file and it's just values seperated by commands like the name suggests. Its like that because Excel can open them, but rename the file and open with whatever application you like...

Originally posted by everwicked
Its like that because Excel can open them, but rename the file and open with whatever application you like...
Mean just a result-txt-file like...

Code:
Min. PSNR = xx.xx

Avg. PSNR = xx.xx

Max. PSNR = xx.xx

And so on... ;)
Or just a info box that shows the final results...

Just because Ive no Excel !!!Bye

It's in my TODO list...

Originally posted by everwicked
It's in my TODO list...

BIG THANKS !!!

Bye

Thanks for help...

Another question: How to exit subjective test (it goes full screen and no way to go back, abort or something else).

Thanks again...

That's on my TODO list as well..

Just as a note, you should make the clips 8-10 seconds long so that you only have to interrupt if you made a mistake or the phone rings . Or in other words, don't try it with large files.

Another problem or bug (could be on my side...)?

Well, when watching subjective test video is full of artifacts (I used avs scripts - trimed 1% of movie with selectrangeevery...). When wathing these scripts in vdubmod or bsplayer everything is ok...

I'll try some more tests and see ... thanks for help

I don't know about bsplayer but vdubmod uses VFW to decode avs whilst I use directshow.

So the ultimate test, would be to drag the file onto graphedit and see what happens when you play it...

From GraphEdit:
AviSynth video -gt; Avi Decompressor -gt; Video Renderer

But I solved problem adding pixel_type=quot;yv12quot; in avifilesource.

Also for TODO list after subjective test program just closes (or crashes?)...