[Officeshots] Pixelwise comparison of pdf files

[Milos Sramek]

Hi,

I am new on this list, so let me introduce myself first: my name is
Milos Sramek. I found the officeshots page when I was looking for tools
to compare quality of ODF renderings created by different applications.
I have been talking to Michiel  for some time now, and I even have set
up my own factory (the OOO3.4 a LO3.4 ones, others may follow).

Officeshots can create pdfs by many tools so that they can be inspected
visually. However, only significant differences are visible.  Thus I
wrote a script, which takes pdfs and compares them - both some simple
statistics is computed and difference images are created.

As an example I attach the results for the shah/2 Inserting An Image
Try.odt file, which shows numeric differences between all pairs of
available pdfs. The results is in a per cent-like scale:
100 means perfect fit of both images, 0 means that no two black pixels
in the pdf files overlap.
You can visually check what do these values mean in difference images,
which are available in the file
http://www.viskom.oeaw.ac.at/~milos/shah2-LO3.4.pdf
Here, the LO3.4 result is compared to other applications (marked by the
blue labels). Pixels set by just one application are red or cyan, those
set by both are black. If the numerical result is 100, only black pixels
are shown. These images are related to line 2 of the table.

This way, one can see exactly where are the differences. One can also
see that some application render the text really poorly.

Currently I use this tool to prepare a study, which I would like to sent
to Slovak government as an argument that ODF is the right standard to
use. I have, however some problems with the officeshots service:

- the server with MSO software is nearly always down. Is there any idea
when it will be up? I would like to send a couple of files for testing.
I think that I can even install and run such factory, but I do not own
licenses for Windows and MSO.
- In spite of the fact that my factory with LO3.4 and OOO3.4 is running
(when I send a file for testing, it is correctly processed), most files
of the available galleries are  not processed by LO3.4 and OOO3.4. (e.g.
see 
http://www.officeshots.org/galleries/view/opendocument-fellowship-test-suite)
Is it somehow possible to force the system to rerun all tests on a
certain factory?

If you want to test the script, it is attached.

best
Milos



-- 
email & jabber: sramek.milos at gmail.com

-------------- next part --------------
A non-text attachment was scrubbed...
Name: 2 Inserting An Image Try_RSLT.ods
Type: application/vnd.oasis.opendocument.spreadsheet
Size: 10068 bytes
Desc: not available
URL: <http://lists.opendocsociety.org/pipermail/officeshots/attachments/20110616/26e28d27/attachment.ods>