Sour grapes from Mozilla Corp's Rob Sayre today as news spreads that the latest nightly build of Safari gets 100/100 on Acid 3. There are still 3 timing warnings, meaning the animation isn't as smooth as it's supposed to be. Animation smoothness is also part of the test specification, so this can't be referred to as a complete pass yet. I'm surprised that the timing part hasn't been included as one of the 100 tests, it would make for a less ambiguous result if it was.
To get back to Rob Sayre, I have no doubts that the Firefox team is as dedicated to web standards as Opera and Safari, so why not take this opportunity to show it off?
Says Rob:
> Besides, commitment to standards is strong at Mozilla, where we don’t constantly seek to rubber stamp our own implementation.
While the grandstanding aspect is part of what Sayre complains about, I see that as one of the most important components of the Acid tests, giving browser developers a kick in the ass to push for a more complete supports of the standards and giving publicity to the standards cause itself. In that respect, the quality of the tests - of which I know too little to comment - is secondary.
And, if the tests themselves were a load of irrelevant rubbish I suspect we would have heard something sooner than the day on which the first two browsers more or less pass the test. Sour grapes and sore losers indeed.
There's one thing Rob points out that is worth investigating. This commit showing that Safari tests for a specific font and turns off font smoothing for that font - specifically to pass Acid 3. That, I believe, goes against the spirit of the test and I think the Safari team would do well to put that into the open if it isn't what it looks like - a hack simply to pass the test. A Slashdot comment offers some insight:
> It's not the outrageous hack you think it is. Ahem is a dummy font that needs to have specific sizing in order for Acid3 to give accurate results. If Ahem doesn't have the specific size assumed by the Acid3 test, that means Acid3 can't give accurate results, not that Acid3 failed. So the Webkit developers disabled font smoothing for that specific font so that Acid3 could give accurate results, not to cheat. This isn't cheating because Acid3 isn't testing the font size, it's assuming the font size. It doesn't make sense to test the font size because that's volatile in real world conditions anyway.
But it's still not conclusive evidence that this hack is a valid pass. Alas, another ambiguity to the Acid 3 test, leaving passes open to judgement of whether or not they follow the spirit of the test.
UPDATE: Mozilla Chief Evangelist Mike Shaver makes a few more comments about the Acid 3 test on his blog, and feels that Acid 3 is a missed opportunity in the series, an opportunity to establish a base level functionality that's good for the web that, in his opinion, turned into a race to expose irrelevant browser bugs. More insight from Acid 3 author Ian Hickson in the comments.