Commit Graph

11 Commits

Author SHA1 Message Date
David Fugate 2c16b93983 Re-added tests disabled by https://bugs.ecmascript.org/show_bug.cgi?id=126. 2011-09-12 10:02:51 -07:00
David Fugate 2871886420 test\harness\*:
- a lot of JS harness code written in strings have been moved out to actual physical files
  such as ed.js (syntax error detection for globally scoped tests) and gs.js (global scope test
  case validator).  This change makes it far easier to maintain the test harness code
- reorganized helper.js providing a clear indication which methods are used by external objects,
  which are implementation details, and which are unequivocally test262-specific.  I've also added,
  openErrorWindow, which will be used to open a descriptive error message window for each test case
  failure reported on the 'Run' tab
- improved the error message for syntax errors occurring when a test case fails to load
- sta.js no longer tries to pickle all helper functions it contains!  Instead, we load the file
  directly from sth.js.  The performance of fnGlobalObject has been improved.  Finally, the ES5Harness
  object has been moved from sth.js (in a string) to here
- sth.js now has a browser implementer hook, controller.implementerHook, which allows browser implementers
  to handle test case failures in their own way (e.g., log to the filesystem).  The 'run' function was
  basically re-written

Added 37 new test cases from the "IE Test Center" Build release.  There were 14 modifications to
existing test cases as well.  Refactored SputnikGlobalScope.js such that test case paths are now used
as indices into the GlobalScopeTests array.

TestCasePackager.py had the concept of templated test harnesses introduced - see templates\runner.test262.html.
Also added support for one HTML test harness per ES5 chapter.  Last but not least, TestCasePackagerConfig.py
now has a 'source control' abstraction class which abstracts away source control adds|edits when dynamically
generating *.json and *.html test chapters.
2011-08-25 11:18:44 -07:00
David Fugate 9c0e7dd413 Test failures in the 'Run' tab now have a link to the test case's source
similar to the 'Results' tab.
2011-06-09 16:31:52 -07:00
David Fugate 0edb82f716 Fixed a number of small issues with the website. 2011-03-11 14:14:23 -08:00
David Fugate 82c8d63eee Added a test harness 'debug' mode to Simple Test Harness. Accessible via appending
"?sitedebug" to the end of the Test262 URL.

There's a mismatch between the Test262 test harness and IE Test Center's harness
which invalidated 15.4.4.17-5-1.js, 15.4.4.18-5-1.js, and 15.4.4.20-5-1.js on Test262.
Essentially what's going on is Test262 uses the 'window' object as 'this' for the test
case functions whereas IE Test Center uses the test case object housing the test case
function as this.  This causes problems for test cases pertaining to scoping.  I've gone
ahead and adjusted the Test262 tests to expect 'window' to be 'this', and will be updating
IE Test Center's harness to use the 'window' object as well so we don't run into this
problem again.
2011-02-08 09:42:59 -08:00
David Fugate e4d4a7a870 test\harness\helper.js: extended the 'finished' method to accept as input the total elapsed execution time
of the tests.  Emit this to the activity bar


test\harness\sta.js:  too many years of Python had me thinking JavaScript arrays have an append method:)  Fixed.
                      Also, added a pickled representation of all test helper functions found in this file


test\harness\sth.js:  detached most test helper functions from the iframe's document object (as globals) and
                      inject these into the actual test cases. It's a bit slower and not as elegant, but it is
                      cleaner from an ES5 purist perspective.  Still need to move Sputnik helper functions into
                      sta.js

                      Extended Controller such that it now measures overall test execution time.  Such a change
                      is very useful for measuring performance-impact changes such as the aforementioned
                      improvement
2011-02-03 16:28:52 -08:00
David Fugate 8bd3768a4e - all files supporting the 'Browsers' tab have been removed.
- updated website version number to 0.2
2011-01-17 11:08:45 -08:00
David Fugate 7ec9ee2d66 Four or five IE Test Center test cases (ES5 Chapter 10) were corrupted due to a bug in
the Test262 XML conversion tool.  These have been manually updated, and a bug needs to
be filed on the tool when bugs.ecmascript.org comes back online.

Fixed an issue involving the Back button on the results page.
2010-11-13 15:22:20 -08:00
David Fugate fbb888778d Quite a few modifications have been made to the test harness (website/resources/scripts/global/*)
which have resulted in it being able to run negative test cases which corrupt the global JavaScript
environment.  This lets us enable fifty plus more Sputnik test cases.  Another positive result from
this test harness refactoring is that Opera no longer hangs when running the tests.
2010-11-12 09:27:59 -08:00
David Fugate 31a27896b8 A number of bugs in the Test262 harness are fixed with this check-in. 2010-11-01 16:28:46 -07:00
David Fugate 7396642963 This commit includes Microsoft's initial contributions to Test262:
- external\contributions\: test contributions to Test262 from external entities such as Microsoft and Google.
                           This directory consists of the external tests without any modifications
- test\harness\:  test harness used to run Test262 tests.  Presently web-based
- test\suite\:    suite of vendor-neutral ECMAScript test cases conforming to the ES5 spec
- tools\:         among other things this includes a set of tools used to convert various external test
                  contributions to a format the Test262 test harness can consume
- website\:       an archived copy of the http://test262.ecmascript.org website
2010-10-18 20:50:07 -07:00