Commit Graph

6839 Commits

Author SHA1 Message Date
David Fugate bd20fef7a1 Disabled 7 more invalid test cases. 2011-02-10 16:08:29 -08:00
David Fugate 8841b45e0c Six tests are dependent upon the Sputnik driver dynamically generating
some datetime constants before execution.  As we do not yet have support
for this, I've disabled them.  See https://bugs.ecmascript.org/show_bug.cgi?id=11
for more details.
2011-02-10 11:00:25 -08:00
David Fugate 7f1b0fa7a5 Removed prototype www.ecmascript.org revamp. 2011-02-10 09:12:55 -08:00
David Fugate 1f54cd6343 Two 7.9 tests are invalid according to ES5 (see https://bugs.ecmascript.org/show_bug.cgi?id=7).
Disabled.
2011-02-08 13:59:17 -08:00
David Fugate 82c8d63eee Added a test harness 'debug' mode to Simple Test Harness. Accessible via appending
"?sitedebug" to the end of the Test262 URL.

There's a mismatch between the Test262 test harness and IE Test Center's harness
which invalidated 15.4.4.17-5-1.js, 15.4.4.18-5-1.js, and 15.4.4.20-5-1.js on Test262.
Essentially what's going on is Test262 uses the 'window' object as 'this' for the test
case functions whereas IE Test Center uses the test case object housing the test case
function as this.  This causes problems for test cases pertaining to scoping.  I've gone
ahead and adjusted the Test262 tests to expect 'window' to be 'this', and will be updating
IE Test Center's harness to use the 'window' object as well so we don't run into this
problem again.
2011-02-08 09:42:59 -08:00
David Fugate e4d4a7a870 test\harness\helper.js: extended the 'finished' method to accept as input the total elapsed execution time
of the tests.  Emit this to the activity bar


test\harness\sta.js:  too many years of Python had me thinking JavaScript arrays have an append method:)  Fixed.
                      Also, added a pickled representation of all test helper functions found in this file


test\harness\sth.js:  detached most test helper functions from the iframe's document object (as globals) and
                      inject these into the actual test cases. It's a bit slower and not as elegant, but it is
                      cleaner from an ES5 purist perspective.  Still need to move Sputnik helper functions into
                      sta.js

                      Extended Controller such that it now measures overall test execution time.  Such a change
                      is very useful for measuring performance-impact changes such as the aforementioned
                      improvement
2011-02-03 16:28:52 -08:00
David Fugate 2ec3b287d7 - split sth.js (simple test harness) into sth.js and sta.js (simple test APIs)
- updated version number for the overall site to 0.3
2011-02-03 12:27:00 -08:00
David Fugate f301c17e6b sth.js: added a couple of test helper functions
Addressed test case issues detailed in https://mail.mozilla.org/pipermail/test262-discuss/2011-January/000020.html.
2011-02-02 13:24:45 -08:00
David Fugate bbf270c065 IE9 RC1 test case additions have been propagated to the test XMLs. 2011-02-02 10:06:51 -08:00
David Fugate 1ef6afcf78 ietestcenter sources are now synchronized with IE9 RC1 test cases. 2011-02-02 10:00:25 -08:00
David Fugate dd47c9ea12 Updating IE Test Center sources to IE9 RC1. 2011-02-02 09:57:23 -08:00
David Fugate cef2d1ed51 Added Microsoft's Test262 contributions stemming from IE9 RC1:
- 12.14-7.js:  cleaned up
- 15.2.3.3:  89 test case additions
- 15.2.3.4:  29 test case additions
- 15.2.3.6:  1,076 test case additions and 15 minor test case fixes
- 15.2.3.9-1.js:  cleaned up
- 15.3.4.5-2-8.js:  cleaned up
- 15.4.4.14:  14 test case additions and 3 minor test case fixes
- 15.4.4.15:  9 test case additions and 3 minor test case fixes
- 15.4.4.17:  1 test case additions and 1 minor test case fix
- 15.4.4.18:  1 minor test case fix
- 15.4.4.19:  1 test case addition and 2 minor test case fixes
- 15.4.4.20:  3 minor test case fixes
- 15.4.4.21:  1 test case addition and 1 minor test case fix
- 15.4.4.22: 2 minor test case fixes
- 15.9.4.4: 2 minor test case fixes
- 15.9.5.43-0-2.js: minor test case fix
2011-02-02 09:44:09 -08:00
David Fugate 37859d334a - default.html still had a reference to reports.js. Removed. Also, removed test\harness\reports.js
- test\harness\sth.js:  fixed a bug spotted by Mark Miller.  In short, we were allowing
  a test case return value of 'undefined' to be successful WRT IE Test Center tests because
  Sputnik tests normally return undefined (successful or not).  We now differentiate between
  Sputnik/IE Test Center when evaluating return values
2011-01-17 15:01:19 -08:00
David Fugate 8bd3768a4e - all files supporting the 'Browsers' tab have been removed.
- updated website version number to 0.2
2011-01-17 11:08:45 -08:00
David Fugate 0252ed17af Added a tool to help analyze our coverage of ES5. 2011-01-14 15:07:29 -08:00
David Fugate afff585d55 Version numbers were incorrect on most *.html pages (referenced 1.0 and indicated the page was produced in October). Fixed
Added a blurb to the "Development" section of default.html referring Ecma TC39 members to http://wiki.ecmascript.org/doku.php?id=test262:test262
for details on test submissions.
2010-11-16 16:19:26 -08:00
David Fugate 42b884b7ba TestCasePackager.ps1 had problems dealing with test case files that had valid test code
prior to the usage of "ES5Harness".  Specifically in cases like:
  var abc = ...;
  ES5Harness.registerTest( {
  //...abc gets used here

the declaration of "abc" would've been ripped out thereby corrupting the test.

This change fixes the issue for all existing IE Test Center and Sputnik test cases. Note
however that it could potentially fail for lines like this: "/*abc*/ /*".  If we ever add
cases including comments like this, the implementation of isTestStarted will need to be
revisited.

There were five such test cases that were being affected by this issue in IE Test
Center's chapter 10 and 15 tests.  These have all been fixed via the updated script.
2010-11-16 15:43:29 -08:00
David Fugate 3fedec4130 15.4.4.14-9-b-i-6.js and 15.4.4.15-9-b-i-6.js were never reviewed internally at Microsoft
for their adherence to the ES5 specs. Removing until we've fulfilled all internal policies
around these two tests.
2010-11-16 08:00:32 -08:00
David Fugate 2f34b4e050 TestCasePacker.ps1:
- The only parameter required for this script is now the test suite version.  All other
  parameters are generated relative to the location of this script
- This script now generates the XML'ized test cases directly to website\resources\scripts\testcases\.
  Likewise, it copies the test harness taken from test\harness\* to website\resources\scripts\global\
- Added tons of error checking and we now emit the current generation status to stdout
- Made the script more generic in the sense that it can take arbitrary directories under test\suite\*
  containing ES5 test chapters.  Previous behavior was it was looking for test chapters directly under website\
2010-11-16 07:46:42 -08:00
David Fugate 90b97dbae5 Removed website/(browsersreport|development|results|run) as we do not need path-like
access to the webpages.  index.html should suffice.
2010-11-15 21:28:42 -08:00
David Fugate 35450e9e80 Did a bit of refactoring on the test262 directory structure and propagated changes from
website\* out to test\*:
- Removed test\harness\ECMA-262-TOC.xml.  The casing on this file was incorrect, but
  more importantly it's a static file not generated by the harness
- Populated test\harness with the contents of website\resources\scripts\global\.  In
  the future, we need to update test\harness\* and propagate these changes out to
  website\*
- Test\suite\ietestcenter is now a verbatim copy of the IE Test Center tests that
  WERE under website\resources\scripts\testcases\*
- Moved all Sputnik tests from website\resources\scripts\testcases\* out to
  test\suite\sputnik_converted
- Moved website\resources\scripts\testcases\excludelist.xml out to test\config\*.  This
  particular file was only used for the test conversion process to XML, and is not actually
  needed by the website as best as I can tell
- Website\resources\scripts\testcases now only contains the XMLized test cases.  This is
  the right thing to do as the *.js files here weren't actually being used by the website
  and the general public can now peruse the test cases directly via Mercurial
2010-11-15 21:23:35 -08:00
David Fugate 1063159ce0 For the time being do not try to get a list of all XML files under the 'TEST_RESULT_PATH' directory using
an HTTP request as this directory isn't (yet) publically indexable.  Instead, we'll use a hardcoded
list of files for now.
2010-11-15 09:56:26 -08:00
David Fugate c3435f4665 Changed the case of a couple of files. 2010-11-15 09:52:07 -08:00
David Fugate d92a57cee4 Changing the case on a couple of files that worked fine on Windows IIS, but fail against a (case-sensitive)
UNIX web server.
2010-11-15 09:49:49 -08:00
David Fugate 7ec9ee2d66 Four or five IE Test Center test cases (ES5 Chapter 10) were corrupted due to a bug in
the Test262 XML conversion tool.  These have been manually updated, and a bug needs to
be filed on the tool when bugs.ecmascript.org comes back online.

Fixed an issue involving the Back button on the results page.
2010-11-13 15:22:20 -08:00
David Fugate 8feb0705ab Added a favicon as Chrome appears to be requesting this file each time a test262 test case
is run (several thousand times for one test run).
2010-11-12 19:12:31 -08:00
David Fugate 5892707de0 Fixed a comment in an IE Tester Center test case. 2010-11-12 17:19:12 -08:00
David Fugate c98e2f253b Casing of the filename, ecma-262-toc.xml, has been changed. 2010-11-12 15:12:26 -08:00
David Fugate cd651fdabc Need to change the case of the filename, ECMA-262-TOC.xml, to run test262 on a UNIX server. 2010-11-12 15:11:32 -08:00
David Fugate 0f4607001b Added all command bar options back into browserreport.html (there are assumptions about the number
and sequencing of command bar options in the backend of the site).

Also, changed the version of test262 as reported by default.html to 0.1.
2010-11-12 11:03:58 -08:00
David Fugate a7d48522e6 Removed "Browsers Report" as a title bar option in default.html. 2010-11-12 10:55:42 -08:00
David Fugate fbb888778d Quite a few modifications have been made to the test harness (website/resources/scripts/global/*)
which have resulted in it being able to run negative test cases which corrupt the global JavaScript
environment.  This lets us enable fifty plus more Sputnik test cases.  Another positive result from
this test harness refactoring is that Opera no longer hangs when running the tests.
2010-11-12 09:27:59 -08:00
David Fugate 62cde7819a Propagated changes from website\resources\scripts\global over to test\harness\*. In the future, the
website needs to be generated based on the contents of test\harness\*, not the other way around.
2010-11-03 10:22:23 -07:00
David Fugate c26f761a9f tools\TestCaseHTMLPackager\TestCasePacker.ps1: there were some improvements made to this script WRT to the
processing of unicode-related test cases.

tools\TestCaseHTMLPackager\TestUpdater.ps1:  new script which preprocesses test cases (rips out comments,
etc.)

external\contributions\Microsoft\ietestcenter_ppb5\chapter11\11.4\11.4.1\11.4.1-4.a-10.js and
website\resources\scripts\testcases\chapter11\11.4\11.4.1\11.4.1-4.a-10.js:  cleaned up a code comment

website\enginereports\sample.xml: removed

website\resources\scripts\global\jquery-1.4.2.js:  removed

website\resources\scripts\*.ps1:  moved into the tools\ directory

website\Web.config:  removed.  This is only relevant for Windows-based hosting of test262

website\browserreport.html:  removed
2010-11-03 10:10:47 -07:00
dave fugate a9aa8cf961 Test... 2010-11-02 11:46:00 -07:00
David Fugate 31a27896b8 A number of bugs in the Test262 harness are fixed with this check-in. 2010-11-01 16:28:46 -07:00
David Fugate 7396642963 This commit includes Microsoft's initial contributions to Test262:
- external\contributions\: test contributions to Test262 from external entities such as Microsoft and Google.
                           This directory consists of the external tests without any modifications
- test\harness\:  test harness used to run Test262 tests.  Presently web-based
- test\suite\:    suite of vendor-neutral ECMAScript test cases conforming to the ES5 spec
- tools\:         among other things this includes a set of tools used to convert various external test
                  contributions to a format the Test262 test harness can consume
- website\:       an archived copy of the http://test262.ecmascript.org website
2010-10-18 20:50:07 -07:00
David Fugate fdb0cf1ed9 Removed test file. My account can commit files successfully! 2010-10-18 20:14:58 -07:00
allenwb 7cdb22473f Test comit message. 2010-10-13 20:54:02 -07:00