Commit Graph

195 Commits

Author SHA1 Message Date
David Fugate e45ca2e0f3 https://bugs.ecmascript.org/show_bug.cgi?id=266 and https://bugs.ecmascript.org/show_bug.cgi?id=270 resolved. 2012-02-27 16:45:56 -08:00
David Fugate c984466e4f Re-gen'ed website (+389 new tests). 2012-02-27 15:48:35 -08:00
David Fugate c64d7b5758 https://bugs.ecmascript.org/show_bug.cgi?id=274
Fixed.

Re-gen'ed the website.
2012-02-24 15:40:42 -08:00
David Fugate e0d156d38c Implemented the following work items:
- https://bugs.ecmascript.org/show_bug.cgi?id=44
- https://bugs.ecmascript.org/show_bug.cgi?id=45
2012-02-22 11:53:29 -08:00
David Fugate 7b1eb0dce6 Regen'ed website. 2012-02-08 15:35:16 -08:00
David Fugate 37ebff11ed Regen'ed website. 2012-02-03 15:23:28 -08:00
David Fugate 0ff258fa1d Experimental test402 (internationalization testing) page added. 2012-01-25 14:29:00 -08:00
David Fugate 279825ea44 Added experimental test402 support (JS internationalization standard). 2012-01-25 14:04:40 -08:00
David Fugate d7619456fa Generate one *.html per *.json in addition to the default.html which includes all tests.
Added support to create testcases_bestPractice.html without also adding them to default.html.

Preliminary support for tests under test/suite/internationalization has been added.
2012-01-19 16:03:21 -08:00
David Fugate 98a0b9e10e S8.5_A13_T1 is implementation dependent (cannot pass on current ARM
architectures), but worth keeping around for the coverage it provides.
Documented that this is expected to fail on ARM.
2012-01-18 12:16:09 -08:00
David Fugate e6f9015301 Last two invalid test cases have been fixed. 2012-01-16 14:06:17 -08:00
David Fugate 4d241e4bec S7.8.5_A3.1_T7 through S7.8.5_A3.1_T9 were invalid as written. The only way to specify unicode flags
to literal regexp patterns is through eval and similar mechanisms (e.g., Function constructor).  Fixed.

All but two of the remaining disabled tests in excludelist.xml were disabled because the tests polluted
the global JS environment, not because the tests themselves were invalid.  This is no longer an issue as
of the latest test262 harness (actually it wasn't an issue about a year ago either).  Re-enabled.
2012-01-16 12:51:55 -08:00
David Fugate a180d5f371 https://bugs.ecmascript.org/show_bug.cgi?id=61 is fixed. 2012-01-16 11:17:05 -08:00
David Fugate 9e00383b5f Two more issues called out in excludelist.xml are gone. 2012-01-13 15:48:35 -08:00
David Fugate 42737015f4 https://bugs.ecmascript.org/show_bug.cgi?id=75 2012-01-13 15:15:29 -08:00
David Fugate 9dbc4e9821 Test harness changes last Fall enabled execution of this===theGlobalObject Sputnik tests again.
Also, two of this weren't actually this-related.  Fixed their separate issues.
2012-01-13 14:54:45 -08:00
David Fugate 7e7ebe85f2 https://bugs.ecmascript.org/show_bug.cgi?id=60 2012-01-13 13:31:45 -08:00
David Fugate e394b50364 Rest of https://bugs.ecmascript.org/show_bug.cgi?id=23 fix. 2012-01-13 11:33:05 -08:00
David Fugate d8add6e8c6 https://bugs.ecmascript.org/show_bug.cgi?id=14 fixed. 2012-01-13 09:51:10 -08:00
David Fugate fb301f6f8e https://bugs.ecmascript.org/show_bug.cgi?id=7 2012-01-13 09:42:02 -08:00
David Fugate e28b10e5a6 https://bugs.ecmascript.org/show_bug.cgi?id=218 resolved. 2012-01-12 16:39:35 -08:00
David Fugate 5254b88b29 https://bugs.ecmascript.org/show_bug.cgi?id=26 is fixed. 2012-01-05 09:17:14 -08:00
David Fugate 7700283145 Regen'ed website reflecting 11/18/11 changes. 2011-11-28 11:15:27 -08:00
David Fugate fd38135510 Merge. 2011-11-11 11:58:16 -08:00
David Fugate 5df3134fac Fixed https://bugs.ecmascript.org/show_bug.cgi?id=207. 2011-11-11 11:40:05 -08:00
David Fugate 4e74861ccb Updated Microsoft's test262 contributions reflecting the IE10 PPB4 update to IE Test Center.
77 new (mostly) strict mode tests plus the removal of one invalid test case.

Sputnik and IE Test Center tests now live side-by-side in ch* directories under test/suite.
2011-11-04 12:46:23 -07:00
David Fugate 43b58c99d0 Preserve only the first line of each test case's copyright header
when encoding to JSON which coincidentally preserves the BOM as well.
This shaved ~10 megs off of chapter15.json alone.
2011-11-04 12:04:46 -07:00
David Fugate dc9bd9601b Fewer Json files (experiment...). 2011-10-03 16:01:47 -07:00
David Fugate 5a665767e6 Re-gen'ed website using new Sputnik directory names. 2011-10-03 13:31:15 -07:00
David Fugate 6c9436f977 Re-gen'ed website. 2011-10-03 12:08:06 -07:00
Mark Miller 68f00c57a3 Just change in generated formatting 2011-09-30 04:03:28 -04:00
David Fugate a8625046d2 Re-enabled 12 tests. 2011-09-27 12:52:17 -07:00
David Fugate ffa85c2584 Moved all test helper functions into sta.js; removed sputnikLib.js.
Laid down the groundwork for a console-based test runner.
2011-09-26 16:12:46 -07:00
David Fugate 352d86b8ed Support not-NotEarlyError as well. 2011-09-25 17:05:32 -07:00
David Fugate 515ed58d60 Fixed bug in generated IETC test cases regarding NotEarlyError. 2011-09-25 16:25:20 -07:00
David Fugate 209657430d Re-gen'ed website. 2011-09-25 16:21:18 -07:00
David Fugate 19ec143b0d Do not put 'best practice' tests on the live website. 2011-09-25 15:37:56 -07:00
David Fugate 77e7297a21 Re-gen'ed website. 2011-09-25 15:06:48 -07:00
David Fugate ba41d38511 Regenerated website using new package.py and test/suite/converted. 2011-09-25 11:41:04 -07:00
David Fugate 54b6ae5e9c Moved resources and images directories (from website) up a couple levels.
Added new 'packaging' directory to tooling.
2011-09-24 11:47:48 -07:00
David Fugate 4fcd9a836d https://bugs.ecmascript.org/show_bug.cgi?id=34. Fixed 2011-09-23 16:27:46 -07:00
David Fugate 382f5c17e6 https://bugs.ecmascript.org/show_bug.cgi?id=5. Fixed 2011-09-23 15:10:53 -07:00
David Fugate 1b3e926837 Think I've come up with a fix for https://bugs.ecmascript.org/show_bug.cgi?id=11 (Date_library.js):
- juneDate and decemberDate were both one month off.  Fixed
- LocalTZA wasn't actually LocalTZA as defined in ES5.  If we were in DST when
  this was created, LocalTZA was off by one hour.  Fixed
- GetSundayInMonth was completely busted (i.e., arithmetic operations on the 'count'
  param which happens to be a string).  Fixed(?)
- DaylightSzavingTA was defined incorrectly.  It assumed the local time zone adjustment
  hadn't been accounted for.  This wasn't how UTC was calling it.  Fixed(?)
2011-09-22 11:58:06 -07:00
David Fugate ec5dce172d From the 'Run' tab, there's now a clickable 'Error' link showing precisely what
failed.
2011-09-22 11:43:39 -07:00
David Fugate 0937e10a03 Improved global scope 'missing error' error message. 2011-09-22 11:41:30 -07:00
David Fugate 0b0736cbee S11.1.1_A2 (https://bugs.ecmascript.org/show_bug.cgi?id=179) 2011-09-14 10:45:46 -07:00
David Fugate f381e5a4b1 Re-gen'ed website. 2011-09-13 16:37:30 -07:00
David Fugate 33a175689e Rebuilt website. 2011-09-12 13:34:49 -07:00
David Fugate 807a3ba1b7 Merge. 2011-09-12 11:25:23 -07:00
David Fugate 2c16b93983 Re-added tests disabled by https://bugs.ecmascript.org/show_bug.cgi?id=126. 2011-09-12 10:02:51 -07:00
Mark Miller 9fab5f9a3a Much rougher: A first attempt at building the testcases for the website based on the new canonical test262 style testcase. 2011-09-07 00:02:16 -07:00
David Fugate 2871886420 test\harness\*:
- a lot of JS harness code written in strings have been moved out to actual physical files
  such as ed.js (syntax error detection for globally scoped tests) and gs.js (global scope test
  case validator).  This change makes it far easier to maintain the test harness code
- reorganized helper.js providing a clear indication which methods are used by external objects,
  which are implementation details, and which are unequivocally test262-specific.  I've also added,
  openErrorWindow, which will be used to open a descriptive error message window for each test case
  failure reported on the 'Run' tab
- improved the error message for syntax errors occurring when a test case fails to load
- sta.js no longer tries to pickle all helper functions it contains!  Instead, we load the file
  directly from sth.js.  The performance of fnGlobalObject has been improved.  Finally, the ES5Harness
  object has been moved from sth.js (in a string) to here
- sth.js now has a browser implementer hook, controller.implementerHook, which allows browser implementers
  to handle test case failures in their own way (e.g., log to the filesystem).  The 'run' function was
  basically re-written

Added 37 new test cases from the "IE Test Center" Build release.  There were 14 modifications to
existing test cases as well.  Refactored SputnikGlobalScope.js such that test case paths are now used
as indices into the GlobalScopeTests array.

TestCasePackager.py had the concept of templated test harnesses introduced - see templates\runner.test262.html.
Also added support for one HTML test harness per ES5 chapter.  Last but not least, TestCasePackagerConfig.py
now has a 'source control' abstraction class which abstracts away source control adds|edits when dynamically
generating *.json and *.html test chapters.
2011-08-25 11:18:44 -07:00
David Fugate bda89b6452 https://bugs.ecmascript.org/show_bug.cgi?id=127 2011-07-18 10:59:06 -07:00
David Fugate 5b2de8816f https://bugs.ecmascript.org/show_bug.cgi?id=126 2011-07-18 10:29:23 -07:00
David Fugate 009262deba https://bugs.ecmascript.org/show_bug.cgi?id=128 2011-07-18 09:15:03 -07:00
David Fugate 383aaca3b1 https://bugs.ecmascript.org/show_bug.cgi?id=133 2011-07-18 09:05:23 -07:00
David Fugate 9eb6c8c2d2 15.4.4.15-3-14, 15.4.4.15-3-29, and 15.4.4.15-3-8 were disabled with no reason or bug given. These actually look OK,
and pass on all browsers...
2011-07-08 16:02:19 -07:00
David Fugate 58466ad144 Changed the website reported version number back to 0.7.5.2 (live website is at 0.7.5.1). 2011-07-07 14:43:28 -07:00
David Fugate d848bcad16 Recent update from Sputnik has made S12.10_A3.3_T4 a valid ES5 test. Re-enabled 2011-07-07 13:42:04 -07:00
David Fugate a442fb1509 More Sputnik tests have been fixed and enabled. 2011-07-07 12:58:55 -07:00
David Fugate 314a8abb70 https://bugs.ecmascript.org/show_bug.cgi?id=12 is partially fixed. 2011-07-07 10:38:08 -07:00
David Fugate c77066fc25 https://bugs.ecmascript.org/show_bug.cgi?id=118 2011-07-07 08:47:12 -07:00
David Fugate 6224968765 https://bugs.ecmascript.org/show_bug.cgi?id=120 2011-07-07 08:34:41 -07:00
David Fugate aa4b085528 https://bugs.ecmascript.org/show_bug.cgi?id=117
Disabled 9 invalid tests.
2011-07-06 11:00:55 -07:00
David Fugate 09ea4a8413 https://bugs.ecmascript.org/show_bug.cgi?id=61 2011-07-05 16:39:32 -07:00
David Fugate c8559941b2 https://bugs.ecmascript.org/show_bug.cgi?id=61 2011-07-05 16:36:04 -07:00
David Fugate a4a9057358 Added a reference to the new FAQ on the ES Wiki. 2011-07-01 14:18:35 -07:00
David Fugate 8b0704e64c https://bugs.ecmascript.org/show_bug.cgi?id=87 *should* in theory be fixed now. Need to test
on the live website to be sure.
2011-07-01 12:01:55 -07:00
David Fugate 42b534663f Added a small script, InvalidTestDetector.py, to help detect test dependencies on DOM and
host objects (which make them invalid for test262).  Using this, I found one benign 'alert'
usage (it was never even called) and removed it.
2011-06-30 14:31:11 -07:00
David Fugate 4cbb71f6b0 An ActiveX test slipped into IE Test Center/test262 by mistake. Removed 2011-06-30 09:59:25 -07:00
David Fugate 254821616f Added a few missing test case descriptions. 2011-06-29 12:02:57 -07:00
David Fugate 0e187575b1 Regenerated website. 2011-06-29 11:30:40 -07:00
David Fugate b78c959d2a New Sputnik 'negative' metadata that included exception type was causing problems for SputnikConverter.
Took the easy fix and split the metadata into two: 'negative' and 'errortype'.
2011-06-29 11:11:12 -07:00
David Fugate 55855b285e Updated test262 with test case additions and edits from the PPB2 release of IE10. This included:
- 22 test case additions (mostly strict mode)
- 4 test case edits
2011-06-23 15:04:00 -07:00
David Fugate 9c0e7dd413 Test failures in the 'Run' tab now have a link to the test case's source
similar to the 'Results' tab.
2011-06-09 16:31:52 -07:00
David Fugate 33ba3d7621 Moved TEST_LIST_PATH from sth.js to default.html. 2011-06-07 09:48:10 -07:00
David Fugate c04a994e00 Added missing license header to TestCasePackager.py. Also, split
this module in two such that the configuration of the test case
packaging tool is separate from the implementation.
2011-06-02 15:41:54 -07:00
David Fugate e3da78c009 Merge... 2011-05-31 13:47:26 -07:00
David Fugate 355ffd9d54 Fixed minor typo (see https://bugs.ecmascript.org/show_bug.cgi?id=74). 2011-05-31 13:42:12 -07:00
David Fugate b084094004 https://bugs.ecmascript.org/show_bug.cgi?id=103 2011-05-25 17:27:58 -07:00
David Fugate 7732e3578e More improvements regarding https://bugs.ecmascript.org/show_bug.cgi?id=33 2011-05-25 14:11:05 -07:00
David Fugate f9ec77866a Fix for https://bugs.ecmascript.org/show_bug.cgi?id=72. 2011-05-25 13:07:43 -07:00
David Fugate 0baf9ae7f6 Seems I accidentally checked in 10.4.2-2-c-1.js.orig in addition to 10.4.2-2-c-1.js. Removed 10.4.2-2-c-1.js.orig. 2011-05-20 13:48:57 -07:00
David Fugate 33c1a02fea Original test author fixed Bug #69. 2011-05-18 15:27:12 -07:00
David Fugate 623f25e341 - disabled five invalid tests
- fixed issues in 10.6-13-a-1.js, 13.2-17-1.js, and 15.5.4.20-2-46.js.  Still have a number
  of test bugs to look into once I get more free time though
2011-05-13 08:46:20 -07:00
David Fugate 46cb0b9f54 Removed 'website' version; left in 'test suite' version displayed on the 'run' page. 2011-05-03 09:48:03 -07:00
David Fugate 994e6f3049 A previous check-in made today lost generation of 'N.0' test section directories for
tests covering a given chapter, N, without delving into subsections.  This in turn
broken the Results page which was by default displaying individual results for chapters
13(.0) and 14(.0).  Fixed.
2011-04-20 16:52:14 -07:00
David Fugate ef45786a21 A major web browser does not fire window.onerror for iframes when the iframe's document
contains a JavaScript syntax error (major test area).  Added a workaround.
2011-04-20 15:39:50 -07:00
David Fugate b055423983 Removed (SputnikConverter) requirement that globally scoped tests be generated to a
'GlobalScope' directory.
2011-04-20 12:01:06 -07:00
David Fugate 545f2c34a0 *NOTE: this is a work-in-progress. Need to remove our dependency on a separate 'GlobalScope'
directory next*

SputnikConverter:
- ES5TestCase.cs
	* Case of JSON-based property names was wrong.  Fixed
	* Use the tests' 'id' instead of 'path' as the GlobalScopeTests keys
	* Added 'id' and 'path' as Global Scope test metadata.  The correct/clean solution here is to simply use 'path'
	  as the key to GlobalScopeTests, but this refactoring needs to be undertaken later when we can convert the
	  'normal' test cases over to use 'path' as the key as well
	* Turns out we cannot depend on the message received by window.onerror to have some form of "syntax"
	  contained within it.  Instead, we'll just rely on the regular expression ".", matches any one character,
	  for the short term
- SputnikTestCase.cs
	* Same case issue as for ES5TestCases.cs
	* Don't trust the Sputnik metadata for the ES5 section name or even test case id to be correct. Instead,
	  generate this information from the file path of the test case


TestCasePackager.py:
- added a new global, GLOBAL_SCOPE_FILES, which is a list of JS files found directly under test\suite\*.js
  which include metadata for so-called globally scoped tests.  These files are imported directly by the HTML
  test harness

test\suite\*:
- regenerated Sputnik tests based on new converter

default.html:
- import SputnikGlobalScope.js.  Really TestCasePackager.py should generate the global scope imports to
  default.html automatically...


website\resources\scripts\testcases\*:
- test cases have shuffled from existing *.json files into globalscope.json
2011-04-20 11:17:38 -07:00
David Fugate 7ee99fb6ce We had a duplicate copy of fnGlobalObject in both sth.js and sta.js. Left only the sta.js copy.
Regenerated the JSON files based on ietestcenter changes.
2011-04-08 09:44:12 -07:00
David Fugate 09186bafb4 84 IE Test Center test cases had corrupted 'path' properties in
their test case objects.  Created an automated tool, FixPathsAndIds.py,
to fix these.

TestCasePackager.py no longer throws when it encounters a non-*.js
file where it expects test cases.  Instead, it simply ignores it.
2011-03-30 09:48:29 -07:00
David Fugate 58fbb10d21 Ecmascript bug 60 is indeed valid and I've disabled the two related test
cases.
2011-03-23 17:27:18 -07:00
David Fugate bbc06eb6f2 Now looked at all bugs.ecmascript.org test case issues up to and
including https://bugs.ecmascript.org/show_bug.cgi?id=59.
2011-03-23 15:39:26 -07:00
David Fugate 4ec74def48 Disabled invalid tests - see https://bugs.ecmascript.org/show_bug.cgi?id=80
for details.
2011-03-23 15:19:34 -07:00
David Fugate ba59cf13be More cleanup on TestCasePackager.py. 2011-03-23 13:46:15 -07:00
David Fugate 31e2bcacf6 Partial cleanup of TestCasePackager.py. Major change is the 'json'
module is now utilized.
2011-03-23 12:48:09 -07:00
David Fugate 61343f1b93 TestCasePackager.py is a verbatim port of TestCasePackager.ps1. The
rationale behind the addition of this file is it's meant to replace
TestCasePackager.ps1 outright and will be runnable on all major
operating systems.  There's still a bit of cleanup work needed as
the Python port was hardly optimized for the language.

A few side effects of this change:
- it now takes under ten seconds to generate the test262 website (PS
  version was taking over a minute)
- generated *.json files are ~5% smaller in size (PS was forcing
  '\r\n' and the Python version preserves the tests' newlines whether
  they're '\r\n' or '\n')
2011-03-23 10:37:21 -07:00
David Fugate 2282dfba34 Fixed a typo on the main page. 2011-03-14 11:44:30 -07:00
David Fugate feccaa7ac4 Added partial support for test cases not in any particular section of an
ES5 chapter.  That is, ecma-262-toc.xml now has '.0' sections for all chapters
and I've manually modified (Sputnik Ch. 13 & 14) test case id's and paths
to utilize the '.0' suffix.  Long term, SputnikConverter needs to perform
this transformation itself though.
2011-03-11 17:42:53 -08:00