2315 Commits

Author SHA1 Message Date
Ms2ger
59bc1d6a2f Intl.RelativeTimeFormat: Add a basic test for the functionality of supportedLocalesOf().
This is based on test/intl402/NumberFormat/supportedLocalesOf/basic.js.
2018-08-10 17:21:08 +02:00
Ms2ger
48d95ac3c4 Intl.RelativeTimeFormat: Add some tests for the 'narrow' style. 2018-08-04 11:10:19 -04:00
Ms2ger
1e8d69f0fa Intl.RelativeTimeFormat: Test for grouping in long numbers.
The specification was changed to remove the useGrouping option in
<https://github.com/tc39/proposal-intl-relative-time/pull/81>.

The change to remove the minimumIntegerDigits option in that PR was already
taken into account; this commit also removes the reference to the issue.

This also removes some commented-out code that was left in by accident.
2018-08-04 11:09:20 -04:00
Ms2ger
fd666c5048 Intl.RelativeTimeFormat: Add some en-US-specific tests for format/formatToParts. 2018-07-27 13:09:44 -04:00
Ms2ger
604df708b3 Intl.RelativeTimeFormat: Add some tests for format, formatToParts, and resolvedOptions. 2018-07-27 13:02:00 -04:00
Ms2ger
8e15f532e1 Intl.NumberFormat: Update another test for negative zero.
The specification was updated in https://github.com/tc39/ecma402/pull/232.
2018-07-27 13:00:04 -04:00
Rick Waldron
588459fc34 Generate tests 2018-07-25 12:19:29 -04:00
Rick Waldron
64f219b666 Features: run feature detector to verify newly added feature flags 2018-07-25 12:16:49 -04:00
Rick Waldron
c6d7d66dfa Merge branch 'feature-new.target' of https://github.com/IgnoredAmbience/test262 into IgnoredAmbience-feature-new.target
* 'feature-new.target' of https://github.com/IgnoredAmbience/test262:
  Add feature flags for `new.target`
2018-07-25 11:54:58 -04:00
Thomas Wood
2d4ac25fa0 Add feature flags for new.target
Additionally removed the `arrow-function` feature for
test/language/eval-code/direct/new.target-fn.js as it is not testing
arrow-functions, but they are mentioned in the preamble.
2018-07-24 20:31:35 +01:00
Leo Balter
6335c39ade fixes after rebase 2018-07-24 15:03:54 -04:00
Leo Balter
1452a22a02 more s/wake/notify 2018-07-24 15:03:54 -04:00
Leo Balter
d8bbc281dd First renaming for wake to notify in the wait folder 2018-07-24 15:03:54 -04:00
Leo Balter
4911c6e77a Last renamings in the Atomics/wake folder 2018-07-24 15:03:54 -04:00
Leo Balter
6533378823 Atomics.wake to Atomics.notify 2018-07-24 15:03:54 -04:00
Leo Balter
003388e36e Replace esid 2018-07-24 15:03:54 -04:00
Leo Balter
cdfc67cd9d Move Atomics/wake to Atomics/notify 2018-07-24 15:03:54 -04:00
Leo Balter
d1ad8e8fbc
fix features tag (#1647) 2018-07-24 01:15:26 -04:00
Rick Waldron
2d27462e70 Features: Proxy, Reflect (See pull/1643) (#1646)
Follow up to https://github.com/tc39/test262/pull/1643
2018-07-20 18:42:39 -04:00
Thomas Wood
d817076ddb Make Proxy/ownKeys tests ES5-parsable. (#1644)
All other Proxy tests use the syntax `attr: function() {...}` for
defining traps, ownKeys was unique in using the shorthand syntax. Change
to longhand syntax for back-compat for partial implementations.
2018-07-20 18:40:10 -04:00
Thomas Wood
4f3cbc756d Add a missing Reflect feature flag.
Proxy/deleteProperty/boolean-trap-result-boolean-true.js was missing a
feature flag for the Reflect library.
2018-07-20 15:04:21 -04:00
Ms2ger
764eb4f8b9 Intl.RelativeTimeFormat: Add tests for invalid units in format/formatToParts. 2018-07-20 15:00:30 -04:00
Ivan Vyshnevskyi
56e0ef70a5 Fix the ranges of non-HexDigits in decodeURI and decodeURIComponent tests 2018-07-20 14:59:31 -04:00
Ms2ger
94b1e80ab3 Intl.RelativeTimeFormat: Add a test for the return value of supportedLocalesOf() 2018-07-13 20:18:12 -04:00
Mike Pennisi
ccaa9571ea Refactor string literal test for parsers
Thsi test for the parsing of string literals was expressed using `eval`.
This made the test more complex than necessary and also prevented the
test from providing value to ECMAScript parsers.

Remove the use of `eval` and instead express the expectation with
literal source text.
2018-07-13 16:17:19 -04:00
Mike Pennisi
4f1e628107 Remove erroneous test
This test is technically valid because it does trigger a SyntaxError in
conforming runtimes. However, it was authored and documented to test
LegacyOctalEscapeSequence, but due to an apparent typo, it actually
demonstrates an unrelated parsing error.

Because 'legacy-octal-escape-sequence-stricts.js' sufficiently tests the
restriction on LegacyOctalEscapeSequence, remove this test rather than
correct it.
2018-07-13 16:17:19 -04:00
Mike Pennisi
4e1a860abd Remove redundant test
This test for string literals asserts the restriction on
LegacyOctalEscapeSequence in strict mode. It is not sufficiently
distinct from the test 'legacy-octal-escape-sequence-stricts.js' to
warrant inclusion in the test suite. Because that test includes much
more thorough documentation, it should be preferred.
2018-07-13 16:17:19 -04:00
Mike Pennisi
2facd45c76 Remove redundant and indirect tests
A number of tests for string literals assert the restriction on
LegacyOctalEscapeSequence in strict mode code and differ only in the
escape sequence under test. Although each is valid, none of the escape
sequences are sufficiently distinct from the test
'legacy-octal-escape-sequence-stricts.js' to warrant their inclusion in
the test suite. Because that test's use of literal code makes it
consumable by parsers and because that test includes much more thorough
documentation, it should be preferred.

Summary of LegacyOctalEscapeSequences under test in the removed files:

    test/language/literals/string/7.8.4-10-s.js: eval('var x = " \\10 ";');
    test/language/literals/string/7.8.4-11-s.js: eval('var x = "\\16";');
    test/language/literals/string/7.8.4-12-s.js: eval('var x = "\\17";');
    test/language/literals/string/7.8.4-13-s.js: eval('var x = "\\30";');
    test/language/literals/string/7.8.4-14-s.js: eval('var x = "\\31";');
    test/language/literals/string/7.8.4-15-s.js: eval('var x = "\\37";');
    test/language/literals/string/7.8.4-16-s.js: eval('var x = "\\400";');
    test/language/literals/string/7.8.4-17-s.js: eval('var x = "\\411";');
    test/language/literals/string/7.8.4-18-s.js: eval('var x = "\\43a";');
    test/language/literals/string/7.8.4-19-s.js: eval('var x = "\\463";');
    test/language/literals/string/7.8.4-2-s.js:  eval('var x = "\\1";');
    test/language/literals/string/7.8.4-20-s.js: eval('var x = "\\474";');
    test/language/literals/string/7.8.4-21-s.js: eval('var x = "\\77";');
    test/language/literals/string/7.8.4-22-s.js: eval('var x = "\\777";');
    test/language/literals/string/7.8.4-23-s.js: eval('var x = "\\000";');
    test/language/literals/string/7.8.4-24-s.js: eval('var x = "\\001";');
    test/language/literals/string/7.8.4-25-s.js: eval('var x = "\\106";');
    test/language/literals/string/7.8.4-26-s.js: eval('var x = "\\207";');
    test/language/literals/string/7.8.4-27-s.js: eval('var x = "\\377";');
    test/language/literals/string/7.8.4-28-s.js: eval('var x = "\\376";');
    test/language/literals/string/7.8.4-29-s.js: eval('var x = "\\3760";');
    test/language/literals/string/7.8.4-3-s.js:  eval('var x = "a\\4";');
    test/language/literals/string/7.8.4-32-s.js: eval('var x = "\\1\\1";');
    test/language/literals/string/7.8.4-33-s.js: eval('var x = "\\1\\2\\7";');
    test/language/literals/string/7.8.4-4-s.js:  eval('var x = "z\\7";');
    test/language/literals/string/7.8.4-5-s.js:  eval('var x = "\\00a";');
    test/language/literals/string/7.8.4-6-s.js:  eval('var x = "\\01z";');
    test/language/literals/string/7.8.4-7-s.js:  eval('var x = "a\\03z";');
    test/language/literals/string/7.8.4-8-s.js:  eval('var x = " \\06";');
2018-07-13 16:17:19 -04:00
Mike Pennisi
3383ba9c1b Extend metadata with esid 2018-07-13 16:09:19 -04:00
Mike Pennisi
6e9cf3765b Add tests for parsing behavior
Test262 already includes tests to ensure the correct runtime semantics
for these forms. Add equivalent tests designed to verify that the
equivalent parsing behavior is also observed.
2018-07-13 16:09:19 -04:00
Mike Pennisi
a9cd42018f Simplify tests for runtime semantics
Verify runtime semantics through assignment to an unresolvable
reference, reducing the complexity of tests that previously relied on
the semantics of the `eval` function.
2018-07-13 16:09:18 -04:00
Mike Pennisi
0618779cb8 Normalize coverage
Promote consistency in coverage by adding new tests that correspond to
those that were authored previously.
2018-07-13 16:09:18 -04:00
Mike Pennisi
0a5b378cff Rename tests for clarity 2018-07-13 14:08:54 -04:00
Leo Balter
0fde488bb4
Update tests for CharacterClassEscapes in RegExps (#1611) 2018-07-09 12:30:33 -04:00
Mathias Bynens
c7ac073e73 Update tests for RegExp Unicode property escapes (#1633)
62cbe2f1cb
2018-07-09 12:26:53 -04:00
Rick Waldron
23925f86a0
Merge pull request #1628 from Ms2ger/NumberFormat-negzero
Update the test for negative zero in NumberFormat.
2018-07-06 14:48:10 -04:00
Rick Waldron
2e007144ba
Merge pull request #1627 from Ms2ger/RelativeTimeFormat-options-proto
Add tests for objects created in the RelativeTimeFormat constructor.
2018-07-06 14:47:40 -04:00
Rick Waldron
47f9008bd3
Merge pull request #1626 from Ms2ger/RelativeTimeFormat-options
Add some more tests for the options argument to the  RelativeTimeForm…
2018-07-06 14:46:49 -04:00
Rick Waldron
7676b1b48e
Merge pull request #1625 from Ms2ger/Segmenter-@@toStringTag
Add a test for Intl.Segmenter.prototype[@@toStringTag].
2018-07-06 14:45:29 -04:00
Rick Waldron
221f212903
Merge pull request #1624 from Ms2ger/ListFormat-@@toStringTag
Add a test for Intl.ListFormat.prototype[@@toStringTag].
2018-07-06 14:44:51 -04:00
Ms2ger
65f2d5e8c2 Update the test for negative zero in NumberFormat.
The specification was updated in https://github.com/tc39/ecma402/pull/232.
2018-07-06 17:29:17 +02:00
Ms2ger
df41a35c79 Add tests for objects created in the RelativeTimeFormat constructor.
The specification was changed in https://github.com/tc39/proposal-intl-relative-time/pull/79.
2018-07-06 16:46:28 +02:00
Ms2ger
f8b6b929df Add some more tests for the options argument to the RelativeTimeFormat constructor. 2018-07-06 15:00:15 +02:00
Ms2ger
b46778dc0f Add a test for Object.prototype.toString with Intl.ListFormat objects. 2018-07-06 12:31:16 +02:00
Ms2ger
02f20f4e11 Add a test for Object.prototype.toString with Intl.Segmenter objects. 2018-07-06 12:29:43 +02:00
Ms2ger
aa7b3a5d02 Add a test for Object.prototype.toString with Intl.RelativeTimeFormat objects. 2018-07-06 12:27:48 +02:00
Ms2ger
d258fcd3ba Add a test for Intl.Segmenter.prototype[@@toStringTag].
This was added to the specification in https://github.com/tc39/proposal-intl-segmenter/pull/29.
2018-07-06 12:23:39 +02:00
Ms2ger
46a0ff6e41 Add a test for Intl.ListFormat.prototype[@@toStringTag].
The specification changed in https://github.com/tc39/proposal-intl-list-format/pull/13.
2018-07-06 12:06:38 +02:00
Ms2ger
6092c08ade Update expectation for Intl.RelativeTimeFormat.prototype[@@toStringTag].
The specification changed in https://github.com/tc39/proposal-intl-relative-time/pull/77.
2018-07-06 11:45:20 +02:00
André Bargull
8bc4e38a48 Make Atomics tests more resilient against intermittent failures (#1617)
Also fixes multiple issues and bugs in various Atomics tests.

CONTRIBUTING.md and INTERPRETING.md:
- Add missing description for `CanBlockIsFalse` flag and also introduce `CanBlockIsTrue` flag which is needed for some tests (see below).

harness/atomicsHelper.js:
- Updated `$262.agent.waitUntil` to clarify it can also be called with BigInt64Array objects.
- Added `$262.agent.timeouts` constants to unify the various, inconsistently used timeouts in the Atomics tests. Each timeout constant has a brief description and a usage example to clarify when it should or should not be used. The default values were tested in SpiderMonkey (locally and CI) under various system load levels and should hopefully also be valid for other engines. 
- Added `$262.agent.tryYield` to yield control from the main thread. The default implementation simply calls `$262.agent.sleep`, but test262 hosts could theoretically provide a different implementation.
- Added `$262.agent.trySleep` to replace direct calls to `$262.agent.sleep` from the main thread. Motivation for this function: Some test262 hosts (like browsers) may be able to pause and sleep on the main thread, so they could provide their implementation for `trySleep` which performs a busy-wait or something do nothing.

harness/testAtomics.js:
- Replace `let`, `arrow-functions`, and `for-of` loops to avoid creating extremely long `features` lists in tests using this helper. Removed `Map`, `WeakMap`, `Set`, and `WeakSet` (these weren't even listed in features.yaml) for the same reason and added the missing `Symbol` entry for this file to features.yaml.
- Updated all files including "harness/testAtomics.js" to match the new feature requirements.


test/built-ins/Atomics/store/good-views.js and test/built-ins/Atomics/store/bigint/good-views.js:
- Replace `arrow-functions` and `for-of` loops with ES5 alternatives.


test/built-ins/Atomics/wait/bigint/*.js and test/built-ins/Atomics/wake/bigint/*.js
- Some tests were using `BigInt64Array.BYTES_PER_ELEMENT * 8` for the SharedArrayBuffer length, but their non-BigInt counterparts are using `Int32Array.BYTES_PER_ELEMENT * 4`. For consistency and to make it easier to compare the BigInt against the non-BigInt versions, I've changed it to `BigInt64Array.BYTES_PER_ELEMENT * 4`.
- Also aligned formatting and statement placement when they differed between the non-BigInt and the BigInt version of a test file. (I've diffed some of the non-BigInt and BigInt files against each other and different formatting was a nuisance.)

Test files using `$262.agent.monotonicNow()`:
- Moved `$262.agent.report()` calls outside of the block of code measured `$262.agent.monotonicNow()` to avoid measuring how long it takes to execute `$262.agent.report()`. 
- Without this change some tests failed intermittently in certain test configurations in SpiderMonkey. For example with the flags `--ion-eager -- ion-offthread-compile=off` which forces early Ion compilation on the main thread. The `$262.agent.report()` implementation in the SpiderMonkey test262 host embedding uses a for-loop which was forcefully Ion compiled under these settings. And because Ion compilation can take some time, the test case ran longer than `$262.agent.MAX_TIME_EPSILON` which lead to intermittent failures.

Test files using `CanBlockIsFalse` / `CanBlockIsTrue`:
- Some of these tests actually expected that the main thread can wait and [[CanBlock]] is `true` for the agent record executing the test. Therefore I've added a new `CanBlockIsTrue` flag and replaced the flags where needed.

test/built-ins/Atomics/wait/**/*.js and test/built-ins/Atomics/wake/**/*.js:
- Use an atomic counter `RUNNING` in more tests to have better control when a worker agent was actually started.
- Replace the various `$262.agent.sleep(/* Sleep X ms to ensure worker actually sleeps */)` calls with the new `$262.agent.tryYield()` function. This `X` was sometimes as low as 10 milliseconds, which is definitely too short for CI systems under heavy load (observed by intermittent CI failures for SpiderMonkey) and sometimes as high as 500 milliseconds, which is probably much longer than needed even when the system is under heavy load. 
- Removed duplicate strings in assertion messages, presumably from copy-pasting the messages between different files.
- Removed extra empty lines at the end of multiple files.

test/built-ins/Atomics/wake/bad-range.js, test/built-ins/Atomics/wake/bigint/bad-range.js, and test/built-ins/Atomics/wait/bigint/non-bigint64-typedarray-throws.js:
- Removed unnecessary `features` and `includes` from this file.

test/built-ins/Atomics/wait/waiterlist-order-of-operations-is-fifo.js and test/built-ins/Atomics/wait/bigint/waiterlist-order-of-operations-is-fifo.js:
- The test was actually broken and didn't test what it said it does. This probably explains #1530.
- The test wants to ensure the waiterlist is implemented as a FIFO structure. This requires that the waiting agents all wait on the same index position, because the waiterlists are defined by each index. But if the agents wait on different indices, each agent is inserted into a different FIFO structure and therefore we can't observe any FIFO ordering between the agents when they're woken up.
- All this requires a bit of synchronization between the main agent and the waiting agent, I hope the added comments help to review these changes.

test/built-ins/Atomics/wait/good-views.js:
- The agent sends multiple reports to the main agent, but only the first one was read.
- This error was introduced during previous refactorings. I've changed it to back to use a while-loop as used in the first version of this file.

test/built-ins/Atomics/wait/no-spurious-wakeup-no-operation.js:
- Only the BigInt version of this test was present, copied it so we also get code coverage for the non-BigInt case.

test/built-ins/Atomics/wait/waiterlist-block-indexedposition-wake.js:
- Added extra while loops to avoid intermittent failures when the agent worker haven't started to wait.
- This should help to avoid some of the intermittent failures we saw for SpiderMonkey.

test/built-ins/Atomics/wake/wake-all-on-loc.js and test/built-ins/Atomics/wake/bigint/wake-all-on-loc.js:
- This test was also no longer after previous refactoring sessions.
- The "B" agent only waited for 10 milliseconds, which made it likely that it already timed out before the main agent was able to call `Atomics.wake`, which in turn rendered the test useless, because the test case wants to ensure that `Atomics.wake` cannot wake "B". But if "B" was already timed out, it can trivially not be woken by `Atomics.wake`.
- Added some safety measure to catch the case when "B" timed out before `Atomics.wake` was called and made it a test error if that happens.

test/built-ins/Atomics/wake/count-defaults-to-infinity-missing.js, test/built-ins/Atomics/wake/count-defaults-to-infinity-undefined.js, and test/built-ins/Atomics/wake/undefined-index-defaults-to-zero.js:
- Changed the `$262.agent.start()` calls to use a for-loop to avoid code duplication.
- (Forgot to undo the code formatting around `assert.sameValue`, still need to change it back.)
- Also more while-loops around `Atomics.wake`.
- These changes should fix #1529 and #1566.

test/built-ins/Atomics/wake/wake-all.js:
- Removed "B" worker agent.
- Without this removal the test case would be exactly equal to test/built-ins/Atomics/wake/wake-all-on-loc.js.

test/built-ins/Atomics/wake/wake-in-order-one-time.js:
- Add for-loops to avoid code duplication and make the test more readable.
- Make the `Atomics.wake` assertion messages unique by adding the current loop counter.
- Add `$262.agent.tryYield()` to give the worker agents enough time to actually start waiting.

test/built-ins/Atomics/wake/wake-in-order.js:
- Removed the outer loop `attempt < 10` because it uses `$262.agent` in a way currently not required to work. And which actually also doesn't work in SpiderMonkey's implementation of `$262.agent`.
- According to INTERPRETING.md `$262.agent.broadcast()` broadcasts its message to all agents ever started by `$262.agent.start()` and then blocks until all agents received the broadcast. It is not required that the agents started by the first `$262.agent.broadcast()` call will all be disabled/destroyed/whatever when the second `$262.agent.broadcast()` call occurs, which then means the second `$262.agent.broadcast()` call still tries to reach the agents started in the first loop iteration, but these may no longer accept broadcasts and therefore won't acknowledge they've received the broadcast. Which then means the second `$262.agent.broadcast()` call waits forever.
2018-07-03 12:34:54 -04:00