Revision history for Test-Harness 3.48 2023-10-02 - Accept TAP version 14 3.47 2023-08-13 - Add missing negation in EINTR check - Fix HARNESS_PERL_SWITCHES=-I handling in TAP::Harness::Env 3.46 2023-07-30 - Color the "ok"s as well. - Skip symlink tests on msys2 - Use use absolute path for executable tests - Space-quote executable if has spaces - Avoid using Errno::EINTR directly for platforms without it - stop calling import on App::Prove plugins 3.45_02 2023-06-01 - Avoid using Errno::EINTR directly for platforms without it 3.45_01 28-04-2023 - Color the "ok"s as well. - Skip symlink tests on msys2 - Use use absolute path for executable tests - Space-quote executable if has spaces 3.44 17-04-2022 - Release 3.43_06 as non-dev 3.43_06 11-04-2022 - Fix skipping SEGV test 3.43_05 07-04-2022 - Fix failing SEGV test on Windows 3.43_04 22-01-2022 - Remove ASCII-isms to better work on EBCDIC 3.43_03 30-07-2021 - Move timer initialization - Fix YAMLish behaviour with empty values - fix eintr error handling in TAP::Parser::Multiplexer - Parse out signal name & core dump. 3.43_02 25-03-2020 - Let the aggregator finish gracefully after bailout - Make prove respect HARNESS_VERBOSE if no verbosity flags are passed 3.42 19-03-2018 - Enable rulesfile.t to run in core 3.41 27-02-2018 - Released 3.40_01 without code modifications 3.40_01 23-07-2017 - Return handle for pipes and sockets #58 (Erik Huelsmann) - TAP v13 plan allows trailing whitespace (Steffen Schwigon) - prove: add a --statefile= option to customize the .prove file (Ævar Arnfjörð Bjarmason) - Avoid non-deterministic source handling, make a SourceHandler tie an error. (Michael Schwern, Leon Timmermans) - Fix and simplify MSWin32 colorization (Roy Ivy III) - Fix file source handler to accept single extensions option (Tomoki Aonuma) - Spelling fixes (Brian Wightman) 3.39 06-04-2017 - Make tests pass when PERL_USE_UNSAFE_INC=0 3.38 13-03-2017 - Released 3.37_01 without changes 3.37_01 - Set PERL_USE_UNSAFE_INC when running tests using Test::Harness (Leon Timmermans) - Avoid loading optional modules from . in prove 3.36 30-12-2015 - Accept YAML with trailing whitespace in header (Maik Hentsche) - Stop bundling Test::More for testing 3.35 2015-01-14 - Fix prove --version to actually print the version (Leon Timmermans, #101216) - Add --version to usage message (Leon Timmermans, #101215) 3.34 2014-11-02 - Enable printing CPU times spent per test (Jarkko Hietaniemi) 3.33 2014-08-16 - Various documentation fixes (Leon Timmermans, Justin Cook) 3.32 2014-06-11 - Remove harness_class from argument hash in T::H::E (Leon Timmermans) 3.31 2014-06-07 - Implement external rulesfile for TAP::Harness (David Golden) - Add harness_class argument to TAP::Harness::Env (Leon Timmermans) - Make prove respect environmental variables #28 (Leon Timmermans) 3.30 2013-11-12 - Fix missing parent prereq in META.{yml,json} and NotBuild.PL (Dagfinn Ilmari Mannsåker, #89650) - Respect PERL5LIB in tainting source handler test (Dagfinn Ilmari Mannsåker, Leon Timmermans) - Use base instead of parent: This dist is used for testing all other modules, so it should avoid having any non-core prerequisites. Having parent as a prereq leads to a circular dependency of parent -> Test::More -> Test::Harness. (Graham Knop) - Various POD fixes (Nathan Gary Glenn) - Don't localize all of %ENV in harness.t (Craig Berry) - Give TAP::Harness::Beyond a unique NAME (Leon Timmermans) 3.29 2013-08-10 - Get rid of use vars in favor of our in all modules (Leon Timmermans) and tests (Karen Etheridge) - Added use warnings to all modules (Leon Timmermans) and tests (Karen Etheridge) - Use parent instead of @ISA in all modules (Leon Timmermans) and tests (Karen Etheridge) - Fix failing test on VMS (Craig Berry) - Improve error message on loading failure (Leon Timmermans, #77730) - Use Text::ParseWords, deprecate TAP::Parser::Utils 3.28 2013-05-02 - Bugfix: Fix taint failures on Windows (Jan Dubois) 3.27 2013-04-30 - Dramatically reduce memory usage (Nick Clark, RT #84939) - Store test_num (in Grammar.pm) as a number instead of a string. Reduces memory usage (Nick Clark, RT #84939) - PERL5LIB is always propogated to a test's @INC, even with taint more (Schwern, RT #84377) - restore "always add -w to switches" behavior 3.26 2013-01-16 - Renamed env.opts.t to env_opts.t (for VMS) - Skipped some TAP::Formatter::HTML tests due to this bug: #82738 3.26 2012-06-05 - Rereleased to fix CPAN permission problem. No functional change. 3.24 2012-06-03 - RT #74393: corrected typo in M::B integration docs. - RT #63473: fix typo. - RT #49732: Attempt to load File::Glob::Windows to get correct glob semantics on Win32. - RT #47890: Don't use Win32::GetShortPathName. - RT #64404: Ignore textness ('-T') of script when reading shebang. - Handle the case where we don't know the wait status of the test more gracefully. - Make the test summary 'ok' line overrideable so that it can be changed to a plugin to make the output of prove idempotent. - Stop adding '-w' to perl switches by default - Apply upstream patch: http://perl5.git.perl.org/perl.git/commit \ /6359c64336d99060952232e7e300bd3c31afead8 In testargs.t in Test::Harness, don't run a world-writable file. The test writes a file, then changes the mode, then executes it. The file needs to be +x to be executable (on many platforms). The file will need to be +w to be deletable on some platforms. But setting the file world writable just before running it feels like a bad idea, given that the file's name is as predictable as process IDs, as there's a race condition to break into the account running perl's tests. 3.23 2011-02-20 - Merge in changes from core. Thanks BinGOs. - Made SourceHandler understand that an executable binary file is probably an executable. - Added workaround for Getopt::Long 2.25 handling of multivalue options. Fixes test failure on stock perl 5.6.2. 3.22 2010-08-14 - Allow TAP::Parser to recognize a nested BAIL_OUT directive. - Add brief HOWTO for creating and running pgTAP tests to TAP::Parser::SourceHandler::pgTAP. - Fix trailing plan + embedded YAML + TAP 13 case. Thanks to Steffen Schwigon. #54518. - Numerous spelling fixes. Thanks to Ville Skyttä. - Add new option --tapversion for prove to set the default assumed TAP version. Thanks to Steffen Schwigon. - Fixed tests to run successfully under Devel::Cover. Thanks to Phillipe Bruhat. - Fixed injection of test args to work with general executables as well as Perl scripts (#59186). - Allow multiple --ext=.foo arguments to prove, to allow running different types of tests in the same prove run. - App::Prove::extension() is now App::Prove::extensions(), and returns an arrayref of extensions, rather than a single scalar. The same change has been made to App::Prove::State::extension(). - Preserve old semantics for test scripts with a shebang line by favouring Perl as the intepreter for any file with a shebang (#59457). - Add --trap (summary on Ctrl-C) option to prove (#59427). - Removed TAP::Parser::SourceHandler::pgTAP. Find it in its own distribution on CPAN. - Source options to prove can now be specified so as to be passed to the source as a hash reference, eg: prove --source XYZ --xyz-option pset=foo=bar Ths "pset" option will be passed as a hash reference with the key "foo" and the value "bar". 3.21 2010-01-30 - Add test to ensure we're not depending on a module we no longer ship. - Fix up skip counts for Windows case - tests were failing on Windows. 3.20 2010-01-22 - Remove references / dependency on TAP::Parser::Source::Perl 3.19 2010-01-20 - Avoid depending on Module::Build. The resulting circular dependency made it impossible to install Test::Harness and/or Module::Build in some cases. 3.18 2010-01-19 - Handle the case where the filename of the perl executable contains space. Thanks to kmx. - Various documentation fixes. 3.17_04 2010-01-04 - Fix failures due to unknown location of Perl in t/source_handler.t. - Use EUMM style shebang magic to produce an executable 'psql' for t/source_handler.t. 3.17_03 2009-11-19 - Fix failures due to over-strict assertions in t/source.t. 3.17_02 2009-11-17 - Merge in Steve's missing changes. Oops. 3.17_01 2009-11-17 - Re-engineered source handling API to allow users to configure how TAP is sourced by the parser. Introduced a new 'sources' param to TAP::Harness, and new options to prove, eg: prove --source XYZ --xyz-option foo=bar The new TAP::Parser::SourceHandler API makes it much easier to write plugins. This breaks backwards compatibility for plugins & extenstions that rely on the following APIs: TAP::Parser::Source TAP::Parser::SourceFactory TAP::Parser::IteratorFactory TAP::Parser, specifically: new: 'source' & 'tap' params source_class perl_source_class iterator_factory_class make_source make_perl_source make_iterator Please see the TAP::Parser docs for more details. [Steve Purkis & David Wheeler] - Removed dependency on File::Spec [Schwern] - Made it possible to pass different args to each test [Lee Johnson] - Added HARNESS_SUBCLASS option to Test::Harness - Added TAP::Parser::SourceHandler::File which lets you to stream TAP from a text file (eg: *.tap). - Added TAP::Parser::SourceHandler::pgTAP. All the source handlers are new, but this is the only one to add major new functioality: the ability to run pgTAP tests (http://pgtap.projects.postgresql.org/). 3.17 2009-05-05 - Changed the 'failures' so that it is overridden by verbosity rather than the other way around. - Added the 'comments' option, most useful when used in conjunction with the 'failures' option. - Deprecated support for Perls earlier than 5.6.0. - Allow '-I lib' as well as '-Ilib' in $Test::Harness::Switches (regression). - Restore old skip parsing semantics for TAP < v13. Refs #39031. - Numerous small documentation fixes. - Remove support for fork-based parallel testing. Multiplexed parallel testing remains. 3.16 2009-02-19 - Fix path splicing on platforms where the path separator is not ':'. - Fixes/skips for failing Win32 tests. - Don't break with older CPAN::Reporter versions. 3.15 2009-02-17 - Refactor getter/setter generation into TAP::Object. - The App::Prove::State::Result::Test now stores the parser object. - After discussion with Andy, agreed to clean up the test output somewhat. t/foo.....ok becomes t/foo.t ... ok - Make Bail out! die instead of exiting. Dies with the same message as 2.64 for (belated) backwards compatibility. - Alex Vaniver's patch to refactor TAP::Formatter::Console into a new class, TAP::Formatter::File and a common base class: TAP::Formatter::Base. - Fix a bug where PERL5LIB might be put in the wrong spot in @INC. #40257 - Steve Purkis implemented a plugin mechanism for App::Prove. 3.14 2008-09-13 - Created a proper (ha!) API for prove state results and tests. - Added --count and --nocount options to prove to control X/Y display while running tests. - Added 'fresh' state option to run test scripts that have been touched since the test run. - fixed bug where PERL5OPT was not properly split - fixed regex in _filtered_inc. Fixes #39248. Thanks Slaven. 3.13 2008-07-27 - fixed various closure related leaks - made prove honour HARNESS_TIMER - Applied patches supplied by Alex Vandiver - add 'rules' switch to prove: allows parallel execution rules to be specified on the command line. - allow '**' (any path) wildcard in parallel rules - fix bug report address - make tprove_gtk example work again. 3.12 2008-06-22 - applied Steve Purkis' huge refactoring patch which adds configurable factories for most of the major internal classes. - applied David Wheeler's patch to allow exec to be a code reference. - made tests more robust in the presence of -MFoo in PERL5OPT. 3.11 2008-06-09 - applied Jim Keenan's patch that makes App::Prove::run return a rather than exit (#33609) - prove -r now recurses cwd rather than 't' by default (#33007) - restored --ext switch to prove (#33848) - added ignore_exit option to TAP::Parser and corresponding interfaces to TAP::Harness and Test::Harness. Requested for Parrot. - Implemented rule based parallel scheduler. - Moved filename -> display name mapping out of formatter. This prevents the formatter's strip-extensions logic from stripping extensions from supplied descriptions. - Only strip extensions from test names if all tests have the same extension. Previously we stripped extensions if all names had /any/ extension making it impossible to distinguish tests whose name differed only in the extension. - Removed privacy test that made it impossible to subclass TAP::Parser. - Delayed initialisation of grammar making it easier to replace the TAP::Parser stream after instantiation. - Make it possible to supply import parameters to a replacement harness with prove. - Make it possible to replace either _grammar /or/ _stream before reading from a TAP::Parser. 3.10 2008-02-26 - fix undefined value warnings with bleadperl. - added pragma support. - fault unknown TAP tokens under strict pragma. 3.09 2008-02-10 - support for HARNESS_PERL_SWITCHES containing things like '-e "system(shift)"'. - set HARNESS_IS_VERBOSE during verbose testing. - documentation fixes. 3.08 2008-02-08 - added support for 'out' option to Test::Harness::execute_tests. See #32476. Thanks RENEEB. - Fixed YAMLish handling of non-alphanumeric hash keys. - Added --dry option to prove for 2.64 compatibility. 3.07 2008-01-13 - prove now supports HARNESS_PERL_SWITCHES. - restored TEST_VERBOSE to prove. 3.06 2008-01-01 - Skip t/unicode.t if PERL_UNICODE set. Fixes #31731. Thanks Lukas. - App::Prove::State no longer complains about tests that are deleted. - --state=new and --state=old now consider the modification time of test scripts. - Made test suite core-compatible. 3.05 2007-12-09 - Skip unicode.t if Encode unavailable - Support for .proverc files. - Clarified prove documentation. 3.04 2007-12-02 - Fixed output leakage with really_quiet set. - Progress reports for tests without plans now show "143/?" instead of "143/0". - Made TAP::Harness::runtests support aliases for test names. - Made it possible to pass command line args to test programs from prove, TAP::Harness, TAP::Parser. - Added --state switch to prove. 3.03 2007-11-17 - Fixed some little bugs-waiting-to-happen inside TAP::Parser::Grammar. - Added parser_args callback to TAP::Harness. - Made @INC propagation even more compatible with 2.64 so that parrot still works *and* #30796 is fixed. 3.02 2007-11-15 - Process I/O now unbuffered, uses sysread, plays better with select. Fixes #30740. - Made Test::Harness @INC propagation more compatible with 2.64. Was breaking Parrot's test suite. - Added HARNESS_OPTIONS (#30676) 3.01 2007-11-12 - Fix for RHEL incpush.patch related failure. - Output real time of test completion with --timer - prove -b adds blib/auto to @INC - made SKIP plan parsing even more liberal for pre-v13 TAP 3.00 2007-11-06 - Non-dev release. No changes since 2.99_09. 2.99_09 2007-11-05 - Implemented TODO-in-PLAN syntax for TAP version 12 and earlier. 2.99_08 2007-11-04 - Tiny changes. New version pushed to get some smoke coverage. 2.99_07 2007-11-01 - Fix for #21938: Unable to handle circular links - Fix for #24926: prove -b and -l should use absolute paths - Fixed prove switches. Big oops. How the hell did we miss that? - Consolidated quiet, really_quiet, verbose into verbosity. - Various VMS related fixes to tests 2.99_06 2007-10-30 - Added skip_all method to TAP::Parser. - Display reason for skipped tests. - make test now self tests. 2.99_05 2007-10-30 - Fix for occasional rogue -1 exit code on Windows. - Fix for @INC handling under CPANPLUS. - Added real time to prove --timer output - Improved prove error message in case where 't' not found and no tests named. 2.99_04 2007-10-11 - Fixed bug where 'All tests successful' would not be printed if bonus tests are seen. - Fixed bug where 'Result: FAIL' would be printed at the end of a test run if there were unexpectedly succeeding tests. - Added -M, -P switches to allow arbitrary modules to be loaded by prove. We haven't yet defined what they'll do once they load but it's a start... - Added testing under simulated non-forking platforms. 2.99_03 2007-10-06 - Refactored all display specific code out of TAP::Harness. - Relaxed strict parsing of skip plan for pre v13 TAP. - Elapsed hi-res time is now displayed in integer milliseconds instead of fractional seconds. - prove stops running if any command-line switches are invalid. - prove -v would try to print an undef. - Added support for multiplexed and forked parallel tests. Use prove -j 9 to run tests in parallel and prove -j 9 --fork to fork. These features are experimental and currently unavailable on Windows. - Rationalized the management of the environment that we give to test scripts (PERL5LIB, PERL5OPT, switches). - Fixed handling of STDIN (we no longer close it) for test scripts. - Performance enhancements. Parser is now 30% - 40% faster. 2.99_02 2007-09-07 - Ensure prove (and App::Prove) sort any recursively discovered tests - It is now possible to register multiple callback handlers for a particular event. - Added before_runtests, after_runtests callbacks to TAP::Harness. - Moved logic of prove program into App::Prove. - Added simple machine readable summary. - Performance improvement: The processing pipeline within TAP::Parser is now a closure which speeds up access to the various attribtes it needs. - Performance improvement: Test count spinner now updates exponentially less frequently as the count increases which saves a lot of I/O on big tests. - More improvements in test coverage from Leif. - Fixes to TAP spooling - now captures YAML blocks correctly. - Fix YAMLish handling of empty arrays, hashes. - Renamed TAP::Harness::Compatible to Test::Harness, runtests to prove. - Fixes to @INC handling. We didn't always pass the correct path to subprocesses. - We now observe any switches in HARNESS_PERL_SWITCHES. - Changes to output formatting for greater compatibility with Test::Harness 2.64. - Added unicode test coverage and fixed a couple of unicode issues. - Additions to documentation. - Added support for non-forking Perls. If forking isn't available we fall back to open and disable stream merging. - Added support for simulating non-forking Perls to improve our test coverage. ======================================================================== Version numbers below this point relate to TAP::Parser - which was the name of this version of Test::Harness during its development. ======================================================================== 0.54 - Optimized I/O for common case of 'runtests -l' - Croak if supplied an empty (0 lines) Perl script. - Made T::P::Result::YAML return literal input YAML correctly. - Merged speed-ups from speedy branch. 0.53 18 August 2007 - Fixed a few docs nits. - Added -V (--version) switch to runtests. Suggested by markjugg on Perlmonks. - Fixed failing t/030-grammer.t under 5.9.5. Exact cause still unknown; something to do with localisation of $1 et all I think. - Fixed use of three arg open in t/compat/test-harness-compat; was failing on 5.6.2. - Fixed runtests --exec option. T::H wasn't passing the exec option to T::P. - Merged Leif Eriksen's coverage enhancing changes to t/080-aggregator.t, t/030-grammar.t - Made various changes so that we test cleanly on 5.0.5. - Many more coverage enhancements by Leif. - Applied Michael Peters' patch to add an EOF callback to TAP::Parser. - Added --reverse option to runtests to run tests in reverse order. - Made runtests exit with non-zero status if the test run had problems. - Stopped TAP::Parser::Iterator::Process from trampling on STDIN. 0.52 14 July 2007 - Incorporate Schwern's investigations into TAP versions. Unversioned TAP is now TAP v12. The lowest explicit version number that can be specified is 13. - Renumbered tests to eliminate gaps. - Killed execrc. The '--exec' switch to runtests handles all of this for us. - Refactored T::P::Iterator into T::P::Iterator::(Array|Process|Stream) so that we have a process specific iterator with which to experiment with STDOUT/STDERR merging. - Removed vestigial exit status handling from T::P::I::Stream. - Removed unused pid interface from T::P::I::Process. - Fixed infinite recursion in T::P::I::Stream and added regression coverage for same. - Added tests for T::P::I::Process. - TAP::Harness now displays the first five TAP syntax errors and explains how to pass the -p flag to runtests to see them all. - Added merge option to TAP::Parser::Iterator::Process, TAP::Parser::Source, TAP::Parser and TAP::Harness. - Added --merge option to runtests to enable STDOUT/STDERR merging. This behaviour used to be the default. - Made T::P::I::Process use open3 for both merged and non-merged streams so that it works on Windows. - Implemented Eric Wilhelm's IO::Select based multiple stream handler so that STDERR is piped to us even if stream merging is turned off. This tends to reduce the temporal skew between the two streams so that error messages appear closer to their correct location. - Altered the T::P::Grammar interface so that it gets a stream rather than the next line from the stream in preparation for making it handle YAML diagnostics. - Implemented YAML syntax. Currently YAML may only follow a test result. The first line of YAML is '---' and the last line is '...'. - Made grammar version-aware. Different grammars may now be selected depending on the TAP version being parsed. - Added formatter delegate mechanism for test results. - Added prototype stream based YAML(ish) parser. - Added more tests for T::P::YAMLish - Altered T::P::Grammar to use T::P::YAMLish - Removed T::P::YAML - Added raw source capture to T::P::YAMLish - Added support for double quoted hash keys - Added TAP::Parser::YAMLish::Writer and renamed T::P::YAMLish as T::P::YAMLish::Reader. - Added extra TAP::Parser::YAMLish::Writer output options - Inline YAML documents must now be indented by at least one space - Fixed broken dependencies in bin/prove - Make library paths absolute before running tests in case tests chdir before loading modules. - Added libs and switches handling to T::H::Compatible. This and the previous change fix [24926] - Added PERLLIB to libraries stripped in _default_inc [12030] - Our version of prove now handles directories containing circular links correctly [21938] - Set TAP_VERSION env var in Parser [11595] - Added setup, teardown hooks to T::P::I::Process to facilitate the setup and cleanup of the test script's environment - Any additional libs added to the command line are also added to PERL5LIB for the duration of a test run so that any Perl children of the test script inherit the same library paths. - Fixed handling of single quoted hash keys in T::P::Y::Reader - Made runtests return the TAP::Parser::Aggregator - Fixed t/120-harness.t has failures if TAP::Harness::Color cannot load optional modules [27125] - thanks DROLSKY - Fixed parsing of \# in test description 0.51 12 March 2007 - 'execrc' file now allows 'regex' matches for tests. - rename 'TAPx' --> 'TAP' - Reimplemented the parse logic of TAP::Parser as a state machine. - Removed various ad-hoc state variables from TAP::Parser and moved their logic into the state machine. - Removed now-unused is_first / is_last methods from Iterator and simplified remaining logic to suit. - Removed now-redundant t/140-varsource.t. - Implemented TAP version syntax. - Tidied TAP::Harness::Compatible documentation - Removed redundant modules below TAP::Harness::Compatible - Removed unused compatibility tests 0.50_07 5 March 2007 - Fixed bug where we erroneously checked the test number instead of number of tests run to determine if we've run more tests than we planned. - Add a --directives switch to 'runtests' which only shows test results with directives (such as 'TODO' or 'SKIP'). - Removed some dead code from TAPx::Parser. - Added color support for Windows using Win32::Console. - Made Color::failure_output reset colors before printing the trailing newline. - Corrected some issues with the 'runtests' docs and removed some performance notes which no longer seem accurate. - Fixed bug whereby if tests without file extensions were included then the spacing of the result leaders would be off. - execrc file is now a YAML file. - Removed white background on the test failures. It was too garish for me. Just more proof that we need better ways of overriding color support. - Started work on TAPx::Harness::Compatible. Right now it's mainly just a direct lift of Test::Harness to make sure the tests work. - Commented out use Data::Dumper::Simple in T::Harness.pm - it's not a core module. - Added next_raw to TAPx::Parser::Iterator which skips any fixes for quirky TAP that are implemented by next. Used to support TAPx::Harness::Compatible::Iterator - Applied our version number to all T::H::Compatible modules - Removed T::H::C::Assert. It's documented as being private to Test::Harness and we're not going to need it. - Refactored runtests to call aggregate_tests to expose the interface we need for the compatibility layer. - Make it possible to pass an end time to summary so that it needn't be called immediately after the tests complete. - Moved callback handling into TAPx::Base and altered TAPx::Parser to use it. - Made TAPx::Harness into a subclass of TAPx::Base and implemented made_parser callback. - Moved the dispatch of callbacks out of run and into next so that they're called when TAPx::Harness iterates through the results. - Implemented PERL_TEST_HARNESS_DUMP_TAP which names a directory into which the raw TAP of any tests run via TAPx::Harness will be written. - Rewrote the TAPx::Grammar->tokenize method to return a TAPx::Parser::Result object. Code is much cleaner now. - Moved the official grammar from TAPx::Parser to TAPx::Parser::Grammar, provided a link and updated the grammar. - Fixed bug where a properly escaped '# TODO' line in a test description would still be reported as a TODO test. - Added patches/ExtUtils-MakeMaker-6.31.patch - a patch against EUMM that makes test_harness use TAPx::Harness instead of Test::Harness if PERL_EUMM_USE_TAPX is true and TAPx::Harness is installed. In other words cause 'make test' for EUMM based models to use TAPx::Harness. - Added support for timer option to TAPx::Harness which causes the elapsed time for each test to be displayed. - Setup tapx-dev@hexten.net mailing list. - Fixed accumulating @$exec bug in TAPx::Harness. - Made runtests pass '--exec' option as an array. - (#24679) TAPx::Harness now reports failure for tests that die after completing all subtests. - Added in_todo attribute on TAPx::Parser which is true while the most recently seen test was a TODO. - (#24728) TAPx::Harness now supresses diagnostics from failed TODOs. Not sure if the semantics of this are correct yet. 0.50_06 18 January 2007 - Fixed doc typo in examples/README [rt.cpan.org #24409] - Colored test output is now the default for 'runtests' unless you're running under windows or -t STDOUT is false. [rt.cpan.org #24310] - Removed the .t extension from t/source_tests/*.t since those are 'test tests' which caused false negatives when running recursive tests. [Adrian Howard] - Somewhere along the way, the exit status started working again. Go figure. - Factored color output so that disabling it under Windows is cleaner. - Added explicit switch to :crlf layer after open3 under Windows. open3 defaults to raw mode resulting in spurious \r characters input parsed input. - Made Iterator do an explicit wait for subprocess termination. Needed to get process status correctly on Windows. - Fixed bug which didn't allow t/010-regression.t to be run directly via Perl unless you specified Perl's full path. - Removed SIG{CHLD} handler (which we shouldn't need I think because we explicitly waitpid) and made binmode ':crlf' conditional on IS_WIN32. On Mac OS these two things combined to expose a problem which meant that output from test scripts was sometimes lost. - Made t/110-source.t use File::Spec->catfile to build path to test script. - Made Iterator::FH init is_first, is_last to 0 rather than undef for consistency with array iterator. - Added t/120-varsource.t to test is_first and is_last semantics over files with small numbers of lines. - Added check for valid callback keys. - Added t/130-results.t for Result classes. 0.50_05 15 January 2007 - Removed debugging code accidentally left in bin/runtests. - Removed 'local $/ = ...' from the iterator. Hopefully that will fix the line ending bug, but I don't know about the wstat problem. 0.50_04 14 January 2007 - BACKWARDS IMCOMPATIBLE: Renamed all '::Results' classes to '::Result' because they represent a single result. - Fixed bug where piping would break verbose output. - IPC::Open3::open3 now takes a @command list rather than a $command string. This should make it work under Windows. - Added 'stdout_sterr' sample test back to regression tests. IPC::Open3 appears to make it work. - Bug fix: don't print 'All tests successful' if no tests are run. - Refactored 'runtests' to make it a bit easier to follow. - Bug fix: Junk and comments now allowed before a leading plan. - HARNESS_ACTIVE and HARNESS_VERSION environment variables now set. - Renamed 'problems' in TAPx::Parser and TAPx::Aggregator to 'has_problems'. 0.50_03 08 January 2007 - Fixed bug where '-q' or '-Q' with colored tests weren't suppressing all information. - Fixed an annoying MANIFEST nit. - Made '-h' for runtests now report help. Using a new harness requires the full --harness switch. - Added 'problems' method to TAPx::Parser and TAPx::Parser::Aggregator. - Deprecatd 'todo_failed' in favor of 'todo_passed' - Add -I switch to runtests. - Fixed runtests doc nit (smylers) - Removed TAPx::Parser::Builder. - A few more POD nits taken care of. - Completely removed all traces of C<--merge> as IPC::Open3 seems to be working. - Moved the tprove* examples to examples/bin in hopes of them no longer showing up in CPAN's docs. - Made the 'unexpectedly succeeded' message clearer (Adam Kennedy) 0.50_02 06 January 2007 - Added some files I left out of the manifest (reported by Florian Ragwitz). - Added strict to Makefile.PL and changed @PROGRAM to @program (reported Florian Ragwitz). 0.50_01 06 January 2007 - Added a new example which shows to how test Perl, Ruby, and URLs all at the same time using 'execrc' files. - Fixed the diagnostic format mangling bug. - We no longer override Test::Builder to merge streams. Instead, we go ahead and use IPC::Open3. It remains to be seen whether or not this is a good idea. - Fixed vms nit: for failing tests, vms often has the 'not' on a line by itself. - Fixed bugs where unplanned tests were not reporting as a failure (test number greater than tests planned). - TAPx::Parser constructor can now take an 'exec' option to tell it what to execute to create the stream (huge performance boost). - Added TAPx::Parser::Source. This allows us to run tests in just about any programming language. - Renamed the filename() method to source() in TAPx::Parser::Source::Perl. - We now cache the @INC values found for TAPx::Parser::Source::Perl. - Added two test harnesses, TAPx::Harness and TAPx::Harness::Color. - Removed references to manual stream construction from TAPx::Parser documentation. Users should not (usually) need to worry about streams. - Added bin/runtests utility. This is very similar to 'prove'. - Renumbered tests to make it easier to add new ones. - Corrected some minor documentation nits. - Makefile.PL is no longer auto-generated (it's built by hand). - Fixed regression test bug where driving tests through the harness I'm testing caused things to break. - BUG: exit() values are now broken. I don't know how to capture them with IPC::Open3. However, since no one appears to be using them, this might not be an issue. 0.41 12 December 2006 - Fixed (?) 10-regression.t test which failed on Windows. Removed the segfault test as it has no meaning on Windows. Reported by PSINNOTT and fix recommended by Schwern based on his Test::Harness experience. http://rt.cpan.org/Ticket/Display.html?id=21624 0.40 05 December 2006 - Removed TAPx::Parser::Streamed and folded its functionality into TAPx::Parser. - Fixed bug where sometimes is_good_plan() would return a false positive (exposed by refactoring). - A number of tiny performance enhancements. 0.33 22 September 2006 - OK, I'm getting ticked off by some of the comments on Perl-QA so I rushed this out the door and broke it :( I'm backing out one test and slowing down a bit. 0.32 22 September 2006 - Applied patch from Schwern which fixed the Builder package name (TAPx:: instead of TAPX:: -- stupid case-insensitive package names!). [rt.cpan.org #21605] 0.31 21 September 2006 - Fixed bug where Carp::croak without parens could cause Perl to fail to compile on some platforms. [Andreas J. Koenig] - Eliminated the non-portable redirect of STDERR to STDOUT (2>&1) and fixed the synchronization issue. This involves overridding Test::Builder::failure_output() in a very sneaky way. I may have to back this out. - Renamed boolean methods to begin with 'is_'. The methods they replace are documented, deprecated, and will not be removed prior to version 1.00. 0.30 17 September 2006 - Fixed bug where no output would still claim to have a good plan. - Fixed bug where no output would cause parser to die. - Fixed bug where failing to specify a plan would be two parse errors instead of one. - Fixed bug where a correct plan count in an incorrect place would still report as a 'good_plan'. - Fixed bug where comments could accidently be misparsed as directives. - Eliminated testing of internal structure of result objects. The other tests cover this. - Allow hash marks in descriptions. This was causing a problem because many test suites (Regexp::Common and Perl core) allowed them to exist. - Added support for SKIP directives in plans. - Did some work simplifying &TAPx::Parser::_initialize. It's not great, but it's better than it was. - TODO tests now always pass, regardless of actual_passed status. - Removed 'use warnings' and now use -w - 'switches' may now be passed to the TAPx::Parser constructor. - Added 'exit' status. - Added 'wait' status. - Eliminated 'use base'. This is part of the plan to make TAPx::Parser compatible with older versions of Perl. - Added 'source' key to the TAPx::Parser constructor. Making new parsers is now much easier. - Renamed iterator first() and last() methods to is_first() and is_last(). Credit: Aristotle. - Planned tests != tests run is now a parse error. It was really stupid of me not to do that in the first place. - Added massive regression test suite in t/100-regression.t - Updated the grammar to show that comments are allowed. - Comments are now permitted after an ending plan. 0.22 13 September 2006 - Removed buggy support for multi-line chunks from streams. If your streams or iterators return anything but single lines, this is a bug. - Fixed bug whereby blank lines in TAP would confuse the parser. Reported by Torsten Schoenfeld. - Added first() and last() methods to the iterator. - TAPx::Parser::Source::Perl now has a 'switches' method which allows switches to be passed to the perl executable running the test file. This allows tprove to accept a '-l' argument to force lib/ to be included in Perl's @INC. 0.21 8 September 2006 - Included experimental GTK interface written by Torsten Schoenfeld. - Fixed bad docs in examples/tprove_color - Applied patch from Shlomi Fish fixing bug where runs from one stream could leak into another when bailing out. [rt.cpan.org #21379] - Fixed some typos in the POD. - Corrected the grammar to allow for a plan of "1..0" (infinite stream). - Started to add proper acknowledgements. 0.20 2 September 2006 - Fixed bug reported by GEOFFR. When no tap output was found, an "Unitialized value" warning occurred. [rt.cpan.org #21205] - Updated tprove to now report a test failure when no tap output found. - Removed examples/tprove_color2 as tprove_color now works. - Vastly improved callback system and updated the docs for how to use them. - Changed TAPx::Parser::Source::Perl to use Symbol::gensym() instead of a hard-to-guess filehandle name. 0.12 30 July 2006 - Added a test colorization script - Callback support added. - Added TAPx::Parser::Source::Perl. - Added TAPx::Parser::Aggregator. - Added version numbers to all classes. - Added 'todo_failed' test result and parser. - 00-load.t now loads all classes instead of having individual tests load their supporting classes. - Changed $parser->results to $parser->next 0.11 25 July, 2006 - Renamed is_skip and is_todo to has_skip and has_todo. Much less confusing since a result responding true to those also responded true to is_test. - Added simplistic bin/tprove to run tests. Much harder than I thought and much code stolen from Test::Harness. - Modified stolen iterator to fix a bug with stream handling when extra newlines were encountered. - Added TAPx::Parser::Iterator (stolen from Test::Harness::Iterator) - Normalized internal structure of result objects. - All tokens now have a 'type' key. This greatly simplifies internals. - Copied much result POD info into the main docs. - Corrected the bug report URLs. - Minor updates to the grammar listed in the POD. 0.10 23 July, 2006 - Oh my Larry, we gots docs! - _parse and _tap are now private methods. - Stream support has been added. - Moved the grammar into its own class. - Pulled remaining parser functionality out of lexer. - Added type() method to Results(). - Parse errors no longer croak(). Instead, they are available through the parse_errors() method. - Added good_plan() method. - tests_planned != tests_run is no longer a parse error. - Renamed test_count() to tests_run(). - Renamed num_tests() to tests_planned(). 0.03 17 July, 2006 - 'Bail out!' is now handled. - The parser is now data driven, thus skipping a huge if/else chain - We now track all TODOs, SKIPs, passes and fails by test number. - Removed all non-core modules. - Store original line for each TAP line. Available through $result->raw(). - Renamed test is_ok() to passed() and added actual_passed(). The former method takes into account TODO tests and the latter returns the actual pass/fail status. - Fixed a bug where SKIP tests would not be identified correctly. 0.02 8 July, 2006 - Moved some lexer responsibility to the parser. This will allow us to eventually parse streams. - Properly track passed/failed tests, even accounting for TODO. - Added support for comments and unknown lines. - Allow explicit and inferred test numbers to be mixed. - Allow escaped hashes in the test description. - Renamed to TAPx::Parser. Will probably rename it again. 0.01 Date/time - First version, unreleased on an unsuspecting world. - No, you'll never know when ...