ActiveState Community

Perl testplan doesn't really work

Posted by vad3r on 2009-04-23 03:17
OS: OS X Tiger ( PowerPC / Intel )

I created a very basic Makefile to run tests against several perl modules. When starten from a shell it looks perfect but the builtin Komodo testplan doesn't work as expected:

The example testplan has 4 checks. All of them succeed on the shell. When using the Makefile the first element is "Information" containing **** Unrecognized input: /usr/bin/perl ./XYZ.t

The first check shows the correct output generated but all following have an empty Details block. Even if i make one of the tests fail i don't see the output.

The last test is never marked as succeeded (blue information icon) and on the top there's the information that 3 tests passed. Here's the output from running the Makefile manually:

/usr/bin/perl ./XYZ.t
1..4
ok 1 - use XYZ::Common;
ok 2 - use XYZ::Stuff::Base;
ok 3 - use XYZ::MoreStuff;
ok 4 - use XYZ::New::Stuff;

This is regular test output when using Test::More. Does Komodo expect anything different?

Thanks,

vad3r

Could you file a bug on this?
ericp | Thu, 2009-04-23 09:41

I have to admit that writing a harness for Perl tests was much
harder than for Python, PHP, or Ruby, because the other languages
libraries let you subclass their standard test library, so you
can see exactly which tests pass and which fail. With Perl I have
to parse output. Support for the output of Test::More is
definitely intended.

Could you file a bug at http://bugs.activestate.com/enter_bug.cgi?product=Komodo
and attach a zip/tar/tgz containing the Makefile and t files? I don't
think I'll need the actual Perl source -- mock tests that simply emit
the ok statements should be enough to hit the bug.

Thanks,
Eric

Bug filed
vad3r | Thu, 2009-04-23 09:58

Thanks for your answer. I filed a bug for this issue

http://bugs.activestate.com/show_bug.cgi?id=82890