Report for Scraper-3.05

Back
From: metabase:user:d2c9f356-b46f-11df-9a90-20a83c0b7757
Subject: FAIL Scraper-3.05 v5.12.4 SunOS/Solaris
Date: 2011-06-26T14:53:17Z

This distribution has been tested as part of the CPAN Testers
project, supporting the Perl programming language.  See
http://wiki.cpantesters.org/ for more information or email
questions to cpan-testers-discuss@perl.org


--
Dear Glenn Wood,

This is a computer-generated report for Scraper-3.05
on perl 5.12.4, created by CPAN-Reporter-1.1902.

Thank you for uploading your work to CPAN.  However, there was a problem
testing your distribution.

If you think this report is invalid, please consult the CPAN Testers Wiki
for suggestions on how to avoid getting FAIL reports for missing library
or binary dependencies, unsupported operating systems, and so on:

http://wiki.cpantesters.org/wiki/CPANAuthorNotes

Sections of this report:

    * Tester comments
    * Program output
    * Prerequisites
    * Environment and other context

------------------------------
TESTER COMMENTS
------------------------------

Additional comments from tester:

this report is from an automated smoke testing program
and was not reviewed by a human for accuracy

------------------------------
PROGRAM OUTPUT
------------------------------

Output from '/usr/local/bin/make test':

PERL_DL_NONLAZY=1 /export/home/cpant3/perl5/bin/perl5.12.4 "-MExtUtils::Command::MM" "-e" "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t
t/t.t .. ok
All tests successful.
Files=1, Tests=1,  0 wallclock secs ( 0.01 usr +  0.00 sys =  0.01 CPU)
Result: PASS
PERL_DL_NONLAZY=1 /export/home/cpant3/perl5/bin/perl5.12.4 "-Iblib/lib" "-Iblib/arch" test.pl
# VERSIONS OF MODULES ON WHICH SCRAPER DEPENDS
#     using HTML::Form(6.00);
#     using HTML::TreeBuilder(4.2);
#     using HTTP::Cookies(6.00);
#     using HTTP::Request(6.00);
#     using HTTP::Response(6.01);
#     using HTTP::Status(6.00);
#     using LWP(6.02);
#     using LWP::RobotUA(6.00);
#     using LWP::UserAgent(6.02);
#     using Storable(2.25);
#     using Text::ParseWords(3.27);
#     using Tie::Persistent(1.00);
#     using URI(1.58);
#     using URI::Escape(3.30);
#     using URI::URL(5.03);
#     using URI::http();
#     using User(1.9);
#     using WWW::Search(2.565);
#     using XML::XPath(1.13);
sh: tidy: not found
sh: tidy: not found
1..10
ok 1 - 8 Scraper modules listed in MANIFEST (4,0,4)
ok 2 - WWW::Scraper loaded
sh: tidy: not found
ok 3 # skip This Scraper engine requires 'HTML Tidy' to scrub HTML before parsing.
Get this program from 'http://tidy.sourceforge.net/docs/Overview.html#Download'
Make sure it is in your execution search path.

Use of uninitialized value in pattern match (m//) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 1294.
Use of uninitialized value in pattern match (m//) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 1294.
Use of uninitialized value in pattern match (m//) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 1294.
Use of uninitialized value in pattern match (m//) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 1294.
not ok 4 - CraigsList
#     Failed test (test.pl at line 129)
sh: tidy: not found
ok 5 # skip This Scraper engine requires 'HTML Tidy' to scrub HTML before parsing.
Get this program from 'http://tidy.sourceforge.net/docs/Overview.html#Download'
Make sure it is in your execution search path.

Use of uninitialized value $_ in substitution (s///) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 915.
Use of uninitialized value $_ in substitution (s///) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 916.
Argument "8,510,000" isn't numeric in numeric le (<=) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 662.
Use of uninitialized value $_ in substitution (s///) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 915.
Use of uninitialized value $_ in substitution (s///) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 916.
Argument "8,510,000" isn't numeric in numeric le (<=) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 662.
not ok 6 - Google
#     Failed test (test.pl at line 129)
Use of uninitialized value $_ in substitution (s///) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 915.
Use of uninitialized value $_ in substitution (s///) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 916.
Use of uninitialized value $_ in substitution (s///) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 915.
Use of uninitialized value $_ in substitution (s///) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 916.
not ok 7 - Lycos
#     Failed test (test.pl at line 129)
ok 8 # skip NorthernLight's search engine seems to be down these days!?
ok 9 # skip Sherlock.pm is not working today; many changes out on the frontier that I haven't caught up with yet
Use of uninitialized value $_ in substitution (s///) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 915.
Use of uninitialized value $_ in substitution (s///) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 916.
Use of uninitialized value $_ in substitution (s///) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 915.
Use of uninitialized value $_ in substitution (s///) at /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib/WWW/Search.pm line 916.
not ok 10 - ZIPplus4
#     Failed test (test.pl at line 129)
# Can't locate object method "zipcode" via package "WWW::Scraper::Request::ZIPplus4_" at blib/lib/WWW/Scraper/Request.pm line 207.
# 4 tests had problems. See file 'test.trace' for details.
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Operating system: solaris
Perl version: 5.012004
VERSIONS OF MODULES ON WHICH SCRAPER DEPENDS
    using HTML::Form(6.00);
    using HTML::TreeBuilder(4.2);
    using HTTP::Cookies(6.00);
    using HTTP::Request(6.00);
    using HTTP::Response(6.01);
    using HTTP::Status(6.00);
    using LWP(6.02);
    using LWP::RobotUA(6.00);
    using LWP::UserAgent(6.02);
    using Storable(2.25);
    using Text::ParseWords(3.27);
    using Tie::Persistent(1.00);
    using URI(1.58);
    using URI::Escape(3.30);
    using URI::URL(5.03);
    using URI::http();
    using User(1.9);
    using WWW::Search(2.565);
    using XML::XPath(1.13);
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
LIST SCRAPER SUB-CLASSES, FROM THE MANIFEST
    + Beaucoup(1.07)
    + CraigsList(1.16)
    + Dogpile(1.11)
    - FieldTranslation will not be tested: it is not a Scraper sub-class.
    + Google(1.23)
    - Grub will not be tested: it is not a Scraper sub-class.
    + Lycos(1.00)
    + NorthernLight(1.00)
    + Sherlock(1.00)
    - Response will not be tested: it is not a Scraper sub-class.
    - Request will not be tested: it is not a Scraper sub-class.
    - TidyXML will not be tested: it is not a Scraper sub-class.
    - WSDL will not be tested: it is not a Scraper sub-class.
    + ZIPplus4(1.09)
    - Opcode will not be tested: it is not a Scraper sub-class.
    - ScraperDiscovery will not be tested: it is not a Scraper sub-class.
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Test #0: CraigsList
Test #1: CraigsList 'bogus' search
Test #2: CraigsList one-page search
 + got 0 results for 'Honda'
 --- got 0 results for CraigsList 'Honda', but expected 50
 --- base URL: http://www.craigslist.org/cgi-bin/search?
 --- first URL: http://www.craigslist.org/cgi-bin/search?areaID=1&cat=all&catAbbreviation=car&group=J&max_ask=&min_ask=&new_cat=6&query=Honda&subAreaID=0&type_search=
 --- last URL: http://www.craigslist.org/cgi-bin/search?areaID=1&cat=all&catAbbreviation=car&group=J&max_ask=&min_ask=&new_cat=6&query=Honda&subAreaID=0&type_search=
 --- next URL: 
 --- response message: 200 OK
 --- content size (bytes): 2701
 --- ERRNO: 
 --- Extended OS error: 
Scraper engine CraigsList failed once: 
Test #0: CraigsList
Test #1: CraigsList 'bogus' search
Test #2: CraigsList one-page search
 + got 0 results for 'Honda'
 --- got 0 results for CraigsList 'Honda', but expected 50
 --- base URL: http://www.craigslist.org/cgi-bin/search?
 --- first URL: http://www.craigslist.org/cgi-bin/search?areaID=1&cat=all&catAbbreviation=car&group=J&max_ask=&min_ask=&new_cat=6&query=Honda&subAreaID=0&type_search=
 --- last URL: http://www.craigslist.org/cgi-bin/search?areaID=1&cat=all&catAbbreviation=car&group=J&max_ask=&min_ask=&new_cat=6&query=Honda&subAreaID=0&type_search=
 --- next URL: 
 --- response message: 200 OK
 --- content size (bytes): 2701
 --- ERRNO: 
 --- Extended OS error: 
Scraper engine CraigsList failed twice: 
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Test #0: Google
Test #1: Google 'bogus' search
Test #2: Google one-page search
 + got 0 results for 'search scraper'
 --- got 0 results for Google 'search scraper', but expected 9
 --- base URL: http://www.google.com/search?
 --- first URL: http://www.google.com/search?btnG=Google+Search&hl=en&ie=UTF%2D8&lr=&q=search+scraper&safe=active
 --- last URL: http://www.google.com/search?btnG=Google+Search&hl=en&ie=UTF%2D8&lr=&q=search+scraper&safe=active
 --- next URL: http://www.google.com/search?hl=en&lr=&safe=active&ie=UTF-8&ei=d0YHTpzRK4zCtAbc56nUDA&q=search scraper&start=10&sa=N
 --- response message: 200 OK
 --- content size (bytes): 18740
 --- ERRNO: 
 --- Extended OS error: 
Scraper engine Google failed once: 
Test #0: Google
Test #1: Google 'bogus' search
Test #2: Google one-page search
 + got 0 results for 'search scraper'
 --- got 0 results for Google 'search scraper', but expected 9
 --- base URL: http://www.google.com/search?
 --- first URL: http://www.google.com/search?btnG=Google+Search&hl=en&ie=UTF%2D8&lr=&q=search+scraper&safe=active
 --- last URL: http://www.google.com/search?btnG=Google+Search&hl=en&ie=UTF%2D8&lr=&q=search+scraper&safe=active
 --- next URL: http://www.google.com/search?hl=en&lr=&safe=active&ie=UTF-8&ei=eEYHTteAE4bBswaz05XHDA&q=search scraper&start=10&sa=N
 --- response message: 200 OK
 --- content size (bytes): 19197
 --- ERRNO: 
 --- Extended OS error: 
Scraper engine Google failed twice: 
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Test #0: Lycos
Test #1: Lycos 'bogus' search
Test #2: Lycos one-page search
 + got 0 results for 'turntable'
 --- got 0 results for Lycos 'turntable', but expected 9
 --- base URL: http://search.lycos.com/default.asp?
 --- first URL: http://search.lycos.com/default.asp?loc=searchhp&lpv=1&query=turntable&tab=web
 --- last URL: http://search.lycos.com/default.asp?loc=searchhp&lpv=1&query=turntable&tab=web
 --- next URL: 
 --- response message: 200 OK
 --- content size (bytes): 46690
 --- ERRNO: 
 --- Extended OS error: 
Scraper engine Lycos failed once: 
Test #0: Lycos
Test #1: Lycos 'bogus' search
Test #2: Lycos one-page search
 + got 0 results for 'turntable'
 --- got 0 results for Lycos 'turntable', but expected 9
 --- base URL: http://search.lycos.com/default.asp?
 --- first URL: http://search.lycos.com/default.asp?loc=searchhp&lpv=1&query=turntable&tab=web
 --- last URL: http://search.lycos.com/default.asp?loc=searchhp&lpv=1&query=turntable&tab=web
 --- next URL: 
 --- response message: 200 OK
 --- content size (bytes): 46630
 --- ERRNO: 
 --- Extended OS error: 
Scraper engine Lycos failed twice: 
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Test #0: ZIPplus4
Test #1: ZIPplus4 'bogus' search
Scraper engine ZIPplus4 failed once: Can't locate object method "zipcode" via package "WWW::Scraper::Request::ZIPplus4_" at blib/lib/WWW/Scraper/Request.pm line 207.

Test #0: ZIPplus4
Test #1: ZIPplus4 'bogus' search
Scraper engine ZIPplus4 failed twice: Can't locate object method "zipcode" via package "WWW::Scraper::Request::ZIPplus4_" at blib/lib/WWW/Scraper/Request.pm line 207.

# Looks like you failed 4 tests of 10.
make: *** [test_dynamic] Error 4

------------------------------
PREREQUISITES
------------------------------

Prerequisite modules loaded:

requires:

    Module            Need  Have 
    ----------------- ----- -----
    HTML::Form        0.02  6.00 
    HTML::TreeBuilder 0     4.2  
    HTTP::Cookies     0     6.00 
    HTTP::Request     0     6.00 
    HTTP::Response    0     6.01 
    HTTP::Status      0     6.00 
    LWP               5.48  6.02 
    LWP::RobotUA      0     6.00 
    LWP::UserAgent    0     6.02 
    Storable          0.6   2.25 
    Text::ParseWords  3.2   3.27 
    Tie::Persistent   0.901 1.00 
    URI               0     1.58 
    URI::Escape       0     3.30 
    URI::http         0     0    
    URI::URL          0     5.03 
    User              1.05  1.9  
    WWW::Search       2.35  2.565
    XML::XPath        0     1.13 


------------------------------
ENVIRONMENT AND OTHER CONTEXT
------------------------------

Environment variables:

    AUTOMATED_TESTING = 1
    LANG = C
    LD_LIBRARY_PATH = /usr/local/lib:
    PATH = /export/home/cpant3/perl5/bin:/usr/local/bin:/usr/bin
    PERL5LIB = /export/home/cpant3/.cpan/build/Tie-Persistent-1.00-F34pLf/blib/arch:/export/home/cpant3/.cpan/build/Tie-Persistent-1.00-F34pLf/blib/lib:/export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/arch:/export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib:/export/home/cpant3/.cpan/build/Test-File-1.29-2T7bgV/blib/arch:/export/home/cpant3/.cpan/build/Test-File-1.29-2T7bgV/blib/lib:/export/home/cpant3/.cpan/build/User-1.9-17vdWf/blib/arch:/export/home/cpant3/.cpan/build/User-1.9-17vdWf/blib/lib
    PERL5OPT = 
    PERL5_CPANPLUS_IS_RUNNING = 23610
    PERL5_CPAN_IS_RUNNING = 23610
    PERL5_CPAN_IS_RUNNING_IN_RECURSION = 25336,23610
    PERL_CR_SMOKER_CURRENT = Bundle-WWW-Scraper-Housing-0.03
    PERL_EXTUTILS_AUTOINSTALL = --defaultdeps
    PERL_LWP_SSL_VERIFY_HOSTNAME = 0
    PERL_MM_USE_DEFAULT = 1
    SHELL = /usr/bin/bash
    TERM = xterm

Perl special variables (and OS-specific diagnostics, for MSWin32):

    $^X = /export/home/cpant3/perl5/bin/perl5.12.4
    $UID/$EUID = 103 / 103
    $GID = 1 1
    $EGID = 1 1

Perl module toolchain versions installed:

    Module              Have    
    ------------------- --------
    CPAN                1.9600  
    Cwd                 3.33    
    ExtUtils::CBuilder  0.280202
    ExtUtils::Command   1.17    
    ExtUtils::Install   1.55    
    ExtUtils::MakeMaker 6.56    
    ExtUtils::Manifest  1.58    
    ExtUtils::ParseXS   2.2206  
    File::Spec          3.33    
    Module::Build       0.3800  
    Module::Signature   n/a     
    Test::Harness       3.23    
    Test::More          0.98    
    YAML                0.73    
    YAML::Syck          1.17    
    version             0.91    


--

Summary of my perl5 (revision 5 version 12 subversion 4) configuration:
   
  Platform:
    osname=solaris, osvers=2.10, archname=i86pc-solaris-64int
    uname='sunos vmrz0046 5.10 generic_141445-09 i86pc i386 i86pc solaris '
    config_args='-Dcc=gcc -Dprefix=~/perl5 -Duse64bitint -Dusedevel -d'
    hint=recommended, useposix=true, d_sigaction=define
    useithreads=undef, usemultiplicity=undef
    useperlio=define, d_sfio=undef, uselargefiles=define, usesocks=undef
    use64bitint=define, use64bitall=undef, uselongdouble=undef
    usemymalloc=n, bincompat5005=undef
  Compiler:
    cc='gcc', ccflags ='-DPTR_IS_LONG -fno-strict-aliasing -pipe -I/usr/local/include -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DPERL_USE_SAFE_PUTENV',
    optimize='-O',
    cppflags='-DPTR_IS_LONG -fno-strict-aliasing -pipe -I/usr/local/include'
    ccversion='', gccversion='3.4.6', gccosandvers='solaris2.10'
    intsize=4, longsize=4, ptrsize=4, doublesize=8, byteorder=12345678
    d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=12
    ivtype='long long', ivsize=8, nvtype='double', nvsize=8, Off_t='off_t', lseeksize=8
    alignbytes=4, prototype=define
  Linker and Libraries:
    ld='gcc', ldflags =' -L/usr/local/lib '
    libpth=/usr/local/lib /usr/lib /usr/ccs/lib
    libs=-lsocket -lnsl -lgdbm -ldl -lm -lc
    perllibs=-lsocket -lnsl -ldl -lm -lc
    libc=/lib/libc.so, so=so, useshrplib=false, libperl=libperl.a
    gnulibc_version=''
  Dynamic Linking:
    dlsrc=dl_dlopen.xs, dlext=so, d_dlsymun=undef, ccdlflags=' '
    cccdlflags='-fPIC', lddlflags='-G -L/usr/local/lib'


Characteristics of this binary (from libperl): 
  Compile-time options: PERL_DONT_CREATE_GVSV PERL_MALLOC_WRAP PERL_USE_DEVEL
                        PERL_USE_SAFE_PUTENV USE_64_BIT_INT USE_LARGE_FILES
                        USE_PERLIO USE_PERL_ATOF
  Built under solaris
  Compiled at Jun 21 2011 15:53:50
  %ENV:
    PERL5LIB="/export/home/cpant3/.cpan/build/Tie-Persistent-1.00-F34pLf/blib/arch:/export/home/cpant3/.cpan/build/Tie-Persistent-1.00-F34pLf/blib/lib:/export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/arch:/export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib:/export/home/cpant3/.cpan/build/Test-File-1.29-2T7bgV/blib/arch:/export/home/cpant3/.cpan/build/Test-File-1.29-2T7bgV/blib/lib:/export/home/cpant3/.cpan/build/User-1.9-17vdWf/blib/arch:/export/home/cpant3/.cpan/build/User-1.9-17vdWf/blib/lib"
    PERL5OPT=""
    PERL5_CPANPLUS_IS_RUNNING="23610"
    PERL5_CPAN_IS_RUNNING="23610"
    PERL5_CPAN_IS_RUNNING_IN_RECURSION="25336,23610"
    PERL_CR_SMOKER_CURRENT="Bundle-WWW-Scraper-Housing-0.03"
    PERL_EXTUTILS_AUTOINSTALL="--defaultdeps"
    PERL_LWP_SSL_VERIFY_HOSTNAME="0"
    PERL_MM_USE_DEFAULT="1"
  @INC:
    /export/home/cpant3/.cpan/build/Tie-Persistent-1.00-F34pLf/blib/arch
    /export/home/cpant3/.cpan/build/Tie-Persistent-1.00-F34pLf/blib/lib
    /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/arch
    /export/home/cpant3/.cpan/build/WWW-Search-2.508-KxvP9x/blib/lib
    /export/home/cpant3/.cpan/build/Test-File-1.29-2T7bgV/blib/arch
    /export/home/cpant3/.cpan/build/Test-File-1.29-2T7bgV/blib/lib
    /export/home/cpant3/.cpan/build/User-1.9-17vdWf/blib/arch
    /export/home/cpant3/.cpan/build/User-1.9-17vdWf/blib/lib
    /export/home/cpant3/perl5/lib/site_perl/5.12.4/i86pc-solaris-64int
    /export/home/cpant3/perl5/lib/site_perl/5.12.4
    /export/home/cpant3/perl5/lib/5.12.4/i86pc-solaris-64int
    /export/home/cpant3/perl5/lib/5.12.4
    /export/home/cpant3/perl5/lib/site_perl
    .