[31974] in Perl-Users-Digest
Perl-Users Digest, Issue: 3238 Volume: 11
daemon@ATHENA.MIT.EDU (Perl-Users Digest)
Thu Dec 16 16:09:24 2010
Date: Thu, 16 Dec 2010 13:09:09 -0800 (PST)
From: Perl-Users Digest <Perl-Users-Request@ruby.OCE.ORST.EDU>
To: Perl-Users@ruby.OCE.ORST.EDU (Perl-Users Digest)
Perl-Users Digest Thu, 16 Dec 2010 Volume: 11 Number: 3238
Today's topics:
Entities.pm - How does decode_entities work? <dave@invalid.invalid>
Re: Entities.pm - How does decode_entities work? <uri@StemSystems.com>
Re: Entities.pm - How does decode_entities work? <uri@StemSystems.com>
Extracting a range of words! <vivekchaurasiya@gmail.com>
Re: Extracting a range of words! <tadmc@seesig.invalid>
Re: Extracting a range of words! <uri@StemSystems.com>
Re: Extracting a range of words! <cartercc@gmail.com>
Re: Extracting a range of words! sln@netherlands.com
Re: Extracting a range of words! <tadmc@seesig.invalid>
Re: Extracting a range of words! <tadmc@seesig.invalid>
Re: Extracting a range of words! sln@netherlands.com
Re: FAQ 9.14 How do I make sure users can't enter value (David Canzi)
Looking buy Refined Palm others Cooking Oil <resourts125@gmail.com>
Troubleshooting install from cpan <mark.stafford@gmail.com>
Re: Troubleshooting install from cpan <tadmc@seesig.invalid>
Digest Administrivia (Last modified: 6 Apr 01) (Perl-Users-Digest Admin)
----------------------------------------------------------------------
Date: Thu, 16 Dec 2010 16:32:17 +0000 (UTC)
From: "Dave Saville" <dave@invalid.invalid>
Subject: Entities.pm - How does decode_entities work?
Message-Id: <fV45K0OBJxbE-pn2-3UiIxdhKMNbx@localhost>
I needed to massage some text to put in a web page. I started out with
some s/!/!;/g; type lines and then twigged that perl would most
likely have a module to do it. HTML::Entities.pm. This works fine, but
I then wanted to see *how* it did it.
Having found the module, Entities.pm, I copied it to a tmp directory
and modified the start of my test script from
use HTML::Entities;
to
use lib '.';
use Entities;
I then started sticking in print statements and eventually worked out
how the encode worked. I then tried to do the same with the decode
only to get an error:
Undefined subroutine &Entities::decode_entities called at try.pl line
18.
I then see that the sub line in Entities.pm is sub
decode_entities_old. OK so it's not amazing it could not find it. But
the question is how on earth does it work when the use HTML::Entities
is in effect? Which it does. I ran a search down the entire perl tree
looking for any file with a "sub decode_entities" in it and
Entities.pm is the only file and then it is decode_entities_old. So
how *does* it work?
Is there some way to find out where perl is getting a particular
routine from - rather like the *nix command line "which"?
TIA
--
Regards
Dave Saville
------------------------------
Date: Thu, 16 Dec 2010 12:44:02 -0500
From: "Uri Guttman" <uri@StemSystems.com>
Subject: Re: Entities.pm - How does decode_entities work?
Message-Id: <87aak5ipel.fsf@quad.sysarch.com>
>>>>> "DS" == Dave Saville <dave@invalid.invalid> writes:
DS> I needed to massage some text to put in a web page. I started out with
DS> some s/!/!;/g; type lines and then twigged that perl would most
DS> likely have a module to do it. HTML::Entities.pm. This works fine, but
DS> I then wanted to see *how* it did it.
DS> Having found the module, Entities.pm, I copied it to a tmp directory
DS> and modified the start of my test script from
DS> use HTML::Entities;
DS> to
DS> use lib '.';
DS> use Entities;
what happened to the HTTP:: part? why did you think you could drop it?
DS> I then started sticking in print statements and eventually worked out
DS> how the encode worked. I then tried to do the same with the decode
DS> only to get an error:
DS> Undefined subroutine &Entities::decode_entities called at try.pl line
DS> 18.
you broke its exporting.
uri
--
Uri Guttman ------ uri@stemsystems.com -------- http://www.sysarch.com --
----- Perl Code Review , Architecture, Development, Training, Support ------
--------- Gourmet Hot Cocoa Mix ---- http://bestfriendscocoa.com ---------
------------------------------
Date: Thu, 16 Dec 2010 12:45:55 -0500
From: "Uri Guttman" <uri@StemSystems.com>
Subject: Re: Entities.pm - How does decode_entities work?
Message-Id: <8762utipbg.fsf@quad.sysarch.com>
>>>>> "DS" == Dave Saville <dave@invalid.invalid> writes:
DS> I then see that the sub line in Entities.pm is sub
DS> decode_entities_old. OK so it's not amazing it could not find it. But
DS> the question is how on earth does it work when the use HTML::Entities
DS> is in effect? Which it does. I ran a search down the entire perl tree
DS> looking for any file with a "sub decode_entities" in it and
DS> Entities.pm is the only file and then it is decode_entities_old. So
DS> how *does* it work?
DS> Is there some way to find out where perl is getting a particular
DS> routine from - rather like the *nix command line "which"?
if you read the source and look for decode_entities there is a comment
which says where it is located.
uri
--
Uri Guttman ------ uri@stemsystems.com -------- http://www.sysarch.com --
----- Perl Code Review , Architecture, Development, Training, Support ------
--------- Gourmet Hot Cocoa Mix ---- http://bestfriendscocoa.com ---------
------------------------------
Date: Thu, 16 Dec 2010 07:52:35 -0800 (PST)
From: vivek_12315 <vivekchaurasiya@gmail.com>
Subject: Extracting a range of words!
Message-Id: <a53d0c81-8db3-4ef7-90ff-178fd2d5719d@f8g2000yqd.googlegroups.com>
I need perl help...
say
$text = qq (I confirm that sufficient information and detail have been
reported in this technical report, that it is scientifically sound,
and that appropriate conclusions have been included)
i find the index for "sound".
After that I just need the substring from {-5, +5} WORDS around that
indexof(sound)
i.e.
my final answer shud be = report, that it is scientifically sound, and
that appropriate conclusions have
Is There a strategy or I have to do it in basic steps ?
------------------------------
Date: Thu, 16 Dec 2010 10:30:47 -0600
From: Tad McClellan <tadmc@seesig.invalid>
Subject: Re: Extracting a range of words!
Message-Id: <slrnigkgdb.nc9.tadmc@tadbox.sbcglobal.net>
vivek_12315 <vivekchaurasiya@gmail.com> wrote:
> $text = qq (I confirm that sufficient information and detail have been
> reported in this technical report, that it is scientifically sound,
> and that appropriate conclusions have been included)
>
> i find the index for "sound".
>
> After that I just need the substring from {-5, +5} WORDS around that
> indexof(sound)
What do you want to do if there is only 1 word before the target word,
eg. if searching for "confirm"?
I will assume: show 0-5 words before and after.
What do you want to do if the target word is in the string
at more than one place, eg "been"?
I will assume: find the first one.
What do you want if "sound" appears within some other word
such as "resoundingly"?
I will assume: do not match.
my $word = 'sound';
$text =~ s/.*? # leading stuff to strip
( # $1 is stuff to keep
(\w+\W+){0,5} # 0-5 words
\b$word\b\W* # the word to search for
(\w+\W*){0,5} # 0-5 words
)
.* # trailing stuff to strip
/$1/sx;
--
Tad McClellan
email: perl -le "print scalar reverse qq/moc.liamg\100cm.j.dat/"
The above message is a Usenet post.
I don't recall having given anyone permission to use it on a Web site.
------------------------------
Date: Thu, 16 Dec 2010 12:41:40 -0500
From: "Uri Guttman" <uri@StemSystems.com>
Subject: Re: Extracting a range of words!
Message-Id: <87ei9hipij.fsf@quad.sysarch.com>
>>>>> "TM" == Tad McClellan <tadmc@seesig.invalid> writes:
TM> my $word = 'sound';
TM> $text =~ s/.*? # leading stuff to strip
TM> ( # $1 is stuff to keep
TM> (\w+\W+){0,5} # 0-5 words
TM> \b$word\b\W* # the word to search for
TM> (\w+\W*){0,5} # 0-5 words
TM> )
TM> .* # trailing stuff to strip
TM> /$1/sx;
that was pretty much the regex i would write. but do you need the \b's
in there? assuming $word is really \w chars, then the preceding \W will
obviate the need for the \b. same for the trailing one.
also i would use \s+\S+ since written words could contain apostrophes
and some other punctuation.
uri
--
Uri Guttman ------ uri@stemsystems.com -------- http://www.sysarch.com --
----- Perl Code Review , Architecture, Development, Training, Support ------
--------- Gourmet Hot Cocoa Mix ---- http://bestfriendscocoa.com ---------
------------------------------
Date: Thu, 16 Dec 2010 10:31:14 -0800 (PST)
From: ccc31807 <cartercc@gmail.com>
Subject: Re: Extracting a range of words!
Message-Id: <73586a78-7d6d-4533-92c0-607561722817@f20g2000prn.googlegroups.com>
On Dec 16, 10:52=A0am, vivek_12315 <vivekchauras...@gmail.com> wrote:
> $text =3D qq (I confirm that sufficient information and detail have been
> reported in this technical report, that it is scientifically sound,
> and that appropriate conclusions have been included)
> After that I just need the substring from {-5, +5} WORDS around that
> indexof(sound)
Here's a pretty mindless way to do it. Split the string into an array,
then iterate through the array looking for 'sound'. If necessary, you
can use the word boundary markers. Then, starting at the index of the
array element you found, print the ten elements starting at 'index -
5'. Like this:
my $text =3D qq (I confirm that sufficient information and detail have
been reported in this technical report, that it is scientifically
sound, and that appropriate conclusions have been included);
my @text =3D split(/\s/, $text);
my $index =3D 0;
foreach my $element (@text)
{
last if ($element =3D~ /sound/);
$index++;
}
my @report =3D splice(@text, $index - 5, 11);
print "@report\n";
CC.
------------------------------
Date: Thu, 16 Dec 2010 11:45:54 -0800
From: sln@netherlands.com
Subject: Re: Extracting a range of words!
Message-Id: <d6qkg6hhfbriqsofnl2gvk6lqflh9u43ld@4ax.com>
On Thu, 16 Dec 2010 07:52:35 -0800 (PST), vivek_12315 <vivekchaurasiya@gmail.com> wrote:
>I need perl help...
>
>say
>
>$text = qq (I confirm that sufficient information and detail have been
>reported in this technical report, that it is scientifically sound,
>and that appropriate conclusions have been included)
>
>i find the index for "sound".
>
>After that I just need the substring from {-5, +5} WORDS around that
>indexof(sound)
>
>i.e.
>
>my final answer shud be = report, that it is scientifically sound, and
>that appropriate conclusions have
>
>Is There a strategy or I have to do it in basic steps ?
The only real strategy is that you have to know what WORDS are.
Something like parsing a language. Its not enough trying to split
on spaces. So you need to define the language first.
That means there is a relationship between punctuation and whitespace,
the usual separators of language WORDs.
Its not easy. Free flowing wild englishy bad spelling, punctuation, etc,
will not make this easy. Since you have no basis for a grammar, just an
approximation is the best you could do.
I like this one, uses punctuation and it enforces some rules.
But it is impossible to get it always correct.
-sln
use strict;
use warnings;
my $text = qq (I confirm that sufficient information and detail have been
reported in this technical report, that it' is "scientifically" sound,
and that appropriate conclusion's have been included);
if ( $text =~ /
( #1
( #2
(?:
(?:^|\s)
[[:punct:]]*
\w
[\w[:punct:]]*
[\s[:punct:]]*
){0,5}
)
sound
( #3
(?:
[\s[:punct:]]*
\w
[\w[:punct:]]*
(?:$|\s)
){0,5}
)
)
/x )
{
print <<RES;
\r 1= '$1'\n\n
\r 2= '$2'\n\n
\r 3= '$3'\n
RES
}
------------------------------
Date: Thu, 16 Dec 2010 13:57:52 -0600
From: Tad McClellan <tadmc@seesig.invalid>
Subject: Re: Extracting a range of words!
Message-Id: <slrnigkshj.o7s.tadmc@tadbox.sbcglobal.net>
Uri Guttman <uri@StemSystems.com> wrote:
>>>>>> "TM" == Tad McClellan <tadmc@seesig.invalid> writes:
>
> TM> my $word = 'sound';
> TM> $text =~ s/.*? # leading stuff to strip
> TM> ( # $1 is stuff to keep
> TM> (\w+\W+){0,5} # 0-5 words
> TM> \b$word\b\W* # the word to search for
> TM> (\w+\W*){0,5} # 0-5 words
> TM> )
> TM> .* # trailing stuff to strip
> TM> /$1/sx;
>
> that was pretty much the regex i would write. but do you need the \b's
> in there? assuming $word is really \w chars, then the preceding \W will
> obviate the need for the \b. same for the trailing one.
It is needed for the trailing one, since the \W is zero or more,
and it is zero or more so that the last $word in $text can be
matched.
> also i would use \s+\S+ since written words could contain apostrophes
> and some other punctuation.
That would be an improvement, I'll use that in the future.
--
Tad McClellan
email: perl -le "print scalar reverse qq/moc.liamg\100cm.j.dat/"
The above message is a Usenet post.
I don't recall having given anyone permission to use it on a Web site.
------------------------------
Date: Thu, 16 Dec 2010 14:03:05 -0600
From: Tad McClellan <tadmc@seesig.invalid>
Subject: Re: Extracting a range of words!
Message-Id: <slrnigksrc.o7s.tadmc@tadbox.sbcglobal.net>
ccc31807 <cartercc@gmail.com> wrote:
> On Dec 16, 10:52 am, vivek_12315 <vivekchauras...@gmail.com> wrote:
>> $text = qq (I confirm that sufficient information and detail have been
>> reported in this technical report, that it is scientifically sound,
>> and that appropriate conclusions have been included)
>> After that I just need the substring from {-5, +5} WORDS around that
>> indexof(sound)
>
> Here's a pretty mindless way to do it. Split the string into an array,
> then iterate through the array looking for 'sound'. If necessary, you
> can use the word boundary markers. Then, starting at the index of the
> array element you found, print the ten elements starting at 'index -
> 5'. Like this:
>
> my $text = qq (I confirm that sufficient information and detail have
> been reported in this technical report, that it is scientifically
> sound, and that appropriate conclusions have been included);
> my @text = split(/\s/, $text);
> my $index = 0;
> foreach my $element (@text)
> {
> last if ($element =~ /sound/);
Try it with:
last if ($element =~ /confirm/);
so that $index = 1
> $index++;
> }
> my @report = splice(@text, $index - 5, 11);
^^^^^^^^^^
Negative indexes count backwards from the end of the array...
--
Tad McClellan
email: perl -le "print scalar reverse qq/moc.liamg\100cm.j.dat/"
The above message is a Usenet post.
I don't recall having given anyone permission to use it on a Web site.
------------------------------
Date: Thu, 16 Dec 2010 12:08:30 -0800
From: sln@netherlands.com
Subject: Re: Extracting a range of words!
Message-Id: <66skg69kgt86p5mdtbbqt028j5rtcsdt9q@4ax.com>
On Thu, 16 Dec 2010 13:57:52 -0600, Tad McClellan <tadmc@seesig.invalid> wrote:
>Uri Guttman <uri@StemSystems.com> wrote:
>>>>>>> "TM" == Tad McClellan <tadmc@seesig.invalid> writes:
>>
>> TM> my $word = 'sound';
>> TM> $text =~ s/.*? # leading stuff to strip
>> TM> ( # $1 is stuff to keep
>> TM> (\w+\W+){0,5} # 0-5 words
>> TM> \b$word\b\W* # the word to search for
>> TM> (\w+\W*){0,5} # 0-5 words
>> TM> )
>> TM> .* # trailing stuff to strip
>> TM> /$1/sx;
>>
>> that was pretty much the regex i would write. but do you need the \b's
>> in there? assuming $word is really \w chars, then the preceding \W will
>> obviate the need for the \b. same for the trailing one.
>
>
>It is needed for the trailing one, since the \W is zero or more,
>and it is zero or more so that the last $word in $text can be
>matched.
>
>
>> also i would use \s+\S+ since written words could contain apostrophes
>> and some other punctuation.
>
>
>That would be an improvement, I'll use that in the future.
Neither \s+\S+ or \w+\W+ will work seperately, they have to be used together.
But, since they overlap, its impossible to use together. This leaves
\w plus \s plus punctuation as the foundation.
-sln
------------------------------
Date: Thu, 16 Dec 2010 19:15:41 +0000 (UTC)
From: dmcanzi@remulak.uwaterloo.ca (David Canzi)
Subject: Re: FAQ 9.14 How do I make sure users can't enter values into a form that cause my CGI script to do bad things?
Message-Id: <iedogt$lpe$1@rumours.uwaterloo.ca>
In article <TimOo.17518$uS7.11352@newsfe23.iad>,
PerlFAQ Server <brian@theperlreview.com> wrote:
>This is an excerpt from the latest version perlfaq9.pod, which
>comes with the standard Perl distribution. These postings aim to
>reduce the number of repeated questions as well as allow the community
>to review and update the answers. The latest version of the complete
>perlfaq is at http://faq.perl.org .
>
>--------------------------------------------------------------------
>
>9.14: How do I make sure users can't enter values into a form that cause
>my CGI script to do bad things?
>
> (contributed by brian d foy)
>
> You can't really prevent people from sending your script bad data, at
> least not with Perl, which works on the server side. If you want to
I'd suggest shortening the first sentence to something like this:
"You can't really prevent people from sending your script bad data."
The part of the original sentence after the comma suggests that
client side checking would prevent evil users from sending the
server harmful data. It won't.
The word "really" is optional.
--
David Canzi | Life is too short to point out every mistake. |
------------------------------
Date: Thu, 16 Dec 2010 11:46:39 -0800 (PST)
From: ";;" <resourts125@gmail.com>
Subject: Looking buy Refined Palm others Cooking Oil
Message-Id: <a40073ca-e242-4cab-ab02-ddf5de4bf927@r8g2000prm.googlegroups.com>
Looking buy Refined Palm others Cooking Oil
http://virgo-trading-inc.blogspot.com
------------------------------
Date: Thu, 16 Dec 2010 11:15:06 -0800 (PST)
From: Mark S <mark.stafford@gmail.com>
Subject: Troubleshooting install from cpan
Message-Id: <35e3dd8a-7fce-4708-bbc0-5dd514a6c129@35g2000prb.googlegroups.com>
Hello,
I'm looking for pointers on how to proceed after an error during an
attempted install of Curses. Please see the information below.
Thanks!
Mark
## ## ## ## ## ## Distribution information
# lsb_release -a
LSB Version: :core-3.1-amd64:core-3.1-ia32:core-3.1-
noarch:graphics-3.1-amd64:graphics-3.1-ia32:graphics-3.1-noarch
Distributor ID: RedHatEnterpriseServer
Description: Red Hat Enterprise Linux Server release 5.5 (Tikanga)
Release: 5.5
Codename: Tikanga
## ## ## ## ## ## cpan output
# cpan
Sorry, we have to rerun the configuration dialog for CPAN.pm due to
some missing parameters...
...
cpan[1]> o conf
$CPAN::Config options from '/usr/lib/perl5/5.8.8/CPAN/Config.pm':
commit [Commit changes to disk]
defaults [Reload defaults from disk]
help [Short help about 'o conf' usage]
init [Interactive setting of all options]
applypatch undef
auto_commit [0]
build_cache [10]
build_dir [/root/.cpan/build]
build_dir_reuse undef
build_requires_install_policy [ask/yes]
bzip2 undef
cache_metadata [1]
check_sigs [0]
colorize_debug undef
colorize_output undef
colorize_print undef
colorize_warn undef
commandnumber_in_prompt [1]
commands_quote undef
connect_to_internet_ok [0]
cpan_home [/root/.cpan]
curl undef
dontload_hash
dontload_list undef
ftp [/usr/kerberos/bin/ftp]
ftp_passive [1]
ftp_proxy []
ftpstats_period undef
ftpstats_size undef
getcwd [cwd]
gpg [/usr/bin/gpg]
gzip [/bin/gzip]
halt_on_failure [0]
histfile [/root/.cpan/histfile]
histsize [100]
http_proxy []
inactivity_timeout [0]
index_expire [1]
inhibit_startup_message [0]
keep_source_where [/root/.cpan/sources]
load_module_verbosity [v]
lynx undef
make [/usr/bin/make]
make_arg []
make_install_arg []
make_install_make_command [/usr/bin/make]
makepl_arg []
mbuild_arg []
mbuild_install_arg []
mbuild_install_build_command [./Build]
mbuildpl_arg []
ncftp undef
ncftpget [/usr/bin/ncftpget]
no_proxy []
pager [/usr/bin/less]
password undef
patch undef
patches_dir undef
perl5lib_verbosity [v]
prefer_installer [MB]
prefs_dir undef
prerequisites_policy [ask]
proxy_pass undef
proxy_user undef
randomize_urllist undef
scan_cache [atstart]
shell [/bin/bash]
show_unparsable_versions undef
show_upload_date [0]
show_zero_versions undef
tar [/bin/tar]
tar_verbosity [v]
term_is_latin [1]
term_ornaments [1]
test_report undef
trust_test_report_history [0]
unzip [/usr/bin/unzip]
urllist
0 [ftp://cpan.mirrors.tds.net/pub/CPAN]
use_sqlite [0]
username undef
wait_list undef
wget [/usr/bin/wget]
yaml_load_code [0]
yaml_module undef
cpan[2]> install Curses
CPAN: Storable loaded ok (v2.15)
Going to read '/root/.cpan/Metadata'
Database was generated on Thu, 16 Dec 2010 14:50:26 GMT
Running install for module 'Curses'
Running make for G/GI/GIRAFFED/Curses-1.28.tgz
...
In file included from Curses.c:393:
CursesBoot.c: In function 'boot_Curses':
CursesBoot.c:23: warning: unused variable 't2'
CursesBoot.c:22: warning: unused variable 'tmp'
CursesBoot.c:21: warning: unused variable 'stash'
CursesBoot.c:17: warning: unused variable 'i'
make: *** [Curses.o] Error 1
GIRAFFED/Curses-1.28.tgz
/usr/bin/make -- NOT OK
CPAN: YAML loaded ok (v0.72)
Running make test
Can't test without successful make
Running make install
Make had returned bad status, install seems impossible
Failed during this command:
GIRAFFED/Curses-1.28.tgz : make NO
------------------------------
Date: Thu, 16 Dec 2010 14:13:54 -0600
From: Tad McClellan <tadmc@seesig.invalid>
Subject: Re: Troubleshooting install from cpan
Message-Id: <slrnigktfl.o7s.tadmc@tadbox.sbcglobal.net>
Mark S <mark.stafford@gmail.com> wrote:
> I'm looking for pointers on how to proceed after an error during an
> attempted install of Curses.
You begin cursing of course!
> Thanks!
SCNR
--
Tad McClellan
email: perl -le "print scalar reverse qq/moc.liamg\100cm.j.dat/"
The above message is a Usenet post.
I don't recall having given anyone permission to use it on a Web site.
------------------------------
Date: 6 Apr 2001 21:33:47 GMT (Last modified)
From: Perl-Users-Request@ruby.oce.orst.edu (Perl-Users-Digest Admin)
Subject: Digest Administrivia (Last modified: 6 Apr 01)
Message-Id: <null>
Administrivia:
To submit articles to comp.lang.perl.announce, send your article to
clpa@perl.com.
Back issues are available via anonymous ftp from
ftp://cil-www.oce.orst.edu/pub/perl/old-digests.
#For other requests pertaining to the digest, send mail to
#perl-users-request@ruby.oce.orst.edu. Do not waste your time or mine
#sending perl questions to the -request address, I don't have time to
#answer them even if I did know the answer.
------------------------------
End of Perl-Users Digest V11 Issue 3238
***************************************
