[31869] in Perl-Users-Digest
Perl-Users Digest, Issue: 3132 Volume: 11
daemon@ATHENA.MIT.EDU (Perl-Users Digest)
Wed Sep 15 11:09:35 2010
Date: Wed, 15 Sep 2010 08:09:11 -0700 (PDT)
From: Perl-Users Digest <Perl-Users-Request@ruby.OCE.ORST.EDU>
To: Perl-Users@ruby.OCE.ORST.EDU (Perl-Users Digest)
Perl-Users Digest Wed, 15 Sep 2010 Volume: 11 Number: 3132
Today's topics:
add document tags to xml doc <djstunks@gmail.com>
Re: add document tags to xml doc <ben@morrow.me.uk>
Re: add document tags to xml doc <djstunks@gmail.com>
Re: add document tags to xml doc <ben@morrow.me.uk>
Re: How to pass hash as sub parameter? <tadmc@seesig.invalid>
mapping dots to a map image <cartercc@gmail.com>
Re: mapping dots to a map image <willem@turtle.stack.nl>
Re: mapping dots to a map image <nospam-abuse@ilyaz.org>
Marc the Reaper <marc.girod@gmail.com>
Re: Marc the Reaper <marc.girod@gmail.com>
Re: Marc the Reaper <marc.girod@gmail.com>
text::CSV <hara.acharya@gmail.com>
Re: text::CSV <derykus@gmail.com>
Typeglobs and References <schaitan@gmail.com>
Digest Administrivia (Last modified: 6 Apr 01) (Perl-Users-Digest Admin)
----------------------------------------------------------------------
Date: Tue, 14 Sep 2010 16:45:39 -0700 (PDT)
From: DJ Stunks <djstunks@gmail.com>
Subject: add document tags to xml doc
Message-Id: <4f9de58d-530f-42a1-b13f-9dbe21cfc742@j30g2000vbr.googlegroups.com>
hey all,
I'm using XML::Parser to parse an xml file which is not well-formed.
The source I receive it from formats it as:
$ cat data.xml
<row><data foo="a"/></row>
<row><data baz="b"/></row>
Obviously the parser chokes on this. If I manually add document tags
as follows, my script is fine:
$ cat fixed-data.xml
<d>
<row><data foo="a"/></row>
<row><data baz="b"/></row>
</d>
Question: script is below. What is the easiest way to add the
document tags such that the parser doesn't choke without the
additional step of manually adding them? I can pass a filehandle to
the parser if there was a way to add document tags to the filehandle,
but the file is very large and I couldn't think of an easy way to add
the data to the filehandle without slurping into a scalar.
TIA,
-jp
$ cat tmp.pl
#!/usr/bin/perl
use strict;
use warnings;
use XML::Parser;
my $parser = XML::Parser->new(Handlers => { Start =>
\&handle_start });
$parser->parsefile('fixed-data.xml');
sub handle_start {
my ($p, $el, %atts) = @_;
if ($el eq 'data') {
for my $k (keys %atts) {
print "$k: $atts{$k}\n";
}
}
}
__END__
------------------------------
Date: Wed, 15 Sep 2010 01:26:31 +0100
From: Ben Morrow <ben@morrow.me.uk>
Subject: Re: add document tags to xml doc
Message-Id: <neg5m7-frj2.ln1@osiris.mauzo.dyndns.org>
Quoth DJ Stunks <djstunks@gmail.com>:
> hey all,
>
> I'm using XML::Parser to parse an xml file which is not well-formed.
> The source I receive it from formats it as:
>
> $ cat data.xml
> <row><data foo="a"/></row>
> <row><data baz="b"/></row>
>
> Obviously the parser chokes on this. If I manually add document tags
> as follows, my script is fine:
>
> $ cat fixed-data.xml
> <d>
> <row><data foo="a"/></row>
> <row><data baz="b"/></row>
> </d>
>
> Question: script is below. What is the easiest way to add the
> document tags such that the parser doesn't choke without the
> additional step of manually adding them? I can pass a filehandle to
> the parser if there was a way to add document tags to the filehandle,
> but the file is very large and I couldn't think of an easy way to add
> the data to the filehandle without slurping into a scalar.
See XML::Parser->parse_start. You will obviously have to handle reading
chunks from the file manually.
In the general case you can use something like PerlIO::code, or write a
simple tied filehandle class. Neither is particularly hard, just fiddly.
Ben
------------------------------
Date: Tue, 14 Sep 2010 18:15:48 -0700 (PDT)
From: DJ Stunks <djstunks@gmail.com>
Subject: Re: add document tags to xml doc
Message-Id: <e4dfc5e6-9e57-4897-9b18-20fcc3ae4d2f@q16g2000prf.googlegroups.com>
On Sep 14, 6:26=A0pm, Ben Morrow <b...@morrow.me.uk> wrote:
> Quoth DJ Stunks <djstu...@gmail.com>:
>
>
>
> > hey all,
>
> > I'm using XML::Parser to parse an xml file which is not well-formed.
> > The source I receive it from formats it as:
>
> > $ cat data.xml
> > <row><data foo=3D"a"/></row>
> > <row><data baz=3D"b"/></row>
>
> > Obviously the parser chokes on this. =A0If I manually add document tags
> > as follows, my script is fine:
>
> > $ cat fixed-data.xml
> > <d>
> > <row><data foo=3D"a"/></row>
> > <row><data baz=3D"b"/></row>
> > </d>
>
> > Question: script is below. =A0What is the easiest way to add the
> > document tags such that the parser doesn't choke without the
> > additional step of manually adding them? =A0I can pass a filehandle to
> > the parser if there was a way to add document tags to the filehandle,
> > but the file is very large and I couldn't think of an easy way to add
> > the data to the filehandle without slurping into a scalar.
>
> See XML::Parser->parse_start. You will obviously have to handle reading
> chunks from the file manually.
Thanks very much, Ben. With the modified code below I'm good to go.
It took a bit of hunting on that method, thanks for pointing it out.
-jp
#!/usr/bin/perl
use strict;
use warnings;
use XML::Parser;
my $file =3D 'data.xml';
my $parser =3D XML::Parser->new(Handlers =3D> { Start =3D>
\&handle_start });
my $p =3D $parser->parse_start();
$p->parse_more('<d>');
open (my $fh, '<', $file) or die "Could not open '$file': $!";
LINE:
while (my $line =3D <$fh>) {
$p->parse_more($line);
}
sub handle_start {
my ($p, $el, %atts) =3D @_;
if ($el eq 'data') {
for my $k (keys %atts) {
print "$k: $atts{$k}\n";
}
}
}
__END__
------------------------------
Date: Wed, 15 Sep 2010 02:45:40 +0100
From: Ben Morrow <ben@morrow.me.uk>
Subject: Re: add document tags to xml doc
Message-Id: <43l5m7-i9k2.ln1@osiris.mauzo.dyndns.org>
Quoth DJ Stunks <djstunks@gmail.com>:
> On Sep 14, 6:26 pm, Ben Morrow <b...@morrow.me.uk> wrote:
> > Quoth DJ Stunks <djstu...@gmail.com>:
> >
> > > I'm using XML::Parser to parse an xml file which is not well-formed.
> > > The source I receive it from formats it as:
> >
> > > $ cat data.xml
> > > <row><data foo="a"/></row>
> > > <row><data baz="b"/></row>
> >
> > > Obviously the parser chokes on this. If I manually add document tags
> > > as follows, my script is fine:
> >
> > > $ cat fixed-data.xml
> > > <d>
> > > <row><data foo="a"/></row>
> > > <row><data baz="b"/></row>
> > > </d>
> >
> > > Question: script is below. What is the easiest way to add the
> > > document tags such that the parser doesn't choke without the
> > > additional step of manually adding them? I can pass a filehandle to
> > > the parser if there was a way to add document tags to the filehandle,
> > > but the file is very large and I couldn't think of an easy way to add
> > > the data to the filehandle without slurping into a scalar.
> >
> > See XML::Parser->parse_start. You will obviously have to handle reading
> > chunks from the file manually.
>
> Thanks very much, Ben. With the modified code below I'm good to go.
> It took a bit of hunting on that method, thanks for pointing it out.
>
> #!/usr/bin/perl
>
> use strict;
> use warnings;
>
> use XML::Parser;
>
> my $file = 'data.xml';
>
> my $parser = XML::Parser->new(Handlers => { Start =>
> \&handle_start });
>
> my $p = $parser->parse_start();
> $p->parse_more('<d>');
>
> open (my $fh, '<', $file) or die "Could not open '$file': $!";
>
I would recommend
local $/ = \2048;
at this point, or using sysread instead of <>. There's no need to go
poking through the buffer looking for newlines when you're just going to
pass the whole lot to an XML parser anyway.
> LINE:
> while (my $line = <$fh>) {
> $p->parse_more($line);
> }
Ben
------------------------------
Date: Tue, 14 Sep 2010 14:02:06 -0500
From: Tad McClellan <tadmc@seesig.invalid>
Subject: Re: How to pass hash as sub parameter?
Message-Id: <slrni8vhlo.mf.tadmc@tadbox.sbcglobal.net>
Rui Maciel <rui.maciel@gmail.com> wrote:
> I know how to read docs
The evidence says otherwise.
You asked a basic question about subroutines that is answered
near the very top of the documentation for subroutines.
Wave your hands, and people will _still_ see that you did not
read the relevant doc before posting.
> and how to use usenet.
The evidence says otherwise.
When you make a mistake, such as not reading the relevant docs,
most folks man up and admit their mistake rather than dancing
around proclaiming that it was somebody else's fault.
People that know how to use usenet follow basic netiquette such as
checking the relevant docs before posting and limiting line lengths.
Wave your hands, and people will _still_ see that you are
not following standard netiquette.
> What I lack is the ability to receive insults
Then you should stop earning them (by flaunting netiquette).
> misanthropic idiots who acts as if everyone owes them something
Everybody here is owed the courtesy of checking the relevant docs
before posting.
> and believe that newbies should be
> forced to assume a submissive posture before them and their condescending blurbs.
It is not "newbieness" that makes them beleive that, it is folks
that do not follow the established rules of manners.
> So, regarding your "burning bridges" comment, some people, no matter how technically proficient
> they may be, simply aren't civilized. They, unfortunately, are unable to show any semblance of
> respect
You disrespected us first.
You reap what you sow.
> any better and therefore are complete failures at dealing with other people. It's on everyone's
> best interests to avoid any contact with those misanthropic idiots.
>
> Thankfully, not everyone is like that. The majority of us aren't hampered by that problem and, as
> a consequence, are perfectly capable of interacting with people, even capable of being a pleasure
> to deal with.
You are perfectly capable of interacting with people?
What a hoot!
> injecting pollution into this newsgroup.
Asking a question that is clearly answered by the relevant docs
is injecting pollution into this newsgroup.
>> and you expect to come in and be spoon fed your
>> way?
>
> You seem to be confused or you simply failed to follow the thread, as nowhere I've expected to be
> "spoon fed" anything.
You had us read the docs to you. That is spoon feeding. You should
be able to do that yourself if you were grownup.
> If you want to criticize me or any of my posts please base your accusations
> on reality.
You ask questions clearly answered in the relevant docs.
You do not limit line lengths.
There's some reality.
--
Tad McClellan
email: perl -le "print scalar reverse qq/moc.liamg\100cm.j.dat/"
The above message is a Usenet post.
I don't recall having given anyone permission to use it on a Web site.
------------------------------
Date: Tue, 14 Sep 2010 11:49:17 -0700 (PDT)
From: ccc31807 <cartercc@gmail.com>
Subject: mapping dots to a map image
Message-Id: <9ed47b14-ddda-47a6-b2a8-82c71978e21e@k13g2000vbq.googlegroups.com>
I have three files. One is a data file which contains three columns, a
datum, a X axis (latitude), and a Y axis (longitude). It essentially
represents the number of individuals meeting particular criteria that
reside in specific locations. The second is a GIF with a dot plot
created using GD::Graph, using the data in the first file. The third
is a B & W GIF which is a map of the United States.
I would like to overlay the dot plot with the map to give a graphical
representation of the number of people on a particular location. My
problem seems to be one of projection -- I can manipulate the latitude
and longitude to correlate to the X and Y position of the pixels on
the map for regions, but not for the entire map, i.e., if the dot plot
overlays Washington D.C. perfectly, San Francisco appears in Nevada,
and if I center the map on Chicago, Miami appears in the Gulf of
Mexico. So far, I've used several different maps, and none of them
consistently show the same locations (on the map) for the coordinates.
I'm stuck at adjusting the dot plot file and the map, and I'm thinking
that I probably need an 'intelligent' map that can place the dots
where they belong. Is there a Perl solution to this problem? Or maybe
I'm looking for the wrong solution.
Thanks, CC.
------------------------------
Date: Tue, 14 Sep 2010 19:09:57 +0000 (UTC)
From: Willem <willem@turtle.stack.nl>
Subject: Re: mapping dots to a map image
Message-Id: <slrni8vi45.12ej.willem@turtle.stack.nl>
ccc31807 wrote:
) I have three files. One is a data file which contains three columns, a
) datum, a X axis (latitude), and a Y axis (longitude). It essentially
) represents the number of individuals meeting particular criteria that
) reside in specific locations. The second is a GIF with a dot plot
) created using GD::Graph, using the data in the first file. The third
) is a B & W GIF which is a map of the United States.
)
) I would like to overlay the dot plot with the map to give a graphical
) representation of the number of people on a particular location. My
) problem seems to be one of projection -- I can manipulate the latitude
) and longitude to correlate to the X and Y position of the pixels on
) the map for regions, but not for the entire map, i.e., if the dot plot
) overlays Washington D.C. perfectly, San Francisco appears in Nevada,
) and if I center the map on Chicago, Miami appears in the Gulf of
) Mexico. So far, I've used several different maps, and none of them
) consistently show the same locations (on the map) for the coordinates.
)
) I'm stuck at adjusting the dot plot file and the map, and I'm thinking
) that I probably need an 'intelligent' map that can place the dots
) where they belong. Is there a Perl solution to this problem? Or maybe
) I'm looking for the wrong solution.
You should be looking for a description of the projection that is used to
create the map you have, and more precisely how that would translate to a
mapping function between lat-long coordinates and xy coordinates on the
map.
There's probably, depending on the specific projection used, a more or less
simple mathematical formula to translate. Simply convert that to a perl
function and you're basically done.
After googling for a tiny bit, it appears I was overly optimistic on the
simpleness of the function. The wikipedia entry on the mercator projection
(which was the first hit) gives
x = longitude and y = ln(tan(pi/4 + latitude/2))
Unfortunately, usanian maps of the usa tend to have more complicated
projections so as to maximize the apparent size of the usa in relation to
other places, so it's probably a more complicated formula for that map.
SaSW, Willem
--
Disclaimer: I am in no way responsible for any of the statements
made in the above text. For all I know I might be
drugged or something..
No I'm not paranoid. You all think I'm paranoid, don't you !
#EOT
------------------------------
Date: Tue, 14 Sep 2010 23:37:35 +0000 (UTC)
From: Ilya Zakharevich <nospam-abuse@ilyaz.org>
Subject: Re: mapping dots to a map image
Message-Id: <slrni901pv.c17.nospam-abuse@powdermilk.math.berkeley.edu>
On 2010-09-14, Willem <willem@turtle.stack.nl> wrote:
> ) I'm stuck at adjusting the dot plot file and the map, and I'm thinking
> ) that I probably need an 'intelligent' map that can place the dots
> ) where they belong. Is there a Perl solution to this problem? Or maybe
> ) I'm looking for the wrong solution.
>
> You should be looking for a description of the projection that is used to
> create the map you have, and more precisely how that would translate to a
> mapping function between lat-long coordinates and xy coordinates on the
> map.
>
> There's probably, depending on the specific projection used, a more or less
> simple mathematical formula to translate. Simply convert that to a perl
> function and you're basically done.
Won't work with the most useful projections. They have PARAMETERS
which are very rarely documented on the map.
I would recommend finding a Mercator map, and deal with it; it looks
horrible, but at least it has only scale as the parameter. Then
Heigth = f(Lattitude), Width = const * Longitude * const,
Oh, I see, it is documented below:
> x = longitude and y = ln(tan(pi/4 + latitude/2))
- up to two additive constants [shift], and one multiplicative
[scale], which are easy to find if you know coordinates of two
points on the map.
Hope this helps,
Ilya
------------------------------
Date: Wed, 15 Sep 2010 06:22:17 -0700 (PDT)
From: Marc Girod <marc.girod@gmail.com>
Subject: Marc the Reaper
Message-Id: <da9f5d91-33ed-43a1-a503-7e6123af748a@t7g2000vbj.googlegroups.com>
Hello,
I have a nightly build script which forks a lot of processes which may
last long or not.
I wanted to reap them before the end of the script.
This addition made, I lose the exit code of my builds: they all
pretend to fail, which I suspect to be false.
So, I guess I was not able to read the perlipc page correctly.
Here is a short script which behaves in the same way as my nightly
build;
foo:
#!/usr/bin/perl -w
use strict;
use POSIX ":sys_wait_h";
sub child {
system('date');
my $ec = $? >> 8;
warn "Child exit code: $?\n";
exit $ec;
}
my %family;
sub reaper { # from perlipc
local ($!, $?); # don't let waitpid() overwrite current error
my ($prd, $child) = '';
while (($child = waitpid(-1, WNOHANG)) > 0) {
if (exists $family{$child}) {
$prd = $family{$child};
delete $family{$child};
warn "Reaped $prd($child) with exit $?\n";
}
}
$SIG{CHLD} = \&reaper;
}
$SIG{CHLD} = \&reaper;
if (my $pid = fork) {
$family{$pid} = 'date';
} else {
die "cannot fork: $!" unless defined($pid);
child;
}
while (%family) {
foreach my $kid (keys %family) {
delete $family{$kid} if waitpid($kid, WNOHANG);
}
sleep 1;
}
warn "Parent exit\n";
exit 0;
And an example run:
$ ./foo
Wed Sep 15 14:15:17 BST 2010
Child exit code: -1
Reaped date(21287) with exit 65280
Parent exit
So, how to protect the return code?
Thanks,
Marc
------------------------------
Date: Wed, 15 Sep 2010 06:57:12 -0700 (PDT)
From: Marc Girod <marc.girod@gmail.com>
Subject: Re: Marc the Reaper
Message-Id: <c90354d4-b84f-433c-97a9-b010d7004197@q9g2000vbd.googlegroups.com>
Just two additions to my post, to clarify:
On Sep 15, 2:22=A0pm, Marc Girod <marc.gi...@gmail.com> wrote:
> So, how to protect the return code?
- I did 2 minors improvements inside the reaper function:
1. removed the useless initialization
2. shifted the error code there as I had done in the child function
sub reaper { # from perlipc
local ($!, $?); # don't let waitpid() overwrite current error
my ($prd, $child) =3D '';
while (($child =3D waitpid(-1, WNOHANG)) > 0) {
if (exists $family{$child}) {
$prd =3D $family{$child};
delete $family{$child};
warn "Reaped $prd($child) with exit @{[$?>>8]}\n";
}
}
$SIG{CHLD} =3D \&reaper;
}
- I checked that if I comment away the signal handler setting, date
starts to report success again:
#$SIG{CHLD} =3D \&reaper;
$ ./foo
Wed Sep 15 14:51:08 BST 2010
Child exit code: 0
Parent exit
Marc
------------------------------
Date: Wed, 15 Sep 2010 07:50:56 -0700 (PDT)
From: Marc Girod <marc.girod@gmail.com>
Subject: Re: Marc the Reaper
Message-Id: <0822e093-0ca7-49b4-9546-67deaf0c735e@c13g2000vbr.googlegroups.com>
On Sep 15, 2:22=A0pm, Marc Girod
> So, how to protect the return code?
I found this in perlvar:
If you have installed a signal handler for "SIGCHLD", the value
of $? will usually be wrong outside that handler.
Marc
------------------------------
Date: Tue, 14 Sep 2010 21:59:26 -0700 (PDT)
From: king <hara.acharya@gmail.com>
Subject: text::CSV
Message-Id: <7b6dd912-4aa4-4146-a14d-b6d850630202@p24g2000pra.googlegroups.com>
I have a script which i converted into executable using PDK.
when i run the executable using i get a error saying
"
C:\Users\hacharyx\Desktop\C_State_Residency>C_State_residency.exe
Can't locate Text/CSV_PP.pm in @INC (@INC contains:) at (eval 12) line
2.
at perlapp line 843
BEGIN failed--compilation aborted at C_State_residency.pl line 5."
But when I run the .pl file it works fine.
The script is as follows.
"
#!/c/perl64/bin
use strict;
use warnings;
use Text::CSV;
use Win32::OLE('in');
######################################################################
sleep 4;
system("typeperf \"\\Processor\(\*\)\\% C1 Time\" -sc 50 -o c1.csv");
sleep 1;
######################################################################
my $file_1 = 'c1.csv';
my $csv_1 = Text::CSV->new();
open (CSV_1, "<", $file_1) or die $!;
my @c1_total;
my @column_1;
my $value_1;
my $i;
my $sum_1=0;
while (<CSV_1>)
{
if ($csv_1->parse($_))
{
my @columns_1 = $csv_1->fields();
#print "@columns_1\n";
push(@c1_total, $columns_1[$#columns_1]);
}
else
{
my $err = $csv_1->error_input;
print "Failed to parse line: $err";
}
}
close CSV_1;
shift(@c1_total);
shift(@c1_total);
foreach $value_1 (@c1_total)
{
print "$value_1\n";
}
for($i=0; $i<= $#c1_total; $i++)
{
$sum_1 = $sum_1 + $c1_total[$i];
}
my $avg_1 = $sum_1/($#c1_total+1);
open(Mini_Bat,">>C:\\Tests\\Logs\\Mini_Bat\\Mini_Bat.txt");
print "C1 Avg: $avg_1\n";
print Mini_Bat "% of avg. C1 Time: $avg_1\n";
######################################################################
"
Can anybody help me why it is not working if run after converting into
a executable?
------------------------------
Date: Wed, 15 Sep 2010 04:49:10 -0700 (PDT)
From: "C.DeRykus" <derykus@gmail.com>
Subject: Re: text::CSV
Message-Id: <c7b22208-b896-4d83-9c1a-75ea128d76c5@y12g2000prb.googlegroups.com>
On Sep 14, 9:59=A0pm, king <hara.acha...@gmail.com> wrote:
> I have a script which i converted into executable using PDK.
>
> when i run the executable using i get a error saying
> "
> C:\Users\hacharyx\Desktop\C_State_Residency>C_State_residency.exe
> Can't locate Text/CSV_PP.pm in @INC (@INC contains:) at (eval 12) line
> 2.
> =A0at perlapp line 843
> ...
Did you first check Activestate's PDK resources -
FAQ, archives, user forums...
--
Charles DeRykus
------------------------------
Date: Wed, 15 Sep 2010 06:27:15 -0700 (PDT)
From: Krishna Chaitanya <schaitan@gmail.com>
Subject: Typeglobs and References
Message-Id: <b6ae16aa-f4a4-4fd7-bcc8-217738073fcd@x18g2000pro.googlegroups.com>
Hi everybody,
I've read in Perl books that when used as lvalues, typeglobs are
"equivalent" to references...something like this is constantly quoted
as an example of selective aliasing:
*b = \$a; # aliases $b to $a but leaves @b,%b,etc untouched
Also, I've read about the *foo{THING} notation...accessing $a as:
print ${*a{SCALAR}}; # prints the value of $a
But what is this following code I see in some places:
print ${*a}; # ALSO prints the value of $a
I am confused.....how is ${*a} equivalent to ${*a{SCALAR}} ? If these
2 are equivalent, why follow the *foo{THING} notation at all...? Seems
like the '{THING}' part is quite useless here? Am I wrong, or am I
missing anything subtle/obvious here?
Pls. enlighten.....thanks a lot.
-Chaitanya
------------------------------
Date: 6 Apr 2001 21:33:47 GMT (Last modified)
From: Perl-Users-Request@ruby.oce.orst.edu (Perl-Users-Digest Admin)
Subject: Digest Administrivia (Last modified: 6 Apr 01)
Message-Id: <null>
Administrivia:
To submit articles to comp.lang.perl.announce, send your article to
clpa@perl.com.
Back issues are available via anonymous ftp from
ftp://cil-www.oce.orst.edu/pub/perl/old-digests.
#For other requests pertaining to the digest, send mail to
#perl-users-request@ruby.oce.orst.edu. Do not waste your time or mine
#sending perl questions to the -request address, I don't have time to
#answer them even if I did know the answer.
------------------------------
End of Perl-Users Digest V11 Issue 3132
***************************************
