[6469] in Perl-Users-Digest
Perl-Users Digest, Issue: 95 Volume: 8
daemon@ATHENA.MIT.EDU (Perl-Users Digest)
Tue Mar 11 19:27:17 1997
Date: Tue, 11 Mar 97 16:06:18 -0800
From: Perl-Users Digest <Perl-Users-Request@ruby.OCE.ORST.EDU>
To: Perl-Users@ruby.OCE.ORST.EDU (Perl-Users Digest)
Perl-Users Digest Tue, 11 Mar 1997 Volume: 8 Number: 95
Today's topics:
Perl FAQ part 8 of 0..9: System Interaction [Periodic P <tchrist@mox.perl.com>
Perl FAQ part 9 of 0..9: Networking [Periodic Posting] <tchrist@mox.perl.com>
Reading back from SOCKET <amigliozzi@wpine.com>
Re: Reading back from SOCKET (Nathan V. Patwardhan)
Re: Running same perl script on different platforms <rootbeer@teleport.com>
Re: Scope? <tchrist@mox.perl.com>
Re: Sort, System() problem. <rootbeer@teleport.com>
Re: TCP Server from manpage fails (Kester Habermann)
Tellnet scripting with perl <jkekoni@cc.hut.fi>
Transferring a socket descriptor Bradley.Clark@disclosure.com
Re: WANTED: Perlscript for WebChat <Pjfryan@charm.net>
What's a good Perl book? (David Tong)
XDR -> pack() template? (Paul Holser)
Digest Administrivia (Last modified: 8 Mar 97) (Perl-Users-Digest Admin)
----------------------------------------------------------------------
Date: 11 Mar 1997 23:27:09 GMT
From: Tom Christiansen <tchrist@mox.perl.com>
Subject: Perl FAQ part 8 of 0..9: System Interaction [Periodic Posting]
Message-Id: <5g4pod$g0e$1@csnews.cs.colorado.edu>
=head1 NAME
perlfaq8 - System Interaction ($Revision: 1.14 $)
=head1 DESCRIPTION
This section of the Perl FAQ covers questions involving operating
system interaction. This involves interprocess communication (IPC),
control over the user-interface (keyboard, screen and pointing
devices), and most anything else not related to data manipulation.
Read the FAQs and documentation specific to the port of perl to your
operating system (eg, L<perlvms>, L<perlplan9>, ...). These should
contain more detailed information on the vagaries of your perl.
=head2 How do I find out which operating system I'm running under?
The $^O variable ($OSTYPE if you use English) contains the operating
system that your perl binary was built for.
=head2 How come exec() doesn't return?
Because that's what it does: it replaces your currently running
program with a different one. If you want to keep going (as is
probably the case if you're asking this question) use system()
instead.
=head2 How do I do fancy stuff with the keyboard/screen/mouse?
How you access/control keyboards, screens, and pointing devices
("mice") is system-dependent. Try the following modules:
=over 4
=item Keyboard
Term::Cap Standard perl distribution
Term::ReadKey CPAN
Term::ReadLine::Gnu CPAN
Term::ReadLine::Perl CPAN
Term::Screen CPAN
=item Screen
Term::Cap Standard perl distribution
Curses CPAN
Term::ANSIColor CPAN
=item Mouse
Tk CPAN
=back
=head2 How do I ask the user for a password?
(This question has nothing to do with the web. See a different
FAQ for that.)
There's an example of this in in L<perlfunc/crypt>). First, you put
the terminal into "no echo" mode, then just read the password
normally. You may do this with an old-style ioctl() function, POSIX
terminal control (see L<POSIX>, and Chapter 7 of the Camel), or a call
to the B<stty> program, with varying degrees of portability.
You can also do this for most systems using the Term::ReadKey module
from CPAN, which is easier to use and in theory more portable.
=head2 How do I read and write the serial port?
This depends on which operating system your program is running on. In
the case of Unix, the serial ports will be accessible through files in
/dev; on other systems, the devices names will doubtless differ.
Several problem areas common to all device interaction are the
following
=over 4
=item lockfiles
Your system may use lockfiles to control multiple access. Make sure
you follow the correct protocol. Unpredictable behaviour can result
from multiple processes reading from one device.
=item open mode
If you expect to use both read and write operations on the device,
you'll have to open it for update (see L<perlfunc/"open"> for
details). You may wish to open it without running the risk of
blocking by using sysopen() and C<O_RDWR|O_NDELAY|O_NOCTTY> from the
Fcntl module (part of the standard perl distribution). See
L<perlfunc/"sysopen"> for more on this approach.
=item end of line
Some devices will be expecting a "\r" at the end of each line rather
than a "\n". In some ports of perl, "\r" and "\n" are different from
their usual (Unix) ASCII values of "\012" and "\015". You may have to
give the numeric values you want directly, using octal ("\015"), hex
("0x0D"), or as a control-character specification ("\cM").
print DEV "atv1\012"; # wrong, for some devices
print DEV "atv1\015"; # right, for some devices
Even though with normal text files, a "\n" will do the trick, there is
still no unified scheme for terminating a line that is portable
between Unix, DOS/Win, and Macintosh, except to terminate I<ALL> line
ends with "\015\012", and strip what you don't need from the output.
This applies especially to socket I/O and autoflushing, discussed
next.
=item flushing output
If you expect characters to get to your device when you print() them,
you'll want to autoflush that filehandle, as in the older
use FileHandle;
DEV->autoflush(1);
and the newer
use IO::Handle;
DEV->autoflush(1);
You can use select() and the C<$|> variable to control autoflushing
(see L<perlvar/$|> and L<perlfunc/select>):
$oldh = select(DEV);
$| = 1;
select($oldh);
You'll also see code that does this without a temporary variable, as in
select((select(DEV), $| = 1)[0]);
As mentioned in the previous item, this still doesn't work when using
socket I/O between Unix and Macintosh. You'll need to hardcode your
line terminators, in that case.
=item non-blocking input
If you are doing a blocking read() or sysread(), you'll have to
arrange for an alarm handler to provide a timeout (see
L<perlfunc/alarm>). If you have a non-blocking open, you'll likely
have a non-blocking read, which means you may have to use a 4-arg
select() to determine whether I/O is ready on that device (see
L<perlfunc/"select">.
=back
=head2 How do I decode encrypted password files?
You spend lots and lots of money on dedicated hardware, but this is
bound to get you talked about.
Seriously, you can't if they are Unix password files - the Unix
password system employs one-way encryption. Programs like Crack can
forcibly (and intelligently) try to guess passwords, but don't (can't)
guarantee quick success.
If you're worried about users selecting bad passwords, you should
proactively check when they try to change their password (by modifying
passwd(1), for example).
=head2 How do I start a process in the background?
You could use
system("cmd &")
or you could use fork as documented in L<perlfunc/"fork">, with
further examples in L<perlipc>. Some things to be aware of, if you're
on a Unix-like system:
=over 4
=item STDIN, STDOUT and STDERR are shared
Both the main process and the backgrounded one (the "child" process)
share the same STDIN, STDOUT and STDERR filehandles. If both try to
access them at once, strange things can happen. You may want to close
or reopen these for the child. You can get around this with
C<open>ing a pipe (see L<perlfunc/"open">) but on some systems this
means that the child process cannot outlive the parent.
=item Signals
You'll have to catch the SIGCHLD signal, and possibly SIGPIPE too.
SIGCHLD is sent when the backgrounded process finishes. SIGPIPE is
sent when you write to a filehandle whose child process has closed (an
untrapped SIGPIPE can cause your program to silently die). This is
not an issue with C<system("cmd&")>.
=item Zombies
You have to be prepared to "reap" the child process when it finishes
$SIG{CHLD} = sub { wait };
See L<perlipc/"Signals"> for other examples of code to do this.
Zombies are not an issue with C<system("prog &")>.
=back
=head2 How do I trap control characters/signals?
You don't actually "trap" a control character. Instead, that
character generates a signal, which you then trap. Signals are
documented in L<perlipc/"Signals"> and chapter 6 of the Camel.
Be warned that very few C libraries are re-entrant. Therefore, if you
attempt to print() in a handler that got invoked during another stdio
operation your internal structures will likely be in in an
inconsistent state, and your program will dump core. You can
sometimes avoid this by using syswrite() instead of print().
Unless you're exceedingly careful, the only safe things to do inside a
signal handler are: set a variable and exit. And in the first case,
you should only set a variable in such a way that malloc() is not
called (eg, by setting a variable that already has a value).
For example:
$Interrupted = 0; # to ensure it has a value
$SIG{INT} = sub {
$Interrupted++;
syswrite(STDERR, "ouch\n", 5);
}
However, because syscalls restart by default, you'll find that if
you're in a "slow" call, such as E<lt>FHE<gt>, read(), connect(), or
wait(), that the only way to terminate them is by "longjumping" out;
that is, by raising an exception. See the time-out handler for a
blocking flock() in L<perlipc/"Signals"> or chapter 6 of the Camel.
=head2 How do I modify the shadow password file on a Unix system?
If perl was installed correctly, the getpw*() functions described in
L<perlfunc> provide (read-only) access to the shadow password file.
To change the file, make a new shadow password file (the format varies
from system to system - see L<passwd(5)> for specifics) and use
pwd_mkdb(8) to install it (see L<pwd_mkdb(5)> for more details).
=head2 How do I set the time and date?
Assuming you're running under sufficient permissions, you should be
able to set the system-wide date and time by running the date(1)
program. (There is no way to set the time and date on a per-process
basis.) This mechanism will work for Unix, MS-DOS, Windows, and NT;
the VMS equivalent is C<set time>.
However, if all you want to do is change your timezone, you can
probably get away with setting an environment variable:
$ENV{TZ} = "MST7MDT"; # unixish
$ENV{'SYS$TIMEZONE_DIFFERENTIAL'}="-5" # vms
system "trn comp.lang.perl";
=head2 How can I sleep() or alarm() for under a second?
If you want finer granularity than the 1 second that the sleep()
function provides, the easiest way is to use the select() function as
documented in L<perlfunc/"select">. If your system has itimers and
syscall() support, you can check out the old example in
http://www.perl.com/CPAN/doc/misc/ancient/tutorial/eg/itimers.pl .
=head2 How can I measure time under a second?
In general, you may not be able to. But if you system supports both
the syscall() function in Perl as well as a system call like
gettimeofday(2), then you may be able to do something like this:
require 'sys/syscall.ph';
$TIMEVAL_T = "LL";
$done = $start = pack($TIMEVAL_T, ());
syscall( &SYS_gettimeofday, $start, 0)) != -1
or die "gettimeofday: $!";
##########################
# DO YOUR OPERATION HERE #
##########################
syscall( &SYS_gettimeofday, $done, 0) != -1
or die "gettimeofday: $!";
@start = unpack($TIMEVAL_T, $start);
@done = unpack($TIMEVAL_T, $done);
# fix microseconds
for ($done[1], $start[1]) { $_ /= 1_000_000 }
$delta_time = sprintf "%.4f", ($done[0] + $done[1] )
-
($start[0] + $start[1] );
=head2 How can I do an atexit() or setjmp()/longjmp()? (Exception handling)
Release 5 of Perl added the END block, which can be used to simulate
atexit(). Each package's END block is called when the program or thread
ends (see L<perlmod> manpage for more details).
Perl's exception-handling mechanism is its eval() operator. You can
use eval() as setjmp and die() as longjmp. For details of this, see
the section on signals, especially the time-out handler for a blocking
flock() in L<perlipc/"Signals"> and chapter 6 of the Camel.
If exception handling is all you're interested in, try the
exceptions.pl library (part of the standard perl distribution).
If you want the atexit() syntax (and an rmexit() as well), try the
AtExit module available from CPAN.
=head2 Why doesn't my sockets program work under System V (Solaris)? What does the error message "Protocol not supported" mean?
Some Sys-V based systems, notably Solaris 2.X, redefined some of the
standard socket constants. Since these were constant across all
architectures, they were often hardwired into perl code. The proper
way to deal with this is to "use Socket" to get the correct values.
Note that even though SunOS and Solaris are binary compatible, these
values are different. Go figure.
=head2 How can I call my system's unique C functions from Perl?
In most cases, you write an external module to do it - see the answer
to "Where can I learn about linking C with Perl? [h2xs, xsubpp]".
However, if the function is a system call, and your system supports
syscall(), you can use the syscall function (documented in
L<perlfunc(1)>).
Remember to check the modules that came with your distribution, and
CPAN as well - someone may already have written a module to do it.
=head2 Where do I get the include files to do ioctl() or syscall()?
Historically, these would be generated by the h2ph tool, part of the
standard perl distribution. This program converts cpp(1) directives
in C header files to files containing subroutine definitions, like
&SYS_getitimer, which you can use as arguments to your functions.
It doesn't work perfectly, but it usually gets most of the job done.
Simple files like F<errno.h>, F<syscall.h>, and F<socket.h> were fine,
but the hard ones like F<ioctl.h> nearly always need to hand-edited.
Here's how to install the *.ph files:
1. become super-user
2. cd /usr/include
3. h2ph *.h */*.h
If your system supports dynamic loading, for reasons of portability and
sanity you probably ought to use h2xs (also part of the standard perl
distribution). This tool converts C header files to Perl extensions.
See L<perlxstut> for how to get started with h2xs.
If your system doesn't support dynamic loading, you still probably
ought to use h2xs. See L<perlxstut> and L<ExtUtils::MakeMaker> for
more information (in brief, just use B<make perl> instead of a plain
B<make> to rebuild perl with a new static extension).
=head2 Why do setuid perl scripts complain about kernel problems?
Some operating systems have bugs in the kernel that make setuid
scripts inherently insecure. Perl gives you a number of options
(described in L<perlsec>) to work around such systems.
=head2 How can I open a pipe both to and from a command?
The IPC::Open2 module (part of the standard perl distribution) is an
easy-to-use approach that internally uses pipe(), fork(), and exec()
to do the job. Make sure you read the deadlock warnings in its
documentation, though (see L<IPC::Open2>).
=head2 How can I capture STDERR from an external command?
There are three basic ways of running external commands:
system $cmd; # using system()
$output = `$cmd`; # using backticks (``)
open (PIPE, "cmd |"); # using open()
With system(), both STDOUT and STDERR will go the same place as the
script's versions of these, unless the command redirects them.
Backticks and open() read B<only> the STDOUT of your command.
With any of these, you can change file descriptors before the call:
open(STDOUT, ">logfile");
system("ls");
or you can use Bourne shell file-descriptor redirection:
$output = `$cmd 2>some_file`;
open (PIPE, "cmd 2>some_file |");
You can also use file-descriptor redirection to make STDERR a
duplicate of STDOUT:
$output = `$cmd 2>&1`;
open (PIPE, "cmd 2>&1 |");
Note that you I<cannot> simply open STDERR to be a dup of STDOUT
in your Perl program and avoid calling the shell to do the redirection.
This doesn't work:
open(STDERR, ">&STDOUT");
$alloutput = `cmd args`; # stderr still escapes
This fails because the open() makes STDERR go to where STDOUT was
going at the time of the open(). The backticks then make STDOUT go to
a string, but don't change STDERR (which still goes to the old
STDOUT).
Note that you I<must> use Bourne shell (sh(1)) redirection syntax in
backticks, not csh(1)! Details on why Perl's system() and backtick
and pipe opens all use the Bourne shell are in
http://www.perl.com/CPAN/doc/FMTEYEWTK/versus/csh.whynot .
You may also use the IPC::Open3 module (part of the standard perl
distribution), but be warned that it has a different order of
arguments from IPC::Open2 (see L<IPC::Open3>).
=head2 Why doesn't open() return an error when a pipe open fails?
It does, but probably not how you expect it to. On systems that
follow the standard fork()/exec() paradigm (eg, Unix), it works like
this: open() causes a fork(). In the parent, open() returns with the
process ID of the child. The child exec()s the command to be piped
to/from. The parent can't know whether the exec() was successful or
not - all it can return is whether the fork() succeeded or not. To
find out if the command succeeded, you have to catch SIGCHLD and
wait() to get the exit status.
On systems that follow the spawn() paradigm, open() I<might> do what
you expect - unless perl uses a shell to start your command. In this
case the fork()/exec() description still applies.
=head2 What's wrong with using backticks in a void context?
Strictly speaking, nothing. Stylistically speaking, it's not a good
way to write maintainable code because backticks have a (potentially
humungous) return value, and you're ignoring it. It's may also not be very
efficient, because you have to read in all the lines of output, allocate
memory for them, and then throw it away. Too often people are lulled
to writing:
`cp file file.bak`;
And now they think "Hey, I'll just always use backticks to run programs."
Bad idea: backticks are for capturing a program's output; the system()
function is for running programs.
Consider this line:
`cat /etc/termcap`;
You haven't assigned the output anywhere, so it just wastes memory
(for a little while). Plus you forgot to check C<$?> to see whether
the program even ran correctly. Even if you wrote
print `cat /etc/termcap`;
In most cases, this could and probably should be written as
system("cat /etc/termcap") == 0
or die "cat program failed!";
Which will get the output quickly (as its generated, instead of only
at the end ) and also check the return value.
system() also provides direct control over whether shell wildcard
processing may take place, whereas backticks do not.
=head2 How can I call backticks without shell processing?
This is a bit tricky. Instead of writing
@ok = `grep @opts '$search_string' @filenames`;
You have to do this:
my @ok = ();
if (open(GREP, "-|")) {
while (<GREP>) {
chomp;
push(@ok, $_);
}
close GREP;
} else {
exec 'grep', @opts, $search_string, @filenames;
}
Just as with system(), when you exec() a list, so no shell escapes happen.
=head2 Why can't my script read from STDIN after I gave it EOF (^D on Unix, ^Z on MSDOS)?
Because some stdio's set error and eof flags that need clearing. The
POSIX module defines clearerr() that you can use. That is the
technically correct way to do it. Here are some less reliable
workarounds:
=over 4
=item 1
Try keeping around the seekpointer and go there, like this:
$where = tell(LOG);
seek(LOG, $where, 0);
=item 2
If that doesn't work, try seeking to a different part of the file and
then back.
=item 3
If that doesn't work, try seeking to a different part of
the file, reading something, and then seeking back.
=item 4
If that doesn't work, give up on your stdio package and use sysread.
=back
=head2 How can I convert my shell script to perl?
Learn Perl and rewrite it. Seriously, there's no simple converter.
Things that are awkward to do in the shell are easy to do in Perl, and
this very awkwardness is what would make a shell->perl converter
nigh-on impossible to write. By rewriting it, you'll think about what
you're really trying to do, and hopefully will escape the shell's
pipeline datastream paradigm, which while convenient for some matters,
causes many inefficiencies.
=head2 Can I use perl to run a telnet or ftp session?
Try the Net::FTP and TCP::Client modules (available from CPAN).
http://www.perl.com/CPAN/scripts/netstuff/telnet.emul.shar will also
help for emulating the telnet protocol.
=head2 How can I write expect in Perl?
Once upon a time, there was a library called chat2.pl (part of the
standard perl distribution), which never really got finished. These
days, your best bet is to look at the Comm.pl library available from
CPAN.
=head2 Is there a way to hide perl's command line from programs such as "ps"?
First of all note that if you're doing this for security reasons (to
avoid people seeing passwords, for example) then you should rewrite
your program so that critical information is never given as an
argument. Hiding the arguments won't make your program completely
secure.
To actually alter the visible command line, you can assign to the
variable $0 as documented in L<perlvar>. This won't work on all
operating systems, though. Daemon programs like sendmail place their
state there, as in:
$0 = "orcus [accepting connections]";
=head2 I {changed directory, modified my environment} in a perl script. How come the change disappeared when I exited the script? How do I get my changes to be visible?
=over 4
=item Unix
In the strictest sense, it can't be done -- the script executes as a
different process from the shell it was started from. Changes to a
process are not reflected in its parent, only in its own children
created after the change. There is shell magic that may allow you to
fake it by eval()ing the script's output in your shell; check out the
comp.unix.questions FAQ for details.
=item VMS
Change to %ENV persist after Perl exits, but directory changes do not.
=back
=head2 How do I close a process' filehandle without waiting for it to complete?
If your system supports signals, send a QUIT signal to the process
(see the kill() function, documented in L<perlfunc/"kill">.
=head2 How do I fork a daemon process?
If by daemon process you mean one that's detached (disassociated from
its tty), then the following process is reported to work on most
Unixish systems. Non-Unix users should check their Your_OS::Process
module for other solutions.
=over 4
=item *
Open /dev/tty and use the the TIOCNOTTY ioctl on it. See L<tty(4)>
for details.
=item *
Change directory to /
=item *
Reopen STDIN, STDOUT, and STDERR so they're not connected to the old
tty.
=item *
Background yourself like this:
fork && exit;
=back
=head2 How do I make my program run with sh and csh?
See the F<eg/nih> script (part of the perl source distribution).
=head2 How do I keep my own module/library directory?
When you build modules, use the PREFIX option when generating
Makefiles:
perl Makefile.PL PREFIX=/u/mydir/perl
then either set the PERL5LIB environment variable before you run
scripts that use the modules/libraries (see L<perlrun>) or say
use lib '/u/mydir/perl';
See Perl's L<lib> for more information.
=head2 How do I find out if I'm running interactively or not?
Good question. Sometimes C<-t STDIN> and C<-t STDOUT> can give clues,
sometimes not.
if (-t STDIN && -t STDOUT) {
print "Now what? ";
}
On POSIX systems, you can test whether your own process group matches
the current process group of your controlling terminal as follows:
use POSIX qw/getpgrp tcgetpgrp/;
open(TTY, "/dev/tty") or die $!;
$tpgrp = tcgetpgrp(TTY);
$pgrp = getpgrp();
if ($tpgrp == $pgrp) {
print "foreground\n";
} else {
print "background\n";
}
=head2 How do I timeout a slow event?
Use the alarm() function, probably in conjunction with a signal
handler, as documented L<perlipc/"Signals"> and chapter 6 of the
Camel. You may instead use the more flexible Sys::AlarmCall module
available from CPAN.
=head2 How do I set CPU limits?
Use the BSD::Resource module from CPAN.
=head2 How do I avoid zombies on a Unix system?
Use the reaper code from L<perlipc/"Signals"> to call wait() when a
SIGCHLD is received, or else use the double-fork technique described
in L<perlfunc/fork>.
=head2 How do I use an SQL database?
There are a number of excellent interfaces to SQL databases. See the
DBD::* modules available from
http://www.perl.com/CPAN/modules/dbperl/DBD .
=head2 How do I make a system() exit on control-C?
You can't. You need to imitate the system() call (see L<perlipc> for
sample code) and then have a signal handler for the INT signal that
passes the signal on to the subprocess.
=head2 How do I open a file without blocking?
If you're lucky enough to be using a system that supports
non-blocking reads (most Unixish systems do), you need only to use the
O_NDELAY or O_NONBLOCK flag from the Fcntl module in conjunction with
sysopen():
use Fcntl;
sysopen(FH, "/tmp/somefile", O_WRONLY|O_NDELAY|O_CREAT, 0644)
or die "can't open /tmp/somefile: $!":
=head2 How do I install a CPAN module?
The easiest way is to have the CPAN module do it for you. This module
comes with perl version 5.004 and later. To manually install the CPAN
module, or any well-behaved CPAN module for that matter, follow these
steps:
=over 4
=item 1
Unpack the source into a temporary area.
=item 2
perl Makefile.PL
=item 3
make
=item 4
make test
=item 5
make install
=back
If your version of perl is compiled without dynamic loading, then you
just need to replace step 3 (B<make>) with B<make perl> and you will
get a new F<perl> binary with your extension linked in.
See L<ExtUtils::MakeMaker> for more details on building extensions.
=head1 AUTHOR AND COPYRIGHT
Copyright (c) 1997 Tom Christiansen and Nathan Torkington.
All rights reserved. See L<perlfaq> for distribution information.
--
Tom Christiansen tchrist@jhereg.perl.com
Besides, it's good to force C programmers to use the toolbox occasionally. :-)
--Larry Wall in <1991May31.181659.28817@jpl-devvax.jpl.nasa.gov>
------------------------------
Date: 11 Mar 1997 23:26:59 GMT
From: Tom Christiansen <tchrist@mox.perl.com>
Subject: Perl FAQ part 9 of 0..9: Networking [Periodic Posting]
Message-Id: <5g4po3$g0f$1@csnews.cs.colorado.edu>
=head1 NAME
perlfaq9 - Networking ($Revision: 1.13 $)
=head1 DESCRIPTION
This section deals with questions related to networking, the internet,
and a few on the web.
=head2 My CGI script runs from the command line but not the browser. Can you help me fix it?
Sure, but you probably can't afford our contracting rates :-)
Seriously, if you can demonstrate that you've read the following FAQs
and that your problem isn't something simple that can be easily
answered, you'll probably receive a courteous and useful reply to your
question if you post it on comp.infosystems.www.authoring.cgi (if it's
something to do with HTTP, HTML, or the CGI protocols). Questions that
appear to be Perl questions but are really CGI ones that are posted to
comp.lang.perl.misc may not be so well received.
The useful FAQs are:
http://www.perl.com/perl/faq/idiots-guide.html
http://www3.pair.com/webthing/docs/cgi/faqs/cgifaq.shtml
http://www.perl.com/perl/faq/perl-cgi-faq.html
http://www-genome.wi.mit.edu/WWW/faqs/www-security-faq.html
http://www.boutell.com/faq/
=head2 How do I remove HTML from a string?
The most correct way (albeit not the fastest) is to use HTML::Parse
from CPAN (part of the libwww-perl distribution, which is a must-have
module for all web hackers).
Many folks attempt a simple-minded regular expression approach, like
C<s/E<lt>.*?E<gt>//g>, but that fails in many cases because the tags
may continue over line breaks, they may contain quoted angle-brackets,
or HTML comment may be present. Plus folks forget to convert
entities, like C<<> for example.
Here's one "simple-minded" approach, that works for most files:
#!/usr/bin/perl -p0777
s/<(?:[^>'"]*|(['"]).*?\1)*>//gs
If you want a more complete solution, see the 3-stage striphtml
program in
http://www.perl.com/CPAN/authors/Tom_Christiansen/scripts/striphtml.gz
.
=head2 How do I extract URLs?
A quick but imperfect approach is
#!/usr/bin/perl -n00
# qxurl - tchrist@perl.com
print "$2\n" while m{
< \s*
A \s+ HREF \s* = \s* (["']) (.*?) \1
\s* >
}gsix;
This version does not adjust relative URLs, understand alternate
bases, deal with HTML comments, or accept URLs themselves as
arguments. It also runs about 100x faster than a more "complete"
solution using the LWP suite of modules, such as the
http://www.perl.com/CPAN/authors/Tom_Christiansen/scripts/xurl.gz
program.
=head2 How do I download a file from the user's machine? How do I open a file on another machine?
In the context of an HTML form, you can use what's known as
B<multipart/form-data> encoding. The CGI.pm module (available from
CPAN) supports this in the start_multipart_form() method, which isn't
the same as the startform() method.
=head2 How do I make a pop-up menu in HTML?
Use the B<E<lt>SELECTE<gt>> and B<E<lt>OPTIONE<gt>> tags. The CGI.pm
module (available from CPAN) supports this widget, as well as many
others, including some that it cleverly synthesizes on its own.
=head2 How do I fetch an HTML file?
Use the LWP::Simple module available from CPAN, part of the excellent
libwww-perl (LWP) package. On the other hand, and if you have the
lynx text-based HTML browser installed on your system, this isn't too
bad:
$html_code = `lynx -source $url`;
$text_data = `lynx -dump $url`;
=head2 how do I decode or create those %-encodings on the web?
Here's an example of decoding:
$string = "http://altavista.digital.com/cgi-bin/query?pg=q&what=news&fmt=.&q=%2Bcgi-bin+%2Bperl.exe";
$string =~ s/%([a-fA-F0-9]{2})/chr(hex($1))/ge;
Encoding is a bit harder, because you can't just blindly change
all the non-alphanumunder character (C<\W>) into their hex escapes.
It's important that characters with special meaning like C</> and C<?>
I<not> be translated. Probably the easiest way to get this right is
to avoid reinventing the wheel and just use the URI::Escape module,
which is part of the libwww-perl package (LWP) available from CPAN.
=head2 How do I redirect to another page?
Instead of sending back a C<Content-Type> as the headers of your
reply, send back a C<Location:> header. Officially this should be a
C<URI:> header, so the CGI.pm module (available from CPAN) sends back
both:
Location: http://www.domain.com/newpage
URI: http://www.domain.com/newpage
Note that relative URLs in these headers can cause strange effects
because of "optimizations" that servers do.
=head2 How do I put a password on my web pages?
That depends. You'll need to read the documentation for your web
server, or perhaps check some of the other FAQs referenced above.
=head2 How do I edit my .htpasswd and .htgroup files with Perl?
The HTTPD::UserAdmin and HTTPD::GroupAdmin modules provide a
consistent OO interface to these files, regardless of how they're
stored. Databases may be text, dbm, Berkley DB or any database with a
DBI compatible driver. HTTPD::UserAdmin supports files used by the
`Basic' and `Digest' authentication schemes. Here's an example:
use HTTPD::UserAdmin ();
HTTPD::UserAdmin
->new(DB => "/foo/.htpasswd")
->add($username => $password);
=head2 How do I parse an email header?
For a quick-and-dirty solution, try this solution derived
from page 222 of the 2nd edition of "Programming Perl":
$/ = '';
$header = <MSG>;
$header =~ s/\n\s+/ /g; # merge continuation lines
%head = ( UNIX_FROM_LINE, split /^([-\w]+):\s*/m, $header );
That solution doesn't do well if, for example, you're trying to
maintain all the Received lines. A more complete approach is to use
the Mail::Header module from CPAN (part of the MailTools package).
=head2 How do I decode a CGI form?
A lot of people are tempted to code this up themselves, so you've
probably all seen a lot of code involving C<$ENV{CONTENT_LENGTH}> and
C<$ENV{QUERY_STRING}>. It's true that this can work, but there are
also a lot of versions of this floating around that are quite simply
broken!
Please do not be tempted to reinvent the wheel. Instead, use the
CGI.pm or CGI_Lite.pm (available from CPAN), or if you're trapped in
the module-free land of perl1 .. perl4, you might look into cgi-lib.pl
(available from http://www.bio.cam.ac.uk/web/form.html).
=head2 How do I check a valid email address?
You can't.
Without sending mail to the address and seeing whether it bounces (and
even then you face the halting problem), you cannot determine whether
an email address is valid. Even if you apply the email header
standard, you can have problems, because there are deliverable
addresses that aren't RFC-822 (the mail header standard) compliant,
and addresses that aren't deliverable which are compliant.
Many are tempted to try to eliminate many frequently-invalid email
addresses with a simple regexp, such as
C</^[\w.-]+\@([\w.-]\.)+\w+$/>. However, this also throws out many
valid ones, and says nothing about potential deliverability, so is not
suggested. Instead, see
http://www.perl.com/CPAN/authors/Tom_Christiansen/scripts/ckaddr.gz ,
which actually checks against the full RFC spec (except for nested
comments), looks for addresses you may not wish to accept email to
(say, Bill Clinton or your postmaster), and then makes sure that the
hostname given can be looked up in DNS. It's not fast, but it works.
=head2 How do I decode a MIME/BASE64 string?
The MIME-tools package (available from CPAN) handles this and a lot
more. Decoding BASE64 becomes as simple as:
use MIME::base64;
$decoded = decode_base64($encoded);
A more direct approach is to use the unpack() function's "u"
format after minor transliterations:
tr#A-Za-z0-9+/##cd; # remove non-base64 chars
tr#A-Za-z0-9+/# -_#; # convert to uuencoded format
$len = pack("c", 32 + 0.75*length); # compute length byte
print unpack("u", $len . $_); # uudecode and print
=head2 How do I return the user's email address?
On systems that support getpwuid, the $E<lt> variable and the
Sys::Hostname module (which is part of the standard perl distribution),
you can probably try using something like this:
use Sys::Hostname;
$address = sprintf('%s@%s', getpwuid($<), hostname);
Company policies on email address can mean that this generates addresses
that the company's email system will not accept, so you should ask for
users' email addresses when this matters. Furthermore, not all systems
on which Perl runs are so forthcoming with this information as is Unix.
The Mail::Util module from CPAN (part of the MailTools package) provides a
mailaddress() function that tries to guess the mail address of the user.
It makes a more intelligent guess than the code above, using information
given when the module was installed, but it could still be incorrect.
Again, the best way is often just to ask the user.
=head2 How do I send/read mail?
Sending mail: the Mail::Mailer module from CPAN (part of the MailTools
package) is UNIX-centric, while Mail::Internet uses Net::SMTP which is
not UNIX-centric. Reading mail: use the Mail::Folder module from CPAN
(part of the MailFolder package) or the Mail::Internet module from
CPAN (also part of the MailTools package).
=head2 How do I find out my hostname/domainname/IP address?
A lot of code has historically cavalierly called the C<`hostname`>
program. While sometimes expedient, this isn't very portable. It's
one of those tradeoffs of convenience versus portability.
The Sys::Hostname module (part of the standard perl distribution) will
give you the hostname after which you can find out the IP address
(assuming you have working DNS) with a gethostbyname() call.
use Socket;
use Sys::Hostname;
my $host = hostname();
my $addr = inet_ntoa(scalar(gethostbyname($name)) || 'localhost');
Probably the simplest way to learn your DNS domain name is to grok
it out of /etc/resolv.conf, at least under Unix. Of course, this
assumes several things about your resolv.conf configuration, including
that it exists.
(We still need a good DNS domain name-learning method for non-Unix
systems.)
=head2 How do I fetch a news article or the active newsgroups?
Use the Net::NNTP or News::NNTPClient modules, both available from CPAN.
This can make tasks like fetching the newsgroup list as simple as:
perl -MNews::NNTPClient
-e 'print News::NNTPClient->new->list("newsgroups")'
=head2 How do I fetch/put an FTP file?
LWP::Simple (available from CPAN) can fetch but not put. Net::FTP (also
available from CPAN) is more complex but can put as well as fetch.
=head2 How can I do RPC in Perl?
A DCE::RPC module is being developed (but is not yet available), and
will be released as part of the DCE-Perl package (available from
CPAN). No ONC::RPC module is known.
=head1 AUTHOR AND COPYRIGHT
Copyright (c) 1997 Tom Christiansen and Nathan Torkington.
All rights reserved. See L<perlfaq> for distribution information.
--
Tom Christiansen tchrist@jhereg.perl.com
Unix is like a toll road on which you have to stop every 50 feet to
pay another nickel. But hey! You only feel 5 cents poorer each time.
--Larry Wall in <1992Aug13.192357.15731@netlabs.com>
------------------------------
Date: Tue, 11 Mar 1997 16:15:35 -0500
From: Anne Migliozzi <amigliozzi@wpine.com>
Subject: Reading back from SOCKET
Message-Id: <3325CB77.3C39@wpine.com>
Hello - I am a beginner with Perl. I have written a script that creates,
bind, connects and writes to a socket successfully. However, now I want
that same socket to tell me when errors occur during the script. I have
three Perl books (camel book included) and have not been able to
accomplish this task. This script will run on Unix platforms and I am
using Perl 5.001. Can anybody help me??????? Please???!!!!!
Thanks, Anne
(p.s. If having the script helps, I can send it to you.)
------------------------------
Date: 11 Mar 1997 22:06:20 GMT
From: nvp@shore.net (Nathan V. Patwardhan)
Subject: Re: Reading back from SOCKET
Message-Id: <5g4l0s$ok2@fridge-nf0.shore.net>
Anne Migliozzi (amigliozzi@wpine.com) wrote:
: Hello - I am a beginner with Perl. I have written a script that creates,
: bind, connects and writes to a socket successfully. However, now I want
: that same socket to tell me when errors occur during the script. I have
If you're doing something like:
while($response = <SOCKET>) {
....
You can always try to snarf (is there a better word?) and compare
the output:
while($response = <SOCKET>) { # read
if($response =~ /500/) { # check response
print "An error occurred!\n"; # respond
} elsif($response =~ /foo on you/) {
print "Foo is to baz as roseanne is to bar.\n";
} elsif($response =~ /received/) {
print "Exiting!\n";
print SOCKET "QUIT\r\n";
}
}
Is this what you were looking for? Let me know if you need something
else.
--
Nathan V. Patwardhan
nvp@shore.net
------------------------------
Date: Tue, 11 Mar 1997 12:33:26 -0800
From: Tom Phoenix <rootbeer@teleport.com>
To: Derek May <dmay@memh.ti.com>
Subject: Re: Running same perl script on different platforms
Message-Id: <Pine.GSO.3.96.970311122934.695V-100000@kelly.teleport.com>
On Tue, 11 Mar 1997, Derek May wrote:
> Is there a way to set up our scripts to check the current OS version
> before looking for the perl executable?
Wait. Do you want your scripts to do something before the perl binary is
running? Not until Time::Warp.pm is finished!
You could put a check into your scripts. If what you want isn't in the
Config module, try getting the output of 'uname -a' and see whether that
doesn't take care of you.
Hope this helps!
-- Tom Phoenix http://www.teleport.com/~rootbeer/
rootbeer@teleport.com PGP Skribu al mi per Esperanto!
Randal Schwartz Case: http://www.lightlink.com/fors/
------------------------------
Date: 11 Mar 1997 20:40:58 GMT
From: Tom Christiansen <tchrist@mox.perl.com>
Subject: Re: Scope?
Message-Id: <5g4g0q$840$1@csnews.cs.colorado.edu>
[courtesy cc of this posting sent to cited author via email]
In comp.lang.perl.misc,
jwilleke@ix.netcom.com (Jonathan C. Willeke) writes:
:According to the Camel book and the man pages, lexically scoped
:variables declared with my are not visible to to routines called in
:the current block. However, check out this bit of code:
:
: #!/usr/bin/perl -w
: my $a = 1234;
: print "called from main, \$a: $a\n";
: scopeTest();
:
: sub scopeTest() {
: print "called from scopeTest, \$a: $a\n";
: }
:
:Here's the resulting output:
:
: called from main, $a: 1234
: called from scopeTest, $a: 1234
:
:Am I misunderstanding the docs. on this?
Yes, you are. Let's look at scoping levels.
Remember that the file level count as a scope.
So it's as though you had written this:
{
my $a = 1234;
print "called from main, \$a: $a\n";
scopeTest();
sub scopeTest() {
print "called from scopeTest, \$a: $a\n";
}
}
Which is very different from this:
{
my $a = 1234;
print "called from main, \$a: $a\n";
scopeTest();
}
sub scopeTest() {
print "called from scopeTest, \$a: $a\n";
}
See the difference? That's why this works:
sub BEGIN {
my $count = 42;
sub next_counter { return ++$count }
sub prev_counter { return --$count }
}
--tom
--
Tom Christiansen tchrist@jhereg.perl.com
Personally, I don't care whether someone is cool enough to quote Doug
Gwyn--I only care whether Doug Gwyn is cool enough to quote. --Larry Wall
------------------------------
Date: Tue, 11 Mar 1997 12:29:12 -0800
From: Tom Phoenix <rootbeer@teleport.com>
To: Ramon Castillo <rcastill@icix.net>
Subject: Re: Sort, System() problem.
Message-Id: <Pine.GSO.3.96.970311122633.695U-100000@kelly.teleport.com>
On Mon, 10 Mar 1997, Ramon Castillo wrote:
> If I do this from the shell it works fine
>
> sort +1n -t:: -o output.file input.file
>
> but when run the script
>
> system("sort +1n -t:: -o output.file input.file");
>
> The error mess. is
> sort: invalid use of command line options.
Could you be calling a different sort of sort? :-) That is, could your
PATH be different in the two cases?
Have you tried the multi-argument form of system?
system('sort', '+1n', '-t::', '-o', 'output.file', 'input.file');
Hope this helps!
-- Tom Phoenix http://www.teleport.com/~rootbeer/
rootbeer@teleport.com PGP Skribu al mi per Esperanto!
Randal Schwartz Case: http://www.lightlink.com/fors/
------------------------------
Date: 11 Mar 1997 20:55:51 GMT
From: kester@unix-ag.uni-kl.de (Kester Habermann)
Subject: Re: TCP Server from manpage fails
Message-Id: <5g4gsn$mvh@sun.rhrk.uni-kl.de>
Hi,
I wrote:
: Hi,
:
: I took the sample TCP-server (multi-threaded version) from the perlipc
although it's a bit silly following up to my own posting, I'm posting
the solution here, so I hopefully don't waste anyone's time.
I was given the hint, that this had already been discussed in this
group, but I somehow must have missed that thread.
A simple fix is:
$SIG{CHLD} = \&REAPER;
! for ( $waitedpid = 0;
! ($paddr = accept(Client,Server)) || $waitedpid;
! $waitedpid = 0, close Client)
{
- next if $waitedpid;
my($port,$iaddr) = sockaddr_in($paddr);
my $name = gethostbyaddr($iaddr,AF_INET);
--- 29,37 ----
$SIG{CHLD} = \&REAPER;
! for ( ; ($paddr = accept(Client,Server));
! close Client)
{
my($port,$iaddr) = sockaddr_in($paddr);
my $name = gethostbyaddr($iaddr,AF_INET);
Kester.
------------------------------
Date: 11 Mar 1997 22:26:08 GMT
From: "Joonas Kekoni" <jkekoni@cc.hut.fi>
Subject: Tellnet scripting with perl
Message-Id: <01bad902$c9ee2760$3016e982@aurora.tky.hut.fi>
Has anyone done "telnet scripting" using perl?
I have tried piping stuff to telnet sing bash with
---
telnet <<EOF
open xxx.yyy
jkekoni
mypasswd
command1
command2
logout
---
So i think using the telnet program is not an option. I am not familiar
with tcpip-programming, so i thought it could be easier to find a ready
"telnet script" and
then change it to fit my purpose.
------------------------------
Date: Tue, 11 Mar 1997 17:11:05 -0600
From: Bradley.Clark@disclosure.com
To: Bradley.Clark@disclosure.com
Subject: Transferring a socket descriptor
Message-Id: <858121580.27548@dejanews.com>
I have encountered a problem while trying to pass the
socket descriptor to an unrelated client process. I'm trying to
use a domain-socket to transfer a socket descriptor. In
C this can be done with sendmsg and recvmsg are their any
equivalent perl functions. If not, any other ideas for passing
socket descriptors to an unrelated client process using sockets
are more than welcome.
Thanks in advance,
Bradley Clark
-------------------==== Posted via Deja News ====-----------------------
http://www.dejanews.com/ Search, Read, Post to Usenet
------------------------------
Date: Mon, 10 Mar 1997 23:09:48 -0800
From: Joseph Ryan <Pjfryan@charm.net>
To: Anders F{ltros <afs@ludd.luth.se>
Subject: Re: WANTED: Perlscript for WebChat
Message-Id: <33250538.7E7D@charm.net>
Anders F{ltros wrote:
> Wanted: Perlscript for WebChat
http://www.eff.org/~erict/Scripts
--
Joseph Ryan
jfryan@mdbusiness.com
------------------------------
Date: 11 Mar 1997 21:14:20 GMT
From: dtong@lynx.dac.neu.edu (David Tong)
Subject: What's a good Perl book?
Message-Id: <5g4hvc$1lr@chaos.dac.neu.edu>
Hi,
I know C and KSH very well but I am new to Perl. I need to implement on NT,
UNIX and QNX with Perl. What would be a good Perl reference book I can get
in the book store?
Thank You
David Tong
------------------------------
Date: 11 Mar 1997 20:36:08 GMT
From: pholser@bnr.ca (Paul Holser)
Subject: XDR -> pack() template?
Message-Id: <5g4fno$n32@crchh327.rich.bnr.ca>
Hi all...
Curious to know whether anyone has written routines to
take a protocol specification in XDR (eXternal Data
Representation) for transfer of data in a machine-independent
format, and crunch it into a template suitable for pack()ing
data into a structure for such transfer?
Or, if there's a quickie way to do this by hand that
I'm missing, feel free to let me know. E-mail
replies welcome.
Cheers,
pholser
--
// Paul Holser (pholser@nortel.com)
// Northern Telecom, Inc., Richardson, TX
// These thoughts are mine, take 'em or leave 'em.
// "Those things that hurt, instruct." --Benjamin Franklin
------------------------------
Date: 8 Mar 97 21:33:47 GMT (Last modified)
From: Perl-Request@ruby.oce.orst.edu (Perl-Users-Digest Admin)
Subject: Digest Administrivia (Last modified: 8 Mar 97)
Message-Id: <null>
Administrivia:
The Perl-Users Digest is a retransmission of the USENET newsgroup
comp.lang.perl.misc. For subscription or unsubscription requests, send
the single line:
subscribe perl-users
or:
unsubscribe perl-users
to almanac@ruby.oce.orst.edu.
To submit articles to comp.lang.perl.misc (and this Digest), send your
article to perl-users@ruby.oce.orst.edu.
To submit articles to comp.lang.perl.announce, send your article to
clpa@perl.com.
To request back copies (available for a week or so), send your request
to almanac@ruby.oce.orst.edu with the command "send perl-users x.y",
where x is the volume number and y is the issue number.
The Meta-FAQ, an article containing information about the FAQ, is
available by requesting "send perl-users meta-faq". The real FAQ, as it
appeared last in the newsgroup, can be retrieved with the request "send
perl-users FAQ". Due to their sizes, neither the Meta-FAQ nor the FAQ
are included in the digest.
The "mini-FAQ", which is an updated version of the Meta-FAQ, is
available by requesting "send perl-users mini-faq". It appears twice
weekly in the group, but is not distributed in the digest.
For other requests pertaining to the digest, send mail to
perl-users-request@ruby.oce.orst.edu. Do not waste your time or mine
sending perl questions to the -request address, I don't have time to
answer them even if I did know the answer.
------------------------------
End of Perl-Users Digest V8 Issue 95
************************************
