[Python-checkins] CVS: python/dist/src/Doc/lib libshlex.tex,1.7,1.8

Fred L. Drake python-dev@python.org
Mon, 3 Jul 2000 02:56:25 -0700


Update of /cvsroot/python/python/dist/src/Doc/lib
In directory slayer.i.sourceforge.net:/tmp/cvs-serv24985/Doc/lib

Modified Files:
	libshlex.tex 
Log Message:

Eric S. Raymond <esr@thyrsus.com>:
This patch implements relative-path semantics for the "source" facility resembling
those of cpp(1), documents the change, and improves the shlex test main to
make it easier to test this feature.  Along the way, it fixes a name error
in the existing docs.

[Additional documentation markup changes for consistency by FLD.]


Index: libshlex.tex
===================================================================
RCS file: /cvsroot/python/python/dist/src/Doc/lib/libshlex.tex,v
retrieving revision 1.7
retrieving revision 1.8
diff -C2 -r1.7 -r1.8
*** libshlex.tex	2000/05/01 20:14:47	1.7
--- libshlex.tex	2000/07/03 09:56:23	1.8
***************
*** 14,18 ****
  Python applications.
  
! \begin{classdesc}{shlex}{\optional{stream}, \optional{file}}
  A \class{shlex} instance or subclass instance is a lexical analyzer
  object.  The initialization argument, if present, specifies where to
--- 14,18 ----
  Python applications.
  
! \begin{classdesc}{shlex}{\optional{stream\optional{, file}}}
  A \class{shlex} instance or subclass instance is a lexical analyzer
  object.  The initialization argument, if present, specifies where to
***************
*** 36,39 ****
--- 36,40 ----
  A \class{shlex} instance has the following methods:
  
+ 
  \begin{methoddesc}{get_token}{}
  Return a token.  If tokens have been stacked using
***************
*** 53,85 ****
  \end{methoddesc}
  
! \begin{methoddesc}{openhook}{filename}
! When shlex detects a source request (see \member{source} below)
! this method is given the following token as argument, and expected to 
! return a tuple consisting of a filename and an opened stream object. 
! 
! Normally, this method just strips any quotes off the argument and
! treats it as a filename, calling \code{open()} on it.  It is exposed so that
! you can use it to implement directory search paths, addition of
! file extensions, and other namespace hacks.
  
  There is no corresponding `close' hook, but a shlex instance will call
! the \code{close()} method of the sourced input stream when it returns EOF.
  \end{methoddesc}
  
! \begin{methoddesc}{error_leader}{\optional{file}, \optional{line}}
  This method generates an error message leader in the format of a
! Unix C compiler error label; the format is '"\%s", line \%d: ',
! where the \%s is replaced with the name of the current source file and
! the \%d with the current input line number (the optional arguments
! can be used to override these).
! 
! This convenience is provided to encourage shlex users to generate
! error messages in the standard, parseable format understood by Emacs
! and other Unix tools.
  \end{methoddesc}
  
  Instances of \class{shlex} subclasses have some public instance
! variables which either control lexical analysis or can be used
! for debugging:
  
  \begin{memberdesc}{commenters}
--- 54,96 ----
  \end{methoddesc}
  
! \begin{methoddesc}{sourcehook}{filename}
! When \class{shlex} detects a source request (see
! \member{source} below) this method is given the following token as
! argument, and expected to return a tuple consisting of a filename and
! an open file-like object.
! 
! Normally, this method first strips any quotes off the argument.  If
! the result is an absolute pathname, or there was no previous source
! request in effect, or the previous source was a stream
! (e.g. \code{sys.stdin}), the result is left alone.  Otherwise, if the
! result is a relative pathname, the directory part of the name of the
! file immediately before it on the source inclusion stack is prepended
! (this behavior is like the way the C preprocessor handles
! \code{\#include "file.h"}).  The result of the manipulations is treated
! as a filename, and returned as the first component of the tuple, with
! \function{open()} called on it to yield the second component.
  
+ This hook is exposed so that you can use it to implement directory
+ search paths, addition of file extensions, and other namespace hacks.
  There is no corresponding `close' hook, but a shlex instance will call
! the \method{close()} method of the sourced input stream when it
! returns \EOF.
  \end{methoddesc}
  
! \begin{methoddesc}{error_leader}{\optional{file\optional{, line}}}
  This method generates an error message leader in the format of a
! \UNIX{} C compiler error label; the format is '"\%s", line \%d: ',
! where the \samp{\%s} is replaced with the name of the current source
! file and the \samp{\%d} with the current input line number (the
! optional arguments can be used to override these).
! 
! This convenience is provided to encourage \module{shlex} users to
! generate error messages in the standard, parseable format understood
! by Emacs and other \UNIX{} tools.
  \end{methoddesc}
  
  Instances of \class{shlex} subclasses have some public instance
! variables which either control lexical analysis or can be used for
! debugging:
  
  \begin{memberdesc}{commenters}
***************
*** 91,95 ****
  \begin{memberdesc}{wordchars}
  The string of characters that will accumulate into multi-character
! tokens. By default, includes all \ASCII{} alphanumerics and
  underscore.
  \end{memberdesc}
--- 102,106 ----
  \begin{memberdesc}{wordchars}
  The string of characters that will accumulate into multi-character
! tokens.  By default, includes all \ASCII{} alphanumerics and
  underscore.
  \end{memberdesc}
***************
*** 115,136 ****
  
  \begin{memberdesc}{instream}
! The input stream from which this shlex instance is reading characters.
  \end{memberdesc}
  
  \begin{memberdesc}{source}
! This member is None by default.  If you assign a string to it, that
! string will be recognized as a lexical-level inclusion request similar
! to the `source' keyword in various shells.  That is, the immediately
! following token will opened as a filename and input taken from that
! stream until EOF, at which point the \code{close()} method of that
! stream will be called and the input source will again become the
! original input stream. Source requests may be stacked any number of
! levels deep.
  \end{memberdesc}
  
  \begin{memberdesc}{debug}
! If this member is numeric and 1 or more, a shlex instance will print
! verbose progress output on its behavior.  If you need to use this,
! you can read the module source code to learn the details.
  \end{memberdesc}
  
--- 126,149 ----
  
  \begin{memberdesc}{instream}
! The input stream from which this \class{shlex} instance is reading
! characters.
  \end{memberdesc}
  
  \begin{memberdesc}{source}
! This member is \code{None} by default.  If you assign a string to it,
! that string will be recognized as a lexical-level inclusion request
! similar to the \samp{source} keyword in various shells.  That is, the
! immediately following token will opened as a filename and input taken
! from that stream until \EOF, at which point the \method{close()}
! method of that stream will be called and the input source will again
! become the original input stream. Source requests may be stacked any
! number of levels deep.
  \end{memberdesc}
  
  \begin{memberdesc}{debug}
! If this member is numeric and \code{1} or more, a \class{shlex}
! instance will print verbose progress output on its behavior.  If you
! need to use this, you can read the module source code to learn the
! details.
  \end{memberdesc}