[Edu-sig] counting lexemes...

[Jeffrey Elkner]

hi all!

i got such a great response to my last query that i'm trying another one
;-)  is there anything out there already that i can use to parse python,
c++, and java source files to get a listing and count of the lexemes
that occur in each?

i spent the better part of an afternoon writing python scripts to remove
comments and docstrings so that i could compare line numbers, and i'm
afraid parsing to get at the lexemes is beyond my ability within the
time i have left to prepare my thesis.

anyone suggestions?

thanks again!

jeff elkner
yorktown high school
arlington, va