[issue32536] ast and tokenize disagree about line number

[Mark Shannon]

New submission from Mark Shannon <mark at hotpy.org>:

This occurs (on linux at least) when the the end of line sequence `\r\r\n` occurs in a comment that is indented relative to the following lines.

The attached file demonstrates the problem.

----------
components: Library (Lib)
files: tokenize_fail_test.py
messages: 309852
nosy: Mark.Shannon
priority: normal
severity: normal
status: open
title: ast and tokenize disagree about line number
type: behavior
versions: Python 2.7
Added file: https://bugs.python.org/file47380/tokenize_fail_test.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32536>
_______________________________________