sqlite3 scrapy

[Thomas Kaufmann]

Am Donnerstag, 7. Juli 2016 16:52:12 UTC+2 schrieb Chris Angelico:
> On Fri, Jul 8, 2016 at 12:42 AM, Thomas Kaufmann <tokauf at gmail.com> wrote:
> > I changed my code in the way you suggested. There is no effect in the db. I start this script on the commandline with:
> >
> > tk at Hamlet:~/myscrapy/tutorial/tutorial/spiders$ scrapy crawl webbot
> 
> You have some print calls in your code. Are they happening? Do you see
> anything on your console? If not, you probably don't have a database
> issue, you have an invocation issue. If you do, please post the output
> along with the latest code - it might be revealing.
> 
> ChrisA

Hi Chris,

here is my table:

sqlite> CREATE TABLE Frisch(id INTEGER PRIMARY KEY NOT NULL, line TEXT NOT NULL);

And here is the output from my script on the console:

2016-07-07 16:59:13 [scrapy] DEBUG: Crawled (200) <GET http://www.frischblau.de/> (referer: None)
2016-07-07 16:59:14 [scrapy] DEBUG: Crawled (200) <GET http://www.frischblau.de/#top> (referer: http://www.frischblau.de/)
-> SQLite version: 3.8.2
INSERT INTO Frisch VALUES (?, ?) (2, u'#top')
INSERT INTO Frisch VALUES (?, ?) (3, u'mailto:info at frischblau.de')
INSERT INTO Frisch VALUES (?, ?) (4, u'http://www.zukunftscharta.de')
INSERT INTO Frisch VALUES (?, ?) (5, u'https://www.microsoft.com/de-de/WindowsForBusiness/End-of-IE-support')
INSERT INTO Frisch VALUES (?, ?) (6, u'https://contao.org/de/news/screenguide28-platz-1.html')
INSERT INTO Frisch VALUES (?, ?) (7, u'http://www.ifmo.de')
INSERT INTO Frisch VALUES (?, ?) (8, u'http://www.werksdesign.de')

...