From naomi.see at seenaomi.net Fri Apr 20 12:27:17 2018 From: naomi.see at seenaomi.net (Naomi See) Date: Fri, 20 Apr 2018 11:27:17 -0500 Subject: [omaha] Next meetup May 24th Message-ID: Hello friends! I'm happy to report that we have 19 python users show up last night and it was a great meeting! Lots of engagement and a variety of projects everyone works on using Python. The next meetup is going to be at UNO the specifics are still pending but if you want to attend I suggest RSVPing as space is limited. https://www.meetup.com/Omahas-Python-Users-Group/events/249959558/ Most of the attendees are not on the mailing list but as we start to increase momentum that might change. We are on Twitter @OmahaPython if you use that platform Also there's a PyData meetup which is Python for Data Science specific that is meeting on the 26th of April if that is of interest to you : https://www.meetup.com/PyData-Omaha/events/249479521/ Also there's an online meetup that I'm a co-organizer for called PyLadiesRemote and this Saturday morning there's a talk online about PySpark further info along with code and setup requirements can be found here: h ttps://www.eventbrite.com/e/introduction-to-pyspark-with-garren-staubli-tickets-44427449698 Have a great rest of the month! Naomi- From charlieahern at gmail.com Sun Apr 22 23:03:53 2018 From: charlieahern at gmail.com (Charlie Ahern) Date: Sun, 22 Apr 2018 22:03:53 -0500 Subject: [omaha] Pythons' Carpool Lincoln->Omaha 5/24/18? Message-ID: My wife and I are moving to Lincoln on the 15th (from Des Moines). Hopefully by the 24th we'll be settled enough that I can go to the meeting. Will anyone be driving from Lincoln to Omaha for the meeting? I'm a Python newbie, primarily a hobbyist (with close to 40 years experience in high tech) studying: * NLP and possible analysis of the text in SEC reports from EDGAR (Electronic Data Gathering, Analysis, and Retrieval system) * Statistical analysis of SEC and other data sources, such as FRED (Federal Reserve Economic Data) -- Charlie Ahern Reading, after a certain age, diverts the mind too much from its creative pursuits. Any man who reads too much and uses his own brain too little falls into lazy habits of thinking, just as the man who spends too much time in the theater is tempted to be content with living vicariously instead of living his own life. - Albert Einstein From wes.turner at gmail.com Sun Apr 22 23:49:20 2018 From: wes.turner at gmail.com (Wes Turner) Date: Sun, 22 Apr 2018 23:49:20 -0400 Subject: [omaha] Pythons' Carpool Lincoln->Omaha 5/24/18? In-Reply-To: References: Message-ID: EDGAR, pandas-datareader, interpretation of financial reports, quantopian tools such as zipline I won't be driving from Lincoln to Omaha, but have a few relevant links to share here that you've probably already reviewed. EDGAR discontinuing FTP support https://github.com/pydata/pandas-datareader/issues/269 https://en.wikipedia.org/wiki/EDGAR - https://www.sec.gov/edgar/searchedgar/accessing-edgar-data.htm - https://www.sec.gov/oiea/Article/edgarguide.html - https://en.wikipedia.org/wiki/Form_10-K (annual) - https://en.wikipedia.org/wiki/Form_10-Q (quarterly) - https://en.wikipedia.org/wiki/XBRL https://en.wikipedia.org/wiki/Benjamin_Graham#Bibliography "Warren Buffett and the Interpretation of Financial Statements: The Search for the Company with a Durable Competitive Advantage" https://g.co/kgs/65XRnv https://www.quantopian.com/help/fundamentals - some of these stats are from EDGAR - some of these stats are from Morningstar - it'd be great to also have data about environmental sustainability (e.g. from mandatory reports) just like the GRI reports >From "Pulling Stock Market Data - Yahoo and Google don't work anymore?" https://www.reddit.com/r/Python/comments/7zxptg/pulling_stock_market_data_yahoo_and_google_dont/#dus01vk > quantopian/zipline pulls data from Quandl with a data ingest step; with the US Treasury 10 year bond yield and/or SPY (from IEX) as a benchmark. > https://github.com/quantopian/zipline > - https://www.quantopian.com/tutorials/ > - https://www.quantopian.com/posts/community-algorithms-migrated-to-quantopian-2 > - "7 Best Community-Built Value Investing Algorithms Using Fundamentals" > https://blog.quantopian.com/fundamentals-contest-winners/ - https://github.com/quantopian/pyfolio - https://github.com/quantopian/alphalens On Sunday, April 22, 2018, Charlie Ahern via Omaha wrote: > My wife and I are moving to Lincoln on the 15th (from Des Moines). > Hopefully by the 24th we'll be settled enough that I can go to the > meetinag. > Will anyone be driving from Lincoln to Omaha for the meeting? > > I'm a Python newbie, primarily a hobbyist (with close to 40 years > experience in high tech) studying: > * NLP and possible analysis of the text in SEC reports from EDGAR > (Electronic Data Gathering, Analysis, and Retrieval system) > * Statistical analysis of SEC and other data sources, such as FRED (Federal > Reserve Economic Data) > > -- > Charlie Ahern > > Reading, after a certain age, diverts the mind too much from its creative > pursuits. Any man who reads too much and uses his own brain too little > falls into lazy habits of thinking, just as the man who spends too much > time in the theater is tempted to be content with living vicariously > instead of living his own life. - Albert Einstein > _______________________________________________ > Omaha Python Users Group mailing list > Omaha at python.org > https://mail.python.org/mailman/listinfo/omaha > http://www.OmahaPython.org > From charlieahern at gmail.com Mon Apr 23 13:00:04 2018 From: charlieahern at gmail.com (Charlie Ahern) Date: Mon, 23 Apr 2018 12:00:04 -0500 Subject: [omaha] Omaha Digest, Vol 131, Issue 2 In-Reply-To: References: Message-ID: Hey Wes, thanks for all of the links. I've seen some, but not all, of them. Disappointing that the SEC broke the pandas-datareader feed. Not sure of the details, but it looks like some company now has a contract to monetize public information. "Yep, this is public information. We'll sell it to you at a profitable rate per month." I need to do more research, particularly about Quantopian-Quandl. The Efficient Markets Hypothesis (like neo-classical economics) "states that asset prices fully reflect all available information." However, are markets efficient if the cost of information makes it unavailable or difficult to access? https://en.wikipedia.org/wiki/Efficient-market_hypothesis Thanks again, Charlie On Mon, Apr 23, 2018 at 11:00 AM, wrote: > Send Omaha mailing list submissions to > omaha at python.org > > To subscribe or unsubscribe via the World Wide Web, visit > https://mail.python.org/mailman/listinfo/omaha > or, via email, send a message with subject or body 'help' to > omaha-request at python.org > > You can reach the person managing the list at > omaha-owner at python.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Omaha digest..." > > > Today's Topics: > > 1. Pythons' Carpool Lincoln->Omaha 5/24/18? (Charlie Ahern) > 2. Re: Pythons' Carpool Lincoln->Omaha 5/24/18? (Wes Turner) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Sun, 22 Apr 2018 22:03:53 -0500 > From: Charlie Ahern > To: omaha at python.org > Subject: [omaha] Pythons' Carpool Lincoln->Omaha 5/24/18? > Message-ID: > uu5jUn5EqwQ at mail.gmail.com> > Content-Type: text/plain; charset="UTF-8" > > My wife and I are moving to Lincoln on the 15th (from Des Moines). > Hopefully by the 24th we'll be settled enough that I can go to the meeting. > Will anyone be driving from Lincoln to Omaha for the meeting? > > I'm a Python newbie, primarily a hobbyist (with close to 40 years > experience in high tech) studying: > * NLP and possible analysis of the text in SEC reports from EDGAR > (Electronic Data Gathering, Analysis, and Retrieval system) > * Statistical analysis of SEC and other data sources, such as FRED (Federal > Reserve Economic Data) > > -- > Charlie Ahern > > Reading, after a certain age, diverts the mind too much from its creative > pursuits. Any man who reads too much and uses his own brain too little > falls into lazy habits of thinking, just as the man who spends too much > time in the theater is tempted to be content with living vicariously > instead of living his own life. - Albert Einstein > > > ------------------------------ > > Message: 2 > Date: Sun, 22 Apr 2018 23:49:20 -0400 > From: Wes Turner > To: Omaha Python Users Group > Cc: Charlie Ahern > Subject: Re: [omaha] Pythons' Carpool Lincoln->Omaha 5/24/18? > Message-ID: > gmail.com> > Content-Type: text/plain; charset="UTF-8" > > EDGAR, pandas-datareader, interpretation of financial reports, quantopian > tools such as zipline > > I won't be driving from Lincoln to Omaha, but have a few relevant links to > share here that you've probably already reviewed. > > EDGAR discontinuing FTP support > https://github.com/pydata/pandas-datareader/issues/269 > > https://en.wikipedia.org/wiki/EDGAR > - https://www.sec.gov/edgar/searchedgar/accessing-edgar-data.htm > - https://www.sec.gov/oiea/Article/edgarguide.html > - https://en.wikipedia.org/wiki/Form_10-K (annual) > - https://en.wikipedia.org/wiki/Form_10-Q (quarterly) > - https://en.wikipedia.org/wiki/XBRL > > > https://en.wikipedia.org/wiki/Benjamin_Graham#Bibliography > > "Warren Buffett and the Interpretation of Financial Statements: The Search > for the Company with a Durable Competitive Advantage" > https://g.co/kgs/65XRnv > > https://www.quantopian.com/help/fundamentals > - some of these stats are from EDGAR > - some of these stats are from Morningstar > - it'd be great to also have data about environmental sustainability (e.g. > from mandatory reports) just like the GRI reports > > >From "Pulling Stock Market Data - Yahoo and Google don't work anymore?" > https://www.reddit.com/r/Python/comments/7zxptg/pulling_stock_market_data_ > yahoo_and_google_dont/#dus01vk > > > quantopian/zipline pulls data from Quandl with a data ingest step; with > the US Treasury 10 year bond yield and/or SPY (from IEX) as a benchmark. > > https://github.com/quantopian/zipline > > - https://www.quantopian.com/tutorials/ > > - > https://www.quantopian.com/posts/community-algorithms- > migrated-to-quantopian-2 > > - "7 Best Community-Built Value Investing Algorithms Using Fundamentals" > > https://blog.quantopian.com/fundamentals-contest-winners/ > > - https://github.com/quantopian/pyfolio > - https://github.com/quantopian/alphalens > > > On Sunday, April 22, 2018, Charlie Ahern via Omaha > wrote: > > > My wife and I are moving to Lincoln on the 15th (from Des Moines). > > Hopefully by the 24th we'll be settled enough that I can go to the > > meetinag. > > Will anyone be driving from Lincoln to Omaha for the meeting? > > > > I'm a Python newbie, primarily a hobbyist (with close to 40 years > > experience in high tech) studying: > > * NLP and possible analysis of the text in SEC reports from EDGAR > > (Electronic Data Gathering, Analysis, and Retrieval system) > > * Statistical analysis of SEC and other data sources, such as FRED > (Federal > > Reserve Economic Data) > > > > -- > > Charlie Ahern > > > > Reading, after a certain age, diverts the mind too much from its creative > > pursuits. Any man who reads too much and uses his own brain too little > > falls into lazy habits of thinking, just as the man who spends too much > > time in the theater is tempted to be content with living vicariously > > instead of living his own life. - Albert Einstein > > _______________________________________________ > > Omaha Python Users Group mailing list > > Omaha at python.org > > https://mail.python.org/mailman/listinfo/omaha > > http://www.OmahaPython.org > > > > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > Omaha mailing list > Omaha at python.org > https://mail.python.org/mailman/listinfo/omaha > > > ------------------------------ > > End of Omaha Digest, Vol 131, Issue 2 > ************************************* > -- Charlie Ahern (408) 821-6414 Reading, after a certain age, diverts the mind too much from its creative pursuits. Any man who reads too much and uses his own brain too little falls into lazy habits of thinking, just as the man who spends too much time in the theater is tempted to be content with living vicariously instead of living his own life. - Albert Einstein From naomi.see at seenaomi.net Mon Apr 23 13:02:42 2018 From: naomi.see at seenaomi.net (Naomi) Date: Mon, 23 Apr 2018 12:02:42 -0500 Subject: [omaha] Omaha Digest, Vol 131, Issue 2 In-Reply-To: References: Message-ID: Hey Charlie - You may want to post this inquiry on the meetup event as well. :) Hope it works out! Cheers, Naomi- Sent from my iPad > On Apr 23, 2018, at 12:00 PM, Charlie Ahern via Omaha wrote: > > Hey Wes, thanks for all of the links. I've seen some, but not all, of them. > > Disappointing that the SEC broke the pandas-datareader feed. Not sure of > the details, but it looks like some company now has a contract to monetize > public information. "Yep, this is public information. We'll sell it to you > at a profitable rate per month." I need to do more research, particularly > about Quantopian-Quandl. > > The Efficient Markets Hypothesis (like neo-classical economics) "states > that asset prices fully reflect all > available information." However, are markets efficient if the cost of > information makes it unavailable or difficult to access? > https://en.wikipedia.org/wiki/Efficient-market_hypothesis > > Thanks again, > > Charlie > >> On Mon, Apr 23, 2018 at 11:00 AM, wrote: >> >> Send Omaha mailing list submissions to >> omaha at python.org >> >> To subscribe or unsubscribe via the World Wide Web, visit >> https://mail.python.org/mailman/listinfo/omaha >> or, via email, send a message with subject or body 'help' to >> omaha-request at python.org >> >> You can reach the person managing the list at >> omaha-owner at python.org >> >> When replying, please edit your Subject line so it is more specific >> than "Re: Contents of Omaha digest..." >> >> >> Today's Topics: >> >> 1. Pythons' Carpool Lincoln->Omaha 5/24/18? (Charlie Ahern) >> 2. Re: Pythons' Carpool Lincoln->Omaha 5/24/18? (Wes Turner) >> >> >> ---------------------------------------------------------------------- >> >> Message: 1 >> Date: Sun, 22 Apr 2018 22:03:53 -0500 >> From: Charlie Ahern >> To: omaha at python.org >> Subject: [omaha] Pythons' Carpool Lincoln->Omaha 5/24/18? >> Message-ID: >> > uu5jUn5EqwQ at mail.gmail.com> >> Content-Type: text/plain; charset="UTF-8" >> >> My wife and I are moving to Lincoln on the 15th (from Des Moines). >> Hopefully by the 24th we'll be settled enough that I can go to the meeting. >> Will anyone be driving from Lincoln to Omaha for the meeting? >> >> I'm a Python newbie, primarily a hobbyist (with close to 40 years >> experience in high tech) studying: >> * NLP and possible analysis of the text in SEC reports from EDGAR >> (Electronic Data Gathering, Analysis, and Retrieval system) >> * Statistical analysis of SEC and other data sources, such as FRED (Federal >> Reserve Economic Data) >> >> -- >> Charlie Ahern >> >> Reading, after a certain age, diverts the mind too much from its creative >> pursuits. Any man who reads too much and uses his own brain too little >> falls into lazy habits of thinking, just as the man who spends too much >> time in the theater is tempted to be content with living vicariously >> instead of living his own life. - Albert Einstein >> >> >> ------------------------------ >> >> Message: 2 >> Date: Sun, 22 Apr 2018 23:49:20 -0400 >> From: Wes Turner >> To: Omaha Python Users Group >> Cc: Charlie Ahern >> Subject: Re: [omaha] Pythons' Carpool Lincoln->Omaha 5/24/18? >> Message-ID: >> > gmail.com> >> Content-Type: text/plain; charset="UTF-8" >> >> EDGAR, pandas-datareader, interpretation of financial reports, quantopian >> tools such as zipline >> >> I won't be driving from Lincoln to Omaha, but have a few relevant links to >> share here that you've probably already reviewed. >> >> EDGAR discontinuing FTP support >> https://github.com/pydata/pandas-datareader/issues/269 >> >> https://en.wikipedia.org/wiki/EDGAR >> - https://www.sec.gov/edgar/searchedgar/accessing-edgar-data.htm >> - https://www.sec.gov/oiea/Article/edgarguide.html >> - https://en.wikipedia.org/wiki/Form_10-K (annual) >> - https://en.wikipedia.org/wiki/Form_10-Q (quarterly) >> - https://en.wikipedia.org/wiki/XBRL >> >> >> https://en.wikipedia.org/wiki/Benjamin_Graham#Bibliography >> >> "Warren Buffett and the Interpretation of Financial Statements: The Search >> for the Company with a Durable Competitive Advantage" >> https://g.co/kgs/65XRnv >> >> https://www.quantopian.com/help/fundamentals >> - some of these stats are from EDGAR >> - some of these stats are from Morningstar >> - it'd be great to also have data about environmental sustainability (e.g. >> from mandatory reports) just like the GRI reports >> >>> From "Pulling Stock Market Data - Yahoo and Google don't work anymore?" >> https://www.reddit.com/r/Python/comments/7zxptg/pulling_stock_market_data_ >> yahoo_and_google_dont/#dus01vk >> >>> quantopian/zipline pulls data from Quandl with a data ingest step; with >> the US Treasury 10 year bond yield and/or SPY (from IEX) as a benchmark. >>> https://github.com/quantopian/zipline >>> - https://www.quantopian.com/tutorials/ >>> - >> https://www.quantopian.com/posts/community-algorithms- >> migrated-to-quantopian-2 >>> - "7 Best Community-Built Value Investing Algorithms Using Fundamentals" >>> https://blog.quantopian.com/fundamentals-contest-winners/ >> >> - https://github.com/quantopian/pyfolio >> - https://github.com/quantopian/alphalens >> >> >> On Sunday, April 22, 2018, Charlie Ahern via Omaha >> wrote: >> >>> My wife and I are moving to Lincoln on the 15th (from Des Moines). >>> Hopefully by the 24th we'll be settled enough that I can go to the >>> meetinag. >>> Will anyone be driving from Lincoln to Omaha for the meeting? >>> >>> I'm a Python newbie, primarily a hobbyist (with close to 40 years >>> experience in high tech) studying: >>> * NLP and possible analysis of the text in SEC reports from EDGAR >>> (Electronic Data Gathering, Analysis, and Retrieval system) >>> * Statistical analysis of SEC and other data sources, such as FRED >> (Federal >>> Reserve Economic Data) >>> >>> -- >>> Charlie Ahern >>> >>> Reading, after a certain age, diverts the mind too much from its creative >>> pursuits. Any man who reads too much and uses his own brain too little >>> falls into lazy habits of thinking, just as the man who spends too much >>> time in the theater is tempted to be content with living vicariously >>> instead of living his own life. - Albert Einstein >>> _______________________________________________ >>> Omaha Python Users Group mailing list >>> Omaha at python.org >>> https://mail.python.org/mailman/listinfo/omaha >>> http://www.OmahaPython.org >>> >> >> >> ------------------------------ >> >> Subject: Digest Footer >> >> _______________________________________________ >> Omaha mailing list >> Omaha at python.org >> https://mail.python.org/mailman/listinfo/omaha >> >> >> ------------------------------ >> >> End of Omaha Digest, Vol 131, Issue 2 >> ************************************* >> > > > > -- > Charlie Ahern > (408) 821-6414 > > Reading, after a certain age, diverts the mind too much from its creative > pursuits. Any man who reads too much and uses his own brain too little > falls into lazy habits of thinking, just as the man who spends too much > time in the theater is tempted to be content with living vicariously > instead of living his own life. - Albert Einstein > _______________________________________________ > Omaha Python Users Group mailing list > Omaha at python.org > https://mail.python.org/mailman/listinfo/omaha > http://www.OmahaPython.org From wes.turner at gmail.com Mon Apr 23 14:20:52 2018 From: wes.turner at gmail.com (Wes Turner) Date: Mon, 23 Apr 2018 14:20:52 -0400 Subject: [omaha] Omaha Digest, Vol 131, Issue 2 In-Reply-To: References: Message-ID: On Monday, April 23, 2018, Charlie Ahern via Omaha wrote: > Hey Wes, thanks for all of the links. I've seen some, but not all, of them. > > Disappointing that the SEC broke the pandas-datareader feed. Not sure of > the details, but it looks like some company now has a contract to monetize > public information. "Yep, this is public information. We'll sell it to you > at a profitable rate per month." I need to do more research, particularly > about Quantopian-Quandl. They probably discontinued the FTP API because it was an FTP API. This data should be free! > > The Efficient Markets Hypothesis (like neo-classical economics) "states > that asset prices fully reflect all > available information." However, are markets efficient if the cost of > information makes it unavailable or difficult to access? > https://en.wikipedia.org/wiki/Efficient-market_hypothesis Information asymmetry https://en.wikipedia.org/wiki/Information_asymmetry > Information asymmetries are studied in the context of principal?agent problems where they are a major cause of misinforming and is essential in every communication process.[6] Information asymmetry is in contrast to perfect information, which is a key assumption in neo-classical economics.[7] In 2001 the Nobel Memorial Prize in Economics was awarded to George Akerlof, Michael Spence, and Joseph E. Stiglitz for their "analyses of markets with asymmetric information".[8] ... Even given perfect information, is behavior rational? https://en.wikipedia.org/wiki/Nudge_(book) "*Stock market forces can be modeled with a quantum harmonic oscillator*" https://phys.org/news/2018-02-stock-quantum-harmonic-oscillator.html https://en.wikipedia.org/wiki/Quantum_harmonic_oscillator Quantopian has an objective, cumulative performance metric with which to compare algorithmic trading strategies. It's possible to code up piecewise unexplainable buy/sell decisions of the past; and compare them. Back testing: historical data Paper trading: live data, 'fake' trades Live trading: live data, live trades There are a few places that will host, run, and feed data to algos implemented with Zipline. Quantopian doesn't host Zipline algos anymore; QuantRocket is one place that does. (Over the past 10 years, cryptocurrency / digital asset HODLers have outperformed even NVIDIA and clean energy index funds. enigmampc/catalyst is a fork of Zipline for cryptocurrency trading that now uses ccxt for exchange APIs. Arbitrage between exchanges may still be viable for alt coins.) > Thanks again, > > Charlie > > On Mon, Apr 23, 2018 at 11:00 AM, wrote: > > > Send Omaha mailing list submissions to > > omaha at python.org > > > > To subscribe or unsubscribe via the World Wide Web, visit > > https://mail.python.org/mailman/listinfo/omaha > > or, via email, send a message with subject or body 'help' to > > omaha-request at python.org > > > > You can reach the person managing the list at > > omaha-owner at python.org > > > > When replying, please edit your Subject line so it is more specific > > than "Re: Contents of Omaha digest..." > > > > > > Today's Topics: > > > > 1. Pythons' Carpool Lincoln->Omaha 5/24/18? (Charlie Ahern) > > 2. Re: Pythons' Carpool Lincoln->Omaha 5/24/18? (Wes Turner) > > > > > > ---------------------------------------------------------------------- > > > > Message: 1 > > Date: Sun, 22 Apr 2018 22:03:53 -0500 > > From: Charlie Ahern > > To: omaha at python.org > > Subject: [omaha] Pythons' Carpool Lincoln->Omaha 5/24/18? > > Message-ID: > > > uu5jUn5EqwQ at mail.gmail.com> > > Content-Type: text/plain; charset="UTF-8" > > > > My wife and I are moving to Lincoln on the 15th (from Des Moines). > > Hopefully by the 24th we'll be settled enough that I can go to the > meeting. > > Will anyone be driving from Lincoln to Omaha for the meeting? > > > > I'm a Python newbie, primarily a hobbyist (with close to 40 years > > experience in high tech) studying: > > * NLP and possible analysis of the text in SEC reports from EDGAR > > (Electronic Data Gathering, Analysis, and Retrieval system) > > * Statistical analysis of SEC and other data sources, such as FRED > (Federal > > Reserve Economic Data) > > > > -- > > Charlie Ahern > > > > Reading, after a certain age, diverts the mind too much from its creative > > pursuits. Any man who reads too much and uses his own brain too little > > falls into lazy habits of thinking, just as the man who spends too much > > time in the theater is tempted to be content with living vicariously > > instead of living his own life. - Albert Einstein > > > > > > ------------------------------ > > > > Message: 2 > > Date: Sun, 22 Apr 2018 23:49:20 -0400 > > From: Wes Turner > > To: Omaha Python Users Group > > Cc: Charlie Ahern > > Subject: Re: [omaha] Pythons' Carpool Lincoln->Omaha 5/24/18? > > Message-ID: > > > gmail.com> > > Content-Type: text/plain; charset="UTF-8" > > > > EDGAR, pandas-datareader, interpretation of financial reports, quantopian > > tools such as zipline > > > > I won't be driving from Lincoln to Omaha, but have a few relevant links > to > > share here that you've probably already reviewed. > > > > EDGAR discontinuing FTP support > > https://github.com/pydata/pandas-datareader/issues/269 > > > > https://en.wikipedia.org/wiki/EDGAR > > - https://www.sec.gov/edgar/searchedgar/accessing-edgar-data.htm > > - https://www.sec.gov/oiea/Article/edgarguide.html > > - https://en.wikipedia.org/wiki/Form_10-K (annual) > > - https://en.wikipedia.org/wiki/Form_10-Q (quarterly) > > - https://en.wikipedia.org/wiki/XBRL > > > > > > https://en.wikipedia.org/wiki/Benjamin_Graham#Bibliography > > > > "Warren Buffett and the Interpretation of Financial Statements: The > Search > > for the Company with a Durable Competitive Advantage" > > https://g.co/kgs/65XRnv > > > > https://www.quantopian.com/help/fundamentals > > - some of these stats are from EDGAR > > - some of these stats are from Morningstar > > - it'd be great to also have data about environmental sustainability > (e.g. > > from mandatory reports) just like the GRI reports > > > > >From "Pulling Stock Market Data - Yahoo and Google don't work anymore?" > > https://www.reddit.com/r/Python/comments/7zxptg/ > pulling_stock_market_data_ > > yahoo_and_google_dont/#dus01vk > > > > > quantopian/zipline pulls data from Quandl with a data ingest step; with > > the US Treasury 10 year bond yield and/or SPY (from IEX) as a benchmark. > > > https://github.com/quantopian/zipline > > > - https://www.quantopian.com/tutorials/ > > > - > > https://www.quantopian.com/posts/community-algorithms- > > migrated-to-quantopian-2 > > > - "7 Best Community-Built Value Investing Algorithms Using > Fundamentals" > > > https://blog.quantopian.com/fundamentals-contest-winners/ > > > > - https://github.com/quantopian/pyfolio > > - https://github.com/quantopian/alphalens > > > > > > On Sunday, April 22, 2018, Charlie Ahern via Omaha > > wrote: > > > > > My wife and I are moving to Lincoln on the 15th (from Des Moines). > > > Hopefully by the 24th we'll be settled enough that I can go to the > > > meetinag. > > > Will anyone be driving from Lincoln to Omaha for the meeting? > > > > > > I'm a Python newbie, primarily a hobbyist (with close to 40 years > > > experience in high tech) studying: > > > * NLP and possible analysis of the text in SEC reports from EDGAR > > > (Electronic Data Gathering, Analysis, and Retrieval system) > > > * Statistical analysis of SEC and other data sources, such as FRED > > (Federal > > > Reserve Economic Data) > > > > > > -- > > > Charlie Ahern > > > > > > Reading, after a certain age, diverts the mind too much from its > creative > > > pursuits. Any man who reads too much and uses his own brain too little > > > falls into lazy habits of thinking, just as the man who spends too much > > > time in the theater is tempted to be content with living vicariously > > > instead of living his own life. - Albert Einstein > > > _______________________________________________ > > > Omaha Python Users Group mailing list > > > Omaha at python.org > > > https://mail.python.org/mailman/listinfo/omaha > > > http://www.OmahaPython.org > > > > > > > > > ------------------------------ > > > > Subject: Digest Footer > > > > _______________________________________________ > > Omaha mailing list > > Omaha at python.org > > https://mail.python.org/mailman/listinfo/omaha > > > > > > ------------------------------ > > > > End of Omaha Digest, Vol 131, Issue 2 > > ************************************* > > > > > > -- > Charlie Ahern > (408) 821-6414 > > Reading, after a certain age, diverts the mind too much from its creative > pursuits. Any man who reads too much and uses his own brain too little > falls into lazy habits of thinking, just as the man who spends too much > time in the theater is tempted to be content with living vicariously > instead of living his own life. - Albert Einstein > _______________________________________________ > Omaha Python Users Group mailing list > Omaha at python.org > https://mail.python.org/mailman/listinfo/omaha > http://www.OmahaPython.org > From bkealey at unomaha.edu Mon Apr 23 15:57:35 2018 From: bkealey at unomaha.edu (Burch Kealey) Date: Mon, 23 Apr 2018 19:57:35 +0000 Subject: [omaha] EDGAR Access Message-ID: I spent a very limited amount of time trying to understand what Charlie meant by his comment that the SEC 'pandas-datareader feed'. Is this just because the SEC shut down ftp access? Frankly the fact that the shut down FTP access is probably a good thing - I am not sure of all the technical details of how they provide computing resources to FTP versus HTTP but our experience is that HTTP is is so much faster than the old FTP access. Further, at the peak the SEC only allowed 50 concurrent FTP sessions so there were plenty of times when we would try to establish a session and would be turned away because all of the ports were taken. We have never had a competitive connection problem after going to HTTP which was about two years before they switched off the FTP. I will also observe that to me the frustrating issue about the SEC is how they make more data available for free. You might like that but when they originally sought funding for EDGAR what they told Congress is we will build a repository and then let the market develop unique products from that data. So we have this constant risk that the SEC will decide to make something that we do freely available and that puts a lid on investment opportunities and other issues. I would be interested in trying to better understand the issue Charlie raised because that is pretty much contrary to the way the SEC has worked. They have had/provided a feed of EDGAR since EDGAR was first created so I don't think that can be what you are talking about. One of the problems their contractor has had is that people can very easily develop tools to scrape filings so they have not gotten the revenue that they have expected from providing the direct feed. I know some folks at the SEC and have had at least a working relationship with them for almost a decade. They were often frustrated because of users failing to observe the limitations for fair access that they tried to set out there was a ton of abuse. They are always looking for ways to improve free access to content. We use the SECs RSS feed to identify when new filings are made and then REQUESTS to grab the filing for our internal use. It is considerably faster than FTP access and we have far fewer problems in transit. I don't understand why but that is my experience as someone who consumes 1,500 + SEC filings every single business day. From charlieahern at gmail.com Tue Apr 24 22:47:04 2018 From: charlieahern at gmail.com (Charlie Ahern) Date: Tue, 24 Apr 2018 21:47:04 -0500 Subject: [omaha] Omaha Digest, Vol 131, Issue 4 In-Reply-To: References: Message-ID: Hey, Burch. Thanks for the reply. I'll have to do some research about the SEC's HTTP access and alternatives to scraping. I'm still an ignorant newbie. Hopefully we can meet up at the Meetup. Thanks again for your comments. Charlie On Tue, Apr 24, 2018 at 11:00 AM, wrote: > Send Omaha mailing list submissions to > omaha at python.org > > To subscribe or unsubscribe via the World Wide Web, visit > https://mail.python.org/mailman/listinfo/omaha > or, via email, send a message with subject or body 'help' to > omaha-request at python.org > > You can reach the person managing the list at > omaha-owner at python.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Omaha digest..." > > > Today's Topics: > > 1. EDGAR Access (Burch Kealey) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Mon, 23 Apr 2018 19:57:35 +0000 > From: Burch Kealey > To: Omaha Python Users Group > Subject: [omaha] EDGAR Access > Message-ID: > namprd07.prod.outlook.com> > > Content-Type: text/plain; charset="iso-8859-1" > > I spent a very limited amount of time trying to understand what Charlie > meant by his comment that the SEC 'pandas-datareader feed'. Is this just > because the SEC shut down ftp access? Frankly the fact that the shut down > FTP access is probably a good thing - I am not sure of all the technical > details of how they provide computing resources to FTP versus HTTP but our > experience is that HTTP is is so much faster than the old FTP access. > Further, at the peak the SEC only allowed 50 concurrent FTP sessions so > there were plenty of times when we would try to establish a session and > would be turned away because all of the ports were taken. We have never > had a competitive connection problem after going to HTTP which was about > two years before they switched off the FTP. > > > I will also observe that to me the frustrating issue about the SEC is how > they make more data available for free. You might like that but when they > originally sought funding for EDGAR what they told Congress is we will > build a repository and then let the market develop unique products from > that data. So we have this constant risk that the SEC will decide to make > something that we do freely available and that puts a lid on investment > opportunities and other issues. I would be interested in trying to better > understand the issue Charlie raised because that is pretty much contrary to > the way the SEC has worked. They have had/provided a feed of EDGAR since > EDGAR was first created so I don't think that can be what you are talking > about. One of the problems their contractor has had is that people can > very easily develop tools to scrape filings so they have not gotten the > revenue that they have expected from providing the direct feed. > > > I know some folks at the SEC and have had at least a working relationship > with them for almost a decade. They were often frustrated because of users > failing to observe the limitations for fair access that they tried to set > out there was a ton of abuse. They are always looking for ways to improve > free access to content. > > > We use the SECs RSS feed to identify when new filings are made and then > REQUESTS to grab the filing for our internal use. It is considerably > faster than FTP access and we have far fewer problems in transit. I don't > understand why but that is my experience as someone who consumes 1,500 + > SEC filings every single business day. > > > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > Omaha mailing list > Omaha at python.org > https://mail.python.org/mailman/listinfo/omaha > > > ------------------------------ > > End of Omaha Digest, Vol 131, Issue 4 > ************************************* > -- Charlie Ahern (408) 821-6414 Reading, after a certain age, diverts the mind too much from its creative pursuits. Any man who reads too much and uses his own brain too little falls into lazy habits of thinking, just as the man who spends too much time in the theater is tempted to be content with living vicariously instead of living his own life. - Albert Einstein From betsy at python.org Wed Apr 4 17:03:00 2018 From: betsy at python.org (Betsy Waliszewski) Date: Wed, 04 Apr 2018 21:03:00 -0000 Subject: [omaha] [PSF-Board] PSF Board Resolution Notification - OPUG's Meetup.com subscription for six months - Omaha Python UG, Nebraska Message-ID: Hi Naomi, Sorry for the delay in letting you know we received your request. The PSF is happy to approve your 6-month meetup.com reimbursement of $89.94 for OPUG. I have cc'ed in our financial controller, Phyllis. Please send her a copy of the receipt for the payment when available. Additionally, we are avoiding making wire transfers for amounts less than $500. Can you send Phyllis a PayPal email address or a mailing address where she can send you a check? Best regards, Betsy On Sat, Mar 24, 2018 at 4:13 PM, psf at python.org wrote: > Submitted on Saturday, March 24, 2018 - 19:13 > Submitted by user: seenaomi > Submitted values are: > > ==Contact== > Existing Contact: naomi see > Legal First Name: naomi > Legal Last Name: see > Nickname: naomi > Email: naomi.see at seenaomi.net > City: Omaha > Country: United States > State/Province/Region: NE > Region Other: > Postal Code: 68104 > Phone Number: 4028853796 > > > ==Organization== > Organization Name: Omaha Python Users Group > Organization Email: omaha at python.org > Twitter Handle: https://twitter.com/OmahaPython > Website: https://omahapython.github.io/ > > > ==Proposal == > Grant Type: Event site subscription (Meetup) > Grant Title: OPUG's Meetup.com subscription for six months > Objective: Fund the use of Meetup.com for organizing and managing Omaha > Python Users Group for a six month period. Meetup.com helps to increase the > visibility of the user group, as well as boost attendance through automated > reminders, RSVP functionality, and other tools. It also makes organizing > and > promoting the group easier, as well as providing a platform to garner > sponsorships and thank sponsors publicly. > Grant Amount: $89.94, which is the cost of 6 months to organize a group on > Meetup.com. > Beneficiaries: > The Omaha Python Users Group has had many organizers, this time a woman has > stepped up. The group died due to a lack of attendance. The new organizer > is > trying to broaden the scope of the reach. The Meetup.com account is a > critical piece of getting the group off of the ground once again. The site > is > already used widely by other Tech Meetup groups in the Omaha area and is > one > of the first places people will look for new meetup opportunities. > Meetup.com > is a well-known site for people looking for like-minded individuals, > providing us good visibility for new members. It also cross-promotes groups > to each other, encouraging members of other tech groups to consider joining > ours. > > Meetup.com provides a centralized location where our members see what?s > coming up and who has RSVPed for the meeting. Members can also leave > comments > about the group itself. > Follow-up activities: As organizer I intend to document the progression of > the group as it hopefully matures. I will gladly share these updates with > PSF. Sharing successes and failures etc. > Disbursement: PayPal > Syllabus Link: > Length of time: > % of Python: > ==Other== > Additional Attachments: > Link to Code of Conduct: > https://www.meetup.com/Omahas-Python-Users-Group/pages/25981 > 800/Code_of_Conduct/ > > > The results of this submission may be viewed at: > https://psfmember.org/node/2/submission/253 > > _______________________________________________ > PSF-Board mailing list > PSF-Board at python.org > https://mail.python.org/mailman/listinfo/psf-board > From phyllis at python.org Wed Apr 11 15:16:12 2018 From: phyllis at python.org (Phyllis Dobbs) Date: Wed, 11 Apr 2018 19:16:12 -0000 Subject: [omaha] [PSF-Board] PSF Board Resolution Notification - OPUG's Meetup.com subscription for six months - Omaha Python UG, Nebraska In-Reply-To: References: Message-ID: We also accept PayPal if that method of reimbursement is preferred to a check. Thanks, Phyllis A. Dobbs Controller Python Software Foundation On Wed, Apr 4, 2018 at 4:02 PM, Betsy Waliszewski wrote: > Hi Naomi, > > Sorry for the delay in letting you know we received your request. > > The PSF is happy to approve your 6-month meetup.com reimbursement of > $89.94 for OPUG. > > I have cc'ed in our financial controller, Phyllis. Please send her a copy > of the receipt for the payment when available. Additionally, we are > avoiding making wire transfers for amounts less than $500. Can you send > Phyllis a PayPal email address or a mailing address where she can send you > a check? > > Best regards, > > Betsy > > > On Sat, Mar 24, 2018 at 4:13 PM, psf at python.org wrote: > >> Submitted on Saturday, March 24, 2018 - 19:13 >> Submitted by user: seenaomi >> Submitted values are: >> >> ==Contact== >> Existing Contact: naomi see >> Legal First Name: naomi >> Legal Last Name: see >> Nickname: naomi >> Email: naomi.see at seenaomi.net >> City: Omaha >> Country: United States >> State/Province/Region: NE >> Region Other: >> Postal Code: 68104 >> Phone Number: 4028853796 >> >> >> ==Organization== >> Organization Name: Omaha Python Users Group >> Organization Email: omaha at python.org >> Twitter Handle: https://twitter.com/OmahaPython >> Website: https://omahapython.github.io/ >> >> >> ==Proposal == >> Grant Type: Event site subscription (Meetup) >> Grant Title: OPUG's Meetup.com subscription for six months >> Objective: Fund the use of Meetup.com for organizing and managing Omaha >> Python Users Group for a six month period. Meetup.com helps to increase >> the >> visibility of the user group, as well as boost attendance through >> automated >> reminders, RSVP functionality, and other tools. It also makes organizing >> and >> promoting the group easier, as well as providing a platform to garner >> sponsorships and thank sponsors publicly. >> Grant Amount: $89.94, which is the cost of 6 months to organize a group on >> Meetup.com. >> Beneficiaries: >> The Omaha Python Users Group has had many organizers, this time a woman >> has >> stepped up. The group died due to a lack of attendance. The new organizer >> is >> trying to broaden the scope of the reach. The Meetup.com account is a >> critical piece of getting the group off of the ground once again. The >> site is >> already used widely by other Tech Meetup groups in the Omaha area and is >> one >> of the first places people will look for new meetup opportunities. >> Meetup.com >> is a well-known site for people looking for like-minded individuals, >> providing us good visibility for new members. It also cross-promotes >> groups >> to each other, encouraging members of other tech groups to consider >> joining >> ours. >> >> Meetup.com provides a centralized location where our members see what?s >> coming up and who has RSVPed for the meeting. Members can also leave >> comments >> about the group itself. >> Follow-up activities: As organizer I intend to document the progression of >> the group as it hopefully matures. I will gladly share these updates with >> PSF. Sharing successes and failures etc. >> Disbursement: PayPal >> Syllabus Link: >> Length of time: >> % of Python: >> ==Other== >> Additional Attachments: >> Link to Code of Conduct: >> https://www.meetup.com/Omahas-Python-Users-Group/pages/25981 >> 800/Code_of_Conduct/ >> >> >> The results of this submission may be viewed at: >> https://psfmember.org/node/2/submission/253 >> >> _______________________________________________ >> PSF-Board mailing list >> PSF-Board at python.org >> https://mail.python.org/mailman/listinfo/psf-board >> > >