custom data warehouse in python vs. out-of-the-box ETL tool

[M.-A. Lemburg]

snfctech wrote:
> Does anyone have experience building a data warehouse in python?  Any
> thoughts on custom vs using an out-of-the-box product like Talend or
> Informatica?
> 
> I have an integrated system Dashboard project that I was going to
> build using cross-vendor joins on existing DBs, but I keep hearing
> that a data warehouse is the way to go.  e.g. I want to create orders
> and order_items with relations to members (MS Access DB), products
> (flat file) and employees (MySQL).
> 
> Thanks in advance for any tips.

You might want to look at this solution for doing cross-database JOINs:

EasySoft ODBC Join-Engine:

    http://www.easysoft.com/products/data_access/odbc_odbc_join_engine/index.html

and then use our mxODBC to access EasySoft's Engine:

    http://www.egenix.com/products/python/mxODBC/

or mxODBC Connect, if you have a client-server setup:

    http://www.egenix.com/products/python/mxODBCConnect/

Some database engines also allow integrating external ODBC
data sources - the external tables then look like normal
database tables and can be used in JOINs as well. I know that DB2
and Oracle support this kind of setup. You can access those using
mxODBC as well.

-- 
Marc-Andre Lemburg
eGenix.com

Professional Python Services directly from the Source  (#1, Sep 23 2009)
>>> Python/Zope Consulting and Support ...        http://www.egenix.com/
>>> mxODBC.Zope.Database.Adapter ...             http://zope.egenix.com/
>>> mxODBC, mxDateTime, mxTextTools ...        http://python.egenix.com/
________________________________________________________________________

::: Try our new mxODBC.Connect Python Database Interface for free ! ::::


   eGenix.com Software, Skills and Services GmbH  Pastor-Loeh-Str.48
    D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg
           Registered at Amtsgericht Duesseldorf: HRB 46611
               http://www.egenix.com/company/contact/