Combining 2 data series into one

Paul Barry paul.james.barry at gmail.com
Wed Jun 28 08:02:36 EDT 2017


Maybe try your code on a sub-set of your data - perhaps 1000 lines of data?
- to see if that works.

Anyone else on the list suggest anything to try here?

On 28 June 2017 at 12:50, Bhaskar Dhariyal <dhariyalbhaskar at gmail.com>
wrote:

> No it didn't work. I am getting memory error. Using 32GB RAM system
>
> On Wed, Jun 28, 2017 at 5:17 PM, Paul Barry <paul.james.barry at gmail.com>
> wrote:
>
>> On the line that's failing, your code is this:
>>
>>     combinedX=combinedX+dframe['tf']
>>
>> which uses combinedX on both sides of the assignment statement - note
>> that Python is reporting a 'MemoryError", which may be happening due to
>> this "double use" (maybe).  What happens if you create a new dataframe,
>> like this:
>>
>>     newX = combinedX + dframe['tf']
>>
>> Regardless, it looks like you are doing a dataframe merge.  Jake V's book
>> has an excellent section on it here: http://nbviewer.jupyter.
>> org/github/jakevdp/PythonDataScienceHandbook/blob/master/
>> notebooks/03.07-Merge-and-Join.ipynb - this should take about 20 minutes
>> to read, and may be of use to you.
>>
>> Paul.
>>
>>
>>
>> On 28 June 2017 at 12:19, Bhaskar Dhariyal <dhariyalbhaskar at gmail.com>
>> wrote:
>>
>>> On Wednesday, 28 June 2017 14:43:48 UTC+5:30, Paul Barry  wrote:
>>> > This should do it:
>>> >
>>> > >>> import pandas as pd
>>> > >>>
>>> > >>> df1 = pd.DataFrame(['bhaskar', 'Rohit'], columns=['first_name'])
>>> > >>> df1
>>> >   first_name
>>> > 0    bhaskar
>>> > 1      Rohit
>>> > >>> df2 = pd.DataFrame(['dhariyal', 'Gavval'], columns=['last_name'])
>>> > >>> df2
>>> >   last_name
>>> > 0  dhariyal
>>> > 1    Gavval
>>> > >>> df = pd.DataFrame()
>>> > >>> df['name'] = df1['first_name'] + ' ' + df2['last_name']
>>> > >>> df
>>> >                name
>>> > 0  bhaskar dhariyal
>>> > 1      Rohit Gavval
>>> > >>>
>>> >
>>> > Again, I draw your attention to Jake VanderPlas's excellent book,
>>> which is
>>> > available for free on the web.  All of these kind of data
>>> manipulations are
>>> > covered there:  https://github.com/jakevdp/PythonDataScienceHandbook
>>> - the
>>> > hard copy is worth owning too (if you plan to do a lot of work using
>>> > numpy/pandas).
>>> >
>>> > I'd also recommend the upcoming 2nd edition of Wes McKinney's "Python
>>> for
>>> > Data Analysis" book - I've just finished tech reviewing it for
>>> O'Reilly,
>>> > and it is very good, too - highly recommended.
>>> >
>>> > Regards.
>>> >
>>> > Paul.
>>> >
>>> > On 28 June 2017 at 07:11, Bhaskar Dhariyal <dhariyalbhaskar at gmail.com>
>>> > wrote:
>>> >
>>> > > Hi!
>>> > >
>>> > > I have 2 dataframe i.e. df1['first_name'] and df2['last_name']. I
>>> want to
>>> > > make it as df['name']. How to do it using pandas dataframe.
>>> > >
>>> > > first_name
>>> > > ----------
>>> > > bhaskar
>>> > > Rohit
>>> > >
>>> > >
>>> > > last_name
>>> > > -----------
>>> > > dhariyal
>>> > > Gavval
>>> > >
>>> > > should appear as
>>> > >
>>> > > name
>>> > > ----------
>>> > > bhaskar dhariyal
>>> > > Rohit Gavval
>>> > >
>>> > >
>>> > >
>>> > > Thanks
>>> > > --
>>> > > https://mail.python.org/mailman/listinfo/python-list
>>> > >
>>> >
>>> >
>>> >
>>> > --
>>> > Paul Barry, t: @barrypj <https://twitter.com/barrypj> - w:
>>> > http://paulbarry.itcarlow.ie - e: paul.barry at itcarlow.ie
>>> > Lecturer, Computer Networking: Institute of Technology, Carlow,
>>> Ireland.
>>>
>>> https://drive.google.com/open?id=0Bw2Avni0DUa3aFJKdC1Xd2trM2c
>>> link to code
>>> --
>>> https://mail.python.org/mailman/listinfo/python-list
>>>
>>
>>
>>
>> --
>> Paul Barry, t: @barrypj <https://twitter.com/barrypj> - w:
>> http://paulbarry.itcarlow.ie - e: paul.barry at itcarlow.ie
>> Lecturer, Computer Networking: Institute of Technology, Carlow, Ireland.
>>
>
>


-- 
Paul Barry, t: @barrypj <https://twitter.com/barrypj> - w:
http://paulbarry.itcarlow.ie - e: paul.barry at itcarlow.ie
Lecturer, Computer Networking: Institute of Technology, Carlow, Ireland.



More information about the Python-list mailing list