python - adding dummy columns to the original dataframe

Question

I have a dataframe looks like this:

 ????????????JOINED_CO GENDER ???EXEC_FULLNAME ?GVKEY ?YEAR ?CONAME ?BECAMECEO ?REJOIN ??LEFTOFC ???LEFTCO ?RELEFT ???REASON ?PAGE
CO_PER_ROL ????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????
5622 ?????????????NaN ??MALE ??Ira A. Eichner ??1004 ?1992 ?AAR CORP ??19550101 ????NaN ?19961001 ?19990531 ????NaN ?RESIGNED ???79
5622 ?????????????NaN ??MALE ??Ira A. Eichner ??1004 ?1993 ?AAR CORP ??19550101 ????NaN ?19961001 ?19990531 ????NaN ?RESIGNED ???79
5622 ?????????????NaN ??MALE ??Ira A. Eichner ??1004 ?1994 ?AAR CORP ??19550101 ????NaN ?19961001 ?19990531 ????NaN ?RESIGNED ???79
5622 ?????????????NaN ??MALE ??Ira A. Eichner ??1004 ?1995 ?AAR CORP ??19550101 ????NaN ?19961001 ?19990531 ????NaN ?RESIGNED ???79
5622 ?????????????NaN ??MALE ??Ira A. Eichner ??1004 ?1996 ?AAR CORP ??19550101 ????NaN ?19961001 ?19990531 ????NaN ?RESIGNED ???79
5622 ?????????????NaN ??MALE ??Ira A. Eichner ??1004 ?1997 ?AAR CORP ??19550101 ????NaN ?19961001 ?19990531 ????NaN ?RESIGNED ???79
5622 ?????????????NaN ??MALE ??Ira A. Eichner ??1004 ?1998 ?AAR CORP ??19550101 ????NaN ?19961001 ?19990531 ????NaN ?RESIGNED ???79
5623 ?????????????NaN ??MALE ?David P. Storch ??1004 ?1992 ?AAR CORP ??19961009 ????NaN ??????NaN ??????NaN ????NaN ??????NaN ???57
5623 ?????????????NaN ??MALE ?David P. Storch ??1004 ?1993 ?AAR CORP ??19961009 ????NaN ??????NaN ??????NaN ????NaN ??????NaN ???57
5623 ?????????????NaN ??MALE ?David P. Storch ??1004 ?1994 ?AAR CORP ??19961009 ????NaN ??????NaN ??????NaN ????NaN ??????NaN ???57
5623 ?????????????NaN ??MALE ?David P. Storch ??1004 ?1995 ?AAR CORP ??19961009 ????NaN ??????NaN ??????NaN ????NaN ??????NaN ???57
5623 ?????????????NaN ??MALE ?David P. Storch ??1004 ?1996 ?AAR CORP ??19961009 ????NaN ??????NaN ??????NaN ????NaN ??????NaN ???57

For the YEAR value, I like to add year columns (1993,1994...,2009) to the original dataframe, If the value in YEAR is 1992, then the value in the 1992 column should be 1 otherwise 0.

I used a very stupid for loop, but it seems to run forever as I have a large dataset. Could anyone help me with it, thanks a lot!

Answer 1

In [77]: df = pd.concat([df, pd.get_dummies(df['YEAR'])], axis=1); df
Out[77]: 
      JOINED_CO GENDER    EXEC_FULLNAME  GVKEY  YEAR    CONAME  BECAMECEO  
5622        NaN   MALE   Ira A. Eichner   1004  1992  AAR CORP   19550101   
5622        NaN   MALE   Ira A. Eichner   1004  1993  AAR CORP   19550101   
5622        NaN   MALE   Ira A. Eichner   1004  1994  AAR CORP   19550101   
5622        NaN   MALE   Ira A. Eichner   1004  1995  AAR CORP   19550101   
5622        NaN   MALE   Ira A. Eichner   1004  1996  AAR CORP   19550101   
5622        NaN   MALE   Ira A. Eichner   1004  1997  AAR CORP   19550101   
5622        NaN   MALE   Ira A. Eichner   1004  1998  AAR CORP   19550101   
5623        NaN   MALE  David P. Storch   1004  1992  AAR CORP   19961009   
5623        NaN   MALE  David P. Storch   1004  1993  AAR CORP   19961009   
5623        NaN   MALE  David P. Storch   1004  1994  AAR CORP   19961009   
5623        NaN   MALE  David P. Storch   1004  1995  AAR CORP   19961009   
5623        NaN   MALE  David P. Storch   1004  1996  AAR CORP   19961009   

      REJOIN   LEFTOFC    LEFTCO  RELEFT    REASON  PAGE  1992  1993  1994  
5622     NaN  19961001  19990531     NaN  RESIGNED    79     1     0     0   
5622     NaN  19961001  19990531     NaN  RESIGNED    79     0     1     0   
5622     NaN  19961001  19990531     NaN  RESIGNED    79     0     0     1   
5622     NaN  19961001  19990531     NaN  RESIGNED    79     0     0     0   
5622     NaN  19961001  19990531     NaN  RESIGNED    79     0     0     0   
5622     NaN  19961001  19990531     NaN  RESIGNED    79     0     0     0   
5622     NaN  19961001  19990531     NaN  RESIGNED    79     0     0     0   
5623     NaN       NaN       NaN     NaN       NaN    57     1     0     0   
5623     NaN       NaN       NaN     NaN       NaN    57     0     1     0   
5623     NaN       NaN       NaN     NaN       NaN    57     0     0     1   
5623     NaN       NaN       NaN     NaN       NaN    57     0     0     0   
5623     NaN       NaN       NaN     NaN       NaN    57     0     0     0   

      1995  1996  1997  1998  
5622     0     0     0     0  
5622     0     0     0     0  
5622     0     0     0     0  
5622     1     0     0     0  
5622     0     1     0     0  
5622     0     0     1     0  
5622     0     0     0     1  
5623     0     0     0     0  
5623     0     0     0     0  
5623     0     0     0     0  
5623     1     0     0     0  
5623     0     1     0     0  

If you'd like to delete the YEAR column, then you could follow this up with del df['YEAR']. Or, drop the YEAR column from df before calling concat:

df = pd.concat([df.drop('YEAR', axis=1), pd.get_dummies(df['YEAR'])], axis=1)