Как почистить панды DataFrame

Question

Мой текущий DataFrame приведен ниже:

    0   1    2   3      4    5
0   NAN Name NAN Amount NAN Percentage
1   NAN A    NAN 28223  NAN 8.70%
2   NAN B    NAN NAN    NAN NAN
3   NAN C    NAN NAN    NAN NAN
4   NAN D    NAN 21871  NAN 6.80%
5   NAN E    NAN NAN    NAN NAN
6   NAN F    NAN NAN    NAN NAN
7   NAN G    NAN 21380  NAN 6.64%
8   NAN H    NAN NAN    NAN NAN
9   NAN I    NAN NAN    NAN NAN
10  NAN J    NAN 20784  NAN 6.46%
11  NAN K    NAN NAN    NAN NAN
12  NAN L    NAN NAN    NAN NAN

Я хочу очистить этот DataFrame, удалив некоторые значения NAN и некоторые значения NAN в Not Listed.

Ожидаемый результат

Name Amount     Percentage
A    28223      8.70%
B    Not Listed Not Listed
C    Not Listed Not Listed
D    21871      6.80%
E    Not Listed Not Listed
F    Not Listed Not Listed
G    21380      6.64%
H    Not Listed Not Listed
I    Not Listed Not Listed
J    20784      6.46%
K    Not Listed Not Listed
L    Not Listed Not Listed

Может кто-нибудь, пожалуйста, помогите мне в этом

Answer 1

Вы можете удалить ненужные столбцы на df.drop([column_names],axis=1) и заменить NAN на not listed, затем установить заголовки столбцов и удалить дополнительную строку, которая была взята для заголовка.

df =df.drop([0,2,4],axis=1).replace(np.nan, 'Not Listed')
df.columns = df.iloc[0]
df.drop(0,inplace=True)

Answer 2

Учитывая вашу конкретную структуру данных:

df.columns = df.iloc[0, :]  # Rename the columns based on the first row of data.
df.columns.name = None  # Set the columns name to None.
df = df.iloc[1:, :].reset_index(drop=True)  # Drop the column names from the data in the dataframe.
>>> df.replace('NAN', np.nan).dropna(how='all', axis=1).replace(np.nan, 'Not Listed')
   Name      Amount  Percentage
0     A       28223       8.70%
1     B  Not Listed  Not Listed
2     C  Not Listed  Not Listed
3     D       21871       6.80%
4     E  Not Listed  Not Listed
5     F  Not Listed  Not Listed
6     G       21380       6.64%
7     H  Not Listed  Not Listed
8     I  Not Listed  Not Listed
9     J       20784       6.46%
10    K  Not Listed  Not Listed
11    L  Not Listed  Not Listed

Вы можете установить индекс на имя, если хотите, изменив последнюю строку кода:

>>> >>> df.replace('NAN', np.nan).dropna(how='all', axis=1).replace(np.nan, 'Not Listed').set_index('Name')
          Amount  Percentage
Name                        
A          28223       8.70%
B     Not Listed  Not Listed
C     Not Listed  Not Listed
D          21871       6.80%
E     Not Listed  Not Listed
F     Not Listed  Not Listed
G          21380       6.64%
H     Not Listed  Not Listed
I     Not Listed  Not Listed
J          20784       6.46%
K     Not Listed  Not Listed
L     Not Listed  Not Listed

Answer 3

dropna + slicing

t = df.dropna(axis=1, how='all').values
pd.DataFrame(t[1:], columns=t[0]).fillna('Not listed')

   Name      Amount  Percentage
0     A       28223       8.70%
1     B  Not listed  Not listed
2     C  Not listed  Not listed
3     D       21871       6.80%
4     E  Not listed  Not listed
5     F  Not listed  Not listed
6     G       21380       6.64%
7     H  Not listed  Not listed
8     I  Not listed  Not listed
9     J       20784       6.46%
10    K  Not listed  Not listed
11    L  Not listed  Not listed