Question : remove duplicate row in df
Answered by : sachin-verma
# Below are quick example
# keep first duplicate row
df2 = df.drop_duplicates()
# Using DataFrame.drop_duplicates() to keep first duplicate row
df2 = df.drop_duplicates(keep='first')
# keep last duplicate row
df2 = df.drop_duplicates( keep='last')
# Remove all duplicate rows
df2 = df.drop_duplicates(keep=False)
# Delete duplicate rows based on specific columns
df2 = df.drop_duplicates(subset=["Courses", "Fee"], keep=False)
# Drop duplicate rows in place
df.drop_duplicates(inplace=True)
# Using DataFrame.apply() and lambda function
df2 = df.apply(lambda x: x.astype(str).str.lower()).drop_duplicates(subset=['Courses', 'Fee'], keep='first')Source : | Last Update : Wed, 26 Aug 20
Question : pandas drop duplicates from column
Answered by : clean-chimpanzee-x9xh2muu92w1
data = data.drop_duplicates(subset=['City'], keep='first')Source : https://duckduckgo.com/?q=pandas+drop+duplicates+from+column&t=brave&ia=web | Last Update : Sun, 22 May 22
Question : pd drop duplicate columns
Answered by : ben-levitas
# For dropping duplicate columns:
df = df.loc[:,~df.columns.duplicated()]Source : | Last Update : Tue, 06 Dec 22
Question : drop duplicates columns pandas
Answered by : or-berger
df.loc[:,~df.columns.duplicated()]Source : | Last Update : Wed, 08 Jun 22
Question : pandas remove duplicates columns
Answered by : perfect-penguin-a1nt3r09ybl6
df = df.loc[:,~df.columns.duplicated()].copy()
# https://stackoverflow.com/questions/14984119/python-pandas-remove-duplicate-columnsSource : | Last Update : Mon, 10 Oct 22
Question : pd df drop duplicates
Answered by : athul-mathew
df.drop_duplicates(subset=['brand', 'style'], keep='last')Source : https://pandas.pydata.org/docs/reference/api/pandas.DataFrame.drop_duplicates.html | Last Update : Mon, 29 Aug 22
Question : pd df drop duplicates
Answered by : lazy-lark-jenyffc7wa94
df.drop_duplicates()Source : | Last Update : Mon, 30 May 22