October 15, 2024

Python Tutorials

Python Read CSV File

Comma-Separated Values (CSV) files are a common data storage format that uses a simple text file with values separated by commas. Python provides multiple ways to read and process CSV files. The most common methods involve using the built-in csv module or the pandas library.

1. Reading CSV Files with the csv Module

The csv module is a built-in module that provides functionality to read from and write to CSV files. Here’s a basic example of how to read a CSV file using this module:

import csv

# Specify the path to your CSV file
file_path = "example.csv"

# Open the file and read its contents
with open(file_path, mode='r') as file:
    # Create a CSV reader object
    csv_reader = csv.reader(file)

    # Iterate over the rows and print each one
    for row in csv_reader:
        print(row)

This code will print each row of the CSV file as a list of strings. Each list corresponds to a row in the CSV file, with each element representing a cell value.

2. Reading CSV Files as Dictionaries

The DictReader class in the csv module allows you to read CSV files as dictionaries, where the keys are the column headers:

import csv

# Specify the path to your CSV file
file_path = "example.csv"

# Open the file and read its contents
with open(file_path, mode='r') as file:
    # Create a DictReader object
    csv_reader = csv.DictReader(file)

    # Iterate over the rows and print each one as a dictionary
    for row in csv_reader:
        print(row)

Each row is returned as an OrderedDict, where the keys are the column names and the values are the corresponding data from that row.

3. Reading CSV Files with pandas

The pandas library is a powerful tool for data manipulation and analysis. It provides an easy way to read and process CSV files. Here’s how to read a CSV file using pandas:

import pandas as pd

# Specify the path to your CSV file
file_path = "example.csv"

# Read the CSV file into a DataFrame
df = pd.read_csv(file_path)

# Display the first few rows of the DataFrame
print(df.head())

This code reads the CSV file into a DataFrame, which is a powerful data structure that allows for easy data manipulation and analysis. The head() method displays the first five rows of the DataFrame by default.

4. Specifying Delimiters

By default, CSV files use commas as delimiters, but you can specify a different delimiter if your file uses something else (e.g., tabs or semicolons):

import csv

# Specify the path to your CSV file
file_path = "example.csv"

# Open the file and read its contents with a custom delimiter
with open(file_path, mode='r') as file:
    csv_reader = csv.reader(file, delimiter=';')

    # Iterate over the rows and print each one
    for row in csv_reader:
        print(row)

If you’re using pandas, you can specify the delimiter using the sep parameter:

import pandas as pd

# Specify the path to your CSV file
file_path = "example.csv"

# Read the CSV file with a custom delimiter into a DataFrame
df = pd.read_csv(file_path, sep=';')

# Display the first few rows of the DataFrame
print(df.head())

5. Handling Large CSV Files

When dealing with large CSV files, it’s important to manage memory efficiently. You can use the chunksize parameter in pandas to read the file in smaller chunks:

import pandas as pd

# Specify the path to your CSV file
file_path = "large_example.csv"

# Read the CSV file in chunks
chunk_size = 1000
chunks = pd.read_csv(file_path, chunksize=chunk_size)

# Process each chunk
for chunk in chunks:
    print(chunk.head())

This method reads the CSV file in chunks of 1000 rows at a time, which can significantly reduce memory usage when working with large datasets.

6. Skipping Rows and Handling Headers

If your CSV file has extra rows or headers that you want to skip, you can use the skiprows and header parameters:

import pandas as pd

# Specify the path to your CSV file
file_path = "example.csv"

# Read the CSV file, skipping the first row and using the second row as headers
df = pd.read_csv(file_path, skiprows=1, header=0)

# Display the first few rows of the DataFrame
print(df.head())

7. Conclusion

Python provides flexible and powerful ways to read and process CSV files, whether using the built-in csv module for simple tasks or the pandas library for more complex data manipulation. By understanding these tools, you can efficiently handle CSV data in your Python projects.

You May Like