Handling CSV Files with Python: A Beginner’s Guide

Data Science Updated on April 30, 2025

Python Seaborn for Beginners: A Guide to Beautiful Data Visualization

Excerpt: Seaborn is a Python library that simplifies data visualization, offering stunning, easy-to-create plots for exploring and understanding data. This beginner’s guide introduces Seaborn, explains how to create common visualizations like scatter plots, histograms, and heatmaps, and provides practical examples to help you start visualizing data with confidence.

Table of Contents

  1. Introduction
  2. What is a CSV File?
  3. Reading CSV Files with Python
  4. Writing to CSV Files
  5. Practical Examples
  6. Best Practices for Handling CSV Files
  7. Conclusion

Introduction

Comma-Separated Values (CSV) files are widely used for storing and exchanging tabular data, such as spreadsheets or database exports. Python’s versatility makes it an excellent tool for working with CSV files, whether you’re reading data for analysis or creating files to store information. In this beginner’s guide, we’ll explore how to handle CSV files using Python’s built-in csv module and the powerful pandas library. With step-by-step explanations and practical examples, you’ll learn how to read, write, and manipulate CSV data, empowering you to tackle real-world data tasks with confidence.

What is a CSV File?

A CSV file is a plain text file that stores tabular data, where each line represents a row, and columns are separated by a delimiter (usually a comma, but sometimes a tab or semicolon). For example:

name,age,city
Alice,25,New York
Bob,30,London

CSV files are simple, lightweight, and compatible with many applications, including spreadsheets (e.g., Excel) and databases. Python provides two main ways to work with CSV files:

  • The csv module: Built into Python, ideal for lightweight tasks and precise control.
  • The pandas library: A powerful tool for data analysis, perfect for handling large datasets and complex operations.

Reading CSV Files with Python

Using the csv Module

The csv module provides functions to read CSV files as rows of data. To read a CSV file, open it with the open() function and use csv.reader():

import csv

with open('data.csv', 'r') as file:
    reader = csv.reader(file)
    header = next(reader)  # Skip the header row
    for row in reader:
        print(row)  # Each row is a list

This code assumes data.csv exists and prints each row as a list of strings. For the example CSV above, the output would be:

['Alice', '25', 'New York']
['Bob', '30', 'London']

To access specific columns, index the row:

for row in reader:
    name, age, city = row  # Unpack the row
    print(f"Name: {name}, Age: {age}")

Using pandas

The pandas library simplifies CSV reading by loading the file into a DataFrame, a table-like structure ideal for data analysis:

import pandas as pd

df = pd.read_csv('data.csv')
print(df)

Output:

    name  age     city
0  Alice   25  New York
1    Bob   30   London

You can access columns, filter rows, or perform calculations:

print(df['name'])  # Access the 'name' column
print(df[df['age'] > 25])  # Filter rows where age > 25

Writing to CSV Files

Using the csv Module

To write to a CSV file, use csv.writer() to create rows. Open the file in write ('w') or append ('a') mode:

import csv

# Write to a new CSV file
data = [
    ['name', 'age', 'city'],
    ['Alice', 25, 'New York'],
    ['Bob', 30, 'London']
]

with open('output.csv', 'w', newline='') as file:
    writer = csv.writer(file)
    for row in data:
        writer.writerow(row)

The newline='' parameter ensures consistent handling of line endings across platforms. This creates output.csv with the specified data.

Using pandas

With pandas, you can write a DataFrame to a CSV file using to_csv():

import pandas as pd

# Create a DataFrame
data = {'name': ['Alice', 'Bob'], 'age': [25, 30], 'city': ['New York', 'London']}
df = pd.DataFrame(data)

# Write to CSV
df.to_csv('output.csv', index=False)

The index=False parameter prevents writing row indices to the file, keeping the output clean.

Practical Examples

Example 1: Reading and Filtering CSV Data

This example reads a CSV file containing student data and filters students older than 20.

Sample students.csv:

name,age,grade
Alice,19,85
Bob,22,90
Charlie,21,88

Code:

import pandas as pd

# Read CSV
df = pd.read_csv('students.csv')

# Filter students with age > 20
filtered = df[df['age'] > 20]
print("Students older than 20:")
print(filtered)

Output:

Students older than 20:
      name  age  grade
1      Bob   22     90
2  Charlie   21     88

Explanation: The pd.read_csv() function loads the CSV into a DataFrame, and df[df['age'] > 20] filters rows based on the age column.

Example 2: Creating a CSV File from User Input

This example prompts the user to enter data and saves it to a CSV file using the csv module.

Code:

import csv

# Collect user input
records = []
headers = ['name', 'age', 'city']
while True:
    name = input("Enter name (or 'q' to quit): ")
    if name.lower() == 'q':
        break
    age = input("Enter age: ")
    city = input("Enter city: ")
    records.append([name, age, city])

# Write to CSV
with open('user_data.csv', 'w', newline='') as file:
    writer = csv.writer(file)
    writer.writerow(headers)  # Write header
    for record in records:
        writer.writerow(record)

print("Data saved to user_data.csv!")

Explanation: The program collects user input in a loop, stores it in a list, and writes it to user_data.csv with headers. The newline='' parameter ensures proper formatting.

Best Practices for Handling CSV Files

  • Use with Statements: Always use with to open files, ensuring they’re closed automatically.
  • Handle Exceptions: Catch errors like FileNotFoundError or PermissionError:
try:
      df = pd.read_csv('data.csv')
except FileNotFoundError:
      print("File not found!")
  • Specify Encoding: Use encoding='utf-8' for files with special characters:
df = pd.read_csv('data.csv', encoding='utf-8')
  • Check Delimiters: If the CSV uses a delimiter other than a comma (e.g., ;), specify it:
df = pd.read_csv('data.csv', sep=';')
  • Use pandas for Large Files: For big datasets, pandas is faster and offers advanced features like filtering and grouping.
  • Validate Data: Check for missing or malformed data before processing:
if df.isnull().any().any():
      print("Warning: Missing values detected!")
  • Backup Files: When writing, consider backing up the original file to avoid data loss.

Conclusion

Handling CSV files in Python is a valuable skill for anyone working with data, from simple lists to complex datasets. The csv module offers lightweight, precise control for basic tasks, while pandas provides a powerful, flexible way to manage large datasets with ease. By learning to read, write, and manipulate CSV files, you can build applications like data loggers, report generators, or data analysis tools. Start with the examples in this guide, experiment with your own CSV files, and explore the capabilities of csv and pandas to unlock the full potential of your data. Happy coding!