Saturday, August 19, 2017

Read zipped csv files in python pandas without downloading zipfile

Here is a python program to read zipped csv files
------------------------------------
import requests
import io
import zipfile
import pandas as pd
#use a modern browser version name: Firefox/54.0.1
header = {'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:32.0) Gecko/20100101 Firefox/54.0.1',}
remotezip = requests.get(url, headers=header)
root = zipfile.ZipFile(io.BytesIO(remotezip.content))
for name in root.namelist():
            df = pd.read_csv(root.open(name))

No comments:

Post a Comment