Step 1 - Pre-Process AddressBase Premium CSV files

A relatively small Python script has been built to process all the ZIP files of CSV - about 5.5Gb.  You will also need about 37Gb for the combined CSV output files.

1. Copy ALL Zip files to a folder - they can be in different sub folders, the script will recursively walk through.
2. Create an OUTPUT folder that will have the combined OUTPUT CSV files.
3. Copy the addressbase_csv.ini and Python addressbase_csv_import.py script to a Python folder.
4. Edit the addressbase_csv.ini file to specify your dataFolder (point 1) and your outputFolder (point 2)

#####
# extractor settings
#####
[data]
# location of the CSV file ZIPs
dataFolder = /home/[user]/addressbase_epoch24
#where to put the output CSV files
outputFolder = /home/[user]/addressbase_epoch24/output
#####
# Notification email settings
#####
[notification]
mailto = [to-email]
gmail_user = [from-email]
gmail_pwd = [password]
smtpserver = [servername]
#####
# Database credentials for database
# which will hold coordinates and metadata
#####
[database]
pgdbname = osmm1231
pghost = [postgresql_server_address]
pgport = [postgresql_server_port]
pguser = [postgresql_username]
pgpassword = [postgresql_password]

Go to to a command prompt, navigate to the Python folder and run the following:

python addressbase_csv_import.py

You will now have a folder with the following output files: