Versions Compared

Old Version 2

changes.mady.by.user Antony Scott

Saved on

compared with

New Version Current

changes.mady.by.user Antony Scott

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Working with
Numberedheadings
h3, h4
number-formatdecimal
skip-headingsHNaN
start-numbering-with2
h1[h1.decimal]
start-numbering-with2
h2.[h1.decimal].[h2.upper-latin]
h3
h4
h5
enabledtrue
h6
start-numbering-atH1

Vector Data in QGIS

Vector data provides a way to represent real world features within the GIS environment. A feature is anything you can see on the landscape.

QGIS can open over 60 file-based data formats (using the OGR library), including ESRI shapefile and MapInfo TAB. It can also connect to spatial database sources including PostgreSQL, SpatiaLite, Oracle, and MSSQL), to Web Feature Service (WFS) and Point Cloud data, and to Arc REST services. QGIS’s default file format is GeoPackage, a file-based database. Most QGIS functionality is available for all vector data sources, though some formats are read-only mode and need to be saved to another format for editing.

In this exercise you will learn how to work with data from different sources.

Vector Data Sources

GeoPackage

GeoPackage is an OGC standard data format. It has a .gpkg file extension, and it can hold one or many layers, including non-spatial and raster data, and can also store QGIS projects.

Load GeoPackage

MapInfo: add aonb_wales.mif in the same way

  1. All vector data is in ...\QGIS Training\Data\vector - right-click on the Favorites icon in the Browser panel to add this location for quick access

  2. Open the project from the previous exercise

  3. Using the Data Source Manager button, add file-based vector data by clicking the Vector tab on the left and browsing to the file

  4. Click Add to load the aonb_england.gpkg GeoPackage layer

  • Shapefile: add wind_turbines_point.shp by double clicking or right-click to bring up the list of options

    1. Click Close to close the dialog and view the layer

    ESRI Shapefile

    Shapefile is a widely-used legacy format , developed by ESRI, used on many download sites. Shapefiles comprise four or more individual files on disk - all must be available for the file to open.

    Load Shapefile

    1. Use the Browser to navigate to wind_turbines_point.shp in the vector folder (it’s in D:/PhotonUser/My Files/Home Folder/QGIS Training/Data)

    2. Double-click on the file to load it into the

    map

    1. Layers panel, then right-click > Zoom to Layer(s) to show the layer on the map

    2. Right-click on the layer in the Browser to see the other options available

    MapInfo

    QGIS can open both MIF and TAB files - these will appear in the browser with other file-based data. Note that MapInfo files can contain multiple geometry types, so QGIS may present a dialog with a choice of geometry types - i.e. line, polygon, point - to load.

    Load MapInfo

    1. Load the aonb_wales.mif

     layer

    1. file

    Excel

    QGIS will open an Excel file as vector data, and will normally recognise data types (for example string, integer, date). If the data includes coordinates, creating there is an extra step you need to create a geometry column which QGIS can use to represent the data spatially requires an extra step..

    Load Excel

    1. Add RTC Location 2017_0.xlsx, using the Vector tab in the Data Source Manager

    2. Note that the data appears as a table in the Layers panel at this point - nothing is on the map

    3. To turn the coordinates into points, use the Search box (in the lower left corner) to find the Create points layer from table process

    4. Complete the

    dialogue

    1. dialog as follows and run the process - this will create a new spatial layer on the map

    Database Layers

    Loading database To load vector layers follows a slightly different process to loading a file-based layer, as from a database, you first need to establish a database connection. The process is similar for all databases, but in this example we will use data in a PostGreSQL PostgreSQL database.

    Database layers

    You can load either spatial or non-spatial data from a database - the non-spatial data will be shown in QGIS as a table, which you can join to spatial data as shown below.

    To load data from a PostGreSQL database:

  • Click Open Data Source Manager

  • Click the PostgreSQL tab

    • If you haven't connected to the database before, click New to create a new database connection

  • Complete the dialog:

    1. Name: your name for the connection

    2. Host: the name or IP address of the server the database is running on

    3. Port: the port the database is running on - by default in PostGreSQL this is 5432, but it could be different

    4. Database: the name of the database you want to connect to

    • Under Authentication, click the Add button to add your credentials

  • The first time you do this, you will be prompted for a Master password - make sure this is something you can safely store or remember, as it cannot be retrieved later

    • Once you have done this, you will be able to set the credentials for this connection:

  • Click Save to save these credentials, then click Test Connection to make sure the connection is OK

    • If all is well, click OK, then click Connect to establish the connection with the database

  • Expand the database schemas, and select a table and click Add to add it to the map

  • Check Also list tables with no geometry to view non-spatial data tables

    • Once the data is loaded in the Layers panel, it will behave in the same way as file-based vector layers. You only need to set up the connection once - after that, you can connect to the database from the PostGreSQL table in the Data Source Manager, or from the Browser tab.

    1. Create a connection to the training_qgis database on the appstream_data.astuntechnology.com server using Data Source Manager > PostgreSQL > New

    2. Complete the connection details as shown in the screenshot below, using the Basic tab under Authentication - note the user credentials are qgis/qgis (click Store)

    3. Click Test Connection to make sure you can connect to the database - if successful, you will see a confirmation message

    4. Click OK, then Connect to open the connection

    5. Close the Data Source Manager dialog, then using the Browser pane, navigate to PostGIS > QGIS Training > boundaryline > county_region and double-click on the layer to add to the map

    Web Feature Service (WFS) Layers

    Data available in OGC Web Feature Service (WFS) format can be loaded in QGIS and used in a similar way to any other vector layer. However as the data is online, , as long as you have an Internet connection is required, although once the connection has been made it data can be saved locally . WFS data is supplied as GML, and features can be selected, styled and queried in the same way as any other vector data. 

    Create a new saved WFS Connection 

    Open

    The first time you use a WFS source, you will once you are connected. So first of all you need to create a connection:

    Click

    .

    Load WFS

    1. Create a new WFS connection using Data Source Manager

    , then the WFS tabClick New, then in the Create a New WFS Connection dialog, add the connection details.

  • Name: your name for the connection

    • URL: the URL of the WFS, for example http://essex.astuntechnology.com

    1. > WFS > New

    2. Open Chrome in AppStream, and go to https://data.gov.uk and search for conservation areas in Carlisle, then right click on Download to copy the link, and paste to the URL field in the dialogue below  - it should be http://maps.carlisle.gov.uk/getows.ashx?mapsource=

    Essex

    1. CCC/

    Inspire_Colchester

    1. inspire&TypeName=

    allotment

    1. conservation_areas&version=1.1.0&request=GetFeature&service=WFS

    Authentication: complete as required

    1. (you can also paste from here)

    2. Click OK

    .

    1. then Connect

     to the WFS 

  • Select the saved WFS

    • Click Connect to show the layers available in the WFS

  • Select the layer(s) required - you can select multiple layers

  • Click Add to load the layer(s) into the map

  • Note that with large datasets, it can take some time for the layers to load

    • WFS Queries

    • By default, only features within the current view extent will be downloaded - uncheck Only request features overlapping the view extent to load all features from the source

    • To load only a subset of features (other than by extent), click Build query to bring up the SQL Query Composer, and add a query to select the features you need

    Once WFS layers are loaded, they can be managed in the same way as other vector layers.

    Transactional Web Feature Service (WFS-T) layers, which are editable, are also supported in QGIS.

    Navigating Vector Layers

    There are different approaches to navigating around the layers you have loaded, for example using toolbars, mouse actions and menus - some of the key ones are listed here.

    The buttons in the Map Navigation Toolbar will also get you around the map, and change the action of your mouse and cursor - these will help you identify the data and views you need.

    View Layer Extents

    When a layer has been added to the Layers panel, the features will be visible in the map frame on the right. To see the whole layer in the frame:

    1. Click on the layer to select it

    2. Right-click > Zoom to Layer (or click the icon on the toolbar)

    Attribute Table

    You can browse the attribute data for each layer by right-clicking on the layer and selecting Open Attribute Table, (or click the  icon in the toolbar). 

    Manage the Layer List

    Normally, layers at the top of the list in the Layers panel appear on the map in front of layers further down the list. You can change the order of layers in the list by dragging and dropping layers to a new position.

    Group Layers 

    Layers can be grouped to create a hierarchical layer list, or table of contents.

    Click the Add Group button at the top of the Layers panel 

  • Right-click and Rename the new group

  • Drag and drop layers into the group 

    • Remove Layers

    To remove a layer from the list, select the layer, then Right-click > Remove. This does not delete the data, just removes it from the map. However you will lose any styling or queries you have applied to the layer.

    Joining Layers

    If you want to use data in your map which has no spatial references

    1. Click on the layer you want to load, then Add and Close

    2. The layer will be added to the map

    Attribute Table

    Attribute tables hold the data which sits behind every layer.

    Open Attribute Tables

    1. Right-click > Open Attribute Table on one of the layers you have open, and see how the data in the attribute tables relates to the features on the map (you may need to use the Panel Switcher to find the table)

    2. Select an feature in the attribute table by clicking on the row number  on the left - it will be highlighted ('selected') in the table, and will also be selected in yellow on the map

    3. When you have a feature selected, use the Zoom to Selection button in the attribute table toolbar to navigate to the feature on the map

    4. Click on a column header to sort the table using that column

    Join Layer to Non-Spatial data

    If you want to use data which has no spatial references in the map, you will need to join this to a corresponding spatial dataset. For In this example, you might have population we have Index of Multiple Deprivation (IMD) data for census areas (LLSOAs), and a polygon layer of the census areas themselves, and you want to LLSOAs themselves - we will join the two in order to show the population IMD figures for each areas as a label.

  • Add the non-spatial data table, and the spatial layer you are joining it to, as described earlier

  • The new table will appear in the Layers panel, but not on the map

  • Double-click the spatial layer to bring up the Properties dialog, and select the Joins tab

    • Click the Add button bottom left to add a join

    In the Add Vector Join dialog, use the dropdowns to specify:

  • Join layer: the layer you want to join to the current one

  • Join field: the field in the target layer (the one you are joining to) that is going to be used for the join (this might be ID, for example, or name, or in the case below, neighbourhood)

    • Target field: the field in the current layer (the spatial one) which is going to be used for the join - this must contain the same data as the join field

  • Click OK and OK again, then check the attribute table of the spatial layer - it will have an expanded number of columns to include the data from the non-spatial table

    • Join definition

    The join definition

    Join Layers

    1. Open IMD2019_Index_of_Multiple_Deprivation.xlsx  selecting the IMD2019 sheet

    2. If it’s not already loaded, load the llsoa_dec_2011_england_wales_ne layer from the LLSOA_Dec_2011_England_Wales GeoPackage

    3. Open the attribute tables for both IMD2019  and llsoa_dec_2011_england_wales_ne and compare the data

    4. Notice that LSOA code (2011) in the the spreadsheet layer uses the same data as code in the spatial layer

    5. Select  llsoa_dec_2011_england_wales_ne and right-click > Properties > Joins, and press the green + button to add a join

    6. Select the target spreadsheet layer and the correct columns to match the two layers, then click OK

    7. Open the attribute table of llsoa_dec_2011_england_wales_ne to ensure the data has been joined correctly

    8. If you have time and you know how, add the IMD Rank as a label to each LLSOA, and apply a Graduated style to the joined data using the Rank attribute, or a Categorised style using the Decile attribute (this will be covered in more detail in a later module)

    9. Save the project

    The join you have just created is saved in memory, and is saved in the QGIS project - it does not affect the source data

    . It will therefore reflect

    , but it will be updated with the current data each time the project is loaded.

    You can edit the join after it has been created - for example to exclude fields from the joined data - in the same dialog you used to create it.

    Exporting Vector Data

    To export a layer or part of a layer:

    Right

    Exporting Vector Data

    Any of the vector formats you have been using can be exported into most other formats, including CSV and GeoPackage.

    Export Data

    1. Click on the layer to be exported, then right-click > Export > Save Features as

     from the layer

    2. In the dialog,

    you can simply save the file as a different name - however you can also use other options

    1. options include:

      1. Format: save the data in a different vector format

      2. File name: browse to the location where you want the file to be saved, and give it a name

      3. Layer name: for a GeoPackage, by default this will be the same as the file name, but you can change it (GeoPackages can contain many layers)

      4. CRS: reproject the data on save to a different CRS

      5. Save only selected features: save a subset of the features

    CRS: reproject the data on save to a different CRS

      1. based on a selection you have already made

      2. Select fields to export: save a subset of fields from the attribute table

      3. Extent: save only features visible in the current extent

    Exporting a joined layer

    1. Use the remaining time in the exercise to try a few of these options

    Note that If you export a layer with a join, the exported data will include the fields in the join - this is a way of creating a permanent new dataset from a joined layer, although from this point on it won’t be updated if the source layers change.