10.0 Data management#

Data management is a critical component of any project. Below are recommendations on file naming conventions and file structure to help manage remote camera data. Refer to the Remote Camera Survey Guidelines (RCSC et al., 2024) for additional information topics related to data management, including software platforms and tools to help camera users enter metadata as well as store, process and analyze image data.

10.1 Naming conventions#

It is highly recommended that users develop a set of naming conventions prior to entering data. Using naming conventions will minimize the risk of having images from different deployments, study areas, or surveys with the same name. Note that many metadata/data repositories (e.g., B.C. Metadata Standards [RISC, 2019], Wildlife Insights Minimum Metadata Standards [Ahumada et al., 2019], WildTrax) have required field formats and special character limitations.

Naming conventions are especially important for the following fields:

Refer to the Special characters section, as well as Appendix A - Table A2 for examples of recommended naming conventions.

10.1.1 Allowable formats & Special characters#

IDs (i.e., “Name” or “ID” field listed above) and file names should not have spaces or leading zeros. Additional restrictions on special characters are as follows:

  • Supported special characters: - _ :

  • Special characters NOT supported: , . / ( ) [ ] & # @ space

Alternative naming conventions may be used, but the goal should be to minimize duplication of IDs (and/or file names). Note that if you plan to use Timelapse2 (Greenberg, 2018), special characters for alphanumeric fields are further restricted to letters, numbers, “_”, and “-“.

10.1.2 Renaming images#

If you wish to rename your images, it is highly recommended that renamed images reflect the associated Image Name.

Data entry software can be used for batch processing of image names, which can significantly reduce data processing time compared to renaming images manually (e.g., Timelapse2 [Greenberg, 2018], Reconyx MapView [Reconyx, Holmen, WI, USA]) or other tools (e.g., WildCo Lab’s Image Renamer [WildCo Lab, 2021b]). Note that it is not always necessary to rename images. For example, renaming would not be required if data are stored in a folder structure that identifies the camera location and the survey from which it was collected.

10.2 File structure#

Image data ideally should be stored in a hierarchical structure as shown in (Figure 1). Each level would typically comprise a series of file subfolders containing data from the level below it (e.g., a project folder with study area subfolders, with each study area with survey subfolders etc.). For example, Figure 2 shows the file structure for a project that consisted of two study areas, each with one survey and each survey with two camera locations with one deployment period and two sequences per camera location.

However, this is often not the way we store this information in the form of CSVs (e.g., if there are only one or two study areas, it might not make sense to store this information in a separate CSV file). These metadata standards suggest a CSV structure similar to that of other metadata/data repositories (e.g., B.C. Metadata Standards [RISC, 2019], Wildlife Insights Minimum Metadata Standards [Ahumada et al., 2019], WildTrax) that consists of four CSVs associated with these metadata standards:

  • Project CSV

  • Sample Station/Camera Location CSV

  • Deployment CSV

  • Image/Sequence CSV (includes Event Type = “Tag”)

The information from each CSV can be linked using identifiers for each of the levels in the folder structure/hierarchy (refer to Figure 3) so that redundant information does not need to be repeated, and the chance of error is reduced. The connections between the levels and CSVs are also outlined in Appendix A - Table A2.

Refer to the Remote Camera Metadata Standards: Metadata Template v3 (RCSC, 2024) for the template CSVs and additional information.

../_images/Metadata_FolderStructure_2024-01-22.png

Figure 2. Example of the recommended file structure and naming conventions for a project that consisted of two study areas, each with one survey and each survey with two camera locations with one deployment period and 2 sequences per camera location.

../_images/Metadata_Links_CSV_Heirarchy_2024-01-22.png

Figure 3. The hierarchical structure of remote camera data in the Remote Camera Metadata Standards for Alberta (based on Forrester et al. [2016], Wildlife Insights Minimum Metadata Standards [Ahumada et al., 2019] and the B.C. Metadata Standards [RISC, 2019]) and the linkages with and within the four CSVs included in these metadata standards (“project CSV,” “Sample Station/Camera Location CSV,” “Deployment CSV,” and the “Image/Sequence CSV”).

10.5 Data storage (archival)#

It is strongly encouraged/may be required that remote camera datasets are submitted to an open data repository. There are regulatory requirements to submit data loadforms to the FWMIS database (not images, although this is strongly encouraged) according to specific policies (e.g., Sensitive Species Inventory Protocols, Research and Collection permits, etc.). A new FWMIS loadform consistent with these metadata standards will be available in August 2023. Refer to the Government of Alberta web pages for further information.

There are other cloud or server-based repositories available to house all camera datasets, including http://www.wildtrax.ca/WildTrax, eMammal (McShea et al., 2015), https://www.wildlifeinsights.org/Wildlife Insights (Ahumada et al., 2019) and others (see Young et al., [2018] for a comparison of 12 available programs for the management of camera data).

All data, including the images, deployment area photos and complete metadata, can be uploaded and stored in the WildTrax repository. WildTrax has multiple privacy options and can accommodate all categories of images that users may prefer to manage separately, including “false trigger” and images of humans.

Appendix 1 - Table A1 contains a crosswalk table linking the data fields from these Alberta Metadata Standards with those from the B.C. Metadata Standards (RISC, 2019), FWMIS, WildTrax and Wildlife Insights (Ahumada et al., 2019) data repositories.

Refer to the Remote Camera Survey Guidelines (RCSC et al., 2024) for more information on data storage.