Animal Re-Identification from Video

Abstract

Repository of annotated videos, images and extracted features of multiple animals <strong>1. Videos</strong> The videos are available in the file "videos.zip". The original videos included in this repository have been sourced from Pixabay under Pixabay License Free for commercial use No attribution required The video data is summarised below: <em>Short Name</em> <em>Video Name</em> <em># Frames</em> <em>Size</em> <em># Bounding boxes</em> <em># Identities</em> Pigs Pigs_49651_960_540_500f.mp4 500 ( 960, 540) 6184 26 Koi fish Koi_5652_952_540.mp4 536 ( 952, 540) 1635 9 Pigeons (curb) Pigeons_8234_1280_720.mp4 443 (1280, 720) 4700 16 Pigeons (ground) Pigeons_4927_960_540_600f.mp4 600 ( 960, 540) 3079 17 Pigeons (square) Pigeons_29033_960_540_300f.mp4 300 ( 960, 540) 4892 28 <strong>2. Annotated videos</strong> The annotated videos are available in the file "annotated_videos.zip": Annotated_Pigs_49651_960_540_500f.mp4. Annotation contributed by Lucy Kuncheva Annotated_Koi_5652_952_540.mp4. Annotation contributed by Lucy Kuncheva Annotated_Pigeons_8234_1270_720.mp4. Annotation contributed by Wilf Langdon Annotated_Pigeons_4927_960_540_600f.mp4. Annotation contributed by Frank Krzyzowski Annotated_Pigeons_29033_960_540_300f.mp4. Annotation contributed by Owen West <strong>3. Images</strong> The individual images are in the file "images.zip". For each video, all the images are in the corresponding folder. Inside, there is a folder for each individual with all the images. The filename of each image includes the frame number. <strong>4. Frames information</strong> The correspondence between images and frames in the videos are in the file "frames.zip" The prefixes "h1_" and "h2_" denote, respectively, the first and second halves of the videos. The columns on these files are: x, y: coordinates in pixels of the top left corner of the bounding box. width, height: of the bounding box in pixels. frame: frame number. max_w, max_h. label: the label (class) number. image: file name. <strong>5. Extracted features</strong> Files with the extracted features are in "features.zip". The prefixes "h1_" and "h2_" denote, respectively, the data corresponding to the first and second halves of the videos. Five representations are used: "RGB" moments. "HOG": Histogram of Oriented Gradients "LBP": Local Binary Patterns. "AE": AutoEncoders. "MN2": extracted from a Keras MobileNetV2 model pre-trained on Imagenet The representation appears as a postfix in the file names. In each csv file, each image appears as a row. The feature values followed by the label (class) number. <strong>6. Source code</strong> Sample code (matlab &amp; python) is available at https://github.com/admirable-ubu/animal-recognition