2016/1/91 The Quantitative Assessment System of Animal Behavior based on Image Technology (Part 2)...

112/04/21 1

The Quantitative Assessment System of Animal Behavior based on Image

Technology (Part 2)

Presenter: Min-Ji Jan

Adviser: Dr. Pei-Jarn Chen

Date: 2010/11/24

以影像技術為基礎之動物行為量化評估系統(Part2)

112/04/21 2

Papers Review(1)Papers Review(1) Zhi-Wei Chou, “The Study of Animal Mutual Behavior Using

Embedded System”, I-Shou University.

System diagram

112/04/21 3

Papers Review(1)Papers Review(1) Experimental apparatus:

CCD camera FPGA: ALTERA FLEX1K100QC208 SDARM: Micron MT48LC32M8A2 video A/D converter(ADC): NXP SAA7113H video D/A converter (DAC): NXP SAA7121H MCU: ATMEL ATMEGA8515L

112/04/21 4

Papers Review(1)Papers Review(1)

Image file

Video file

Threshold

Object Detection

start

FrameScanning

1 、 Line ScanObject detection

2 、 Determine end of line scan

Determine end of frame

End

Flow chart:

112/04/21 5

Papers Review(1)Papers Review(1) Results

112/04/21 6

Papers Review(2)Papers Review(2) Yuan-Hsing Shih , Ming-Shing Young ,“Integrated digital

image and accelerometer measurements of rat locomotor and vibratory behaviour”, Journal of Neuroscience Methods.,166 (2007) 81–88.

Block diagram of the measurement system

112/04/21 7

Papers Review(2)Papers Review(2) Experimental apparatus:

Experimental cage: 45cm × 45cm × 40cm. Video camera: Samsung 510×492/EIA-pixel 380-

Tvline CCD image sensor. Capture card: PV147, Provideo Inc. Accelerometer: ADXL202JE

112/04/21 8


Results of image processing.

112/04/21 9

Papers Review(3)Papers Review(3) Yojiro Sakiyama , Tetsujo Sujaku, Akihiro Furuta, “A novel

automated method for measuring the effect of analgesics on formalin-evoked licking behavior in rats”, Journal of Neuroscience Methods, 167 (2008) 167–175.

112/04/21 10


112/04/21 11


112/04/21 12

Papers Review(4)Papers Review(4) HuanWang, Robert J. Spinner, EricJ. Sorenson, Anthony

J.Windebank, “Measurement of forelimb function by digital video motion analysis in rat nerve transection models”, Journal of the Peripheral Nervous System, 13:92–102 (2008).

A permanent marker was tattooed at five bony landmarks the distal third of the ulna. the ulnar head. the fifth metacarpal base. the MP joint. the proximal interphalangeal joint

MP(metacarpophalangeal):掌骨指骨

112/04/21 13


Experimental apparatus: Transparent runway:101cm × 10cm × 30cm.

Mirror: at a 45 angle below the track.

Digital camera: Fastened on a tripod placed 1 m away from the runway. Level with and perpendicular to the runway.

112/04/21 14


112/04/21 15


112/04/21 16

Materials and MethodsMaterials and Methods

System architecture diagram

112/04/21 17

Materials and MethodsMaterials and Methods Experimental apparatus:

Camera: Sparrow IEEE 1394b IMS-130 CR. MAVIS IEEE 1394a IM-100.

Image capture card: 1394a, 1394b. Animal cage: 80cm × 80cm × 60cm. PC: CPU is 2.5GHz and RAM is DDRII 800

2.00GB. Software: C++ Builder6, opencv1.0.

112/04/21 18

Materials and MethodsMaterials and MethodsStart

Gray & Threshold Color Threshold

Morphology operated

Object Detection

Top angle Side angle

Morphology operated

Object Detection

Draw the behavior line Draw the line of

the leg joints

calculated the angle between the leg

joints

Flow Chart

112/04/21 19

Materials and MethodsMaterials and Methods Analyzed the image for top angle

An image is processed by setting a grey level threshold.

The threshold image is obtained by Morphology process.

112/04/21 20

Materials and MethodsMaterials and Methods Analyzed the image for top angle

Center tracking cvFindContours cvBoundingRect

112/04/21 21

Materials and MethodsMaterials and Methods Analyzed the image for side angle

Color markers Markers for the use on hind paw should be well discriminated

from other limbs, tail, body and background.

Yojiro Sakiyama , Tetsujo Sujaku, Akihiro Furuta, “A novel automated method for measuring the effect of analgesics on formalin-evoked licking behavior in rats”, Journal of Neuroscience Methods, 167 (2008) 167–175.

112/04/21 22


An image is processed by setting a color threshold. The threshold image is obtained by Morphology

process.

112/04/21 23


The four feet joints marks Center tracking cvFindContours cvBoundingRect

112/04/21 24


Calculated the angle between the leg joints

xabbac cos2222

A

B C

a

b

c

x

abcbax 2/cos 222

112/04/21 25


Calculated the angle between the leg joints

The angle between the red and green line:90° The angle between the green and blue line:47°

112/04/21 26

Sedý J, Urdzíková L, Jendelová P, and Syková E, “Methods for behavioral testing of spinal cord injured rats”, Neuroscience and Biobehavioral Reviews., 32: 550–580, 2008.

Yuan-Hsing Shih, and Ming-Shing Young, “Integrated digital image and accelerometer measurements of Rat locomotor and vibratory behavior” Journal of Neuroscience Methods., 166: 81–88, 2007.

Ming-Wen Chang, Ming-Shing Young, and Mao-Tsun Lin, “An inclined plane system with microcontroller to determine limb motor function of laboratory animals” Journal of Neuroscience Methods., 168: 186–194, 2008.

Ming-Wen Chang, Ching-Ping Chang, Ying-Chieh Weia, Shang-You Hou,Ming-Shing Young, and Mao-Tsun Lin, “A force plate measurement system to assess hindlimb weight support of spinal cord injured rats” Journal of Neuroscience Methods., 189: 130–137, 2010.

Yojiro Sakiyama, Tetsujo Sujaku, and Akihiro Furuta, “A novel automated method for measuring the effect of analgesics on formalin-evoked licking behavior in rats” Journal of Neuroscience Methods., 167: 167–175, 2008.

HuanWang, Robert J. Spinner, EricJ. Sorenson, and Anthony J.Windebank, “Measurement of forelimb function by digital video motion analysis in rat nerve transection models” Journal of the Peripheral Nervous System., 13: 92–102, 2008.

ReferencesReferences

2016/1/91 The Quantitative Assessment System of Animal Behavior based on Image Technology (Part 2)...

Documents

Transcript of 2016/1/91 The Quantitative Assessment System of Animal Behavior based on Image Technology (Part 2)...