Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line...

36
KYOTO UNIVERSITY 京都大学 Bio-Sensing Engineering Naoshi Kondo Laboratory of Bio-Sensing Engineering Graduate School of Agriculture Kyoto University, Japan Fluorescence Phenomenon on Agricultural Products

Transcript of Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line...

Page 1: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Bio-Sensing Engineering

Naoshi Kondo

Laboratory of Bio-Sensing Engineering

Graduate School of Agriculture

Kyoto University, Japan

Fluorescence Phenomenon on Agricultural Products

Page 2: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

来週までのレポート

農産物の蛍光物質についてどのようなことに利用できるか(品質評価,鮮度評価,異物検査,腐敗防止,光合成の活性度,化学薬品の検査),学んだことを例を挙げてレポートしなさい

Page 3: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

Spectroscopy

Various type of light-matter interaction

Page 4: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

Why Fluorescence and what we can detect with Fluorescence Spectroscopy?

• In general fluorescence emitted by compounds with benzene ring or conjugationsystem in their molecular structure

• Many bio-products are containing fluorophore• Fluorophore could be used as a marker for bio-products content, time series

changes, and physical characteristics.• Interaction of fluorescence phenomenon with other light-matter phenomenon

Beta carotene

CoumarinChlorophyll

Page 5: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Image PC

HostPC

180°Turn over

Image PC

TV Camera Lighting Device

X-ray generator

Scintilator

Imaging PC

JudgementPC

Trigger sensor

Spectrometer

Halogen lamp

Typical Fruit grading system

Page 6: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

A Color TV camera-Double LED system

White LED

device

Camera

UV LED device

PC

White LED

device

White LED

device

UV LED device

UV LED device

Page 7: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Rotten Fruit

Slight injury, but possibility to be rotten

White Light UV Light

Fluorescence

Fluorescence Image

Page 8: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Pin hole Rot Grow rotten area Mold Influence

Other fruits

Slight injury makes all fruits in a box spoil

2 weeks1 week

Separate slight injury fruits from healthy fruits

Before storage

Page 9: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Top view of the image acquisition system on an

practical grading line (Shibuya Seiki)

Page 10: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

Separated rotting fruits in several hours

Shibuya Seiki

Page 11: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Autonomous controlled drone

Page 12: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

Dark part

Scute (Placoid scale, Shield shape scale)

Horse Mackerel (fish name)

Page 13: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Ishida

Parasite worm (Anisakis) detection

Page 14: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

3.2 t/h

Applicable to Grain Sorter

ColorCamera

Grain Guide

Background

Color/NIRCamera

Light (CCFL)

NIR LED

Bad grain Good grain

EjectorNozzle

Possibility to

separate by FL

Satake

Page 15: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Activities of Fluorescence Substances

Excitation

280 nm

230 nm

Page 16: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Flavonoid change

0

1

2

3

4

4 6 8 10 12 14 16 18 20Inte

nsity R

atio

Ex 2

80

/Ex 2

30

Day After Harvest

Intensity Ratio Flavonoids Exocarp

Ex 280/Ex 230

Stored in 4 C

Stored in 20 C

(Yang et al.,2011, total flavonoid in green peppers increased during storage)

Freshness index?

Page 17: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Photosynthesis activities in Periwinkle (plant name)

FL. Intensity of shady

leaves is higher

Hidden part of leaf is higher

Page 18: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Family of cucumber plant

Disease white dots are

highlighted Yellowish weaken

leaves are low intensity

Greenish healthy leaves

are high intensity

Page 19: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

Induction method to assess the

photosynthetic function in tomato plant

Time (s)

Ch

l flu

ore

sce

nce

inte

nsity

(r.u

.)

1 10 100

Light on

I D

P

S

M

T

Excitation light intensity

P/S

M/S

Chl fluorescence induction

Courtesy of Prof. Takayama, Ehime Univ.

Page 20: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

1.5

m

0.6 m

CFI robot for practical use

0.6 m

CCD camera120°2.1m

Tomato plant

PC

CCD

camera

Automatic

operation cart

Blue LED for

excitation light

Chl fluorescence

image

Iseki Co., Ltd.: by courtesy of Prof. Takayama, Ehime University

Page 21: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

Applicable to seedling production robots

Grafting robot

Cutting sticking robot

Transplanting robot

BRAIN

Page 22: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Collaboration research: Tea leaves fluorescence Kyoto Prefectural Tea Industry Research Institute

Page 23: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Chemical detection

Possibility of

chemical residues

detection

Rotting

Actively add fluorescence substance to spreading agent

Page 24: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

Fertilizers

Chemical Fertilizer

N-P-K=14-10-13

Chemical Fertilizer

N-P-K=14-2-16

Lime

Organic fertilizer

(Cattle manure) Greenish

Blueish

Reddish

Page 25: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

Measurement Box

Power source, PC,

Spectroscopy,

PLC, amp board

Antenna of

DGPS

Chisel

(sensor

probe

housing)

※ Date: 2004. 11. 21 Depth: 150mm, Speed: About 30cm/ sec

Cooperation with SHIBUYA MACHINERY CO.,LTD., TUAT

Commercialized Real time soil sensor

Applicable to soil sensor

Shibuya

Page 26: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Arrangement of Sensors in chisel

Illumination fiber

EC Electrode

Laser Displacement

sensor Color cameraCondensed

fiberGround surface

Soil flattener

Courtesy of Prof. Shibusawa, TUAT

Page 27: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Effect of fertilizer treatment on carrot fluorescence

Chemical fertilizer Organic fertilizer

Page 28: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Effect of fertilizer treatment on carrot fluorescence

Chemical fertilizer Organic fertilizer

Page 29: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

Moisture

Content

NO3-NSOM

pH EC

Real-time soil sensor

N, EC, pH, moisture content, SOM,

soil temperature, compaction

Maps from Soil Sensor

By courtesy of

Prof. Shibusawa, TUAT

Page 30: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

Tomato Freshness Monitoring Day 1 3 7 9 11 15

Color

image

UV

image

0

5

10

15

0 5 10 15 20

PW

L

Day

Spoilage limitFRESH

SPOILED

UV image color channel Physiological Weight Loss during storage

0

50

100

150

200

0 5 10 15

HS

V

Day

hue saturation value

Nurulhuda et al. (2017)

Page 31: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

Fish eye fluorescence

Day 0

Day 0

Day 3

Day 3

Day 6

Day 6

Peak A

Peak C

Peak B

Page 32: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Collaboration research: Olive oil authentication and quality evaluation

Color image (halogen lamp) and FL image (Ex: 365 nm)A: Coratina; B: Chieti; C: Virgin OO; D: Taggiasca; E: Bosana; F: Unknown, unfiltered;

G: Monte Etna; H: Ogliarola; I: Mix, Coratina, Ogliarola, Signora

Collaboration with University of Molise, Italy

Page 33: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Kyoto University Project “SPIRITS” Construction of Database of Fluorescence Properties in Asian Agriculture,

Livestock, and Aquaculture for 9 Billion People’s Food Production

2. Quality measurement

1. Reduction of the post-harvest loss

Accumulation to DBTemperate Zone

Tropical Zone

(Supporting Program for Interaction-based Initiative Team Studies)

Page 34: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Kyoto University Project on Fluorescence Construction of Database of Fluorescence Properties in Asian Agriculture,

Livestock, and Aquaculture for 9 Billion People’s Food Production

Temperate Zone

Tropical Zone

2. Quality measurement

3. Food safety

4. Plant production control

5. Chemical tracking

1. Reduction of the post-harvest loss

Accumulation to DB

Kyoto Univ.

University

Res. Institute

Res. Institute

University

Company

Res. Institute

Company

Company

Res. InstituteProducts in AgricultureLivestockAquaculture

Properties of Fluorescence

the World Food

Production

Contribution to

DBJoin the members to accumulate Fluorescence Data

20/42

Page 35: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

KYOTO UNIVERSITY京都大学

Page 36: Bio-Sensing Engineering...Top view of the image acquisition system on an practical grading line (Shibuya Seiki) Separated rotting fruits in several hours Shibuya Seiki KYOTO UNIVERSITY

Roles of Grading Facility and Sensors

1. Efficient sorting, and labor saving

2. Uniformization of fruit quality

3. Enhancing market value of the products

(Establishing local region brand of products)

4. Fair payment to producers based

not only on quantity but on quality of each fruit

5. Farming guidance from grading results and GIS

6. Contribution to the traceability system

for food safety and security

7. Saving the food loss

Producer Operator Distributor Consumer