Camera-based 3D-measuring helping in the assessment of cow ... · Noora Ruuskanen¹, Matti...

11
Camera-based 3D-measuring helping in the assessment of cow body structure ERIAFF Conference 12.6.2018 Seinäjoki Noora Ruuskanen¹, Matti Kurkela², Minna Toivonen³, Mikko Maksimainen², Juho-Pekka Virtanen², Hannu Hyyppä², Eija Latomki³, Mari Mukka-Koivumki³, Teija Rnk¹, Marika Ahlavuo², Jussi-Matti Kallio¹ 1) Seinäjoki UAS, Food and Agriculture, etunimi.sukunimi@seamk . 2) Aalto University, PL 14100, 00076 AALTO etunimi.sukunimi@aalto. 3) Faba osk, PL 40, 01301 Vantaa. etunimi.sukunimi@faba.

Transcript of Camera-based 3D-measuring helping in the assessment of cow ... · Noora Ruuskanen¹, Matti...

Page 1: Camera-based 3D-measuring helping in the assessment of cow ... · Noora Ruuskanen¹, Matti Kurkela², Minna Toivonen³, Mikko Maksimainen², Juho-Pekka Virtanen², Hannu Hyyppä²,

Camera-based 3D-measuring helping in the assessment

of cow body structure

ERIAFF Conference 12.6.2018 Seinäjoki

Noora Ruuskanen¹, Matti Kurkela², Minna Toivonen³, Mikko

Maksimainen², Juho-Pekka Virtanen², Hannu Hyyppä², Eija Latomaki³,

Mari Mukka-Koivumaki³, Teija Ronka¹, Marika Ahlavuo², Jussi-Matti

Kallio¹

1) Seinäjoki UAS, Food and Agriculture, etunimi.sukunimi@seamk.

2) Aalto University, PL 14100, 00076 AALTO etunimi.sukunimi@aalto.

3) Faba osk, PL 40, 01301 Vantaa. etunimi.sukunimi@faba.

Page 2: Camera-based 3D-measuring helping in the assessment of cow ... · Noora Ruuskanen¹, Matti Kurkela², Minna Toivonen³, Mikko Maksimainen², Juho-Pekka Virtanen², Hannu Hyyppä²,

About funding and partners

Project carried out 12/2016-5/2018

Project partners Seinäjoki UAS, Aalto University and Faba

Funded by Europan agricultural fund, Leader-group Liiveri, Faba and farmers

Page 3: Camera-based 3D-measuring helping in the assessment of cow ... · Noora Ruuskanen¹, Matti Kurkela², Minna Toivonen³, Mikko Maksimainen², Juho-Pekka Virtanen², Hannu Hyyppä²,

Why use 3D measuring?

- Precision farming is making it’s way to animal husbandry, and 3D measuring is one of potential ways to monitor animals

- Project focused on finding out possibilities to do 3D measuring of dairy cows on farmconditions

Main interests of the project:

- Can 3D models give useful information of body condition score and cow body structure?- Could 3D models be useful to breeding specialists?- Could veterinarians use 3D models to monitor animal health?- How farmers could use models to prevent diseases, improve animal welfare and developtheir farms?

Page 4: Camera-based 3D-measuring helping in the assessment of cow ... · Noora Ruuskanen¹, Matti Kurkela², Minna Toivonen³, Mikko Maksimainen², Juho-Pekka Virtanen², Hannu Hyyppä²,

Some challenges

Could 3D measuring be used to monitor cow’s health and body structure?

Does the fur texture or the color of cows affect measuring results?Image capturing must be done with many cameras the same time to get exhaustive resultsCapturing has to be done in a short period of time (animals move)How to ensure animal welfare during capturing? (no stress)

All barns are different, cows are curious and to move in groups

Page 5: Camera-based 3D-measuring helping in the assessment of cow ... · Noora Ruuskanen¹, Matti Kurkela², Minna Toivonen³, Mikko Maksimainen², Juho-Pekka Virtanen², Hannu Hyyppä²,

Equipments

- Multi camera system developed by Aalto university- Structure depth camera- Both equipment were tested first in Ilmajoki schoolbarn.

After few adjustments another tests on five differentdairy farms on South Ostrobothnia region.

Page 6: Camera-based 3D-measuring helping in the assessment of cow ... · Noora Ruuskanen¹, Matti Kurkela², Minna Toivonen³, Mikko Maksimainen², Juho-Pekka Virtanen², Hannu Hyyppä²,
Page 7: Camera-based 3D-measuring helping in the assessment of cow ... · Noora Ruuskanen¹, Matti Kurkela², Minna Toivonen³, Mikko Maksimainen², Juho-Pekka Virtanen², Hannu Hyyppä²,

What did we do..

All the barns were different:- Artificial and natural light- Bedding materials- General layout - Milking techniques

- Cameras were used in different styles on each farm- Animals were very curious about the cameras and people using them!

Page 8: Camera-based 3D-measuring helping in the assessment of cow ... · Noora Ruuskanen¹, Matti Kurkela², Minna Toivonen³, Mikko Maksimainen², Juho-Pekka Virtanen², Hannu Hyyppä²,

kuvia

Page 9: Camera-based 3D-measuring helping in the assessment of cow ... · Noora Ruuskanen¹, Matti Kurkela², Minna Toivonen³, Mikko Maksimainen², Juho-Pekka Virtanen², Hannu Hyyppä²,

Results

-You actually can make a 3D model of cows!

- Best place for cameras are either on milking robot or in the exit gate of milking parlour- Rails and fences could be a problem- Curious animals block the ways around the cameras- Dirt and dust are problematic to optical devices

- 3D models uploaded to website for observation

Page 10: Camera-based 3D-measuring helping in the assessment of cow ... · Noora Ruuskanen¹, Matti Kurkela², Minna Toivonen³, Mikko Maksimainen², Juho-Pekka Virtanen², Hannu Hyyppä²,

Results

- 3D models uploaded to website for observation

Page 11: Camera-based 3D-measuring helping in the assessment of cow ... · Noora Ruuskanen¹, Matti Kurkela², Minna Toivonen³, Mikko Maksimainen², Juho-Pekka Virtanen², Hannu Hyyppä²,

Whats next?

- Developing camera systems : automatic image capturing, wireless data transfer- Automatisation of constructing models from images- Long term experiments: time series, observation of changes- Other sensors?

Some challenges- Ownership of data and integration of different data sources- Where to focus? Thermal imaging, imaging movement or only a specific part of animal?