Human Generated Data

Title

Untitled (picking tea leaves)

Date

1870s-1880s

People

Artist: Raimund von Stillfried-Ratenicz, Austrian 1839 - 1911

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Tassel and Janet Tassel, P2004.84

Human Generated Data

Title

Untitled (picking tea leaves)

People

Artist: Raimund von Stillfried-Ratenicz, Austrian 1839 - 1911

Date

1870s-1880s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.3
Human 99.3
Person 99.1
Person 98.4
Outdoors 97.3
Nature 92.6
Clothing 87.2
Apparel 87.2
Helmet 87.2
Art 85.6
Plant 84.8
Countryside 78.1
Garden 72.8
Painting 66.3
Soil 63.5
Gardener 61.9
Worker 61.9
Gardening 61.9
Hat 61.3
Wood 59.2
Ground 58.2
Rural 57.1
Brick 56.7
Harvest 56.6

Imagga
created on 2022-01-08

barrow 28.8
vessel 25.7
outdoors 25.4
child 23.9
container 22
handcart 21.6
bucket 21.5
grass 19
people 18.9
wheeled vehicle 17.6
male 17.1
boy 16.5
happy 16.3
man 16.1
garden 15.9
summer 15.4
outside 15.4
kid 15.1
percussion instrument 14.2
person 13.7
two 13.5
fun 13.5
rural 13.2
country 13.2
vehicle 13.1
cute 12.9
old 12.5
musical instrument 12.3
smile 12.1
drum 11.9
farm 11.6
family 11.6
outdoor 11.5
mother 11.4
autumn 11.4
together 11.4
cheerful 11.4
adult 11.2
happiness 11
little 10.6
pretty 10.5
sitting 10.3
day 10.2
lifestyle 10.1
countryside 10
work 10
field 10
children 10
hat 9.9
vacation 9.8
portrait 9.7
agriculture 9.6
gardening 9.5
sunny 9.5
love 9.5
smiling 9.4
house 9.2
joy 9.2
park 9.1
bench 8.9
women 8.7
play 8.6
daughter 8.6
parent 8.5
food 8.4
attractive 8.4
leisure 8.3
playing 8.2
childhood 8.1
home 8
working 7.9
holiday 7.9
wall 7.7
expression 7.7
toddler 7.6
pot 7.6
lawn 7.5
kids 7.5
basket 7.5
brown 7.4
teen 7.3
water 7.3
decoration 7.3
jug 7.3
fall 7.2
spring 7.1
travel 7
father 7
rustic 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

clothing 95.2
person 90.9
outdoor 87.3
human face 78.9
toddler 73.4
cartoon 69
text 66.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-46
Gender Male, 70.8%
Calm 39%
Confused 32.1%
Sad 19.7%
Fear 2.9%
Disgusted 2.1%
Angry 1.8%
Surprised 1.6%
Happy 0.8%

AWS Rekognition

Age 16-22
Gender Female, 100%
Calm 60.1%
Confused 20.2%
Sad 12.5%
Surprised 2.7%
Disgusted 2.2%
Angry 1%
Fear 0.8%
Happy 0.6%

AWS Rekognition

Age 6-12
Gender Female, 100%
Calm 84.9%
Confused 5.3%
Happy 3.6%
Surprised 3.4%
Sad 1.2%
Angry 0.9%
Fear 0.3%
Disgusted 0.3%

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Helmet 87.2%

Captions

Microsoft

a group of people that are standing in the grass 59.8%
a group of people standing in the grass 59.7%
a couple of people that are standing in the grass 56.1%