Human Generated Data

Title

Untitled (tea pouring)

Date

1880s

People

Artist: Kusakabe Kimbei, Japanese 1841 - 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Tassel and Janet Tassel, P2004.83

Human Generated Data

Title

Untitled (tea pouring)

People

Artist: Kusakabe Kimbei, Japanese 1841 - 1934

Date

1880s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 99.8
Apparel 99.8
Human 99.7
Person 99.7
Person 98.7
Person 97.4
Fashion 89.1
Robe 89.1
Gown 81.4
Kimono 77.5
Art 65.2
Portrait 55.6
Photo 55.6
Photography 55.6
Face 55.6

Imagga
created on 2022-01-08

home 43.9
family 37.4
room 35.3
people 34
man 33
adult 31.5
male 31.1
couch 30.9
happy 29.5
smiling 27.5
person 26.9
child 26.5
couple 26.1
indoors 25.5
together 25.4
lifestyle 24.6
mother 23.1
sitting 22.3
happiness 21.9
fun 21.7
love 21.3
casual 21.2
father 20.8
clothing 20.4
interior 20.3
boy 19.1
attractive 18.2
pajama 17.9
women 17.4
cheerful 17.1
portrait 16.8
son 16.7
kid 16
sofa 15.9
their 14.7
20s 14.7
group 14.5
husband 14.4
smile 14.3
living 14.2
house 14.2
looking 13.6
jeans 13.4
adults 13.3
indoor 12.8
mom 12.6
30s 12.5
nightwear 12.3
sit 12.3
covering 12.3
expression 11.9
daughter 11.8
relaxing 11.8
domestic 11.8
joy 11.7
dad 11.6
cup 11.1
two 11
playing 10.9
parents 10.8
childhood 10.7
holding 10.7
elderly 10.5
computer 10.4
togetherness 10.4
play 10.3
senior 10.3
mature 10.2
life 10.2
cute 10
blond 9.9
buddy 9.8
handsome 9.8
pretty 9.8
brown hair 9.8
loving 9.5
wife 9.5
color 9.5
laughing 9.5
office 9.4
inside 9.2
business 9.1
game 9.1
beverage 9
table 9
classroom 8.9
living room 8.8
student 8.8
brother 8.6
men 8.6
face 8.5
females 8.5
three 8.4
horizontal 8.4
camera 8.3
laptop 8.3
leisure 8.3
parent 8.3
joyful 8.3
girls 8.2
businesswoman 8.2
consumer goods 7.9
beverages 7.9
brunette 7.8
hug 7.7
having 7.7
enjoying 7.6
enjoy 7.5
friends 7.5
enjoyment 7.5
relationship 7.5
friendship 7.5
coffee 7.4
lady 7.3
children 7.3
kin 7.1

Google
created on 2022-01-08

Table 81.9
Tints and shades 76.6
Vintage clothing 71.2
Sharing 70.8
Cooking 70.5
Art 69.8
Event 69.5
Sitting 67.7
Room 67.3
Visual arts 67.1
Stock photography 64.1
Conversation 62
Recreation 60.7
Child 57
Chair 55.4
Fun 54.4
Vegetable 53.3
Square 52.9

Microsoft
created on 2022-01-08

person 98.9
wall 98.9
clothing 97.7
indoor 97.5
human face 96.9
text 91.2
drawing 87.3
painting 79.5
woman 59.5
cartoon 53.2
posing 41.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-18
Gender Female, 99.9%
Calm 96.7%
Sad 0.8%
Disgusted 0.6%
Fear 0.5%
Surprised 0.4%
Confused 0.4%
Happy 0.3%
Angry 0.3%

AWS Rekognition

Age 10-18
Gender Female, 100%
Calm 99.8%
Sad 0.1%
Surprised 0%
Happy 0%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 12-20
Gender Female, 100%
Calm 76.8%
Sad 18.4%
Confused 1.7%
Disgusted 1.1%
Angry 1%
Surprised 0.4%
Fear 0.3%
Happy 0.2%

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people sitting posing for the camera 94.9%
a group of people posing for the camera 94.8%
a group of people posing for a picture 94.7%

Text analysis

Amazon

837

Google

837
837