Human Generated Data

Title

Untitled (Yvonne, daughter, and grandchild, Buffalo)

Date

1992, printed later

People

Artist: Milton Rogovin, American 1909 - 2011

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Jon Vein and Ellen Goldsmith-Vein, 2011.607.3

Human Generated Data

Title

Untitled (Yvonne, daughter, and grandchild, Buffalo)

People

Artist: Milton Rogovin, American 1909 - 2011

Date

1992, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.2
Person 99.2
Person 99.2
Person 98.7
People 92.1
Clothing 90.7
Apparel 90.7
Art 84.7
Text 77.6
Drawing 70.6
Face 66.6
Kid 62
Child 62
Pants 61.1
Photography 60.7
Portrait 60.7
Photo 60.7
Wall 59.3
Shorts 58.6

Clarifai
created on 2018-03-23

people 99.9
child 99.6
group 98.2
two 98
adult 97.8
portrait 97.2
offspring 97.2
family 96.8
man 96.4
son 96.3
sibling 96
wear 94.6
woman 94.4
boy 93.7
three 92.6
administration 91.8
group together 91.1
facial expression 89.3
four 86.4
music 84.1

Imagga
created on 2018-03-23

person 24.6
man 23.5
people 22.3
sport 18.7
male 17.8
adult 14.3
outdoors 14.2
silhouette 14.1
park 14
old 13.9
runner 13.4
art 13.3
vintage 13.2
athlete 13
portrait 12.9
grunge 12.8
happy 11.9
black 11.8
outdoor 11.5
autumn 11.4
aged 10.9
sunset 10.8
child 10.7
ancient 10.4
active 10.1
world 10.1
leisure 10
circa 9.9
postmark 9.8
retro 9.8
envelope 9.7
business 9.7
stamp 9.7
mail 9.6
lifestyle 9.4
letter 9.2
success 8.8
grass 8.7
men 8.6
walking 8.5
beach 8.4
alone 8.2
trees 8
family 8
hair 7.9
philately 7.9
love 7.9
couple 7.8
happiness 7.8
sea 7.8
kick 7.8
play 7.8
game 7.6
fashion 7.5
free 7.5
fun 7.5
action 7.4
water 7.3
contestant 7.3
message 7.3
fall 7.2
currency 7.2
team 7.2
boy 7.1

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

grass 99.9
person 99.4
standing 99.3
outdoor 97.5
posing 95.9
old 71.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Female, 93.5%
Angry 1.6%
Calm 22.2%
Happy 62.1%
Disgusted 1.4%
Surprised 1.4%
Sad 9.5%
Confused 1.7%

AWS Rekognition

Age 57-77
Gender Female, 99.9%
Happy 10%
Disgusted 8.2%
Calm 68.2%
Sad 3.1%
Confused 3.1%
Angry 4.8%
Surprised 2.5%

AWS Rekognition

Age 4-7
Gender Female, 61.7%
Surprised 3.6%
Happy 8.8%
Disgusted 1.6%
Calm 13.6%
Confused 6.4%
Angry 6.7%
Sad 59.3%

Microsoft Cognitive Services

Age 43
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a man standing in front of a group of people posing for a photo 89.8%
a group of people posing for a photo 89.7%
a vintage photo of a group of people posing for the camera 89.6%