Human Generated Data

Title

Untitled (Yvonne, daughter, and grandchild, Buffalo)
Date

1992, printed later
People

Artist: Milton Rogovin, American 1909 - 2011
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Jon Vein and Ellen Goldsmith-Vein, 2011.607.3

Human Generated Data

Title

Untitled (Yvonne, daughter, and grandchild, Buffalo)

People

Artist: Milton Rogovin, American 1909 - 2011

Date

1992, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.2
Person 99.2
Person 99.2
Person 98.7
People 92.1
Apparel 90.7
Clothing 90.7
Art 84.7
Text 77.6
Drawing 70.6
Face 66.6
Kid 62
Child 62
Pants 61.1
Photography 60.7
Portrait 60.7
Photo 60.7
Wall 59.3
Shorts 58.6

Clarifai
created on 2018-03-23

people 99.9
child 99.6
group 98.2
two 98
adult 97.8
portrait 97.2
offspring 97.2
family 96.8
man 96.4
son 96.3
sibling 96
wear 94.6
woman 94.4
boy 93.7
three 92.6
administration 91.8
group together 91.1
facial expression 89.3
four 86.4
music 84.1

Imagga
created on 2018-03-23

person 24.6
man 23.5
people 22.3
sport 18.7
male 17.8
adult 14.3
outdoors 14.2
silhouette 14.1
park 14
old 13.9
runner 13.4
art 13.3
vintage 13.2
athlete 13
portrait 12.9
grunge 12.8
happy 11.9
black 11.8
outdoor 11.5
autumn 11.4
aged 10.9
sunset 10.8
child 10.7
ancient 10.4
active 10.1
world 10.1
leisure 10
circa 9.9
postmark 9.8
retro 9.8
envelope 9.7
business 9.7
stamp 9.7
mail 9.6
lifestyle 9.4
letter 9.2
success 8.8
grass 8.7
men 8.6
walking 8.5
beach 8.4
alone 8.2
trees 8
family 8
hair 7.9
philately 7.9
love 7.9
couple 7.8
happiness 7.8
sea 7.8
kick 7.8
play 7.8
game 7.6
fashion 7.5
free 7.5
fun 7.5
action 7.4
water 7.3
contestant 7.3
message 7.3
fall 7.2
currency 7.2
team 7.2
boy 7.1

Google
created on 2018-03-23

people 96.7
photograph 96.2
white 95.9
clothing 94.9
black and white 92.6
standing 85.6
male 83.4
monochrome photography 82.8
vintage clothing 81.8
snapshot 81.8
family 80.5
human behavior 77.8
child 77.8
monochrome 72.4
design 65
pattern 57.6
retro style 53.3
tree 53.3
stock photography 53
gentleman 52.7

Microsoft
created on 2018-03-23

grass 99.9
person 99.4
standing 99.3
outdoor 97.5
posing 95.9
old 71.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Female, 99.9%
Happy 10%
Disgusted 8.2%
Calm 68.2%
Sad 3.1%
Confused 3.1%
Angry 4.8%
Surprised 2.5%

AWS Rekognition

Age 10-15
Gender Female, 93.5%
Angry 1.6%
Calm 22.2%
Happy 62.1%
Disgusted 1.4%
Surprised 1.4%
Sad 9.5%
Confused 1.7%

AWS Rekognition

Age 4-7
Gender Female, 61.7%
Surprised 3.6%
Happy 8.8%
Disgusted 1.6%
Calm 13.6%
Confused 6.4%
Angry 6.7%
Sad 59.3%

Microsoft Cognitive Services

Age 43
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a man standing in front of a group of people posing for a photo 89.8%
a group of people posing for a photo 89.7%
a vintage photo of a group of people posing for the camera 89.6%