Human Generated Data

Title

Untitled (Eli Wallach, Arthur Miller, John Huston, Montgomery Clift, Marilyn Monroe, and Clark Gable on the set of The Misfits)
Date

1960, printed later
People

Artist: Bruce Davidson, American born 1933
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2011.177
Copyright

© Magnum Photos, Inc. and Bruce Davidson

Human Generated Data

Title

Untitled (Eli Wallach, Arthur Miller, John Huston, Montgomery Clift, Marilyn Monroe, and Clark Gable on the set of The Misfits)

People

Artist: Bruce Davidson, American born 1933

Date

1960, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Apparel 99.9
Clothing 99.9
Hat 99.6
Hat 99.4
Person 99.3
Human 99.3
Person 99
Face 97.4
Person 96.4
Person 87.1
Sun Hat 83.1
Hat 78.5
Cowboy Hat 77.6
Portrait 68.9
Photo 68.9
Photography 68.9
People 65.2
Finger 62.7
Man 61.8
Person 61.3
Beard 58.9
Costume 55.7
Coat 55.4
Overcoat 55.4
Accessories 55.2
Glasses 55.2
Accessory 55.2

Clarifai
created on 2018-03-23

people 99.8
group 97.9
adult 97.7
group together 96.5
man 94.8
wear 93.9
outfit 92.9
several 91.9
veil 91
administration 89
three 87.2
woman 87.2
music 87.2
military 87.1
many 86.6
portrait 86.5
lid 86.1
four 85.5
leader 85.3
two 84.7

Imagga
created on 2018-03-23

man 31.6
male 23.4
hat 23
people 22.3
person 19.3
old 18.1
statue 17.3
men 17.2
face 15.6
mask 14.4
weapon 14.2
sculpture 14.2
art 13.3
portrait 12.3
adult 11.7
device 11
work 11
black 10.8
worker 10.7
covering 10.1
vintage 10
clothing 10
gun 9.9
religion 9.9
cowboy hat 9.8
ancient 9.5
safety 9.2
comic book 9.1
fun 9
one 9
job 8.8
musical instrument 8.8
home 8.8
building 8.7
war 8.7
military 8.7
profession 8.6
astronaut 8.5
newspaper 8.4
hand 8.4
glasses 8.3
occupation 8.2
human 8.2
protection 8.2
style 8.2
business 7.9
headdress 7.8
soldier 7.8
antique 7.8
equipment 7.7
helmet 7.7
skill 7.7
culture 7.7
industry 7.7
world 7.6
fashion 7.5
traditional 7.5
symbol 7.4
retro 7.4
photographer 7.1

Google
created on 2018-03-23

photograph 95.7
black and white 92.3
monochrome photography 84.9
human behavior 82.6
snapshot 81.8
photography 80.7
monochrome 73.1
vintage clothing 67.9
stock photography 56.2
retro style 56.2

Microsoft
created on 2018-03-23

person 98.9
text 89.3

Face analysis

Amazon

Google

AWS Rekognition

Age 35-53
Gender Male, 99.8%
Angry 1.4%
Sad 4.9%
Calm 89.5%
Disgusted 0.5%
Happy 0.6%
Surprised 0.5%
Confused 2.6%

AWS Rekognition

Age 27-44
Gender Male, 93.9%
Confused 30.3%
Surprised 8.9%
Calm 17.8%
Sad 22.9%
Disgusted 3.7%
Happy 7.9%
Angry 8.5%

AWS Rekognition

Age 30-47
Gender Male, 99.7%
Calm 8.8%
Surprised 1.6%
Happy 78.3%
Sad 7%
Disgusted 0.3%
Confused 1.9%
Angry 2.1%

AWS Rekognition

Age 26-43
Gender Male, 53.5%
Surprised 5.7%
Disgusted 15.2%
Confused 6.3%
Sad 7.6%
Angry 17.7%
Happy 38.6%
Calm 8.8%

AWS Rekognition

Age 35-52
Gender Male, 95.1%
Surprised 1.4%
Disgusted 0.9%
Confused 3.1%
Sad 17.5%
Angry 4.5%
Happy 0.6%
Calm 72.1%

AWS Rekognition

Age 20-38
Gender Male, 86.1%
Disgusted 0.5%
Angry 2.5%
Calm 5.5%
Sad 85.8%
Happy 0.6%
Confused 3.3%
Surprised 1.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.6%
Person 99.3%

Captions

Microsoft

a group of people around each other 80.1%
a group of people taking a selfie 55.8%
a group of people that are brushing their teeth 12.7%