Human Generated Data

Title

Untitled (men in suits standing in police line-up)

Date

1962

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15959

Human Generated Data

Title

Untitled (men in suits standing in police line-up)

People

Artist: Jack Gould, American

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Stage 99.9
Person 96.3
Human 96.3
Person 95.2
Person 95
Person 94.9
Person 94.8
Clothing 94.4
Apparel 94.4
Interior Design 89.1
Indoors 89.1
Room 83.7
Coat 81.8
Overcoat 81.8
Suit 80.8
Suit 80.6
Suit 80
Theater 70.6
Suit 63.7

Imagga
created on 2022-02-05

silhouette 34.7
people 31.2
theater curtain 30.2
person 27.9
curtain 27.9
male 27.6
crowd 25.9
man 24.2
audience 21.4
business 20.6
design 20.2
group 19.3
nighttime 18.6
businessman 18.5
flag 18.4
blind 18.1
cheering 17.6
men 17.2
nation 17
symbol 16.8
black 16.8
lights 16.7
stadium 16.5
patriotic 16.3
vibrant 15.7
suit 15.4
bright 15
cinema 14.8
icon 14.2
team 13.4
performance 13.4
glowing 12.9
work 12.5
protective covering 12.3
clothing 12.3
event 12
concert 11.6
art 11.5
theater 11.4
outfit 11.3
presentation 11.2
vivid 11.1
competition 11
covering 10.4
women 10.3
teamwork 10.2
music 9.9
musician 9.8
stage 9.7
boss 9.6
dance 9.5
shiny 9.5
elegant 9.4
dark 9.2
executive 9
job 8.8
adult 8.8
classical 8.6
party 8.6
muscular 8.6
speaker 8.6
orange 8.4
manager 8.4
training 8.3
entertainment 8.3
businesswoman 8.2
baron 8.2
dress 8.1
light 8.1
shadow 8.1
worker 8.1
success 8
night 8
building 8
versus 7.9
president 7.8
championship 7.8
match 7.7
skill 7.7
athlete 7.7
musical 7.7
life 7.5
sport 7.4
graphic 7.3
office 7.2
modern 7

Google
created on 2022-02-05

Microsoft
created on 2022-02-05

person 95.4
text 89.2
music 83.7
clothing 83.2
concert 62.3
suit 57.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Angry 51.2%
Calm 19.1%
Disgusted 13.9%
Confused 8.9%
Sad 5.4%
Surprised 0.6%
Fear 0.5%
Happy 0.3%

AWS Rekognition

Age 53-61
Gender Male, 100%
Calm 78.8%
Sad 18.4%
Angry 0.8%
Confused 0.6%
Surprised 0.5%
Fear 0.4%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 98.6%
Sad 0.4%
Angry 0.3%
Surprised 0.2%
Confused 0.2%
Happy 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 43-51
Gender Male, 96.2%
Angry 53%
Sad 18.2%
Calm 14.1%
Confused 6.8%
Disgusted 3%
Surprised 2.4%
Fear 1.8%
Happy 0.7%

AWS Rekognition

Age 53-61
Gender Male, 99.9%
Calm 72.5%
Confused 10.7%
Angry 6.2%
Sad 5.9%
Surprised 1.8%
Fear 1.2%
Disgusted 0.9%
Happy 0.7%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.3%
Suit 80.8%

Captions

Microsoft

a group of people in a dark room 55.2%
a group of men in a dark room 43.4%
a group of people standing in a dark room 43.3%

Text analysis

Amazon

KODAK
FILM
SAFETY FILM
SAFETY
S

Google

KODAK S AFET
AFET
KODAK
S