Human Generated Data

Title

Untitled (men wearing suits standing in a police line-up)
Date

1962
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15519

Human Generated Data

Title

Untitled (men wearing suits standing in a police line-up)

People

Artist: Jack Gould, American

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Apparel 99.8
Overcoat 99.8
Clothing 99.8
Coat 99.8
Human 96.9
Person 94
Person 93.9
Person 93.8
Person 92.7
Suit 91.8
Person 91.6
Stage 91.4
Tuxedo 90.3
Suit 85.9
Face 83.8
Suit 82.7
Man 76.2
Suit 75.4
Display 71.2
Screen 71.2
Monitor 71.2
Electronics 71.2
Suit 69.2
Performer 67.8
Indoors 66.3
Room 63.9
Photography 63.5
Portrait 63.5
Photo 63.5
Crowd 60
Blazer 57.9
Jacket 57.9

Imagga
created on 2022-03-05

theater curtain 54.8
curtain 46.4
crowd 43.2
silhouette 40.5
person 39.2
audience 39
people 37.9
cheering 37.2
nighttime 37.2
stadium 36.9
nation 36.9
patriotic 36.4
lights 36.1
flag 35.7
blind 32.8
vibrant 30.6
icon 30
male 28.3
vivid 27.9
symbol 26.9
man 26.2
bright 22.9
team 22.4
event 22.2
protective covering 22
competition 21.9
design 21.9
teamwork 21.3
businessman 20.3
muscular 20
business 20
sport 19.8
athlete 18.9
championship 18.5
training 18.5
match 18.3
skill 18.3
boss 18.2
dangerous 18
work 18
versus 17.7
fight 17.4
group 16.9
job 15.9
presentation 15.8
weapon 15.2
covering 14.8
president 14.7
protection 14.5
businesswoman 14.5
speech 13.7
leader 13.5
performance 13.4
sword 12.9
supporters 12.8
stab 12.8
occupation 12.8
fencing 12.8
technique 12.8
clothing 12.7
musician 12.6
blade 12.6
gear 12.5
sharp 12.3
black 11.4
sexy 11.2
stage 11
suit 10
star 10
music 9.9
performer 9.8
concert 9.7
executive 9.7
couple 9.6
classical 9.5
men 9.4
theater 8.6
elegant 8.6
cinema 8.3
glowing 8.3
outfit 8.2
adult 8.1
worker 8
player 8
women 7.9
smile 7.8
speaker 7.6
light 7.4
playing 7.3
gown 7.1

Google
created on 2022-03-05

Coat 92.9
Sleeve 87.2
Rectangle 83.3
Suit 82.9
Line 81.8
Entertainment 79.6
Smile 77.2
Tie 76.7
Snapshot 74.3
Window 73.2
Event 73.1
Magenta 73
Performing arts 72.6
Font 71.9
Team 68.4
Formal wear 67.5
Stage equipment 66.4
Display device 63.6
Uniform 63.5
Music 62.1

Microsoft
created on 2022-03-05

suit 96
person 95.9
text 94.3
clothing 93.2
man 85.5
posing 46.5

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 45.7%
Confused 33.2%
Angry 16.9%
Surprised 1.2%
Sad 1%
Disgusted 1%
Happy 0.9%
Fear 0.2%

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 86.7%
Confused 3.6%
Angry 3.6%
Sad 3.2%
Happy 1%
Fear 0.8%
Surprised 0.8%
Disgusted 0.4%

AWS Rekognition

Age 51-59
Gender Male, 100%
Calm 86.9%
Confused 5.7%
Happy 2.2%
Sad 1.8%
Angry 1.7%
Surprised 0.7%
Disgusted 0.7%
Fear 0.3%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Calm 99.6%
Sad 0.2%
Happy 0.1%
Surprised 0.1%
Confused 0.1%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Sad 59.3%
Confused 20.5%
Calm 11.2%
Happy 2.7%
Surprised 2%
Angry 1.9%
Fear 1.7%
Disgusted 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94%
Suit 91.8%
Monitor 71.2%

Captions

Microsoft

a group of men posing for a picture 82.5%
a man wearing a suit and tie 82.4%
a man standing in front of a building 72%

Text analysis

Amazon

I
KODYK
KODYK EIRW
A EITA
EIRW

Google

MAGOM
37
A°2
MJ13
MJI7 Y T 37 A°2 MAGOM MJ13 Y
MJI7
Y
T