Human Generated Data

Title

Untitled (three young men in suits)

Date

1964

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19192

Human Generated Data

Title

Untitled (three young men in suits)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1964

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Clothing 99.8
Coat 99.8
Apparel 99.8
Overcoat 99.8
Person 98.9
Human 98.9
Furniture 97.2
Chair 97.2
Person 96
Person 95
Poster 91.1
Advertisement 91.1
Sitting 90.5
Tuxedo 88
Text 87.4
Suit 83.7
Man 74.4
Suit 65.7
People 64.2
Face 57.1

Imagga
created on 2022-02-25

person 36.9
adult 31
people 30.7
man 29.8
business 27.3
male 22.7
businessman 21.2
black 20.6
professional 20.5
corporate 18.9
silhouette 18.2
office 17.8
attractive 16.8
outfit 16.7
dancer 16.4
women 15.8
portrait 15.5
businesswoman 15.4
wind instrument 15.3
looking 15.2
sitting 14.6
happy 14.4
team 14.3
computer 14.3
teacher 14.2
meeting 14.1
work 14.1
suit 13.9
lady 13.8
lifestyle 13.7
dark 13.4
brass 13.2
performer 13.2
group 12.9
men 12.9
communication 12.6
job 12.4
executive 12.2
musical instrument 12.2
laptop 12
youth 11.9
brunette 11.3
body 11.2
indoor 11
model 10.9
posing 10.7
room 10.5
success 10.5
couple 10.5
manager 10.2
sport 10.2
face 9.9
active 9.9
fashion 9.8
boy 9.8
indoors 9.7
together 9.6
chair 9.6
hands 9.6
businesspeople 9.5
desk 9.4
cornet 9.3
elegance 9.2
slim 9.2
dress 9
sunset 9
dance 8.9
love 8.7
happiness 8.6
telephone 8.5
pretty 8.4
studio 8.4
human 8.2
20s 8.2
clothing 8.2
confident 8.2
style 8.2
figure 8.2
worker 8.1
working 8
hair 7.9
employee 7.9
colleagues 7.8
entertainer 7.7
educator 7.7
modern 7.7
expression 7.7
notebook 7.5
fun 7.5
one 7.5
technology 7.4
training 7.4
secretary 7.3
sensuality 7.3
smiling 7.2
jacket 7.1

Google
created on 2022-02-25

Photograph 94.3
Rectangle 88.5
Suit 87.1
Font 82.9
Blazer 76.6
Snapshot 74.3
Formal wear 72.2
Tie 70.6
Art 68.7
Event 67.9
Pattern 67.8
Chair 66.8
Collectable 65.6
Collar 63.6
White-collar worker 63.6
Paper product 57.6
Sitting 57.5
Room 55
Ruler 54.9
Photography 52

Microsoft
created on 2022-02-25

text 99.3
wall 97.3
suit 97.3
person 95.2
clothing 94.9
man 92.7
gallery 82
room 78.8
smile 63.6
posing 39.7
different 34.1
picture frame 7.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 99%
Calm 93.9%
Angry 5.1%
Confused 0.6%
Sad 0.2%
Surprised 0.1%
Fear 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 85.4%
Sad 5.3%
Confused 3.1%
Surprised 2.1%
Angry 1.6%
Fear 1.2%
Happy 0.9%
Disgusted 0.5%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 98.5%
Happy 0.6%
Surprised 0.3%
Confused 0.2%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Sad 0.1%

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Chair 97.2%
Poster 91.1%
Suit 83.7%

Captions

Microsoft

a group of people posing for a photo 80.5%
a group of men posing for a photo 72.6%
a group of kids posing for a photo 45.4%

Text analysis

Amazon

64
DEC
154
131

Google

DEC 154 131
DEC
154
131