Human Generated Data

Title

Untitled (three young men in suits)

Date

1964

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19191

Human Generated Data

Title

Untitled (three young men in suits)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1964

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.9
Apparel 99.9
Suit 99.5
Coat 99.5
Overcoat 99.5
Chair 98.6
Furniture 98.6
Human 97.9
Person 97.9
Person 97.5
Person 96.8
Shirt 95.3
Tuxedo 91.1
Face 82.3
Sitting 72.6
Man 69.3
Waiter 68.3
Accessory 65.5
Accessories 65.5
Tie 65.5
Photo 62.9
Portrait 62.9
Photography 62.9
Dress Shirt 62
Undershirt 58.4

Imagga
created on 2022-03-05

silhouette 37.2
people 35.7
person 33.8
man 28.2
player 25.5
male 22
sport 21.4
business 19.4
crowd 18.2
businessman 17.7
training 17.5
adult 17
symbol 16.2
team 16.1
outfit 15.7
audience 15.6
black 15.4
group 15.3
suit 15.1
secretary 15.1
human 15
event 14.8
nighttime 14.7
entrepreneur 14.5
facility 14.4
icon 14.2
lights 13.9
cheering 13.7
stadium 13.6
dance 13.6
athlete 13.4
patriotic 13.4
nation 13.2
flag 12.8
competition 12.8
active 12.6
skill 12.5
muscular 12.4
golfer 12.3
couple 12.2
men 12
body 12
shorts 11.7
field 11.7
boy 11.7
activity 11.6
fight 11.6
match 11.6
art 11
exercise 10.9
versus 10.8
gymnasium 10.7
championship 10.7
happy 10.6
ring 10.4
youth 10.2
park 9.9
professional 9.6
design 9.6
women 9.5
corporate 9.4
action 9.3
power 9.2
fashion 9
family 8.9
boxing 8.8
figure 8.7
gloves 8.7
happiness 8.6
against 8.3
child 8.2
pose 8.2
fitness 8.1
sexy 8
looking 8
uppercut 7.9
jab 7.9
baron 7.9
executive 7.9
ropes 7.9
dancer 7.9
punch 7.9
work 7.8
standing 7.8
hands 7.8
athletic facility 7.8
employee 7.8
portrait 7.8
play 7.8
jump 7.7
block 7.6
contestant 7.6
dangerous 7.6
studio 7.6
tie 7.6
dark 7.5
treasury 7.4
success 7.2

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 99.3
wall 95.5
clothing 84.3
man 83.1
black and white 81.4
person 76.8
posing 75.4
white 66.7
suit 65.4
old 47.7

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 100%
Sad 45.7%
Happy 42.7%
Angry 4.1%
Calm 3.1%
Disgusted 1.7%
Surprised 1.1%
Confused 1%
Fear 0.8%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 89.1%
Sad 2.4%
Angry 2.3%
Disgusted 2.2%
Confused 1.7%
Surprised 1.3%
Fear 0.7%
Happy 0.4%

AWS Rekognition

Age 36-44
Gender Male, 99.8%
Happy 61.1%
Calm 16.5%
Angry 10%
Sad 4.4%
Surprised 4%
Disgusted 1.9%
Confused 1.4%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 98.6%
Person 97.9%
Tie 65.5%

Captions

Microsoft

a man and woman posing for a photo 62.3%
a man and a woman posing for a photo 62.2%
a person in a suit posing for a photo 62.1%

Text analysis

Amazon

12
H
-
MAGOM
A*2
YY37A2
MJIR YY37A2
MJIR

Google

YT
ML3
T
3A2
12
13
A2
AGOX
12 ML3 T 13 A2 AGOX MJIR YT 3A2 AAGOA
MJIR
AAGOA