Human Generated Data

Title

Untitled (portrait of two boys)
Date

c. 1970
People

Artist: Bachrach Studios, founded 1868
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.533

Human Generated Data

Title

Untitled (portrait of two boys)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Apparel 99.9
Clothing 99.9
Overcoat 99.9
Coat 99.9
Jacket 98.5
Blazer 98.5
Tie 98.1
Accessories 98.1
Accessory 98.1
Tie 97.1
Human 95.3
Person 93.5
Person 93.1
Suit 91.4
Tuxedo 87.1
Man 86.3
Suit 76.9
Female 75.2
Photo 61.6
Portrait 61.6
Face 61.6
Photography 61.6
Woman 61.3
Pattern 55.8
Art 55.8
Graphics 55.8
Floral Design 55.8

Imagga
created on 2022-02-26

suit 70.2
businessman 51.2
business 45
man 44.4
male 41.2
office 33.1
person 31.1
executive 30.8
adult 29.9
handsome 29.4
corporate 28.4
professional 28.3
standing 27.8
confident 27.3
tie 26.6
portrait 26.5
businesswoman 26.4
success 25.8
people 25.7
elevator 22.9
men 22.3
successful 22
happy 21.3
clothing 20.9
garment 20.8
job 20.4
smiling 20.3
smile 20
work 19.6
manager 18.6
face 17.8
businesspeople 17.1
expression 17.1
lifting device 16.8
building 16.7
attractive 16.1
guy 15.7
formal 15.3
happiness 14.9
company 14.9
cell 14.7
businessmen 14.6
group 14.5
looking 14.4
confidence 14.4
jacket 14.4
boss 14.4
team 14.3
fashion 14.3
career 14.2
device 13.7
corporation 13.5
modern 13.3
meeting 13.2
elegant 12.9
holding 12.4
cheerful 12.2
workplace 11.4
one 11.2
camera 11.1
model 10.9
lifestyle 10.8
colleagues 10.7
working 10.6
coat 10.6
black 10.5
serious 10.5
couple 10.5
covering 10.2
casual 10.2
20s 10.1
worker 10
dress 9.9
consumer goods 9.9
groom 9.8
outdoors 9.7
partnership 9.6
smart 9.4
outside 9.4
teamwork 9.3
alone 9.1
hand 9.1
employee 9
style 8.9
kimono 8.8
shirt 8.4
elegance 8.4
human 8.3
occupation 8.3
friendly 8.2
women 7.9
indoors 7.9
determined 7.9
coworkers 7.9
brunette 7.8
boy 7.8
color 7.8
30s 7.7
leadership 7.7
indoor 7.3
lady 7.3
necktie 7.3
family 7.1
posing 7.1
love 7.1
robe 7.1
day 7.1
look 7

Google
created on 2022-02-26

Clothing 98.7
Smile 97.7
Suit trousers 96.8
Dress shirt 90.9
Tartan 88.6
School uniform 88.5
Sleeve 87.2
Standing 86.4
Gesture 85.3
Collar 84.1
Tie 84.1
Suit 81.6
Blazer 78.3
Formal wear 75.9
Button 74.7
Fashion design 72.9
Hat 72.5
Vintage clothing 72.4
Event 72.4
White-collar worker 71.9

Microsoft
created on 2022-02-26

person 99.2
wall 97
clothing 97
standing 95.5
suit 93.6
tie 92.7
smile 90.8
man 90.6
human face 89.9
coat 89.6
posing 89
text 75.3
blazer 71.8
shirt 69.8
gentleman 65.1
collar 62.7
formal wear 61.9
dress shirt 53.5
clothes 18.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 92%
Happy 3.6%
Confused 2.8%
Surprised 0.7%
Sad 0.4%
Disgusted 0.2%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 6-16
Gender Female, 98.4%
Happy 98.6%
Surprised 0.4%
Fear 0.2%
Disgusted 0.2%
Angry 0.2%
Confused 0.2%
Calm 0.1%
Sad 0.1%

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 14
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 98.1%
Person 93.5%
Suit 91.4%

Captions

Microsoft

a man wearing a suit and tie posing for a picture 99.3%
a man wearing a suit and tie posing for a photo 99%
a man wearing a suit and tie standing in front of a window 98.3%