Human Generated Data

Title

Untitled (portrait of two boys)

Date

c. 1970

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.533

Human Generated Data

Title

Untitled (portrait of two boys)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1970

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.533

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.9
Apparel 99.9
Overcoat 99.9
Coat 99.9
Blazer 98.5
Jacket 98.5
Tie 98.1
Accessories 98.1
Accessory 98.1
Tie 97.1
Human 95.3
Person 93.5
Person 93.1
Suit 91.4
Tuxedo 87.1
Man 86.3
Suit 76.9
Female 75.2
Portrait 61.6
Face 61.6
Photography 61.6
Photo 61.6
Woman 61.3
Floral Design 55.8
Art 55.8
Graphics 55.8
Pattern 55.8

Clarifai
created on 2023-10-29

people 99.7
portrait 99.7
two 98.5
wear 98.5
woman 98.2
adult 98.1
man 97.5
facial expression 96.7
jacket 95.8
group 95.5
girl 95.5
outfit 93.2
three 91.8
indoors 90.1
fashion 90
outerwear 89.4
dress 88.9
business 88.8
partnership 88.3
menswear 86.5

Imagga
created on 2022-02-26

suit 70.2
businessman 51.2
business 45
man 44.4
male 41.2
office 33.1
person 31.1
executive 30.8
adult 29.9
handsome 29.4
corporate 28.4
professional 28.3
standing 27.8
confident 27.3
tie 26.6
portrait 26.5
businesswoman 26.4
success 25.8
people 25.7
elevator 22.9
men 22.3
successful 22
happy 21.3
clothing 20.9
garment 20.8
job 20.4
smiling 20.3
smile 20
work 19.6
manager 18.6
face 17.8
businesspeople 17.1
expression 17.1
lifting device 16.8
building 16.7
attractive 16.1
guy 15.7
formal 15.3
happiness 14.9
company 14.9
cell 14.7
businessmen 14.6
group 14.5
looking 14.4
confidence 14.4
jacket 14.4
boss 14.4
team 14.3
fashion 14.3
career 14.2
device 13.7
corporation 13.5
modern 13.3
meeting 13.2
elegant 12.9
holding 12.4
cheerful 12.2
workplace 11.4
one 11.2
camera 11.1
model 10.9
lifestyle 10.8
colleagues 10.7
working 10.6
coat 10.6
black 10.5
serious 10.5
couple 10.5
covering 10.2
casual 10.2
20s 10.1
worker 10
dress 9.9
consumer goods 9.9
groom 9.8
outdoors 9.7
partnership 9.6
smart 9.4
outside 9.4
teamwork 9.3
alone 9.1
hand 9.1
employee 9
style 8.9
kimono 8.8
shirt 8.4
elegance 8.4
human 8.3
occupation 8.3
friendly 8.2
women 7.9
indoors 7.9
determined 7.9
coworkers 7.9
brunette 7.8
boy 7.8
color 7.8
30s 7.7
leadership 7.7
indoor 7.3
lady 7.3
necktie 7.3
family 7.1
posing 7.1
love 7.1
robe 7.1
day 7.1
look 7

Google
created on 2022-02-26

Clothing 98.7
Smile 97.7
Suit trousers 96.8
Dress shirt 90.9
Tartan 88.6
School uniform 88.5
Sleeve 87.2
Standing 86.4
Gesture 85.3
Collar 84.1
Tie 84.1
Suit 81.6
Blazer 78.3
Formal wear 75.9
Button 74.7
Fashion design 72.9
Hat 72.5
Vintage clothing 72.4
Event 72.4
White-collar worker 71.9

Microsoft
created on 2022-02-26

person 99.2
wall 97
clothing 97
standing 95.5
suit 93.6
tie 92.7
smile 90.8
man 90.6
human face 89.9
coat 89.6
posing 89
text 75.3
blazer 71.8
shirt 69.8
gentleman 65.1
collar 62.7
formal wear 61.9
dress shirt 53.5
clothes 18.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 92%
Happy 3.6%
Confused 2.8%
Surprised 0.7%
Sad 0.4%
Disgusted 0.2%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 6-16
Gender Female, 98.4%
Happy 98.6%
Surprised 0.4%
Fear 0.2%
Disgusted 0.2%
Angry 0.2%
Confused 0.2%
Calm 0.1%
Sad 0.1%

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 14
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie
Person
Suit
Tie 98.1%
Tie 97.1%
Person 93.5%
Person 93.1%
Suit 91.4%
Suit 76.9%

Categories

Imagga

people portraits 78.1%
events parties 20.8%