Human Generated Data

Title

Untitled (couple and boy)
Date

1970s
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2958

Human Generated Data

Title

Untitled (couple and boy)

People

Artist: Unidentified Artist,

Date

1970s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Tie 99.8
Accessories 99.8
Accessory 99.8
Apparel 99.7
Clothing 99.7
Human 99.3
Person 99.3
Person 98.8
Suit 97.6
Overcoat 97.6
Coat 97.6
Person 96.8
Evening Dress 96
Robe 96
Fashion 96
Gown 96
Tuxedo 81.6
Suit 81
Blazer 78.1
Jacket 78.1
Sleeve 73.9
Female 67.6
Long Sleeve 67.5
People 63.4
Sitting 57.3
Wedding 57.2
Plant 56.4
Wedding Gown 55.2

Imagga
created on 2022-02-26

businessman 64.7
team 61.1
corporate 59.5
business 59.1
office 55.6
teamwork 51.2
businesswoman 50.2
group 49.3
man 49.2
meeting 47.3
executive 46.9
businesspeople 46.7
male 45.6
people 41.4
suit 41.2
professional 40.2
groom 39.4
secretary 37.9
men 36.2
person 35.8
colleagues 35.1
businessmen 33.3
confident 32.9
success 32.3
work 29.9
partnership 29.9
successful 29.4
happy 28.9
partners 27.3
smiling 26.1
leadership 26
job 25.7
coworkers 25.6
manager 25.2
staff 25
company 24.3
adult 24.1
corporation 23.2
standing 21.8
smile 21.5
partner 20.4
together 20.2
workplace 20.1
communication 19.4
building 19.1
portrait 18.8
entrepreneur 18.5
cooperation 18.4
career 18
employee 17.8
associates 17.8
looking 17.7
women 17.5
worker 17.3
working 16.9
30s 16.4
boss 16.3
formal 16.3
colleague 15.9
diverse 15.7
diversity 15.4
confidence 15.4
desk 15.2
attractive 14.7
sitting 14.7
discussion 13.7
workers 13.6
handsome 13.4
indoor 12.8
businesswomen 12.8
handshake 12.8
40s 12.7
mid adult 12.6
tie 12.4
20s 12
happiness 11.8
businessperson 11.7
indoors 11.5
director 11.3
computer 11.3
adviser 11.1
busy 10.6
cheerful 10.6
females 10.4
smart 10.4
mature 10.3
friendly 10.1
jacket 9.9
judge 9.9
executives 9.9
conference 9.8
deal 9.8
agreement 9.7
employment 9.7
planning 9.7
lawyer 9.7
couple 9.6
table 9.6
lifestyle 9.4
expression 9.4
three 9.3
camera 9.3
laptop 9.1
holding 9.1
environment 9.1
black 9
collaboration 8.9
discussing 8.9
25 30 years 8.8
males 8.8
modern 8.4
presentation 8.4
look 7.9
crew 7.9
employer 7.9
30 35 years 7.9
shake 7.9
face 7.8
pretty 7.7
project 7.7
two 7.7
horizontal 7.6
baron 7.5
commerce 7.5
document 7.4
positive 7.4
occupation 7.4
lady 7.3
paper 7.1

Google
created on 2022-02-26

Sleeve 87.2
Tie 87.2
Gesture 85.3
Collar 84.1
Suit 82.3
Happy 79.8
Formal wear 78.4
Blazer 78.3
Fashion design 77.7
Event 73.4
White-collar worker 69.8
Jewellery 69.6
Vintage clothing 69.1
Magenta 63.9
Waist 62.9
Pattern 61.5
Fashion accessory 61.1
Bow tie 58.4
Classic 57.6
Tuxedo 57.2

Microsoft
created on 2022-02-26

person 99.9
wall 97.9
clothing 94.8
human face 93.2
indoor 89.3
posing 87.4
smile 77.7
standing 77.3
tie 76.8
suit 72.6
coat 58.8
woman 57.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Female, 100%
Calm 97.7%
Surprised 1.1%
Happy 0.4%
Confused 0.2%
Sad 0.2%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 45-51
Gender Male, 100%
Confused 33.2%
Calm 27.8%
Disgusted 17.4%
Angry 12.9%
Happy 3.1%
Sad 2.5%
Surprised 1.8%
Fear 1.4%

AWS Rekognition

Age 4-10
Gender Male, 100%
Calm 99%
Confused 0.3%
Surprised 0.2%
Angry 0.2%
Sad 0.2%
Disgusted 0.1%
Happy 0%
Fear 0%

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.8%
Person 99.3%
Suit 97.6%

Captions

Microsoft

a man and woman posing for a photo 94.5%
a man and a woman posing for a photo 94.4%
a man and woman posing for a picture 94.3%