Human Generated Data

Title

Untitled (family portrait in living room, one woman and five men)
Date

c. 1955
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10365

Human Generated Data

Title

Untitled (family portrait in living room, one woman and five men)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Tie 99.2
Accessory 99.2
Accessories 99.2
Coat 98.8
Suit 98.8
Apparel 98.8
Overcoat 98.8
Clothing 98.8
Human 98.2
Sitting 98.1
Person 97.9
Person 97.4
Suit 97.4
Suit 97.2
Tie 97
Tie 96.6
Suit 96.4
Tie 95.7
Person 94.7
Person 94.5
Person 92.8
Crowd 91.5
Suit 86
Person 80.7
People 79.4
Tie 76.8
Person 72.6
Jury 65.8
Face 62.9
Audience 59.5
Press Conference 59.2
Attorney 57.7

Imagga
created on 2022-01-23

businessman 54.8
office 53
business 49.8
man 48.4
team 44.8
male 42.6
businesswoman 37.3
person 37.1
corporate 35.2
people 35.2
businesspeople 35.1
executive 34.9
meeting 34.9
group 33.9
teamwork 32.5
men 30.1
professional 29.1
suit 29.1
colleagues 27.2
adult 25.6
work 25.1
happy 25.1
confident 24.6
businessmen 24.4
secretary 23.4
partnership 22.1
smiling 21
manager 18.6
partners 18.5
tie 18
handsome 17.8
success 17.7
job 17.7
staff 17.2
worker 17
desk 17
portrait 16.8
together 16.7
standing 16.5
successful 16.5
corporation 16.4
career 16.1
working 15.9
coworkers 15.7
golfer 15.5
partner 15.5
30s 15.4
sitting 14.6
looking 14.4
table 13.9
associates 13.8
occupation 13.8
indoor 13.7
kin 13.7
colleague 13.7
laptop 13.7
smile 13.5
leadership 13.5
communication 13.4
boss 13.4
company 13
baron 12.6
cooperation 12.6
formal 12.4
workplace 12.4
indoors 12.3
cheerful 12.2
computer 12
player 12
20s 11.9
entrepreneur 11.9
discussing 11.8
businesswomen 11.8
discussion 11.7
groom 11.6
busy 11.6
jacket 11.6
mature 11.2
expression 11.1
employee 10.8
conference 10.8
mid adult 10.6
talking 10.5
lawyer 10.4
building 10.3
senior 10.3
attractive 9.8
40s 9.7
director 9.7
necktie 9.7
contestant 9.4
lifestyle 9.4
two 9.3
face 9.2
modern 9.1
25 30 years 8.8
bow tie 8.8
agreement 8.7
couple 8.7
employment 8.7
diversity 8.7
confidence 8.6
guy 8.5
presentation 8.4
horizontal 8.4
women 7.9
collaboration 7.9
crew 7.9
paper 7.8
happiness 7.8
diverse 7.8
businessperson 7.8
deal 7.8
collar 7.7
planner 7.6
females 7.6
doctor 7.5
clothing 7.1

Google
created on 2022-01-23

Photograph 94.3
Coat 90.5
Suit 84.2
Blazer 77.9
Collar 77.9
Tie 75.4
Snapshot 74.3
Event 72.1
White-collar worker 70
Vintage clothing 68.2
Team 67.3
History 65
Chair 62.1
Formal wear 59.8
Monochrome 59.5
Sitting 58.1
Classic 57
Font 50.6
Collaboration 50.4

Microsoft
created on 2022-01-23

person 100
wall 99.7
clothing 96.5
man 95.5
smile 95
text 94.9
human face 90.5
standing 83.2
suit 83.2
black 81.1
posing 77.1
people 76.7
group 61.7
old 52
dressed 38.1
clothes 26

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 72-82
Gender Male, 99.9%
Calm 99.2%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Sad 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 59-67
Gender Female, 97.8%
Calm 99.2%
Disgusted 0.2%
Happy 0.2%
Angry 0.1%
Sad 0.1%
Confused 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 82.2%
Happy 6.6%
Surprised 3.4%
Confused 2%
Angry 2%
Sad 1.6%
Fear 1.2%
Disgusted 1%

AWS Rekognition

Age 48-54
Gender Male, 100%
Happy 88.8%
Surprised 5.1%
Calm 3.1%
Angry 1.1%
Fear 0.8%
Disgusted 0.6%
Confused 0.3%
Sad 0.2%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Happy 64.1%
Surprised 15.7%
Calm 9.1%
Confused 4.4%
Angry 3.1%
Fear 2.5%
Disgusted 0.9%
Sad 0.3%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Calm 93.5%
Happy 3.9%
Confused 1.1%
Surprised 0.8%
Disgusted 0.3%
Angry 0.2%
Fear 0.2%
Sad 0.1%

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 71
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 58
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.2%
Suit 98.8%
Person 97.9%

Captions

Microsoft

a group of people posing for a photo 98.9%
a group of people posing for the camera 98.8%
a group of people posing for a photo in a suit and tie 98.7%