Human Generated Data

Title

Untitled (family portrait in living room, one woman and five men)

Date

c. 1955

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10366

Human Generated Data

Title

Untitled (family portrait in living room, one woman and five men)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Tie 99.1
Accessories 99.1
Accessory 99.1
Human 98.6
Person 98.6
Tie 97.7
Sitting 97.4
Coat 97
Overcoat 97
Apparel 97
Suit 97
Clothing 97
Person 96.2
Tie 95.9
Person 95.6
Suit 95.5
Suit 93.7
Person 93.4
Suit 91.9
Person 91.2
Crowd 88.2
Suit 88.1
Person 84.5
Jury 82.8
Tie 74.6
People 73.5
Tie 73.5
Audience 63.6
Face 59
Head 58.6
Photo 55.7
Photography 55.7
Portrait 55.7
Attorney 55.6

Imagga
created on 2022-01-23

businessman 58.3
executive 51.8
business 51.7
man 49.8
office 47.4
male 44.7
suit 38.7
corporate 37.8
person 36.4
team 35
people 34.1
meeting 34
businesswoman 32.8
businesspeople 32.3
men 30.1
professional 29.8
teamwork 27.8
businessmen 27.3
happy 27
adult 26.7
group 26.6
confident 26.4
colleagues 26.3
smiling 25.3
secretary 24.3
work 23.6
manager 22.4
partnership 21.2
entrepreneur 21.1
baron 20.4
handsome 19.6
portrait 19.4
tie 19
successful 18.3
leadership 18.3
cheerful 17.9
looking 17.6
smile 17.1
desk 17
success 16.9
job 16.8
corporation 16.4
career 16.1
communication 16
coworkers 15.7
standing 15.7
sitting 15.5
30s 15.4
worker 15.2
colleague 14.7
partners 14.6
jacket 14.6
busy 14.5
staff 14.4
working 14.2
together 14
partner 13.5
boss 13.4
workplace 13.4
company 13
20s 12.8
indoor 12.8
mature 12.1
face 12.1
computer 12
expression 12
occupation 11.9
laptop 11.9
associates 11.8
businesswomen 11.8
happiness 11.8
formal 11.5
table 11.3
businessperson 10.7
discussion 10.7
40s 10.7
cooperation 10.6
indoors 10.6
attractive 10.5
garment 10.2
lifestyle 10.1
modern 9.8
conference 9.8
groom 9.8
lawyer 9.6
talking 9.5
clothing 9.5
necktie 9.3
discussing 8.9
employee 8.8
building 8.7
couple 8.7
mid adult 8.7
diversity 8.7
confidence 8.6
two 8.5
senior 8.4
presentation 8.4
horizontal 8.4
friendly 8.2
judge 8.1
30 35 years 7.9
bow tie 7.8
25 30 years 7.8
conversation 7.8
planner 7.8
employment 7.7
profession 7.7
females 7.6
guy 7.5
color 7.2

Google
created on 2022-01-23

Photograph 94.2
Coat 91.2
Tie 87.5
Suit 85.4
Collar 83.4
Smile 79.7
Blazer 78.3
Formal wear 75.5
White-collar worker 75.3
Event 73.6
Team 69.1
Vintage clothing 68.1
Suit trousers 65
Monochrome 64.7
Watch 64.6
Stock photography 62.6
History 62.3
Lap 58
Picture frame 56.5
Sitting 56.2

Microsoft
created on 2022-01-23

person 100
wall 99.2
clothing 96.5
smile 95.7
text 95.3
man 93.4
human face 87.7
posing 81.9
people 77.4
group 74.5
suit 68.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-46
Gender Male, 99.7%
Happy 97.8%
Calm 1.4%
Confused 0.3%
Surprised 0.2%
Angry 0.1%
Fear 0.1%
Sad 0.1%
Disgusted 0.1%

AWS Rekognition

Age 53-61
Gender Female, 99.7%
Calm 97%
Angry 0.8%
Happy 0.6%
Disgusted 0.4%
Surprised 0.4%
Confused 0.3%
Sad 0.3%
Fear 0.2%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Happy 52.9%
Calm 21.1%
Surprised 5.2%
Disgusted 5.2%
Angry 4.8%
Confused 4.5%
Fear 3.6%
Sad 2.7%

AWS Rekognition

Age 31-41
Gender Male, 99.8%
Calm 96.6%
Angry 1.7%
Confused 1%
Happy 0.2%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Calm 83.4%
Happy 4.3%
Angry 3.9%
Disgusted 2.3%
Confused 1.9%
Sad 1.8%
Fear 1.4%
Surprised 1%

AWS Rekognition

Age 70-80
Gender Male, 100%
Calm 99.6%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Confused 0%
Happy 0%
Sad 0%
Fear 0%

Microsoft Cognitive Services

Age 71
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 63
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.1%
Person 98.6%
Suit 97%

Captions

Microsoft

a group of people posing for a photo 99.1%
a group of people posing for the camera 99%
a group of people posing for a picture 98.9%