Human Generated Data

Title

Untitled (family portrait in living room with anniversary couple)

Date

c. 1960

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10396

Human Generated Data

Title

Untitled (family portrait in living room with anniversary couple)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.8
Person 99.8
Person 99.4
Person 99.4
Person 99
People 98.5
Accessories 98.2
Accessory 98.2
Tie 98.2
Family 98.1
Tie 97.1
Apparel 95.9
Suit 95.9
Overcoat 95.9
Clothing 95.9
Coat 95.9
Suit 94.5
Person 94.2
Person 93.1
Tuxedo 80.3
Performer 57

Imagga
created on 2022-01-23

kin 67.8
businessman 53
businesswoman 49.1
business 47.4
office 45.8
businesspeople 44.6
man 44.4
meeting 43.4
team 43
group 41.9
colleagues 40.8
male 38.4
people 36.3
teamwork 35.2
corporate 30.1
adult 28.7
men 27.5
happy 25.7
person 25.7
executive 24.8
30s 24.1
smiling 23.9
coworkers 23.6
work 23.6
manager 23.3
together 21.9
professional 21.6
discussing 21.6
businessmen 21.5
working 21.2
indoors 21.1
suit 19.8
discussion 19.5
20s 19.3
indoor 19.2
table 19
associates 18.7
job 18.6
confident 18.2
desk 18
success 17.7
sitting 17.2
talking 17.1
partners 16.5
successful 16.5
workplace 16.2
computer 16
groom 15.7
40s 15.6
laptop 15.5
cooperation 15.5
cheerful 15.5
mid adult 15.4
partnership 15.4
staff 15.3
lifestyle 15.2
communication 15.1
mother 15.1
horizontal 15.1
standing 14.8
businesswomen 14.7
corporation 14.5
portrait 14.2
career 14.2
director 13.8
smile 13.5
partner 13.5
busy 13.5
women 13.5
presentation 13
looking 12.8
face 12.8
25 30 years 12.7
worker 12.6
attractive 12.6
formal 12.4
parent 12.3
couple 12.2
mature 12.1
company 12.1
camera 12
happiness 11.8
leadership 11.5
four 11.5
senior 11.3
room 11.1
nurse 11.1
collaboration 10.8
30 35 years 10.8
color 10.6
boss 10.5
home 10.4
boardroom 9.9
crew 9.8
employee 9.8
handsome 9.8
3 9.8
conference 9.8
colleague 9.8
females 9.5
casual 9.3
forties 8.8
good mood 8.8
20 25 years 8.8
thirties 8.8
conversation 8.7
jacket 8.7
collar 8.6
friends 8.5
business people 7.9
explaining 7.9
diverse 7.8
businessperson 7.8
middle aged 7.8
agreement 7.8
employment 7.7
planning 7.7
tie 7.6
adults 7.6
doctor 7.5
holding 7.4
secretary 7.4
occupation 7.3
blond 7.2
family 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 100
wall 99.7
posing 97.8
smile 96.8
clothing 96.5
standing 95.3
man 91.7
human face 91.1
text 90.5
suit 85.2
woman 83.1
group 79.8
people 77.4
retro 59.2
old 56.7
sketch 51.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 41-49
Gender Female, 100%
Happy 98.8%
Surprised 0.4%
Fear 0.3%
Confused 0.2%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%
Calm 0%

AWS Rekognition

Age 53-61
Gender Female, 85.9%
Happy 72.1%
Disgusted 11.7%
Angry 7.1%
Surprised 2.1%
Confused 2%
Calm 1.9%
Fear 1.7%
Sad 1.3%

AWS Rekognition

Age 42-50
Gender Male, 99.7%
Happy 99.7%
Surprised 0.1%
Disgusted 0.1%
Confused 0%
Fear 0%
Calm 0%
Angry 0%
Sad 0%

AWS Rekognition

Age 37-45
Gender Female, 99.4%
Calm 29.1%
Happy 25.2%
Angry 13.8%
Surprised 10.6%
Confused 7.3%
Disgusted 6.9%
Sad 4.4%
Fear 2.7%

AWS Rekognition

Age 42-50
Gender Female, 100%
Happy 60.9%
Calm 18.6%
Confused 5.6%
Disgusted 4.6%
Surprised 3.1%
Sad 2.9%
Fear 2.7%
Angry 1.6%

AWS Rekognition

Age 65-75
Gender Male, 99.3%
Calm 47.6%
Happy 40.4%
Angry 2.7%
Sad 2.4%
Confused 2.1%
Disgusted 1.8%
Surprised 1.6%
Fear 1.3%

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 53
Gender Male

Microsoft Cognitive Services

Age 47
Gender Female

Microsoft Cognitive Services

Age 66
Gender Male

Microsoft Cognitive Services

Age 52
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Tie 98.2%
Suit 95.9%

Captions

Microsoft

a group of people posing for a photo 99.5%
a group of people posing for the camera 99.4%
a group of people posing for a picture 99.3%