Human Generated Data

Title

Untitled (six adults at family reunion)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3029

Human Generated Data

Title

Untitled (six adults at family reunion)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-21

Person 99.7
Human 99.7
Person 98
Person 97.9
Person 96.8
Person 96.8
Clothing 96.1
Apparel 96.1
Accessories 93.8
Tie 93.8
Accessory 93.8
Person 93.4
Overcoat 89.3
Suit 89.3
Coat 89.3
Tie 83.9
Tie 81.7
Room 76.2
Indoors 76.2
Suit 72.1
Scientist 62.4
Clinic 62.4
Face 61.6
Shirt 61.5
Lab 59.5
Photo 57.1
Photography 57.1
Lab Coat 56.5
Wood 55.7
Sleeve 55.4

Imagga
created on 2022-01-21

nurse 82.5
male 43.3
person 42.6
man 41
people 38.5
businessman 33.6
adult 31.4
business 31
doctor 30.1
medical 29.1
team 28.7
professional 28.5
hospital 28.4
coat 27.9
happy 27.6
lab coat 27.1
men 26.6
job 25.7
colleagues 25.3
group 25
work 24.3
mature 24.2
office 24.1
worker 23.1
clinic 22.8
portrait 22.7
patient 22.1
businesspeople 21.8
smiling 21.7
meeting 21.7
working 21.2
teamwork 20.4
30s 20.2
businesswoman 20
care 19.8
medicine 19.4
looking 19.2
corporate 18.9
health 18.8
senior 18.7
indoors 18.5
occupation 18.3
indoor 18.3
desk 17
doctors 16.7
table 16.4
elderly 16.3
stethoscope 15.8
coworkers 15.7
casual 15.3
smile 15
associates 14.8
20s 14.7
golfer 14.6
uniform 14.4
specialist 14.1
room 14
case 13.9
standing 13.9
camera 13.9
cheerful 13.8
lifestyle 13.7
clinical 13.7
women 13.4
together 13.1
couple 13.1
confident 12.7
suit 12.6
handsome 12.5
four 12.5
practitioner 12.2
sitting 12
home 12
successful 11.9
two 11.9
laptop 11.8
happiness 11.8
40s 11.7
color 11.7
cooperation 11.6
mid adult 11.6
clothing 11.5
talking 11.4
face 11.4
success 11.3
player 11.3
human 11.2
crew 10.8
bright 10.7
consultant 10.7
discussion 10.7
modern 10.5
old 10.5
sick person 10.2
day 10.2
surgeon 10.1
50s 9.8
attractive 9.8
expertise 9.7
busy 9.6
computer 9.6
partnership 9.6
profession 9.6
staff 9.6
serious 9.5
building 9.5
ethnic 9.5
waiter 9.4
manager 9.3
horizontal 9.2
employee 9.1
new 8.9
technology 8.9
contestant 8.9
discussing 8.8
30 35 years 8.8
executive 8.8
good mood 8.8
thirties 8.8
partner 8.7
hands 8.7
company 8.4
aged 8.1
light 8
general practitioner 7.9
fifties 7.9
explaining 7.9
heal 7.9
forties 7.9
60s 7.8
businessmen 7.8
assistant 7.8
older 7.8
workers 7.8
diversity 7.7
illness 7.6
plan 7.6
friendly 7.3
garment 7.2
life 7.2

Google
created on 2022-01-21

Microsoft
created on 2022-01-21

text 98.7
person 86.7
clothing 76.9
smile 68.7
old 57.5
man 57.1
posing 53.4

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Calm 74.5%
Happy 17.8%
Disgusted 3.9%
Sad 1.4%
Confused 0.8%
Surprised 0.7%
Angry 0.6%
Fear 0.3%

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 93.3%
Sad 3.1%
Angry 1.3%
Happy 0.9%
Surprised 0.6%
Confused 0.4%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 49-57
Gender Male, 99.2%
Happy 49.2%
Calm 35%
Sad 10.7%
Surprised 1.5%
Angry 1.2%
Confused 1%
Disgusted 0.7%
Fear 0.6%

AWS Rekognition

Age 25-35
Gender Male, 98.3%
Happy 98.7%
Calm 1%
Surprised 0.1%
Sad 0.1%
Confused 0%
Angry 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 47-53
Gender Male, 99.7%
Calm 65.4%
Happy 27.8%
Sad 2.1%
Angry 1.6%
Surprised 1.4%
Disgusted 0.7%
Confused 0.7%
Fear 0.3%

AWS Rekognition

Age 45-51
Gender Male, 100%
Happy 86.6%
Sad 3.5%
Confused 3.2%
Calm 1.9%
Angry 1.7%
Disgusted 1.5%
Surprised 1.3%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 93.8%
Suit 89.3%

Captions

Microsoft

a group of people posing for a photo 94.1%
a group of people posing for the camera 94%
a group of people posing for a picture 93.9%

Text analysis

Amazon

MJ17--YT33A°2--HAGOX

Google

KODVK
KODVK -- --EITW
--EITW
--