Human Generated Data

Title

Untitled (family portrait with six generations)

Date

c. 1945

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2692

Human Generated Data

Title

Untitled (family portrait with six generations)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-16

Human 98.2
Person 98.2
Person 97.8
Person 97.3
Person 96.6
Person 94.7
Tie 92.4
Accessory 92.4
Accessories 92.4
Clothing 92.4
Apparel 92.4
People 80.3
Tie 73
Chair 70.6
Furniture 70.6
Person 67.1
Photography 63.1
Photo 63.1
Portrait 63.1
Face 63.1
Doctor 61.2
Clinic 58.7
Footwear 56.8
Shoe 56.8
Drawing 56.6
Art 56.6

Imagga
created on 2022-01-16

lab coat 69.8
coat 69.2
doctor 37.6
nurse 36.8
person 36.2
medical 36.2
man 33.6
professional 33.4
hospital 33.3
male 31.2
people 29
adult 27.4
health 27.1
medicine 26.4
garment 25.9
patient 24
job 23.9
stethoscope 23.5
clothing 23.2
clinic 23.1
care 22.2
happy 21.9
looking 20
businessman 19.4
occupation 19.2
portrait 18.8
uniform 18.2
work 18.1
senior 17.8
two 17.8
business 17.6
specialist 16.4
practitioner 16.1
mature 15.8
smile 15.7
worker 15.4
team 15.2
smiling 15.2
teacher 14.8
laboratory 13.5
standing 13
group 12.9
student 12.9
men 12.9
lab 12.6
day 12.6
staff 12.4
couple 12.2
bright 12.2
doctors 11.8
clinical 11.7
surgeon 11.7
handsome 11.6
profession 11.5
human 11.2
case 11.1
happiness 11
indoor 11
confident 10.9
healthy 10.7
face 10.7
elderly 10.5
success 10.5
old 10.4
office 10.4
building 10.3
hair 10.3
teamwork 10.2
friendly 10.1
examination 9.7
indoors 9.7
women 9.5
corporate 9.5
camera 9.2
successful 9.2
writing 9.1
one 9
life 8.9
technology 8.9
family 8.9
physician 8.8
health care 8.7
exam 8.6
illness 8.6
adults 8.5
casual 8.5
black 8.4
company 8.4
cheerful 8.1
new 8.1
science 8
working 8
lifestyle 7.9
scientist 7.8
hands 7.8
pensive 7.8
architecture 7.8
education 7.8
assistant 7.8
chemistry 7.7
mid adult 7.7
attractive 7.7
chart 7.6
serious 7.6
research 7.6
hand 7.6
educator 7.4
suit 7.4
groom 7.4
color 7.2
wind instrument 7.2
brass 7.1

Google
created on 2022-01-16

Microsoft
created on 2022-01-16

text 99.4
old 89.2
clothing 88.7
person 80.2
posing 76.8
wedding dress 76.5
dress 61.3
group 55.4
man 54.1
vintage 26.9

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 99.5%
Sad 47.2%
Confused 19.6%
Disgusted 13.2%
Surprised 8.7%
Angry 8.2%
Fear 1.3%
Calm 1.3%
Happy 0.6%

AWS Rekognition

Age 51-59
Gender Male, 100%
Sad 98.9%
Angry 0.4%
Disgusted 0.2%
Confused 0.2%
Fear 0.1%
Surprised 0.1%
Happy 0.1%
Calm 0.1%

AWS Rekognition

Age 28-38
Gender Female, 53.8%
Happy 76.1%
Calm 7.1%
Sad 5.1%
Disgusted 4.9%
Surprised 4.8%
Confused 0.8%
Fear 0.6%
Angry 0.6%

AWS Rekognition

Age 54-64
Gender Male, 95.3%
Calm 94.6%
Confused 1.7%
Angry 1.5%
Happy 0.9%
Sad 0.6%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Tie 92.4%
Shoe 56.8%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 91.7%
a vintage photo of a group of people posing for a picture 91.6%
a group of people posing for a photo 91.5%

Text analysis

Amazon

IS3
KODAK-SEEIA

Google

KODVK-
S3
KODVK- 丁S3