Human Generated Data

Title

Untitled (two portraits of a young couple with small child)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2341

Human Generated Data

Title

Untitled (two portraits of a young couple with small child)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Apparel 100
Clothing 100
Person 99.2
Human 99.2
Person 98.9
Person 98.8
Hat 96.6
Person 96.2
Person 95.5
Coat 90.5
Hat 84.4
Sun Hat 79.1
Glass 69.2
Accessory 66.5
Sunglasses 66.5
Accessories 66.5
Overcoat 63
Suit 61.3

Imagga
created on 2022-01-30

people 35.7
person 32.7
man 30.2
shower cap 28
medical 27.4
negative 27.3
nurse 26.5
coat 25.9
clothing 25.4
doctor 25.4
adult 25
medicine 22.9
professional 22.9
cap 21.7
film 21.6
male 20.6
patient 20.3
laboratory 20.2
lab coat 20
work 19.6
human 18.7
working 18.6
health 18.1
groom 17.7
couple 17.4
headdress 17.1
photographic paper 16.7
bride 16.6
test 16.4
research 16.2
team 16.1
hospital 15.8
technology 15.6
lab 15.5
worker 15.5
clinic 15.2
love 15
portrait 14.9
wedding 14.7
scientist 14.7
men 14.6
chemistry 14.5
biology 14.2
science 14.2
equipment 14
smiling 13.7
scientific 13.6
chemical 13.6
two 13.5
dress 12.6
education 12.1
women 11.9
chemist 11.8
student 11.8
happiness 11.7
businessman 11.5
development 11.4
together 11.4
happy 11.3
photographic equipment 11.1
teamwork 11.1
business 10.9
surgeon 10.8
lifestyle 10.8
care 10.7
indoors 10.5
husband 10.5
attractive 10.5
illness 10.5
home 10.4
casual 10.2
occupation 10.1
smile 10
biotechnology 9.8
life 9.8
lady 9.7
assistant 9.7
ceremony 9.7
office 9.6
instrument 9.5
face 9.2
modern 9.1
case 9.1
researcher 8.9
biochemistry 8.9
surgery 8.8
celebration 8.8
optical 8.7
bouquet 8.7
day 8.6
sitting 8.6
marriage 8.5
wife 8.5
clothes 8.4
hand 8.4
color 8.3
fashion 8.3
suit 8.1
garment 8
gown 8
computer 8
family 8
looking 8
job 8
microscope 7.9
technician 7.8
model 7.8
colleagues 7.8
tube 7.7
married 7.7
profession 7.7
glasses 7.4
cheerful 7.3
room 7.3
sick person 7.2
romantic 7.1
uniform 7

Google
created on 2022-01-30

Microsoft
created on 2022-01-30

wall 99.8
human face 97
posing 96.5
clothing 89.7
person 89.2
hat 82
black and white 81.4
fashion accessory 78.6
smile 77.8
group 74.8
text 68.6
man 64.3
sketch 54.3
different 33.6

Face analysis

Amazon

Google

AWS Rekognition

Age 16-24
Gender Male, 93.7%
Calm 96%
Happy 1.9%
Disgusted 0.7%
Confused 0.6%
Surprised 0.6%
Sad 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 92.8%
Happy 6.1%
Confused 0.4%
Surprised 0.3%
Disgusted 0.2%
Sad 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Female, 82.9%
Calm 47.6%
Happy 33.2%
Surprised 16.2%
Confused 1.2%
Disgusted 0.8%
Fear 0.5%
Angry 0.3%
Sad 0.3%

AWS Rekognition

Age 14-22
Gender Female, 100%
Calm 84%
Surprised 10.1%
Sad 3.1%
Confused 0.8%
Happy 0.8%
Disgusted 0.6%
Angry 0.3%
Fear 0.3%

AWS Rekognition

Age 37-45
Gender Female, 98%
Calm 99.3%
Surprised 0.3%
Sad 0.2%
Fear 0.1%
Happy 0.1%
Angry 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 18-24
Gender Female, 100%
Calm 98.3%
Sad 0.8%
Surprised 0.7%
Confused 0.1%
Disgusted 0.1%
Happy 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Hat 96.6%
Sunglasses 66.5%

Captions

Microsoft

a group of people posing for a photo 96.4%
a group of people posing for the camera 96.3%
a group of people posing for a picture 96.2%

Text analysis

Amazon

d
Ja d
Ja