Human Generated Data

Title

Untitled (young woman and children on couch)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17237

Human Generated Data

Title

Untitled (young woman and children on couch)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.7
Human 99.7
Person 99.6
Person 98.5
Lamp 92.1
Table Lamp 92.1
Clinic 86
Interior Design 63.6
Indoors 63.6
Sitting 58.9
Person 43.5

Imagga
created on 2022-02-26

nurse 45.5
man 40.3
people 35.7
medical 35.3
surgeon 33.2
person 31.7
male 31.2
patient 30.2
doctor 30.1
professional 27.7
senior 25.3
hospital 25.2
work 24.3
smiling 22.4
adult 20.4
medicine 20.3
happy 20.1
sitting 19.8
coat 18.4
lab coat 18.2
indoors 17.6
worker 17.3
clinic 16.3
office 16.1
looking 16
health 16
mature 15.8
specialist 15.7
occupation 15.6
portrait 15.5
laboratory 15.4
research 15.2
job 15
care 14.8
couple 14.8
working 14.1
men 13.7
lifestyle 13.7
illness 13.4
scientist 12.7
two people 12.6
lab 12.6
exam 12.5
science 12.5
profession 12.4
holding 12.4
business 12.2
smile 12.1
two 11.9
room 11.9
salon 11.5
elderly 11.5
businessman 11.5
talking 11.4
hand 10.6
mid adult 10.6
test 10.6
hairdresser 10.5
husband 10.5
businesspeople 10.4
home 10.4
clothing 10.1
drink 10
surgery 9.8
middle aged 9.7
chemical 9.7
scientific 9.7
chemistry 9.7
together 9.6
standing 9.6
uniform 9.5
biology 9.5
wife 9.5
love 9.5
face 9.2
waiter 9.1
human 9
team 9
wine 8.9
family 8.9
to 8.9
assistant 8.7
retired 8.7
table 8.7
retirement 8.6
drinking 8.6
student 8.5
casual 8.5
attractive 8.4
indoor 8.2
necktie 8.2
technology 8.2
sick person 8.1
computer 8
glass 8
case 8
women 7.9
bow tie 7.9
happiness 7.8
40s 7.8
examination 7.8
instrument 7.8
restaurant 7.8
looking camera 7.7
old 7.7
garment 7.6
meeting 7.5
help 7.5
equipment 7.4
service 7.4
glasses 7.4
cheerful 7.3
color 7.2
suit 7.2
romantic 7.1
modern 7

Google
created on 2022-02-26

Photograph 94.2
White 92.2
Black 89.7
Black-and-white 86.6
Standing 86.4
Gesture 85.3
Style 84.1
Monochrome 79
Monochrome photography 76
Snapshot 74.3
Cooking 72.8
Service 71.5
Vintage clothing 70.4
Hat 67.8
Font 67.5
Stock photography 66.3
Room 65.7
History 59.9
T-shirt 57.2
Tie 55.8

Microsoft
created on 2022-02-26

person 98.8
human face 97.9
clothing 94
man 92.5
text 81.9
black and white 71.6
woman 63.7
old 53.6

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Male, 89.4%
Calm 92.6%
Surprised 5.1%
Sad 1.5%
Disgusted 0.2%
Confused 0.2%
Fear 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 20-28
Gender Male, 94.5%
Calm 96.7%
Angry 1.4%
Sad 0.9%
Surprised 0.4%
Happy 0.3%
Fear 0.2%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 23-33
Gender Female, 99.8%
Calm 97.1%
Surprised 1%
Sad 0.5%
Fear 0.5%
Confused 0.3%
Disgusted 0.2%
Angry 0.2%
Happy 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 90%
a group of people posing for the camera 89.9%
a group of people posing for a picture 89.8%

Text analysis

Google

-YT3RA°2-
-XAa
MJI7- -YT3RA°2- -XAa
MJI7-