Human Generated Data

Title

Untitled (woman reading book to children on couch)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17059

Human Generated Data

Title

Untitled (woman reading book to children on couch)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.5
Human 99.5
Person 99.1
Person 98.9
Person 95.7
Clothing 94.2
Apparel 94.2
Person 91.2
Person 90
Face 73.5
Female 70.4
People 64.2
Dance 64.1
Girl 62.9
Indoors 61.7

Imagga
created on 2022-02-26

person 41.2
man 41
senior 40.3
people 36.2
male 36.2
elderly 33.5
couple 33.1
adult 30.9
happy 28.2
old 26.5
portrait 25.9
retired 25.2
husband 23.8
together 23.6
mature 23.2
retirement 23
smiling 21.7
teacher 21.5
family 20.4
love 19.7
wife 19
negative 18.4
home 18.3
professional 18.2
human 17.2
smile 16.4
looking 16
indoors 15.8
older 15.5
film 15.5
lifestyle 15.2
grandfather 14.8
women 14.2
men 13.7
patient 13.7
60s 13.7
aged 13.6
casual 13.6
married 13.4
medical 13.2
health 13.2
pensioner 12.7
education 12.1
sitting 12
fun 12
hair 11.9
nurse 11.8
child 11.6
room 11.4
educator 11.4
student 11.3
photographic paper 11.2
technology 11.1
camera 11.1
two 11
happiness 11
kin 10.9
holding 10.7
worker 10.7
face 10.6
affection 10.6
lady 10.5
modern 10.5
mother 10.4
specialist 10.3
work 10.2
gray 9.9
hand 9.9
70s 9.8
to 9.7
father 9.7
enjoying 9.5
day 9.4
grandma 9.3
cheerful 8.9
romance 8.9
case 8.9
group 8.9
working 8.8
businessman 8.8
computer 8.8
grandmother 8.8
look 8.8
affectionate 8.7
eyes 8.6
hospital 8.6
loving 8.6
teamwork 8.3
glasses 8.3
leisure 8.3
care 8.2
outdoors 8.2
active 8.2
sick person 8.1
team 8.1
romantic 8
medicine 7.9
seventies 7.9
equipment 7.8
sixties 7.8
couples 7.8
surgeon 7.8
having 7.7
clinic 7.7
age 7.6
doctor 7.5
friends 7.5
joy 7.5
friendship 7.5
clothing 7.5
photographic equipment 7.5
playing 7.3
laptop 7.3
suit 7.2
holiday 7.2
handsome 7.1

Google
created on 2022-02-26

Photograph 94.2
Black-and-white 82.1
Headgear 81.5
Snapshot 74.3
Event 71.4
Vintage clothing 71.4
Monochrome photography 71.1
Monochrome 69.6
Eyewear 69.4
Crew 68.3
Font 66.2
Room 65.5
Personal protective equipment 64.6
Photo caption 64
Hat 63.5
Stock photography 63
History 60.6
Uniform 60.5
Team 57.6
Fun 56.3

Microsoft
created on 2022-02-26

person 98.2
clothing 88.2
text 85.9
human face 83.4
man 73.6
black and white 72.4

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Female, 98.7%
Happy 94.3%
Surprised 2.2%
Calm 1.2%
Disgusted 1.1%
Fear 0.4%
Angry 0.4%
Confused 0.3%
Sad 0.2%

AWS Rekognition

Age 18-26
Gender Female, 99.8%
Calm 55.7%
Happy 23.4%
Sad 11.7%
Surprised 3.8%
Angry 2.1%
Disgusted 1.5%
Fear 1%
Confused 0.9%

AWS Rekognition

Age 20-28
Gender Male, 99%
Calm 98%
Sad 1.2%
Confused 0.4%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Happy 0%
Fear 0%

AWS Rekognition

Age 10-18
Gender Female, 89.4%
Surprised 74%
Calm 18.3%
Happy 3%
Fear 2.6%
Angry 1%
Sad 0.5%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 38-46
Gender Female, 89.5%
Happy 71.8%
Calm 17.2%
Surprised 5%
Sad 3.7%
Angry 1.1%
Fear 0.5%
Disgusted 0.5%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people around each other 88.3%
a group of people standing around a table 87.5%
a group of people posing for the camera 87.4%

Text analysis

Amazon

3
01113--YT330-X

Google

El
El