Human Generated Data

Title

Untitled (studio portrait of two boys standing in sailor outfits stand with hands resting on central table)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3647

Human Generated Data

Title

Untitled (studio portrait of two boys standing in sailor outfits stand with hands resting on central table)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.5
Human 99.5
Person 99.2
Apparel 98.2
Clothing 98.2
Chair 80.9
Furniture 80.9
Face 77.7
Dress 76.4
Female 71.4
Photography 66.9
Photo 66.9
Portrait 66.9
People 65.7
Girl 61.4
Sleeve 60.7
Kid 60.5
Child 60.5
Table 59.4
Shorts 57.9
Door 57.4
Sailor Suit 56.7
Overcoat 56.1
Suit 56.1
Coat 56.1
Costume 55.5

Clarifai
created on 2019-06-01

people 99.9
adult 98
two 97.2
man 96.8
group 95.7
wear 95.1
woman 94.1
portrait 91.5
three 91.2
child 89
group together 87.9
outfit 87.3
one 86.9
musician 85.5
leader 84.8
music 83.6
administration 82.2
sit 81.5
medical practitioner 80.2
four 80.1

Imagga
created on 2019-06-01

grandfather 52.5
senior 40.3
man 36.3
person 32
people 30.1
elderly 27.8
male 27.8
mature 27
medical 26.5
patient 25.7
retired 25.2
happy 25.1
health 23.6
adult 22.9
couple 22.6
retirement 22.1
home 21.5
hospital 21.5
old 20.9
professional 20.8
doctor 20.7
men 18.9
stethoscope 18.8
nurse 18.5
care 18.1
aged 18.1
smiling 18.1
together 16.6
lifestyle 16.6
family 15.1
indoors 14.9
portrait 14.9
looking 14.4
women 14.2
camera 13.9
sitting 13.7
older 13.6
happiness 13.3
pensioner 13.2
coat 13
60s 12.7
kin 12.6
married 12.5
casual 11.9
clinic 11.9
70s 11.8
medicine 11.4
illness 11.4
smile 11.4
two 11
human 10.5
worker 10.3
love 10.3
church 10.2
gray hair 9.8
cheerful 9.7
middle aged 9.7
clothing 9.6
profession 9.6
wife 9.5
healthy 9.4
case 9.2
joyful 9.2
occupation 9.2
outdoors 9
to 8.8
mother 8.8
instrument 8.6
husband 8.6
talking 8.6
face 8.5
sick person 8.4
help 8.4
horizontal 8.4
leisure 8.3
holding 8.2
staff 8.2
hair 7.9
look 7.9
surgeon 7.9
seniors 7.9
grandma 7.8
grandmother 7.8
physician 7.8
teacher 7.8
cold 7.7
sick 7.7
30s 7.7
aging 7.7
winter 7.7
age 7.6
enjoying 7.6
inside 7.4
religion 7.2
team 7.2
job 7.1
day 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

person 97.7
human face 97.3
clothing 92.4
old 74.4
posing 60.2
people 56

Face analysis

Amazon

Google

AWS Rekognition

Age 10-15
Gender Male, 87.5%
Happy 1.6%
Confused 3.4%
Angry 1.3%
Disgusted 0.9%
Surprised 3.3%
Sad 2%
Calm 87.5%

AWS Rekognition

Age 11-18
Gender Male, 57.4%
Angry 2.3%
Disgusted 1.3%
Confused 2.8%
Calm 43.8%
Sad 47.1%
Surprised 1.8%
Happy 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 91.6%
a vintage photo of a group of people posing for a picture 91.5%
a group of people posing for a photo 91.4%