Human Generated Data

Title

Untitled (two photographs: studio portrait of two children standing and baby in chair; studio portrait of three children, one boy seated in chair and smiling)
Date

c. 1935, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6104

Human Generated Data

Title

Untitled (two photographs: studio portrait of two children standing and baby in chair; studio portrait of three children, one boy seated in chair and smiling)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6104

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Clothing 99.5
Apparel 99.5
Person 99.3
Human 99.3
Person 98.9
Person 98.6
Person 96.4
Person 92.3
Person 90
Coat 88.9
Overcoat 88.9
Advertisement 88.5
Collage 88.5
Poster 88.5
Suit 76.6
Footwear 75.5
Shoe 75.5
Shoe 71.1
Performer 60
Furniture 57
Face 56
Photography 55.7
Photo 55.7

Clarifai
created on 2019-11-16

people 99.9
group 98.8
man 98.5
woman 97.7
chair 97.7
adult 96.4
group together 96
family 95.3
child 92.9
furniture 90.9
room 90.6
street 90
music 89.4
actor 85.6
musician 83.4
monochrome 83.4
indoors 83.1
leader 80.1
outfit 79.2
wear 78.6

Imagga
created on 2019-11-16

musical instrument 52.5
keyboard instrument 30.5
wind instrument 25.6
man 25.5
accordion 24.1
people 23.4
stringed instrument 23.3
percussion instrument 22.9
male 20.6
sax 20
person 19.2
silhouette 18.2
adult 18.1
black 17.6
grand piano 17.3
piano 16.8
outfit 15.4
music 15.4
men 14.6
sexy 14.5
business 14
guitar 12.9
concert 12.6
group 12.1
women 11.9
crowd 11.5
body 11.2
style 11.1
portrait 11
model 10.9
professional 10.6
businessman 10.6
fashion 10.6
device 9.9
human 9.7
urban 9.6
couple 9.6
rock 9.6
love 9.5
youth 9.4
clothing 9.3
city 9.1
team 9
oboe 8.9
sitting 8.6
star 8.5
attractive 8.4
hot 8.4
studio 8.4
dark 8.4
musician 8.3
chair 8.3
kettle 8.2
microphone 8.2
sensuality 8.2
stage 8
holiday 7.9
art 7.8
singer 7.8
expression 7.7
musical 7.7
performance 7.7
life 7.6
window 7.5
instrument 7.5
indoor 7.3
bass 7.3
sensual 7.3
danger 7.3
office 7.2
dirty 7.2
suit 7.2
posing 7.1
night 7.1
interior 7.1
spotlight 7.1

Google
created on 2019-11-16

Photograph 96.1
Black-and-white 85.4
Snapshot 82.9
Photography 73.8
Monochrome 70.2
Room 65.7
Stock photography 59.4
Style 51
Art 50.2

Microsoft
created on 2019-11-16

person 96.9
clothing 96.8
man 93.9
footwear 90.2
standing 86.4
furniture 83.1
black and white 78.6
text 72.1
posing 43.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 51.8%
Calm 54.4%
Happy 45%
Disgusted 45%
Surprised 45%
Angry 45.1%
Sad 45.4%
Fear 45%
Confused 45.1%

AWS Rekognition

Age 5-15
Gender Male, 51%
Calm 54.4%
Disgusted 45%
Happy 45.1%
Fear 45%
Surprised 45.1%
Sad 45.1%
Confused 45.1%
Angry 45.1%

AWS Rekognition

Age 2-8
Gender Male, 54.9%
Angry 45.5%
Fear 45.1%
Confused 45.2%
Surprised 45.5%
Calm 53.1%
Disgusted 45.1%
Sad 45.3%
Happy 45.2%

AWS Rekognition

Age 5-15
Gender Male, 53.9%
Calm 45.1%
Sad 45%
Confused 45%
Happy 54.6%
Angry 45.2%
Disgusted 45.1%
Fear 45%
Surprised 45.1%

AWS Rekognition

Age 3-11
Gender Male, 50.2%
Sad 45.3%
Fear 46.2%
Disgusted 45%
Angry 45.3%
Happy 45%
Confused 45.1%
Calm 47.9%
Surprised 50.1%

AWS Rekognition

Age 3-9
Gender Female, 54.7%
Happy 45%
Angry 45.3%
Disgusted 45%
Confused 45.2%
Sad 45.8%
Calm 53.3%
Surprised 45.1%
Fear 45.3%

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 1
Gender Female

Microsoft Cognitive Services

Age 16
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Suit 76.6%
Shoe 75.5%

Categories

Imagga

interior objects 86%
paintings art 5.8%
food drinks 5.4%
pets animals 1%