Human Generated Data

Title

Untitled (two photographs: studio portrait of girl in white dress with flower crown and veil; studio portrait of three girls in black dresses and white collars)
Date

c. 1935, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6106

Human Generated Data

Title

Untitled (two photographs: studio portrait of girl in white dress with flower crown and veil; studio portrait of three girls in black dresses and white collars)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Apparel 98.8
Clothing 98.8
Person 98.4
Human 98.4
Footwear 97.2
Shoe 97.2
Person 97.1
Shoe 90.7
Person 88.4
Overcoat 86
Person 84.7
Sleeve 73.3
Gown 67.3
Evening Dress 67.3
Fashion 67.3
Robe 67.3
Suit 62.8
Mannequin 58
Cloak 55.4
Long Sleeve 55.3
Coat 53.4

Clarifai
created on 2019-11-16

people 99.9
woman 98.3
monochrome 97.8
adult 96
wear 95.5
man 95
group 94.7
wedding 92.4
child 92.2
portrait 88.4
group together 88
room 87.8
two 87.5
outfit 86.4
street 85.3
family 84.1
actor 83.8
indoors 81.3
music 80.3
actress 79.2

Imagga
created on 2019-11-16

people 24
man 23.5
world 21.2
person 19.1
male 18.4
kin 18.1
businessman 16.8
business 16.4
couple 15.7
adult 15.3
men 12.9
black 12.7
clothing 12.4
silhouette 12.4
scholar 12.2
love 11.8
life 11.7
fashion 11.3
old 11.1
happiness 11
suit 10.7
group 10.5
walking 10.4
groom 10.3
building 10.3
women 10.3
family 9.8
intellectual 9.7
happy 9.4
city 9.1
dress 9
sunset 9
two 8.5
travel 8.4
portrait 8.4
window 8.4
executive 8.4
bride 8.3
wedding 8.3
history 8
together 7.9
urban 7.9
corporate 7.7
walk 7.6
wife 7.6
friends 7.5
vintage 7.4
future 7.4
holding 7.4
park 7.4
office 7.4
new 7.3
romantic 7.1
job 7.1
summer 7.1

Google
created on 2019-11-16

Photograph 96.4
Black-and-white 87.2
Snapshot 86.1
Photography 67.8
Outerwear 65.8
Room 65.7
Picture frame 64.5
Stock photography 62.1
Art 58.1
Monochrome photography 57.8
Gentleman 54.5
Monochrome 54.4
Style 51

Microsoft
created on 2019-11-16

text 95.9
person 92.4
clothing 92.1
black 91.5
dress 86.7
standing 83.8
posing 80.9
black and white 79.3
white 78
footwear 71.9
suit 65.2
old 41.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-23
Gender Female, 54.6%
Happy 45%
Confused 45%
Calm 54.5%
Angry 45%
Disgusted 45%
Surprised 45%
Fear 45%
Sad 45.4%

AWS Rekognition

Age 1-5
Gender Female, 51.1%
Disgusted 45%
Sad 46.8%
Happy 45%
Surprised 45.1%
Calm 52.5%
Fear 45.3%
Confused 45.2%
Angry 45.2%

AWS Rekognition

Age 28-44
Gender Female, 54.2%
Disgusted 46.4%
Fear 45.8%
Surprised 45.2%
Angry 46.2%
Calm 48.6%
Happy 45.1%
Confused 47%
Sad 45.7%

AWS Rekognition

Age 7-17
Gender Male, 51.4%
Surprised 45%
Sad 45.1%
Calm 54.7%
Happy 45%
Confused 45%
Disgusted 45%
Fear 45%
Angry 45.1%

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Shoe 97.2%
Coat 53.4%

Captions

Microsoft

a black and white photo of a group of people posing for the camera 93.4%
a black and white photo of a group of people posing for a picture 93.3%
a group of people posing for a photo 93.2%