Human Generated Data

Title

Untitled (couple pose with young girl on lap)

Date

1946

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4232

Human Generated Data

Title

Untitled (couple pose with young girl on lap)

People

Artist: Durette Studio, American 20th century

Date

1946

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Clothing 100
Apparel 100
Human 99.4
Person 99.4
Furniture 99.2
Shoe 99
Footwear 99
Person 98.7
Suit 98.5
Coat 98.5
Overcoat 98.5
Dress 98.1
Person 97.4
Shoe 94.4
Wedding 92.1
Bridegroom 92.1
Face 91.4
Smile 89.3
Robe 89.3
Fashion 89.3
Female 89
Helmet 86.1
Shoe 85.4
Tuxedo 84.6
Gown 83.8
Photo 78.9
Portrait 78.9
Photography 78.9
Shoe 74.6
Shorts 74.3
Man 73.9
Costume 72.8
Accessories 72.7
Accessory 72.7
Glasses 72.7
Wedding Gown 70.4
Outdoors 68.7
Girl 68.3
Woman 68
Porch 67.4
Kid 63.3
Child 63.3
Shoe 62
Brick 61.2
Person 60.3
Flooring 57.6
Bride 57.2
Water 56.9
Chair 56.7
Shoe 50.8

Clarifai
created on 2019-06-01

people 99.5
monochrome 96.1
man 96
adult 95.7
woman 94
two 93.5
wear 90.3
group together 90.2
one 88.6
indoors 85.6
child 83
street 79.5
portrait 78.3
group 78.2
vehicle 73.1
action 72.4
health 72
sports equipment 71.9
uniform 71.4
several 69.6

Imagga
created on 2019-06-01

mask 30.1
brass 26.3
people 26.2
man 26.2
person 24.5
adult 21
wind instrument 21
portrait 18.8
male 18.4
helmet 17.9
protective covering 16.9
fashion 16.6
covering 15.7
human 15.7
sport 15.4
football helmet 15
device 14.7
musical instrument 14.4
black 14.4
action 13.9
body 13.6
men 12.9
protection 11.8
model 11.7
clothing 11.5
lifestyle 10.8
city 10.8
posing 10.7
headdress 10.5
boy 10.4
style 10.4
street 10.1
active 10
exercise 10
fitness 9.9
trombone 9.8
athlete 9.7
fun 9.7
sexy 9.6
urban 9.6
legs 9.4
motion 9.4
wall 9.4
dress 9
outdoors 9
hair 8.7
standing 8.7
modern 8.4
pretty 8.4
attractive 8.4
dark 8.3
training 8.3
leisure 8.3
danger 8.2
happy 8.1
suit 8.1
activity 8.1
looking 8
couple 7.8
cornet 7.8
hands 7.8
youth 7.7
outdoor 7.6
elegance 7.6
hot 7.5
vintage 7.4
future 7.4
fit 7.4
sensuality 7.3
women 7.1
cool 7.1
baritone 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

clothing 90.6
black and white 90
person 88.1
footwear 75.7
posing 45.2

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Male, 86.9%
Calm 83.1%
Surprised 0.5%
Disgusted 0.2%
Happy 0.4%
Sad 12.1%
Confused 1.3%
Angry 2.3%

AWS Rekognition

Age 26-43
Gender Male, 62%
Happy 37.2%
Disgusted 1.3%
Sad 7.9%
Surprised 7.9%
Angry 12.6%
Calm 28.2%
Confused 4.9%

AWS Rekognition

Age 23-38
Gender Female, 91%
Angry 5.7%
Surprised 8.6%
Disgusted 0.9%
Sad 18.2%
Calm 26.9%
Happy 35.2%
Confused 4.5%

Feature analysis

Amazon

Person 99.4%
Shoe 99%
Helmet 86.1%
Chair 56.7%

Captions

Microsoft

a person posing for the camera 83.9%
a person posing for a photo 68%
a man and a woman posing for a photo 35.5%

Text analysis

Amazon

M
M 02
02