Human Generated Data

Title

Untitled (family portrait in hallway with lace curtain in background)

Date

c. 1905-1915

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3937

Human Generated Data

Title

Untitled (family portrait in hallway with lace curtain in background)

People

Artist: Durette Studio, American 20th century

Date

c. 1905-1915

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 97.7
Person 97.7
Person 97.6
Person 95.5
Apparel 95.1
Clothing 95.1
Person 92.1
Face 87.8
Person 87
Person 85.8
Person 78.4
People 78.2
Indoors 75.6
Drawing 74.7
Art 74.7
Person 72.8
Person 71.6
Crowd 70.8
Room 64.2
Person 63.2
Portrait 63.1
Photography 63.1
Photo 63.1
Sketch 58.8
Sleeve 55.7
Female 55

Clarifai
created on 2019-06-01

people 99.3
adult 97.5
group 94.4
man 91.9
wear 91.1
woman 85.5
portrait 84.6
one 82
many 81.5
monochrome 78.8
art 77.4
retro 77.1
child 72.3
texture 70.8
pattern 67.6
room 67.6
abstract 66.9
no person 66.8
window 64.9
group together 64.5

Imagga
created on 2019-06-01

drawing 36
design 34.4
sketch 32
art 31.3
grunge 28.1
representation 24.2
silhouette 24
floral 23.9
frame 23.7
element 21.5
splash 20.7
pattern 19.9
graphic 18.3
drop 18.2
shape 17.9
flower 17.7
wallpaper 17.6
backdrop 17.3
decorative 16.7
water 16.7
decoration 16.3
bubbles 16.2
liquid 15.7
leaf 15.6
texture 15.3
bubble 15.1
style 14.9
retro 14.8
backgrounds 14.6
clean 14.2
drops 14.2
summer 14.2
transparent 13.5
card 13.4
spring 13.4
plant 13.2
ornament 13
motion 12.9
vintage 12.4
curl 12.4
holiday 12.2
cold 12.1
clip art 12.1
ornate 11.9
border 11.8
drink 11.7
wet 11.6
creative 11.5
medicine 11.5
scroll 11.5
clear 11.4
swirl 11.1
snow 10.9
symbol 10.8
black 10.4
paper 10.3
set 10.2
banner 10.1
paint 10
painting 9.9
modern 9.8
cartoon 9.8
decor 9.7
greeting 9.3
elegance 9.3
air 9.2
sign 9
color 8.9
cool 8.9
thirst 8.8
curve 8.8
artistic 8.7
ink 8.7
stain 8.7
season 8.6
elegant 8.6
winter 8.5
old 8.4
health 8.4
ice 8.2
wave 8.1
icon 7.9
love 7.9
text 7.9
droplet 7.8
gift 7.8
splashing 7.8
painted 7.6
creation 7.6
freshness 7.5
elements 7.4
cover 7.4
foliage 7.4
light 7.4
artwork 7.3
dirty 7.2
fresh 7.2
glass 7

Google
created on 2019-06-01

White 96.5
Photograph 96
Black-and-white 74.4
Monochrome 64.3
Photography 62.4
Art 58.1
Drawing 57.6
Style 52.5

Microsoft
created on 2019-06-01

drawing 97.8
sketch 97.6
human face 90.6
person 84.2
black and white 84.1
man 70.5
clothing 69.4

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 80%
Confused 3.1%
Surprised 3.9%
Happy 4.4%
Angry 2.3%
Sad 4.2%
Disgusted 5.4%
Calm 76.8%

AWS Rekognition

Age 26-43
Gender Male, 95.2%
Disgusted 2.7%
Happy 4.9%
Sad 4.9%
Calm 76.8%
Angry 2.6%
Surprised 4.8%
Confused 3.3%

AWS Rekognition

Age 20-38
Gender Male, 53.2%
Disgusted 45.1%
Happy 45.3%
Surprised 45.2%
Sad 46.4%
Angry 45.2%
Confused 45.3%
Calm 52.4%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Happy 48%
Calm 47.8%
Angry 45.6%
Surprised 46.8%
Disgusted 45.7%
Confused 45.5%
Sad 45.6%

AWS Rekognition

Age 23-38
Gender Male, 53.7%
Confused 45.4%
Angry 45.5%
Sad 46.7%
Calm 48.6%
Disgusted 46.7%
Happy 46.6%
Surprised 45.5%

AWS Rekognition

Age 15-25
Gender Male, 97.1%
Calm 74.2%
Disgusted 2.1%
Sad 6.9%
Surprised 2.9%
Happy 2.3%
Confused 8.6%
Angry 2.9%

AWS Rekognition

Age 26-43
Gender Male, 54.2%
Sad 45.8%
Angry 45.3%
Disgusted 45.4%
Surprised 45.6%
Happy 47.3%
Calm 50.1%
Confused 45.4%

AWS Rekognition

Age 20-38
Gender Female, 95.8%
Confused 7.9%
Surprised 6.3%
Happy 8.4%
Angry 5.9%
Sad 49.5%
Disgusted 10.3%
Calm 11.7%

Feature analysis

Amazon

Person 97.7%

Captions

Microsoft

a group of people in a room 73.9%
a group of people standing in a room 67.7%
a group of people standing next to a door 48%