Human Generated Data

Title

Untitled (partially unexposed portrait of large group in masquerade costumes)
Date

c. 1905-1910
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3926

Human Generated Data

Title

Untitled (partially unexposed portrait of large group in masquerade costumes)

People

Artist: Durette Studio, American 20th century

Date

c. 1905-1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.2
Human 99.2
Person 98.6
Person 97.5
Person 97.2
Person 97
Person 96.5
Art 96
Drawing 96
Person 95.8
Person 95
Person 92.9
Person 92.5
Person 91.9
Person 91.4
Person 91
Sunglasses 89.1
Accessory 89.1
Accessories 89.1
Person 88
Face 85.6
Apparel 83.3
Clothing 83.3
Person 83.3
Sketch 72
Person 67
Painting 63.1
Doodle 58.7
Photography 57.5
Photo 57.5
Portrait 57.3
Person 44.3

Clarifai
created on 2019-06-01

people 99.5
group 96.9
man 93.1
vintage 91.3
child 91.2
adult 90.9
retro 90.1
veil 89.9
art 89.3
illustration 88.8
woman 88.3
antique 85.5
wear 85.4
desktop 84.6
old 84.3
paper 83.8
many 82.5
sepia 78.2
wedding 77.7
group together 76.9

Imagga
created on 2019-06-01

glass 49.6
ice 27.3
cold 26.7
drink 25.9
liquid 24.6
water 23.3
cool 23.1
clear 22.7
container 20.1
wet 19.7
close 19.4
drop 19
splash 18.9
reflection 18.3
transparent 17
beverage 15.5
drops 15.1
shower curtain 15
alcohol 14.2
clean 13.4
bubble 13.2
curtain 12.8
fresh 12.4
frozen 12.4
vase 12.2
bar 12
purity 12
texture 11.8
refreshment 11.8
paper 11.7
pattern 11.6
splashing 11.6
sketch 11.3
drawing 11.3
old 11.1
vessel 11
ice cube 10.9
design 10.8
freshness 10.8
droplet 10.7
cubes 10.6
cocktail 10.6
frost 10.6
vintage 10.5
shape 10.4
pure 10.2
crystal 10.2
square 10
blind 9.9
protective covering 9.9
icy 9.8
refresh 9.7
jar 9.7
backgrounds 9.7
cube 9.7
aqua 9.5
shiny 9.5
elegant 9.4
furnishing 9.4
grunge 9.4
antique 9.3
solid 9.3
art 9.3
decoration 9.1
single 9
h2o 8.8
objects 8.7
party 8.6
bubbles 8.5
color 8.3
cash 8.2
smooth 8.2
retro 8.2
refrigerator 8.2
currency 8.1
representation 7.9
tumbler 7.9
frigid 7.9
slippery 7.9
crystals 7.9
melt 7.8
azure 7.8
refraction 7.8
pour 7.8
money 7.7
mirror 7.6
gold 7.4
covering 7.2
bank 7.2
financial 7.1

Google
created on 2019-06-01

Photograph 95.1
Photography 62.4
Stock photography 62.1
Black-and-white 56.4
Team 52.3
Art 50.2

Microsoft
created on 2019-06-01

text 99
posing 96.4
person 86.6
human face 85.9
clothing 82.1
old 71.2
wedding dress 52.5

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Disgusted 2.1%
Sad 28.5%
Calm 37.2%
Confused 4%
Surprised 4.7%
Happy 17.5%
Angry 6%

AWS Rekognition

Age 26-43
Gender Male, 54.7%
Angry 45.3%
Surprised 45.4%
Calm 51.3%
Sad 46.8%
Confused 45.4%
Disgusted 45.4%
Happy 45.4%

AWS Rekognition

Age 26-43
Gender Male, 97%
Calm 68.5%
Surprised 9%
Sad 6%
Confused 2.7%
Disgusted 6.5%
Happy 3%
Angry 4.3%

AWS Rekognition

Age 23-38
Gender Male, 53.1%
Disgusted 45.5%
Sad 50.6%
Happy 46.6%
Confused 45.6%
Surprised 45.4%
Angry 45.3%
Calm 46%

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Disgusted 45.2%
Confused 45.2%
Angry 45.2%
Calm 51.3%
Surprised 45.2%
Happy 45.3%
Sad 47.6%

AWS Rekognition

Age 35-52
Gender Female, 53.2%
Angry 3.1%
Sad 8.2%
Disgusted 4.8%
Surprised 4.3%
Happy 6.7%
Calm 70.8%
Confused 2.1%

AWS Rekognition

Age 26-43
Gender Male, 53.3%
Disgusted 45.4%
Confused 45.4%
Sad 45.8%
Happy 45.3%
Angry 45.3%
Surprised 45.5%
Calm 52.3%

AWS Rekognition

Age 15-25
Gender Male, 54.3%
Angry 45.4%
Sad 46.5%
Surprised 45.5%
Happy 45.4%
Calm 51.4%
Disgusted 45.4%
Confused 45.4%

AWS Rekognition

Age 19-36
Gender Female, 52%
Sad 46.6%
Angry 45.4%
Surprised 45.6%
Calm 49.1%
Disgusted 45.7%
Happy 47%
Confused 45.6%

AWS Rekognition

Age 35-52
Gender Male, 53%
Angry 45.5%
Calm 50.7%
Sad 47.3%
Surprised 45.4%
Disgusted 45.5%
Happy 45.4%
Confused 45.3%

AWS Rekognition

Age 17-27
Gender Female, 51%
Sad 46.9%
Happy 46.6%
Confused 45.8%
Angry 45.8%
Surprised 45.5%
Disgusted 46.3%
Calm 48.1%

AWS Rekognition

Age 26-44
Gender Male, 98.4%
Disgusted 2.3%
Happy 12.7%
Sad 6%
Calm 64.4%
Angry 4.8%
Surprised 5%
Confused 4.8%

AWS Rekognition

Age 26-43
Gender Male, 53.6%
Surprised 45.2%
Happy 45.8%
Disgusted 45.4%
Calm 45.8%
Sad 51.9%
Confused 45.4%
Angry 45.3%

AWS Rekognition

Age 15-25
Gender Female, 52%
Angry 45.4%
Disgusted 45.8%
Happy 45.9%
Sad 46%
Surprised 45.8%
Calm 50.7%
Confused 45.5%

AWS Rekognition

Age 23-38
Gender Male, 53.2%
Angry 45.1%
Disgusted 45.1%
Happy 45%
Sad 54.3%
Surprised 45.1%
Calm 45.3%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 50.9%
Angry 45.3%
Sad 46.7%
Surprised 45.3%
Happy 45.7%
Calm 51.2%
Disgusted 45.3%
Confused 45.5%

AWS Rekognition

Age 45-65
Gender Male, 54.1%
Happy 46%
Sad 46.6%
Confused 45.4%
Angry 45.4%
Disgusted 47%
Surprised 45.5%
Calm 49.1%

AWS Rekognition

Age 17-27
Gender Female, 53.1%
Sad 50.7%
Angry 45.7%
Calm 46.9%
Confused 45.4%
Disgusted 45.6%
Happy 45.4%
Surprised 45.4%

AWS Rekognition

Age 20-38
Gender Female, 52.1%
Happy 45.1%
Angry 46%
Surprised 45.5%
Disgusted 45.4%
Sad 50%
Calm 46.9%
Confused 46%

AWS Rekognition

Age 23-38
Gender Female, 52.7%
Confused 45.5%
Surprised 45.9%
Happy 46%
Calm 45.4%
Sad 50.3%
Disgusted 46.4%
Angry 45.5%

Feature analysis

Amazon

Person 99.2%
Sunglasses 89.1%
Painting 63.1%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 76.9%
a group of kids posing for a photo 54.4%
a vintage photo of a group of people posing for a picture 54.3%