Human Generated Data

Title

Untitled (group of six men, seated, crowd of men in background)
Date

c. 1870-1890
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.367.55

Human Generated Data

Title

Untitled (group of six men, seated, crowd of men in background)

People

Artist: Unidentified Artist,

Date

c. 1870-1890

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 97.2
Human 97.2
Person 96.7
Person 94.5
Person 92.6
Person 92.3
Person 82.5
Amusement Park 77.4
Theme Park 75.8
Text 75.1
Art 72.6
Painting 72.6
Person 65.4
Canvas 59.6
Carousel 57.8
Machine 55.8
Spoke 55.8
Person 49.7

Clarifai
created on 2018-03-16

vintage 98.7
retro 98.6
people 98.4
old 96.9
antique 95.2
print 94.7
art 94.7
group 94.5
adult 94.5
wear 92.3
man 92.2
paper 92
furniture 91.2
ancient 90.7
illustration 89
no person 87.8
room 86.1
collection 84.5
card 82.6
woman 82.2

Imagga
created on 2018-03-16

vintage 46.3
grunge 40.9
old 40.4
fire screen 35.4
antique 34.8
texture 33.3
retro 31.9
screen 31.9
aged 29
container 26.9
ancient 25.1
border 24.4
frame 24.1
paper 23.5
protective covering 23.3
structure 23.2
art 23.1
decoration 20.8
grungy 19
tray 18.9
covering 18.5
material 17.9
dirty 17.2
damaged 17.2
wall 17.1
pattern 16.4
rusty 16.2
design 15.8
receptacle 15.3
grain 14.8
empty 14.6
wallpaper 14.5
graffito 14.5
black 13.8
decay 13.5
history 13.4
old fashioned 13.3
brass 13.3
historic 12.8
grime 12.7
paint 12.7
style 12.6
memorial 12.6
brown 12.5
space 12.4
graphic 12.4
letter 11.9
stamp 11.8
envelope 11.6
rust 11.6
backdrop 11.5
parchment 11.5
worn 11.5
textured 11.4
blank 11.1
binding 11
global 10.9
architecture 10.9
mottled 10.7
fracture 10.7
crumpled 10.7
crack 10.7
dirt 10.5
text 10.5
postmark 9.9
postage 9.8
ragged 9.7
stains 9.7
detail 9.6
stained 9.6
spot 9.6
mail 9.6
building 9.5
map 9.3
rough 9.1
backgrounds 8.9
box 8.9
printed 8.8
interior 8.8
states 8.7
geography 8.7
stain 8.6
post 8.6
weathered 8.5
textures 8.5
money 8.5
china 8.5
travel 8.4
page 8.3
decorative 8.3
color 8.3
tracery 8.3
artwork 8.2
symbol 8.1
currency 8.1
blackboard 8.1
surface 7.9
postal 7.8
atlas 7.8
faded 7.8
messy 7.7
edge 7.7
culture 7.7
obsolete 7.7
international 7.6
bill 7.6
house 7.5
chest 7.5
gold 7.4
note 7.3
landmark 7.2

Google
created on 2018-03-16

picture frame 74.3
history 67.3
antique 50.5

Microsoft
created on 2018-03-16

old 78.3
picture frame 57.6

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 48-68
Gender Male, 53.4%
Calm 47.9%
Confused 45.1%
Surprised 45.1%
Disgusted 45.1%
Happy 45.3%
Angry 46.9%
Sad 49.7%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Calm 51.4%
Angry 45.5%
Disgusted 45%
Happy 45.1%
Confused 45.8%
Surprised 45.1%
Sad 47.1%

AWS Rekognition

Age 35-52
Gender Female, 52.2%
Happy 48%
Disgusted 45.1%
Calm 45.2%
Sad 51.1%
Confused 45.4%
Angry 45.2%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Male, 50.3%
Confused 49.6%
Sad 49.7%
Angry 49.7%
Calm 49.9%
Happy 49.5%
Surprised 49.5%
Disgusted 49.6%

AWS Rekognition

Age 6-13
Gender Male, 50.3%
Surprised 49.6%
Angry 49.6%
Sad 49.7%
Calm 49.8%
Disgusted 49.6%
Confused 49.6%
Happy 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Sad 50.4%
Disgusted 49.5%
Angry 49.5%
Happy 49.5%
Surprised 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 49-69
Gender Male, 53.8%
Happy 45.4%
Surprised 45.1%
Disgusted 45.1%
Confused 45.2%
Angry 47.1%
Calm 45.5%
Sad 51.5%

AWS Rekognition

Age 38-57
Gender Female, 50.5%
Confused 49.5%
Surprised 49.5%
Happy 49.8%
Angry 49.5%
Disgusted 49.5%
Sad 50.1%
Calm 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Disgusted 49.5%
Happy 49.5%
Angry 49.6%
Surprised 49.5%
Sad 49.9%
Calm 49.9%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Happy 49.6%
Angry 49.7%
Disgusted 49.6%
Calm 49.5%
Sad 50.1%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 29-45
Gender Female, 50.3%
Sad 49.8%
Calm 49.7%
Confused 49.6%
Angry 49.6%
Happy 49.7%
Disgusted 49.6%
Surprised 49.6%

AWS Rekognition

Age 26-44
Gender Male, 50%
Sad 50.5%
Disgusted 49.5%
Surprised 49.5%
Calm 49.5%
Angry 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Male, 54.4%
Confused 45.3%
Surprised 45.1%
Calm 46.5%
Sad 52.4%
Disgusted 45.1%
Happy 45.2%
Angry 45.3%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Confused 49.5%
Happy 49.6%
Sad 49.8%
Angry 49.7%
Disgusted 49.6%
Surprised 49.5%
Calm 49.8%

AWS Rekognition

Age 38-59
Gender Male, 54.7%
Calm 45.1%
Surprised 45%
Angry 45.1%
Sad 54.6%
Disgusted 45%
Confused 45.1%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Sad 50.4%
Calm 49.5%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 38-57
Gender Female, 50.4%
Sad 50.3%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Calm 49.6%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Sad 49.8%
Calm 49.6%
Surprised 49.6%
Angry 49.6%
Disgusted 49.7%
Happy 49.6%
Confused 49.6%

AWS Rekognition

Age 35-53
Gender Female, 50.5%
Surprised 49.5%
Confused 49.5%
Calm 50%
Sad 49.8%
Happy 49.6%
Disgusted 49.5%
Angry 49.5%

AWS Rekognition

Age 17-27
Gender Female, 50.2%
Calm 50.1%
Angry 49.6%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%
Surprised 49.5%
Sad 49.7%

AWS Rekognition

Age 14-25
Gender Female, 50.1%
Surprised 49.5%
Angry 49.6%
Sad 49.7%
Calm 49.9%
Disgusted 49.6%
Confused 49.7%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Surprised 49.5%
Confused 49.5%
Disgusted 49.6%
Calm 49.7%
Angry 49.5%
Sad 50%
Happy 49.6%

Microsoft Cognitive Services

Age 51
Gender Male

Feature analysis

Amazon

Person 97.2%
Painting 72.6%

Captions

Microsoft

a group of people posing for a photo 60.7%
an old photo of a group of people posing for the camera 56.6%
an old photo of a group of people posing for a picture 56.5%

Text analysis

Amazon

H{@HOH
taes