Human Generated Data

Title

Untitled (family scene)

Date

c. 1887

People

Artist: Adolfo Farsari, American 1841 - 1898

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.3.14.1

Human Generated Data

Title

Untitled (family scene)

People

Artist: Adolfo Farsari, American 1841 - 1898

Date

c. 1887

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.4
Human 99.4
Apparel 97.5
Clothing 97.5
Helmet 97.5
Person 95.1
Person 91.9
Helmet 88.5
Art 83.6
Coat 68.5
Photo 66.7
Photography 66.7
Portrait 63.1
Face 63.1
Painting 62.8
Hat 61.8

Clarifai
created on 2018-03-16

people 99
lid 98.8
man 97.8
adult 97.1
indoors 95
painting 95
woman 94.3
room 93.8
art 93.7
illustration 90.5
wall 90
wear 88.9
two 88.2
veil 87.5
family 86.1
actor 85.4
one 85.2
expression 84.9
bill 84.3
business 84

Imagga
created on 2018-03-16

bag 33
container 31.8
purse 25.8
envelope 13.4
shoe 12.4
black 11.4
fun 11.2
card 11
paper 11
vintage 10.7
holiday 10.7
clothing 10.6
old 10.4
adult 10.3
business 10.3
gift 10.3
stamp 10.3
snow 10.3
winter 10.2
casual 10.2
footwear 10.1
present 10
sandal 9.9
fashion 9.8
celebration 9.6
person 9.5
people 9.5
box 9.3
shopping 9.2
letter 9.2
postage 8.8
man 8.7
play 8.6
mail 8.6
cold 8.6
money 8.5
sport 8.4
shop 8.4
pretty 8.4
color 8.3
retro 8.2
paint 8.1
active 8.1
colorful 7.9
postmark 7.9
season 7.8
grunge 7.7
store 7.5
poster 7.5
sale 7.4
covering 7.2

Google
created on 2018-03-16

Microsoft
created on 2018-03-16

indoor 94.4
gallery 87.1
room 84.7
picture frame 44.6

Face analysis

Amazon

AWS Rekognition

Age 1-5
Gender Female, 54%
Calm 45%
Disgusted 45%
Angry 45%
Surprised 45%
Confused 45%
Sad 54.9%
Happy 45%

AWS Rekognition

Age 1-5
Gender Female, 51.7%
Disgusted 45.2%
Calm 47.7%
Confused 45.8%
Surprised 45.5%
Sad 49.7%
Happy 45.3%
Angry 45.8%

AWS Rekognition

Age 6-13
Gender Female, 52.4%
Surprised 45.6%
Confused 45.6%
Disgusted 45.3%
Calm 48.3%
Angry 45.7%
Sad 48.3%
Happy 46.2%

AWS Rekognition

Age 14-25
Gender Male, 53.6%
Sad 47.8%
Surprised 45.2%
Disgusted 45.1%
Confused 45.2%
Calm 47.4%
Happy 45.1%
Angry 49.2%

Feature analysis

Amazon

Person 99.4%
Helmet 97.5%
Painting 62.8%

Captions

Microsoft

a bathroom with a sink and a mirror in a room 17.3%
a bathroom with a sink and a mirror 17.2%
a bathroom with a sink and mirror in a room 16.3%