Human Generated Data

Title

Untitled (man carrying baskets of vegetables)
Date

c. 1870-c. 1890
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.367.27

Human Generated Data

Title

Untitled (man carrying baskets of vegetables)

People

Artist: Unidentified Artist,

Date

c. 1870-c. 1890

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.367.27

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 98.5
Person 98.5
Person 98.3
Person 95.5
Person 95
Person 88.6
Person 84.7
Person 83.3
Vehicle 81.5
Transportation 81.5
Person 78.5
Advertisement 75.5
Person 72.8
Wheel 71.9
Machine 71.9
Poster 68.2
Person 67.4
Bike 63.6
Collage 59.8
Bicycle 58.3
Building 56.6
Housing 56.6
Spoke 55.2
Person 44
Person 43.5

Clarifai
created on 2018-03-16

collection 99.6
people 99.6
illustration 98.9
group 98.5
adult 98.2
print 97.8
many 97.4
woman 97.4
set 96
man 95.6
no person 94.8
art 93.8
collage 91.6
picture frame 87.9
indoors 86.3
painting 86
lithograph 85.7
text 85.6
shelf 84.5
fashion 83.8

Imagga
created on 2018-03-16

case 72
old 34.8
vintage 34.7
shelf 24
texture 22.9
paper 21.9
art 21.9
antique 21.8
retro 21.3
design 20.2
frame 20
ancient 19
grunge 18.7
decoration 16.8
aged 15.4
pattern 13.7
religion 13.4
blank 12.8
collection 12.6
brown 12.5
gold 12.3
postage 11.8
door 11.7
mail 11.5
post 11.4
style 11.1
culture 11.1
letter 11
book 10.9
stamp 10.9
postmark 10.8
postal 10.8
wallpaper 10.7
decor 10.6
unique 10.4
wall 10.2
artwork 10.1
flower 10
border 9.9
temple 9.5
furniture 9.5
drawing 9.4
architecture 9.4
floral 9.3
church 9.2
decorative 9.2
wood 9.2
glass 9.1
paint 9
symbol 8.7
icon 8.7
covering 8.4
screen 8.2
dirty 8.1
painting 8.1
history 8
detail 8
graphic 8
yellow 7.9
holiday 7.9
album 7.8
museum 7.7
golden 7.7
card 7.6
worn 7.6
painted 7.6
finance 7.6
china 7.5
traditional 7.5
plant 7.5
element 7.4
backdrop 7.4
greeting 7.4
close 7.4
cover 7.4
cash 7.3
global 7.3
office 7.2
currency 7.2
home 7.2
material 7.1
structure 7.1
interior 7.1
surface 7

Google
created on 2018-03-16

picture frame 72.8
collection 65.9

Microsoft
created on 2018-03-16

shelf 86.9
different 58
bunch 42.8
various 42.7
several 11.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 53.9%
Disgusted 46%
Surprised 45.2%
Sad 51.9%
Calm 45.5%
Angry 46%
Happy 45.3%
Confused 45.1%

AWS Rekognition

Age 15-25
Gender Female, 50.5%
Sad 50.3%
Calm 49.6%
Surprised 49.5%
Angry 49.5%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.1%
Disgusted 49.6%
Sad 49.7%
Calm 49.6%
Surprised 49.7%
Happy 49.5%
Confused 49.6%
Angry 49.8%

AWS Rekognition

Age 35-52
Gender Female, 50%
Sad 49.9%
Calm 49.7%
Angry 49.6%
Surprised 49.6%
Confused 49.5%
Happy 49.6%
Disgusted 49.6%

AWS Rekognition

Age 16-27
Gender Female, 50.5%
Sad 50.4%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Calm 49.5%
Happy 49.6%
Confused 49.5%

AWS Rekognition

Age 45-65
Gender Male, 50.5%
Surprised 49.5%
Disgusted 49.5%
Calm 50.4%
Confused 49.5%
Angry 49.5%
Happy 49.5%
Sad 49.5%

AWS Rekognition

Age 16-27
Gender Female, 50.4%
Disgusted 49.6%
Surprised 49.5%
Sad 50%
Calm 49.5%
Angry 49.6%
Happy 49.8%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Disgusted 49.5%
Sad 49.7%
Calm 49.5%
Surprised 49.5%
Happy 49.6%
Confused 49.5%
Angry 50.1%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Calm 49.6%
Surprised 49.6%
Confused 49.6%
Angry 49.6%
Sad 49.7%
Happy 49.9%
Disgusted 49.5%

AWS Rekognition

Age 11-18
Gender Female, 50.4%
Happy 49.5%
Confused 49.5%
Angry 49.5%
Disgusted 49.5%
Sad 49.9%
Calm 50%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Confused 49.6%
Calm 49.9%
Angry 49.7%
Sad 49.6%
Surprised 49.6%
Disgusted 49.5%
Happy 49.5%

Feature analysis

Amazon

Person 98.5%
Wheel 71.9%
Bicycle 58.3%

Categories

Imagga

paintings art 99.8%
interior objects 0.1%
streetview architecture 0.1%

Captions

Microsoft
created on 2018-03-16

a store shelf filled with books 46.1%
a display case 46%
a shelf filled with books 42.3%

Text analysis

Amazon

ya-:3
79.:
403
/-11134154
44.480.22