Human Generated Data

Title

Tableau

Date

20th century

People

Artist: Conger Metcalf, American 1914 - 1998

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of H.Wade White, in memory of Lottie Helen Lenn, 1962.95

Human Generated Data

Title

Tableau

People

Artist: Conger Metcalf, American 1914 - 1998

Date

20th century

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2020-05-02

Person 98.7
Human 98.7
Art 93
Person 86.3
Painting 86.1
Drawing 77.5
Face 67.5
Person 63.9
Photography 62.4
Portrait 62.4
Photo 62.4
Person 59.2
Girl 57.1
Female 57.1
Sketch 55.9

Clarifai
created on 2020-05-02

people 99.9
group 99.6
art 99.5
illustration 99.4
adult 98.7
print 98.6
painting 98.1
man 95.6
engraving 95
woman 93.9
veil 93.1
child 92.4
interaction 90.4
son 89.5
several 88.3
two 86.1
wear 86
portrait 85
baby 83.9
three 82.6

Imagga
created on 2020-05-02

money 39.1
currency 37.7
cash 35.7
dollar 33.4
finance 31.3
bank 27.8
bill 27.6
banking 25.7
paper 25.1
dollars 25.1
financial 23.2
business 21.9
art 21.4
hundred 21.3
wealth 20.7
sketch 20.2
sculpture 20.1
decoration 19.7
savings 18.7
graffito 18.5
us 18.3
old 18.1
tray 17.9
comic book 17.5
close 17.1
rich 16.8
pay 16.3
loan 16.3
exchange 16.2
history 16.1
drawing 16
vintage 15.7
ancient 15.6
memorial 15.4
brass 15
economy 14.8
bills 14.6
receptacle 14.5
culture 14.5
one 14.2
structure 13.9
note 13.8
investment 13.8
banknote 13.6
franklin 12.8
funds 12.7
banknotes 12.7
states 12.6
finances 12.5
profit 12.4
carving 12.4
stamp 12.2
representation 12.2
church 12
letter 11.9
container 11.9
postmark 11.8
postage 11.8
religion 11.7
market 11.5
mail 11.5
symbol 11.5
newspaper 11.4
detail 11.3
architecture 10.9
postal 10.8
statue 10.7
notes 10.6
united 10.5
capital 10.4
antique 10.4
retro 9.8
black 9.6
payment 9.6
god 9.6
temple 9.5
product 9.3
sign 9
printed 8.9
salary 8.8
wages 8.8
closeup 8.8
creation 8.6
post 8.6
envelope 8.1
object 8.1
concepts 8
stamps 7.9
stone 7.8
rate 7.8
value 7.8
museum 7.8
economic 7.8
change 7.7
daily 7.7
save 7.6
religious 7.5
figure 7.5
monument 7.5
commerce 7.5
number 7.5
historic 7.3
collection 7.2
bookend 7.2
icon 7.1
print media 7

Google
created on 2020-05-02

Microsoft
created on 2020-05-02

text 99.9
drawing 99.4
sketch 98.7
art 87.3
cartoon 83
old 76.1
person 67.5
posing 66
child art 61
painting 18.6

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 21-33
Gender Male, 98%
Disgusted 0.1%
Sad 30.2%
Fear 0%
Surprised 0%
Confused 0.3%
Happy 0.1%
Calm 69%
Angry 0.3%

AWS Rekognition

Age 16-28
Gender Male, 74.9%
Surprised 3.8%
Calm 90.6%
Sad 0.6%
Disgusted 0.3%
Angry 2.3%
Fear 0.2%
Happy 1.5%
Confused 0.8%

AWS Rekognition

Age 19-31
Gender Female, 65.5%
Angry 3.7%
Fear 8.6%
Disgusted 0.7%
Surprised 4.3%
Happy 1.6%
Calm 60.4%
Sad 19.3%
Confused 1.6%

AWS Rekognition

Age 34-50
Gender Male, 95.3%
Confused 11%
Surprised 0.8%
Calm 13.8%
Disgusted 13.8%
Happy 1.4%
Fear 0.7%
Sad 18.3%
Angry 40.2%

AWS Rekognition

Age 16-28
Gender Male, 53.8%
Confused 45.1%
Disgusted 45%
Calm 47.8%
Angry 45.3%
Happy 45%
Fear 45%
Surprised 45%
Sad 51.7%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 22
Gender Male

Feature analysis

Amazon

Person 98.7%
Painting 86.1%

Captions

Microsoft

a group of people posing for a photo 74.7%
an old photo of a group of people posing for the camera 72.8%
an old photo of a group of people posing for a picture 72.7%

Text analysis

Amazon

Me
Me feay
feay
ESSSSS