Human Generated Data

Title

Royal Household

Date

c. 1920-1950s

People

Artist: Felipe Jesus Consalvos, American 1891-c.1960

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Collection of Didi & David Barrett ‘71, 2011.45

Human Generated Data

Title

Royal Household

People

Artist: Felipe Jesus Consalvos, American 1891-c.1960

Date

c. 1920-1950s

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 98.5
Person 98.5
Car 96.7
Automobile 96.7
Transportation 96.7
Vehicle 96.7
Person 96.1
Person 95.5
Advertisement 95.3
Person 95.3
Person 94.8
Person 88.4
Collage 88
Person 84
Person 82.9
Person 79.5
Spoke 77.6
Machine 77.6
Wheel 77.3
Person 74.3
Art 69.4
Tire 69.2
Paper 59.7
Brochure 59.7
Flyer 59.7
Text 58.9
Car Wheel 56.2
Billboard 55.4
Poster 50.2
Person 48.5

Clarifai
created on 2018-02-09

people 99.6
vehicle 99.5
transportation system 96.6
car 96.6
painting 95.7
woman 95.6
adult 95.5
man 93.4
art 90.2
print 89.1
group 87.9
vintage 87.5
illustration 86
retro 85.8
old 82.1
music 81.2
furniture 80.2
veil 79.2
seat 79.1
wear 77.2

Imagga
created on 2018-02-09

vintage 32.2
container 27.7
art 25.1
postage 22.6
postal 22.6
letter 22
stamp 21.3
mail 21
old 20.2
postmark 19.7
envelope 19.1
printed 18.7
retro 18
post 17.2
card 16.1
tray 16.1
frame 15.9
shows 15.7
black 15
design 14.7
delivery 13.6
cutting 13.5
symbol 13.5
communications 13.4
painted 13.3
unique 13.3
receptacle 13
antique 13
circa 12.8
culture 12.8
global 12.8
paint 12.7
decoration 12.4
gold 12.3
ancient 12.1
grunge 11.9
floral 11.9
icon 11.9
zigzag 11.9
stamps 11.8
renaissance 11.8
painter 11.7
paintings 11.7
museum 11.6
letters 11.6
covering 11.5
fine 11.4
money 11
finance 11
elegance 10.9
post mail 10.9
masterpiece 10.9
fame 10.8
known 10.8
wood 10.8
texture 10.4
box 10.4
style 10.4
pattern 10.2
graphic 10.2
church 10.2
note 10.1
blackboard 9.9
currency 9.9
close 9.7
office 9.6
closeup 9.4
cash 9.1
border 9
one 9
history 8.9
canceled 8.9
philately 8.9
wooden 8.8
artist 8.7
paper 8.6
drawing 8.6
elegant 8.6
classic 8.3
message 8.2
aged 8.1
case 8.1
religion 8.1
celebration 8
interior 8
business 7.9
wallet 7.9
binding 7.9
golden 7.7
saint 7.7
wallpaper 7.7
bill 7.6
bag 7.4
object 7.3
artwork 7.3
rug 7.2

Google
created on 2018-02-09

car 97.1
motor vehicle 79.8
automotive design 76.1
art 72.4
poster 70.5
vehicle 70.3
picture frame 67.1
advertising 58
font 52.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 97.9%
Angry 6.1%
Confused 5.9%
Disgusted 4.6%
Happy 47.3%
Surprised 2.8%
Sad 3.7%
Calm 29.5%

AWS Rekognition

Age 26-43
Gender Male, 95.8%
Angry 1.6%
Happy 0.2%
Disgusted 0.4%
Calm 94.1%
Sad 0.8%
Surprised 0.5%
Confused 2.3%

AWS Rekognition

Age 15-25
Gender Male, 57%
Sad 2.3%
Surprised 2.2%
Disgusted 1.4%
Confused 1.9%
Calm 74.4%
Happy 16.2%
Angry 1.6%

AWS Rekognition

Age 10-15
Gender Male, 54.6%
Happy 45.1%
Disgusted 45%
Confused 45.1%
Angry 45%
Surprised 45.1%
Sad 45%
Calm 54.7%

AWS Rekognition

Age 26-43
Gender Female, 98.6%
Confused 6%
Sad 2.6%
Calm 37.7%
Disgusted 3.6%
Angry 5.6%
Happy 37.7%
Surprised 6.8%

AWS Rekognition

Age 20-38
Gender Female, 95.5%
Disgusted 0.5%
Sad 0.2%
Calm 0.5%
Surprised 0.7%
Happy 96.7%
Confused 0.7%
Angry 0.7%

AWS Rekognition

Age 20-38
Gender Female, 91.6%
Happy 7.4%
Confused 10.6%
Sad 4%
Angry 10.8%
Calm 48.4%
Disgusted 4.5%
Surprised 14.3%

AWS Rekognition

Age 35-52
Gender Male, 97.9%
Confused 2.3%
Sad 1.4%
Calm 92.1%
Disgusted 0.3%
Angry 1.5%
Happy 1%
Surprised 1.3%

AWS Rekognition

Age 26-43
Gender Female, 99.6%
Calm 0.1%
Surprised 0.5%
Disgusted 0.3%
Angry 0.3%
Sad 0.2%
Confused 0.4%
Happy 98.2%

AWS Rekognition

Age 16-27
Gender Female, 94.4%
Confused 0.6%
Sad 97.6%
Surprised 0.2%
Angry 0.3%
Calm 0.8%
Happy 0.2%
Disgusted 0.3%

AWS Rekognition

Age 4-9
Gender Male, 58.2%
Happy 0.4%
Sad 1.4%
Surprised 1.7%
Confused 1.1%
Calm 93.4%
Angry 1.4%
Disgusted 0.6%

AWS Rekognition

Age 60-90
Gender Male, 90%
Sad 10.7%
Calm 31.8%
Surprised 2.5%
Angry 44.4%
Disgusted 4.6%
Happy 1.6%
Confused 4.4%

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 46
Gender Female

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 31
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Car 96.7%
Poster 50.2%

Captions

Microsoft

a group of people posing for a photo 49.3%
a group of people in a room 49.2%
a group of people in a store 36.6%

Text analysis

Amazon

HAND
MADE
Peddlers
HAND MADE
THENDORA
THEN
HOUSEHOLD
ROYAL HOUSEHOLD
BLE
HOT-AIR
ROYAL
FASHION
BLE HAND MADE MADE 0oUb HAND MADE OOUBLE
1
OOUBLE
HOT- HOT-AIR AIR
AIR
HOT-
dy FASHION 14 1 1
dy
0oUb
DOO
NteD.
JL
14
e

Google

LDOUB
OoUBL
MADE
HAND
0
L
LDOUB HAND MADE OoUBL LEHAND MADE 0 HOT- ROYAL HOUSE H O L D Peddlers hishay HAND MADEO
LEHAND
HOT-
ROYAL
D
MADEO
HOUSE
H
O
Peddlers
hishay