Human Generated Data

Title

Saint Barbara (right panel)

Date

16th century

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mr. and Mrs. Robert G. Stone in memory of Galen L. Stone, 1953.59.C

Human Generated Data

Title

Saint Barbara (right panel)

People

Artist: Unidentified Artist,

Date

16th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 97.8
Human 97.8
Person 97.2
Person 97.2
Person 96.9
Painting 96.7
Art 96.7
Person 93.3
Person 81.6
Text 58.1
Person 51.8
Person 48.8

Clarifai
created on 2020-04-24

people 100
group 99.8
adult 99.4
print 98.7
woman 97.2
wear 97.1
man 96.7
two 96.4
art 96
three 94.5
gown (clothing) 93.5
many 91.2
administration 90.8
leader 90.6
illustration 90.4
four 89.5
one 89.1
five 88.5
monarch 88.1
portrait 88

Imagga
created on 2020-04-24

drawing 100
sketch 100
representation 92.8
old 22.3
art 21.5
history 20.6
architecture 20.3
sculpture 17.2
money 15.3
bank 14.4
cash 13.7
building 13.6
statue 13.3
dollar 13
antique 13
ancient 13
book jacket 12.6
city 12.5
vintage 12.4
historical 12.2
window 12.1
historic 11.9
currency 11.7
financial 11.6
business 11.5
detail 11.3
rich 11.2
church 11.1
finance 11
paper 11
landmark 10.8
wealth 10.8
dollars 10.6
monument 10.3
famous 10.2
black 10.2
banking 10.1
symbol 10.1
house 10
retro 9.8
jacket 9.8
one 9.7
close 9.7
decoration 9.6
bill 9.5
closeup 9.4
man 9.4
culture 9.4
savings 9.3
stone 9.3
travel 9.2
design 9
religion 9
bills 8.7
us 8.7
pay 8.6
god 8.6
grunge 8.5
franklin 7.9
states 7.7
loan 7.7
capital 7.6
human 7.5
wrapping 7.5
tourism 7.4
figure 7.2
home 7.2

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

text 91.8
clothing 90.5
person 89.5
painting 73.5
woman 72.2
old 70.1
posing 61.6
group 59.5
people 59.1
drawing 52.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 98.2%
Happy 0.2%
Calm 96.6%
Sad 1.4%
Disgusted 1.2%
Fear 0%
Surprised 0.2%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 1-7
Gender Male, 52.9%
Happy 45.6%
Confused 45.6%
Disgusted 45.3%
Sad 45.4%
Fear 45.4%
Angry 48.3%
Calm 48.5%
Surprised 45.9%

AWS Rekognition

Age 18-30
Gender Female, 98.1%
Happy 0.2%
Fear 0%
Disgusted 0.1%
Surprised 0.1%
Sad 1.8%
Confused 0.3%
Calm 97.5%
Angry 0.1%

AWS Rekognition

Age 50-68
Gender Male, 91.8%
Angry 4.2%
Surprised 2.6%
Confused 8.3%
Disgusted 19.5%
Happy 0.4%
Calm 17.6%
Fear 1.6%
Sad 45.8%

AWS Rekognition

Age 23-37
Gender Female, 99.3%
Angry 1.1%
Calm 74.3%
Fear 0.6%
Sad 20.3%
Confused 1.7%
Happy 0.5%
Surprised 0.8%
Disgusted 0.7%

AWS Rekognition

Age 24-38
Gender Female, 54.2%
Angry 45%
Calm 54.4%
Disgusted 45%
Happy 45.2%
Fear 45%
Confused 45%
Surprised 45%
Sad 45.3%

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Painting 96.7%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 81.2%
a vintage photo of a group of people posing for a picture 81.1%
a group of people posing for a photo 81%

Text analysis

Amazon

AMAWno

Google

हय MASTER OF FRANKFORT
OF
हय
MASTER
FRANKFORT