Human Generated Data

Title

Jonathan and Kevin + Toby Scott-Hynes. October 9, 1994
Date

1994
People

Artist: Elsa Dorfman, American 1937 - 2020
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Jonathan Scott and Toby "Scott-Hynes" in loving memory of Kevin Hynes, P1998.59
Copyright

© Elsa Dorfman

Human Generated Data

Title

Jonathan and Kevin + Toby Scott-Hynes. October 9, 1994

People

Artist: Elsa Dorfman, American 1937 - 2020

Date

1994

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Apparel 100
Clothing 100
Human 99.5
Person 99.5
Person 98.3
Footwear 98
Pants 97
Sitting 95.9
Boot 81.2
Jeans 76.1
Denim 76.1
Wood 70.5
Shoe 67.9
Shoe 61.9
Plywood 55.8
Riding Boot 55.6
Shoe 50.9

Clarifai
created on 2018-02-19

man 97.3
people 96.3
indoors 94.9
adult 94
sit 93.6
two 92.9
furniture 91.4
woman 91.3
room 91.2
family 87.7
wear 87.5
seat 86.6
portrait 86.2
business 82.7
togetherness 82.5
sitting 80.9
looking 80.7
technology 79
one 78.9
chair 78.5

Imagga
created on 2018-02-19

man 43
male 38.1
person 34.4
happy 30.7
people 30.7
smiling 26
adult 25
couple 24.4
home 23.9
portrait 21.3
casual 21.2
lifestyle 21
sitting 20.6
grandfather 19.9
family 19.6
smile 18.5
together 18.4
attractive 17.5
boy 17.4
handsome 16.9
senior 16.9
looking 16.8
father 16.1
mature 15.8
love 15.8
child 15.7
couch 15.5
holding 14.9
dad 14.1
indoors 14.1
20s 13.7
life 12.9
fun 12.7
two 12.7
elderly 12.4
room 12.4
cute 12.2
lady 12.2
clothing 12
guy 11.1
happiness 11
house 10.9
jeans 10.5
mother 10.3
business 10.3
professional 10.1
indoor 10
confident 10
face 9.9
pretty 9.8
parent 9.8
cheerful 9.8
husband 9.7
retired 9.7
living 9.5
hairdresser 9.5
student 9.4
camera 9.2
occupation 9.2
health 9
human 9
kid 8.9
job 8.8
businessman 8.8
son 8.8
retirement 8.6
day 8.6
sofa 8.6
men 8.6
wife 8.5
old 8.4
joy 8.3
group 8.1
office 8
kin 7.8
patient 7.8
30s 7.7
loving 7.6
enjoying 7.6
sit 7.6
laughing 7.6
fashion 7.5
relaxed 7.5
one 7.5
glasses 7.4
care 7.4
friendly 7.3
alone 7.3
domestic 7.2

Google
created on 2018-02-19

photograph 95.2
poster 73
fun 59.3

Microsoft
created on 2018-02-19

person 99.9
wall 99.1
man 95.9
indoor 92.3
posing 38.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 99.7%
Angry 1.4%
Happy 92.9%
Calm 0.2%
Sad 0.4%
Confused 0.9%
Surprised 2.6%
Disgusted 1.6%

AWS Rekognition

Age 26-43
Gender Male, 99.8%
Surprised 5.5%
Angry 5.6%
Disgusted 2.9%
Confused 1.5%
Happy 83.4%
Calm 0.5%
Sad 0.7%

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 67.9%

Captions

Microsoft

a man and a woman sitting on a couch 66%
a man holding a sign 65.9%
a man and woman sitting on a couch 61.5%

Text analysis

Amazon

MARTIN
SAIN MARTIN
SAIN
ant
/9gh
/9gh oupuis
Jott.
Sokfr
e
oupuis
Jott. ant A Hy Sokfr Ip e
Hy
Ip
A

Google

ANT MAR /994
ANT
MAR
/994