Human Generated Data

Title

Untitled (man posed holding two black dogs while sitting on couch)
Date

c. 1960
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10171

Human Generated Data

Title

Untitled (man posed holding two black dogs while sitting on couch)

People

Artist: Martin Schweig, American 20th century

Date

c. 1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Accessories 98.4
Accessory 98.4
Tie 98.4
Apparel 96.9
Clothing 96.9
Human 95.8
Person 95.8
Hair 93.6
Cushion 87.1
Pillow 81.1
Face 62.9
Door 61.5
People 61
Shoe 58.2
Footwear 58.2
Furniture 57.8
Person 52.6

Clarifai
created on 2021-04-03

people 99.7
adult 98
two 97.5
man 97.3
woman 96.5
portrait 93.6
music 93.4
wear 92.9
actress 91
one 89.7
sit 88.4
love 88.2
indoors 87.9
facial expression 87.4
outfit 86.8
family 85.1
furniture 84.2
musician 82.2
monochrome 81.3
actor 80.4

Imagga
created on 2021-04-03

person 38.1
happy 33.2
people 32.9
home 31.9
man 27.6
adult 26.9
portrait 23.3
male 23.2
smiling 23.1
lifestyle 23.1
child 22.7
bow tie 22.6
casual 22
couple 21.8
smile 21.4
family 20.5
attractive 19.6
necktie 19.2
love 18.9
indoors 18.4
together 18.4
happiness 18
cheerful 17.9
clothing 17.7
couch 17.4
sitting 17.2
mother 17
book 16.9
boy 16.5
indoor 16.4
face 16.3
room 15.8
looking 15.2
kid 15.1
women 15
domestic 14.8
senior 13.1
father 12.6
sofa 12.5
leisure 12.5
parent 12.4
garment 12.2
mature 12.1
blond 12.1
one 11.9
pretty 11.9
holding 11.6
professional 11.1
joyful 11
two 11
alone 11
cute 10.8
only 10.5
reading 10.5
old 10.5
living 10.4
expression 10.2
grandma 10.2
20s 10.1
children 10
handsome 9.8
computer 9.7
fun 9.7
interior 9.7
hair 9.5
day 9.4
son 9.3
house 9.2
joy 9.2
playing 9.1
business 9.1
brother 9
technology 8.9
living room 8.8
retired 8.7
eyes 8.6
men 8.6
loving 8.6
laptop 8.6
marriage 8.5
enjoying 8.5
youth 8.5
relaxed 8.4
color 8.3
camera 8.3
fashion 8.3
human 8.2
dad 8.2
teenager 8.2
office 8.2
husband 8.2
dress 8.1
lady 8.1
success 8
job 8
work 8
holiday 7.9
grandmother 7.8
black 7.8
education 7.8
scholar 7.7
1 7.7
read 7.7
retirement 7.7
elderly 7.7
daughter 7.6
laughing 7.6
learning 7.5
relationship 7.5
care 7.4
single 7.4
teen 7.4
businesswoman 7.3
executive 7.3
adolescent 7.1
romantic 7.1
suit 7.1

Google
created on 2021-04-03

Smile 91.7
Gesture 85.3
Happy 85.2
Style 83.9
Tie 82.6
Vintage clothing 74.7
Monochrome photography 72.5
Formal wear 71.7
Monochrome 70.7
Photo caption 70
Room 69.4
Eyewear 69.2
Font 68.4
Sitting 68
Event 68
Pattern 67.3
Suit 66.9
Rectangle 66.1
Romance 65.5
Sunglasses 64.3

Microsoft
created on 2021-04-03

person 99.5
human face 86.2
indoor 85.3
clothing 82.7
text 80.7
window 80.6
smile 70.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-50
Gender Male, 88%
Happy 99.8%
Surprised 0.1%
Calm 0%
Confused 0%
Angry 0%
Sad 0%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 98.4%
Person 95.8%

Captions

Microsoft

a man and woman sitting next to a window 58.5%
a man and a woman sitting in front of a window 58.4%
a man and a woman sitting next to a window 58.3%

Text analysis

Amazon

SAINT
PROOS
SAINT I_OUIS
I_OUIS
AIRRIN
AIRRIN JDIHMVIEI
JDIHMVIEI

Google

(CHWEIG
PROCE ARTIN J (CHWEIG SAINT OUIS
ARTIN
PROCE
SAINT
J
OUIS