Human Generated Data

Title

Untitled (woman and man dressed up and seated on sofa)
Date

c. 1950, printed later
People

Artist: John Deusing, American active 1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.179

Human Generated Data

Title

Untitled (woman and man dressed up and seated on sofa)

People

Artist: John Deusing, American active 1940s

Date

c. 1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Furniture 100
Person 99.5
Human 99.5
Clothing 99.4
Apparel 99.4
Person 98.3
Couch 95.5
Hat 94.9
Footwear 89
Shoe 89
Living Room 77.6
Indoors 77.6
Room 77.6
Sun Hat 72.4
Cowboy Hat 71.3
Cushion 66.4
Sitting 65.4
Shoe 57

Imagga
created on 2021-12-14

sitting 44.7
home 39.1
person 34.9
grandfather 34.2
man 32.3
couch 31.9
chair 31.1
room 29.7
sofa 29.3
happy 27.6
armchair 27
adult 25.4
male 24.8
smiling 24.6
people 22.9
smile 22.8
indoors 22
lifestyle 21
furniture 20.9
living 20.9
interior 19.5
seat 19.3
house 19.2
hat 19.1
attractive 18.9
casual 18.6
indoor 18.3
cowboy hat 17.7
business 17.6
portrait 17.5
laptop 17.4
clothing 16.9
looking 16.8
work 16.7
couple 16.6
sit 16.1
happiness 15.7
jeans 15.3
bench 15.2
relax 15.2
leisure 14.9
relaxing 14.6
scholar 13.4
pretty 13.3
computer 12.9
apartment 12.5
relaxed 12.2
office 12
domestic 11.9
relaxation 11.7
job 11.5
headdress 11.4
cheerful 11.4
modern 11.2
one 11.2
love 11
student 10.9
handsome 10.7
face 10.7
working 10.6
color 10.6
fashion 10.6
success 10.5
reading 10.5
women 10.3
alone 10
rest 10
intellectual 9.9
living room 9.8
family 9.8
businessman 9.7
full length 9.7
comfort 9.6
together 9.6
comfortable 9.5
resting 9.5
kin 9.5
child 9.4
book 9.3
human 9
look 8.8
professional 8.7
cute 8.6
corporate 8.6
men 8.6
model 8.6
executive 8.4
occupation 8.2
successful 8.2
technology 8.2
style 8.2
mother 8.1
lady 8.1
notebook 8
pillow 8
luxury 7.7
mid adult 7.7
guy 7.7
youth 7.7
husband 7.6
career 7.6
horizontal 7.5
floor 7.4
glasses 7.4
20s 7.3
businesswoman 7.3
worker 7.1
day 7.1

Google
created on 2021-12-14

Clothing 98.7
Outerwear 95.1
Furniture 94.3
Picture frame 92.8
Hat 89.2
Coat 88.9
Style 83.9
Suit 82
Sun hat 79.2
Classic 76.4
Vintage clothing 76.2
Monochrome 74.1
Rectangle 73.9
Blazer 72.9
Monochrome photography 71.4
Room 70.7
Chair 69.9
Sitting 68.2
Stock photography 63.3
Formal wear 62.7

Microsoft
created on 2021-12-14

text 97.7
sitting 95.9
clothing 94.9
person 90.7
man 88.2
hat 86.8
drawing 84
sketch 77
furniture 68.1
fashion accessory 67
old 63.7
cartoon 54.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-47
Gender Female, 98.9%
Surprised 89.2%
Calm 3.4%
Confused 2.9%
Happy 1.9%
Angry 1.7%
Fear 0.4%
Disgusted 0.3%
Sad 0.3%

AWS Rekognition

Age 17-29
Gender Male, 98%
Calm 99.2%
Angry 0.5%
Surprised 0.1%
Sad 0.1%
Happy 0%
Confused 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Couch 95.5%
Hat 94.9%
Shoe 89%

Captions

Microsoft

a group of people sitting on a bench 91.1%
a man and a woman sitting on a bench 81.2%
a man and woman sitting on a bench 78.8%