Human Generated Data

Title

Untitled (man in checkered coat and hat looking into mirror)

Date

c. 1948

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14754

Human Generated Data

Title

Untitled (man in checkered coat and hat looking into mirror)

People

Artist: Jack Gould, American

Date

c. 1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.4
Human 99.4
Person 98.1
Art 90.8
Drawing 83.1
Flooring 80.9
Clothing 79.6
Apparel 79.6
Sketch 72.3
Floor 72.2
Photography 63.8
Photo 63.8
Art Gallery 57.2
Wood 56.3

Imagga
created on 2022-01-29

cleaner 25.1
person 24.4
man 24.2
home 23.9
interior 23.9
crutch 23
adult 22.9
indoors 22.8
people 21.7
male 21.4
smiling 20.2
room 19.3
happy 18.8
staff 17.8
house 17.5
one 17.2
casual 16.1
looking 16
holding 15.7
portrait 14.9
fashion 14.3
lifestyle 13.7
stick 13.7
happiness 13.3
women 12.6
smile 12.1
light 12
pretty 11.9
clothing 11.7
sitting 11.2
window 11
device 10.6
business 10.3
black 10.2
dress 9.9
professional 9.7
lady 9.7
furniture 9.7
standing 9.6
wall 9.5
hair 9.5
luxury 9.4
model 9.3
inside 9.2
office 9.1
indoor 9.1
refrigerator 9
style 8.9
work 8.8
door 8.8
couple 8.7
cute 8.6
face 8.5
attractive 8.4
laptop 8.2
student 8.1
cheerful 8.1
businessman 7.9
modern 7.7
clothes 7.5
fun 7.5
child 7.3
alone 7.3
lamp 7.3
grandfather 7.2
sexy 7.2
working 7.1

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

wall 99.7
drawing 98.4
sketch 93.7
text 90.1
art 89.1
clothing 87.4
man 86.9
person 85.8
black and white 82.1
standing 81.8
painting 51.3

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 89.9%
Calm 45.4%
Surprised 35.7%
Sad 8.2%
Disgusted 4%
Confused 3%
Fear 1.9%
Angry 0.8%
Happy 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 88.5%
a man standing in front of a mirror 88.4%
a man that is standing in front of a mirror posing for the camera 83.8%