Human Generated Data

Title

Untitled (man, woman, and three children in living room)

Date

1946

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15992.2

Human Generated Data

Title

Untitled (man, woman, and three children in living room)

People

Artist: Jack Gould, American

Date

1946

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Furniture 99.9
Human 98.7
Person 98.7
Person 97.1
Couch 94.8
Painting 88.9
Art 88.9
Room 86
Indoors 86
Living Room 86
Person 84.6
Home Decor 84.1
Person 75.8
Person 70.1
Interior Design 67.1
Chair 63.6
Curtain 56.3
Person 46.8

Imagga
created on 2022-02-05

newspaper 61.4
product 49
creation 37.9
room 23.7
home 16.7
old 16.7
shop 16.5
window 16.2
door 15.1
house 15
classroom 14.9
barbershop 13.5
people 13.4
interior 13.3
vintage 13.2
building 13
grunge 12.8
light 12.7
indoor 11.9
mercantile establishment 11.6
modern 11.2
architecture 10.9
black 10.8
man 10.7
wall 10.3
frame 10
retro 9.8
texture 9
person 9
design 9
new 8.9
indoors 8.8
antique 8.6
men 8.6
male 8.5
blackboard 8.3
aged 8.1
dirty 8.1
chair 8.1
decoration 8
working 7.9
women 7.9
business 7.9
adult 7.8
portrait 7.8
place of business 7.7
sitting 7.7
drawing 7.6
work 7.4
sliding door 7.3
holiday 7.2
decor 7.1

Google
created on 2022-02-05

Microsoft
created on 2022-02-05

text 92.1
window 85.5
person 75
room 74.2
clothing 61.7
gallery 59.5

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 99.2%
Calm 91.1%
Happy 7.3%
Confused 0.5%
Sad 0.4%
Surprised 0.3%
Disgusted 0.3%
Fear 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Painting 88.9%

Captions

Microsoft

a group of people sitting in a room 85.5%
a group of people in a room 85.4%
a group of people sitting around a living room 74.7%