Human Generated Data

Title

Untitled (man in office and men outside of Biggie's steak shop)

Date

1946

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15993

Human Generated Data

Title

Untitled (man in office and men outside of Biggie's steak shop)

People

Artist: Jack Gould, American

Date

1946

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Human 99.3
Sitting 99.3
Person 99.2
Person 98.4
Indoors 83.1
Furniture 77.4
Flooring 76.2
Room 74.5
Crowd 68.2
Desk 67.7
Table 67.7
Electronics 65.3
Screen 65.3
Living Room 64.4
Blonde 59.7
Kid 59.7
Girl 59.7
Woman 59.7
Child 59.7
Female 59.7
Teen 59.7
Pc 59.5
Computer 59.5
People 59.3
Monitor 59.3
Display 59.3
Couch 59.1
Lamp 57.4
Table Lamp 57.4

Imagga
created on 2022-03-25

interior 63.7
room 59.7
furniture 55.2
case 52.7
house 50.1
home 49.4
window 33.4
architecture 32
lamp 31.7
table 31.4
decor 30.9
luxury 30.9
modern 29.4
design 27.6
apartment 25.9
wood 25.8
indoors 25.5
residential 24.9
wall 23.8
structure 23.2
floor 23.2
glass 22.6
altar 22
chair 21.1
comfortable 20
domestic 19.9
inside 19.3
living 19
panel 18.9
light 18.7
decoration 18.1
bathroom 18
hotel 17.2
upright 16.8
estate 16.1
elegance 16
cabinet 15.9
sofa 15.6
style 15.6
relaxation 15.1
kitchen 14.8
3d 14.7
elegant 14.6
mansion 13.7
piano 13.6
bedroom 13.2
wooden 13.2
mirror 12.4
real 12.3
indoor 11.9
carpet 11.7
pillow 11.7
chandelier 11.5
furnishing 11.3
shelf 11
relax 11
tile 10.7
bath 10.4
stringed instrument 10.4
keyboard instrument 10.3
percussion instrument 10.3
rest 10.2
seat 10.2
clock 10.1
nobody 10.1
vase 9.7
contemporary 9.4
sink 9.3
classic 9.3
stylish 9
building 9
bed 9
vessel 9
ceiling 8.8
curtain 8.8
tub 8.8
lighting 8.7
render 8.7
basin 8.6
old 8.4
clean 8.3
frame 8.3
cushion 7.9
washstand 7.9
musical instrument 7.8
chairs 7.8
residence 7.8
stove 7.8
decorating 7.8
travel 7.7
expensive 7.7
towel 7.6
dining 7.6
lifestyles 7.6
plant 7.5
lights 7.4
antique 7.4
counter 7.2
washbasin 7.1

Google
created on 2022-03-25

Microsoft
created on 2022-03-25

wall 99.9
indoor 98.9
table 95.5
white 83.8
interior 64.4
text 62.4
black and white 54.3
kitchen 50.7
furniture 35.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 98.2%
Angry 1.1%
Confused 0.2%
Disgusted 0.1%
Sad 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 99.8%
Calm 63.5%
Sad 30.2%
Confused 4.6%
Fear 0.6%
Surprised 0.5%
Disgusted 0.3%
Angry 0.3%
Happy 0.1%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 38
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Desk 67.7%

Captions

Microsoft

an old photo of a living room 91%
old photo of a living room 89.9%
an old photo of a living room with a sink and a mirror 69.3%