Human Generated Data

Title

Untitled (older man seated at desk, woman standing behind him in front of bookshelves)
Date

c. 1940, printed later
People

Artist: Paul Gittings, American 1900 - 1988
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12959

Human Generated Data

Title

Untitled (older man seated at desk, woman standing behind him in front of bookshelves)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Furniture 99.9
Human 97.8
Person 97.8
Shelf 97.2
Person 95.9
Bookcase 95.7
Table 88.8
Indoors 87.4
Desk 85.1
Coat 80.9
Apparel 80.9
Clothing 80.9
Suit 80.9
Overcoat 80.9
Room 77.2
Couch 70
Living Room 64.5
Screen 63.8
Electronics 63.8
Monitor 62.2
Display 62.2
LCD Screen 61.2
Home Decor 59.1
Window 58.6
Tabletop 57
Sitting 55.9

Clarifai
created on 2019-11-16

people 99.8
adult 98.9
room 97.9
furniture 97
desk 97
man 96.9
one 96.3
leader 95.9
chair 95.4
administration 95.3
two 95.1
home 92.7
woman 91.6
group together 91.5
sit 87.9
portrait 85.9
group 85.7
indoors 84.5
monochrome 84.1
three 79.9

Imagga
created on 2019-11-16

furniture 77
table 56
interior 54.9
room 53
home 42.3
office 40.2
chair 39.4
bookcase 38.2
indoors 37.8
house 36.8
desk 36.2
modern 35.8
furnishing 29.5
indoor 27.4
window 25.7
decor 25.7
floor 23.3
design 22.5
kitchen 21.8
wood 21.7
inside 21.2
sofa 18.2
living 18
file 17.9
luxury 17.2
residential 16.3
seat 15.8
architecture 15.6
glass 15.6
light 15.4
computer 15.4
apartment 14.4
decoration 13.8
domestic 13.7
studio apartment 13.4
comfortable 13.4
style 13.4
sitting 12.9
lamp 12.4
office furniture 12.3
empty 12
business 11.5
dining 11.4
laptop 11.1
cabinet 10.9
lifestyle 10.8
chairs 10.8
man 10.8
working 10.6
wall 10.3
nobody 10.1
elegance 10.1
restaurant 9.8
contemporary 9.4
adult 9.3
classroom 9.3
coffee 9.3
stove 9.2
shelf 9.2
relaxation 9.2
people 8.9
vase 8.7
couch 8.7
work 8.6
mirror 8.6
space 8.5
male 8.5
armchair 8.4
book 8.4
plant 8.2
reflection 8.1
success 8
wooden 7.9
women 7.9
bright 7.9
oven 7.9
blind 7.8
pillow 7.8
3d 7.7
elegant 7.7
flower 7.7
expensive 7.7
plate 7.6
relax 7.6
drink 7.5
technology 7.4
phone 7.4
person 7.3
black 7.2
structure 7.2
job 7.1

Google
created on 2019-11-16

Photograph 96.2
Snapshot 84.7
Black-and-white 82.7
Room 79.1
Furniture 75.2
Photography 67.8
Window 66.9
Monochrome 64.3
Desk 64
Home 63.7
Interior design 59.1
Sitting 54.1
House 53.7
Gentleman 51.3
Building 50.8

Microsoft
created on 2019-11-16

indoor 99.2
window 99.2
furniture 97.4
text 96.8
shelf 93.3
black 88.9
table 88.1
black and white 87.1
book 76.9
desk 69.2
man 61.5
chair 59.7
bookcase 59
office 52.1
person 50.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-52
Gender Male, 98.4%
Happy 0.1%
Sad 3.1%
Confused 0.5%
Disgusted 0.1%
Angry 0.8%
Surprised 0.1%
Calm 95.3%
Fear 0.1%

AWS Rekognition

Age 25-39
Gender Female, 54.9%
Surprised 45%
Calm 53.6%
Fear 45%
Disgusted 45%
Happy 46.2%
Angry 45%
Sad 45%
Confused 45%

AWS Rekognition

Age 23-37
Gender Female, 50.5%
Surprised 49.5%
Disgusted 49.5%
Sad 49.6%
Angry 49.5%
Calm 49.9%
Happy 49.5%
Fear 49.5%
Confused 50%

Microsoft Cognitive Services

Age 54
Gender Female

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Suit 80.9%

Captions

Microsoft

a person sitting at a desk in front of a book shelf 87.9%
a person sitting at a desk in front of a window 87.8%
a person sitting in front of a book shelf 82.2%