Human Generated Data

Title

Untitled (man at desk)

Date

early 20th century

People

Artist: Caufield and Shook, American 1903 - 1978

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.160

Human Generated Data

Title

Untitled (man at desk)

People

Artist: Caufield and Shook, American 1903 - 1978

Date

early 20th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.3
Sitting 99.3
Person 99.1
Furniture 94.1
Flooring 92.5
Shoe 87.4
Footwear 87.4
Apparel 87.4
Clothing 87.4
Indoors 82.6
Table 79.8
Desk 77.3
Room 72.9
Floor 68.4
Electronics 67.2
Screen 67.2
Office 66.9
Monitor 57.6
Display 57.6
Coat 57.3
Overcoat 57.3
Suit 57.3
LCD Screen 55.5
Studio 55.3
Couch 55.2

Imagga
created on 2021-12-14

room 66.8
classroom 42.6
interior 35.4
furniture 33.8
home 33.5
table 33.3
office 29.6
indoors 29
modern 28
desk 28
business 24.9
laptop 24.7
house 24.2
computer 23.8
indoor 23.7
man 23.5
person 23.5
chair 22.9
adult 21.9
businessman 21.2
male 20.6
work 19.6
floor 19.5
people 19.5
corporate 18.9
professional 18.4
meeting 17
sitting 16.3
teacher 15.9
businesswoman 15.5
director 15.4
happy 15
executive 14.8
window 14.7
couch 14.5
looking 14.4
communication 14.3
group 13.7
design 13.5
decor 13.3
glass 13.2
inside 12.9
confident 12.7
file 12.7
women 12.7
sofa 12.4
working 12.4
living 12.3
lifestyle 12.3
education 12.1
men 12
suit 11.7
wood 11.7
smiling 11.6
apartment 11.5
domestic 10.8
black 10.8
device 10.8
conference 10.8
team 10.7
handsome 10.7
smile 10.7
job 10.6
iron lung 10.6
businesspeople 10.4
office furniture 10.4
luxury 10.3
manager 10.2
architecture 10.2
stringed instrument 10
light 10
holding 9.9
cheerful 9.8
corporation 9.6
technology 9.6
workplace 9.5
talking 9.5
musical instrument 9.5
happiness 9.4
coffee 9.3
alone 9.1
board 9
seat 8.9
notebook 8.8
wooden 8.8
kitchen 8.7
residential 8.6
employee 8.6
career 8.5
respirator 8.5
relax 8.4
portrait 8.4
presentation 8.4
color 8.3
occupation 8.2
blackboard 8
projector 8
worker 8
decoration 8
bright 7.9
equipment 7.8
space 7.8
empty 7.7
elegant 7.7
wall 7.7
attractive 7.7
comfortable 7.6
formal 7.6
lamp 7.6
educator 7.5
horizontal 7.5
life 7.5
piano 7.5
training 7.4
phone 7.4
clothing 7.3
new 7.3
success 7.2
family 7.1
together 7

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

indoor 97.5
furniture 95.4
sitting 94.3
text 93
black and white 90.9
person 89.3
table 88.8
man 66.7
piano 62.4
clothing 59.5
chair 56.9
desk 56.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-38
Gender Male, 64.8%
Calm 85.8%
Confused 5.1%
Disgusted 2.9%
Surprised 2.4%
Happy 2.2%
Sad 1.1%
Fear 0.3%
Angry 0.3%

AWS Rekognition

Age 41-59
Gender Male, 98.6%
Sad 47.5%
Calm 33.5%
Disgusted 8.3%
Happy 2.8%
Confused 2.7%
Fear 2.3%
Angry 2.2%
Surprised 0.8%

AWS Rekognition

Age 21-33
Gender Male, 67.5%
Calm 93.3%
Happy 2.8%
Sad 1.4%
Confused 1.3%
Angry 0.5%
Disgusted 0.4%
Surprised 0.3%
Fear 0.1%

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.1%
Shoe 87.4%

Captions

Microsoft

a man sitting in a room 92.4%
a man sitting at a desk 91%
a man sitting on a desk 86.7%