Human Generated Data

Title

Untitled (two men behind desk)
Date

1951
People

Artist: Peter James Studio, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20049

Human Generated Data

Title

Untitled (two men behind desk)

People

Artist: Peter James Studio, American

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.5
Human 99.5
Clothing 98.2
Apparel 98.2
Person 97.5
Furniture 97.2
Tie 97
Accessory 97
Accessories 97
Pc 93.4
Computer 93.4
Electronics 93.4
Overcoat 89.4
Coat 89.4
Shirt 89
Table 88.3
LCD Screen 86.3
Screen 86.3
Monitor 86.3
Display 86.3
Desk 80.6
Tabletop 76
Suit 74.3
Meal 69.4
Food 69.4
Laptop 59.7
Photography 57.2
Face 57.2
Photo 57.2
Portrait 57.2
Sitting 57.1
Indoors 56.1
Dress Shirt 55.3

Imagga
created on 2022-03-05

man 49.8
male 44.1
waiter 41.2
people 37.4
office 33.4
person 33.3
business 31.6
adult 30.6
meeting 30.2
dining-room attendant 29.9
happy 29.5
businessman 29.2
smiling 29
worker 27.7
sitting 27.5
men 26.6
employee 26.5
home 26.3
laptop 24.9
businesswoman 24.6
colleagues 24.3
working 23.9
businesspeople 23.7
team 23.3
together 22.8
senior 22.5
table 22.1
couple 21.8
room 21.3
group 21
talking 20.9
desk 20.3
lifestyle 20.3
indoors 20.2
computer 20.1
work 19.6
mature 19.5
executive 19.3
professional 19.1
teamwork 18.6
women 18.2
portrait 16.2
smile 15.7
nurse 14.6
40s 14.6
restaurant 13.8
cheerful 13.8
discussing 13.8
corporate 13.8
discussion 13.6
casual 13.6
elderly 13.4
modern 13.3
lab coat 13.1
grandma 13.1
20s 12.8
color 12.8
technology 12.6
horizontal 12.6
coat 12.5
30s 12.5
standing 12.2
classroom 12.2
looking 12
successful 11.9
two 11.9
suit 11.7
two people 11.7
mid adult 11.6
job 11.5
clothing 11.4
education 11.3
camera 11.1
happiness 11
indoor 11
explaining 10.8
coworkers 10.8
presentation 10.2
communication 10.1
kitchen 10
house 10
associates 9.8
busy 9.6
retirement 9.6
four 9.6
adults 9.5
confident 9.1
holding 9.1
old 9.1
kin 9.1
teacher 9
collaboration 8.9
teaching 8.8
staff 8.6
workplace 8.6
face 8.5
friends 8.5
clinic 8.2
hospital 8.1
meal 8.1
handsome 8
boardroom 7.9
four people 7.9
day 7.9
conference 7.8
partners 7.8
conversation 7.8
concentration 7.7
planning 7.7
formal 7.6
ethnic 7.6
lunch 7.5
manager 7.5
success 7.2
interior 7.1
medical 7.1

Google
created on 2022-03-05

Coat 85.9
Table 85.9
Black-and-white 84.8
Style 83.9
Desk 76.6
Writing desk 75.5
Monochrome photography 74.5
Monochrome 74.5
White-collar worker 72.9
Suit 69.7
Office equipment 69.2
Tie 67.2
Science 66.8
Sitting 65.7
Room 63.7
Machine 63.6
Curtain 62.5
Stock photography 61.7
Tableware 60.5
Vintage clothing 60

Microsoft
created on 2022-03-05

person 99.5
text 96.9
indoor 91.8
man 91
clothing 79.8
black and white 77.6
dish 74.4
laptop 57.2
table 32.3

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 99.5%
Sad 46.4%
Angry 41.6%
Disgusted 3.9%
Calm 2.6%
Fear 2.5%
Surprised 1.2%
Confused 1.2%
Happy 0.6%

AWS Rekognition

Age 51-59
Gender Male, 100%
Confused 54.6%
Calm 20.2%
Surprised 15.7%
Happy 3.1%
Sad 2.4%
Angry 1.7%
Disgusted 1.5%
Fear 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 97%
Suit 74.3%

Captions

Microsoft

a man and a woman sitting at a table 87.1%
a group of people sitting at a table 87%
a person sitting at a table 86.9%

Text analysis

Amazon

M'GREGOR
NEW
W.CHECOB
McGREGOR
SCIENCE BOOKS NEW MUNDERS
e
SCIENCE
McGEGOR
MUNDERS
BOOKS
H.CRE
DON'T
YТ37А-AX
SPORTSME3T

Google

M
M*GREGOR
1OENCE
M'GREGOR
M GREGOR M'GREGOR M'GREGOR 1OENCE WORKT NEW WINIER M*GREGOR WCHE
GREGOR
WORKT
NEW
WINIER
WCHE