Human Generated Data

Title

Untitled (man and woman sitting on opposite sides of desk)
Date

1954
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15210

Human Generated Data

Title

Untitled (man and woman sitting on opposite sides of desk)

People

Artist: Jack Gould, American

Date

1954

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.4
Person 99.4
Person 99.3
Clinic 95.1
Hospital 80.9
Doctor 67.7
Furniture 60
Operating Theatre 60
Text 57.3
Face 55.5

Imagga
created on 2022-03-05

man 39.7
people 36.3
office 35
desk 34.1
person 33.2
computer 33
male 31.9
adult 31.6
indoors 29.9
working 29.2
business 26.7
home 26.3
laptop 25.7
work 23.6
table 23.3
furniture 22.4
professional 21.3
smiling 20.3
happy 20.1
technology 20
businessman 19.4
portrait 19.4
room 17.4
businesswoman 17.3
sitting 17.2
men 17.2
group 15.3
center 15.2
meeting 15.1
teamwork 14.8
education 14.7
corporate 14.6
smile 14.3
colleagues 13.6
casual 13.6
worker 13.4
patient 13.4
businesspeople 13.3
learning 13.2
executive 13
file 12.9
occupation 12.8
indoor 12.8
team 12.5
house 12.5
monitor 12.4
interior 12.4
keyboard 12.2
women 11.9
school 11.8
clinic 11.4
senior 11.3
camera 11.1
horizontal 10.9
face 10.7
attractive 10.5
two 10.2
inside 10.1
lifestyle 10.1
classroom 10
student 10
office furniture 9.8
cheerful 9.8
40s 9.7
job 9.7
specialist 9.6
30s 9.6
looking 9.6
couple 9.6
teacher 9.5
newspaper 9.4
mature 9.3
focus 9.3
communication 9.2
20s 9.2
holding 9.1
hospital 8.9
coworkers 8.8
medical 8.8
together 8.8
equipment 8.8
studying 8.6
kitchen 8.4
successful 8.2
confident 8.2
shop 8.1
associates 7.9
surfing 7.8
conference 7.8
partners 7.8
screen 7.7
staff 7.7
workplace 7.6
reading 7.6
talking 7.6
college 7.6
females 7.6
plan 7.6
pen 7.5
doctor 7.5
human 7.5
new 7.3
board 7.2
product 7.2
happiness 7.1
modern 7

Google
created on 2022-03-05

Clothing 98.7
Picture frame 96.1
Photograph 94.2
Cabinetry 93.9
White 92.2
Black 89.6
Coat 86.9
Drawer 85.1
Black-and-white 84.3
Style 83.8
Table 83
Desk 79.6
Art 78.7
Chest of drawers 77
Chair 75.5
Suit 75.2
Office equipment 74.7
Snapshot 74.3
Monochrome 71.3
Monochrome photography 71.2

Microsoft
created on 2022-03-05

text 98.4
indoor 94.4
person 90.2
furniture 85.2
house 79.1
black and white 66
table 26.4

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 60.9%
Happy 60.8%
Calm 21.1%
Confused 12.7%
Sad 2.1%
Disgusted 0.9%
Angry 0.9%
Fear 0.7%
Surprised 0.7%

AWS Rekognition

Age 23-33
Gender Female, 77.8%
Calm 39.9%
Sad 29.5%
Confused 8.9%
Surprised 7.2%
Fear 6.4%
Happy 4%
Angry 2.8%
Disgusted 1.3%

AWS Rekognition

Age 18-24
Gender Female, 75.9%
Calm 83.4%
Sad 11.5%
Confused 3.2%
Angry 0.6%
Happy 0.5%
Disgusted 0.3%
Fear 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

an old photo of a man in a kitchen 83.8%
a man standing in a kitchen 81.6%
a group of people in a kitchen 81.5%

Text analysis

Amazon

NAGO
NAGON
MJI7 YT33A'2 NAGO
YT33A'2
MJI7

Google

DVK YT31 A°2 EIFW KODVK 2.V L E
DVK
YT31
L
E
A°2
KODVK
EIFW
2.V