Human Generated Data

Title

Untitled (boy in glasses sitting at desk)

Date

1962

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16498

Human Generated Data

Title

Untitled (boy in glasses sitting at desk)

People

Artist: Lucian and Mary Brown, American

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Clothing 99.8
Apparel 99.8
Person 99.3
Human 99.3
Sunglasses 96.1
Accessory 96.1
Accessories 96.1
Furniture 92.9
Shelf 85.6
Glasses 85.4
Coat 84.6
Home Decor 84.1
Indoors 77
Shop 76.7
Goggles 74.7
Face 74.2
Female 68.8
Room 67.7
Cushion 63.1
Photo 61.5
Portrait 61.5
Photography 61.5
Text 59.8
Suit 59.1
Overcoat 59.1
Jacket 58
Table 58
Shoe Shop 56.2
Lab Coat 55.2

Imagga
created on 2022-02-11

lab coat 100
coat 100
professional 58.4
pharmacist 46.6
garment 43.7
medical 38
man 37.7
adult 35.9
people 35.8
person 34.9
health professional 34.4
male 33.4
work 33
doctor 30.1
working 29.2
clothing 28
office 27.5
lab 24.3
laboratory 24.1
worker 23.4
team 23.3
computer 23.3
hospital 23.2
job 23
health 23
occupation 22.9
clinic 22.6
business 22.5
scientist 21.6
medicine 21.2
men 20.6
indoors 19.4
patient 19.1
research 19.1
desk 18.9
businessman 18.6
happy 18.2
biology 18.1
nurse 17.6
laptop 17.3
student 17.2
businesspeople 17.1
science 16.9
assistant 16.5
chemistry 16.4
teamwork 15.8
colleagues 15.6
chemical 15.6
portrait 15.6
corporate 14.6
smiling 14.5
care 14
businesswoman 13.7
looking 13.6
technology 13.4
smile 12.8
scientific 12.6
bright 12.2
20s 11.9
indoor 11.9
chemist 11.8
experiment 11.7
test 11.6
profession 11.5
face 11.4
table 11.3
study 11.2
women 11.1
room 11
microscope 10.9
30s 10.6
exam 10.6
attractive 10.5
illness 10.5
success 10.5
talking 10.5
meeting 10.4
manager 10.3
executive 10.1
successful 10.1
color 10
confident 10
associates 9.8
modern 9.8
group 9.7
home 9.6
serious 9.5
education 9.5
uniform 9.5
sitting 9.5
suit 9.2
genes 8.9
technician 8.8
physician 8.8
discovery 8.8
busy 8.7
specialist 8.6
casual 8.5
two 8.5
communication 8.4
shop 8.1
to 8
lifestyle 8
together 7.9
microbiology 7.9
day 7.9
surgery 7.8
analysis 7.8
consultant 7.8
sample 7.8
senior 7.5
instrument 7.5
company 7.5
equipment 7.4
focus 7.4
treatment 7.4
cheerful 7.3
look 7
pretty 7

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

text 99
person 93.1
indoor 91.2
clothing 84.6
man 81.2
window 81.1
human face 68.9
glasses 61.6

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Female, 51.5%
Calm 81.5%
Happy 6.2%
Sad 3.8%
Disgusted 2.3%
Fear 2%
Surprised 1.5%
Angry 1.4%
Confused 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Sunglasses 96.1%

Captions

Microsoft

a person standing in front of a window 52.5%
a person standing in front of a window 52.4%
a man and a woman standing in front of a window 25%

Text analysis

Amazon

18
American
-
American - Pres
FIVE
Products
d America
Pres
Parid Ratvery d America Products
Ratvery
Parid
ESTE

Google

MJIA-
-YT3RA°2-
-XAa
18 MJIA- -YT3RA°2- -XAa Tod n en
18
Tod
en
n