Human Generated Data

Title

Untitled (man on chair with little girl)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16424

Human Generated Data

Title

Untitled (man on chair with little girl)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 98.7
Human 98.7
Clothing 98
Apparel 98
Person 97.8
Furniture 85.5
Couch 74.9
Finger 63.4
Drawing 59.3
Art 59.3
Indoors 59.2
Photography 57.1
Photo 57.1
Shirt 56.4
Sleeve 55.2
Room 55.1

Imagga
created on 2022-02-11

man 42.4
professional 39.1
coat 37.8
people 37.4
male 36.9
person 36.8
lab coat 35.4
adult 33.8
work 33
medical 31.8
businessman 30.9
businesspeople 29.5
business 29.2
doctor 28.2
corporate 27.5
office 27.5
job 27.5
working 27.4
nurse 25.5
team 25.1
lab 24.3
laboratory 24.1
medicine 23.8
worker 23.1
scientist 21.6
happy 21.3
occupation 21.1
computer 20.1
looking 20
research 20
men 19.8
teamwork 19.5
colleagues 19.5
student 19.2
businesswoman 19.1
desk 18.9
portrait 18.8
health 18.8
science 17.8
clothing 17.4
bright 17.2
biology 17.1
chemical 16.9
casual 16.1
meeting 16
smiling 15.9
hospital 15.9
smile 15.7
face 15.6
chemistry 15.5
garment 15.2
handsome 15.2
women 15
manager 14.9
associates 14.8
education 14.7
attractive 14.7
indoor 14.6
suit 14.6
group 14.5
test 14.4
20s 13.8
success 13.7
patient 13.7
laptop 13.7
confident 13.7
scientific 13.6
technology 13.4
chemist 12.8
modern 12.6
clinic 12.4
care 12.4
executive 12.2
microscope 11.9
day 11.8
businessmen 11.7
expertise 11.7
lifestyle 11.6
serious 11.5
indoors 11.4
color 11.1
successful 11
employee 10.9
specialist 10.8
consultant 10.7
assistant 10.7
together 10.5
pretty 10.5
table 10.4
two 10.2
uniform 9.8
experiment 9.8
corporation 9.7
look 9.6
formal 9.6
career 9.5
sitting 9.5
communication 9.2
horizontal 9.2
hand 9.1
room 9.1
human 9
groom 8.9
coworkers 8.9
discovery 8.8
busy 8.7
talking 8.6
focus 8.3
alone 8.2
cheerful 8.1
biotechnology 7.9
happiness 7.8
25 30 years 7.8
technician 7.8
physician 7.8
cure 7.8
1 7.7
planning 7.7
30s 7.7
instrument 7.7
diversity 7.7
leadership 7.7
surgeon 7.7
exam 7.7
profession 7.7
ethnic 7.6
development 7.6
adults 7.6
equipment 7.6
shirt 7.5
study 7.5
holding 7.4
glasses 7.4
jacket 7.2
building 7.1
to 7.1

Google
created on 2022-02-11

Hat 91.5
Sleeve 86.9
Gesture 85.3
Black-and-white 84.9
Style 83.8
Monochrome photography 74.8
Art 74.2
Monochrome 72.9
Nurse 71.5
Vintage clothing 68.7
Room 68.1
Health care provider 66.6
Stock photography 63.1
Font 62.3
Photographic paper 61
Nurse uniform 60.4
Service 56.4
Visual arts 54
Rectangle 53.5
Pattern 51

Microsoft
created on 2022-02-11

text 98.9
window 98.2
black and white 93.3
clothing 83
person 58.1
sketch 52.9

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 94.7%
Calm 88.9%
Happy 5.7%
Confused 1.5%
Sad 1.4%
Disgusted 1%
Angry 0.7%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 18-26
Gender Male, 65.8%
Calm 95.2%
Surprised 2%
Sad 1.8%
Confused 0.3%
Disgusted 0.3%
Angry 0.2%
Happy 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a person standing in front of a window 73.8%
a person standing next to a window 68.3%
a man and a woman standing in front of a window 49.4%

Text analysis

Amazon

3

Google

MJI7--YT37A°2--XAGOX
MJI7--YT37A°2--XAGOX