Human Generated Data

Title

Untitled (two men standing in office)

Date

1952

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20209

Human Generated Data

Title

Untitled (two men standing in office)

People

Artist: Peter James Studio, American

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.7
Apparel 99.7
Human 98.6
Person 98.6
Person 94.9
Shirt 93.1
Furniture 92.6
Indoors 84.6
Chair 81.9
Room 79.8
Sleeve 75.5
Shelf 74
Shoe 73.6
Footwear 73.6
Coat 65.3
Suit 62
Overcoat 62
Portrait 59.4
Photo 59.4
Face 59.4
Photography 59.4
Dress Shirt 59.3
Flooring 58.8
Long Sleeve 57.6
Bookcase 57.5
Clinic 57

Imagga
created on 2022-03-05

man 44.4
person 41.7
male 41.2
professional 35.8
people 35.2
adult 34.1
nurse 30.8
happy 29.5
businessman 29.2
coat 29
doctor 28.2
portrait 27.9
lab coat 27.6
business 27.4
suit 27
executive 25.2
corporate 24.9
office 24.9
job 24.8
medical 24.7
smiling 23.2
clothing 23
hospital 22.8
smile 21.4
standing 20.9
men 20.6
health 20.2
garment 20.1
patient 20.1
stethoscope 18.9
worker 18.2
uniform 17.9
medicine 17.6
looking 17.6
occupation 17.4
successful 17.4
confident 17.3
work 17.3
handsome 17
mature 16.8
clinic 16.7
success 16.1
senior 15.9
indoors 15.8
specialist 15.8
couple 14.8
attractive 14.7
bright 14.3
businesspeople 14.2
happiness 14.1
manager 14
women 13.5
team 13.5
care 13.2
indoor 12.8
modern 12.6
day 12.6
elderly 12.5
profession 12.5
practitioner 12.4
building 11.9
casual 11.9
businesswoman 11.8
mid adult 11.6
lifestyle 11.6
formal 11.5
career 11.4
teamwork 11.1
friendly 11
holding 10.7
face 10.7
working 10.6
30s 10.6
confidence 10.5
human 10.5
one 10.5
camera 10.2
colleagues 9.7
group 9.7
jacket 9.7
corporation 9.7
home 9.6
boss 9.6
meeting 9.4
case 9.4
company 9.3
pretty 9.1
old 9.1
cheerful 8.9
color 8.9
clinical 8.8
together 8.8
laboratory 8.7
partnership 8.7
room 8.6
sick person 8.6
adults 8.5
desk 8.5
two 8.5
guy 8.5
hand 8.4
life 8.3
positive 8.3
alone 8.2
bow tie 8.2
look 7.9
black 7.8
businessperson 7.8
40s 7.8
expertise 7.8
diversity 7.7
illness 7.6
ethnic 7.6
secretary 7.6
tie 7.6
necktie 7.5
technology 7.4
glasses 7.4
light 7.4
20s 7.3
science 7.1
love 7.1
staff 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 94.3
clothing 90.3
person 89.1
man 86.9
standing 81.2
furniture 54
posing 37.6
clothes 18.9

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Surprised 67.1%
Happy 10.5%
Calm 10.1%
Sad 4.1%
Confused 2.7%
Angry 2.5%
Disgusted 2.1%
Fear 1%

AWS Rekognition

Age 52-60
Gender Male, 100%
Happy 89.3%
Angry 3.7%
Fear 1.5%
Disgusted 1.4%
Confused 1.3%
Surprised 1.1%
Sad 1%
Calm 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Chair 81.9%
Shoe 73.6%
Suit 62%

Captions

Microsoft

a man and a woman standing in a room 78%
a person standing in a room 77.9%
a group of people standing in a room 77.8%

Text analysis

Amazon

28

Google

28
28