Human Generated Data

Title

Untitled (installation of Mayor Sam Tabor)

Date

1955

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3170

Human Generated Data

Title

Untitled (installation of Mayor Sam Tabor)

People

Artist: Harry Annas, American 1897 - 1980

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Apparel 100
Clothing 100
Person 98.6
Human 98.6
Person 98.5
Person 97.8
Person 97.3
Person 97.2
Person 94.8
Coat 94.8
Person 94.4
Lab Coat 93.7
Person 93.6
Overcoat 92.4
Person 87.5
Clinic 82.2
Suit 79.1
Tuxedo 78
Person 73.9
Robe 69.9
Fashion 69.9
Shirt 66.3
Gown 63.3
Portrait 61.4
Face 61.4
Photography 61.4
Photo 61.4
Dress 57.6
Wedding 57.4
Scientist 55.8

Imagga
created on 2022-01-22

man 46.4
male 43.3
person 41.7
businessman 37.1
business 35.3
people 35.2
office 34.7
meeting 32.1
professional 30.6
happy 30.1
adult 29.9
team 29.6
colleagues 27.2
lab coat 26.6
men 24.9
coat 24.6
nurse 24.2
businesspeople 22.8
work 22.8
businesswoman 22.7
smiling 22.4
corporate 22.4
group 21.8
mature 21.4
teamwork 21.3
indoors 21.1
doctor 20.7
job 20.4
executive 20.1
working 19.5
medical 19.4
specialist 19.2
patient 19.1
table 19.1
lifestyle 18.8
practitioner 18.5
desk 18
clinic 17.9
worker 17.2
talking 17.1
senior 16.9
room 16.8
home 16.8
together 16.7
smile 15.7
portrait 15.5
indoor 15.5
casual 15.3
hospital 14.9
clothing 14.9
standing 14.8
associates 14.8
modern 14.7
sitting 14.6
laptop 14.6
women 14.2
manager 14
couple 13.9
color 13.9
coworkers 13.8
success 13.7
discussion 13.6
suit 13.5
ethnic 13.3
health 13.2
20s 12.8
looking 12.8
40s 12.7
happiness 12.5
30s 12.5
handsome 12.5
elderly 12.5
cheerful 12.2
computer 12
camera 12
successful 11.9
confident 11.8
discussing 11.8
communication 11.8
diverse 11.8
conference 11.7
mid adult 11.6
diversity 11.5
care 11.5
groom 10.9
attractive 10.5
career 10.4
life 10.4
teacher 10.3
presentation 10.2
sick person 10.1
occupation 10.1
case 10
holding 9.9
medicine 9.7
busy 9.6
four 9.6
employee 9.6
workplace 9.5
company 9.3
stethoscope 9.3
face 9.2
explaining 8.9
garment 8.7
cooperation 8.7
corporation 8.7
leader 8.7
partnership 8.7
boss 8.6
staff 8.6
two 8.5
horizontal 8.4
human 8.3
surgeon 8.2
board 8.1
interior 8
boardroom 7.9
bright 7.9
30 35 years 7.9
businessmen 7.8
partner 7.7
formal 7.6
technology 7.4
training 7.4
new 7.3

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 98.1
clothing 93.8
text 92.7
woman 82.5
man 81
human face 64.7
wedding dress 62.7
smile 57.3

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Male, 90.5%
Happy 80.3%
Calm 12.1%
Surprised 3.7%
Sad 1.5%
Confused 1%
Disgusted 0.7%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 51-59
Gender Male, 99.1%
Calm 97%
Sad 1.5%
Happy 0.6%
Surprised 0.5%
Confused 0.3%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 25-35
Gender Female, 67.9%
Calm 97.9%
Sad 0.9%
Angry 0.3%
Surprised 0.2%
Confused 0.2%
Happy 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 51-59
Gender Female, 99.4%
Calm 82.8%
Happy 7.7%
Surprised 5.7%
Angry 1.2%
Sad 1.2%
Confused 0.5%
Disgusted 0.4%
Fear 0.4%

AWS Rekognition

Age 26-36
Gender Male, 89.5%
Calm 90.4%
Sad 4.1%
Confused 2.2%
Disgusted 1.4%
Angry 0.7%
Surprised 0.6%
Fear 0.3%
Happy 0.2%

AWS Rekognition

Age 21-29
Gender Female, 87.6%
Calm 57.7%
Happy 39.5%
Sad 1.6%
Disgusted 0.3%
Fear 0.3%
Confused 0.3%
Angry 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Suit 79.1%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 80.7%
a group of people standing in front of a mirror 80.6%
a group of people in front of a mirror posing for the camera 79.6%

Text analysis

Amazon

12
FILM
KODAK
SAFETY KODAK
SAFETY

Google

12
12