Human Generated Data

Title

Untitled (three men in front of map)

Date

c. 1950

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19004

Human Generated Data

Title

Untitled (three men in front of map)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.5
Apparel 99.5
Human 99.1
Person 99.1
Person 98.6
Person 97.8
Clinic 92.3
Coat 86.4
Tie 85.3
Accessories 85.3
Accessory 85.3
Chair 84.3
Furniture 84.3
Lab Coat 81.3
Suit 72.4
Overcoat 72.4
Doctor 70.9
Portrait 59.7
Photography 59.7
Face 59.7
Photo 59.7
Hospital 57.4
Shirt 55.2

Imagga
created on 2022-03-05

groom 100
man 49.8
male 46.2
person 46.2
businessman 44.2
business 40.2
adult 39.7
people 39.1
office 38.8
team 34.1
professional 32.5
meeting 32.1
businesswoman 31.9
colleagues 31.1
happy 30.8
corporate 29.3
working 27.4
teamwork 26.9
businesspeople 26.6
worker 26.5
executive 26.1
group 25.8
men 25.8
together 25.4
smiling 25.4
work 25.2
talking 22.8
smile 22.8
job 22.2
women 21.4
desk 20.8
laptop 20.1
sitting 19.8
room 19.7
modern 19.7
portrait 19.4
computer 18.5
table 18.2
patient 17.8
suit 17.5
couple 17.5
ethnic 17.2
doctor 16.9
manager 16.8
40s 16.6
success 16.1
indoors 15.8
associates 15.8
happiness 15.7
indoor 15.5
boss 15.3
casual 15.3
medical 15
nurse 14.9
20s 14.7
discussion 14.6
30s 14.5
communication 14.3
handsome 14.3
mature 14
coworkers 13.8
discussing 13.8
conference 13.7
home 13.6
mid adult 13.5
hospital 13.2
clothing 13.2
company 13
occupation 12.9
two 12.7
employee 12.7
lifestyle 12.3
cheerful 12.2
leader 11.6
diversity 11.6
four 11.5
face 11.4
attractive 11.2
looking 11.2
health 11.1
successful 11
care 10.7
life 10.7
corporation 10.6
color 10.6
staff 10.5
formal 10.5
career 10.4
presentation 10.3
lab coat 10.1
boardroom 9.9
explaining 9.9
partnership 9.6
standing 9.6
adults 9.5
practitioner 9.3
teacher 9.3
clinic 9.3
confident 9.1
coat 9
human 9
new 8.9
waiter 8.9
business people 8.9
diverse 8.8
colleague 8.8
partners 8.8
partner 8.7
bright 8.6
illness 8.6
pretty 8.4
horizontal 8.4
hand 8.4
building 8
medicine 7.9
day 7.9
businessmen 7.8
cooperation 7.7
busy 7.7
planning 7.7
expression 7.7
twenties 7.7
multi 7.6
senior 7.5
treatment 7.4
aged 7.2
hall 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 98.5
man 91.5
person 70.6
clothing 63.6

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 98.8%
Calm 70.8%
Happy 28.2%
Disgusted 0.3%
Sad 0.2%
Fear 0.2%
Confused 0.2%
Surprised 0.1%
Angry 0.1%

AWS Rekognition

Age 53-61
Gender Male, 99.9%
Calm 73.7%
Happy 13.4%
Confused 5.8%
Sad 2.2%
Surprised 2.1%
Disgusted 1.9%
Angry 0.7%
Fear 0.3%

AWS Rekognition

Age 43-51
Gender Male, 100%
Surprised 50.9%
Calm 20.6%
Happy 12.7%
Sad 7.1%
Fear 3.6%
Confused 2.5%
Disgusted 1.4%
Angry 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 85.3%
Chair 84.3%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 60.8%
a man standing in front of a window 60.7%
a man that is standing in front of a mirror posing for the camera 48.9%

Text analysis

Amazon

FILM
KODAK
AFETY
2
SH
C FILM 2 و
و
C
911

Google

AFETY
KODAK
FILM
KODAK AFETY FILM