Human Generated Data

Title

Untitled (seven men wearing name tags chatting in conference hall)

Date

1950-1955

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9399

Human Generated Data

Title

Untitled (seven men wearing name tags chatting in conference hall)

People

Artist: Martin Schweig, American 20th century

Date

1950-1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.5
Human 99.5
Person 99.2
Apparel 99
Clothing 99
Person 98.8
Person 98.5
Person 98.4
Clinic 97.9
Person 96.4
Coat 82
Person 81.5
Lab Coat 78.8
Doctor 78.3
Tie 78
Accessory 78
Accessories 78
Hospital 77.1
Shirt 75.6
Operating Theatre 70.3
Sleeve 66.3
Furniture 61.9
Chair 61.9

Imagga
created on 2022-01-23

surgeon 71.2
nurse 53.1
man 44.3
people 37.4
medical 35.3
doctor 34.8
person 34.5
senior 32.8
male 30.5
patient 30.5
hospital 28.7
professional 27.3
mature 26
adult 25.8
specialist 25
men 24.9
health 23.6
elderly 22
happy 21.3
medicine 20.2
work 18.8
worker 18.7
working 18.6
home 18.3
care 18.1
smiling 18.1
human 18
portrait 17.5
occupation 17.4
clinic 17.3
illness 17.1
team 17
indoors 16.7
uniform 15.8
old 15.3
business 15.2
couple 14.8
job 14.1
older 13.6
women 13.4
retirement 13.4
sitting 12.9
smile 12.8
coat 12.7
laboratory 12.5
profession 12.4
equipment 12.3
together 12.3
camera 12
surgery 11.7
colleagues 11.7
lifestyle 11.6
30s 11.5
businessman 11.5
meeting 11.3
lab 10.7
retired 10.7
sick 10.6
to 10.6
exam 10.5
husband 10.5
group 10.5
happiness 10.2
student 10.1
inside 10.1
case 10
70s 9.8
cheerful 9.7
chemical 9.6
stethoscope 9.6
test 9.6
looking 9.6
standing 9.6
development 9.5
biology 9.5
day 9.4
clothing 9.2
horizontal 9.2
sick person 9.2
20s 9.2
hand 9.1
suit 9
technology 8.9
science 8.9
fifties 8.9
office 8.8
50s 8.8
scientist 8.8
half length 8.8
40s 8.8
thirties 8.8
middle aged 8.8
scientific 8.7
chemistry 8.7
education 8.7
research 8.6
talking 8.5
wife 8.5
casual 8.5
instrument 8.4
teamwork 8.3
holding 8.2
room 8.2
family 8
facing camera 7.9
chemist 7.9
discussing 7.9
forties 7.8
casual clothing 7.8
discussion 7.8
assistant 7.8
expertise 7.8
businesspeople 7.6
adults 7.6
help 7.4
mask 7.4
indoor 7.3
grandfather 7.2
aged 7.2
color 7.2
staff 7.2
handsome 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 98.9
wall 95.9
clothing 94.6
text 93.2
indoor 92.4
man 92.1
standing 88.2
black and white 54.9
drawing 53.9

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Calm 83%
Surprised 6.5%
Disgusted 4.1%
Confused 2.7%
Happy 1.6%
Angry 1.1%
Sad 0.7%
Fear 0.2%

AWS Rekognition

Age 53-61
Gender Male, 98%
Calm 97%
Sad 0.9%
Surprised 0.6%
Angry 0.5%
Confused 0.5%
Disgusted 0.3%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 54-62
Gender Male, 99.7%
Sad 79.7%
Confused 12.3%
Surprised 2.9%
Calm 1.6%
Angry 1.5%
Happy 0.8%
Disgusted 0.7%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 78%
Chair 61.9%

Captions

Microsoft

a group of people standing in a room 97.3%
a group of people posing for a photo 92.9%
a group of people posing for the camera 92.8%

Text analysis

Amazon

8
3
13
G
L'
< G L' 8 3
<
YТ37А-ХАОX

Google

YT37A2-AGON * **
YT37A2-AGON
**
*