Human Generated Data

Title

Untitled (seven men wearing name tags chatting in conference hall)
Date

1950-1955
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9399

Human Generated Data

Title

Untitled (seven men wearing name tags chatting in conference hall)

People

Artist: Martin Schweig, American 20th century

Date

1950-1955

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9399

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.5
Human 99.5
Person 99.2
Clothing 99
Apparel 99
Person 98.8
Person 98.5
Person 98.4
Clinic 97.9
Person 96.4
Coat 82
Person 81.5
Lab Coat 78.8
Doctor 78.3
Tie 78
Accessories 78
Accessory 78
Hospital 77.1
Shirt 75.6
Operating Theatre 70.3
Sleeve 66.3
Chair 61.9
Furniture 61.9

Clarifai
created on 2023-10-27

people 99.3
group 98.7
man 98
group together 95.1
adult 94.7
monochrome 92.9
education 89.9
uniform 88.3
healthcare 85.4
science 85.1
leader 84.4
woman 81.8
medical practitioner 81.5
many 81.3
three 80.1
medicine 79.7
coat 79
outerwear 76.1
scientist 76
doctor 75.7

Imagga
created on 2022-01-23

surgeon 71.2
nurse 53.1
man 44.3
people 37.4
medical 35.3
doctor 34.8
person 34.5
senior 32.8
male 30.5
patient 30.5
hospital 28.7
professional 27.3
mature 26
adult 25.8
specialist 25
men 24.9
health 23.6
elderly 22
happy 21.3
medicine 20.2
work 18.8
worker 18.7
working 18.6
home 18.3
care 18.1
smiling 18.1
human 18
portrait 17.5
occupation 17.4
clinic 17.3
illness 17.1
team 17
indoors 16.7
uniform 15.8
old 15.3
business 15.2
couple 14.8
job 14.1
older 13.6
women 13.4
retirement 13.4
sitting 12.9
smile 12.8
coat 12.7
laboratory 12.5
profession 12.4
equipment 12.3
together 12.3
camera 12
surgery 11.7
colleagues 11.7
lifestyle 11.6
30s 11.5
businessman 11.5
meeting 11.3
lab 10.7
retired 10.7
sick 10.6
to 10.6
exam 10.5
husband 10.5
group 10.5
happiness 10.2
student 10.1
inside 10.1
case 10
70s 9.8
cheerful 9.7
chemical 9.6
stethoscope 9.6
test 9.6
looking 9.6
standing 9.6
development 9.5
biology 9.5
day 9.4
clothing 9.2
horizontal 9.2
sick person 9.2
20s 9.2
hand 9.1
suit 9
technology 8.9
science 8.9
fifties 8.9
office 8.8
50s 8.8
scientist 8.8
half length 8.8
40s 8.8
thirties 8.8
middle aged 8.8
scientific 8.7
chemistry 8.7
education 8.7
research 8.6
talking 8.5
wife 8.5
casual 8.5
instrument 8.4
teamwork 8.3
holding 8.2
room 8.2
family 8
facing camera 7.9
chemist 7.9
discussing 7.9
forties 7.8
casual clothing 7.8
discussion 7.8
assistant 7.8
expertise 7.8
businesspeople 7.6
adults 7.6
help 7.4
mask 7.4
indoor 7.3
grandfather 7.2
aged 7.2
color 7.2
staff 7.2
handsome 7.1

Google
created on 2022-01-23

Coat 91.1
Workwear 86.5
Sleeve 86.4
Service 76.4
Medical 74.5
Uniform 73.6
Vintage clothing 72.3
Monochrome photography 71.3
Team 69.5
Monochrome 69.2
Event 69.2
Health care provider 68
Crew 67.4
Health care 67.4
Room 66.8
Font 63.6
Stock photography 63.3
Job 62.1
History 58.9
Medical assistant 58.7

Microsoft
created on 2022-01-23

person 98.9
wall 95.9
clothing 94.6
text 93.2
indoor 92.4
man 92.1
standing 88.2
black and white 54.9
drawing 53.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Calm 83%
Surprised 6.5%
Disgusted 4.1%
Confused 2.7%
Happy 1.6%
Angry 1.1%
Sad 0.7%
Fear 0.2%

AWS Rekognition

Age 53-61
Gender Male, 98%
Calm 97%
Sad 0.9%
Surprised 0.6%
Angry 0.5%
Confused 0.5%
Disgusted 0.3%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 54-62
Gender Male, 99.7%
Sad 79.7%
Confused 12.3%
Surprised 2.9%
Calm 1.6%
Angry 1.5%
Happy 0.8%
Disgusted 0.7%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Chair
Person 99.5%
Person 99.2%
Person 98.8%
Person 98.5%
Person 98.4%
Person 96.4%
Person 81.5%
Tie 78%
Chair 61.9%

Categories

Imagga

paintings art 87.4%
people portraits 6.9%
text visuals 3.6%

Text analysis

Amazon

8
3
13
G
L'
< G L' 8 3
<
YТ37А-ХАОX

Google

YT37A2-AGON * **
YT37A2-AGON
*
**