Human Generated Data

Title

Untitled (three men chatting in conference room surrounded by other men)

Date

1950-1955

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9400

Human Generated Data

Title

Untitled (three men chatting in conference room surrounded by other men)

People

Artist: Martin Schweig, American 20th century

Date

1950-1955

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9400

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.8
Apparel 99.8
Person 98.3
Human 98.3
Person 98
Person 97.9
Person 96.4
Person 96.3
Person 94.3
Person 93.9
Coat 87.5
Overcoat 87.5
Tie 84.9
Accessories 84.9
Accessory 84.9
Tie 83.8
Person 75.8
Suit 75.4
Suit 74
Suit 64.9
Text 64.2
Shirt 63.5
People 62.8
Veil 58.7
Tuxedo 58.5
Indoors 58.4
Face 57.6
Robe 55.5
Fashion 55.5
Person 42.8

Clarifai
created on 2023-10-26

people 99
man 97.7
science 97.6
monochrome 97.5
group 97.4
indoors 94.3
hospital 93.3
adult 92.8
medicine 91.1
education 90.5
healthcare 87.9
doctor 84.3
coat 82.6
group together 82
woman 80.9
interaction 80.1
medical 77.8
technology 76.9
business 76.5
three 74.6

Imagga
created on 2022-01-23

man 41.7
people 34.6
male 33.3
person 30.3
executive 28.9
patient 27.9
surgeon 27.5
senior 27.2
medical 24.7
professional 23.2
couple 21.8
doctor 21.6
business 21.3
adult 20.9
happy 20.7
men 19.7
home 19.1
office 18.6
indoors 17.6
smiling 17.4
hospital 17
team 17
meeting 17
businessman 16.8
nurse 16.5
mature 15.8
work 15.7
elderly 15.3
health 15.3
worker 15.3
metropolitan 15.1
sitting 14.6
clothing 14.4
women 14.2
job 14.2
occupation 13.7
suit 13.7
illness 13.3
portrait 12.9
corporate 12.9
clinic 12.7
happiness 12.5
coat 12.5
medicine 12.3
room 12.1
teamwork 12
specialist 12
old 11.8
care 11.5
to 11.5
interior 11.5
together 11.4
group 11.3
modern 11.2
70s 10.8
surgery 10.7
exam 10.5
talking 10.4
businesspeople 10.4
adults 10.4
looking 10.4
education 10.4
lifestyle 10.1
indoor 10
case 9.9
shower cap 9.7
retired 9.7
profession 9.6
standing 9.6
industry 9.4
casual 9.3
two 9.3
camera 9.2
working 8.8
40s 8.8
lab coat 8.7
career 8.5
desk 8.5
horizontal 8.4
color 8.3
inside 8.3
treatment 8.3
holding 8.3
human 8.2
handsome 8
smile 7.8
face 7.8
groom 7.8
table 7.8
cap 7.8
two people 7.8
colleagues 7.8
student 7.7
attractive 7.7
30s 7.7
retirement 7.7
husband 7.6
life 7.6
communication 7.6
technology 7.4
cheerful 7.3
businesswoman 7.3
success 7.2
aged 7.2
family 7.1
sick person 7
teacher 7

Google
created on 2022-01-23

Outerwear 95.2
Sleeve 87.2
Standing 86.4
Black-and-white 84.8
Style 83.9
Hat 80.8
Font 75.8
Monochrome photography 73.3
Event 73.2
Monochrome 72.9
Vintage clothing 69.9
Team 68.9
White-collar worker 67.8
Uniform 66.6
History 64.9
Formal wear 64.8
Art 64.8
Stock photography 63.3
Room 63.1
Crew 62.6

Microsoft
created on 2022-01-23

person 99.9
clothing 95.8
standing 93.2
text 92.5
indoor 90.8
man 89.4
line 29

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Male, 99.9%
Calm 99.4%
Surprised 0.2%
Confused 0.1%
Sad 0.1%
Happy 0.1%
Disgusted 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 100%
Surprised 94.4%
Happy 3%
Calm 1.3%
Angry 0.3%
Sad 0.3%
Disgusted 0.3%
Fear 0.2%
Confused 0.2%

AWS Rekognition

Age 33-41
Gender Female, 94.1%
Calm 69%
Sad 21.2%
Confused 4%
Angry 2.6%
Disgusted 1.3%
Happy 1.3%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 48-56
Gender Male, 99.6%
Calm 76.5%
Sad 12.2%
Confused 2.7%
Angry 2.5%
Surprised 2.3%
Happy 2.3%
Disgusted 1%
Fear 0.6%

AWS Rekognition

Age 29-39
Gender Male, 99.6%
Sad 81.7%
Fear 14.3%
Happy 0.9%
Calm 0.8%
Disgusted 0.7%
Confused 0.6%
Angry 0.5%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Tie 84.9%
Suit 75.4%

Text analysis

Amazon

8
3
El
st
st وم e 8 3
e
وم
YТ37А-АОX

Google

te e 8 3 YT37A2- AGON
te
e
8
3
YT37A2-
AGON