Human Generated Data

Title

Untitled (fifteen people posed in living room for golden anniversary celebration)
Date

1961
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9851

Human Generated Data

Title

Untitled (fifteen people posed in living room for golden anniversary celebration)

People

Artist: Martin Schweig, American 20th century

Date

1961

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9851

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Clothing 99.3
Apparel 99.3
Person 99.3
Human 99.3
Person 99.1
Person 98.9
Person 98.9
Person 98.5
Person 97.7
Person 97.3
Person 97
Person 96.7
Chair 95.1
Furniture 95.1
Person 94.2
Face 93.5
Person 92.4
Person 89.4
Head 89.1
Dress 79.6
Female 79.3
Person 78.5
Table 78.5
Coat 78
Indoors 76.7
Suit 76
Overcoat 76
Portrait 72.4
Photography 72.4
Photo 72.4
Kid 67.3
Child 67.3
Meal 66.7
Food 66.7
People 66.5
Room 66
Shirt 65.6
Girl 64.6
Floor 60.1
Sleeve 59.5
Clinic 58.1
Plant 57.3
Woman 57.2
Baby 56.6
Lab Coat 56.6
Person 50

Clarifai
created on 2023-10-27

people 99.8
group 99.4
man 98.3
adult 98.1
woman 95.7
group together 95.1
healthcare 94.5
medical practitioner 92.2
uniform 90.5
many 90.3
medicine 89.9
scientist 89.5
coat 89.3
education 88.9
science 88.1
hospital 86
doctor 85.8
squad 82.6
outerwear 82.1
medical 78.5

Imagga
created on 2022-01-28

nurse 100
male 35.4
man 33.1
people 32.9
businessman 30.9
person 30.5
business 27.9
patient 27.6
team 25.1
men 24.9
happy 23.8
adult 23.5
medical 22.1
hospital 21.5
professional 21.5
office 21
doctor 20.7
colleagues 20.4
smiling 20.2
businesswoman 20
teamwork 19.5
job 18.6
group 18.5
indoors 18.4
30s 18.3
women 18.2
businesspeople 17.1
worker 17
room 16.6
clinic 16.4
corporate 16.3
working 15.9
40s 15.6
meeting 15.1
coat 14
standing 13.9
lab coat 13.5
case 12.9
portrait 12.9
20s 12.8
work 12.6
mid adult 12.5
health 12.5
medicine 12.3
looking 12
associates 11.8
suit 11.7
illness 11.4
ethnic 11.4
talking 11.4
smile 11.4
new 11.3
mature 11.2
day 11
sick person 10.8
thirties 10.7
four 10.5
together 10.5
success 10.5
clothing 10.4
desk 10.4
sitting 10.3
manager 10.2
casual 10.2
camera 10.2
care 9.9
discussing 9.8
coworkers 9.8
home 9.6
profession 9.6
executive 9.4
happiness 9.4
lifestyle 9.4
senior 9.4
successful 9.1
modern 9.1
color 8.9
staff 8.9
forties 8.8
50s 8.8
discussion 8.8
middle aged 8.8
assistant 8.7
couple 8.7
table 8.6
diversity 8.6
black 8.4
company 8.4
inside 8.3
cheerful 8.1
family 8
to 8
business people 7.9
two people 7.8
expertise 7.8
angle 7.7
partnership 7.7
two 7.6
adults 7.6
life 7.6
horizontal 7.5
building 7.4
occupation 7.3
bright 7.1
handsome 7.1

Google
created on 2022-01-28

Photograph 94.3
Health care provider 87.1
Nurse 79.2
Health care 74.4
Medical assistant 74.3
Snapshot 74.3
Medical 71.8
Event 71.4
Art 70.5
Service 70.2
Room 69.1
Shelf 66.4
Monochrome 65.9
Monochrome photography 64.3
Clinic 63.7
Stock photography 63.7
Science 63.5
Building 62.6
Font 62.2
Vintage clothing 59

Microsoft
created on 2022-01-28

person 98.5
clothing 95.5
text 95.2
man 84.5
posing 77.1
smile 61.6
woman 61.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 99.8%
Happy 51.6%
Confused 32%
Disgusted 6.4%
Surprised 2.8%
Sad 2.7%
Calm 2.7%
Angry 1.4%
Fear 0.4%

AWS Rekognition

Age 37-45
Gender Male, 100%
Happy 43.5%
Surprised 42.8%
Confused 8.7%
Calm 2.3%
Sad 0.9%
Angry 0.7%
Disgusted 0.6%
Fear 0.4%

AWS Rekognition

Age 48-56
Gender Male, 99%
Calm 71.6%
Surprised 23.9%
Sad 2.3%
Confused 1.2%
Angry 0.3%
Disgusted 0.3%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 40-48
Gender Male, 97.3%
Happy 97.3%
Surprised 0.9%
Calm 0.7%
Sad 0.4%
Confused 0.2%
Fear 0.2%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99.6%
Calm 72.3%
Surprised 10.6%
Happy 6.7%
Sad 2.9%
Fear 2.3%
Disgusted 2.2%
Confused 2.2%
Angry 0.8%

AWS Rekognition

Age 52-60
Gender Male, 99.9%
Calm 99.5%
Confused 0.2%
Sad 0.1%
Surprised 0.1%
Happy 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 43-51
Gender Female, 89.3%
Happy 97.4%
Calm 1.5%
Sad 0.4%
Confused 0.2%
Disgusted 0.2%
Surprised 0.1%
Fear 0%
Angry 0%

AWS Rekognition

Age 47-53
Gender Male, 95.7%
Calm 68%
Happy 17.9%
Disgusted 5.3%
Sad 4.9%
Angry 1.8%
Confused 0.9%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 49-57
Gender Male, 98.6%
Sad 52.2%
Calm 22%
Surprised 11.1%
Happy 4.9%
Angry 4%
Fear 2.5%
Disgusted 1.9%
Confused 1.3%

AWS Rekognition

Age 16-24
Gender Male, 96.1%
Calm 86.1%
Sad 11%
Confused 1.1%
Angry 1%
Surprised 0.3%
Disgusted 0.2%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 97.7%
Calm 47.9%
Sad 18.2%
Surprised 12%
Happy 6.2%
Confused 5%
Disgusted 4.6%
Angry 4%
Fear 2.1%

AWS Rekognition

Age 52-60
Gender Male, 99.7%
Sad 79.7%
Calm 13.3%
Confused 4.2%
Angry 1.1%
Disgusted 0.6%
Happy 0.5%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 30-40
Gender Male, 100%
Sad 95.3%
Calm 1.4%
Happy 1.4%
Confused 0.5%
Disgusted 0.5%
Angry 0.4%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 48-54
Gender Male, 99.4%
Sad 94.8%
Calm 1.8%
Angry 1.2%
Happy 0.8%
Disgusted 0.5%
Confused 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 19-27
Gender Male, 75.8%
Calm 88.5%
Sad 4.3%
Surprised 2.1%
Happy 2%
Fear 1.1%
Angry 1%
Disgusted 0.5%
Confused 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.3%
Person 99.1%
Person 98.9%
Person 98.9%
Person 98.5%
Person 97.7%
Person 97.3%
Person 97%
Person 96.7%
Person 94.2%
Person 92.4%
Person 89.4%
Person 78.5%
Person 50%

Text analysis

Amazon

BOUSO

Google

MJI7--YT37A°2- - XAGON
MJI7--YT37A°2-
-
XAGON