Human Generated Data

Title

Untitled (fifteen people posed in living room for golden anniversary celebration)

Date

1961

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9851

Human Generated Data

Title

Untitled (fifteen people posed in living room for golden anniversary celebration)

People

Artist: Martin Schweig, American 20th century

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Apparel 99.3
Clothing 99.3
Person 99.3
Human 99.3
Person 99.1
Person 98.9
Person 98.9
Person 98.5
Person 97.7
Person 97.3
Person 97
Person 96.7
Chair 95.1
Furniture 95.1
Person 94.2
Face 93.5
Person 92.4
Person 89.4
Head 89.1
Dress 79.6
Female 79.3
Person 78.5
Table 78.5
Coat 78
Indoors 76.7
Overcoat 76
Suit 76
Photography 72.4
Photo 72.4
Portrait 72.4
Kid 67.3
Child 67.3
Food 66.7
Meal 66.7
People 66.5
Room 66
Shirt 65.6
Girl 64.6
Floor 60.1
Sleeve 59.5
Clinic 58.1
Plant 57.3
Woman 57.2
Baby 56.6
Lab Coat 56.6
Person 50

Imagga
created on 2022-01-28

nurse 100
male 35.4
man 33.1
people 32.9
businessman 30.9
person 30.5
business 27.9
patient 27.6
team 25.1
men 24.9
happy 23.8
adult 23.5
medical 22.1
hospital 21.5
professional 21.5
office 21
doctor 20.7
colleagues 20.4
smiling 20.2
businesswoman 20
teamwork 19.5
job 18.6
group 18.5
indoors 18.4
30s 18.3
women 18.2
businesspeople 17.1
worker 17
room 16.6
clinic 16.4
corporate 16.3
working 15.9
40s 15.6
meeting 15.1
coat 14
standing 13.9
lab coat 13.5
case 12.9
portrait 12.9
20s 12.8
work 12.6
mid adult 12.5
health 12.5
medicine 12.3
looking 12
associates 11.8
suit 11.7
illness 11.4
ethnic 11.4
talking 11.4
smile 11.4
new 11.3
mature 11.2
day 11
sick person 10.8
thirties 10.7
four 10.5
together 10.5
success 10.5
clothing 10.4
desk 10.4
sitting 10.3
manager 10.2
casual 10.2
camera 10.2
care 9.9
discussing 9.8
coworkers 9.8
home 9.6
profession 9.6
executive 9.4
happiness 9.4
lifestyle 9.4
senior 9.4
successful 9.1
modern 9.1
color 8.9
staff 8.9
forties 8.8
50s 8.8
discussion 8.8
middle aged 8.8
assistant 8.7
couple 8.7
table 8.6
diversity 8.6
black 8.4
company 8.4
inside 8.3
cheerful 8.1
family 8
to 8
business people 7.9
two people 7.8
expertise 7.8
angle 7.7
partnership 7.7
two 7.6
adults 7.6
life 7.6
horizontal 7.5
building 7.4
occupation 7.3
bright 7.1
handsome 7.1

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

person 98.5
clothing 95.5
text 95.2
man 84.5
posing 77.1
smile 61.6
woman 61.1

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 99.8%
Happy 51.6%
Confused 32%
Disgusted 6.4%
Surprised 2.8%
Sad 2.7%
Calm 2.7%
Angry 1.4%
Fear 0.4%

AWS Rekognition

Age 37-45
Gender Male, 100%
Happy 43.5%
Surprised 42.8%
Confused 8.7%
Calm 2.3%
Sad 0.9%
Angry 0.7%
Disgusted 0.6%
Fear 0.4%

AWS Rekognition

Age 48-56
Gender Male, 99%
Calm 71.6%
Surprised 23.9%
Sad 2.3%
Confused 1.2%
Angry 0.3%
Disgusted 0.3%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 40-48
Gender Male, 97.3%
Happy 97.3%
Surprised 0.9%
Calm 0.7%
Sad 0.4%
Confused 0.2%
Fear 0.2%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99.6%
Calm 72.3%
Surprised 10.6%
Happy 6.7%
Sad 2.9%
Fear 2.3%
Disgusted 2.2%
Confused 2.2%
Angry 0.8%

AWS Rekognition

Age 52-60
Gender Male, 99.9%
Calm 99.5%
Confused 0.2%
Sad 0.1%
Surprised 0.1%
Happy 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 43-51
Gender Female, 89.3%
Happy 97.4%
Calm 1.5%
Sad 0.4%
Confused 0.2%
Disgusted 0.2%
Surprised 0.1%
Fear 0%
Angry 0%

AWS Rekognition

Age 47-53
Gender Male, 95.7%
Calm 68%
Happy 17.9%
Disgusted 5.3%
Sad 4.9%
Angry 1.8%
Confused 0.9%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 49-57
Gender Male, 98.6%
Sad 52.2%
Calm 22%
Surprised 11.1%
Happy 4.9%
Angry 4%
Fear 2.5%
Disgusted 1.9%
Confused 1.3%

AWS Rekognition

Age 16-24
Gender Male, 96.1%
Calm 86.1%
Sad 11%
Confused 1.1%
Angry 1%
Surprised 0.3%
Disgusted 0.2%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 97.7%
Calm 47.9%
Sad 18.2%
Surprised 12%
Happy 6.2%
Confused 5%
Disgusted 4.6%
Angry 4%
Fear 2.1%

AWS Rekognition

Age 52-60
Gender Male, 99.7%
Sad 79.7%
Calm 13.3%
Confused 4.2%
Angry 1.1%
Disgusted 0.6%
Happy 0.5%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 30-40
Gender Male, 100%
Sad 95.3%
Calm 1.4%
Happy 1.4%
Confused 0.5%
Disgusted 0.5%
Angry 0.4%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 48-54
Gender Male, 99.4%
Sad 94.8%
Calm 1.8%
Angry 1.2%
Happy 0.8%
Disgusted 0.5%
Confused 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 19-27
Gender Male, 75.8%
Calm 88.5%
Sad 4.3%
Surprised 2.1%
Happy 2%
Fear 1.1%
Angry 1%
Disgusted 0.5%
Confused 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of people posing for a photo 89%
a group of people posing for the camera 88.9%
a group of people posing for a picture 88.8%

Text analysis

Amazon

BOUSO

Google

MJI7--YT37A°2-
XAGON
MJI7--YT37A°2- - XAGON
-