Human Generated Data

Title

Untitled (woman chatting with four people in chairs at New Year's party)

Date

1952

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9409

Human Generated Data

Title

Untitled (woman chatting with four people in chairs at New Year's party)

People

Artist: Martin Schweig, American 20th century

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.6
Human 99.6
Clothing 99.4
Apparel 99.4
Person 98.5
Person 98.1
Person 97.8
Person 90.8
Person 85.8
Furniture 84.1
Person 81
Person 76
Hat 75.1
Face 71.4
People 69.7
Person 63.9
Food 61.9
Meal 61.9
Portrait 61.5
Photo 61.5
Photography 61.5
Couch 59.2
Indoors 57.8
Room 57.8
Bonnet 56.9

Imagga
created on 2022-01-23

person 37.4
people 36.3
man 33.6
adult 30.2
patient 29.5
home 28.7
salon 27.9
male 27.7
couple 25.3
room 25.2
indoors 24.6
women 21.4
nurse 20
men 19.8
senior 19.7
happy 19.4
hospital 19.1
smiling 18.8
professional 18.2
sitting 17.2
interior 16.8
medical 16.8
hairdresser 16.7
two 16.1
work 15.7
indoor 15.5
cheerful 15.4
barbershop 14.9
portrait 14.9
worker 14.8
health 14.6
care 14
office 13.7
smile 13.5
love 13.4
family 13.3
happiness 13.3
talking 13.3
doctor 13.2
clinic 13.1
shop 12.8
mother 12.7
bed 12.3
teacher 12.3
together 12.3
occupation 11.9
team 11.6
lifestyle 11.6
business 11.5
medicine 11.5
meeting 11.3
table 11.3
mature 11.2
holding 10.7
two people 10.7
businessman 10.6
loving 10.5
illness 10.5
group 10.5
life 10.5
old 10.5
desk 10.4
inside 10.1
face 9.9
uniform 9.8
lady 9.7
to 9.7
husband 9.7
elderly 9.6
chair 9.5
mercantile establishment 9.4
kin 9.4
domestic 9.2
communication 9.2
modern 9.1
dress 9
educator 8.9
romantic 8.9
working 8.8
assistance 8.7
education 8.7
businesspeople 8.5
wife 8.5
casual 8.5
house 8.4
sick person 8.3
human 8.2
case 8.2
aged 8.1
coat 8.1
looking 8
holiday 7.9
colleagues 7.8
sick 7.7
married 7.7
groom 7.6
enjoying 7.6
togetherness 7.6
relationship 7.5
teamwork 7.4
20s 7.3
businesswoman 7.3
suit 7.2
grandma 7.1
handsome 7.1
job 7.1
day 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 92.1
woman 89.1
clothing 88.1
wedding dress 84.4
text 78.7
dress 76.9
human face 68.6
bride 67.9
dining table 8.4

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Female, 92.4%
Sad 40.3%
Happy 29.5%
Surprised 17.4%
Calm 7.3%
Confused 1.8%
Fear 1.6%
Disgusted 1%
Angry 1%

AWS Rekognition

Age 45-53
Gender Female, 56%
Sad 32.3%
Happy 24.2%
Calm 20.7%
Confused 12.3%
Surprised 4.1%
Disgusted 2.7%
Fear 2.3%
Angry 1.4%

AWS Rekognition

Age 34-42
Gender Male, 98%
Calm 97.7%
Surprised 1.7%
Happy 0.3%
Confused 0.1%
Sad 0.1%
Disgusted 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 30-40
Gender Male, 62.4%
Calm 80.2%
Sad 13.2%
Disgusted 2%
Happy 1.8%
Confused 0.9%
Angry 0.9%
Surprised 0.7%
Fear 0.4%

AWS Rekognition

Age 40-48
Gender Female, 98.9%
Calm 83.8%
Sad 4.3%
Happy 3.4%
Surprised 3%
Confused 1.8%
Angry 1.4%
Fear 1.4%
Disgusted 0.9%

AWS Rekognition

Age 25-35
Gender Female, 89.2%
Calm 79.7%
Happy 14.9%
Sad 2.3%
Surprised 1.3%
Confused 0.6%
Disgusted 0.5%
Angry 0.4%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 75.1%

Captions

Microsoft

a group of people sitting at a table 78%
a group of people in a room 77.9%
a group of people sitting around a table 77.8%

Text analysis

Amazon

AA
AA 83A
83A
ODVK-SVEETA