Human Generated Data

Title

Untitled (young women sitting around living room and chatting)

Date

1941

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10148

Human Generated Data

Title

Untitled (young women sitting around living room and chatting)

People

Artist: Martin Schweig, American 20th century

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.4
Human 99.4
Person 98.7
Person 98.6
Person 98.6
Person 97.4
Person 97.2
Person 95
Person 91.1
Person 90.1
Poster 89.6
Advertisement 89.6
Person 87.7
Person 86.7
Indoors 84.3
Room 84.3
People 73.9
Crowd 70.2
Clothing 69.8
Apparel 69.8
Dressing Room 57.5

Imagga
created on 2022-01-22

sport 25
person 24.7
man 21.5
adult 21.4
people 20.6
world 17.9
black 17.6
lifestyle 16.6
fashion 15.8
lady 14.6
portrait 14.2
male 14.2
happy 13.8
exercise 13.6
posing 13.3
newspaper 13
sexy 12.8
body 12.8
hair 12.7
women 12.6
model 12.4
silhouette 12.4
dance 12.2
active 12.1
play 12.1
player 12
pretty 11.9
style 11.9
brass 11.8
action 11.3
cornet 11.1
dancer 11.1
elegance 10.9
fitness 10.8
wind instrument 10.6
human 10.5
attractive 10.5
outdoors 10.4
product 10.3
clothing 10.1
sensuality 10
face 9.9
ball 9.9
businessman 9.7
one 9.7
athlete 9.2
dark 9.2
activity 9
creation 8.6
happiness 8.6
modern 8.4
outdoor 8.4
energy 8.4
summer 8.4
leisure 8.3
freedom 8.2
teenager 8.2
dress 8.1
sunset 8.1
recreation 8.1
water 8
business 7.9
musical instrument 7.9
smile 7.8
board 7.8
motion 7.7
expression 7.7
casual 7.6
hand 7.6
performer 7.6
power 7.6
fun 7.5
fit 7.4
success 7.2
game 7.1
sky 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

text 99.8
person 99.5
clothing 95.2
window 85.7
woman 80.5
dance 77
footwear 74.1
people 65.8
man 64.6
old 58.6
posing 36.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 62%
Happy 81.1%
Calm 5.8%
Sad 5.2%
Surprised 2.8%
Fear 2.2%
Angry 2%
Disgusted 0.6%
Confused 0.3%

AWS Rekognition

Age 23-31
Gender Female, 99.9%
Calm 98.6%
Sad 0.7%
Confused 0.2%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 18-24
Gender Female, 54.9%
Happy 99.3%
Surprised 0.2%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Calm 0.1%
Sad 0.1%
Confused 0%

AWS Rekognition

Age 18-24
Gender Female, 100%
Calm 100%
Sad 0%
Confused 0%
Angry 0%
Surprised 0%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 23-33
Gender Female, 99.7%
Calm 99.4%
Sad 0.2%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Surprised 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Female, 100%
Happy 98.8%
Surprised 0.3%
Sad 0.2%
Angry 0.2%
Fear 0.2%
Calm 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 18-26
Gender Female, 99.8%
Happy 78.6%
Calm 10%
Fear 4.1%
Angry 1.9%
Surprised 1.9%
Sad 1.4%
Confused 1.1%
Disgusted 1%

AWS Rekognition

Age 19-27
Gender Female, 100%
Calm 46.1%
Surprised 18.1%
Angry 16.6%
Happy 13.9%
Fear 2.1%
Disgusted 1.5%
Sad 0.9%
Confused 0.8%

AWS Rekognition

Age 29-39
Gender Female, 100%
Happy 54.6%
Sad 29.3%
Fear 4%
Calm 3.1%
Surprised 3%
Disgusted 2.8%
Confused 1.8%
Angry 1.4%

AWS Rekognition

Age 20-28
Gender Female, 67.2%
Calm 93.7%
Fear 3.8%
Surprised 1.3%
Disgusted 0.4%
Happy 0.3%
Angry 0.2%
Sad 0.2%
Confused 0.1%

AWS Rekognition

Age 21-29
Gender Female, 81.6%
Fear 33%
Angry 18.5%
Sad 18.4%
Calm 16.5%
Happy 5.9%
Disgusted 4.2%
Surprised 1.7%
Confused 1.7%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Poster 89.6%

Captions

Microsoft

a group of people posing for a photo 89.1%
a group of people in an old photo of a person 86.6%
a group of people standing next to a window 86.5%

Text analysis

Amazon

PROOF
MARTIN
LOUIS
SAINT LOUIS
SAINT
MARTIN SCHWEIG
SCHWEIG

Google

MARTIN
SAINT
LOUIS
PROOF
PROOF MARTIN SCHWEIG SAINT LOUIS
SCHWEIG