Human Generated Data

Title

Untitled (group portrait of young men and women in front of curtain)

Date

c. 1920-1940, printed later

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12329

Human Generated Data

Title

Untitled (group portrait of young men and women in front of curtain)

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Date

c. 1920-1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.6
Human 99.6
Person 99
Person 99
Person 98.7
Person 98.3
Person 97.2
Person 96.4
Person 95.7
Person 94.6
Person 88.8
Person 88
Person 87.6
Crowd 87.3
Person 87.3
Person 87.1
People 87
Person 85.9
Skin 84.7
Audience 84.1
Person 77.9
Indoors 73.1
Classroom 73.1
Room 73.1
School 73.1
Person 72.8
Face 71.3
Female 66.7
Person 63.1
Person 61.5
Apparel 55.9
Clothing 55.9
Performer 55.5

Clarifai
created on 2019-11-16

people 99.9
group 99.9
many 99.7
group together 99.7
music 99.1
woman 98.1
musician 97.4
singer 97.2
child 96
adult 95.6
performance 95.5
band 95
man 95
stage 94.5
wear 93.8
portrait 92.1
theater 91.7
audience 90.2
guitarist 89.5
crowd 88.6

Imagga
created on 2019-11-16

kin 35.8
person 33.6
people 33.4
adult 30.4
man 25.5
black 23.8
male 22
group 20.9
sexy 20.9
silhouette 20.7
world 19.2
dark 18.4
model 17.9
dancer 17.7
body 17.6
attractive 17.5
portrait 16.8
fashion 16.6
men 16.3
performer 16.2
love 15.8
women 15
couple 14.8
dance 14.7
studio 14.4
human 14.2
gymnasium 12.8
pretty 12.6
passion 12.2
one 11.9
pose 11.8
posing 11.5
together 11.4
hair 11.1
dress 10.8
entertainer 10.5
brunette 10.4
boy 10.4
business 10.3
athletic facility 10.3
happy 10
sensual 10
lady 9.7
businessman 9.7
style 9.6
looking 9.6
lifestyle 9.4
sport 9.4
youth 9.4
sensuality 9.1
fun 9
art 8.7
erotic 8.5
teacher 8.5
skin 8.5
teenager 8.2
suit 8.1
team 8.1
night 8
to 8
facility 7.8
crowd 7.7
grunge 7.7
seductive 7.6
clothing 7.6
elegance 7.6
teamwork 7.4
girls 7.3
fitness 7.2
sunset 7.2
singer 7.2
shadow 7.2
cool 7.1
happiness 7
modern 7

Google
created on 2019-11-16

Photograph 96.5
People 94.3
Social group 90.9
Snapshot 84.1
Black-and-white 78.1
Photography 73.8
Room 65.7
Monochrome 64.3
Team 64.1
Event 62.7
Family 61.4
Portrait 55.1
Picture frame 52.4
Art 50.2

Microsoft
created on 2019-11-16

posing 99.4
clothing 98.8
smile 97.4
person 97.2
wall 96.4
group 92.9
human face 90.9
man 89
standing 87.9
woman 83.6
text 80.5
footwear 70.6
people 57.8
old 40.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Female, 53.3%
Calm 53.8%
Sad 45.7%
Fear 45%
Confused 45.2%
Angry 45.2%
Happy 45%
Disgusted 45%
Surprised 45.1%

AWS Rekognition

Age 12-22
Gender Male, 54.2%
Angry 45.7%
Happy 45%
Disgusted 45%
Calm 46.7%
Fear 45.9%
Surprised 45%
Sad 51.6%
Confused 45.1%

AWS Rekognition

Age 27-43
Gender Female, 54.8%
Angry 45.1%
Happy 45%
Disgusted 45%
Calm 54.1%
Fear 45%
Surprised 45%
Sad 45.7%
Confused 45.1%

AWS Rekognition

Age 12-22
Gender Male, 54.7%
Angry 45.2%
Happy 45.1%
Calm 54.4%
Confused 45.1%
Disgusted 45%
Fear 45%
Sad 45.1%
Surprised 45%

AWS Rekognition

Age 14-26
Gender Male, 54.8%
Fear 45.2%
Confused 45.2%
Calm 50.5%
Sad 45.5%
Disgusted 46.4%
Happy 46.6%
Surprised 45.3%
Angry 45.5%

AWS Rekognition

Age 22-34
Gender Male, 53.7%
Happy 45.1%
Surprised 45%
Fear 45%
Calm 54.5%
Angry 45%
Sad 45.2%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 22-34
Gender Female, 54.2%
Fear 45%
Angry 45%
Calm 54.7%
Happy 45.2%
Sad 45%
Disgusted 45%
Confused 45%
Surprised 45%

AWS Rekognition

Age 23-35
Gender Female, 54.6%
Fear 45.1%
Angry 45.4%
Calm 52.9%
Happy 45.2%
Sad 45.1%
Disgusted 45.1%
Confused 45.3%
Surprised 45.9%

AWS Rekognition

Age 19-31
Gender Male, 54.7%
Surprised 45.1%
Sad 45.1%
Confused 45.1%
Happy 45.3%
Disgusted 45%
Fear 45%
Angry 45%
Calm 54.3%

AWS Rekognition

Age 12-22
Gender Male, 54.9%
Fear 45%
Happy 45%
Angry 45.1%
Disgusted 45%
Sad 45%
Surprised 45%
Calm 54.8%
Confused 45%

AWS Rekognition

Age 17-29
Gender Female, 50.8%
Calm 53.3%
Sad 46%
Fear 45%
Disgusted 45%
Confused 45.1%
Surprised 45.1%
Happy 45%
Angry 45.4%

AWS Rekognition

Age 13-23
Gender Female, 50.2%
Fear 45%
Calm 54.4%
Disgusted 45%
Happy 45%
Sad 45.1%
Confused 45.1%
Surprised 45.1%
Angry 45.3%

AWS Rekognition

Age 16-28
Gender Female, 54.8%
Calm 50.3%
Happy 48.3%
Disgusted 45.1%
Surprised 45.1%
Angry 45.3%
Sad 45.8%
Fear 45.1%
Confused 45.1%

AWS Rekognition

Age 12-22
Gender Female, 54%
Fear 45%
Calm 54.6%
Angry 45.1%
Disgusted 45%
Confused 45%
Surprised 45%
Sad 45.1%
Happy 45.1%

AWS Rekognition

Age 22-34
Gender Male, 54.4%
Calm 53.8%
Sad 45.3%
Angry 45.3%
Disgusted 45.1%
Happy 45%
Surprised 45.1%
Fear 45.1%
Confused 45.3%

AWS Rekognition

Age 23-37
Gender Female, 54.7%
Calm 54.6%
Sad 45.2%
Confused 45%
Happy 45%
Angry 45.1%
Disgusted 45%
Fear 45%
Surprised 45%

AWS Rekognition

Age 12-22
Gender Female, 53.1%
Confused 45.4%
Disgusted 45.1%
Surprised 45.6%
Calm 48.9%
Angry 45.1%
Sad 45.2%
Happy 49.1%
Fear 45.5%

AWS Rekognition

Age 21-33
Gender Male, 52.7%
Disgusted 45.5%
Surprised 45.5%
Happy 45.1%
Confused 45.3%
Sad 45.6%
Fear 45.3%
Angry 45.8%
Calm 51.9%

AWS Rekognition

Age 15-27
Gender Female, 54.5%
Disgusted 45%
Fear 45%
Confused 45%
Angry 45%
Calm 54.8%
Surprised 45%
Sad 45.1%
Happy 45%

AWS Rekognition

Age 12-22
Gender Female, 54.8%
Sad 45.1%
Surprised 45%
Confused 45%
Angry 45%
Calm 54.7%
Fear 45%
Happy 45.1%
Disgusted 45%

AWS Rekognition

Age 22-34
Gender Male, 54.6%
Angry 45.2%
Disgusted 45%
Surprised 45%
Confused 45%
Fear 45%
Calm 54.7%
Sad 45%
Happy 45%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 14
Gender Male

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 41
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 13
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 98.4%
a group of people posing for the camera 98.3%
a group of people posing for a picture 98.2%