Human Generated Data

Title

Untitled (group portrait of Merrill, ME men's basketball team with coach)
Date

c. 1920-1940, printed later
People

Artist: O. B. Porter Studio, American active 1930s-1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12333

Human Generated Data

Title

Untitled (group portrait of Merrill, ME men's basketball team with coach)

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Date

c. 1920-1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.9
Human 99.9
Person 99.8
Person 99.7
Person 99.7
Person 99.5
Person 99.5
Person 99.3
Person 98.7
Person 98.3
Person 98
Person 96.8
Person 96.5
People 90.1
Footwear 90
Clothing 90
Apparel 90
Shoe 90
Shoe 90
Shorts 88.1
Suit 85.8
Coat 85.8
Overcoat 85.8
Shoe 84.2
Skin 83.5
Shoe 72
Female 68.7
Team 67.2
Crowd 61.6
Girl 61.2
Sport 60.7
Sports 60.7
Fitness 60.4
Working Out 60.4
Exercise 60.4
Person 60
Child 58.3
Woman 58.3
Blonde 58.3
Kid 58.3
Teen 58.3
Indoors 55.9
Shoe 51.5
Shoe 51.1

Clarifai
created on 2019-11-16

people 99.8
group together 99.5
many 98.5
group 98.3
adult 97.8
athlete 97.7
woman 97.3
wear 96.5
man 93.3
recreation 92.5
several 90.6
outfit 90.1
five 89.7
portrait 89.5
music 89.4
sports equipment 87
dancer 86.8
four 85.9
motion 85.7
competition 82.4

Imagga
created on 2019-11-16

dancer 57.9
person 45.8
performer 43.9
sexy 42.6
body 41.6
model 36.6
erotic 33.6
attractive 33.6
people 33.5
entertainer 33.3
skin 31.1
adult 29
black 28.4
portrait 26.5
fashion 25.6
nude 24.3
sensual 22.7
one 22.4
hair 22.2
lady 21.9
pretty 20.3
naked 19.3
studio 19
face 18.5
dark 18.4
love 18.2
style 17.8
kin 16.8
women 16.6
human 16.5
sensuality 16.4
male 16.3
posing 16
passion 16
lifestyle 15.9
blond 15.7
man 15.5
pose 15.4
dance 15
sexual 14.5
desire 14.4
legs 14.2
seductive 13.4
breast 12.7
art 12.4
men 12
gorgeous 11.8
brunette 11.3
slim 11.1
hot 10.9
cute 10.8
happy 10.7
muscular 10.5
couple 10.5
looking 10.4
clothing 10.4
lying 10.3
sitting 10.3
healthy 10.1
silhouette 9.9
health 9.7
glamorous 9.7
gymnasium 9.4
happiness 9.4
lips 9.3
elegance 9.2
lingerie 9.1
world 9
fun 9
sex 8.8
expression 8.5
back 8.4
emotion 8.3
makeup 8.2
athlete 8.2
girls 8.2
glamor 7.7
athletic 7.7
wife 7.6
athletic facility 7.6
pleasure 7.5
relaxation 7.5
enjoy 7.5
sport 7.5
fit 7.4
fitness 7.2
dress 7.2
smile 7.1

Google
created on 2019-11-16

Team 81.4
Art 67.7
Photography 62.4
Black-and-white 56.4

Microsoft
created on 2019-11-16

posing 99.9
wall 98.8
person 98.2
smile 93.6
clothing 91
standing 90.1
group 87.1
human face 85.6
text 75.5
old 66.5
man 66
black 65.1
boy 57.6
footwear 55.2
school 54.8
step 31.6
team 25.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-28
Gender Male, 53.9%
Disgusted 45%
Surprised 45%
Happy 45.1%
Confused 45%
Sad 45%
Fear 45%
Angry 45%
Calm 54.9%

AWS Rekognition

Age 12-22
Gender Male, 54.7%
Angry 45%
Sad 45%
Happy 45%
Disgusted 45%
Calm 54.9%
Confused 45%
Surprised 45%
Fear 45%

AWS Rekognition

Age 11-21
Gender Female, 51.1%
Disgusted 45%
Angry 45%
Confused 45%
Sad 45%
Calm 55%
Happy 45%
Fear 45%
Surprised 45%

AWS Rekognition

Age 12-22
Gender Male, 52.9%
Sad 45%
Happy 45%
Fear 45%
Calm 54.9%
Angry 45%
Disgusted 45%
Confused 45%
Surprised 45%

AWS Rekognition

Age 22-34
Gender Male, 53.7%
Angry 45%
Surprised 45%
Sad 45%
Happy 45.4%
Disgusted 45%
Confused 45%
Calm 54.6%
Fear 45%

AWS Rekognition

Age 12-22
Gender Male, 54.8%
Angry 45%
Happy 45%
Disgusted 45%
Confused 45%
Surprised 45%
Calm 54.9%
Fear 45%
Sad 45%

AWS Rekognition

Age 14-26
Gender Male, 54.7%
Happy 45%
Fear 45%
Angry 45%
Confused 45%
Calm 54.9%
Disgusted 45%
Surprised 45%
Sad 45.1%

AWS Rekognition

Age 21-33
Gender Male, 53.5%
Fear 45%
Happy 45%
Confused 45%
Calm 54.9%
Disgusted 45%
Sad 45%
Angry 45%
Surprised 45%

AWS Rekognition

Age 12-22
Gender Male, 53%
Fear 45%
Surprised 45%
Angry 45%
Happy 45%
Disgusted 45%
Confused 45%
Sad 45.1%
Calm 54.8%

AWS Rekognition

Age 12-22
Gender Male, 54.1%
Angry 45%
Disgusted 45%
Happy 45%
Calm 54.9%
Surprised 45%
Fear 45%
Confused 45%
Sad 45%

AWS Rekognition

Age 13-23
Gender Male, 53.6%
Happy 45.1%
Confused 45.2%
Calm 54.4%
Angry 45.2%
Disgusted 45%
Surprised 45.1%
Fear 45%
Sad 45.1%

AWS Rekognition

Age 18-30
Gender Male, 52.8%
Angry 45%
Disgusted 45%
Happy 45%
Calm 54.9%
Sad 45%
Surprised 45%
Fear 45%
Confused 45%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Shoe 90%
Suit 85.8%

Captions

Microsoft

Cullen Landis et al. posing for a photo 98.1%
Cullen Landis et al. posing for the camera 98%
Cullen Landis et al. posing for a picture 97.9%

Text analysis

Amazon

MERRO
ERR
ERR MERRO ERRIL
ERRIL
ERREY

Google

ERRILL
MERRI
ERRIL
RR
ERRILL RR ERR MERRI ERRIL
ERR