Human Generated Data

Title

Untitled (group portrait of Merrill, ME women's basketball team with coach)
Date

c. 1920-1940, printed later
People

Artist: O. B. Porter Studio, American active 1930s-1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12334

Human Generated Data

Title

Untitled (group portrait of Merrill, ME women's basketball team with coach)

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Date

c. 1920-1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.6
Person 99.6
Person 99.5
Person 99.5
Person 99
Person 98.5
Person 98
Person 98
Person 97.9
People 93.1
Clothing 89
Apparel 89
Boy 75.3
Shorts 74.2
Sports 73.4
Sport 73.4
Footwear 72.3
Shoe 72.3
Team 70.8
Shoe 68.9
Female 67.7
Face 65.7
Team Sport 63.5
Coat 63.5
Suit 63.5
Overcoat 63.5
Skin 63.2
Crowd 61.2
Text 57.6
Performer 57.5
Athlete 57.2
Girl 56.7

Clarifai
created on 2019-11-16

people 99.9
group together 99.3
group 99.2
woman 97.6
adult 97.3
many 93.9
wear 93.8
portrait 93.2
facial expression 93.1
sitting 91.3
outfit 91.3
position 90.8
man 89.9
five 88.3
four 87.8
child 87
several 87
retro 86
recreation 83.1
furniture 81.1

Imagga
created on 2019-11-16

kin 63.1
person 35.4
people 34.6
adult 29.2
ball 27
man 26.9
male 26.4
child 24.5
love 23.7
couple 22.6
happy 21.9
family 21.3
body 20.8
portrait 20.7
lifestyle 20.2
happiness 19.6
soccer ball 19.6
attractive 18.9
sport 18.4
women 16.6
mother 16.3
smile 15.7
men 15.4
youth 15.3
group 15.3
smiling 15.2
fashion 15.1
dancer 14.9
fun 14.2
together 14
sitting 13.7
game equipment 13.3
brunette 13.1
boy 13
cute 12.9
husband 12.6
model 12.4
father 12.4
wife 12.3
studio 12.1
sexy 12
black 12
human 12
life 11.9
fitness 11.7
joy 11.7
leisure 11.6
player 11.3
pretty 11.2
team 10.7
athlete 10.5
married 10.5
one 10.4
hair 10.3
parent 10.2
casual 10.2
performer 10.1
exercise 10
equipment 9.9
lady 9.7
dark 9.2
clothing 9.2
professional 9
blond 9
daughter 9
kid 8.9
looking 8.8
passion 8.5
health 8.3
active 8.3
holding 8.2
care 8.2
girls 8.2
healthy 8.2
son 8.1
activity 8.1
home 8
interior 8
business 7.9
face 7.8
couch 7.7
entertainer 7.6
planner 7.6
females 7.6
relaxation 7.5
enjoy 7.5
friends 7.5
dance 7.5
training 7.4
emotion 7.4
world 7.3
cheerful 7.3
childhood 7.2
posing 7.1
businessman 7.1
indoors 7

Google
created on 2019-11-16

Photograph 96.3
Team 87
Snapshot 83.9
Photography 73.8
Black-and-white 68.3
Sitting 66.1
Family 58
Monochrome 54.4

Microsoft
created on 2019-11-16

person 99.2
posing 95.9
woman 94.5
footwear 92.5
clothing 88.5
smile 78
text 72.3
group 70.3
black 66.3
old 45.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-23
Gender Female, 54.3%
Happy 45%
Angry 45.5%
Disgusted 45%
Calm 54.3%
Fear 45%
Surprised 45%
Confused 45%
Sad 45.1%

AWS Rekognition

Age 20-32
Gender Male, 52.1%
Sad 45%
Disgusted 45%
Confused 45%
Surprised 45%
Happy 45.1%
Fear 45%
Angry 45%
Calm 54.8%

AWS Rekognition

Age 21-33
Gender Female, 54.9%
Happy 45.5%
Calm 54.3%
Disgusted 45%
Surprised 45%
Fear 45%
Sad 45%
Confused 45%
Angry 45%

AWS Rekognition

Age 12-22
Gender Male, 50.4%
Fear 45%
Surprised 45%
Angry 45.1%
Calm 54.4%
Sad 45.1%
Happy 45.2%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 19-31
Gender Male, 53.3%
Surprised 45%
Angry 45%
Fear 45%
Calm 54.8%
Confused 45%
Sad 45%
Disgusted 45%
Happy 45.1%

AWS Rekognition

Age 20-32
Gender Male, 54.8%
Calm 54.3%
Confused 45.2%
Happy 45.4%
Disgusted 45%
Surprised 45%
Sad 45%
Fear 45%
Angry 45%

AWS Rekognition

Age 11-21
Gender Female, 51.9%
Confused 45.2%
Calm 52.6%
Sad 45.9%
Surprised 45.2%
Happy 45%
Disgusted 45%
Fear 45.6%
Angry 45.3%

AWS Rekognition

Age 19-31
Gender Male, 51.3%
Calm 49.9%
Sad 45.5%
Happy 45.1%
Angry 49%
Surprised 45.1%
Confused 45.2%
Disgusted 45.1%
Fear 45.1%

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 72.3%
Suit 63.5%

Captions

Microsoft

a group of people posing for a photo 97.9%
a group of people sitting posing for the camera 97.7%
a group of people posing for the camera 97.6%

Text analysis

Amazon

RRILL
ERL
ERRIL
ERRIT ERRIL
ERRIT
RiLl

Google

FRILL
ERRIA
RR
ERRIA RR FRILL