Human Generated Data

Title

Untitled (group posing with bottles)

Date

c. 1935-1940

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4379

Human Generated Data

Title

Untitled (group posing with bottles)

People

Artist: Durette Studio, American 20th century

Date

c. 1935-1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Clothing 99.7
Apparel 99.7
Human 99.6
Person 99.6
Person 98.7
People 97.7
Person 95.8
Person 95.6
Person 94
Face 92.5
Person 91.2
Shorts 91.2
Female 91
Person 88.8
Plant 88
Grass 88
Outdoors 84.1
Dress 83.9
Field 83.3
Coat 82.5
Suit 82.5
Overcoat 82.5
Person 80
Team Sport 77.1
Sport 77.1
Sports 77.1
Team 77.1
Woman 76.9
Child 74.8
Kid 74.8
Photo 74.4
Portrait 74.4
Photography 74.4
Pants 72
Girl 62.5
Person 61.6
Tree 59.9
Nature 59.5
Football 57.6
Man 56.5
Baby 56.1

Clarifai
created on 2019-06-01

people 99.9
group together 98.5
child 97.5
adult 96.3
group 96
man 95.8
several 94
wear 93.4
many 93.1
woman 92.3
three 91.9
outfit 91.9
four 91.1
retro 90.2
monochrome 89.5
facial expression 88.5
recreation 87.4
two 86.7
boy 86.2
five 86.1

Imagga
created on 2019-06-01

child 39.3
people 32.4
man 30.2
tricycle 29.8
wheeled vehicle 27.8
outdoors 27.6
outdoor 27.5
happy 26.9
kin 26.6
male 25.7
pedestrian 24.2
lifestyle 23.9
happiness 23.5
fun 23.2
family 23.1
person 20.7
active 20.7
park 20.6
vehicle 20.4
adult 20.1
sport 19.3
boy 19.1
love 18.9
portrait 18.8
together 18.4
joy 18.4
smiling 18.1
summer 18
outside 18
parent 17.4
mother 17.2
sky 16.6
couple 16.6
sunset 16.2
kid 16
world 15.4
leisure 14.9
day 14.9
beach 14.5
conveyance 14.1
walking 13.3
autumn 13.2
smile 12.8
playing 12.8
two 12.7
grass 12.7
daughter 12.5
childhood 11.6
silhouette 11.6
walk 11.4
laughing 11.3
relationship 11.2
play 11.2
children 10.9
father 10.9
field 10.9
activity 10.8
vacation 10.6
enjoying 10.4
ball 10.3
healthy 10.1
freedom 10.1
son 10
holiday 10
cheerful 9.8
running 9.6
life 9.5
women 9.5
free 9.4
casual 9.3
girls 9.1
holding 9.1
exercise 9.1
player 9
black 9
human 9
sibling 8.9
little 8.8
full length 8.7
cute 8.6
men 8.6
youth 8.5
dad 8.5
evening 8.4
fit 8.3
countryside 8.2
fall 8.1
having fun 7.9
travel 7.7
health 7.6
clouds 7.6
enjoy 7.5
action 7.4
sun 7.2
romance 7.1
romantic 7.1
sea 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

outdoor 98.8
grass 97.4
clothing 95.1
person 93.8

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 52.4%
Sad 54.6%
Angry 45.1%
Disgusted 45%
Surprised 45%
Happy 45%
Calm 45.2%
Confused 45%

AWS Rekognition

Age 26-43
Gender Female, 54.2%
Disgusted 48.1%
Happy 46%
Surprised 45.5%
Sad 45.4%
Angry 48%
Confused 45.4%
Calm 46.6%

AWS Rekognition

Age 20-38
Gender Male, 50.2%
Confused 45.2%
Happy 45.3%
Calm 52%
Disgusted 45.3%
Sad 46.2%
Angry 45.5%
Surprised 45.5%

AWS Rekognition

Age 20-38
Gender Female, 54.5%
Angry 47.4%
Surprised 45.4%
Disgusted 46%
Sad 48.9%
Calm 46.7%
Happy 45.4%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Calm 48.2%
Disgusted 46%
Sad 48.4%
Surprised 45.7%
Happy 45.6%
Confused 45.4%
Angry 45.7%

AWS Rekognition

Age 26-43
Gender Male, 54.3%
Confused 45.6%
Surprised 45.9%
Calm 50%
Sad 45.9%
Happy 45.7%
Disgusted 45.8%
Angry 46%

AWS Rekognition

Age 15-25
Gender Male, 50.7%
Angry 45.2%
Calm 47%
Sad 51.4%
Surprised 45.2%
Disgusted 45%
Happy 45%
Confused 46.1%

AWS Rekognition

Age 26-43
Gender Female, 52.1%
Angry 45.6%
Sad 50.6%
Happy 46.4%
Confused 45.2%
Surprised 45.6%
Calm 45.5%
Disgusted 46.1%

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of baseball players standing on top of a grass covered field 45.4%
a group of baseball players standing on top of a field 45.3%
a group of baseball players on a field 45.2%