Human Generated Data

Title

Untitled (portrait of nine men with seven dressed as women)

Date

c. 1930-1940

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5944

Human Generated Data

Title

Untitled (portrait of nine men with seven dressed as women)

People

Artist: Durette Studio, American 20th century

Date

c. 1930-1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 99.8
Person 99.8
Person 99.6
Person 99.5
Person 99.4
Person 99.3
Person 99
Person 98.5
Clothing 97.7
Apparel 97.7
Person 97.6
Person 96.6
Shorts 94.2
Face 91.3
Furniture 90.3
Chair 90.3
People 81.3
Photo 67.7
Photography 67.7
Portrait 67.7
Helmet 65.6
Person 65.5
Crowd 65.4
Person 64.4
Shirt 59
Sailor Suit 57.9
Suit 55.6
Coat 55.6
Overcoat 55.6

Clarifai
created on 2019-06-01

people 100
group together 99.7
group 99.5
adult 98.3
many 98.1
several 97.9
man 97.3
woman 97
five 95.3
child 94.1
wear 93.3
four 93
facial expression 90.3
education 90.3
school 87.2
boy 87.2
offspring 87.1
portrait 84.4
leader 84.1
three 83.7

Imagga
created on 2019-06-01

brass 34.1
kin 31.3
people 28.4
wind instrument 27.7
man 25.5
beach 24.6
person 23.7
male 22.7
sky 21.7
silhouette 21.5
sport 20.9
active 20.8
sunset 20.6
adult 20.4
athlete 19.9
summer 19.9
musical instrument 19.6
cornet 18.6
lifestyle 17.3
exercise 17.2
player 17
men 16.3
ocean 15.7
sea 15.6
ballplayer 15.6
outdoor 15.3
outdoors 14.9
couple 14.8
water 14.7
fitness 14.4
happy 14.4
fun 14.2
contestant 13.4
love 13.4
happiness 13.3
leisure 13.3
friendship 13.1
bugle 12.4
body 12
together 11.4
sand 11.3
youth 11.1
portrait 11
black 10.8
group 10.5
standing 10.4
training 10.2
joy 10
world 10
travel 9.8
women 9.5
play 9.5
friends 9.4
energy 9.2
girls 9.1
attractive 9.1
health 9
vacation 9
grass 8.7
boy 8.7
run 8.7
holiday 8.6
party 8.6
dusk 8.6
life 8.5
evening 8.4
shore 8.4
action 8.3
human 8.2
freedom 8.2
landscape 8.2
recreation 8.1
activity 8.1
smiling 7.9
model 7.8
practice 7.7
outside 7.7
running 7.7
athletic 7.7
hand 7.6
enjoying 7.6
healthy 7.6
fashion 7.5
relaxation 7.5
child 7.4
teacher 7.3
sun 7.2
sexy 7.2
coast 7.2
romantic 7.1
family 7.1
day 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

person 99.6
posing 99.6
clothing 95.5
text 92.8
smile 91.4
man 90.7
standing 86.8
old 83.2
group 82.7
player 75.4
team 52.3

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Sad 45.9%
Angry 45.4%
Calm 51.3%
Confused 45.4%
Disgusted 45.3%
Happy 46.2%
Surprised 45.4%

AWS Rekognition

Age 26-43
Gender Female, 61%
Happy 70.4%
Calm 15.6%
Angry 2.5%
Surprised 4.9%
Disgusted 1.4%
Confused 2.6%
Sad 2.6%

AWS Rekognition

Age 26-43
Gender Male, 52.2%
Disgusted 45.1%
Sad 45.7%
Confused 45.4%
Happy 52.4%
Angry 45.3%
Surprised 45.2%
Calm 45.8%

AWS Rekognition

Age 26-43
Gender Male, 53.1%
Sad 46.4%
Angry 45.7%
Calm 49%
Confused 45.6%
Disgusted 45.4%
Happy 47%
Surprised 45.9%

AWS Rekognition

Age 26-43
Gender Female, 52.5%
Disgusted 45.2%
Calm 48.5%
Angry 45.5%
Sad 49.6%
Happy 45.5%
Surprised 45.4%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 95.6%
Confused 4%
Surprised 5.9%
Angry 4.5%
Calm 14.6%
Disgusted 1.9%
Sad 6.2%
Happy 62.9%

AWS Rekognition

Age 20-38
Gender Male, 54.5%
Happy 45.2%
Disgusted 45.1%
Angry 45.4%
Surprised 45.2%
Sad 45.4%
Calm 53.6%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50.8%
Calm 45.5%
Surprised 45.2%
Disgusted 45.1%
Happy 53.9%
Sad 45.1%
Confused 45.1%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Male, 51.7%
Confused 45.2%
Angry 45.3%
Sad 45.2%
Calm 45.6%
Disgusted 45.3%
Happy 52.7%
Surprised 45.6%

AWS Rekognition

Age 23-38
Gender Female, 55%
Confused 45.4%
Happy 45.6%
Surprised 45.6%
Angry 45.2%
Disgusted 45.2%
Calm 51.4%
Sad 46.6%

Feature analysis

Amazon

Person 99.8%
Helmet 65.6%

Captions

Microsoft

a group of people posing for a photo 97.8%
a vintage photo of a group of people posing for the camera 96.8%
a vintage photo of a group of people posing for a picture 96.7%