Human Generated Data

Title

Untitled (two photographs: studio portrait of three people in costumes without masks; studio portrait of three people in costumes with masks)

Date

c. 1905-1915, printed c. 1970

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5986

Human Generated Data

Title

Untitled (two photographs: studio portrait of three people in costumes without masks; studio portrait of three people in costumes with masks)

People

Artist: Durette Studio, American 20th century

Date

c. 1905-1915, printed c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Clothing 99.5
Apparel 99.5
Human 99.3
Person 99.3
Person 99.2
Person 98.9
Person 98.9
Person 97.7
Person 97
Sleeve 93.8
Overcoat 88.2
Coat 88.2
Stage 88.2
Long Sleeve 76.8
Suit 73.3
Footwear 67.6
Shoe 67.6
People 62.6
Shoe 62.2
Crowd 60.8
Fashion 58.3
Flooring 57.3
Face 56.1
Shorts 56

Clarifai
created on 2019-11-16

people 99.7
group 97.9
wear 97.4
woman 97.2
adult 95
group together 95
many 94.8
music 93.1
man 92.9
model 89.1
wedding 88.1
dress 87.9
fashion 87.5
monochrome 86.8
collection 84.8
child 84.4
outfit 84.3
stage 84.3
stump 84.2
several 82.7

Imagga
created on 2019-11-16

man 31.8
people 30.1
male 27
person 25.7
silhouette 25.7
business 24.3
group 23.4
men 23.2
businessman 22.9
world 20.9
adult 17.4
city 15.8
human 15.7
crowd 14.4
urban 14
women 13.4
walk 12.4
walking 12.3
success 12.1
suit 12
black 11.9
corporate 11.2
sport 11
team 10.7
job 10.6
together 10.5
professional 10.4
teamwork 10.2
player 10.2
clothing 10
dark 10
musical instrument 9.6
executive 9.2
travel 9.1
boy 9.1
worker 8.9
office 8.8
life 8.7
move 8.6
athlete 8.4
occupation 8.2
pose 8.1
shadow 8.1
working 7.9
work 7.8
couple 7.8
portrait 7.8
performer 7.7
employee 7.6
outdoor 7.6
fun 7.5
manager 7.4
street 7.4
looking 7.2
body 7.2
sunset 7.2
celebration 7.2
activity 7.2
posing 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

clothing 98.2
person 98.2
man 97.3
text 95.3
black and white 81.1
footwear 80.9
standing 77.2
gallery 76.8
drawing 72.3
sketch 65.7
group 64.3
posing 63.5
old 61.1
cartoon 60.3
abstract 55.7
room 51.8

Face analysis

Amazon

AWS Rekognition

Age 23-37
Gender Male, 53%
Calm 47.2%
Disgusted 45%
Happy 45%
Fear 45.1%
Confused 45%
Angry 45.1%
Surprised 45%
Sad 52.5%

AWS Rekognition

Age 18-30
Gender Female, 54.7%
Sad 45%
Surprised 45%
Angry 45%
Confused 45%
Fear 45%
Happy 45%
Calm 55%
Disgusted 45%

AWS Rekognition

Age 20-32
Gender Female, 54.5%
Surprised 45.3%
Fear 45.2%
Disgusted 45.5%
Calm 51.1%
Angry 45.4%
Confused 45.2%
Happy 46.9%
Sad 45.4%

AWS Rekognition

Age 35-51
Gender Female, 51.3%
Angry 45.9%
Disgusted 45.4%
Surprised 45.9%
Fear 45.3%
Confused 45.2%
Happy 47.5%
Sad 45.2%
Calm 49.6%

AWS Rekognition

Age 19-31
Gender Female, 50.1%
Disgusted 45%
Happy 45%
Angry 45.6%
Confused 45.2%
Calm 45.7%
Fear 47.9%
Sad 50.5%
Surprised 45.1%

AWS Rekognition

Age 2-8
Gender Female, 50.3%
Angry 45%
Sad 54.8%
Confused 45%
Surprised 45%
Happy 45%
Disgusted 45%
Calm 45.1%
Fear 45%

Feature analysis

Amazon

Person 99.3%
Shoe 67.6%

Captions

Microsoft

a group of people posing for a photo 91.9%
a group of people posing for a picture 91.8%
an old photo of a group of people posing for a picture 91.1%