Human Generated Data

Title

Untitled (studio portrait of family with man seated holding cigar and two boys in soldiers uniforms)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3806

Human Generated Data

Title

Untitled (studio portrait of family with man seated holding cigar and two boys in soldiers uniforms)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.4
Human 99.4
Apparel 99.3
Shoe 99.3
Footwear 99.3
Clothing 99.3
Person 99.2
Person 99
Person 97.9
Sailor Suit 96.1
Shoe 95
Shoe 94.9
Shorts 80.9
Sleeve 68.5
Hat 67.5
Officer 56.1
Military 56.1
Military Uniform 56.1

Clarifai
created on 2019-06-01

people 99.8
adult 98.3
wear 96.4
man 96.4
group together 94.7
two 94.5
leader 94
group 93.2
three 92.7
administration 92.3
woman 90.8
several 89.8
five 89.1
four 86.2
one 86.2
military 85.7
many 83.7
outfit 83.7
uniform 83.6
veil 83.2

Imagga
created on 2019-06-01

helmet 28
nurse 20
clothing 19.4
armor plate 17.8
people 17.3
man 16.8
male 16.3
statue 15.6
person 15.2
military uniform 15.1
uniform 14.5
old 12.5
black 12
travel 12
plate 11.9
city 11.6
tourism 11.5
brass 11.3
men 11.2
adult 11.1
history 10.7
medical 10.6
art 10.5
monument 10.3
sculpture 10
coat 9.9
religion 9.8
soldier 9.8
chemical 9.6
historical 9.4
worker 9.1
negative 9
mask 8.9
ancient 8.6
wind instrument 8.6
architecture 8.6
world 8.5
vintage 8.3
historic 8.2
team 8.1
business 7.9
astronaut 7.9
work 7.8
scientist 7.8
professional 7.8
antique 7.8
instrument 7.8
chemistry 7.7
military 7.7
laboratory 7.7
shop 7.7
culture 7.7
human 7.5
building 7.3
group 7.2
tourist 7.2
film 7.2
national 7.2
case 7.2
dress 7.2
medicine 7

Google
created on 2019-06-01

Photograph 96.9
Snapshot 87.2
Standing 85.3
Uniform 69.5
Photography 62.4
Family 53.1

Microsoft
created on 2019-06-01

clothing 97.6
person 88.6
black and white 73.9
smile 71.4
man 68.3
posing 55.9
hat 52.4
old 43.2

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Male, 51.8%
Happy 45.2%
Surprised 45.1%
Angry 45.1%
Confused 45.1%
Calm 52.9%
Sad 46.5%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Disgusted 45.2%
Calm 51.8%
Surprised 45.2%
Angry 45.2%
Happy 45.1%
Sad 47.3%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 51.9%
Disgusted 45.2%
Sad 45.7%
Calm 53.5%
Confused 45.1%
Surprised 45.2%
Happy 45.3%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Female, 54.1%
Sad 48.2%
Calm 49.9%
Surprised 45.4%
Angry 45.3%
Disgusted 45.3%
Happy 45.5%
Confused 45.3%

Feature analysis

Amazon

Person 99.4%
Shoe 99.3%

Captions

Microsoft

a group of people posing for a photo 90.5%
a group of people posing for a picture 90.4%
a group of people posing for the camera 90.3%