Human Generated Data

Title

Untitled (studio portrait of four young girls with matching veils and dresses, clasping hands with rosaries)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3804

Human Generated Data

Title

Untitled (studio portrait of four young girls with matching veils and dresses, clasping hands with rosaries)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.6
Human 99.6
Person 99.2
Clothing 99.1
Apparel 99.1
Person 98.7
Person 98.2
Female 91.9
Shoe 91.9
Footwear 91.9
Shorts 91.5
Shoe 82.6
Shoe 81.5
Shoe 79.1
Dress 77
Girl 75.3
Accessory 73.7
Accessories 73.7
Woman 70.9
Glasses 58.5
Costume 58.3
People 56.7
Shoe 55.4

Clarifai
created on 2019-06-01

people 99.8
adult 97.8
woman 97.1
wear 96.7
group 96.6
man 93
group together 90.4
outfit 89
portrait 86.8
leader 84.8
administration 84.3
monochrome 83.9
many 79.7
one 79.4
two 79.1
three 78.8
child 77.9
movie 77.2
veil 76.5
four 76.3

Imagga
created on 2019-06-01

clothing 28.8
robe 23.3
people 21.7
garment 21.2
man 18.8
dress 17.2
covering 17
fashion 16.6
person 16
women 15.8
black 15.4
business 14.6
adult 14.3
world 14
kin 13.7
male 13.5
religion 13.4
bag 13.3
portrait 12.9
old 12.5
art 12
walking 11.4
clothes 11.2
jacket 11
history 10.7
group 10.5
building 10.3
culture 10.2
costume 9.9
face 9.9
cloak 9.7
couple 9.6
standing 9.6
plastic bag 9.4
two 9.3
attractive 9.1
urban 8.7
happiness 8.6
faith 8.6
architecture 8.6
store 8.5
monument 8.4
traditional 8.3
city 8.3
street 8.3
alone 8.2
style 8.2
outfit 8
travel 7.7
men 7.7
outdoor 7.6
happy 7.5
shop 7.5
vintage 7.4
holding 7.4
church 7.4
consumer goods 7.4
girls 7.3
container 7.3
tourist 7.3
boutique 7.2
color 7.2
catholic 7.2
life 7.1
businessman 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

wall 95.4
clothing 93
dress 88.8
person 85.4
woman 84
black and white 83.2
smile 72.6
fashion 68.2
footwear 54.9

Face analysis

Amazon

AWS Rekognition

Age 57-77
Gender Female, 50.2%
Confused 45.2%
Sad 46.6%
Calm 48.8%
Happy 47.4%
Surprised 45.6%
Disgusted 45.6%
Angry 45.8%

AWS Rekognition

Age 16-27
Gender Male, 53.7%
Disgusted 45%
Sad 45.8%
Calm 53.3%
Confused 45.2%
Surprised 45.1%
Happy 45.3%
Angry 45.2%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Disgusted 46.4%
Sad 46.1%
Happy 46%
Surprised 45.5%
Calm 50.3%
Angry 45.3%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Angry 45.3%
Sad 45.9%
Happy 47.3%
Calm 49%
Confused 45.5%
Disgusted 45.5%
Surprised 46.4%

Feature analysis

Amazon

Person 99.6%
Shoe 91.9%

Captions

Microsoft

a group of men posing for a photo 83.4%
a group of people posing for a photo 83.3%
a group of men posing for a picture 83.2%

Text analysis

Amazon

HJJT