Human Generated Data

Title

Untitled (studio portrait of three children with the smallest child in a wheeled carriage)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3711

Human Generated Data

Title

Untitled (studio portrait of three children with the smallest child in a wheeled carriage)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Clothing 99.5
Apparel 99.5
Human 99.4
Person 99.4
Person 99
Person 99
Hat 84.9
Bonnet 84.9
Face 83.6
Baby 75.1
Portrait 60.7
Photo 60.7
Photography 60.7
Smile 58
Furniture 56.7

Clarifai
created on 2019-06-01

people 99.5
child 97.9
man 95.7
woman 95.4
two 94.9
adult 94.9
family 93.6
veil 93.4
wear 90
indoors 89.4
lid 84.2
fun 83
love 81.4
portrait 81.2
group 80.2
vehicle 77.2
sit 76.3
three 71.5
actor 70.6
boy 70.1

Imagga
created on 2019-06-01

sibling 33.1
people 22.3
child 21.5
shopping 21.3
person 20.6
holiday 17.2
kin 17
happy 15.7
cheerful 15.4
sketch 15.1
adult 14.9
happiness 14.1
mother 13.8
celebration 13.5
human 13.5
portrait 12.9
cart 12.7
drawing 12.6
love 12.6
negative 12.5
man 12.1
sale 12
male 11.4
gift 11.2
smiling 10.8
film 10.8
health 10.4
buy 10.3
women 10.3
day 10.2
representation 10
joy 10
face 9.9
fun 9.7
medical 9.7
one 9.7
couple 9.6
shop 9.5
sitting 9.4
men 9.4
cute 9.3
smile 9.3
dress 9
childhood 8.9
clothing 8.9
decoration 8.7
lifestyle 8.7
winter 8.5
pretty 8.4
cap 8.3
fashion 8.3
snow 8.2
present 8.2
grandfather 8.2
symbol 8.1
science 8
kid 8
business 7.9
basket 7.9
trolley 7.9
boy 7.8
angel 7.8
supermarket 7.8
toddler 7.6
photographic paper 7.6
store 7.6
togetherness 7.5
blond 7.5
holding 7.4
baby 7.4
lady 7.3
year 7.3
hair 7.1
family 7.1
market 7.1
little 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

clothing 96.6
human face 96.5
person 95.8
outdoor 95.2
baby 93.9
toddler 91.5
old 89.7
child 89.1
posing 89
black 75.5
black and white 65.9
smile 63.6
boy 55.3
vintage 28.6

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 92%
Angry 0.6%
Confused 1.1%
Surprised 0.6%
Happy 1.1%
Sad 0.6%
Calm 95.1%
Disgusted 0.8%

AWS Rekognition

Age 26-43
Gender Male, 94.6%
Sad 12.2%
Angry 2.5%
Calm 71.9%
Confused 4.7%
Disgusted 2.4%
Happy 2%
Surprised 4.3%

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a vintage photo of a man and woman posing for a picture 84.4%
a vintage photo of a man and a woman posing for a picture 84.3%
a vintage photo of a man and a woman posing for a photo 82.9%