Human Generated Data

Title

Untitled (officials looking at remains of a building fire)

Date

1957

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18669

Human Generated Data

Title

Untitled (officials looking at remains of a building fire)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1957

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.5
Person 99.5
Person 99.3
Person 99.1
Person 98.7
Person 97.8
Soil 93.4
Ground 92.7
Outdoors 78.5
Clothing 77
Apparel 77
Nature 72
People 63.6
Rubble 60.7
Road 59.9
Archaeology 57
Duel 55.8

Imagga
created on 2022-03-05

beach 20.5
sky 19.8
water 18.7
man 17.5
summer 16.7
sand 16.5
sea 16.4
sun 16.1
people 15.6
ocean 14.9
landscape 14.9
outdoors 14.4
cemetery 13.9
rock 13.9
travel 13.4
person 13
picket fence 12.9
sunset 12.6
outdoor 12.2
male 12.1
two 11.9
silhouette 11.6
groom 11.4
stone 11.3
old 11.1
adult 11.1
love 11.1
happiness 11
tree 11
light 10.8
mountain 10.7
structure 10.5
couple 10.5
men 10.3
fence 10.1
park 9.9
art 9.8
life 9.7
kin 9.7
black 9.6
forest 9.6
walking 9.5
outside 9.4
grunge 9.4
holiday 9.3
vintage 9.1
dress 9
vacation 9
sunlight 8.9
happy 8.8
sunny 8.6
sunrise 8.4
hill 8.4
relaxation 8.4
coast 8.1
standing 7.8
barrier 7.8
child 7.7
joy 7.5
earth 7.4
gravestone 7.3
smiling 7.2
morning 7.2
lifestyle 7.2
recreation 7.2
women 7.1
trees 7.1
bride 7.1
amaranth 7
autumn 7

Google
created on 2022-03-05

Plant 86.3
Grass 81.8
Adaptation 79.3
Hat 79.3
Font 77.7
Art 75.9
Vintage clothing 73.9
Monochrome photography 72.9
Tree 71.3
Landscape 71.2
Monochrome 71.1
Visual arts 66.9
Event 66.7
Soil 64.4
History 63.2
Plantation 63
Photographic paper 59.8
Room 57.3
Illustration 56.6
Paper product 55.3

Microsoft
created on 2022-03-05

text 95.6
outdoor 92.3
clothing 91.9
man 91.6
person 89.8
black and white 83
water 63
old 49.1

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Male, 98.4%
Calm 94.2%
Angry 1.5%
Sad 1.3%
Surprised 1%
Confused 0.9%
Happy 0.4%
Disgusted 0.4%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people standing in front of a building 77.4%
an old photo of a group of people standing in front of a building 72.3%
a group of people standing outside of a building 72.2%