Human Generated Data

Title

Untitled (two girls petting deer)
Date

c. 1955
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8013
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two girls petting deer)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 97.3
Human 97.3
Deer 96.7
Mammal 96.7
Animal 96.7
Wildlife 96.7
Person 94.4
Cow 84.3
Cattle 84.3
Impala 83.9
Elk 80
Horse 78.8
Horse 72.4
Antelope 61.7
Cow 56.5
Person 43.7

Imagga
created on 2022-01-09

horse 23.6
carriage 21.9
landscape 15.6
vaulting horse 14.7
silhouette 14.1
sun 13.7
dark 13.4
old 13.2
outdoor 13
people 12.8
park 11.8
man 11.4
ride 10.8
sunset 10.8
travel 10.6
gymnastic apparatus 10.2
black 10.2
sky 10.2
balcony 10.1
light 10
water 10
building 9.8
carousel 9.7
outdoors 9.4
structure 9
forest 8.7
evening 8.4
mammal 8
night 8
tree 7.9
adult 7.9
summer 7.7
vintage 7.4
person 7.4
camel 7.4
brown 7.4
transport 7.3
scenery 7.2
history 7.2
rural 7

Google
created on 2022-01-09

Tree 88.9
Working animal 87.4
Deer 84.8
Plant 83.3
Fawn 81.6
Art 79.3
Adaptation 79.3
Monochrome 73.8
Monochrome photography 73.1
Painting 72.6
Pack animal 71
Terrestrial animal 68.3
Recreation 68.1
Visual arts 65.9
Vintage clothing 65.1
Canidae 64.8
Landscape 63.1
History 62.9
Illustration 62.8
Herd 62.3

Microsoft
created on 2022-01-09

tree 99.8
outdoor 99.1
text 97.7
animal 92.6
dog 82.9
deer 68.9
old 66.6
black and white 60.6
drawing 59.5
horse-drawn vehicle 53.2

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 100%
Happy 95.5%
Surprised 2.6%
Calm 1.5%
Fear 0.1%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.3%
Cow 84.3%
Horse 78.8%
Antelope 61.7%

Captions

Microsoft

a group of people standing in front of a horse 94.1%
a group of people standing next to a horse 94%
a group of people riding on the back of a horse 89.7%

Text analysis

Amazon

SOUTH
SOUTH POLI
POLI

Google

K 3-42人--EI「W
K
3-42
人
--EI
「
W