Human Generated Data

Title

Untitled (man dressed as Santa Claus with reindeer)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15629.1

Human Generated Data

Title

Untitled (man dressed as Santa Claus with reindeer)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 99.8
Human 99.8
Person 97.9
Horse 91.5
Mammal 91.5
Animal 91.5

Imagga
created on 2022-02-05

caribou 57.1
deer 49.1
horse 43.6
horse cart 30.7
cart 25.4
carriage 23.5
wagon 21.7
horses 20.4
equine 18.7
rope 17.3
camel 16.7
farm 16
rural 15.8
brown 14.7
bridle 13.5
outdoors 13.4
rider 12.8
ride 12.6
wheeled vehicle 12.2
field 11.7
animals 11.1
equestrian 10.8
stallion 10.8
riding 10.7
sport 10.7
old 10.4
line 10.1
cowboy 10
ranch 9.6
vehicle 9.6
grass 9.5
head 9.2
outdoor 9.2
wild 8.7
mule 8.6
sky 8.3
fun 8.2
bull 8.1
person 8
mare 7.8
summer 7.7
culture 7.7
harness 7.6
saddle 7.5
landscape 7.4
dry 7.4
competition 7.3
countryside 7.3
teenager 7.3
plow 7.3
people 7.2
color 7.2
meadow 7.2
team 7.2
ungulate 7.1
wildlife 7.1
crab 7.1

Google
created on 2022-02-05

Photograph 94.2
Sky 91.5
Organism 86.7
Working animal 86.4
Adaptation 79.3
Landscape 76.4
Wheel 76
Pack animal 75.4
Bridle 74.6
Snapshot 74.3
Rein 71.9
Horse tack 71.4
Art 70.8
Event 70.4
Travel 68
Stock photography 65.7
Livestock 65.4
Horn 64.6
Visual arts 63.7
Fun 61.8

Microsoft
created on 2022-02-05

text 99.3
horse 97.6
outdoor 86.5
animal 72
desert 66.1
person 62.2
camel 53.6

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 95.2%
Sad 81.8%
Calm 6.4%
Fear 3.7%
Happy 3.1%
Disgusted 2%
Angry 1.9%
Confused 0.6%
Surprised 0.4%

AWS Rekognition

Age 51-59
Gender Male, 100%
Calm 65.6%
Sad 10.8%
Happy 6.7%
Confused 4.1%
Fear 3.9%
Angry 3.9%
Disgusted 3.5%
Surprised 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Horse 91.5%

Captions

Microsoft

a man riding a horse 78.6%
a screen shot of a man riding a horse 78.5%
a man riding on the back of a horse 73.9%

Text analysis

Amazon

I
BIFW
NAGON

Google

KODVK
KODVK 2.VLELA
2.VLELA