Human Generated Data

Title

Untitled (man dressed as Santa Claus with children on sleigh)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15630.2

Human Generated Data

Title

Untitled (man dressed as Santa Claus with children on sleigh)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 99.1
Human 99.1
Person 98.4
Art 86.8
Clothing 81.4
Apparel 81.4
Person 78.8
Painting 70.8
Chair 69.5
Furniture 69.5
Sled 55.8

Imagga
created on 2022-02-05

comic book 36.1
billboard 29.6
signboard 23.1
structure 20
people 18.4
book jacket 17.9
person 17.6
design 15.2
silhouette 14.9
jacket 14.9
print media 14.5
art 14
black 13.2
symbol 12.8
grunge 12.8
old 11.8
paint 11.8
drawing 11.7
newspaper 11.6
vintage 11.6
man 11.4
male 11.3
style 11.1
product 11
wrapping 10.6
decoration 10.4
business 10.3
icon 10.3
crowd 9.6
flag 9.5
lights 9.3
painting 9
pattern 8.9
group 8.9
cheering 8.8
nighttime 8.8
audience 8.8
stadium 8.8
vibrant 8.8
covering 8.6
patriotic 8.6
wall 8.5
nation 8.5
city 8.3
sport 8.2
retro 8.2
creation 8.1
bass 8
postmark 7.9
urban 7.9
musical 7.7
mail 7.7
sky 7.7
computer 7.6
house 7.5
vivid 7.4
building 7.4
glowing 7.4
letter 7.3
work 7.3
color 7.2
music 7.2
musician 7.2
colorful 7.2
game 7
travel 7

Google
created on 2022-02-05

Tree 84.9
Window 84.9
Art 81.5
Adaptation 79.4
Tints and shades 77.3
Happy 76.6
Lap 71.8
Rectangle 70.6
Vintage clothing 69.7
Visual arts 68.6
Event 68.3
Chair 67.2
Painting 66
Photo caption 64.3
Room 63.3
Magenta 62.1
Square 60.1
Conversation 59.4
Sitting 58.5
Illustration 57.9

Microsoft
created on 2022-02-05

text 99.3
furniture 88.9
chair 76.1
painting 70
clothing 63.6
person 61.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 61-71
Gender Male, 100%
Calm 42.5%
Confused 37%
Angry 9.3%
Happy 4.2%
Disgusted 3.9%
Sad 1.3%
Fear 0.9%
Surprised 0.8%

AWS Rekognition

Age 31-41
Gender Female, 80.4%
Calm 54.5%
Angry 28.2%
Happy 7.3%
Sad 6.2%
Surprised 1.5%
Disgusted 0.9%
Confused 0.7%
Fear 0.6%

Microsoft Cognitive Services

Age 71
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 70.8%
Chair 69.5%

Captions

Microsoft

a group of stuffed animals 30%
a group of people sitting in a chair 29.9%
a group of people sitting in chairs 29.8%

Text analysis

Amazon

E
MAGON
EIFW
EIRW
LEAL

Google

KODVK
KODVK